2024-09-13T18:25:18.843 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T18:25:18.867 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:25:18.962 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991 branch: wip-rishabh-testing-20240910.100730-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} email: null first_in_suite: false job_id: '7903991' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240910.100730-reef ceph: cephfs: ec_profile: - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240910.100730-reef sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6439 sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 sleep_before_teardown: 0 subset: 964/1024 suite: fs suite_branch: wip-rishabh-testing-20240910.100730-reef suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+FKXfHyDAI388pAzNkG9iN/+a6FlEr/n7nD5kIo66Dd++5mTFFvMJ1PwTXkrS8SdawLNf3Feagw/suQMDDHas= smithi194.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQri4ZhPaft15AKHIODYXUxGJIy+tosH7V8FPugKotbayy7cJBiMk9KCskWFQMX67BNkBG0WGHb+0JeXP1wRDU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_14:42:16 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-13T18:25:18.962 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa; will attempt to use it 2024-09-13T18:25:18.963 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa/tasks 2024-09-13T18:25:18.963 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T18:25:18.965 INFO:teuthology.task.internal:Checking packages... 2024-09-13T18:25:18.987 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3' 2024-09-13T18:25:18.987 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T18:25:18.987 INFO:teuthology.packaging:ref: None 2024-09-13T18:25:18.987 INFO:teuthology.packaging:tag: None 2024-09-13T18:25:18.987 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:25:18.987 INFO:teuthology.packaging:sha1: 6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:25:18.987 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240910.100730-reef 2024-09-13T18:25:19.139 INFO:teuthology.task.internal:Found packages for ceph version 18.2.4-860.g6c6b083f 2024-09-13T18:25:19.141 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T18:25:19.147 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T18:25:19.147 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T18:25:19.164 INFO:teuthology.task.internal:Saving configuration 2024-09-13T18:25:19.195 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T18:25:19.207 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T18:25:19.245 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:20:20.024056', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+FKXfHyDAI388pAzNkG9iN/+a6FlEr/n7nD5kIo66Dd++5mTFFvMJ1PwTXkrS8SdawLNf3Feagw/suQMDDHas='} 2024-09-13T18:25:19.278 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi194.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 18:20:20.026021', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQri4ZhPaft15AKHIODYXUxGJIy+tosH7V8FPugKotbayy7cJBiMk9KCskWFQMX67BNkBG0WGHb+0JeXP1wRDU='} 2024-09-13T18:25:19.278 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T18:25:19.285 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-13T18:25:19.285 INFO:teuthology.task.internal:roles: ubuntu@smithi194.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-13T18:25:19.285 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T18:25:19.384 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff1d0490d30>, signals=[15]) 2024-09-13T18:25:19.384 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T18:25:19.390 INFO:teuthology.task.internal:Opening connections... 2024-09-13T18:25:19.391 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:25:19.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:25:19.514 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:25:19.515 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:25:19.605 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T18:25:19.614 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-13T18:25:19.632 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-13T18:25:19.632 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-13T18:25:19.689 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:25:19.690 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:25:19.691 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-13T18:25:19.724 DEBUG:teuthology.orchestra.run.smithi194:> uname -m 2024-09-13T18:25:19.744 INFO:teuthology.orchestra.run.smithi194.stdout:x86_64 2024-09-13T18:25:19.744 DEBUG:teuthology.orchestra.run.smithi194:> cat /etc/os-release 2024-09-13T18:25:19.815 INFO:teuthology.orchestra.run.smithi194.stdout:NAME="CentOS Stream" 2024-09-13T18:25:19.815 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION="9" 2024-09-13T18:25:19.815 INFO:teuthology.orchestra.run.smithi194.stdout:ID="centos" 2024-09-13T18:25:19.815 INFO:teuthology.orchestra.run.smithi194.stdout:ID_LIKE="rhel fedora" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:VERSION_ID="9" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:PLATFORM_ID="platform:el9" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:ANSI_COLOR="0;31" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:LOGO="fedora-logo-icon" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:HOME_URL="https://centos.org/" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T18:25:19.816 INFO:teuthology.orchestra.run.smithi194.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T18:25:19.817 INFO:teuthology.lock.ops:Updating smithi194.front.sepia.ceph.com on lock server 2024-09-13T18:25:19.849 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T18:25:19.911 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T18:25:19.937 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T18:25:19.937 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:25:19.950 DEBUG:teuthology.orchestra.run.smithi194:> test '!' -e /home/ubuntu/cephtest 2024-09-13T18:25:19.995 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T18:25:20.273 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T18:25:20.273 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:25:20.280 DEBUG:teuthology.orchestra.run.smithi194:> test -z $(ls -A /var/lib/ceph) 2024-09-13T18:25:20.393 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T18:25:21.387 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T18:25:21.555 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-13T18:25:21.556 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-13T18:25:21.556 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-13T18:25:21.556 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:25:21.557 DEBUG:teuthology.orchestra.run.smithi194:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T18:25:21.574 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:25:21.574 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T18:25:21.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:25:21.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-09-13T18:25:21.745 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:21.745 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:25:21.746 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-13T18:25:21.763 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:25:21.764 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:21.764 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:25:21.765 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum upgrade -y linux-firmware 2024-09-13T18:25:21.767 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:21.767 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-13T18:25:21.767 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-13T18:25:21.785 INFO:teuthology.orchestra.run.smithi194.stdout:5.14.0-503.el9.x86_64 2024-09-13T18:25:21.785 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-503.el9.x86_64 vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:21.785 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-13T18:25:21.786 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum upgrade -y linux-firmware 2024-09-13T18:25:24.172 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T18:25:25.311 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-13T18:25:27.665 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-09-13T18:25:30.228 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 5.4 MB/s | 20 MB 00:03 2024-09-13T18:25:33.440 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.5 MB 00:01 2024-09-13T18:25:34.882 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 19 kB 00:00 2024-09-13T18:25:35.395 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.5 MB 00:01 2024-09-13T18:25:35.661 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-13T18:25:36.938 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-13T18:25:37.984 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-13T18:25:41.126 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-13T18:25:43.256 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-13T18:25:43.257 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-13T18:25:43.257 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-13T18:25:43.357 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:25:43.357 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:43.518 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T18:25:43.518 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T18:25:43.521 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi192.front.sepia.ceph.com to complete... 2024-09-13T18:25:43.672 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-13T18:25:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-13T18:25:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:Nothing to do. 2024-09-13T18:25:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-13T18:25:45.915 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:25:45.916 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-13T18:25:46.067 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ 2024-09-13T18:25:46.068 DEBUG:teuthology.orchestra.run.smithi194:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/ --input-file=- 2024-09-13T18:25:46.070 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi194.front.sepia.ceph.com to complete... 2024-09-13T18:25:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13 18:25:52 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T18:25:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:FINISHED --2024-09-13 18:25:52-- 2024-09-13T18:25:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:Total wall clock time: 8.6s 2024-09-13T18:25:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:Downloaded: 1 files, 343M in 8.3s (41.2 MB/s) 2024-09-13T18:25:52.168 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-13T18:25:52.168 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T18:25:54.454 INFO:teuthology.orchestra.run.smithi192.stdout:Verifying... ######################################## 2024-09-13T18:25:54.643 INFO:teuthology.orchestra.run.smithi192.stdout:Preparing... ######################################## 2024-09-13T18:25:54.753 INFO:teuthology.orchestra.run.smithi192.stdout:Updating / installing... 2024-09-13T18:25:55.769 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13 18:25:55 URL:https://3.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/centos/9/flavors/default/x86_64/kernel-6.11.0_rc5_g2ca44a2f35ca-1.x86_64.rpm [359633503/359633503] -> "/tmp/kernel.x86_64.rpm" [1] 2024-09-13T18:25:55.769 INFO:teuthology.orchestra.run.smithi194.stderr:FINISHED --2024-09-13 18:25:55-- 2024-09-13T18:25:55.769 INFO:teuthology.orchestra.run.smithi194.stderr:Total wall clock time: 9.7s 2024-09-13T18:25:55.770 INFO:teuthology.orchestra.run.smithi194.stderr:Downloaded: 1 files, 343M in 9.3s (37.0 MB/s) 2024-09-13T18:25:55.772 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-13T18:25:55.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-09-13T18:25:57.902 INFO:teuthology.orchestra.run.smithi194.stdout:Verifying... ######################################## 2024-09-13T18:25:58.067 INFO:teuthology.orchestra.run.smithi194.stdout:Preparing... ######################################## 2024-09-13T18:25:58.182 INFO:teuthology.orchestra.run.smithi194.stdout:Updating / installing... 2024-09-13T18:26:02.725 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T18:26:06.142 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-6.11.0_rc5_g2ca44a2f35ca-1 ######################################## 2024-09-13T18:26:42.433 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T18:26:42.434 DEBUG:teuthology.orchestra.run.smithi192:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T18:26:42.525 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T18:26:42.526 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:26:42.527 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:26:42.528 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:26:42.529 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:26:42.530 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:26:42.531 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:26:42.532 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:26:42.533 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:26:42.534 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:26:42.535 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:26:42.536 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:26:42.537 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T18:26:42.538 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T18:26:42.539 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T18:26:42.540 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:26:42.541 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T18:26:42.542 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T18:26:42.543 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:26:42.544 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T18:26:42.545 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T18:26:42.546 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:26:42.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:26:42.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:26:42.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:26:42.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:26:42.547 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:26:42.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:26:42.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:26:42.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:26:42.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:26:42.548 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:26:42.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:26:42.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:26:42.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T18:26:42.549 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T18:26:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:26:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T18:26:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:26:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:26:42.550 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:26:42.551 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:26:42.552 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:26:42.553 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:26:42.554 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:26:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:26:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:26:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:26:42.555 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:26:42.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:26:42.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:26:42.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:26:42.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:26:42.556 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:26:42.557 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:26:42.558 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:26:42.559 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:26:42.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:26:42.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T18:26:42.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:26:42.560 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:26:42.561 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:26:42.562 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:26:42.563 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:26:42.564 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:26:42.565 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:26:42.566 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:26:42.567 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:26:42.568 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:26:42.569 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:26:42.570 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:26:42.571 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:26:42.572 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:26:42.573 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:26:42.574 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T18:26:42.575 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T18:26:42.576 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:26:42.577 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:26:42.578 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:26:42.579 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:26:42.580 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:26:42.581 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:26:42.582 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T18:26:42.583 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T18:26:42.584 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:26:42.585 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T18:26:42.586 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T18:26:42.587 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:26:42.588 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:26:42.589 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:26:42.590 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T18:26:42.591 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:26:42.592 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T18:26:42.593 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:26:42.594 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:26:42.595 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T18:26:42.596 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T18:26:42.597 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T18:26:42.598 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T18:26:42.599 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:26:42.600 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T18:26:42.601 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T18:26:42.602 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:26:42.603 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:26:42.604 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:26:42.605 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T18:26:42.606 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:26:42.607 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T18:26:42.608 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:26:42.609 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:26:42.610 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:26:42.611 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:26:42.612 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:26:42.613 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:26:42.614 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:26:42.615 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T18:26:42.616 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:26:42.617 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:26:42.618 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:26:42.619 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:26:42.620 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T18:26:42.621 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:26:42.622 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:26:42.623 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T18:26:42.624 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:26:42.625 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:26:42.626 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:26:42.627 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:26:42.628 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:26:42.629 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:26:42.630 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:26:42.631 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:26:42.632 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:26:42.633 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T18:26:42.634 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:26:42.635 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:26:42.636 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:26:42.637 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:26:42.638 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:26:42.639 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T18:26:42.640 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:26:42.641 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:26:42.642 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:26:42.643 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:26:42.644 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:26:42.645 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:26:42.646 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:26:42.647 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T18:26:42.648 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T18:26:42.649 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:26:42.650 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:26:42.651 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T18:26:42.652 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:26:42.653 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:26:42.654 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:26:42.655 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:26:42.656 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:26:42.657 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:26:42.658 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:26:42.659 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:26:42.660 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:26:42.661 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:26:42.662 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:26:42.663 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T18:26:42.664 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T18:26:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:26:42.666 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:26:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:26:42.668 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:26:42.669 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:26:42.670 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:26:42.671 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:26:42.672 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:26:42.673 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:26:42.674 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:26:42.675 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:26:42.676 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:26:42.677 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:26:42.678 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:26:42.679 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:26:42.680 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:26:42.681 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T18:26:42.682 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T18:26:42.683 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T18:26:42.684 INFO:teuthology.orchestra.run.smithi192.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:26:42.689 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.689 DEBUG:teuthology.orchestra.run.smithi192:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T18:26:42.711 INFO:teuthology.orchestra.run.smithi192.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T18:26:42.711 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:26:42.711 INFO:teuthology.orchestra.run.smithi192.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:for file in vmlinuz System.map config; do 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: fi 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:done 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2024-09-13T18:26:42.712 INFO:teuthology.orchestra.run.smithi192.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.713 INFO:teuthology.orchestra.run.smithi192.stdout:fi 2024-09-13T18:26:42.714 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-13T18:26:42.786 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-13T18:26:42.787 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:26:42.788 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:26:42.788 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:26:42.789 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:42.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:26:43.345 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-13T18:26:44.681 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:26:44.713 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-13T18:26:44.716 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-13T18:26:44.731 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.r9OBSMIsrI 2024-09-13T18:26:44.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.r9OBSMIsrI 2024-09-13T18:26:44.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.r9OBSMIsrI 2024-09-13T18:26:44.937 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.r9OBSMIsrI is 6KB 2024-09-13T18:26:44.986 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.r9OBSMIsrI 2024-09-13T18:26:45.001 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:26:45.069 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:26:45.070 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:26:45.070 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:26:45.070 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T18:26:45.071 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.241 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-13T18:26:45.561 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi194.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-09-13T18:26:45.561 DEBUG:teuthology.orchestra.run.smithi194:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-09-13T18:26:45.650 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.650 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.650 INFO:teuthology.orchestra.run.smithi194.stdout:/boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/System.map 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/config 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-13T18:26:45.651 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32c-intel.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-13T18:26:45.652 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-13T18:26:45.653 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-13T18:26:45.654 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-13T18:26:45.655 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecc.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ecdh_generic.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-13T18:26:45.656 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-13T18:26:45.657 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ata_generic.ko 2024-09-13T18:26:45.658 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-13T18:26:45.659 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-13T18:26:45.660 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-13T18:26:45.661 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sis.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-13T18:26:45.662 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-i2c.ko 2024-09-13T18:26:45.663 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/base/regmap/regmap-mmio.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/brd.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/loop.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-13T18:26:45.664 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/virtio_blk.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkfront.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-13T18:26:45.665 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-13T18:26:45.666 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis.ko 2024-09-13T18:26:45.667 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/uv_mmtimer.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/virtio_console.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/powernow-k8.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-13T18:26:45.668 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-13T18:26:45.669 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-13T18:26:45.670 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/edd.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio 2024-09-13T18:26:45.671 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-13T18:26:45.672 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-13T18:26:45.673 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-13T18:26:45.674 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-13T18:26:45.675 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-13T18:26:45.676 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-13T18:26:45.677 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-13T18:26:45.678 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-13T18:26:45.679 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-13T18:26:45.680 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-13T18:26:45.681 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-13T18:26:45.682 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-13T18:26:45.683 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-13T18:26:45.684 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-13T18:26:45.685 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-13T18:26:45.686 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-13T18:26:45.687 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-13T18:26:45.688 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-13T18:26:45.689 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-13T18:26:45.690 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-dev.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core 2024-09-13T18:26:45.691 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5 2024-09-13T18:26:45.692 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt 2024-09-13T18:26:45.693 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-13T18:26:45.694 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-13T18:26:45.695 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-13T18:26:45.696 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-13T18:26:45.697 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-13T18:26:45.698 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mfd-core.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-13T18:26:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-13T18:26:45.700 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-13T18:26:45.701 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-gru/gru.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xp.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpc.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding 2024-09-13T18:26:45.702 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-13T18:26:45.703 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-13T18:26:45.704 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-13T18:26:45.705 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna 2024-09-13T18:26:45.706 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic 2024-09-13T18:26:45.707 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-13T18:26:45.708 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e 2024-09-13T18:26:45.709 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-13T18:26:45.710 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel 2024-09-13T18:26:45.711 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-13T18:26:45.712 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-13T18:26:45.713 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc 2024-09-13T18:26:45.714 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-13T18:26:45.715 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv 2024-09-13T18:26:45.716 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-13T18:26:45.717 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/net_failover.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-13T18:26:45.718 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/dp83640.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-13T18:26:45.719 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_generic.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-13T18:26:45.720 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slhc.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tun.ko 2024-09-13T18:26:45.721 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/virtio_net.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netfront.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-13T18:26:45.722 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci 2024-09-13T18:26:45.723 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pcie/aer_inject.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-13T18:26:45.724 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-13T18:26:45.725 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-13T18:26:45.726 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras 2024-09-13T18:26:45.727 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-13T18:26:45.728 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-13T18:26:45.729 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-13T18:26:45.730 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-13T18:26:45.731 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi 2024-09-13T18:26:45.732 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r 2024-09-13T18:26:45.733 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic 2024-09-13T18:26:45.734 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-13T18:26:45.735 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas 2024-09-13T18:26:45.736 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-13T18:26:45.737 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-13T18:26:45.738 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-13T18:26:45.739 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-13T18:26:45.740 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-13T18:26:45.741 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio 2024-09-13T18:26:45.742 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image 2024-09-13T18:26:45.743 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-13T18:26:45.744 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy 2024-09-13T18:26:45.745 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-13T18:26:45.746 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-13T18:26:45.747 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-13T18:26:45.748 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-13T18:26:45.749 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-13T18:26:45.749 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-13T18:26:45.749 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-13T18:26:45.749 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-13T18:26:45.749 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-13T18:26:45.750 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-13T18:26:45.751 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-13T18:26:45.752 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_balloon.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_mmio.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-09-13T18:26:45.753 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/virtio/virtio_ring.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-13T18:26:45.754 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-13T18:26:45.755 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-13T18:26:45.756 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-acpi-processor.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-13T18:26:45.757 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-13T18:26:45.758 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm 2024-09-13T18:26:45.759 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ecryptfs/ecryptfs.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/fat.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/vfat.ko 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse 2024-09-13T18:26:45.760 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/fuse.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-13T18:26:45.761 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-13T18:26:45.762 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-13T18:26:45.763 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-13T18:26:45.764 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-13T18:26:45.765 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-13T18:26:45.766 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-13T18:26:45.767 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-13T18:26:45.768 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs 2024-09-13T18:26:45.769 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-13T18:26:45.770 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/rcu/rcutorture.ko 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib 2024-09-13T18:26:45.771 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/asn1_encoder.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libaescfb.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math 2024-09-13T18:26:45.772 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/zstd/zstd_compress.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-13T18:26:45.773 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-13T18:26:45.774 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-13T18:26:45.775 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-13T18:26:45.776 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-09-13T18:26:45.777 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/failover.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dns_resolver/dns_resolver.ko 2024-09-13T18:26:45.778 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-13T18:26:45.779 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-13T18:26:45.780 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-13T18:26:45.781 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-13T18:26:45.782 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-13T18:26:45.783 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-13T18:26:45.784 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-13T18:26:45.785 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-13T18:26:45.786 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-13T18:26:45.787 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-13T18:26:45.788 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-13T18:26:45.789 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-13T18:26:45.790 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-13T18:26:45.791 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-13T18:26:45.792 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-13T18:26:45.793 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_quota.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-13T18:26:45.794 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tunnel.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-13T18:26:45.795 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-13T18:26:45.796 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-13T18:26:45.797 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-13T18:26:45.798 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-13T18:26:45.799 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-13T18:26:45.800 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet 2024-09-13T18:26:45.801 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-13T18:26:45.802 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-13T18:26:45.803 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-13T18:26:45.804 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-13T18:26:45.805 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock 2024-09-13T18:26:45.806 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/security/keys/trusted-keys/trusted.ko 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-13T18:26:45.807 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-13T18:26:45.808 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-13T18:26:45.809 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-13T18:26:45.809 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-13T18:26:45.809 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.weakdep 2024-09-13T18:26:45.809 INFO:teuthology.orchestra.run.smithi194.stdout:/lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:26:45.812 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.812 DEBUG:teuthology.orchestra.run.smithi194:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:postinstall scriptlet (using /bin/sh): 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/bin/kernel-install add 6.11.0-rc5-g2ca44a2f35ca /lib/modules/6.11.0-rc5-g2ca44a2f35ca/vmlinuz 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:for file in vmlinuz System.map config; do 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout: if ! cmp --silent "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca"; then 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout: cp "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/${file}" "/boot/${file}-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout: fi 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:done 2024-09-13T18:26:45.837 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -d "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" ] && \ 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout: ! diff -rq "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" >/dev/null 2>&1; then 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout: rm -rf "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout: cp -r "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/dtb" "/boot/dtb-6.11.0-rc5-g2ca44a2f35ca" 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:if [ ! -e "/lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep" ]; then 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout: /usr/sbin/depmod 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:preuninstall scriptlet (using /bin/sh): 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:kernel-install remove 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.838 INFO:teuthology.orchestra.run.smithi194.stdout:fi 2024-09-13T18:26:45.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo rpm -qi grub2-tools 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Name : grub2-tools 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Epoch : 1 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Version : 2.06 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Release : 82.el9 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Architecture: x86_64 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Group : Unspecified 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:Size : 8274670 2024-09-13T18:26:45.920 INFO:teuthology.orchestra.run.smithi194.stdout:License : GPLv3+ 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Packager : builder@centos.org 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Vendor : CentOS 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Summary : Support tools for GRUB. 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:Description : 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T18:26:45.921 INFO:teuthology.orchestra.run.smithi194.stdout:hardware devices. 2024-09-13T18:26:45.922 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:26:45.922 INFO:teuthology.orchestra.run.smithi194.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T18:26:45.922 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T18:26:45.923 INFO:teuthology.task.kernel:Updating grub on smithi194 to boot 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:45.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T18:26:46.488 INFO:teuthology.orchestra.run.smithi194.stderr:Generating grub configuration file ... 2024-09-13T18:26:47.880 INFO:teuthology.orchestra.run.smithi194.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T18:26:47.909 INFO:teuthology.orchestra.run.smithi194.stderr:done 2024-09-13T18:26:47.911 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-13T18:26:47.926 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Kz9G7QBkZ6 2024-09-13T18:26:47.927 DEBUG:teuthology.orchestra.run.smithi194:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Kz9G7QBkZ6 2024-09-13T18:26:48.005 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Kz9G7QBkZ6 2024-09-13T18:26:48.146 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Kz9G7QBkZ6 is 6KB 2024-09-13T18:26:48.169 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Kz9G7QBkZ6 2024-09-13T18:26:48.189 DEBUG:teuthology.orchestra.run.smithi194:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T18:26:48.258 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T18:26:48.258 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T18:26:48.259 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T18:26:48.259 INFO:teuthology.orchestra.run.smithi194.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca.conf 2024-09-13T18:26:48.260 DEBUG:teuthology.orchestra.run.smithi194:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:26:48.402 DEBUG:teuthology.orchestra.run.smithi194:> sudo shutdown -r now 2024-09-13T18:27:15.269 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-13T18:27:15.270 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:27:15.271 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:18.409 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-13T18:27:18.409 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:27:18.410 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:33.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-13T18:27:36.897 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T18:27:42.825 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:27:42.826 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:45.889 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-13T18:27:45.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:27:45.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:27:48.961 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T18:27:57.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:27:57.898 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:28:00.965 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:28:00.965 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:28:16.321 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.192 2024-09-13T18:28:19.389 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.194 2024-09-13T18:28:31.329 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:28:31.330 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:28:31.675 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-13T18:28:32.221 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:28:32.221 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:28:32.222 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-13T18:28:32.256 INFO:teuthology.orchestra.run.smithi192.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:28:32.257 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:28:32.257 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:28:32.257 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:28:33.258 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:34.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:28:34.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:28:34.860 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-13T18:28:35.364 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:28:35.364 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-13T18:28:35.364 DEBUG:teuthology.orchestra.run.smithi194:> uname -r 2024-09-13T18:28:35.399 INFO:teuthology.orchestra.run.smithi194.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:28:35.399 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-13T18:28:35.399 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T18:28:35.399 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T18:28:36.402 DEBUG:teuthology.parallel:result is None 2024-09-13T18:28:36.402 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T18:28:36.410 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T18:28:36.410 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:28:36.414 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T18:28:36.449 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T18:28:36.455 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T18:28:36.463 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T18:28:36.463 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:28:36.491 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T18:28:36.532 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T18:28:36.538 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T18:28:36.539 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:28:36.568 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T18:28:36.691 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:28:36.712 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:28:36.745 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:28:36.806 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T18:28:36.810 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T18:28:36.817 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T18:28:36.817 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:28:36.821 DEBUG:teuthology.orchestra.run.smithi194:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T18:28:36.878 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T18:28:36.887 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T18:28:36.888 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:28:36.892 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T18:28:36.927 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:28:37.033 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:28:37.106 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:28:37.179 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:28:37.243 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:28:37.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:28:37.297 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:28:37.372 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T18:28:37.436 DEBUG:teuthology.orchestra.run.smithi194:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:28:37.505 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T18:28:37.573 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:28:37.573 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T18:28:37.669 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-13T18:28:37.672 DEBUG:teuthology.orchestra.run.smithi194:> sudo service rsyslog restart 2024-09-13T18:28:37.753 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:28:37.769 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:28:38.096 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T18:28:38.104 INFO:teuthology.task.internal:Starting timer... 2024-09-13T18:28:38.104 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T18:28:38.205 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T18:28:38.214 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-09-13T18:28:38.214 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-13T18:28:38.314 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-13T18:28:38.317 DEBUG:teuthology.orchestra.run.smithi194:> sudo service auditd rotate 2024-09-13T18:28:38.418 INFO:teuthology.orchestra.run.smithi194.stdout:Rotating logs: 2024-09-13T18:28:38.421 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T18:28:38.422 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-13T18:28:38.465 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-13T18:28:38.465 DEBUG:teuthology.orchestra.run.smithi194:> /usr/sbin/getenforce 2024-09-13T18:28:38.503 INFO:teuthology.orchestra.run.smithi194.stdout:Permissive 2024-09-13T18:28:38.504 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi192.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi194.front.sepia.ceph.com': 'permissive'} 2024-09-13T18:28:38.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:28:38.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:38.564 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:28:38.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:28:38.621 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T18:28:38.621 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:28:38.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo /usr/sbin/setenforce permissive 2024-09-13T18:28:38.816 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T18:28:38.826 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-13T18:28:38.830 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-13T18:28:38.990 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T18:28:39.000 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T18:28:39.001 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi192.front.sepia.ceph.com,smithi194.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T18:33:20.749 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi192.front.sepia.ceph.com'), Remote(name='ubuntu@smithi194.front.sepia.ceph.com')] 2024-09-13T18:33:20.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:33:20.752 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:20.853 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-13T18:33:20.921 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-13T18:33:20.921 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:33:20.922 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi194.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T18:33:21.017 DEBUG:teuthology.orchestra.run.smithi194:> true 2024-09-13T18:33:21.125 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi194.front.sepia.ceph.com' 2024-09-13T18:33:21.125 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T18:33:21.135 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T18:33:21.136 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:33:21.136 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:33:21.141 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T18:33:21.141 DEBUG:teuthology.orchestra.run.smithi194:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:33:21.201 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:33:21.226 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T18:33:21.231 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:33:21.256 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T18:33:21.282 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-13T18:33:21.306 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-13T18:33:21.307 INFO:teuthology.orchestra.run.smithi194.stderr:sudo: ntpd: command not found 2024-09-13T18:33:21.330 INFO:teuthology.orchestra.run.smithi194.stdout:506 Cannot talk to daemon 2024-09-13T18:33:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:33:21.360 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T18:33:21.365 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:33:21.389 INFO:teuthology.orchestra.run.smithi194.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T18:33:21.457 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:33:21.463 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:33:21.463 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-13T18:33:21.463 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.463 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.464 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.464 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.486 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.493 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:33:21.494 INFO:teuthology.run_tasks:Running task install... 2024-09-13T18:33:21.503 DEBUG:teuthology.task.install:project ceph 2024-09-13T18:33:21.503 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}} 2024-09-13T18:33:21.503 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'} 2024-09-13T18:33:21.503 INFO:teuthology.task.install:Using flavor: default 2024-09-13T18:33:21.508 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T18:33:21.509 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-09-13T18:33:21.509 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:33:21.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:33:21.512 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'tag': None, 'wait_for_package': False} 2024-09-13T18:33:21.512 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:33:21.678 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:33:21.678 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:33:21.694 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/ 2024-09-13T18:33:21.695 INFO:teuthology.task.install.rpm:Package version is 18.2.4-860.g6c6b083f 2024-09-13T18:33:21.806 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:33:21.806 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:33:21.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:33:21.814 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240910.100730-reef/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T18:33:21.814 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:33:21.814 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T18:33:21.865 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:33:21.866 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:33:21.871 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-13T18:33:21.872 DEBUG:teuthology.orchestra.run.smithi194:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T18:33:21.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:33:21.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T18:33:22.043 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:33:22.049 DEBUG:teuthology.orchestra.run.smithi194:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T18:33:22.098 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-13T18:33:22.101 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-13T18:33:22.104 INFO:teuthology.orchestra.run.smithi194.stdout:check_obsoletes = 1 2024-09-13T18:33:22.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum clean all 2024-09-13T18:33:22.375 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-13T18:33:22.376 INFO:teuthology.orchestra.run.smithi194.stdout:45 files removed 2024-09-13T18:33:22.408 DEBUG:teuthology.orchestra.run.smithi194:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:33:22.410 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-13T18:33:23.087 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 272 kB/s | 78 kB 00:00 2024-09-13T18:33:23.091 INFO:teuthology.orchestra.run.smithi194.stdout:ceph packages for x86_64 271 kB/s | 78 kB 00:00 2024-09-13T18:33:23.388 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T18:33:23.426 INFO:teuthology.orchestra.run.smithi194.stdout:ceph noarch packages 39 kB/s | 11 kB 00:00 2024-09-13T18:33:23.672 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 7.5 kB/s | 1.9 kB 00:00 2024-09-13T18:33:23.718 INFO:teuthology.orchestra.run.smithi194.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-13T18:33:24.138 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.2 MB 00:00 2024-09-13T18:33:24.351 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T18:33:26.090 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-13T18:33:26.194 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-13T18:33:30.683 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-13T18:33:32.095 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-13T18:33:32.233 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-13T18:33:33.346 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-13T18:33:33.737 INFO:teuthology.orchestra.run.smithi194.stdout:CentOS Stream 9 - Extras packages 55 kB/s | 19 kB 00:00 2024-09-13T18:33:34.608 INFO:teuthology.orchestra.run.smithi194.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-13T18:33:39.668 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-13T18:33:40.980 INFO:teuthology.orchestra.run.smithi194.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-13T18:33:42.183 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:33:42.183 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:33:42.196 INFO:teuthology.orchestra.run.smithi192.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:33:42.197 INFO:teuthology.orchestra.run.smithi192.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:33:42.198 INFO:teuthology.orchestra.run.smithi192.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:33:42.199 INFO:teuthology.orchestra.run.smithi192.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:33:42.201 INFO:teuthology.orchestra.run.smithi192.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:33:42.204 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:33:42.205 INFO:teuthology.orchestra.run.smithi192.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:33:42.267 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:33:42.289 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:33:42.290 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:33:42.291 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:33:42.292 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:33:42.293 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:33:42.294 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:33:42.295 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:33:42.296 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:33:42.297 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:33:42.298 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:33:42.299 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:33:42.300 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout:Install 130 Packages 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 8 Packages 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 203 M 2024-09-13T18:33:42.301 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-13T18:33:42.694 INFO:teuthology.orchestra.run.smithi192.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-13T18:33:42.861 INFO:teuthology.orchestra.run.smithi192.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 5.0 MB/s | 852 kB 00:00 2024-09-13T18:33:42.928 INFO:teuthology.orchestra.run.smithi192.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 2.1 MB/s | 142 kB 00:00 2024-09-13T18:33:43.079 INFO:teuthology.orchestra.run.smithi192.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 9.6 MB/s | 5.1 MB 00:00 2024-09-13T18:33:43.146 INFO:teuthology.orchestra.run.smithi192.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 9.7 MB/s | 2.1 MB 00:00 2024-09-13T18:33:43.204 INFO:teuthology.orchestra.run.smithi192.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 12 MB/s | 1.5 MB 00:00 2024-09-13T18:33:43.467 INFO:teuthology.orchestra.run.smithi194.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:33:43.468 INFO:teuthology.orchestra.run.smithi194.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-13T18:33:43.478 INFO:teuthology.orchestra.run.smithi194.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-13T18:33:43.479 INFO:teuthology.orchestra.run.smithi194.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-13T18:33:43.480 INFO:teuthology.orchestra.run.smithi194.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-13T18:33:43.481 INFO:teuthology.orchestra.run.smithi194.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-13T18:33:43.483 INFO:teuthology.orchestra.run.smithi194.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-13T18:33:43.485 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-13T18:33:43.486 INFO:teuthology.orchestra.run.smithi194.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-13T18:33:43.504 INFO:teuthology.orchestra.run.smithi192.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 13 MB/s | 4.7 MB 00:00 2024-09-13T18:33:43.548 INFO:teuthology.orchestra.run.smithi194.stdout:Dependencies resolved. 2024-09-13T18:33:43.572 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: Package Arch Version Repository Size 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout:Installing: 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 6.5 k 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 5.1 M 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 852 k 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 142 k 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 1.5 M 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 139 k 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 3.5 M 2024-09-13T18:33:43.573 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 7.4 M 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 49 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 7.7 M 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 40 M 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 264 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 226 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 224 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 18 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 31 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 712 k 2024-09-13T18:33:43.574 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 127 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 162 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 321 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 301 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 99 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 87 k 2024-09-13T18:33:43.575 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 172 k 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrading: 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager x86_64 1:1.49.90-1.el9 baseos 2.3 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm x86_64 1:1.49.90-1.el9 baseos 1.8 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team x86_64 1:1.49.90-1.el9 baseos 41 k 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui x86_64 1:1.49.90-1.el9 baseos 249 k 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: librados2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.3 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 3.0 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-13T18:33:43.576 INFO:teuthology.orchestra.run.smithi194.stdout:Installing dependencies: 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 18 M 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 24 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 2.1 M 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 246 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.7 M 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 17 M 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts noarch 2:18.2.4-860.g6c6b083f.el9 ceph-noarch 16 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 25 k 2024-09-13T18:33:43.577 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 166 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T18:33:43.578 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 478 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2 x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 4.5 M 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-13T18:33:43.579 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 45 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common x86_64 2:18.2.4-860.g6c6b083f.el9 ceph 129 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T18:33:43.580 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T18:33:43.581 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T18:33:43.582 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T18:33:43.583 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T18:33:43.584 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction Summary 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout:====================================================================================== 2024-09-13T18:33:43.585 INFO:teuthology.orchestra.run.smithi194.stdout:Install 130 Packages 2024-09-13T18:33:43.586 INFO:teuthology.orchestra.run.smithi194.stdout:Upgrade 8 Packages 2024-09-13T18:33:43.586 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:33:43.586 INFO:teuthology.orchestra.run.smithi194.stdout:Total download size: 203 M 2024-09-13T18:33:43.587 INFO:teuthology.orchestra.run.smithi194.stdout:Downloading Packages: 2024-09-13T18:33:43.721 INFO:teuthology.orchestra.run.smithi192.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 16 MB/s | 18 MB 00:01 2024-09-13T18:33:43.772 INFO:teuthology.orchestra.run.smithi192.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 509 kB/s | 25 kB 00:00 2024-09-13T18:33:44.005 INFO:teuthology.orchestra.run.smithi192.stdout:(10/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 15 MB/s | 7.7 MB 00:00 2024-09-13T18:33:44.064 INFO:teuthology.orchestra.run.smithi192.stdout:(11/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 3.7 MB/s | 224 kB 00:00 2024-09-13T18:33:44.231 INFO:teuthology.orchestra.run.smithi192.stdout:(12/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 16 MB/s | 17 MB 00:01 2024-09-13T18:33:44.256 INFO:teuthology.orchestra.run.smithi192.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 162 kB/s | 31 kB 00:00 2024-09-13T18:33:44.314 INFO:teuthology.orchestra.run.smithi192.stdout:(14/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 8.4 MB/s | 712 kB 00:00 2024-09-13T18:33:44.340 INFO:teuthology.orchestra.run.smithi192.stdout:(15/138): libcephsqlite-18.2.4-860.g6c6b083f.el 1.9 MB/s | 166 kB 00:00 2024-09-13T18:33:44.357 INFO:teuthology.orchestra.run.smithi192.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 3.0 MB/s | 127 kB 00:00 2024-09-13T18:33:44.399 INFO:teuthology.orchestra.run.smithi192.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 8.0 MB/s | 478 kB 00:00 2024-09-13T18:33:44.406 INFO:teuthology.orchestra.run.smithi194.stdout:(1/138): ceph-18.2.4-860.g6c6b083f.el9.x86_64.r 45 kB/s | 6.5 kB 00:00 2024-09-13T18:33:44.474 INFO:teuthology.orchestra.run.smithi192.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 601 kB/s | 45 kB 00:00 2024-09-13T18:33:44.583 INFO:teuthology.orchestra.run.smithi192.stdout:(19/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 20 MB/s | 4.5 MB 00:00 2024-09-13T18:33:44.608 INFO:teuthology.orchestra.run.smithi192.stdout:(20/138): python3-ceph-common-18.2.4-860.g6c6b0 968 kB/s | 129 kB 00:00 2024-09-13T18:33:44.633 INFO:teuthology.orchestra.run.smithi192.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 3.2 MB/s | 162 kB 00:00 2024-09-13T18:33:44.659 INFO:teuthology.orchestra.run.smithi192.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 6.3 MB/s | 321 kB 00:00 2024-09-13T18:33:44.684 INFO:teuthology.orchestra.run.smithi192.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.8 MB/s | 301 kB 00:00 2024-09-13T18:33:44.734 INFO:teuthology.orchestra.run.smithi192.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.3 MB/s | 99 kB 00:00 2024-09-13T18:33:44.760 INFO:teuthology.orchestra.run.smithi192.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 1.1 MB/s | 87 kB 00:00 2024-09-13T18:33:44.765 INFO:teuthology.orchestra.run.smithi194.stdout:(2/138): ceph-fuse-18.2.4-860.g6c6b083f.el9.x86 2.3 MB/s | 852 kB 00:00 2024-09-13T18:33:44.827 INFO:teuthology.orchestra.run.smithi192.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.5 MB/s | 172 kB 00:00 2024-09-13T18:33:44.874 INFO:teuthology.orchestra.run.smithi194.stdout:(3/138): ceph-immutable-object-cache-18.2.4-860 1.3 MB/s | 142 kB 00:00 2024-09-13T18:33:44.894 INFO:teuthology.orchestra.run.smithi192.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 19 MB/s | 3.0 MB 00:00 2024-09-13T18:33:44.911 INFO:teuthology.orchestra.run.smithi192.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 292 kB/s | 24 kB 00:00 2024-09-13T18:33:44.944 INFO:teuthology.orchestra.run.smithi192.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T18:33:45.444 INFO:teuthology.orchestra.run.smithi192.stdout:(30/138): ceph-mgr-diskprediction-local-18.2.4- 15 MB/s | 7.4 MB 00:00 2024-09-13T18:33:45.515 INFO:teuthology.orchestra.run.smithi194.stdout:(4/138): ceph-base-18.2.4-860.g6c6b083f.el9.x86 4.1 MB/s | 5.1 MB 00:01 2024-09-13T18:33:45.519 INFO:teuthology.orchestra.run.smithi192.stdout:(31/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 5.8 MB/s | 3.5 MB 00:00 2024-09-13T18:33:45.557 INFO:teuthology.orchestra.run.smithi194.stdout:(5/138): ceph-mds-18.2.4-860.g6c6b083f.el9.x86_ 3.1 MB/s | 2.1 MB 00:00 2024-09-13T18:33:45.569 INFO:teuthology.orchestra.run.smithi192.stdout:(32/138): ceph-mgr-modules-core-18.2.4-860.g6c6 1.9 MB/s | 246 kB 00:00 2024-09-13T18:33:45.612 INFO:teuthology.orchestra.run.smithi192.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 537 kB/s | 49 kB 00:00 2024-09-13T18:33:45.654 INFO:teuthology.orchestra.run.smithi192.stdout:(34/138): ceph-prometheus-alerts-18.2.4-860.g6c 194 kB/s | 16 kB 00:00 2024-09-13T18:33:45.679 INFO:teuthology.orchestra.run.smithi192.stdout:(35/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 3.9 MB/s | 264 kB 00:00 2024-09-13T18:33:45.699 INFO:teuthology.orchestra.run.smithi194.stdout:(6/138): ceph-mgr-18.2.4-860.g6c6b083f.el9.x86_ 8.0 MB/s | 1.5 MB 00:00 2024-09-13T18:33:45.704 INFO:teuthology.orchestra.run.smithi192.stdout:(36/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 4.4 MB/s | 226 kB 00:00 2024-09-13T18:33:45.755 INFO:teuthology.orchestra.run.smithi192.stdout:(37/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 243 kB/s | 18 kB 00:00 2024-09-13T18:33:46.108 INFO:teuthology.orchestra.run.smithi194.stdout:(7/138): ceph-mon-18.2.4-860.g6c6b083f.el9.x86_ 8.5 MB/s | 4.7 MB 00:00 2024-09-13T18:33:46.239 INFO:teuthology.orchestra.run.smithi192.stdout:(38/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 16 MB/s | 40 MB 00:02 2024-09-13T18:33:46.264 INFO:teuthology.orchestra.run.smithi192.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 143 kB/s | 80 kB 00:00 2024-09-13T18:33:46.402 INFO:teuthology.orchestra.run.smithi194.stdout:(8/138): ceph-common-18.2.4-860.g6c6b083f.el9.x 8.6 MB/s | 18 MB 00:02 2024-09-13T18:33:46.460 INFO:teuthology.orchestra.run.smithi194.stdout:(9/138): ceph-selinux-18.2.4-860.g6c6b083f.el9. 448 kB/s | 25 kB 00:00 2024-09-13T18:33:46.731 INFO:teuthology.orchestra.run.smithi192.stdout:(40/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 543 kB/s | 253 kB 00:00 2024-09-13T18:33:46.763 INFO:teuthology.orchestra.run.smithi194.stdout:(10/138): ceph-osd-18.2.4-860.g6c6b083f.el9.x86 16 MB/s | 17 MB 00:01 2024-09-13T18:33:46.881 INFO:teuthology.orchestra.run.smithi192.stdout:(41/138): libgfortran-11.5.0-2.el9.x86_64.rpm 712 kB/s | 801 kB 00:01 2024-09-13T18:33:46.884 INFO:teuthology.orchestra.run.smithi194.stdout:(11/138): ceph-radosgw-18.2.4-860.g6c6b083f.el9 10 MB/s | 7.7 MB 00:00 2024-09-13T18:33:46.906 INFO:teuthology.orchestra.run.smithi192.stdout:(42/138): libquadmath-11.5.0-2.el9.x86_64.rpm 287 kB/s | 191 kB 00:00 2024-09-13T18:33:46.909 INFO:teuthology.orchestra.run.smithi194.stdout:(12/138): cephfs-mirror-18.2.4-860.g6c6b083f.el 1.5 MB/s | 224 kB 00:00 2024-09-13T18:33:46.926 INFO:teuthology.orchestra.run.smithi194.stdout:(13/138): libcephfs-devel-18.2.4-860.g6c6b083f. 748 kB/s | 31 kB 00:00 2024-09-13T18:33:46.976 INFO:teuthology.orchestra.run.smithi194.stdout:(14/138): libcephsqlite-18.2.4-860.g6c6b083f.el 3.2 MB/s | 166 kB 00:00 2024-09-13T18:33:46.982 INFO:teuthology.orchestra.run.smithi192.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-09-13T18:33:47.010 INFO:teuthology.orchestra.run.smithi194.stdout:(15/138): libcephfs2-18.2.4-860.g6c6b083f.el9.x 6.9 MB/s | 712 kB 00:00 2024-09-13T18:33:47.032 INFO:teuthology.orchestra.run.smithi192.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-13T18:33:47.035 INFO:teuthology.orchestra.run.smithi194.stdout:(16/138): librados-devel-18.2.4-860.g6c6b083f.e 2.1 MB/s | 127 kB 00:00 2024-09-13T18:33:47.077 INFO:teuthology.orchestra.run.smithi194.stdout:(17/138): libradosstriper1-18.2.4-860.g6c6b083f 7.0 MB/s | 478 kB 00:00 2024-09-13T18:33:47.090 INFO:teuthology.orchestra.run.smithi192.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-13T18:33:47.150 INFO:teuthology.orchestra.run.smithi192.stdout:(46/138): python3-cryptography-36.0.1-4.el9.x86 2.9 MB/s | 1.2 MB 00:00 2024-09-13T18:33:47.152 INFO:teuthology.orchestra.run.smithi194.stdout:(18/138): python3-ceph-argparse-18.2.4-860.g6c6 600 kB/s | 45 kB 00:00 2024-09-13T18:33:47.174 INFO:teuthology.orchestra.run.smithi192.stdout:(47/138): python3-urllib3-1.26.5-6.el9.noarch.r 1.5 MB/s | 215 kB 00:00 2024-09-13T18:33:47.219 INFO:teuthology.orchestra.run.smithi194.stdout:(19/138): python3-ceph-common-18.2.4-860.g6c6b0 1.9 MB/s | 129 kB 00:00 2024-09-13T18:33:47.308 INFO:teuthology.orchestra.run.smithi192.stdout:(48/138): bison-3.7.4-5.el9.x86_64.rpm 5.8 MB/s | 943 kB 00:00 2024-09-13T18:33:47.328 INFO:teuthology.orchestra.run.smithi194.stdout:(20/138): librgw2-18.2.4-860.g6c6b083f.el9.x86_ 15 MB/s | 4.5 MB 00:00 2024-09-13T18:33:47.333 INFO:teuthology.orchestra.run.smithi192.stdout:(49/138): boost-program-options-1.75.0-8.el9.x8 674 kB/s | 107 kB 00:00 2024-09-13T18:33:47.353 INFO:teuthology.orchestra.run.smithi194.stdout:(21/138): python3-cephfs-18.2.4-860.g6c6b083f.e 1.2 MB/s | 162 kB 00:00 2024-09-13T18:33:47.378 INFO:teuthology.orchestra.run.smithi194.stdout:(22/138): python3-rados-18.2.4-860.g6c6b083f.el 6.3 MB/s | 321 kB 00:00 2024-09-13T18:33:47.392 INFO:teuthology.orchestra.run.smithi192.stdout:(50/138): automake-1.16.2-8.el9.noarch.rpm 2.2 MB/s | 689 kB 00:00 2024-09-13T18:33:47.404 INFO:teuthology.orchestra.run.smithi194.stdout:(23/138): python3-rbd-18.2.4-860.g6c6b083f.el9. 5.8 MB/s | 301 kB 00:00 2024-09-13T18:33:47.434 INFO:teuthology.orchestra.run.smithi192.stdout:(51/138): elfutils-libelf-devel-0.191-4.el9.x86 173 kB/s | 22 kB 00:00 2024-09-13T18:33:47.454 INFO:teuthology.orchestra.run.smithi194.stdout:(24/138): python3-rgw-18.2.4-860.g6c6b083f.el9. 1.3 MB/s | 99 kB 00:00 2024-09-13T18:33:47.459 INFO:teuthology.orchestra.run.smithi192.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-09-13T18:33:47.496 INFO:teuthology.orchestra.run.smithi194.stdout:(25/138): rbd-fuse-18.2.4-860.g6c6b083f.el9.x86 946 kB/s | 87 kB 00:00 2024-09-13T18:33:47.518 INFO:teuthology.orchestra.run.smithi192.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-13T18:33:47.555 INFO:teuthology.orchestra.run.smithi194.stdout:(26/138): rbd-nbd-18.2.4-860.g6c6b083f.el9.x86_ 2.9 MB/s | 172 kB 00:00 2024-09-13T18:33:47.588 INFO:teuthology.orchestra.run.smithi192.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 145 kB/s | 18 kB 00:00 2024-09-13T18:33:47.630 INFO:teuthology.orchestra.run.smithi194.stdout:(27/138): rbd-mirror-18.2.4-860.g6c6b083f.el9.x 17 MB/s | 3.0 MB 00:00 2024-09-13T18:33:47.643 INFO:teuthology.orchestra.run.smithi192.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 89 kB/s | 11 kB 00:00 2024-09-13T18:33:47.655 INFO:teuthology.orchestra.run.smithi194.stdout:(28/138): ceph-grafana-dashboards-18.2.4-860.g6 244 kB/s | 24 kB 00:00 2024-09-13T18:33:47.680 INFO:teuthology.orchestra.run.smithi194.stdout:(29/138): ceph-mgr-cephadm-18.2.4-860.g6c6b083f 2.7 MB/s | 139 kB 00:00 2024-09-13T18:33:47.719 INFO:teuthology.orchestra.run.smithi192.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-13T18:33:47.769 INFO:teuthology.orchestra.run.smithi192.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-09-13T18:33:47.886 INFO:teuthology.orchestra.run.smithi192.stdout:(58/138): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-13T18:33:47.914 INFO:teuthology.orchestra.run.smithi194.stdout:(30/138): ceph-mgr-dashboard-18.2.4-860.g6c6b08 14 MB/s | 3.5 MB 00:00 2024-09-13T18:33:47.919 INFO:teuthology.orchestra.run.smithi192.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 3.2 MB/s | 662 kB 00:00 2024-09-13T18:33:47.998 INFO:teuthology.orchestra.run.smithi194.stdout:(31/138): ceph-mgr-modules-core-18.2.4-860.g6c6 2.9 MB/s | 246 kB 00:00 2024-09-13T18:33:48.011 INFO:teuthology.orchestra.run.smithi192.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 196 kB/s | 24 kB 00:00 2024-09-13T18:33:48.053 INFO:teuthology.orchestra.run.smithi192.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 355 kB/s | 47 kB 00:00 2024-09-13T18:33:48.145 INFO:teuthology.orchestra.run.smithi192.stdout:(62/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-09-13T18:33:48.196 INFO:teuthology.orchestra.run.smithi192.stdout:(63/138): openblas-0.3.26-2.el9.x86_64.rpm 271 kB/s | 38 kB 00:00 2024-09-13T18:33:48.473 INFO:teuthology.orchestra.run.smithi194.stdout:(32/138): ceph-test-18.2.4-860.g6c6b083f.el9.x8 20 MB/s | 40 MB 00:02 2024-09-13T18:33:48.490 INFO:teuthology.orchestra.run.smithi194.stdout:(33/138): ceph-mgr-rook-18.2.4-860.g6c6b083f.el 100 kB/s | 49 kB 00:00 2024-09-13T18:33:48.582 INFO:teuthology.orchestra.run.smithi194.stdout:(34/138): ceph-mgr-diskprediction-local-18.2.4- 8.2 MB/s | 7.4 MB 00:00 2024-09-13T18:33:48.633 INFO:teuthology.orchestra.run.smithi194.stdout:(35/138): ceph-prometheus-alerts-18.2.4-860.g6c 103 kB/s | 16 kB 00:00 2024-09-13T18:33:48.666 INFO:teuthology.orchestra.run.smithi194.stdout:(36/138): ceph-volume-18.2.4-860.g6c6b083f.el9. 1.5 MB/s | 264 kB 00:00 2024-09-13T18:33:48.691 INFO:teuthology.orchestra.run.smithi194.stdout:(37/138): cephadm-18.2.4-860.g6c6b083f.el9.noar 2.0 MB/s | 226 kB 00:00 2024-09-13T18:33:48.708 INFO:teuthology.orchestra.run.smithi194.stdout:(38/138): cephfs-top-18.2.4-860.g6c6b083f.el9.n 246 kB/s | 18 kB 00:00 2024-09-13T18:33:48.808 INFO:teuthology.orchestra.run.smithi194.stdout:(39/138): fuse-2.9.9-16.el9.x86_64.rpm 684 kB/s | 80 kB 00:00 2024-09-13T18:33:48.833 INFO:teuthology.orchestra.run.smithi194.stdout:(40/138): libquadmath-11.5.0-2.el9.x86_64.rpm 1.5 MB/s | 191 kB 00:00 2024-09-13T18:33:48.884 INFO:teuthology.orchestra.run.smithi194.stdout:(41/138): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-13T18:33:48.918 INFO:teuthology.orchestra.run.smithi194.stdout:(42/138): libgfortran-11.5.0-2.el9.x86_64.rpm 3.5 MB/s | 801 kB 00:00 2024-09-13T18:33:48.943 INFO:teuthology.orchestra.run.smithi194.stdout:(43/138): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-13T18:33:48.993 INFO:teuthology.orchestra.run.smithi194.stdout:(44/138): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-13T18:33:49.019 INFO:teuthology.orchestra.run.smithi194.stdout:(45/138): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-13T18:33:49.044 INFO:teuthology.orchestra.run.smithi194.stdout:(46/138): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-13T18:33:49.077 INFO:teuthology.orchestra.run.smithi194.stdout:(47/138): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-09-13T18:33:49.244 INFO:teuthology.orchestra.run.smithi194.stdout:(48/138): boost-program-options-1.75.0-8.el9.x8 642 kB/s | 107 kB 00:00 2024-09-13T18:33:49.303 INFO:teuthology.orchestra.run.smithi194.stdout:(49/138): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-13T18:33:49.345 INFO:teuthology.orchestra.run.smithi194.stdout:(50/138): elfutils-libelf-devel-0.191-4.el9.x86 217 kB/s | 22 kB 00:00 2024-09-13T18:33:49.378 INFO:teuthology.orchestra.run.smithi194.stdout:(51/138): bison-3.7.4-5.el9.x86_64.rpm 2.8 MB/s | 943 kB 00:00 2024-09-13T18:33:49.403 INFO:teuthology.orchestra.run.smithi194.stdout:(52/138): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 313 kB 00:00 2024-09-13T18:33:49.428 INFO:teuthology.orchestra.run.smithi194.stdout:(53/138): flexiblas-3.0.4-8.el9.x86_64.rpm 392 kB/s | 33 kB 00:00 2024-09-13T18:33:49.454 INFO:teuthology.orchestra.run.smithi194.stdout:(54/138): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-13T18:33:49.479 INFO:teuthology.orchestra.run.smithi194.stdout:(55/138): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-13T18:33:49.513 INFO:teuthology.orchestra.run.smithi194.stdout:(56/138): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-13T18:33:49.538 INFO:teuthology.orchestra.run.smithi194.stdout:(57/138): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-13T18:33:49.604 INFO:teuthology.orchestra.run.smithi192.stdout:(64/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.4 MB/s | 3.0 MB 00:02 2024-09-13T18:33:49.605 INFO:teuthology.orchestra.run.smithi194.stdout:(58/138): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-13T18:33:49.630 INFO:teuthology.orchestra.run.smithi194.stdout:(59/138): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-13T18:33:49.655 INFO:teuthology.orchestra.run.smithi194.stdout:(60/138): libuuid-devel-2.37.4-20.el9.x86_64.rp 490 kB/s | 24 kB 00:00 2024-09-13T18:33:49.706 INFO:teuthology.orchestra.run.smithi194.stdout:(61/138): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-13T18:33:49.731 INFO:teuthology.orchestra.run.smithi194.stdout:(62/138): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-13T18:33:49.757 INFO:teuthology.orchestra.run.smithi194.stdout:(63/138): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-13T18:33:49.782 INFO:teuthology.orchestra.run.smithi194.stdout:(64/138): openblas-0.3.26-2.el9.x86_64.rpm 510 kB/s | 38 kB 00:00 2024-09-13T18:33:49.932 INFO:teuthology.orchestra.run.smithi194.stdout:(65/138): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T18:33:49.963 INFO:teuthology.orchestra.run.smithi192.stdout:(65/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.5 MB/s | 4.4 MB 00:01 2024-09-13T18:33:50.007 INFO:teuthology.orchestra.run.smithi194.stdout:(66/138): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-13T18:33:50.066 INFO:teuthology.orchestra.run.smithi194.stdout:(67/138): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-13T18:33:50.091 INFO:teuthology.orchestra.run.smithi194.stdout:(68/138): postgresql-private-libs-13.16-1.el9.x 1.6 MB/s | 137 kB 00:00 2024-09-13T18:33:50.096 INFO:teuthology.orchestra.run.smithi192.stdout:(66/138): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-13T18:33:50.166 INFO:teuthology.orchestra.run.smithi194.stdout:(69/138): openblas-openmp-0.3.26-2.el9.x86_64.r 11 MB/s | 4.9 MB 00:00 2024-09-13T18:33:50.214 INFO:teuthology.orchestra.run.smithi192.stdout:(67/138): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-13T18:33:50.233 INFO:teuthology.orchestra.run.smithi194.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 3.6 MB/s | 245 kB 00:00 2024-09-13T18:33:50.342 INFO:teuthology.orchestra.run.smithi194.stdout:(71/138): postgresql-server-13.16-1.el9.x86_64. 21 MB/s | 5.8 MB 00:00 2024-09-13T18:33:50.442 INFO:teuthology.orchestra.run.smithi194.stdout:(72/138): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-13T18:33:50.467 INFO:teuthology.orchestra.run.smithi194.stdout:(73/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.0 MB/s | 248 kB 00:00 2024-09-13T18:33:50.480 INFO:teuthology.orchestra.run.smithi192.stdout:(68/138): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-13T18:33:50.484 INFO:teuthology.orchestra.run.smithi194.stdout:(74/138): python3-jsonpatch-1.21-16.el9.noarch. 618 kB/s | 26 kB 00:00 2024-09-13T18:33:50.501 INFO:teuthology.orchestra.run.smithi194.stdout:(75/138): python3-jsonpointer-2.0-4.el9.noarch. 328 kB/s | 19 kB 00:00 2024-09-13T18:33:50.526 INFO:teuthology.orchestra.run.smithi194.stdout:(76/138): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-13T18:33:50.543 INFO:teuthology.orchestra.run.smithi194.stdout:(77/138): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-13T18:33:50.585 INFO:teuthology.orchestra.run.smithi194.stdout:(78/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-13T18:33:50.635 INFO:teuthology.orchestra.run.smithi194.stdout:(79/138): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-09-13T18:33:50.661 INFO:teuthology.orchestra.run.smithi194.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-09-13T18:33:50.686 INFO:teuthology.orchestra.run.smithi194.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 841 kB/s | 42 kB 00:00 2024-09-13T18:33:50.720 INFO:teuthology.orchestra.run.smithi194.stdout:(82/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-13T18:33:50.755 INFO:teuthology.orchestra.run.smithi192.stdout:(69/138): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-09-13T18:33:50.770 INFO:teuthology.orchestra.run.smithi194.stdout:(83/138): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-13T18:33:50.795 INFO:teuthology.orchestra.run.smithi194.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 680 kB/s | 51 kB 00:00 2024-09-13T18:33:50.862 INFO:teuthology.orchestra.run.smithi194.stdout:(85/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 14 MB/s | 5.1 MB 00:00 2024-09-13T18:33:50.879 INFO:teuthology.orchestra.run.smithi194.stdout:(86/138): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-13T18:33:50.880 INFO:teuthology.orchestra.run.smithi192.stdout:(70/138): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-13T18:33:50.904 INFO:teuthology.orchestra.run.smithi194.stdout:(87/138): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-13T18:33:50.938 INFO:teuthology.orchestra.run.smithi194.stdout:(88/138): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-13T18:33:50.955 INFO:teuthology.orchestra.run.smithi194.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T18:33:51.006 INFO:teuthology.orchestra.run.smithi192.stdout:(71/138): python3-jinja2-2.11.3-6.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-09-13T18:33:51.055 INFO:teuthology.orchestra.run.smithi194.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 818 kB/s | 96 kB 00:00 2024-09-13T18:33:51.072 INFO:teuthology.orchestra.run.smithi194.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 545 kB/s | 64 kB 00:00 2024-09-13T18:33:51.114 INFO:teuthology.orchestra.run.smithi194.stdout:(92/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 769 kB/s | 45 kB 00:00 2024-09-13T18:33:51.148 INFO:teuthology.orchestra.run.smithi192.stdout:(72/138): python3-jsonpatch-1.21-16.el9.noarch. 181 kB/s | 26 kB 00:00 2024-09-13T18:33:51.164 INFO:teuthology.orchestra.run.smithi194.stdout:(93/138): fmt-8.1.1-5.el9.x86_64.rpm 1.2 MB/s | 111 kB 00:00 2024-09-13T18:33:51.215 INFO:teuthology.orchestra.run.smithi194.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.0 MB/s | 308 kB 00:00 2024-09-13T18:33:51.240 INFO:teuthology.orchestra.run.smithi194.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-13T18:33:51.273 INFO:teuthology.orchestra.run.smithi194.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-13T18:33:51.290 INFO:teuthology.orchestra.run.smithi192.stdout:(73/138): python3-jsonpointer-2.0-4.el9.noarch. 135 kB/s | 19 kB 00:00 2024-09-13T18:33:51.307 INFO:teuthology.orchestra.run.smithi194.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T18:33:51.374 INFO:teuthology.orchestra.run.smithi194.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 12 MB/s | 839 kB 00:00 2024-09-13T18:33:51.407 INFO:teuthology.orchestra.run.smithi192.stdout:(74/138): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-13T18:33:51.416 INFO:teuthology.orchestra.run.smithi194.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 13 MB/s | 548 kB 00:00 2024-09-13T18:33:51.458 INFO:teuthology.orchestra.run.smithi194.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-13T18:33:51.492 INFO:teuthology.orchestra.run.smithi194.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 982 kB/s | 32 kB 00:00 2024-09-13T18:33:51.517 INFO:teuthology.orchestra.run.smithi194.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 570 kB/s | 14 kB 00:00 2024-09-13T18:33:51.542 INFO:teuthology.orchestra.run.smithi194.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-13T18:33:51.563 INFO:teuthology.orchestra.run.smithi192.stdout:(75/138): python3-markupsafe-1.1.1-12.el9.x86_6 224 kB/s | 35 kB 00:00 2024-09-13T18:33:51.601 INFO:teuthology.orchestra.run.smithi194.stdout:(104/138): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-13T18:33:51.634 INFO:teuthology.orchestra.run.smithi194.stdout:(105/138): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-13T18:33:51.657 INFO:teuthology.orchestra.run.smithi192.stdout:(76/138): openblas-openmp-0.3.26-2.el9.x86_64.r 1.4 MB/s | 4.9 MB 00:03 2024-09-13T18:33:51.659 INFO:teuthology.orchestra.run.smithi194.stdout:(106/138): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-09-13T18:33:51.685 INFO:teuthology.orchestra.run.smithi194.stdout:(107/138): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-09-13T18:33:51.710 INFO:teuthology.orchestra.run.smithi194.stdout:(108/138): python3-jaraco-classes-3.2.1-5.el9.n 350 kB/s | 18 kB 00:00 2024-09-13T18:33:51.727 INFO:teuthology.orchestra.run.smithi194.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 557 kB/s | 23 kB 00:00 2024-09-13T18:33:51.744 INFO:teuthology.orchestra.run.smithi194.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 585 kB/s | 19 kB 00:00 2024-09-13T18:33:51.761 INFO:teuthology.orchestra.run.smithi194.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 588 kB/s | 20 kB 00:00 2024-09-13T18:33:51.789 INFO:teuthology.orchestra.run.smithi194.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T18:33:51.833 INFO:teuthology.orchestra.run.smithi192.stdout:(77/138): python3-numpy-1.20.1-5.el9.x86_64.rpm 19 MB/s | 5.1 MB 00:00 2024-09-13T18:33:51.836 INFO:teuthology.orchestra.run.smithi194.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 1.5 MB/s | 79 kB 00:00 2024-09-13T18:33:51.862 INFO:teuthology.orchestra.run.smithi194.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-13T18:33:51.975 INFO:teuthology.orchestra.run.smithi192.stdout:(78/138): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-09-13T18:33:52.029 INFO:teuthology.orchestra.run.smithi194.stdout:(115/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 13 MB/s | 16 MB 00:01 2024-09-13T18:33:52.033 INFO:teuthology.orchestra.run.smithi192.stdout:(79/138): python3-numpy-f2py-1.20.1-5.el9.x86_6 667 kB/s | 250 kB 00:00 2024-09-13T18:33:52.071 INFO:teuthology.orchestra.run.smithi194.stdout:(116/138): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-09-13T18:33:52.084 INFO:teuthology.orchestra.run.smithi192.stdout:(80/138): python3-packaging-20.9-5.el9.noarch.r 710 kB/s | 77 kB 00:00 2024-09-13T18:33:52.087 INFO:teuthology.orchestra.run.smithi194.stdout:(117/138): python3-portend-3.1.0-2.el9.noarch.r 281 kB/s | 16 kB 00:00 2024-09-13T18:33:52.113 INFO:teuthology.orchestra.run.smithi194.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.2 MB/s | 90 kB 00:00 2024-09-13T18:33:52.130 INFO:teuthology.orchestra.run.smithi194.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 739 kB/s | 31 kB 00:00 2024-09-13T18:33:52.167 INFO:teuthology.orchestra.run.smithi192.stdout:(81/138): python3-prettytable-0.7.2-27.el9.noar 317 kB/s | 42 kB 00:00 2024-09-13T18:33:52.171 INFO:teuthology.orchestra.run.smithi194.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 1.4 MB/s | 59 kB 00:00 2024-09-13T18:33:52.196 INFO:teuthology.orchestra.run.smithi194.stdout:(121/138): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-13T18:33:52.209 INFO:teuthology.orchestra.run.smithi192.stdout:(82/138): postgresql-13.16-1.el9.x86_64.rpm 623 kB/s | 1.6 MB 00:02 2024-09-13T18:33:52.230 INFO:teuthology.orchestra.run.smithi194.stdout:(122/138): python3-kubernetes-26.1.0-2.el9.noar 2.1 MB/s | 1.0 MB 00:00 2024-09-13T18:33:52.234 INFO:teuthology.orchestra.run.smithi192.stdout:(83/138): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.0 MB/s | 159 kB 00:00 2024-09-13T18:33:52.255 INFO:teuthology.orchestra.run.smithi194.stdout:(123/138): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-09-13T18:33:52.280 INFO:teuthology.orchestra.run.smithi194.stdout:(124/138): python3-typing-extensions-4.12.2-2.e 888 kB/s | 74 kB 00:00 2024-09-13T18:33:52.305 INFO:teuthology.orchestra.run.smithi194.stdout:(125/138): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-13T18:33:52.322 INFO:teuthology.orchestra.run.smithi194.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-13T18:33:52.343 INFO:teuthology.orchestra.run.smithi192.stdout:(84/138): python3-pytz-2021.1-5.el9.noarch.rpm 382 kB/s | 51 kB 00:00 2024-09-13T18:33:52.347 INFO:teuthology.orchestra.run.smithi194.stdout:(127/138): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-13T18:33:52.373 INFO:teuthology.orchestra.run.smithi194.stdout:(128/138): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-13T18:33:52.406 INFO:teuthology.orchestra.run.smithi194.stdout:(129/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-13T18:33:52.410 INFO:teuthology.orchestra.run.smithi192.stdout:(85/138): python3-requests-oauthlib-1.3.0-12.el 306 kB/s | 54 kB 00:00 2024-09-13T18:33:52.456 INFO:teuthology.orchestra.run.smithi194.stdout:(130/138): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-13T18:33:52.544 INFO:teuthology.orchestra.run.smithi192.stdout:(86/138): python3-toml-0.10.2-6.el9.noarch.rpm 312 kB/s | 42 kB 00:00 2024-09-13T18:33:52.640 INFO:teuthology.orchestra.run.smithi194.stdout:(131/138): librados2-18.2.4-860.g6c6b083f.el9.x 12 MB/s | 3.3 MB 00:00 2024-09-13T18:33:52.660 INFO:teuthology.orchestra.run.smithi192.stdout:(87/138): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-13T18:33:52.686 INFO:teuthology.orchestra.run.smithi192.stdout:(88/138): python3-pyasn1-modules-0.4.8-6.el9.no 538 kB/s | 279 kB 00:00 2024-09-13T18:33:52.716 INFO:teuthology.orchestra.run.smithi194.stdout:(132/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 9.7 MB/s | 3.0 MB 00:00 2024-09-13T18:33:52.766 INFO:teuthology.orchestra.run.smithi194.stdout:(133/138): NetworkManager-1.49.90-1.el9.x86_64. 7.5 MB/s | 2.3 MB 00:00 2024-09-13T18:33:52.783 INFO:teuthology.orchestra.run.smithi194.stdout:(134/138): NetworkManager-team-1.49.90-1.el9.x8 611 kB/s | 41 kB 00:00 2024-09-13T18:33:52.786 INFO:teuthology.orchestra.run.smithi192.stdout:(89/138): uuid-1.6.2-55.el9.x86_64.rpm 463 kB/s | 58 kB 00:00 2024-09-13T18:33:52.809 INFO:teuthology.orchestra.run.smithi194.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 5.8 MB/s | 249 kB 00:00 2024-09-13T18:33:52.858 INFO:teuthology.orchestra.run.smithi194.stdout:(136/138): NetworkManager-libnm-1.49.90-1.el9.x 8.3 MB/s | 1.8 MB 00:00 2024-09-13T18:33:52.903 INFO:teuthology.orchestra.run.smithi192.stdout:(90/138): xfsprogs-devel-6.4.0-4.el9.x86_64.rpm 442 kB/s | 96 kB 00:00 2024-09-13T18:33:52.925 INFO:teuthology.orchestra.run.smithi194.stdout:(137/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 21 MB/s | 2.4 MB 00:00 2024-09-13T18:33:52.945 INFO:teuthology.orchestra.run.smithi192.stdout:(91/138): xmlstarlet-1.6.1-20.el9.x86_64.rpm 402 kB/s | 64 kB 00:00 2024-09-13T18:33:52.959 INFO:teuthology.orchestra.run.smithi194.stdout:(138/138): openssl-3.2.2-6.el9.x86_64.rpm 7.7 MB/s | 1.4 MB 00:00 2024-09-13T18:33:52.964 INFO:teuthology.orchestra.run.smithi194.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:33:52.964 INFO:teuthology.orchestra.run.smithi194.stdout:Total 22 MB/s | 203 MB 00:09 2024-09-13T18:33:52.995 INFO:teuthology.orchestra.run.smithi192.stdout:(92/138): fmt-8.1.1-5.el9.x86_64.rpm 2.2 MB/s | 111 kB 00:00 2024-09-13T18:33:53.037 INFO:teuthology.orchestra.run.smithi192.stdout:(93/138): zlib-devel-1.2.11-41.el9.x86_64.rpm 335 kB/s | 45 kB 00:00 2024-09-13T18:33:53.079 INFO:teuthology.orchestra.run.smithi192.stdout:(94/138): gperftools-libs-2.9.1-3.el9.x86_64.rp 3.6 MB/s | 308 kB 00:00 2024-09-13T18:33:53.121 INFO:teuthology.orchestra.run.smithi192.stdout:(95/138): libarrow-doc-9.0.0-11.el9.noarch.rpm 656 kB/s | 26 kB 00:00 2024-09-13T18:33:53.163 INFO:teuthology.orchestra.run.smithi192.stdout:(96/138): liboath-2.6.7-2.el9.x86_64.rpm 1.1 MB/s | 49 kB 00:00 2024-09-13T18:33:53.197 INFO:teuthology.orchestra.run.smithi192.stdout:(97/138): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-13T18:33:53.272 INFO:teuthology.orchestra.run.smithi192.stdout:(98/138): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-13T18:33:53.331 INFO:teuthology.orchestra.run.smithi192.stdout:(99/138): python3-asyncssh-2.13.2-5.el9.noarch. 9.2 MB/s | 548 kB 00:00 2024-09-13T18:33:53.373 INFO:teuthology.orchestra.run.smithi192.stdout:(100/138): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.0 MB/s | 43 kB 00:00 2024-09-13T18:33:53.424 INFO:teuthology.orchestra.run.smithi192.stdout:(101/138): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-13T18:33:53.465 INFO:teuthology.orchestra.run.smithi192.stdout:(102/138): python3-certifi-2023.05.07-4.el9.noa 341 kB/s | 14 kB 00:00 2024-09-13T18:33:53.490 INFO:teuthology.orchestra.run.smithi192.stdout:(103/138): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-13T18:33:53.574 INFO:teuthology.orchestra.run.smithi192.stdout:(104/138): libarrow-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 4.4 MB 00:00 2024-09-13T18:33:53.600 INFO:teuthology.orchestra.run.smithi192.stdout:(105/138): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-09-13T18:33:53.641 INFO:teuthology.orchestra.run.smithi192.stdout:(106/138): python3-jaraco-8.2.1-3.el9.noarch.rp 258 kB/s | 11 kB 00:00 2024-09-13T18:33:53.692 INFO:teuthology.orchestra.run.smithi192.stdout:(107/138): python3-jaraco-classes-3.2.1-5.el9.n 354 kB/s | 18 kB 00:00 2024-09-13T18:33:53.717 INFO:teuthology.orchestra.run.smithi192.stdout:(108/138): python3-google-auth-2.34.0-1.el9.noa 1.5 MB/s | 220 kB 00:00 2024-09-13T18:33:53.743 INFO:teuthology.orchestra.run.smithi192.stdout:(109/138): python3-jaraco-collections-3.0.0-8.e 461 kB/s | 23 kB 00:00 2024-09-13T18:33:53.768 INFO:teuthology.orchestra.run.smithi192.stdout:(110/138): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-09-13T18:33:53.793 INFO:teuthology.orchestra.run.smithi192.stdout:(111/138): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-13T18:33:53.818 INFO:teuthology.orchestra.run.smithi192.stdout:(112/138): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-13T18:33:53.843 INFO:teuthology.orchestra.run.smithi192.stdout:(113/138): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-13T18:33:53.868 INFO:teuthology.orchestra.run.smithi192.stdout:(114/138): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-13T18:33:53.902 INFO:teuthology.orchestra.run.smithi192.stdout:(115/138): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-13T18:33:53.928 INFO:teuthology.orchestra.run.smithi192.stdout:(116/138): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-13T18:33:53.961 INFO:teuthology.orchestra.run.smithi192.stdout:(117/138): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-13T18:33:53.986 INFO:teuthology.orchestra.run.smithi192.stdout:(118/138): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-13T18:33:54.012 INFO:teuthology.orchestra.run.smithi192.stdout:(119/138): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-13T18:33:54.037 INFO:teuthology.orchestra.run.smithi192.stdout:(120/138): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-13T18:33:54.062 INFO:teuthology.orchestra.run.smithi192.stdout:(121/138): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-13T18:33:54.087 INFO:teuthology.orchestra.run.smithi192.stdout:(122/138): python3-tempora-5.0.0-2.el9.noarch.r 715 kB/s | 36 kB 00:00 2024-09-13T18:33:54.130 INFO:teuthology.orchestra.run.smithi192.stdout:(123/138): python3-typing-extensions-4.12.2-2.e 1.1 MB/s | 74 kB 00:00 2024-09-13T18:33:54.155 INFO:teuthology.orchestra.run.smithi192.stdout:(124/138): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-13T18:33:54.188 INFO:teuthology.orchestra.run.smithi192.stdout:(125/138): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-13T18:33:54.214 INFO:teuthology.orchestra.run.smithi192.stdout:(126/138): python3-zc-lockfile-2.0-10.el9.noarc 803 kB/s | 20 kB 00:00 2024-09-13T18:33:54.247 INFO:teuthology.orchestra.run.smithi192.stdout:(127/138): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-13T18:33:54.273 INFO:teuthology.orchestra.run.smithi192.stdout:(128/138): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2024-09-13T18:33:54.331 INFO:teuthology.orchestra.run.smithi192.stdout:(129/138): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-13T18:33:54.547 INFO:teuthology.orchestra.run.smithi192.stdout:(130/138): librados2-18.2.4-860.g6c6b083f.el9.x 12 MB/s | 3.3 MB 00:00 2024-09-13T18:33:54.607 INFO:teuthology.orchestra.run.smithi192.stdout:(131/138): librbd1-18.2.4-860.g6c6b083f.el9.x86 11 MB/s | 3.0 MB 00:00 2024-09-13T18:33:54.765 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction check 2024-09-13T18:33:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction check succeeded. 2024-09-13T18:33:54.935 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction test 2024-09-13T18:33:55.082 INFO:teuthology.orchestra.run.smithi192.stdout:(132/138): NetworkManager-libnm-1.49.90-1.el9.x 3.8 MB/s | 1.8 MB 00:00 2024-09-13T18:33:55.208 INFO:teuthology.orchestra.run.smithi192.stdout:(133/138): NetworkManager-team-1.49.90-1.el9.x8 326 kB/s | 41 kB 00:00 2024-09-13T18:33:55.249 INFO:teuthology.orchestra.run.smithi192.stdout:(134/138): NetworkManager-1.49.90-1.el9.x86_64. 3.3 MB/s | 2.3 MB 00:00 2024-09-13T18:33:55.325 INFO:teuthology.orchestra.run.smithi192.stdout:(135/138): NetworkManager-tui-1.49.90-1.el9.x86 2.1 MB/s | 249 kB 00:00 2024-09-13T18:33:55.402 INFO:teuthology.orchestra.run.smithi192.stdout:(136/138): openssl-3.2.2-6.el9.x86_64.rpm 8.9 MB/s | 1.4 MB 00:00 2024-09-13T18:33:55.551 INFO:teuthology.orchestra.run.smithi192.stdout:(137/138): openssl-libs-3.2.2-6.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-09-13T18:33:57.148 INFO:teuthology.orchestra.run.smithi194.stdout:Transaction test succeeded. 2024-09-13T18:33:57.148 INFO:teuthology.orchestra.run.smithi194.stdout:Running transaction 2024-09-13T18:34:00.917 INFO:teuthology.orchestra.run.smithi192.stdout:(138/138): python3-scipy-1.6.2-8.el9.x86_64.rpm 1.9 MB/s | 16 MB 00:08 2024-09-13T18:34:00.922 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-13T18:34:00.922 INFO:teuthology.orchestra.run.smithi192.stdout:Total 11 MB/s | 203 MB 00:18 2024-09-13T18:34:02.714 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-13T18:34:02.885 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-13T18:34:02.885 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-13T18:34:03.089 INFO:teuthology.orchestra.run.smithi194.stdout: Preparing : 1/1 2024-09-13T18:34:03.213 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:34:03.388 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:34:03.579 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:34:03.624 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:34:03.680 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:34:03.740 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:34:04.105 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:34:04.206 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:34:04.365 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:34:04.391 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:34:04.503 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:34:04.537 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:34:04.747 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:34:04.809 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:34:04.836 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:34:04.963 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:34:04.995 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:34:05.147 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-13T18:34:05.147 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-13T18:34:05.243 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:34:05.458 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:34:05.595 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:05.701 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:06.076 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:06.115 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:34:06.191 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:34:06.275 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:34:06.325 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:34:06.359 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:34:06.447 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:34:06.511 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:34:06.562 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:34:06.609 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:34:06.689 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:34:06.724 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:34:06.769 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:34:06.855 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:34:07.043 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:34:07.109 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:34:07.769 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:34:07.876 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:34:07.930 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:34:07.977 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:34:08.029 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:34:08.208 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:34:08.260 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:34:08.439 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:34:08.605 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:34:08.674 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:34:08.767 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:34:08.807 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:34:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:34:08.901 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:34:08.953 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:34:09.004 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:34:09.193 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:34:09.236 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:34:09.279 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:34:09.395 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:34:09.437 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:34:09.488 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:34:09.518 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:34:09.545 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:34:09.578 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:34:09.615 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:34:09.657 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:34:09.695 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:34:09.757 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:34:09.792 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:34:09.825 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:34:09.872 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:34:09.904 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:34:09.948 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:34:09.998 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:34:10.122 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:34:10.186 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:34:11.063 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:34:11.102 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-13T18:34:11.113 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:34:11.172 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:34:11.284 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:34:11.305 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/146 2024-09-13T18:34:11.330 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:34:11.563 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:34:11.565 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/146 2024-09-13T18:34:11.594 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:34:11.638 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/146 2024-09-13T18:34:11.695 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:34:11.707 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/146 2024-09-13T18:34:11.739 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/146 2024-09-13T18:34:11.801 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/146 2024-09-13T18:34:12.160 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/146 2024-09-13T18:34:12.281 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:34:12.427 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:34:12.465 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:34:12.511 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:34:12.594 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:34:12.629 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:34:12.655 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:34:12.838 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/146 2024-09-13T18:34:12.901 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/146 2024-09-13T18:34:12.958 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:34:13.093 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:34:13.120 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:34:13.340 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 14/146 2024-09-13T18:34:13.551 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 15/146 2024-09-13T18:34:13.666 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:13.777 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:14.145 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.49.90-1.el9.x86_64 16/146 2024-09-13T18:34:14.182 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/146 2024-09-13T18:34:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/146 2024-09-13T18:34:14.232 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:34:14.325 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/146 2024-09-13T18:34:14.359 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:34:14.367 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 20/146 2024-09-13T18:34:14.399 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:34:14.411 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 21/146 2024-09-13T18:34:14.432 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:34:14.498 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 22/146 2024-09-13T18:34:14.553 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 23/146 2024-09-13T18:34:14.597 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 24/146 2024-09-13T18:34:14.644 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 25/146 2024-09-13T18:34:14.748 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 26/146 2024-09-13T18:34:14.752 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:34:14.784 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 27/146 2024-09-13T18:34:14.785 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:34:14.829 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 28/146 2024-09-13T18:34:14.904 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:34:14.914 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 29/146 2024-09-13T18:34:14.934 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:34:14.980 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:34:15.074 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/146 2024-09-13T18:34:15.143 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/146 2024-09-13T18:34:15.413 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:34:15.446 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:34:15.537 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:34:15.564 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:34:15.805 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/146 2024-09-13T18:34:15.903 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/146 2024-09-13T18:34:15.969 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 34/146 2024-09-13T18:34:16.012 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 35/146 2024-09-13T18:34:16.064 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/146 2024-09-13T18:34:16.256 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 37/146 2024-09-13T18:34:16.311 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 38/146 2024-09-13T18:34:16.451 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 39/146 2024-09-13T18:34:16.490 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 40/146 2024-09-13T18:34:16.551 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 41/146 2024-09-13T18:34:16.635 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 42/146 2024-09-13T18:34:16.675 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 43/146 2024-09-13T18:34:16.711 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 44/146 2024-09-13T18:34:16.769 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 45/146 2024-09-13T18:34:16.846 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 46/146 2024-09-13T18:34:16.896 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 47/146 2024-09-13T18:34:17.066 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 48/146 2024-09-13T18:34:17.121 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 49/146 2024-09-13T18:34:17.164 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 50/146 2024-09-13T18:34:17.281 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 51/146 2024-09-13T18:34:17.322 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 52/146 2024-09-13T18:34:17.368 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 53/146 2024-09-13T18:34:17.402 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 54/146 2024-09-13T18:34:17.425 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 55/146 2024-09-13T18:34:17.458 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fmt-8.1.1-5.el9.x86_64 56/146 2024-09-13T18:34:17.496 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 57/146 2024-09-13T18:34:17.537 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 58/146 2024-09-13T18:34:17.575 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : uuid-1.6.2-55.el9.x86_64 59/146 2024-09-13T18:34:17.613 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 60/146 2024-09-13T18:34:17.682 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 61/146 2024-09-13T18:34:17.722 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 62/146 2024-09-13T18:34:17.774 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 63/146 2024-09-13T18:34:17.806 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 64/146 2024-09-13T18:34:17.842 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 65/146 2024-09-13T18:34:17.892 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 66/146 2024-09-13T18:34:18.013 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 67/146 2024-09-13T18:34:18.072 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 68/146 2024-09-13T18:34:18.233 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:18.277 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:18.898 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:18.939 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:34:18.970 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 69/146 2024-09-13T18:34:19.024 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 70/146 2024-09-13T18:34:19.058 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 71/146 2024-09-13T18:34:19.085 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:34:19.085 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:34:19.085 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:34:19.086 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:19.139 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:34:19.172 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 72/146 2024-09-13T18:34:19.225 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 73/146 2024-09-13T18:34:19.457 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 74/146 2024-09-13T18:34:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 75/146 2024-09-13T18:34:19.591 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 76/146 2024-09-13T18:34:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 77/146 2024-09-13T18:34:20.546 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:34:22.143 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:34:22.237 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 80/146 2024-09-13T18:34:22.273 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 81/146 2024-09-13T18:34:22.306 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 82/146 2024-09-13T18:34:22.655 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 83/146 2024-09-13T18:34:22.701 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:34:22.846 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 84/146 2024-09-13T18:34:22.882 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 85/146 2024-09-13T18:34:22.930 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 86/146 2024-09-13T18:34:23.363 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 87/146 2024-09-13T18:34:23.387 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:34:23.478 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 88/146 2024-09-13T18:34:23.506 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 89/146 2024-09-13T18:34:25.799 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:25.835 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:26.447 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 90/146 2024-09-13T18:34:26.488 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:34:26.633 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 91/146 2024-09-13T18:34:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T18:34:26.633 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T18:34:26.633 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:26.681 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:34:31.327 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:34:31.327 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /sys 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /proc 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /mnt 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /var/tmp 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /home 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /root 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout:skipping the directory /tmp 2024-09-13T18:34:31.328 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:31.533 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:34:31.576 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:34:31.576 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:31.576 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:34:31.576 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:33.136 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:34:33.194 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:33.436 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:34:33.487 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:34:33.487 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:33.488 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:34:33.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:34:33.488 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:34:33.488 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:33.979 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:34:34.029 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:34:34.030 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:34.030 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:34:34.030 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:34:34.030 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:34:34.030 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:34.162 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:34:34.222 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:34:34.285 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:34:34.513 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:34:34.582 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:34:34.669 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:34:34.777 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:34:34.966 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:34:35.014 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:34:35.055 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:34:35.080 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:34:35.662 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:34:35.696 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:34:35.726 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:34:35.786 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:34:35.818 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:34:37.028 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:34:37.083 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:34:38.165 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:34:38.195 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:34:38.330 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:34:38.552 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:34:38.580 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:34:38.632 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:38.689 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:34:38.715 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:34:38.846 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:34:38.920 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 92/146 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-13T18:34:38.982 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-13T18:34:38.983 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-13T18:34:38.983 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:39.176 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:34:39.212 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 93/146 2024-09-13T18:34:39.213 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:39.213 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-13T18:34:39.213 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:39.698 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:34:39.733 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:34:39.785 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:39.851 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:34:39.900 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:34:39.900 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:39.901 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:34:39.901 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:39.951 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:34:40.002 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:40.319 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:34:40.370 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:40.753 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:34:40.811 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 94/146 2024-09-13T18:34:40.812 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:40.812 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T18:34:40.812 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:34:40.812 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T18:34:40.812 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:41.028 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 95/146 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T18:34:41.079 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:41.562 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:34:41.614 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 96/146 2024-09-13T18:34:41.614 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:41.614 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T18:34:41.614 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:34:41.614 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T18:34:41.615 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:41.746 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : automake-1.16.2-8.el9.noarch 97/146 2024-09-13T18:34:41.830 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 98/146 2024-09-13T18:34:41.896 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 99/146 2024-09-13T18:34:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 100/146 2024-09-13T18:34:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 101/146 2024-09-13T18:34:42.286 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 102/146 2024-09-13T18:34:42.394 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 103/146 2024-09-13T18:34:42.570 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 104/146 2024-09-13T18:34:42.637 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 105/146 2024-09-13T18:34:42.680 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 106/146 2024-09-13T18:34:42.706 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 107/146 2024-09-13T18:34:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:34:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 108/146 2024-09-13T18:34:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 109/146 2024-09-13T18:34:43.397 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 110/146 2024-09-13T18:34:43.452 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:34:44.374 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:34:44.448 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:34:44.492 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:34:44.521 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:34:44.670 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 111/146 2024-09-13T18:34:44.721 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:34:44.774 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:34:44.829 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:34:44.857 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:34:44.888 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:34:44.940 INFO:teuthology.orchestra.run.smithi194.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:34:45.666 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:45.713 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:45.755 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:45.800 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 112/146 2024-09-13T18:34:45.829 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:34:45.965 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 113/146 2024-09-13T18:34:46.154 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 114/146 2024-09-13T18:34:46.181 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:34:46.232 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 115/146 2024-09-13T18:34:46.232 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:46.232 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T18:34:46.232 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:34:46.232 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T18:34:46.233 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:46.290 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:34:46.316 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 116/146 2024-09-13T18:34:46.419 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 117/146 2024-09-13T18:34:46.515 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 118/146 2024-09-13T18:34:47.026 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:34:47.135 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:34:47.189 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:34:47.299 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:34:47.321 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libtool-2.4.6-46.el9.x86_64 119/146 2024-09-13T18:34:47.346 INFO:teuthology.orchestra.run.smithi194.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:34:47.371 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:34:47.376 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:34:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:34:47.408 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:34:47.427 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 120/146 2024-09-13T18:34:47.428 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:47.428 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T18:34:47.428 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:34:47.428 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T18:34:47.428 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:47.477 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:34:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:34:47.507 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:34:47.526 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 121/146 2024-09-13T18:34:47.527 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:47.527 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T18:34:47.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:47.578 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:34:47.628 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 122/146 2024-09-13T18:34:47.629 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:47.629 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-13T18:34:47.629 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:34:47.629 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-13T18:34:47.629 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:47.648 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:34:47.682 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:34:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:47.701 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:47.942 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:34:47.945 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:34:47.996 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 123/146 2024-09-13T18:34:47.996 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T18:34:47.996 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T18:34:47.996 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:34:47.996 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T18:34:47.997 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:48.078 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:34:48.150 INFO:teuthology.orchestra.run.smithi194.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:34:48.362 INFO:teuthology.orchestra.run.smithi194.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:34:48.362 INFO:teuthology.orchestra.run.smithi194.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T18:34:48.362 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:51.949 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 124/146 2024-09-13T18:34:52.017 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 125/146 2024-09-13T18:34:52.077 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 126/146 2024-09-13T18:34:52.114 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 127/146 2024-09-13T18:34:52.361 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 128/146 2024-09-13T18:34:52.412 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 129/146 2024-09-13T18:34:52.459 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 130/146 2024-09-13T18:34:52.497 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-team-1:1.49.90-1.el9.x86_64 131/146 2024-09-13T18:34:52.534 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : NetworkManager-tui-1:1.49.90-1.el9.x86_64 132/146 2024-09-13T18:34:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:53.315 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:53.358 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 133/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:34:53.643 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:34:53.644 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:34:53.645 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:34:53.646 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:34:53.647 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:34:53.648 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:34:53.649 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:34:53.650 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:34:53.651 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:34:53.652 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:34:53.653 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:34:53.654 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:34:53.655 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:34:54.617 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 134/146 2024-09-13T18:34:54.729 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 135/146 2024-09-13T18:34:54.785 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 136/146 2024-09-13T18:34:54.900 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flex-2.6.4-9.el9.x86_64 137/146 2024-09-13T18:34:54.940 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : bison-3.7.4-5.el9.x86_64 138/146 2024-09-13T18:34:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 139/146 2024-09-13T18:34:55.034 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 140/146 2024-09-13T18:34:55.035 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 141/146 2024-09-13T18:34:55.134 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:34:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 142/146 2024-09-13T18:34:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 143/146 2024-09-13T18:34:55.284 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:55.285 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:55.537 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 144/146 2024-09-13T18:34:55.537 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:34:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 145/146 2024-09-13T18:34:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:34:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:34:55.896 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:55.896 INFO:teuthology.orchestra.run.smithi194.stdout:Upgraded: 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout:Installed: 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:34:55.897 INFO:teuthology.orchestra.run.smithi194.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.898 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:34:55.899 INFO:teuthology.orchestra.run.smithi194.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.900 INFO:teuthology.orchestra.run.smithi194.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:34:55.901 INFO:teuthology.orchestra.run.smithi194.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:34:55.902 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:34:55.903 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:34:55.904 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:34:55.905 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:34:55.906 INFO:teuthology.orchestra.run.smithi194.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:34:55.907 INFO:teuthology.orchestra.run.smithi194.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:34:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:34:55.908 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:34:55.908 INFO:teuthology.orchestra.run.smithi194.stdout:Complete! 2024-09-13T18:34:55.912 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:34:55.912 INFO:teuthology.orchestra.run.smithi192.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-09-13T18:34:55.913 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:34:56.516 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 1/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 3/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 4/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:18.2.4-860.g6c6b08 5/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 6/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 7/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 8/146 2024-09-13T18:35:01.163 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 9/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 10/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 11/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 12/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 13/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_6 14/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 15/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 16/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 17/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_ 18/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 19/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9 20/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x 21/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 22/146 2024-09-13T18:35:01.164 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 23/146 2024-09-13T18:35:01.165 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 24/146 2024-09-13T18:35:01.165 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 25/146 2024-09-13T18:35:01.175 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 26/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 27/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 28/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.e 29/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noar 30/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.no 31/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b 32/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9 33/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 34/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el 35/146 2024-09-13T18:35:01.176 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 36/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 37/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 38/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 39/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 40/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 41/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 42/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 43/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 44/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 45/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 46/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 47/146 2024-09-13T18:35:01.177 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : automake-1.16.2-8.el9.noarch 48/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : bison-3.7.4-5.el9.x86_64 49/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 50/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 51/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flex-2.6.4-9.el9.x86_64 52/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 53/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 54/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 55/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 56/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 57/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 58/146 2024-09-13T18:35:01.178 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 59/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 60/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 61/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 62/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 63/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 64/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 65/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 66/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-13.16-1.el9.x86_64 67/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 68/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 69/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 70/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 71/146 2024-09-13T18:35:01.179 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 72/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 73/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 74/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 75/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 76/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 77/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 78/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 79/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 80/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 81/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 82/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 83/146 2024-09-13T18:35:01.180 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 84/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 85/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 87/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 88/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 89/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 90/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 91/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 92/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 93/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 94/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 95/146 2024-09-13T18:35:01.181 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 96/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 97/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 98/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 99/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 100/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 101/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 102/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 103/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 104/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 105/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 106/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 107/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 108/146 2024-09-13T18:35:01.182 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 109/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 110/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 111/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 112/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 113/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 114/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 115/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 116/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 117/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 118/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 120/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 121/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 122/146 2024-09-13T18:35:01.183 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 123/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 124/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 125/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 126/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 127/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 128/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 129/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 130/146 2024-09-13T18:35:01.184 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 131/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 132/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 133/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 134/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.49.90-1.el9.x86_64 135/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 136/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.49.90-1.el9.x86_64 137/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 138/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.49.90-1.el9.x86_64 139/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 140/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.49.90-1.el9.x86_64 141/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 142/146 2024-09-13T18:35:01.185 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 143/146 2024-09-13T18:35:01.186 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 144/146 2024-09-13T18:35:01.186 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 145/146 2024-09-13T18:35:03.356 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 146/146 2024-09-13T18:35:03.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:03.356 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-13T18:35:03.356 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-1:1.49.90-1.el9.x86_64 2024-09-13T18:35:03.356 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-libnm-1:1.49.90-1.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-team-1:1.49.90-1.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: NetworkManager-tui-1:1.49.90-1.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: automake-1.16.2-8.el9.noarch 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: bison-3.7.4-5.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.357 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-volume-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: cephfs-top-2:18.2.4-860.g6c6b083f.el9.noarch 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: flex-2.6.4-9.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T18:35:03.359 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T18:35:03.360 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T18:35:03.360 INFO:teuthology.orchestra.run.smithi192.stdout: fmt-8.1.1-5.el9.x86_64 2024-09-13T18:35:03.360 INFO:teuthology.orchestra.run.smithi192.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-13T18:35:03.360 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T18:35:03.360 INFO:teuthology.orchestra.run.smithi192.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T18:35:03.361 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T18:35:03.362 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-13.16-1.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.363 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T18:35:03.364 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T18:35:03.365 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T18:35:03.366 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.367 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:18.2.4-860.g6c6b083f.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-13T18:35:03.368 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:03.369 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-13T18:35:03.926 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:03.927 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:35:04.078 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:35:04.122 INFO:teuthology.orchestra.run.smithi192.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:35:04.123 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:35:04.123 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:35:04.125 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3 2024-09-13T18:35:04.270 DEBUG:teuthology.orchestra.run.smithi194:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T18:35:04.320 INFO:teuthology.orchestra.run.smithi194.stdout:18.2.4-860.g6c6b083f.el9 2024-09-13T18:35:04.321 INFO:teuthology.packaging:The installed version of ceph is 18.2.4-860.g6c6b083f.el9 2024-09-13T18:35:04.321 INFO:teuthology.task.install:The correct ceph version 18.2.4-860.g6c6b083f is installed. 2024-09-13T18:35:04.323 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T18:35:04.323 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:04.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:35:04.383 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:04.383 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T18:35:04.444 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T18:35:04.445 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:04.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:35:04.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:35:04.599 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:04.599 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T18:35:04.656 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T18:35:04.752 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T18:35:04.752 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:04.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:35:04.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:35:04.917 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:04.917 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T18:35:04.972 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T18:35:05.069 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T18:35:05.069 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:05.069 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:35:05.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:35:05.222 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:05.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T18:35:05.277 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T18:35:05.372 INFO:teuthology.run_tasks:Running task ceph... 2024-09-13T18:35:05.452 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-13T18:35:05.452 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /var/log/ceph 2024-09-13T18:35:05.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 777 /var/log/ceph 2024-09-13T18:35:05.513 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-13T18:35:05.513 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:35:05.517 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-13T18:35:05.573 INFO:tasks.ceph:Creating extra log directories... 2024-09-13T18:35:05.573 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:35:05.577 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-13T18:35:05.639 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-13T18:35:05.639 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-13T18:35:05.639 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-13T18:35:05.640 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:05.640 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:35:05.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:05.852 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:05.914 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:05.914 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-13T18:35:05.949 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:06.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:06.187 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-13T18:35:06.187 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-13T18:35:06.188 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991', 'branch': 'wip-rishabh-testing-20240910.100730-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full}', 'email': None, 'first_in_suite': False, 'job_id': '7903991', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240910.100730-reef'}, 'ceph': {'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240910.100730-reef', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6439, 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'sleep_before_teardown': 0, 'subset': '964/1024', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240910.100730-reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi192.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBG+FKXfHyDAI388pAzNkG9iN/+a6FlEr/n7nD5kIo66Dd++5mTFFvMJ1PwTXkrS8SdawLNf3Feagw/suQMDDHas=', 'smithi194.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOQri4ZhPaft15AKHIODYXUxGJIy+tosH7V8FPugKotbayy7cJBiMk9KCskWFQMX67BNkBG0WGHb+0JeXP1wRDU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '6c6b083f148f500c4f56d402b9e4ffcab6f1e2d3', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_14:42:16', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-13T18:35:06.188 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:35:06.192 DEBUG:teuthology.orchestra.run.smithi194:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-13T18:35:06.227 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:35:06.269 DEBUG:teuthology.orchestra.run.smithi194:> sudo install -d -m0777 -- /var/run/ceph 2024-09-13T18:35:06.326 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:06.326 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:35:06.361 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:35:06.361 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-13T18:35:06.435 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:35:06.435 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-13 18:34:56.274725042 +0000 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-13 18:32:55.987364429 +0000 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-13 18:32:55.988364409 +0000 2024-09-13T18:35:06.436 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-13 18:32:55.987364429 +0000 2024-09-13T18:35:06.436 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:35:06.528 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-13T18:35:06.528 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-13T18:35:06.528 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000335344 s, 1.5 MB/s 2024-09-13T18:35:06.530 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:35:06.566 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-13T18:35:06.641 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-13 18:34:56.275725022 +0000 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-13 18:32:56.480354703 +0000 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-13 18:32:56.480354703 +0000 2024-09-13T18:35:06.642 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-13 18:32:56.480354703 +0000 2024-09-13T18:35:06.642 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:35:06.733 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-13T18:35:06.733 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-13T18:35:06.733 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000273678 s, 1.9 MB/s 2024-09-13T18:35:06.736 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:35:06.772 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-13T18:35:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:35:06.847 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-13 18:34:56.275725022 +0000 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-13 18:32:56.977344898 +0000 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-13 18:32:56.977344898 +0000 2024-09-13T18:35:06.848 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-13 18:32:56.977344898 +0000 2024-09-13T18:35:06.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:35:06.939 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-13T18:35:06.939 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-13T18:35:06.939 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000292856 s, 1.7 MB/s 2024-09-13T18:35:06.942 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:35:06.978 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 6h/6d Inode: 689 Links: 1 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-13 18:34:56.276725002 +0000 2024-09-13T18:35:07.054 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-13 18:32:57.472335133 +0000 2024-09-13T18:35:07.055 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-13 18:32:57.472335133 +0000 2024-09-13T18:35:07.055 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-13 18:32:57.472335133 +0000 2024-09-13T18:35:07.055 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:35:07.158 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-13T18:35:07.158 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-13T18:35:07.158 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.00028486 s, 1.8 MB/s 2024-09-13T18:35:07.161 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:35:07.197 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:07.197 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:07.197 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T18:35:07.234 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T18:35:07.234 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_1 2024-09-13T18:35:07.309 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T18:35:07.309 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 18:34:48.731156094 +0000 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 18:32:55.996385686 +0000 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 18:32:55.996385686 +0000 2024-09-13T18:35:07.310 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 18:32:55.996385686 +0000 2024-09-13T18:35:07.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T18:35:07.401 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T18:35:07.401 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T18:35:07.402 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000258532 s, 2.0 MB/s 2024-09-13T18:35:07.404 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T18:35:07.441 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_2 2024-09-13T18:35:07.517 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T18:35:07.517 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:07.517 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-09-13T18:35:07.517 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:07.518 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:07.518 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 18:34:48.731156094 +0000 2024-09-13T18:35:07.518 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 18:32:56.465375507 +0000 2024-09-13T18:35:07.518 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 18:32:56.465375507 +0000 2024-09-13T18:35:07.518 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 18:32:56.465375507 +0000 2024-09-13T18:35:07.518 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T18:35:07.610 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T18:35:07.610 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T18:35:07.610 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000274005 s, 1.9 MB/s 2024-09-13T18:35:07.612 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T18:35:07.649 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_3 2024-09-13T18:35:07.724 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 18:34:48.732156072 +0000 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 18:32:56.966364633 +0000 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 18:32:56.966364633 +0000 2024-09-13T18:35:07.725 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 18:32:56.966364633 +0000 2024-09-13T18:35:07.725 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T18:35:07.816 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T18:35:07.816 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T18:35:07.816 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000281401 s, 1.8 MB/s 2024-09-13T18:35:07.819 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T18:35:07.855 DEBUG:teuthology.orchestra.run.smithi194:> stat /dev/vg_nvme/lv_4 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Access: 2024-09-13 18:34:48.733156051 +0000 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Modify: 2024-09-13 18:32:57.440354345 +0000 2024-09-13T18:35:07.930 INFO:teuthology.orchestra.run.smithi194.stdout:Change: 2024-09-13 18:32:57.440354345 +0000 2024-09-13T18:35:07.931 INFO:teuthology.orchestra.run.smithi194.stdout: Birth: 2024-09-13 18:32:57.440354345 +0000 2024-09-13T18:35:07.931 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T18:35:08.023 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records in 2024-09-13T18:35:08.023 INFO:teuthology.orchestra.run.smithi194.stderr:1+0 records out 2024-09-13T18:35:08.023 INFO:teuthology.orchestra.run.smithi194.stderr:512 bytes copied, 0.000271827 s, 1.9 MB/s 2024-09-13T18:35:08.026 DEBUG:teuthology.orchestra.run.smithi194:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T18:35:08.062 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:08.062 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:35:08.062 INFO:tasks.ceph:Generating config... 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] debug client = 20 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] debug ms = 1 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] pid file = 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client.0] debug client = 20 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client.0] debug objecter = 20 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client.1] debug client = 20 2024-09-13T18:35:08.064 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2024-09-13T18:35:08.065 INFO:tasks.ceph:[client.1] debug objecter = 20 2024-09-13T18:35:08.065 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-13T18:35:08.065 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2024-09-13T18:35:08.066 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-13T18:35:08.066 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-13T18:35:08.067 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2024-09-13T18:35:08.068 INFO:tasks.ceph:[osd] osd mon report interval = 5 2024-09-13T18:35:08.068 INFO:tasks.ceph:[osd] osd objectstore = memstore 2024-09-13T18:35:08.068 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-13T18:35:08.068 INFO:tasks.ceph:Setting up mon.a... 2024-09-13T18:35:08.068 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-13T18:35:08.167 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.keyring 2024-09-13T18:35:08.173 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-13T18:35:08.260 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:35:08.315 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.192'), ('mon.b', '172.21.15.194'), ('mon.c', '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]')] 2024-09-13T18:35:08.315 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.192,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-13T18:35:08.317 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:08.317 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:35:08.352 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.192 --add b 172.21.15.194 --addv c '[v2:172.21.15.194:3301,v1:172.21.15.194:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:08.466 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:08.466 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: generated fsid 5e3ff1eb-2fb8-41d1-9304-859f6d9757cb 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:setting min_mon_release = pacific 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 0 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:fsid 5e3ff1eb-2fb8-41d1-9304-859f6d9757cb 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:last_changed 2024-09-13T18:35:08.465207+0000 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:created 2024-09-13T18:35:08.465207+0000 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:min_mon_release 16 (pacific) 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:election_strategy: 1 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:0: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.a 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:1: [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] mon.b 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:2: [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] mon.c 2024-09-13T18:35:08.467 INFO:teuthology.orchestra.run.smithi192.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-13T18:35:08.469 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-13T18:35:08.504 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5e3ff1eb-2fb8-41d1-9304-859f6d9757cb... 2024-09-13T18:35:08.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:35:08.548 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-13T18:35:08.641 INFO:teuthology.orchestra.run.smithi192.stdout:[global] 2024-09-13T18:35:08.641 INFO:teuthology.orchestra.run.smithi192.stdout: chdir = "" 2024-09-13T18:35:08.641 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:35:08.641 INFO:teuthology.orchestra.run.smithi192.stdout: auth supported = cephx 2024-09-13T18:35:08.641 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: filestore xattr use omap = true 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: mon clock drift allowed = 1.000 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: osd crush chooseleaf type = 0 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: auth debug = true 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on old message = true 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on bug = true 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:35:08.642 INFO:teuthology.orchestra.run.smithi192.stdout: mon pg warn max object skew = 0 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default size = 2 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow primary affinity = true 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd allow pg remap = true 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on no sortbitwise = false 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on too few osds = false 2024-09-13T18:35:08.643 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon_allow_pool_size_one = true 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: osd default data pool replay window = 5 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon allow pool delete = true 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon cluster log file level = debug 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: debug asserts on shutdown = true 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon health detail to clog = false 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: mon host = "172.21.15.192,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-09-13T18:35:08.644 INFO:teuthology.orchestra.run.smithi192.stdout: ms die on skipped message = False 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: fsid = 5e3ff1eb-2fb8-41d1-9304-859f6d9757cb 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout:[osd] 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd journal size = 100 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub load threshold = 5.0 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd scrub max interval = 600 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd recover clone overlap = true 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd recovery max chunk = 1048576 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.645 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug shutdown = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug op order = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug verify stray on activate = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd open classes on start = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug pg log writeout = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: osd map max advance = 10 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: journal zero on create = true 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:35:08.646 INFO:teuthology.orchestra.run.smithi192.stdout: filestore apply finisher threads = 3 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bdev debug aio = true 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: osd debug misdirected ops = true 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bdev async discard = True 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bdev enable discard = True 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore allocator = bitmap 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore block size = 96636764160 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: bluestore fsck on mount = True 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluefs = 1/20 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: debug bluestore = 1/20 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: debug osd = 20 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: debug rocksdb = 4/10 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: memstore device bytes = 200000000 2024-09-13T18:35:08.647 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.9 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: osd failsafe full ratio = 1.0 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: osd mon report interval = 5 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: osd objectstore = memstore 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr] 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: debug mgr = 20 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:35:08.648 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mgr/telemetry/nag = false 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout:[mon] 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: debug mon = 20 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: debug paxos = 20 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: debug auth = 20 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon data avail warn = 5 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon mgr mkfs grace = 240 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd reporter subtree level = osd 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd prime pg temp = true 2024-09-13T18:35:08.649 INFO:teuthology.orchestra.run.smithi192.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: # 1m isn't quite enough 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:35:08.650 INFO:teuthology.orchestra.run.smithi192.stdout: mon op complaint time = 120 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd backfillfull ratio = 0.6 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd full ratio = 0.7 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: mon osd nearfull ratio = 0.6 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: mon warn on pool no app = False 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout:[client] 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: rgw cache enabled = true 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable ops log = true 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: rgw enable usage log = true 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: client mount timeout = 600 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-13T18:35:08.651 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout: pid file = "" 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.a] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.b] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mon.c] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-13T18:35:08.652 INFO:teuthology.orchestra.run.smithi192.stdout: debug objectcacher = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug objecter = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug client = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug objectcacher = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug objecter = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout:[mds] 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug mds balancer = 20 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: debug ms = 1 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug frag = True 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: mds debug scatterstat = True 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: mds op complaint time = 180 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: mds verify scatter = True 2024-09-13T18:35:08.653 INFO:teuthology.orchestra.run.smithi192.stdout: osd op complaint time = 180 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi192.stdout: rados mon op timeout = 900 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi192.stdout: rados osd op timeout = 900 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout:[global] 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: chdir = "" 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: auth supported = cephx 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.654 INFO:teuthology.orchestra.run.smithi194.stdout: filestore xattr use omap = true 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon clock drift allowed = 1.000 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: osd crush chooseleaf type = 0 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: auth debug = true 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on old message = true 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on bug = true 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: mon pg warn max object skew = 0 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: # disable pg_autoscaler by default for new pools 2024-09-13T18:35:08.655 INFO:teuthology.orchestra.run.smithi194.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default size = 2 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow primary affinity = true 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd allow pg remap = true 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on legacy crush tunables = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on crush straw calc version zero = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on no sortbitwise = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on osd down out interval zero = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on too few osds = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-13T18:35:08.656 INFO:teuthology.orchestra.run.smithi194.stdout: mon_allow_pool_size_one = true 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: osd default data pool replay window = 5 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon allow pool delete = true 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon cluster log file level = debug 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: debug asserts on shutdown = true 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon health detail to clog = false 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: mon host = "172.21.15.192,172.21.15.194,[v2:172.21.15.194:3301,v1:172.21.15.194:6790]" 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: ms die on skipped message = False 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: fsid = 5e3ff1eb-2fb8-41d1-9304-859f6d9757cb 2024-09-13T18:35:08.657 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout:[osd] 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd journal size = 100 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub load threshold = 5.0 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd scrub max interval = 600 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd mclock profile = high_recovery_ops 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd recover clone overlap = true 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd recovery max chunk = 1048576 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug shutdown = true 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug op order = true 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug verify stray on activate = true 2024-09-13T18:35:08.658 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd open classes on start = true 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug pg log writeout = true 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd deep scrub update digest min age = 30 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd map max advance = 10 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: journal zero on create = true 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: filestore ondisk finisher threads = 3 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: filestore apply finisher threads = 3 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: bdev debug aio = true 2024-09-13T18:35:08.659 INFO:teuthology.orchestra.run.smithi194.stdout: osd debug misdirected ops = true 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: bdev async discard = True 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: bdev enable discard = True 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore allocator = bitmap 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore block size = 96636764160 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: bluestore fsck on mount = True 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluefs = 1/20 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug bluestore = 1/20 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug osd = 20 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: debug rocksdb = 4/10 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: memstore device bytes = 200000000 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull_ratio = 0.85 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.9 2024-09-13T18:35:08.660 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.8 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: osd failsafe full ratio = 1.0 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: osd mon report interval = 5 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: osd objectstore = memstore 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr] 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug mgr = 20 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:35:08.661 INFO:teuthology.orchestra.run.smithi194.stdout: mgr/telemetry/nag = false 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout:[mon] 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: debug mon = 20 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: debug paxos = 20 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: debug auth = 20 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon data avail warn = 5 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon mgr mkfs grace = 240 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min pgs per osd = 4 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd reporter subtree level = osd 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd prime pg temp = true 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: mon reweight min bytes per osd = 10 2024-09-13T18:35:08.662 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: auth mon ticket ttl = 660 # 11m 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: auth service ticket ttl = 240 # 4m 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: # don't complain about insecure global_id in the test suite 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: # 1m isn't quite enough 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon_down_mkfs_grace = 2m 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon_warn_on_filestore_osds = false 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon op complaint time = 120 2024-09-13T18:35:08.663 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd backfillfull ratio = 0.6 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd full ratio = 0.7 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: mon osd nearfull ratio = 0.6 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: mon warn on pool no app = False 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout:[client] 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: rgw cache enabled = true 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable ops log = true 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: rgw enable usage log = true 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: client mount timeout = 600 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-13T18:35:08.664 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: pid file = "" 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.a] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.b] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mon.c] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: debug objectcacher = 20 2024-09-13T18:35:08.665 INFO:teuthology.orchestra.run.smithi194.stdout: debug objecter = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug client = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug objectcacher = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug objecter = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout:[mds] 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug mds balancer = 20 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: debug ms = 1 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug frag = True 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: mds debug scatterstat = True 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: mds op complaint time = 180 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: mds verify scatter = True 2024-09-13T18:35:08.666 INFO:teuthology.orchestra.run.smithi194.stdout: osd op complaint time = 180 2024-09-13T18:35:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: rados mon op timeout = 900 2024-09-13T18:35:08.667 INFO:teuthology.orchestra.run.smithi194.stdout: rados osd op timeout = 900 2024-09-13T18:35:08.672 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-13T18:35:08.672 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-13T18:35:08.768 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-13T18:35:08.768 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:08.768 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-13T18:35:08.803 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:08.803 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-13T18:35:08.879 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:35:08.879 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:08.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:35:08.879 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:35:08.996 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:08.996 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:09.071 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:35:09.071 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:09.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-13T18:35:09.071 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-13T18:35:09.148 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:09.148 DEBUG:teuthology.orchestra.run.smithi194:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:09.223 INFO:tasks.ceph:Setting up mon nodes... 2024-09-13T18:35:09.223 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-13T18:35:09.223 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:35:09.326 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-13T18:35:09.333 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:35:09.447 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-13T18:35:09.453 INFO:tasks.ceph:Setting up mds nodes... 2024-09-13T18:35:09.454 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:35:09.556 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-13T18:35:09.562 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-13T18:35:09.618 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:35:09.720 INFO:teuthology.orchestra.run.smithi192.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-13T18:35:09.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-13T18:35:09.781 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:35:09.885 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-13T18:35:09.890 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-13T18:35:09.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:35:10.047 INFO:teuthology.orchestra.run.smithi194.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-13T18:35:10.052 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-13T18:35:10.108 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-13T18:35:10.108 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T18:35:10.191 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-13T18:35:10.218 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-13T18:35:10.297 INFO:teuthology.orchestra.run.smithi192.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-13T18:35:10.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T18:35:10.405 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-13T18:35:10.433 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-13T18:35:10.513 INFO:teuthology.orchestra.run.smithi194.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-13T18:35:10.540 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-13T18:35:10.541 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi192.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi194.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-13T18:35:10.541 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:10.597 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:10.597 INFO:tasks.ceph:role: osd.0 2024-09-13T18:35:10.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:35:10.598 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:35:10.659 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:10.659 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:10.660 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:11.071 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-13T18:35:11.075 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-13T18:35:11.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:11.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:11.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:11.321 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:11.321 INFO:tasks.ceph:role: osd.1 2024-09-13T18:35:11.321 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:35:11.322 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:35:11.383 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:11.384 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:11.738 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-13T18:35:11.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-13T18:35:11.743 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:11.829 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:11.895 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:11.971 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:11.971 INFO:tasks.ceph:role: osd.2 2024-09-13T18:35:11.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:35:11.971 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:12.039 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:12.040 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:12.422 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-13T18:35:12.426 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-13T18:35:12.426 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:12.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:12.588 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:12.644 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:12.644 INFO:tasks.ceph:role: osd.3 2024-09-13T18:35:12.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:35:12.644 DEBUG:teuthology.orchestra.run.smithi192:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:35:12.707 INFO:teuthology.orchestra.run.smithi192.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:12.707 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:12.707 INFO:teuthology.orchestra.run.smithi192.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:12.707 INFO:teuthology.orchestra.run.smithi192.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:12.708 INFO:teuthology.orchestra.run.smithi192.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:13.116 INFO:teuthology.orchestra.run.smithi192.stdout:Discarding blocks...Done. 2024-09-13T18:35:13.120 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi192.front.sepia.ceph.com -o noatime 2024-09-13T18:35:13.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:13.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:13.320 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:13.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.416+0000 7f64c6e1a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-13T18:35:13.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.421+0000 7f64c6e1a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-13T18:35:13.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.430+0000 7f64c6e1a640 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:13.460 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T18:35:13.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:13.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.602+0000 7f2dd7a0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-13T18:35:13.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.603+0000 7f2dd7a0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-13T18:35:13.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.605+0000 7f2dd7a0c640 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:13.621 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T18:35:13.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:13.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.763+0000 7f1ff9c20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-13T18:35:13.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.764+0000 7f1ff9c20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-13T18:35:13.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.766+0000 7f1ff9c20640 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:13.786 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T18:35:13.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:13.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.928+0000 7fe794618640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-13T18:35:13.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.929+0000 7fe794618640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-13T18:35:13.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:13.930+0000 7fe794618640 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:13.947 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T18:35:14.004 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:14.066 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:14.066 INFO:tasks.ceph:role: osd.4 2024-09-13T18:35:14.066 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:35:14.066 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-13T18:35:14.133 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:14.133 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:14.133 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:14.133 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:14.133 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:14.134 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:14.134 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:14.134 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:14.134 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:14.134 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:14.540 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T18:35:14.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T18:35:14.544 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:14.692 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:14.756 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:14.812 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:14.812 INFO:tasks.ceph:role: osd.5 2024-09-13T18:35:14.812 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:35:14.812 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-13T18:35:14.874 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:14.874 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:14.874 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:14.874 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:14.874 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:14.875 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:14.875 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:14.875 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:14.875 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:14.875 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:15.231 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T18:35:15.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T18:35:15.235 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:15.319 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:15.381 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:15.437 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:15.437 INFO:tasks.ceph:role: osd.6 2024-09-13T18:35:15.437 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:35:15.437 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-13T18:35:15.499 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:15.500 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:15.891 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T18:35:15.895 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T18:35:15.895 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:15.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:16.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:16.104 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-13T18:35:16.104 INFO:tasks.ceph:role: osd.7 2024-09-13T18:35:16.104 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:35:16.105 DEBUG:teuthology.orchestra.run.smithi194:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout: = sunit=0 swidth=0 blks 2024-09-13T18:35:16.169 INFO:teuthology.orchestra.run.smithi194.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-13T18:35:16.170 INFO:teuthology.orchestra.run.smithi194.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-13T18:35:16.170 INFO:teuthology.orchestra.run.smithi194.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-13T18:35:16.170 INFO:teuthology.orchestra.run.smithi194.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-13T18:35:16.592 INFO:teuthology.orchestra.run.smithi194.stdout:Discarding blocks...Done. 2024-09-13T18:35:16.596 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi194.front.sepia.ceph.com -o noatime 2024-09-13T18:35:16.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:16.737 DEBUG:teuthology.orchestra.run.smithi194:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:16.801 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:16.906 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:16.903+0000 7f321360f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-13T18:35:16.909 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:16.907+0000 7f321360f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-13T18:35:16.917 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:16.915+0000 7f321360f640 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:16.945 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T18:35:17.001 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:17.091 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.088+0000 7f809d416640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-13T18:35:17.093 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.091+0000 7f809d416640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-13T18:35:17.099 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.097+0000 7f809d416640 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:17.116 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T18:35:17.172 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:17.260 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.258+0000 7f482c60e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-13T18:35:17.261 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.259+0000 7f482c60e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-13T18:35:17.263 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.261+0000 7f482c60e640 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:17.281 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-13T18:35:17.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:17.425 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.423+0000 7f4921e1f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-13T18:35:17.426 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.423+0000 7f4921e1f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-13T18:35:17.427 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:17.425+0000 7f4921e1f640 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:17.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-13T18:35:17.497 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-13T18:35:17.497 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.498 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-13T18:35:17.559 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.560 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-13T18:35:17.658 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.658 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-13T18:35:17.755 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-13T18:35:17.851 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-13T18:35:17.947 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:17.948 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-13T18:35:18.042 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:18.042 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-13T18:35:18.138 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.138 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-13T18:35:18.197 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-13T18:35:18.292 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.293 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-13T18:35:18.388 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.388 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-13T18:35:18.483 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.483 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-13T18:35:18.579 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.579 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-13T18:35:18.675 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.675 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-13T18:35:18.771 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:18.771 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-13T18:35:18.809 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:18.809 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-13T18:35:18.886 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.886 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-13T18:35:18.921 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:18.921 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-13T18:35:18.996 INFO:tasks.ceph:Adding keys to all mons... 2024-09-13T18:35:18.996 DEBUG:teuthology.orchestra.run.smithi192:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:35:19.000 DEBUG:teuthology.orchestra.run.smithi194:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-13T18:35:19.050 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.y] 2024-09-13T18:35:19.050 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw== 2024-09-13T18:35:19.050 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.a] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A== 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.c] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw== 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.0] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA== 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.1] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw== 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.2] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA== 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.3] 2024-09-13T18:35:19.051 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[mgr.x] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.b] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[mds.d] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.4] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.5] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.6] 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA== 2024-09-13T18:35:19.052 INFO:teuthology.orchestra.run.smithi192.stdout:[osd.7] 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ== 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout:[client.0] 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA== 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout:[client.2] 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w== 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg== 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout:[client.3] 2024-09-13T18:35:19.053 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ== 2024-09-13T18:35:19.088 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.y] 2024-09-13T18:35:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw== 2024-09-13T18:35:19.088 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.a] 2024-09-13T18:35:19.088 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A== 2024-09-13T18:35:19.088 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.c] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.0] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.1] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.2] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.3] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[mgr.x] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew== 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.b] 2024-09-13T18:35:19.089 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[mds.d] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.4] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.5] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.6] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[osd.7] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[client.0] 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA== 2024-09-13T18:35:19.090 INFO:teuthology.orchestra.run.smithi194.stdout:[client.2] 2024-09-13T18:35:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w== 2024-09-13T18:35:19.091 INFO:teuthology.orchestra.run.smithi194.stdout:[client.1] 2024-09-13T18:35:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg== 2024-09-13T18:35:19.091 INFO:teuthology.orchestra.run.smithi194.stdout:[client.3] 2024-09-13T18:35:19.091 INFO:teuthology.orchestra.run.smithi194.stdout: key = AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ== 2024-09-13T18:35:19.093 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:35:19.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:35:19.225 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:19.229 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:19.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:19.328 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:19.422 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.426 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.518 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.522 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.615 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.619 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.711 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.715 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:19.808 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:35:19.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-13T18:35:19.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:19.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:20.004 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:20.008 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-13T18:35:20.102 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.107 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.199 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.203 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.300 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.396 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-13T18:35:20.488 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.492 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.587 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.591 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.691 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.785 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-13T18:35:20.885 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-13T18:35:20.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-13T18:35:20.940 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:35:21.047 DEBUG:teuthology.orchestra.run.smithi192:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-13T18:35:21.103 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-13T18:35:21.158 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:35:21.265 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-13T18:35:21.321 DEBUG:teuthology.orchestra.run.smithi194:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-13T18:35:21.376 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-13T18:35:21.482 DEBUG:teuthology.orchestra.run.smithi194:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-13T18:35:21.537 DEBUG:teuthology.orchestra.run.smithi192:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:21.541 DEBUG:teuthology.orchestra.run.smithi194:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-13T18:35:21.575 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-13T18:35:21.575 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-13T18:35:21.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-13T18:35:21.617 INFO:tasks.ceph.mon.a:Started 2024-09-13T18:35:21.618 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-13T18:35:21.618 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-13T18:35:21.621 INFO:tasks.ceph.mon.b:Started 2024-09-13T18:35:21.622 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-13T18:35:21.622 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-13T18:35:21.625 INFO:tasks.ceph.mon.c:Started 2024-09-13T18:35:21.625 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-13T18:35:21.625 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-13T18:35:21.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-13T18:35:21.629 INFO:tasks.ceph.mgr.y:Started 2024-09-13T18:35:21.629 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-13T18:35:21.630 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-13T18:35:21.633 INFO:tasks.ceph.mgr.x:Started 2024-09-13T18:35:21.633 INFO:tasks.ceph:Setting crush tunables to default 2024-09-13T18:35:21.633 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph osd crush tunables default 2024-09-13T18:35:21.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.783+0000 7f299e400640 1 Processor -- start 2024-09-13T18:35:21.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.784+0000 7f299e400640 1 -- start start 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299e400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980ce610 con 0x7f299815d230 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299806b260 con 0x7f29980cd5e0 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f299815d610 con 0x7f299806acc0 2024-09-13T18:35:21.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299d000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f299815d230 0x7f29980cdde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48570/0 (socket says 172.21.15.192:48570) 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299d000640 1 -- 172.21.15.192:0/2869312342 learned_addr learned my addr 172.21.15.192:0/2869312342 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.785+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.786+0000 7f299da00640 1 -- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 msgr2=0x7f2998167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.786+0000 7f299da00640 1 -- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 msgr2=0x7f2998167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:35:21.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.786+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:35:21.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.786+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T18:35:21.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.987+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:21.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.987+0000 7f299da00640 1 -- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 msgr2=0x7f2998167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-09-13T18:35:21.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.987+0000 7f299da00640 1 -- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 msgr2=0x7f2998167ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-13T18:35:21.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.987+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-13T18:35:21.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.987+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.998+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752018853 0 0) 0x7f299806b260 con 0x7f29980cd5e0 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.998+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2980003520 con 0x7f29980cd5e0 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.998+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959165351 0 0) 0x7f29980ce610 con 0x7f299815d230 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.998+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f299806b260 con 0x7f299815d230 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3530676312 0 0) 0x7f299806b260 con 0x7f299815d230 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 msgr2=0x7f2998167ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 --2- 172.21.15.192:0/2869312342 >> v2:172.21.15.194:3300/0 conn(0x7f299806acc0 0x7f2998167ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 >> v1:172.21.15.194:6789/0 conn(0x7f29980cd5e0 legacy=0x7f299806a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299806b520 con 0x7f299815d230 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f298c001690 con 0x7f299815d230 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 >> v1:172.21.15.192:6789/0 conn(0x7f299815d230 legacy=0x7f29980cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 0x7f2980003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29800047c0 0x7f2980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980005180 0x7f298000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298000c080 con 0x7f2980003b00 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f298000c1f0 con 0x7f2980005180 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f298000c3b0 con 0x7f29800047c0 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f299d000640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 0x7f2980003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:21.999+0000 7f299da00640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980005180 0x7f298000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f2997e00640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29800047c0 0x7f2980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299d000640 1 -- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29800047c0 msgr2=0x7f2980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299d000640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29800047c0 0x7f2980004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299d000640 1 -- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980005180 msgr2=0x7f298000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:22.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299d000640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2980005180 0x7f298000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299d000640 1 -- 172.21.15.192:0/2869312342 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299806b260 con 0x7f2980003b00 2024-09-13T18:35:22.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f299da00640 1 -- 172.21.15.192:0/2869312342 reap_dead start 2024-09-13T18:35:22.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.000+0000 7f2997e00640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f29800047c0 0x7f2980004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:22.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.001+0000 7f299d000640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 0x7f2980003f00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f298c001eb0 tx=0x7f29800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8494dc3483b579 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.002+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c005ad0 con 0x7f2980003b00 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.002+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c02d070 con 0x7f2980003b00 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.002+0000 7f2997400640 1 -- 172.21.15.192:0/2869312342 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c005e70 con 0x7f2980003b00 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 -- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 msgr2=0x7f2980003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 0x7f2980003f00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f298c001eb0 tx=0x7f29800057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 -- 172.21.15.192:0/2869312342 shutdown_connections 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 --2- 172.21.15.192:0/2869312342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2980003b00 0x7f2980003f00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 -- 172.21.15.192:0/2869312342 >> 172.21.15.192:0/2869312342 conn(0x7f29980cf800 msgr2=0x7f29980cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 -- 172.21.15.192:0/2869312342 shutdown_connections 2024-09-13T18:35:22.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.003+0000 7f299e400640 1 -- 172.21.15.192:0/2869312342 wait complete. 2024-09-13T18:35:22.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.005+0000 7f299e400640 1 Processor -- start 2024-09-13T18:35:22.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.005+0000 7f299e400640 1 -- start start 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 0x7f299814e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29980cace0 0x7f299815fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299815db90 con 0x7f29980ca860 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299814ec20 con 0x7f29980cace0 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29980cb870 con 0x7f2980003b00 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 0x7f299814e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f2997e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f2997e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45232/0 (socket says 172.21.15.192:45232) 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f2997e00640 1 -- 172.21.15.192:0/1264679626 learned_addr learned my addr 172.21.15.192:0/1264679626 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299d000640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 0x7f299814e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37198/0 (socket says 172.21.15.192:37198) 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.006+0000 7f299da00640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29980cace0 0x7f299815fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 -- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 msgr2=0x7f299814e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 0x7f299814e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 -- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29980cace0 msgr2=0x7f299815fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29980cace0 0x7f299815fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 -- 172.21.15.192:0/1264679626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980cb2b0 con 0x7f29980ca860 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2997e00640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f298400e780 tx=0x7f298400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984001d30 con 0x7f29980ca860 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29840050d0 con 0x7f29980ca860 2024-09-13T18:35:22.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29980cb590 con 0x7f29980ca860 2024-09-13T18:35:22.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.007+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2984005460 con 0x7f29980ca860 2024-09-13T18:35:22.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.008+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f299814e6a0 con 0x7f29980ca860 2024-09-13T18:35:22.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.008+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f298400c9c0 con 0x7f29980ca860 2024-09-13T18:35:22.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.008+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2984003cd0 con 0x7f29980ca860 2024-09-13T18:35:22.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.009+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f299815d610 con 0x7f29980ca860 2024-09-13T18:35:22.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.013+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f299815d610 con 0x7f29980ca860 2024-09-13T18:35:22.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.080+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f299815dcd0 con 0x7f29980ca860 2024-09-13T18:35:22.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.086+0000 7f2994c00640 1 -- 172.21.15.192:0/1264679626 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f299815dcd0 con 0x7f29980ca860 2024-09-13T18:35:22.089 INFO:teuthology.orchestra.run.smithi192.stderr:adjusted tunables profile to default 2024-09-13T18:35:22.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 msgr2=0x7f299815f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f298400e780 tx=0x7f298400ec40 comp rx=0 tx=0).stop 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 shutdown_connections 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f29980cace0 0x7f299815fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f29980ca860 0x7f299815f5c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 --2- 172.21.15.192:0/1264679626 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2980003b00 0x7f299814e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 >> 172.21.15.192:0/1264679626 conn(0x7f29980cf800 msgr2=0x7f29980b6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 shutdown_connections 2024-09-13T18:35:22.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:22.087+0000 7f299e400640 1 -- 172.21.15.192:0/1264679626 wait complete. 2024-09-13T18:35:22.108 INFO:tasks.ceph:check_enable_crimson: False 2024-09-13T18:35:22.108 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-13T18:35:22.108 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:22.108 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-13T18:35:22.136 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.133+0000 7f344841f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:35:22.138 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.135+0000 7f27cf838040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-13T18:35:22.164 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:22.164 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-13T18:35:22.183 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.180+0000 7f344841f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:35:22.188 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.186+0000 7f27cf838040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-13T18:35:22.244 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:22.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-13T18:35:22.342 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:35:22.342 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-13T18:35:22.347 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.345+0000 7f344841f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:35:22.384 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.381+0000 7f27cf838040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-13T18:35:22.405 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.403+0000 7f344841f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:35:22.440 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:22.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-13T18:35:22.446 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.443+0000 7f27cf838040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-13T18:35:22.496 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:22.496 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-13T18:35:22.592 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:22.592 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-13T18:35:22.597 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.595+0000 7f344841f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:35:22.634 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.632+0000 7f27cf838040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:35:22.653 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:35:22.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-13T18:35:22.729 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:22.726+0000 7f344841f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:35:22.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2024-09-13T18:35:22.758 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:22.755+0000 7f27cf838040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-13T18:35:22.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.935+0000 7f39cfe00640 1 Processor -- start 2024-09-13T18:35:22.938 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.935+0000 7f39cfe00640 1 -- start start 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.936+0000 7f39cfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39d00b8a60 0x7f39d00b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.936+0000 7f39cfe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00b75c0 con 0x7f39d01604b0 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.936+0000 7f39cfe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00b69b0 con 0x7f39d0160890 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.936+0000 7f39cfe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d00b6c90 con 0x7f39d00b8a60 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39d00b8a60 0x7f39d00b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.939 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39d00b8a60 0x7f39d00b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43328/0 (socket says 172.21.15.194:43328) 2024-09-13T18:35:22.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 -- 172.21.15.194:0/3286209142 learned_addr learned my addr 172.21.15.194:0/3286209142 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:22.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 -- 172.21.15.194:0/3286209142 >> v1:172.21.15.194:6789/0 conn(0x7f39d0160890 legacy=0x7f39d00cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 -- 172.21.15.194:0/3286209142 >> v1:172.21.15.192:6789/0 conn(0x7f39d01604b0 legacy=0x7f39d00d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cf400640 1 -- 172.21.15.194:0/3286209142 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00b6f70 con 0x7f39d00b8a60 2024-09-13T18:35:22.940 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.937+0000 7f39cd600640 1 -- 172.21.15.194:0/3286209142 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829985983 0 0) 0x7f39d00b75c0 con 0x7f39d01604b0 2024-09-13T18:35:22.941 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.938+0000 7f39cf400640 1 --2- 172.21.15.194:0/3286209142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00b8a60 0x7f39d00b6300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009e50 tx=0x7f39c802a7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a70e75beb07515e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.938+0000 7f39cd600640 1 -- 172.21.15.194:0/3286209142 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8031600 con 0x7f39d00b8a60 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.938+0000 7f39cd600640 1 -- 172.21.15.194:0/3286209142 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c802d050 con 0x7f39d00b8a60 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.938+0000 7f39cd600640 1 -- 172.21.15.194:0/3286209142 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c80319a0 con 0x7f39d00b8a60 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 -- 172.21.15.194:0/3286209142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00b8a60 msgr2=0x7f39d00b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 --2- 172.21.15.194:0/3286209142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00b8a60 0x7f39d00b6300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f39c8009e50 tx=0x7f39c802a7c0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 -- 172.21.15.194:0/3286209142 shutdown_connections 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 --2- 172.21.15.194:0/3286209142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00b8a60 0x7f39d00b6300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 -- 172.21.15.194:0/3286209142 >> 172.21.15.194:0/3286209142 conn(0x7f39d00b4bb0 msgr2=0x7f39d00b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 -- 172.21.15.194:0/3286209142 shutdown_connections 2024-09-13T18:35:22.942 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.939+0000 7f39cfe00640 1 -- 172.21.15.194:0/3286209142 wait complete. 2024-09-13T18:35:22.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.940+0000 7f39cfe00640 1 Processor -- start 2024-09-13T18:35:22.943 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.941+0000 7f39cfe00640 1 -- start start 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.941+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.941+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d01604b0 0x7f39d0149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.941+0000 7f39cfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 0x7f39d00c8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cfe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d014a4d0 con 0x7f39d01604b0 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cfe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0149da0 con 0x7f39d00cc6f0 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cfe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c7c90 con 0x7f39d00b8a60 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cf400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 0x7f39d00c8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.946 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38096/0 (socket says 172.21.15.194:38096) 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 -- 172.21.15.194:0/589178747 learned_addr learned my addr 172.21.15.194:0/589178747 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39ce000640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d01604b0 0x7f39d0149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 -- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 msgr2=0x7f39d00c8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 0x7f39d00c8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 -- 172.21.15.194:0/589178747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d01604b0 msgr2=0x7f39d0149860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d01604b0 0x7f39d0149860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cea00640 1 -- 172.21.15.194:0/589178747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c8009b30 con 0x7f39d00b8a60 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.942+0000 7f39cf400640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 0x7f39d00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39cea00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c4b0 tx=0x7f39c000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0005480 con 0x7f39d00b8a60 2024-09-13T18:35:22.947 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c00035f0 con 0x7f39d00b8a60 2024-09-13T18:35:22.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d00c7f70 con 0x7f39d00b8a60 2024-09-13T18:35:22.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c00039e0 con 0x7f39d00b8a60 2024-09-13T18:35:22.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00c8530 con 0x7f39d00b8a60 2024-09-13T18:35:22.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f39c001c440 con 0x7f39d00b8a60 2024-09-13T18:35:22.948 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.943+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f39c0012790 con 0x7f39d00b8a60 2024-09-13T18:35:22.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.944+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d0167cf0 con 0x7f39d00b8a60 2024-09-13T18:35:22.949 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:22.947+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f39c0017070 con 0x7f39d00b8a60 2024-09-13T18:35:23.021 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.019+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f39d0067450 con 0x7f39d00b8a60 2024-09-13T18:35:23.029 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.026+0000 7f39c7400640 1 -- 172.21.15.194:0/589178747 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f39c0012a20 con 0x7f39d00b8a60 2024-09-13T18:35:23.029 INFO:teuthology.orchestra.run.smithi194.stdout:0 2024-09-13T18:35:23.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.027+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 msgr2=0x7f39d0149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.027+0000 7f39cfe00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f39c000c4b0 tx=0x7f39c000c970 comp rx=0 tx=0).stop 2024-09-13T18:35:23.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.027+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 shutdown_connections 2024-09-13T18:35:23.030 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.027+0000 7f39cfe00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39d00cc6f0 0x7f39d00c8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.027+0000 7f39cfe00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39d01604b0 0x7f39d0149860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.028+0000 7f39cfe00640 1 --2- 172.21.15.194:0/589178747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39d00b8a60 0x7f39d0149f90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.028+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 >> 172.21.15.194:0/589178747 conn(0x7f39d00b4bb0 msgr2=0x7f39d00ce280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.028+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 shutdown_connections 2024-09-13T18:35:23.031 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.028+0000 7f39cfe00640 1 -- 172.21.15.194:0/589178747 wait complete. 2024-09-13T18:35:23.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2024-09-13T18:35:23.109 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:23.107+0000 7f344841f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:35:23.128 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:23.124+0000 7f27cf838040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-13T18:35:23.175 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:23.172+0000 7f344841f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:35:23.193 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.191+0000 7fcc95c00640 1 Processor -- start 2024-09-13T18:35:23.194 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.191+0000 7fcc95c00640 1 -- start start 2024-09-13T18:35:23.194 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:23.191+0000 7f27cf838040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc95c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc901589f0 0x7fcc900b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc95c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcc900b3af0 0x7fcc9015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc95c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900b2000 con 0x7fcc9006c0b0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc95c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9015bbd0 con 0x7fcc900b3af0 2024-09-13T18:35:23.195 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc95c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc9015beb0 con 0x7fcc901589f0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc8ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc901589f0 0x7fcc900b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc8ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc901589f0 0x7fcc900b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43350/0 (socket says 172.21.15.194:43350) 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.192+0000 7fcc8ea00640 1 -- 172.21.15.194:0/4228348523 learned_addr learned my addr 172.21.15.194:0/4228348523 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.193+0000 7fcc8e000640 1 --2- 172.21.15.194:0/4228348523 >> v2:172.21.15.192:3300/0 conn(0x7fcc900b3af0 0x7fcc9015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.193+0000 7fcc8ea00640 1 -- 172.21.15.194:0/4228348523 >> v2:172.21.15.192:3300/0 conn(0x7fcc900b3af0 msgr2=0x7fcc9015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.193+0000 7fcc8ea00640 1 --2- 172.21.15.194:0/4228348523 >> v2:172.21.15.192:3300/0 conn(0x7fcc900b3af0 0x7fcc9015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.193+0000 7fcc8ea00640 1 -- 172.21.15.194:0/4228348523 >> v1:172.21.15.194:6789/0 conn(0x7fcc9006c0b0 legacy=0x7fcc900cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.196 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.193+0000 7fcc8ea00640 1 -- 172.21.15.194:0/4228348523 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9015c190 con 0x7fcc901589f0 2024-09-13T18:35:23.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.194+0000 7fcc8ea00640 1 --2- 172.21.15.194:0/4228348523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc901589f0 0x7fcc900b2490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc9006e230 tx=0x7fcc8002a1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e59f7d2d7d2c3553 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.197 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.194+0000 7fcc8d600640 1 -- 172.21.15.194:0/4228348523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80032440 con 0x7fcc901589f0 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.194+0000 7fcc8d600640 1 -- 172.21.15.194:0/4228348523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc800325a0 con 0x7fcc901589f0 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.194+0000 7fcc8d600640 1 -- 172.21.15.194:0/4228348523 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80032930 con 0x7fcc901589f0 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 -- 172.21.15.194:0/4228348523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc901589f0 msgr2=0x7fcc900b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 --2- 172.21.15.194:0/4228348523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc901589f0 0x7fcc900b2490 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc9006e230 tx=0x7fcc8002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 -- 172.21.15.194:0/4228348523 shutdown_connections 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 --2- 172.21.15.194:0/4228348523 >> v2:172.21.15.192:3300/0 conn(0x7fcc900b3af0 0x7fcc9015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 --2- 172.21.15.194:0/4228348523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc901589f0 0x7fcc900b2490 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 -- 172.21.15.194:0/4228348523 >> 172.21.15.194:0/4228348523 conn(0x7fcc900b08f0 msgr2=0x7fcc900b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 -- 172.21.15.194:0/4228348523 shutdown_connections 2024-09-13T18:35:23.198 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.195+0000 7fcc95c00640 1 -- 172.21.15.194:0/4228348523 wait complete. 2024-09-13T18:35:23.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.197+0000 7fcc95c00640 1 Processor -- start 2024-09-13T18:35:23.199 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.197+0000 7fcc95c00640 1 -- start start 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 0x7fcc901e1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc901589f0 0x7fcc900ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc901490b0 con 0x7fcc901589f0 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc901e2320 con 0x7fcc900b3af0 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc95c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc901e1a80 con 0x7fcc9006c0b0 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.201 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 0x7fcc901e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38106/0 (socket says 172.21.15.194:38106) 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8ea00640 1 -- 172.21.15.194:0/1687160994 learned_addr learned my addr 172.21.15.194:0/1687160994 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8f400640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc901589f0 0x7fcc900ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 -- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 msgr2=0x7fcc90148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 -- 172.21.15.194:0/1687160994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc901589f0 msgr2=0x7fcc900ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc901589f0 0x7fcc900ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8e000640 1 -- 172.21.15.194:0/1687160994 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc800094d0 con 0x7fcc900b3af0 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.198+0000 7fcc8ea00640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:23.202 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc8e000640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 0x7fcc901e1110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e850 tx=0x7fcc7c00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c0095b0 con 0x7fcc900b3af0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00c940 con 0x7fcc900b3af0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc901e1d60 con 0x7fcc900b3af0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00ccd0 con 0x7fcc900b3af0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc90148a70 con 0x7fcc900b3af0 2024-09-13T18:35:23.203 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fcc7c005c90 con 0x7fcc900b3af0 2024-09-13T18:35:23.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.199+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fcc7c013820 con 0x7fcc900b3af0 2024-09-13T18:35:23.204 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.200+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc901491f0 con 0x7fcc900b3af0 2024-09-13T18:35:23.205 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.203+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fcc901491f0 con 0x7fcc900b3af0 2024-09-13T18:35:23.276 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.273+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7fcc9015b260 con 0x7fcc900b3af0 2024-09-13T18:35:23.283 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.281+0000 7fcc86a00640 1 -- 172.21.15.194:0/1687160994 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc7c021060 con 0x7fcc900b3af0 2024-09-13T18:35:23.284 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 msgr2=0x7fcc901e1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 0x7fcc901e1110 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c00e850 tx=0x7fcc7c00ed10 comp rx=0 tx=0).stop 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 shutdown_connections 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc901589f0 0x7fcc900ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc900b3af0 0x7fcc901e1110 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 --2- 172.21.15.194:0/1687160994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc9006c0b0 0x7fcc90148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 >> 172.21.15.194:0/1687160994 conn(0x7fcc900b08f0 msgr2=0x7fcc9006b980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.285 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 shutdown_connections 2024-09-13T18:35:23.286 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.282+0000 7fcc95c00640 1 -- 172.21.15.194:0/1687160994 wait complete. 2024-09-13T18:35:23.299 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2024-09-13T18:35:23.353 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:23.350+0000 7f344841f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:35:23.359 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:23.357+0000 7f27cf838040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-13T18:35:23.448 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.446+0000 7f45a3800640 1 Processor -- start 2024-09-13T18:35:23.449 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.446+0000 7f45a3800640 1 -- start start 2024-09-13T18:35:23.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a3800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f459c0b3470 0x7f459c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.451 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a3800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c15a8e0 con 0x7f459c0cb330 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a3800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f459c0b2fe0 con 0x7f459c0cdf60 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a3800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0b26b0 con 0x7f459c0b3470 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a1800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f459c0b3470 0x7f459c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a1800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f459c0b3470 0x7f459c0b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43366/0 (socket says 172.21.15.194:43366) 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.448+0000 7f45a1800640 1 -- 172.21.15.194:0/999665784 learned_addr learned my addr 172.21.15.194:0/999665784 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.449+0000 7f45a1800640 1 -- 172.21.15.194:0/999665784 >> v1:172.21.15.194:6789/0 conn(0x7f459c0cdf60 legacy=0x7f459c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.449+0000 7f45a1800640 1 -- 172.21.15.194:0/999665784 >> v1:172.21.15.192:6789/0 conn(0x7f459c0cb330 legacy=0x7f459c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.449+0000 7f45a1800640 1 -- 172.21.15.194:0/999665784 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0b2990 con 0x7f459c0b3470 2024-09-13T18:35:23.452 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.449+0000 7f459b400640 1 -- 172.21.15.194:0/999665784 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606957004 0 0) 0x7f459c15a8e0 con 0x7f459c0cb330 2024-09-13T18:35:23.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.450+0000 7f45a1800640 1 --2- 172.21.15.194:0/999665784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0b3470 0x7f459c0b3870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f459400af60 tx=0x7f459402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc7dc1ad767926e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.450+0000 7f459b400640 1 -- 172.21.15.194:0/999665784 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594008500 con 0x7f459c0b3470 2024-09-13T18:35:23.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.450+0000 7f459b400640 1 -- 172.21.15.194:0/999665784 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f459402e050 con 0x7f459c0b3470 2024-09-13T18:35:23.453 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.450+0000 7f459b400640 1 -- 172.21.15.194:0/999665784 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594008880 con 0x7f459c0b3470 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 -- 172.21.15.194:0/999665784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0b3470 msgr2=0x7f459c0b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 --2- 172.21.15.194:0/999665784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0b3470 0x7f459c0b3870 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f459400af60 tx=0x7f459402b7a0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 -- 172.21.15.194:0/999665784 shutdown_connections 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 --2- 172.21.15.194:0/999665784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0b3470 0x7f459c0b3870 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 -- 172.21.15.194:0/999665784 >> 172.21.15.194:0/999665784 conn(0x7f459c0b08f0 msgr2=0x7f459c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 -- 172.21.15.194:0/999665784 shutdown_connections 2024-09-13T18:35:23.454 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.451+0000 7f45a3800640 1 -- 172.21.15.194:0/999665784 wait complete. 2024-09-13T18:35:23.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.453+0000 7f45a3800640 1 Processor -- start 2024-09-13T18:35:23.455 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.453+0000 7f45a3800640 1 -- start start 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0cb330 0x7f459c0ac970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0cdf60 0x7f459c0aceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c1f1790 con 0x7f459c0cb330 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c146d90 con 0x7f459c0cdf60 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a3800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c146460 con 0x7f459c0b3470 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0cdf60 0x7f459c0aceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38118/0 (socket says 172.21.15.194:38118) 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f45a0e00640 1 -- 172.21.15.194:0/109661618 learned_addr learned my addr 172.21.15.194:0/109661618 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.454+0000 7f459be00640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0cb330 0x7f459c0ac970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 -- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0cdf60 msgr2=0x7f459c0aceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0cdf60 0x7f459c0aceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 -- 172.21.15.194:0/109661618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0cb330 msgr2=0x7f459c0ac970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0cb330 0x7f459c0ac970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 -- 172.21.15.194:0/109661618 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459400ac40 con 0x7f459c0b3470 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a0e00640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f459000c410 tx=0x7f459000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45900035f0 con 0x7f459c0b3470 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4590003770 con 0x7f459c0b3470 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4590003b20 con 0x7f459c0b3470 2024-09-13T18:35:23.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c146740 con 0x7f459c0b3470 2024-09-13T18:35:23.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c0ad4a0 con 0x7f459c0b3470 2024-09-13T18:35:23.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.455+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f4590012400 con 0x7f459c0b3470 2024-09-13T18:35:23.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.456+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f4590012ad0 con 0x7f459c0b3470 2024-09-13T18:35:23.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.456+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c0b3870 con 0x7f459c0b3470 2024-09-13T18:35:23.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.459+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f4590021060 con 0x7f459c0b3470 2024-09-13T18:35:23.530 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.528+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f459c070ce0 con 0x7f459c0b3470 2024-09-13T18:35:23.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.536+0000 7f4598c00640 1 -- 172.21.15.194:0/109661618 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4590017070 con 0x7f459c0b3470 2024-09-13T18:35:23.538 INFO:teuthology.orchestra.run.smithi194.stdout:2 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 msgr2=0x7f459c1f1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f459000c410 tx=0x7f459000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 shutdown_connections 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0cdf60 0x7f459c0aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0cb330 0x7f459c0ac970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 --2- 172.21.15.194:0/109661618 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0b3470 0x7f459c1f1250 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 >> 172.21.15.194:0/109661618 conn(0x7f459c0b08f0 msgr2=0x7f459c0aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 shutdown_connections 2024-09-13T18:35:23.540 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.537+0000 7f45a3800640 1 -- 172.21.15.194:0/109661618 wait complete. 2024-09-13T18:35:23.554 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2024-09-13T18:35:23.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.699+0000 7f2209600640 1 Processor -- start 2024-09-13T18:35:23.702 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.699+0000 7f2209600640 1 -- start start 2024-09-13T18:35:23.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2209600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f220415d130 0x7f2204160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2209600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2209600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2204161600 con 0x7f22041611c0 2024-09-13T18:35:23.704 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2209600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040d2c80 con 0x7f220415d130 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2209600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22040b6550 con 0x7f22040d2630 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2203400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2203400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43386/0 (socket says 172.21.15.194:43386) 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2202a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f220415d130 0x7f2204160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2203400640 1 -- 172.21.15.194:0/3080917684 learned_addr learned my addr 172.21.15.194:0/3080917684 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2202a00640 1 -- 172.21.15.194:0/3080917684 >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 msgr2=0x7f22040b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2202a00640 1 --2- 172.21.15.194:0/3080917684 >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2202a00640 1 -- 172.21.15.194:0/3080917684 >> v1:172.21.15.192:6789/0 conn(0x7f22041611c0 legacy=0x7f22040d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2202a00640 1 -- 172.21.15.194:0/3080917684 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22040b6830 con 0x7f220415d130 2024-09-13T18:35:23.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.701+0000 7f2203400640 1 --2- 172.21.15.194:0/3080917684 >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:23.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.702+0000 7f2202a00640 1 --2- 172.21.15.194:0/3080917684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220415d130 0x7f2204160c80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22040d2f60 tx=0x7f21f402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14beededb3290a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.703+0000 7f2202000640 1 -- 172.21.15.194:0/3080917684 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4032440 con 0x7f220415d130 2024-09-13T18:35:23.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.703+0000 7f2202000640 1 -- 172.21.15.194:0/3080917684 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f40325a0 con 0x7f220415d130 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.703+0000 7f2202000640 1 -- 172.21.15.194:0/3080917684 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4032930 con 0x7f220415d130 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.703+0000 7f2209600640 1 -- 172.21.15.194:0/3080917684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220415d130 msgr2=0x7f2204160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.703+0000 7f2209600640 1 --2- 172.21.15.194:0/3080917684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220415d130 0x7f2204160c80 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22040d2f60 tx=0x7f21f402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 -- 172.21.15.194:0/3080917684 shutdown_connections 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 --2- 172.21.15.194:0/3080917684 >> v2:172.21.15.194:3300/0 conn(0x7f22040d2630 0x7f22040b7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 --2- 172.21.15.194:0/3080917684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f220415d130 0x7f2204160c80 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 -- 172.21.15.194:0/3080917684 >> 172.21.15.194:0/3080917684 conn(0x7f22040cfa30 msgr2=0x7f22040cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 -- 172.21.15.194:0/3080917684 shutdown_connections 2024-09-13T18:35:23.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.704+0000 7f2209600640 1 -- 172.21.15.194:0/3080917684 wait complete. 2024-09-13T18:35:23.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.705+0000 7f2209600640 1 Processor -- start 2024-09-13T18:35:23.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 -- start start 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 0x7f22040a9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 0x7f220415b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 0x7f22041f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22041f4260 con 0x7f22040d2630 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22040aa340 con 0x7f220415d130 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.706+0000 7f2209600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22040aa620 con 0x7f22041611c0 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 0x7f220415b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f2203400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 0x7f22041f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f2203400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 0x7f22041f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38122/0 (socket says 172.21.15.194:38122) 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f2203400640 1 -- 172.21.15.194:0/802254403 learned_addr learned my addr 172.21.15.194:0/802254403 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f2202a00640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 0x7f22040a9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 -- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 msgr2=0x7f22041f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 0x7f22041f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 -- 172.21.15.194:0/802254403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 msgr2=0x7f22040a9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 0x7f22040a9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f21fbe00640 1 -- 172.21.15.194:0/802254403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009b30 con 0x7f220415d130 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.707+0000 7f2202a00640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 0x7f22040a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:23.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21fbe00640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 0x7f220415b6f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c390 tx=0x7f21ec00c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0052d0 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ec005430 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec003830 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f4009400 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22041f39b0 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f21ec003c90 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.708+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f21ec0128b0 con 0x7f220415d130 2024-09-13T18:35:23.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.709+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22040b3c20 con 0x7f220415d130 2024-09-13T18:35:23.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.711+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f21ec017070 con 0x7f220415d130 2024-09-13T18:35:23.785 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.782+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f2204067490 con 0x7f220415d130 2024-09-13T18:35:23.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.789+0000 7f21faa00640 1 -- 172.21.15.194:0/802254403 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f21ec012420 con 0x7f220415d130 2024-09-13T18:35:23.791 INFO:teuthology.orchestra.run.smithi194.stdout:3 2024-09-13T18:35:23.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 msgr2=0x7f220415b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 0x7f220415b6f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00c390 tx=0x7f21ec00c790 comp rx=0 tx=0).stop 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 shutdown_connections 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22041611c0 0x7f22041f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f220415d130 0x7f220415b6f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 --2- 172.21.15.194:0/802254403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22040d2630 0x7f22040a9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 >> 172.21.15.194:0/802254403 conn(0x7f22040cfa30 msgr2=0x7f220406a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 shutdown_connections 2024-09-13T18:35:23.793 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.790+0000 7f2209600640 1 -- 172.21.15.194:0/802254403 wait complete. 2024-09-13T18:35:23.807 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2024-09-13T18:35:23.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.952+0000 7fc0aa000640 1 Processor -- start 2024-09-13T18:35:23.955 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.953+0000 7fc0aa000640 1 -- start start 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0aa000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a4161600 con 0x7fc0a41611c0 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0aa000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40d2c80 con 0x7fc0a40d2630 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0aa000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40b6550 con 0x7fc0a415d130 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38126/0 (socket says 172.21.15.194:38126) 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 -- 172.21.15.194:0/3695630585 learned_addr learned my addr 172.21.15.194:0/3695630585 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 -- 172.21.15.194:0/3695630585 >> v1:172.21.15.194:6789/0 conn(0x7fc0a40d2630 legacy=0x7fc0a40b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.957 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 -- 172.21.15.194:0/3695630585 >> v1:172.21.15.192:6789/0 conn(0x7fc0a41611c0 legacy=0x7fc0a40d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a2a00640 1 -- 172.21.15.194:0/3695630585 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 594403167 0 0) 0x7fc0a40d2c80 con 0x7fc0a40d2630 2024-09-13T18:35:23.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.954+0000 7fc0a3400640 1 -- 172.21.15.194:0/3695630585 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40b6830 con 0x7fc0a415d130 2024-09-13T18:35:23.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.956+0000 7fc0a3400640 1 --2- 172.21.15.194:0/3695630585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0940098d0 tx=0x7fc09402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0d335a891bb8b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.958 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.956+0000 7fc0a2a00640 1 -- 172.21.15.194:0/3695630585 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09402ae90 con 0x7fc0a415d130 2024-09-13T18:35:23.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.956+0000 7fc0a2a00640 1 -- 172.21.15.194:0/3695630585 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc094032440 con 0x7fc0a415d130 2024-09-13T18:35:23.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.956+0000 7fc0a2a00640 1 -- 172.21.15.194:0/3695630585 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0940327d0 con 0x7fc0a415d130 2024-09-13T18:35:23.959 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 -- 172.21.15.194:0/3695630585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 msgr2=0x7fc0a4160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3695630585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc0940098d0 tx=0x7fc09402a200 comp rx=0 tx=0).stop 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 -- 172.21.15.194:0/3695630585 shutdown_connections 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3695630585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a4160c80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 -- 172.21.15.194:0/3695630585 >> 172.21.15.194:0/3695630585 conn(0x7fc0a40cfa30 msgr2=0x7fc0a40cfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 -- 172.21.15.194:0/3695630585 shutdown_connections 2024-09-13T18:35:23.960 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.957+0000 7fc0aa000640 1 -- 172.21.15.194:0/3695630585 wait complete. 2024-09-13T18:35:23.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.958+0000 7fc0aa000640 1 Processor -- start 2024-09-13T18:35:23.961 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 -- start start 2024-09-13T18:35:23.962 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a40c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a41611c0 0x7fc0a40cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40aa690 con 0x7fc0a41611c0 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40a9a80 con 0x7fc0a40d2630 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.959+0000 7fc0aa000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40a9d60 con 0x7fc0a415d130 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a40c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc0a3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43412/0 (socket says 172.21.15.194:43412) 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc0a3400640 1 -- 172.21.15.194:0/3491654152 learned_addr learned my addr 172.21.15.194:0/3491654152 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc0a3e00640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a41611c0 0x7fc0a40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 -- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 msgr2=0x7fc0a414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.963 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 -- 172.21.15.194:0/3491654152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a41611c0 msgr2=0x7fc0a40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a41611c0 0x7fc0a40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 -- 172.21.15.194:0/3491654152 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0940094d0 con 0x7fc0a415d130 2024-09-13T18:35:23.964 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc0a3400640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.960+0000 7fc09be00640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a40c9720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c430 tx=0x7fc08c00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c0035f0 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08c003770 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a40aa040 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc08c003b20 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a414ba10 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fc08c01c440 con 0x7fc0a415d130 2024-09-13T18:35:23.965 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.961+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc08c012960 con 0x7fc0a415d130 2024-09-13T18:35:23.966 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.962+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4067490 con 0x7fc0a415d130 2024-09-13T18:35:23.967 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:23.964+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fc08c017070 con 0x7fc0a415d130 2024-09-13T18:35:24.038 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.036+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7fc0a4160fe0 con 0x7fc0a415d130 2024-09-13T18:35:24.043 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.040+0000 7fc09b400640 1 -- 172.21.15.194:0/3491654152 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc08c012cf0 con 0x7fc0a415d130 2024-09-13T18:35:24.043 INFO:teuthology.orchestra.run.smithi194.stdout:4 2024-09-13T18:35:24.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 msgr2=0x7fc0a40c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a40c9720 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc08c00c430 tx=0x7fc08c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 shutdown_connections 2024-09-13T18:35:24.044 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc0a41611c0 0x7fc0a40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc0a415d130 0x7fc0a40c9720 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 --2- 172.21.15.194:0/3491654152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc0a40d2630 0x7fc0a414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.041+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 >> 172.21.15.194:0/3491654152 conn(0x7fc0a40cfa30 msgr2=0x7fc0a40d1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.042+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 shutdown_connections 2024-09-13T18:35:24.045 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.042+0000 7fc0aa000640 1 -- 172.21.15.194:0/3491654152 wait complete. 2024-09-13T18:35:24.058 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2024-09-13T18:35:24.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.206+0000 7f8bd8400640 1 Processor -- start 2024-09-13T18:35:24.209 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.206+0000 7f8bd8400640 1 -- start start 2024-09-13T18:35:24.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.207+0000 7f8bd8400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8bd00711f0 0x7f8bd015d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.207+0000 7f8bd8400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8bd015da00 0x7f8bd00b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.210 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.207+0000 7f8bd8400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd00ade50 con 0x7f8bd0070e10 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd8400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd00ad840 con 0x7f8bd015da00 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd8400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd015dfd0 con 0x7f8bd00711f0 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8bd00711f0 0x7f8bd015d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8bd00711f0 0x7f8bd015d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43428/0 (socket says 172.21.15.194:43428) 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 -- 172.21.15.194:0/3343706063 learned_addr learned my addr 172.21.15.194:0/3343706063 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd6400640 1 --2- 172.21.15.194:0/3343706063 >> v2:172.21.15.192:3300/0 conn(0x7f8bd015da00 0x7f8bd00b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.211 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 -- 172.21.15.194:0/3343706063 >> v2:172.21.15.192:3300/0 conn(0x7f8bd015da00 msgr2=0x7f8bd00b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 --2- 172.21.15.194:0/3343706063 >> v2:172.21.15.192:3300/0 conn(0x7f8bd015da00 0x7f8bd00b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 -- 172.21.15.194:0/3343706063 >> v1:172.21.15.192:6789/0 conn(0x7f8bd0070e10 legacy=0x7f8bd00ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.208+0000 7f8bd5000640 1 -- 172.21.15.194:0/3343706063 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd015e2b0 con 0x7f8bd00711f0 2024-09-13T18:35:24.212 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.209+0000 7f8bd5000640 1 --2- 172.21.15.194:0/3343706063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd00711f0 0x7f8bd015d4c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0071680 tx=0x7f8bbc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbdca70a37467d05 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.209+0000 7f8bcfe00640 1 -- 172.21.15.194:0/3343706063 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc032440 con 0x7f8bd00711f0 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.209+0000 7f8bcfe00640 1 -- 172.21.15.194:0/3343706063 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bbc0325a0 con 0x7f8bd00711f0 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.209+0000 7f8bcfe00640 1 -- 172.21.15.194:0/3343706063 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bbc032930 con 0x7f8bd00711f0 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 -- 172.21.15.194:0/3343706063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd00711f0 msgr2=0x7f8bd015d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 --2- 172.21.15.194:0/3343706063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd00711f0 0x7f8bd015d4c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f8bd0071680 tx=0x7f8bbc02a270 comp rx=0 tx=0).stop 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 -- 172.21.15.194:0/3343706063 shutdown_connections 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 --2- 172.21.15.194:0/3343706063 >> v2:172.21.15.192:3300/0 conn(0x7f8bd015da00 0x7f8bd00b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.213 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 --2- 172.21.15.194:0/3343706063 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd00711f0 0x7f8bd015d4c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 -- 172.21.15.194:0/3343706063 >> 172.21.15.194:0/3343706063 conn(0x7f8bd00b2af0 msgr2=0x7f8bd00b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 -- 172.21.15.194:0/3343706063 shutdown_connections 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.210+0000 7f8bd8400640 1 -- 172.21.15.194:0/3343706063 wait complete. 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.212+0000 7f8bd8400640 1 Processor -- start 2024-09-13T18:35:24.214 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.212+0000 7f8bd8400640 1 -- start start 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 0x7f8bd0148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 0x7f8bd0148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.216 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd01488d0 con 0x7f8bd0070e10 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0158f60 con 0x7f8bd015da00 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd8400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd0149720 con 0x7f8bd00711f0 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd6400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd6400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43444/0 (socket says 172.21.15.194:43444) 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd6400640 1 -- 172.21.15.194:0/4228214734 learned_addr learned my addr 172.21.15.194:0/4228214734 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd5000640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 0x7f8bd0148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.213+0000 7f8bd5a00640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 0x7f8bd0148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 -- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 msgr2=0x7f8bd0148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 0x7f8bd0148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 -- 172.21.15.194:0/4228214734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 msgr2=0x7f8bd0148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 0x7f8bd0148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 -- 172.21.15.194:0/4228214734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc0094d0 con 0x7f8bd015da00 2024-09-13T18:35:24.217 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd5000640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 0x7f8bd0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:24.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd5a00640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 0x7f8bd0148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:24.218 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd6400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800efc0 tx=0x7f8bc800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8009ba0 con 0x7f8bd015da00 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc800f040 con 0x7f8bd015da00 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd0149a00 con 0x7f8bd015da00 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc80146c0 con 0x7f8bd015da00 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.214+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd0149fc0 con 0x7f8bd015da00 2024-09-13T18:35:24.219 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.215+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f8bc8014b20 con 0x7f8bd015da00 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.215+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f8bc8013960 con 0x7f8bd015da00 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.215+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd00b5ac0 con 0x7f8bd015da00 2024-09-13T18:35:24.220 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.217+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f8bd00b5ac0 con 0x7f8bd015da00 2024-09-13T18:35:24.291 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.287+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7f8bd015d4c0 con 0x7f8bd015da00 2024-09-13T18:35:24.294 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.292+0000 7f8bcd600640 1 -- 172.21.15.194:0/4228214734 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8bc8018020 con 0x7f8bd015da00 2024-09-13T18:35:24.295 INFO:teuthology.orchestra.run.smithi194.stdout:5 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 msgr2=0x7f8bd0149080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800efc0 tx=0x7f8bc800c490 comp rx=0 tx=0).stop 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 shutdown_connections 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8bd015da00 0x7f8bd0149080 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8bd00711f0 0x7f8bd0148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 --2- 172.21.15.194:0/4228214734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8bd0070e10 0x7f8bd0148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 >> 172.21.15.194:0/4228214734 conn(0x7f8bd00b2af0 msgr2=0x7f8bd015fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.296 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 shutdown_connections 2024-09-13T18:35:24.297 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.293+0000 7f8bd8400640 1 -- 172.21.15.194:0/4228214734 wait complete. 2024-09-13T18:35:24.310 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2024-09-13T18:35:24.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.454+0000 7f11cde00640 1 Processor -- start 2024-09-13T18:35:24.457 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.454+0000 7f11cde00640 1 -- start start 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11cde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f11c80b8a60 0x7f11c80b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11cde00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80b75c0 con 0x7f11c81604b0 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11cde00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11c80b69b0 con 0x7f11c8160890 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11cde00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11c80b6c90 con 0x7f11c80b8a60 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11c7e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f11c8160890 0x7f11c80cf990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:54890/0 (socket says 172.21.15.194:54890) 2024-09-13T18:35:24.458 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.455+0000 7f11c7e00640 1 -- 172.21.15.194:0/2587667156 learned_addr learned my addr 172.21.15.194:0/2587667156 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T18:35:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11cd400640 1 --2- 172.21.15.194:0/2587667156 >> v2:172.21.15.192:3300/0 conn(0x7f11c80b8a60 0x7f11c80b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11c7400640 1 -- 172.21.15.194:0/2587667156 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1657557597 0 0) 0x7f11c80b69b0 con 0x7f11c8160890 2024-09-13T18:35:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11c7400640 1 -- 172.21.15.194:0/2587667156 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11b0003520 con 0x7f11c8160890 2024-09-13T18:35:24.459 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11cd400640 1 -- 172.21.15.194:0/2587667156 >> v1:172.21.15.194:6789/0 conn(0x7f11c8160890 legacy=0x7f11c80cf990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11cd400640 1 -- 172.21.15.194:0/2587667156 >> v1:172.21.15.192:6789/0 conn(0x7f11c81604b0 legacy=0x7f11c80d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.456+0000 7f11cd400640 1 -- 172.21.15.194:0/2587667156 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c80b6f70 con 0x7f11c80b8a60 2024-09-13T18:35:24.460 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.457+0000 7f11cd400640 1 --2- 172.21.15.194:0/2587667156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80b6300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009d90 tx=0x7f11c002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb944f04fd5b23f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.457+0000 7f11c7400640 1 -- 172.21.15.194:0/2587667156 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0007740 con 0x7f11c80b8a60 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.457+0000 7f11c7400640 1 -- 172.21.15.194:0/2587667156 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c002d050 con 0x7f11c80b8a60 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.457+0000 7f11c7400640 1 -- 172.21.15.194:0/2587667156 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c0007ac0 con 0x7f11c80b8a60 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 -- 172.21.15.194:0/2587667156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 msgr2=0x7f11c80b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 --2- 172.21.15.194:0/2587667156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80b6300 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009d90 tx=0x7f11c002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.461 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 -- 172.21.15.194:0/2587667156 shutdown_connections 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 --2- 172.21.15.194:0/2587667156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80b6300 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 -- 172.21.15.194:0/2587667156 >> 172.21.15.194:0/2587667156 conn(0x7f11c80b4bb0 msgr2=0x7f11c80b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 -- 172.21.15.194:0/2587667156 shutdown_connections 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.458+0000 7f11cde00640 1 -- 172.21.15.194:0/2587667156 wait complete. 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.460+0000 7f11cde00640 1 Processor -- start 2024-09-13T18:35:24.462 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.460+0000 7f11cde00640 1 -- start start 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c81604b0 0x7f11c80cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c80cafb0 con 0x7f11c80b8a60 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11c8149150 con 0x7f11c80cb980 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cde00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11c81493c0 con 0x7f11c81604b0 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.465 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11c7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c81604b0 0x7f11c80cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.194:43452/0 (socket says 172.21.15.194:43452) 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cd400640 1 -- 172.21.15.194:0/4028828239 learned_addr learned my addr 172.21.15.194:0/4028828239 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.461+0000 7f11cca00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 -- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c81604b0 msgr2=0x7f11c80cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c81604b0 0x7f11c80cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 -- 172.21.15.194:0/4028828239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 msgr2=0x7f11c80c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 -- 172.21.15.194:0/4028828239 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c0009a70 con 0x7f11c80cb980 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cca00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cd400640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009eb0 tx=0x7f11c0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c003c830 con 0x7f11c80cb980 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c003c990 con 0x7f11c80cb980 2024-09-13T18:35:24.466 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c003cd00 con 0x7f11c80cb980 2024-09-13T18:35:24.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11c80ca960 con 0x7f11c80cb980 2024-09-13T18:35:24.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.462+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11c80c5ff0 con 0x7f11c80cb980 2024-09-13T18:35:24.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.463+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f11c0045760 con 0x7f11c80cb980 2024-09-13T18:35:24.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.463+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f11c0031630 con 0x7f11c80cb980 2024-09-13T18:35:24.467 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.463+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11c80d2c00 con 0x7f11c80cb980 2024-09-13T18:35:24.468 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.466+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f11c004a020 con 0x7f11c80cb980 2024-09-13T18:35:24.470 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:24.468+0000 7f27cf838040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:35:24.529 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:24.527+0000 7f27cf838040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:35:24.538 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:24.535+0000 7f344841f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-13T18:35:24.538 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.535+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7f11c8067450 con 0x7f11c80cb980 2024-09-13T18:35:24.542 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.540+0000 7f11c4c00640 1 -- 172.21.15.194:0/4028828239 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11c0040070 con 0x7f11c80cb980 2024-09-13T18:35:24.543 INFO:teuthology.orchestra.run.smithi194.stdout:6 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 msgr2=0x7f11c814c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f11c0009eb0 tx=0x7f11c0004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 shutdown_connections 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f11c80cb980 0x7f11c814c1f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f11c81604b0 0x7f11c80cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 --2- 172.21.15.194:0/4028828239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11c80b8a60 0x7f11c80c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 >> 172.21.15.194:0/4028828239 conn(0x7f11c80b4bb0 msgr2=0x7f11c806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 shutdown_connections 2024-09-13T18:35:24.544 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.541+0000 7f11cde00640 1 -- 172.21.15.194:0/4028828239 wait complete. 2024-09-13T18:35:24.558 DEBUG:teuthology.orchestra.run.smithi194:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2024-09-13T18:35:24.603 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:24.600+0000 7f344841f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-13T18:35:24.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.702+0000 7fa53b200640 1 Processor -- start 2024-09-13T18:35:24.705 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.703+0000 7fa53b200640 1 -- start start 2024-09-13T18:35:24.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 0x7fa5340b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.706 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340b75c0 con 0x7fa5341604b0 2024-09-13T18:35:24.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5340b69b0 con 0x7fa5340cf990 2024-09-13T18:35:24.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5340b6c90 con 0x7fa534160890 2024-09-13T18:35:24.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53a800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa5340cf990 0x7fa5340b7a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.194:54894/0 (socket says 172.21.15.194:54894) 2024-09-13T18:35:24.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa53a800640 1 -- 172.21.15.194:0/2524730319 learned_addr learned my addr 172.21.15.194:0/2524730319 (peer_addr_for_me v1:172.21.15.194:0/0) 2024-09-13T18:35:24.707 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa539400640 1 --2- 172.21.15.194:0/2524730319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 0x7fa5340b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231137961 0 0) 0x7fa5340b69b0 con 0x7fa5340cf990 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa51c003520 con 0x7fa5340cf990 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa539400640 1 -- 172.21.15.194:0/2524730319 >> v1:172.21.15.194:6789/0 conn(0x7fa5340cf990 legacy=0x7fa5340b7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273692283 0 0) 0x7fa5340b75c0 con 0x7fa5341604b0 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.704+0000 7fa539400640 1 -- 172.21.15.194:0/2524730319 >> v1:172.21.15.192:6789/0 conn(0x7fa5341604b0 legacy=0x7fa5340d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.705+0000 7fa539400640 1 -- 172.21.15.194:0/2524730319 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5340b6f70 con 0x7fa534160890 2024-09-13T18:35:24.708 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa539400640 1 --2- 172.21.15.194:0/2524730319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 0x7fa5340b6300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097d0 tx=0x7fa52402a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1155746fbda142 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524032440 con 0x7fa534160890 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5240325a0 con 0x7fa534160890 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa538a00640 1 -- 172.21.15.194:0/2524730319 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa524032910 con 0x7fa534160890 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa53b200640 1 -- 172.21.15.194:0/2524730319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 msgr2=0x7fa5340b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa53b200640 1 --2- 172.21.15.194:0/2524730319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 0x7fa5340b6300 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa5240097d0 tx=0x7fa52402a200 comp rx=0 tx=0).stop 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.706+0000 7fa53b200640 1 -- 172.21.15.194:0/2524730319 shutdown_connections 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.707+0000 7fa53b200640 1 --2- 172.21.15.194:0/2524730319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa534160890 0x7fa5340b6300 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.707+0000 7fa53b200640 1 -- 172.21.15.194:0/2524730319 >> 172.21.15.194:0/2524730319 conn(0x7fa5340b4bb0 msgr2=0x7fa5340b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.707+0000 7fa53b200640 1 -- 172.21.15.194:0/2524730319 shutdown_connections 2024-09-13T18:35:24.710 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.707+0000 7fa53b200640 1 -- 172.21.15.194:0/2524730319 wait complete. 2024-09-13T18:35:24.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.708+0000 7fa53b200640 1 Processor -- start 2024-09-13T18:35:24.711 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.708+0000 7fa53b200640 1 -- start start 2024-09-13T18:35:24.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5341604b0 0x7fa5340c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa534155ba0 0x7fa5340cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:24.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5341f3600 con 0x7fa5341604b0 2024-09-13T18:35:24.713 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa534156040 con 0x7fa534155ba0 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa534156320 con 0x7fa5340cf990 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa539e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa539e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.194:38174/0 (socket says 172.21.15.194:38174) 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa539e00640 1 -- 172.21.15.194:0/3409153481 learned_addr learned my addr 172.21.15.194:0/3409153481 (peer_addr_for_me v2:172.21.15.194:0/0) 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa539400640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5341604b0 0x7fa5340c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.709+0000 7fa53a800640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa534155ba0 0x7fa5340cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 -- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa534155ba0 msgr2=0x7fa5340cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa534155ba0 0x7fa5340cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.714 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 -- 172.21.15.194:0/3409153481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5341604b0 msgr2=0x7fa5340c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5341604b0 0x7fa5340c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 -- 172.21.15.194:0/3409153481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa524009400 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa539e00640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c460 tx=0x7fa52800c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa528005480 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5280035f0 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5280039a0 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.710+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa534156600 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.711+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa534156bc0 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.711+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7fa52801b400 con 0x7fa5340cf990 2024-09-13T18:35:24.715 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.711+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fa528012a60 con 0x7fa5340cf990 2024-09-13T18:35:24.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.712+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa534156de0 con 0x7fa5340cf990 2024-09-13T18:35:24.716 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.714+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7fa528012cf0 con 0x7fa5340cf990 2024-09-13T18:35:24.786 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.783+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7fa534067450 con 0x7fa5340cf990 2024-09-13T18:35:24.790 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.788+0000 7fa52e000640 1 -- 172.21.15.194:0/3409153481 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa528012400 con 0x7fa5340cf990 2024-09-13T18:35:24.790 INFO:teuthology.orchestra.run.smithi194.stdout:7 2024-09-13T18:35:24.791 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 msgr2=0x7fa5341f30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa52800c460 tx=0x7fa52800c920 comp rx=0 tx=0).stop 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 shutdown_connections 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa534155ba0 0x7fa5340cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5341604b0 0x7fa5340c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 --2- 172.21.15.194:0/3409153481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa5340cf990 0x7fa5341f30c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 >> 172.21.15.194:0/3409153481 conn(0x7fa5340b4bb0 msgr2=0x7fa5340d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 shutdown_connections 2024-09-13T18:35:24.792 INFO:teuthology.orchestra.run.smithi194.stderr:2024-09-13T18:35:24.789+0000 7fa53b200640 1 -- 172.21.15.194:0/3409153481 wait complete. 2024-09-13T18:35:24.807 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-13T18:35:24.807 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-13T18:35:24.811 INFO:tasks.ceph.osd.0:Started 2024-09-13T18:35:24.811 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-13T18:35:24.811 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-13T18:35:24.815 INFO:tasks.ceph.osd.1:Started 2024-09-13T18:35:24.815 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-13T18:35:24.815 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-13T18:35:24.819 INFO:tasks.ceph.osd.2:Started 2024-09-13T18:35:24.819 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-13T18:35:24.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-13T18:35:24.823 INFO:tasks.ceph.osd.3:Started 2024-09-13T18:35:24.824 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-13T18:35:24.824 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-13T18:35:24.827 INFO:tasks.ceph.osd.4:Started 2024-09-13T18:35:24.828 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-13T18:35:24.828 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-13T18:35:24.831 INFO:tasks.ceph.osd.5:Started 2024-09-13T18:35:24.831 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-13T18:35:24.833 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-13T18:35:24.838 INFO:tasks.ceph.osd.6:Started 2024-09-13T18:35:24.838 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-13T18:35:24.838 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-13T18:35:24.843 INFO:tasks.ceph.osd.7:Started 2024-09-13T18:35:24.843 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:24.973 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-13T18:35:24.970+0000 7f7b596dc640 -1 Falling back to public interface 2024-09-13T18:35:24.979 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-13T18:35:24.977+0000 7f06b6fbb640 -1 Falling back to public interface 2024-09-13T18:35:24.982 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-13T18:35:24.979+0000 7f56cdc0d640 -1 Falling back to public interface 2024-09-13T18:35:24.989 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-13T18:35:24.987+0000 7f0b2c551640 -1 Falling back to public interface 2024-09-13T18:35:24.995 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-13T18:35:24.992+0000 7f7b596dc640 -1 osd.4 0 log_to_monitors true 2024-09-13T18:35:24.996 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-13T18:35:24.993+0000 7fd7a2c17640 -1 Falling back to public interface 2024-09-13T18:35:25.006 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-13T18:35:25.003+0000 7f06b6fbb640 -1 osd.6 0 log_to_monitors true 2024-09-13T18:35:25.006 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-13T18:35:25.004+0000 7f56cdc0d640 -1 osd.3 0 log_to_monitors true 2024-09-13T18:35:25.008 INFO:tasks.ceph.osd.0.smithi192.stderr:2024-09-13T18:35:25.006+0000 7f3622bb0640 -1 Falling back to public interface 2024-09-13T18:35:25.011 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-13T18:35:25.009+0000 7f0b2c551640 -1 osd.2 0 log_to_monitors true 2024-09-13T18:35:25.018 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-13T18:35:25.016+0000 7fb2de419640 -1 Falling back to public interface 2024-09-13T18:35:25.019 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-13T18:35:25.017+0000 7fdefd134640 -1 Falling back to public interface 2024-09-13T18:35:25.038 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-13T18:35:25.034+0000 7fd7a2c17640 -1 osd.1 0 log_to_monitors true 2024-09-13T18:35:25.040 INFO:tasks.ceph.osd.0.smithi192.stderr:2024-09-13T18:35:25.038+0000 7f3622bb0640 -1 osd.0 0 log_to_monitors true 2024-09-13T18:35:25.046 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-13T18:35:25.043+0000 7fdefd134640 -1 osd.5 0 log_to_monitors true 2024-09-13T18:35:25.046 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-13T18:35:25.043+0000 7fb2de419640 -1 osd.7 0 log_to_monitors true 2024-09-13T18:35:25.056 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.053+0000 7f27cf838040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:35:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.053+0000 7f3f47e00640 1 Processor -- start 2024-09-13T18:35:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.053+0000 7f3f47e00640 1 -- start start 2024-09-13T18:35:25.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 0x7f3f48157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480b3c90 con 0x7f3f480adf50 2024-09-13T18:35:25.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f480b3110 con 0x7f3f48161210 2024-09-13T18:35:25.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48157750 con 0x7f3f48156e30 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f46a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 0x7f3f48157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3f480adf50 0x7f3f4815d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48592/0 (socket says 172.21.15.192:48592) 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f47400640 1 -- 172.21.15.192:0/2504065941 learned_addr learned my addr 172.21.15.192:0/2504065941 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f46a00640 1 -- 172.21.15.192:0/2504065941 >> v1:172.21.15.194:6789/0 conn(0x7f3f48161210 legacy=0x7f3f480ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f46a00640 1 -- 172.21.15.192:0/2504065941 >> v1:172.21.15.192:6789/0 conn(0x7f3f480adf50 legacy=0x7f3f4815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f46000640 1 -- 172.21.15.192:0/2504065941 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409375477 0 0) 0x7f3f480b3c90 con 0x7f3f480adf50 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.055+0000 7f3f46a00640 1 -- 172.21.15.192:0/2504065941 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480b33f0 con 0x7f3f48156e30 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f46a00640 1 --2- 172.21.15.192:0/2504065941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 0x7f3f48157210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097d0 tx=0x7f3f3802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=225d219b971eefff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f46000640 1 -- 172.21.15.192:0/2504065941 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38032440 con 0x7f3f48156e30 2024-09-13T18:35:25.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f46000640 1 -- 172.21.15.192:0/2504065941 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f380325a0 con 0x7f3f48156e30 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f46000640 1 -- 172.21.15.192:0/2504065941 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38032930 con 0x7f3f48156e30 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f47e00640 1 -- 172.21.15.192:0/2504065941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 msgr2=0x7f3f48157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.057+0000 7f3f47e00640 1 --2- 172.21.15.192:0/2504065941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 0x7f3f48157210 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3f380097d0 tx=0x7f3f3802a210 comp rx=0 tx=0).stop 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.058+0000 7f3f47e00640 1 -- 172.21.15.192:0/2504065941 shutdown_connections 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.058+0000 7f3f47e00640 1 --2- 172.21.15.192:0/2504065941 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f48156e30 0x7f3f48157210 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.058+0000 7f3f47e00640 1 -- 172.21.15.192:0/2504065941 >> 172.21.15.192:0/2504065941 conn(0x7f3f480736d0 msgr2=0x7f3f480b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.058+0000 7f3f47e00640 1 -- 172.21.15.192:0/2504065941 shutdown_connections 2024-09-13T18:35:25.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.058+0000 7f3f47e00640 1 -- 172.21.15.192:0/2504065941 wait complete. 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.059+0000 7f3f47e00640 1 Processor -- start 2024-09-13T18:35:25.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.059+0000 7f3f47e00640 1 -- start start 2024-09-13T18:35:25.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 0x7f3f4813efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f48161210 0x7f3f480cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f481419d0 con 0x7f3f48161210 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4815cbf0 con 0x7f3f48156e30 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.060+0000 7f3f47e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f48141350 con 0x7f3f480adf50 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37274/0 (socket says 172.21.15.192:37274) 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 -- 172.21.15.192:0/3989330578 learned_addr learned my addr 172.21.15.192:0/3989330578 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f47400640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f48161210 0x7f3f480cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f3e000640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 0x7f3f4813efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:25.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 -- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 msgr2=0x7f3f4813efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 0x7f3f4813efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 -- 172.21.15.192:0/3989330578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f48161210 msgr2=0x7f3f480cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f48161210 0x7f3f480cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 -- 172.21.15.192:0/3989330578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f38009400 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f3e000640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 0x7f3f4813efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.061+0000 7f3f46a00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098f0 tx=0x7f3f380046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f38030b80 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f38030ce0 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f3803d680 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f481441f0 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f4813f4e0 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f3f38039040 con 0x7f3f480adf50 2024-09-13T18:35:25.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.062+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3f38046d30 con 0x7f3f480adf50 2024-09-13T18:35:25.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.063+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f480af6b0 con 0x7f3f480adf50 2024-09-13T18:35:25.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.065+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f3f38041020 con 0x7f3f480adf50 2024-09-13T18:35:25.109 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.106+0000 7f344841f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-13T18:35:25.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.126+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f480b2d70 con 0x7f3f480adf50 2024-09-13T18:35:25.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.127+0000 7f3f3f400640 1 -- 172.21.15.192:0/3989330578 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3f38037070 con 0x7f3f480adf50 2024-09-13T18:35:25.129 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:25.130 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":10,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:24.785692+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:25.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 msgr2=0x7f3f4815c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3f380098f0 tx=0x7f3f380046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 shutdown_connections 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f48161210 0x7f3f480cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f48156e30 0x7f3f4813efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 --2- 172.21.15.192:0/3989330578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f480adf50 0x7f3f4815c6b0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 >> 172.21.15.192:0/3989330578 conn(0x7f3f480736d0 msgr2=0x7f3f48160620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 shutdown_connections 2024-09-13T18:35:25.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:25.128+0000 7f3f47e00640 1 -- 172.21.15.192:0/3989330578 wait complete. 2024-09-13T18:35:25.147 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-13T18:35:25.147 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-13T18:35:25.160 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.157+0000 7f27cf838040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:35:25.205 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.203+0000 7f344841f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-13T18:35:25.280 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.276+0000 7f27cf838040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:35:25.323 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.320+0000 7f344841f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-13T18:35:25.332 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.329+0000 7f27cf838040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:35:25.376 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.373+0000 7f344841f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-13T18:35:25.456 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.453+0000 7f27cf838040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:35:25.498 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.496+0000 7f344841f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-13T18:35:25.518 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.515+0000 7f27cf838040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:35:25.560 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.557+0000 7f344841f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-13T18:35:25.569 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.566+0000 7f27cf838040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:35:25.611 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.608+0000 7f344841f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-13T18:35:25.691 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.689+0000 7f27cf838040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:35:25.733 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.731+0000 7f344841f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-13T18:35:25.748 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.746+0000 7f27cf838040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:35:25.790 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.788+0000 7f344841f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-13T18:35:25.807 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.804+0000 7f27cf838040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:35:25.849 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.846+0000 7f344841f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-13T18:35:25.883 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.880+0000 7f27cf838040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:35:25.925 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.922+0000 7f344841f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-13T18:35:25.934 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.931+0000 7f27cf838040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:35:25.954 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:25.976 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:25.974+0000 7f344841f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-13T18:35:25.989 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:25.986+0000 7f27cf838040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:35:26.030 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:26.027+0000 7f344841f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-13T18:35:26.094 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.091+0000 7f82c1600640 1 Processor -- start 2024-09-13T18:35:26.094 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.091+0000 7f82c1600640 1 -- start start 2024-09-13T18:35:26.095 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.092+0000 7f82c1600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f82bc146610 0x7f82bc0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:26.095 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.092+0000 7f82c1600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82bc0b2780 0x7f82bc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:26.095 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.092+0000 7f82c1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82bc0ae770 con 0x7f82bc0afd80 2024-09-13T18:35:26.095 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.092+0000 7f82c1600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc0cd920 con 0x7f82bc0b2780 2024-09-13T18:35:26.095 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.092+0000 7f82c1600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82bc0cdb30 con 0x7f82bc146610 2024-09-13T18:35:26.096 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82bc0b2780 0x7f82bc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:26.096 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82bc0b2780 0x7f82bc0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45326/0 (socket says 172.21.15.192:45326) 2024-09-13T18:35:26.096 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 -- 172.21.15.192:0/4135586309 learned_addr learned my addr 172.21.15.192:0/4135586309 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:26.096 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82baa00640 1 --2- 172.21.15.192:0/4135586309 >> v2:172.21.15.194:3300/0 conn(0x7f82bc146610 0x7f82bc0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 -- 172.21.15.192:0/4135586309 >> v2:172.21.15.194:3300/0 conn(0x7f82bc146610 msgr2=0x7f82bc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 --2- 172.21.15.192:0/4135586309 >> v2:172.21.15.194:3300/0 conn(0x7f82bc146610 0x7f82bc0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 -- 172.21.15.192:0/4135586309 >> v1:172.21.15.194:6789/0 conn(0x7f82bc0afd80 legacy=0x7f82bc0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.093+0000 7f82ba000640 1 -- 172.21.15.192:0/4135586309 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82bc0ae1b0 con 0x7f82bc0b2780 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.094+0000 7f82ba000640 1 --2- 172.21.15.192:0/4135586309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc0b2780 0x7f82bc0ad840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009870 tx=0x7f82a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e6e5511a1a8ddc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.094+0000 7f82b9600640 1 -- 172.21.15.192:0/4135586309 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8032440 con 0x7f82bc0b2780 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.094+0000 7f82b9600640 1 -- 172.21.15.192:0/4135586309 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a80325a0 con 0x7f82bc0b2780 2024-09-13T18:35:26.097 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.094+0000 7f82b9600640 1 -- 172.21.15.192:0/4135586309 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8032930 con 0x7f82bc0b2780 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 -- 172.21.15.192:0/4135586309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc0b2780 msgr2=0x7f82bc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 --2- 172.21.15.192:0/4135586309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc0b2780 0x7f82bc0ad840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f82a8009870 tx=0x7f82a802a210 comp rx=0 tx=0).stop 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 -- 172.21.15.192:0/4135586309 shutdown_connections 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 --2- 172.21.15.192:0/4135586309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc0b2780 0x7f82bc0ad840 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 --2- 172.21.15.192:0/4135586309 >> v2:172.21.15.194:3300/0 conn(0x7f82bc146610 0x7f82bc0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 -- 172.21.15.192:0/4135586309 >> 172.21.15.192:0/4135586309 conn(0x7f82bc0ae960 msgr2=0x7f82bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 -- 172.21.15.192:0/4135586309 shutdown_connections 2024-09-13T18:35:26.098 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.095+0000 7f82c1600640 1 -- 172.21.15.192:0/4135586309 wait complete. 2024-09-13T18:35:26.099 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.097+0000 7f82c1600640 1 Processor -- start 2024-09-13T18:35:26.099 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.097+0000 7f82c1600640 1 -- start start 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 0x7f82bc1f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 0x7f82bc15ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc158740 con 0x7f82bc146610 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc158a20 con 0x7f82bc0afd80 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82c1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82bc158d00 con 0x7f82bc0b2780 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82baa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 0x7f82bc1f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:26.101 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82ba000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 0x7f82bc15ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82baa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 0x7f82bc1f37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34282/0 (socket says 172.21.15.192:34282) 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82ba000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 0x7f82bc15ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37278/0 (socket says 172.21.15.192:37278) 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82baa00640 1 -- 172.21.15.192:0/3572085045 learned_addr learned my addr 172.21.15.192:0/3572085045 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45338/0 (socket says 172.21.15.192:45338) 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 -- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 msgr2=0x7f82bc15ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 0x7f82bc15ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 -- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 msgr2=0x7f82bc1f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 0x7f82bc1f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.102 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.098+0000 7f82bb400640 1 -- 172.21.15.192:0/3572085045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80094d0 con 0x7f82bc146610 2024-09-13T18:35:26.103 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82bb400640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c690 tx=0x7f82b400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:26.103 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4003b70 con 0x7f82bc146610 2024-09-13T18:35:26.103 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82b4003cd0 con 0x7f82bc146610 2024-09-13T18:35:26.103 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b4005310 con 0x7f82bc146610 2024-09-13T18:35:26.103 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82bc158fe0 con 0x7f82bc146610 2024-09-13T18:35:26.104 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82bc1597e0 con 0x7f82bc146610 2024-09-13T18:35:26.104 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 1) v1 ==== 668+0+0 (secure 0 0 0) 0x7f82b400a640 con 0x7f82bc146610 2024-09-13T18:35:26.104 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.099+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7f82b4012be0 con 0x7f82bc146610 2024-09-13T18:35:26.104 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.100+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82bc0ce2f0 con 0x7f82bc146610 2024-09-13T18:35:26.105 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.102+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73245 (secure 0 0 0) 0x7f82b400aa80 con 0x7f82bc146610 2024-09-13T18:35:26.165 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.162+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82bc0b4bd0 con 0x7f82bc146610 2024-09-13T18:35:26.166 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.163+0000 7f82b2a00640 1 -- 172.21.15.192:0/3572085045 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f82b400ac20 con 0x7f82bc146610 2024-09-13T18:35:26.166 INFO:teuthology.misc.health.smithi192.stdout: 2024-09-13T18:35:26.166 INFO:teuthology.misc.health.smithi192.stdout:{"epoch":11,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:25.999869+0000","last_up_change":"0.000000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 msgr2=0x7f82bc15b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f82b400c690 tx=0x7f82b400cb50 comp rx=0 tx=0).stop 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 shutdown_connections 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82bc146610 0x7f82bc15b2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f82bc0b2780 0x7f82bc15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 --2- 172.21.15.192:0/3572085045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f82bc0afd80 0x7f82bc1f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:26.167 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 >> 172.21.15.192:0/3572085045 conn(0x7f82bc0ae960 msgr2=0x7f82bc15fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:26.168 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 shutdown_connections 2024-09-13T18:35:26.168 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:26.164+0000 7f82c1600640 1 -- 172.21.15.192:0/3572085045 wait complete. 2024-09-13T18:35:26.179 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-13T18:35:26.721 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:26.719+0000 7f27cf838040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:35:26.748 INFO:tasks.ceph.mgr.x.smithi194.stderr:2024-09-13T18:35:26.745+0000 7f344841f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-13T18:35:27.040 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-13T18:35:27.037+0000 7fb2d9200640 -1 osd.7 0 waiting for initial osdmap 2024-09-13T18:35:27.041 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-13T18:35:27.038+0000 7f56c8e00640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T18:35:27.041 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-13T18:35:27.038+0000 7f06b2800640 -1 osd.6 0 waiting for initial osdmap 2024-09-13T18:35:27.041 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-13T18:35:27.038+0000 7fd79d600640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T18:35:27.041 INFO:tasks.ceph.osd.0.smithi192.stderr:2024-09-13T18:35:27.038+0000 7f361da00640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T18:35:27.042 INFO:tasks.ceph.osd.7.smithi194.stderr:2024-09-13T18:35:27.040+0000 7fb2d1000640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.042 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-13T18:35:27.040+0000 7f0b27400640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T18:35:27.043 INFO:tasks.ceph.osd.6.smithi194.stderr:2024-09-13T18:35:27.040+0000 7f06a9c00640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.043 INFO:tasks.ceph.osd.3.smithi192.stderr:2024-09-13T18:35:27.041+0000 7f56c0200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.044 INFO:tasks.ceph.osd.1.smithi192.stderr:2024-09-13T18:35:27.041+0000 7fd795400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.044 INFO:tasks.ceph.osd.0.smithi192.stderr:2024-09-13T18:35:27.041+0000 7f3615800640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.044 INFO:tasks.ceph.osd.2.smithi192.stderr:2024-09-13T18:35:27.042+0000 7f0b1f200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.053 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-13T18:35:27.050+0000 7f7b54600640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T18:35:27.054 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-13T18:35:27.051+0000 7fdef8000640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T18:35:27.055 INFO:tasks.ceph.osd.4.smithi194.stderr:2024-09-13T18:35:27.053+0000 7f7b4c400640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:27.056 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-13T18:35:27.053+0000 7fdeef400640 -1 osd.5 12 osdmap fullness state needs update 2024-09-13T18:35:27.743 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:27.742+0000 7f2770800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-13T18:35:27.745 INFO:tasks.ceph.mgr.y.smithi192.stderr:2024-09-13T18:35:27.744+0000 7f2770800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-13T18:35:28.025 INFO:tasks.ceph.osd.5.smithi194.stderr:2024-09-13T18:35:28.020+0000 7fdeefe00640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T18:35:29.030 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:35:29.028+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-13T18:35:32.986 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.120+0000 7f86f4a00640 1 Processor -- start 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.120+0000 7f86f4a00640 1 -- start start 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 0x7f86f0070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86f4a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f006c5d0 con 0x7f86f006e990 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86f4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f00b3920 con 0x7f86f015a9e0 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86f4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00b3730 con 0x7f86f00cdfd0 2024-09-13T18:35:33.126 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86e6a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f86f006e990 0x7f86f00cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33270/0 (socket says 172.21.15.192:33270) 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86e6a00640 1 -- 172.21.15.192:0/2863881538 learned_addr learned my addr 172.21.15.192:0/2863881538 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.121+0000 7f86efe00640 1 --2- 172.21.15.192:0/2863881538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 0x7f86f0070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1835184623 0 0) 0x7f86f006c5d0 con 0x7f86f006e990 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86d4003520 con 0x7f86f006e990 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86efe00640 1 -- 172.21.15.192:0/2863881538 >> v1:172.21.15.194:6789/0 conn(0x7f86f015a9e0 legacy=0x7f86f006ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233810444 0 0) 0x7f86f00b3920 con 0x7f86f015a9e0 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86efe00640 1 -- 172.21.15.192:0/2863881538 >> v1:172.21.15.192:6789/0 conn(0x7f86f006e990 legacy=0x7f86f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.127 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.122+0000 7f86efe00640 1 -- 172.21.15.192:0/2863881538 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f00b3c00 con 0x7f86f00cdfd0 2024-09-13T18:35:33.128 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.123+0000 7f86efe00640 1 --2- 172.21.15.192:0/2863881538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 0x7f86f0070630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009dc0 tx=0x7f86e802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66ba2de1f74d9af2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.128 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.123+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8007740 con 0x7f86f00cdfd0 2024-09-13T18:35:33.128 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.123+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e802d050 con 0x7f86f00cdfd0 2024-09-13T18:35:33.128 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.123+0000 7f86eea00640 1 -- 172.21.15.192:0/2863881538 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e8007ac0 con 0x7f86f00cdfd0 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 -- 172.21.15.192:0/2863881538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 msgr2=0x7f86f0070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 --2- 172.21.15.192:0/2863881538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 0x7f86f0070630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86e8009dc0 tx=0x7f86e802a6d0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 -- 172.21.15.192:0/2863881538 shutdown_connections 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 --2- 172.21.15.192:0/2863881538 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f00cdfd0 0x7f86f0070630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 -- 172.21.15.192:0/2863881538 >> 172.21.15.192:0/2863881538 conn(0x7f86f00736d0 msgr2=0x7f86f00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 -- 172.21.15.192:0/2863881538 shutdown_connections 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.124+0000 7f86f4a00640 1 -- 172.21.15.192:0/2863881538 wait complete. 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.125+0000 7f86f4a00640 1 Processor -- start 2024-09-13T18:35:33.129 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.126+0000 7f86f4a00640 1 -- start start 2024-09-13T18:35:33.131 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.126+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 0x7f86f01f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.131 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.131 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86f4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 0x7f86f014cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.131 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86f4a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f014c930 con 0x7f86f00cdfd0 2024-09-13T18:35:33.131 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86f4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f01f20c0 con 0x7f86f006e990 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86f4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f0154a60 con 0x7f86f015a9e0 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34266/0 (socket says 172.21.15.192:34266) 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 -- 172.21.15.192:0/4160188548 learned_addr learned my addr 172.21.15.192:0/4160188548 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86ef400640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 0x7f86f01f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86efe00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 0x7f86f014cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 -- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 msgr2=0x7f86f014cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 0x7f86f014cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 -- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 msgr2=0x7f86f01f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 0x7f86f01f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 -- 172.21.15.192:0/4160188548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e8009a70 con 0x7f86f00cdfd0 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86ef400640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 0x7f86f01f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:33.132 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86efe00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 0x7f86f014cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.127+0000 7f86e6a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86d80010e0 tx=0x7f86d800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.128+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005ce0 con 0x7f86f00cdfd0 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.128+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8005e60 con 0x7f86f00cdfd0 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.128+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80072b0 con 0x7f86f00cdfd0 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.128+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86f0154d40 con 0x7f86f00cdfd0 2024-09-13T18:35:33.133 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.128+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f014c550 con 0x7f86f00cdfd0 2024-09-13T18:35:33.134 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.129+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f014c6e0 con 0x7f86f00cdfd0 2024-09-13T18:35:33.134 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.130+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7f86d8007410 con 0x7f86f00cdfd0 2024-09-13T18:35:33.134 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.131+0000 7f86e7e00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 0x7f86cc06d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.134 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.131+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f86d8088580 con 0x7f86f00cdfd0 2024-09-13T18:35:33.135 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.131+0000 7f86ef400640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 0x7f86cc06d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.135 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.131+0000 7f86ef400640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 0x7f86cc06d030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000f60 tx=0x7f86e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.138 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.136+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f86d8053b80 con 0x7f86f00cdfd0 2024-09-13T18:35:33.309 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.307+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86f014ca70 con 0x7f86f00cdfd0 2024-09-13T18:35:33.310 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.308+0000 7f86e7e00640 1 -- 172.21.15.192:0/4160188548 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12910 (secure 0 0 0) 0x7f86f014ca70 con 0x7f86f00cdfd0 2024-09-13T18:35:33.310 INFO:teuthology.misc.health.smithi192.stdout: 2024-09-13T18:35:33.311 INFO:teuthology.misc.health.smithi192.stdout:{"epoch":17,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:32.051173+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:33.312 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 msgr2=0x7f86cc06d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 0x7f86cc06d030 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f86e0000f60 tx=0x7f86e0009040 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 msgr2=0x7f86f0154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f86d80010e0 tx=0x7f86d800c960 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 shutdown_connections 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86cc06ab70 0x7f86cc06d030 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86f015a9e0 0x7f86f014cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f00cdfd0 0x7f86f0154110 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 --2- 172.21.15.192:0/4160188548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86f006e990 0x7f86f01f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 >> 172.21.15.192:0/4160188548 conn(0x7f86f00736d0 msgr2=0x7f86f00af170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 shutdown_connections 2024-09-13T18:35:33.313 INFO:teuthology.misc.health.smithi192.stderr:2024-09-13T18:35:33.310+0000 7f86f4a00640 1 -- 172.21.15.192:0/4160188548 wait complete. 2024-09-13T18:35:33.325 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-13T18:35:33.325 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-13T18:35:33.326 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:35:33.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:35:33.330 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:35:33.330 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:35:33.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:35:33.333 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:35:33.334 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:35:33.334 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:35:33.338 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:35:33.338 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:35:33.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:35:33.342 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:35:33.342 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-13T18:35:33.342 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:33.458 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:35:33.465 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:35:33.469 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:35:33.470 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:35:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.503+0000 7fd83c600640 1 Processor -- start 2024-09-13T18:35:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.503+0000 7fd83c600640 1 -- start start 2024-09-13T18:35:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd8340b4770 0x7fd83406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd834071c90 0x7fd83415d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd83415dbe0 0x7fd83415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83415e050 con 0x7fd8340b4770 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834070a70 con 0x7fd83415dbe0 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340b4b50 con 0x7fd834071c90 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd839c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd8340b4770 0x7fd83406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd839c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd8340b4770 0x7fd83406c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34312/0 (socket says 172.21.15.192:34312) 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd839c00640 1 -- 172.21.15.192:0/1700800671 learned_addr learned my addr 172.21.15.192:0/1700800671 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd839200640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd834071c90 0x7fd83415d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.504+0000 7fd83a600640 1 --2- 172.21.15.192:0/1700800671 >> v2:172.21.15.194:3300/0 conn(0x7fd83415dbe0 0x7fd83415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.505+0000 7fd839c00640 1 -- 172.21.15.192:0/1700800671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd834071c90 msgr2=0x7fd83415d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.505+0000 7fd839c00640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd834071c90 0x7fd83415d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.505+0000 7fd839c00640 1 -- 172.21.15.192:0/1700800671 >> v2:172.21.15.194:3300/0 conn(0x7fd83415dbe0 msgr2=0x7fd83415a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.505+0000 7fd839c00640 1 --2- 172.21.15.192:0/1700800671 >> v2:172.21.15.194:3300/0 conn(0x7fd83415dbe0 0x7fd83415a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.505+0000 7fd839c00640 1 -- 172.21.15.192:0/1700800671 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd834070f00 con 0x7fd8340b4770 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.506+0000 7fd839c00640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340b4770 0x7fd83406c6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8340b5220 tx=0x7fd82802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3c438869fe2470 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.506+0000 7fd833e00640 1 -- 172.21.15.192:0/1700800671 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82802ae90 con 0x7fd8340b4770 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.506+0000 7fd833e00640 1 -- 172.21.15.192:0/1700800671 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd828032440 con 0x7fd8340b4770 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.506+0000 7fd833e00640 1 -- 172.21.15.192:0/1700800671 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8280327d0 con 0x7fd8340b4770 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 -- 172.21.15.192:0/1700800671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340b4770 msgr2=0x7fd83406c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340b4770 0x7fd83406c6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd8340b5220 tx=0x7fd82802a140 comp rx=0 tx=0).stop 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 -- 172.21.15.192:0/1700800671 shutdown_connections 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 --2- 172.21.15.192:0/1700800671 >> v2:172.21.15.194:3300/0 conn(0x7fd83415dbe0 0x7fd83415a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd834071c90 0x7fd83415d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 --2- 172.21.15.192:0/1700800671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8340b4770 0x7fd83406c6b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 -- 172.21.15.192:0/1700800671 >> 172.21.15.192:0/1700800671 conn(0x7fd8340b2030 msgr2=0x7fd834069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 -- 172.21.15.192:0/1700800671 shutdown_connections 2024-09-13T18:35:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.507+0000 7fd83c600640 1 -- 172.21.15.192:0/1700800671 wait complete. 2024-09-13T18:35:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.508+0000 7fd83c600640 1 Processor -- start 2024-09-13T18:35:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 -- start start 2024-09-13T18:35:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4770 0x7fd834150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415dbe0 0x7fd834140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd834166170 con 0x7fd834071c90 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341654f0 con 0x7fd83415dbe0 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.509+0000 7fd83c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8341657d0 con 0x7fd8340b4770 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34324/0 (socket says 172.21.15.192:34324) 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 -- 172.21.15.192:0/1575539478 learned_addr learned my addr 172.21.15.192:0/1575539478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839200640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4770 0x7fd834150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd83a600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415dbe0 0x7fd834140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 -- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4770 msgr2=0x7fd834150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4770 0x7fd834150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 -- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415dbe0 msgr2=0x7fd834140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415dbe0 0x7fd834140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 -- 172.21.15.192:0/1575539478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280094d0 con 0x7fd834071c90 2024-09-13T18:35:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd839c00640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd82802a180 tx=0x7fd8280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.510+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82803b840 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.511+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82803b9a0 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.511+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd834165ab0 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.511+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82803bd50 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.511+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd834165180 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.512+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83415d6a0 con 0x7fd834071c90 2024-09-13T18:35:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.512+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 4) v1 ==== 89089+0+0 (secure 0 0 0) 0x7fd828039040 con 0x7fd834071c90 2024-09-13T18:35:33.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.513+0000 7fd831600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 0x7fd81406d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.513+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd8280a96b0 con 0x7fd834071c90 2024-09-13T18:35:33.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.514+0000 7fd839200640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 0x7fd81406d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.514+0000 7fd839200640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 0x7fd81406d030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd834142060 tx=0x7fd820009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.518+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd828074d60 con 0x7fd834071c90 2024-09-13T18:35:33.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.532+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd828075130 con 0x7fd834071c90 2024-09-13T18:35:33.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.689+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd834165910 con 0x7fd834071c90 2024-09-13T18:35:33.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.690+0000 7fd831600640 1 -- 172.21.15.192:0/1575539478 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fd834165910 con 0x7fd834071c90 2024-09-13T18:35:33.693 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:33.693 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":17,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:32.051173+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:33.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 msgr2=0x7fd81406d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 0x7fd81406d030 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd834142060 tx=0x7fd820009190 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 msgr2=0x7fd834161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd82802a180 tx=0x7fd8280046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 shutdown_connections 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd81406ab70 0x7fd81406d030 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd83415dbe0 0x7fd834140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8340b4770 0x7fd834150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 --2- 172.21.15.192:0/1575539478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd834071c90 0x7fd834161d30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.692+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 >> 172.21.15.192:0/1575539478 conn(0x7fd8340b2030 msgr2=0x7fd8340b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.693+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 shutdown_connections 2024-09-13T18:35:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.693+0000 7fd83c600640 1 -- 172.21.15.192:0/1575539478 wait complete. 2024-09-13T18:35:33.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:33.711 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:33.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.865+0000 7fb0f0a00640 1 Processor -- start 2024-09-13T18:35:33.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.865+0000 7fb0f0a00640 1 -- start start 2024-09-13T18:35:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec0b3af0 0x7fb0ec15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0f0a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0ec06c0b0 0x7fb0ec06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0f0a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0ec0b2000 con 0x7fb0ec1589f0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0f0a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0ec06ca80 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0f0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec0b2ba0 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0e9e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb0ec1589f0 0x7fb0ec0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33296/0 (socket says 172.21.15.192:33296) 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0e9e00640 1 -- 172.21.15.192:0/2031301788 learned_addr learned my addr 172.21.15.192:0/2031301788 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.866+0000 7fb0ea800640 1 --2- 172.21.15.192:0/2031301788 >> v2:172.21.15.192:3300/0 conn(0x7fb0ec06c0b0 0x7fb0ec06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0e3e00640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec0b3af0 0x7fb0ec15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0e9400640 1 -- 172.21.15.192:0/2031301788 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443867914 0 0) 0x7fb0ec0b2000 con 0x7fb0ec1589f0 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0ea800640 1 -- 172.21.15.192:0/2031301788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec0b3af0 msgr2=0x7fb0ec15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0ea800640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec0b3af0 0x7fb0ec15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0ea800640 1 -- 172.21.15.192:0/2031301788 >> v1:172.21.15.192:6789/0 conn(0x7fb0ec1589f0 legacy=0x7fb0ec0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.867+0000 7fb0ea800640 1 -- 172.21.15.192:0/2031301788 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec15bbd0 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.868+0000 7fb0ea800640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec06c540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009d90 tx=0x7fb0e402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22cccaeadb094e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.868+0000 7fb0e9400640 1 -- 172.21.15.192:0/2031301788 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4007740 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.868+0000 7fb0e9400640 1 -- 172.21.15.192:0/2031301788 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e402d050 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.868+0000 7fb0e9400640 1 -- 172.21.15.192:0/2031301788 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4007ac0 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 -- 172.21.15.192:0/2031301788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec06c0b0 msgr2=0x7fb0ec06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec06c540 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4009d90 tx=0x7fb0e402a660 comp rx=0 tx=0).stop 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 -- 172.21.15.192:0/2031301788 shutdown_connections 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec06c540 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/2031301788 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec0b3af0 0x7fb0ec15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 -- 172.21.15.192:0/2031301788 >> 172.21.15.192:0/2031301788 conn(0x7fb0ec0b08f0 msgr2=0x7fb0ec0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 -- 172.21.15.192:0/2031301788 shutdown_connections 2024-09-13T18:35:33.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.869+0000 7fb0f0a00640 1 -- 172.21.15.192:0/2031301788 wait complete. 2024-09-13T18:35:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.870+0000 7fb0f0a00640 1 Processor -- start 2024-09-13T18:35:33.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.870+0000 7fb0f0a00640 1 -- start start 2024-09-13T18:35:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec14e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec1589f0 0x7fb0ec0af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec1f6240 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec1e6370 con 0x7fb0ec06c0b0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0f0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0ec1e3fa0 con 0x7fb0ec1589f0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.871+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34342/0 (socket says 172.21.15.192:34342) 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 -- 172.21.15.192:0/3094596650 learned_addr learned my addr 172.21.15.192:0/3094596650 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0ea800640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec1589f0 0x7fb0ec0af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e9e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec14e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 -- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec1589f0 msgr2=0x7fb0ec0af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec1589f0 0x7fb0ec0af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 -- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0ec06c0b0 msgr2=0x7fb0ec14e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec14e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 -- 172.21.15.192:0/3094596650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e4009a70 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e3e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e8b0 tx=0x7fb0d400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4009610 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0d400c8e0 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0d400cc90 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.872+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec1e3670 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.873+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0ec1e3c30 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.873+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0ec06c540 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.874+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0d4013470 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.875+0000 7fb0e2000640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 0x7fb0c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.875+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0d4089160 con 0x7fb0ec0b3af0 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.875+0000 7fb0e9e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 0x7fb0c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:33.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.876+0000 7fb0e9e00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 0x7fb0c806d0f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc007fd0 tx=0x7fb0dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:33.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:33.880+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0d4054680 con 0x7fb0ec0b3af0 2024-09-13T18:35:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.049+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0ec0b2980 con 0x7fb0ec0b3af0 2024-09-13T18:35:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.050+0000 7fb0e2000640 1 -- 172.21.15.192:0/3094596650 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0d4057ca0 con 0x7fb0ec0b3af0 2024-09-13T18:35:34.053 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 msgr2=0x7fb0c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 0x7fb0c806d0f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc007fd0 tx=0x7fb0dc009040 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 msgr2=0x7fb0ec1e5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400e8b0 tx=0x7fb0d400ed70 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 shutdown_connections 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0c806ac30 0x7fb0c806d0f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0ec1589f0 0x7fb0ec0af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0ec0b3af0 0x7fb0ec1e5920 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 --2- 172.21.15.192:0/3094596650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0ec06c0b0 0x7fb0ec14e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 >> 172.21.15.192:0/3094596650 conn(0x7fb0ec0b08f0 msgr2=0x7fb0ec159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:34.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 shutdown_connections 2024-09-13T18:35:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.052+0000 7fb0f0a00640 1 -- 172.21.15.192:0/3094596650 wait complete. 2024-09-13T18:35:34.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:34.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.219+0000 7ff804000640 1 Processor -- start 2024-09-13T18:35:34.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.219+0000 7ff804000640 1 -- start start 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff804000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff804000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff7fc15bc20 0x7ff7fc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff804000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc140480 con 0x7ff7fc0cb0b0 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff804000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc15ee90 con 0x7ff7fc15bc20 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff804000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc15f170 con 0x7ff7fc0cacd0 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff800c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff7fc0cb0b0 0x7ff7fc140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33312/0 (socket says 172.21.15.192:33312) 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff800c00640 1 -- 172.21.15.192:0/1415980951 learned_addr learned my addr 172.21.15.192:0/1415980951 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff802000640 1 --2- 172.21.15.192:0/1415980951 >> v2:172.21.15.194:3300/0 conn(0x7ff7fc15bc20 0x7ff7fc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.220+0000 7ff801600640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff7fbe00640 1 -- 172.21.15.192:0/1415980951 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4290275352 0 0) 0x7ff7fc140480 con 0x7ff7fc0cb0b0 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff7fbe00640 1 -- 172.21.15.192:0/1415980951 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e4003520 con 0x7ff7fc0cb0b0 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff802000640 1 -- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 msgr2=0x7ff7fc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff802000640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff802000640 1 -- 172.21.15.192:0/1415980951 >> v1:172.21.15.192:6789/0 conn(0x7ff7fc0cb0b0 legacy=0x7ff7fc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.221+0000 7ff802000640 1 -- 172.21.15.192:0/1415980951 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc15f450 con 0x7ff7fc15bc20 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.222+0000 7ff802000640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc0afd80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009d90 tx=0x7ff7f402a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c342b734150be9cf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.222+0000 7ff7fbe00640 1 -- 172.21.15.192:0/1415980951 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4007740 con 0x7ff7fc15bc20 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.222+0000 7ff7fbe00640 1 -- 172.21.15.192:0/1415980951 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f402d050 con 0x7ff7fc15bc20 2024-09-13T18:35:34.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.222+0000 7ff7fbe00640 1 -- 172.21.15.192:0/1415980951 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f4007ac0 con 0x7ff7fc15bc20 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 -- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc15bc20 msgr2=0x7ff7fc0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc0afd80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009d90 tx=0x7ff7f402a660 comp rx=0 tx=0).stop 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 -- 172.21.15.192:0/1415980951 shutdown_connections 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc0afd80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 --2- 172.21.15.192:0/1415980951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 -- 172.21.15.192:0/1415980951 >> 172.21.15.192:0/1415980951 conn(0x7ff7fc0ae960 msgr2=0x7ff7fc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:34.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 -- 172.21.15.192:0/1415980951 shutdown_connections 2024-09-13T18:35:34.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.223+0000 7ff804000640 1 -- 172.21.15.192:0/1415980951 wait complete. 2024-09-13T18:35:34.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.224+0000 7ff804000640 1 Processor -- start 2024-09-13T18:35:34.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.224+0000 7ff804000640 1 -- start start 2024-09-13T18:35:34.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc1f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc0cb0b0 0x7ff7fc13d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc06ae00 con 0x7ff7fc15bc20 2024-09-13T18:35:34.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1f0800 con 0x7ff7fc0cb0b0 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.225+0000 7ff804000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc06a280 con 0x7ff7fc0cacd0 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34356/0 (socket says 172.21.15.192:34356) 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 -- 172.21.15.192:0/3754216877 learned_addr learned my addr 172.21.15.192:0/3754216877 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff801600640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc1f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff800c00640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc0cb0b0 0x7ff7fc13d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 -- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 msgr2=0x7ff7fc1f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc1f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 -- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc0cb0b0 msgr2=0x7ff7fc13d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc0cb0b0 0x7ff7fc13d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 -- 172.21.15.192:0/3754216877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f4009a70 con 0x7ff7fc15bc20 2024-09-13T18:35:34.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.226+0000 7ff802000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009eb0 tx=0x7ff7f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.227+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f403c830 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.227+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f403c990 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.227+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f403cd00 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.227+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc06a560 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.227+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc06a8f0 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.228+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc15e790 con 0x7ff7fc15bc20 2024-09-13T18:35:34.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.229+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7f4031400 con 0x7ff7fc15bc20 2024-09-13T18:35:34.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.229+0000 7ff7f9600640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:34.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.229+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff7f40aaae0 con 0x7ff7fc15bc20 2024-09-13T18:35:34.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.230+0000 7ff801600640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:34.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.230+0000 7ff801600640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009aa0 tx=0x7ff7f0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:34.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.234+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7f4076140 con 0x7ff7fc15bc20 2024-09-13T18:35:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.434+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7fc06c6c0 con 0x7ff7fc15bc20 2024-09-13T18:35:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.435+0000 7ff7f9600640 1 -- 172.21.15.192:0/3754216877 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7ff7f404a500 con 0x7ff7fc15bc20 2024-09-13T18:35:34.438 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:34.438 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-09-13T18:35:34.438 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 2 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 msgr2=0x7ff7dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0009aa0 tx=0x7ff7f0009190 comp rx=0 tx=0).stop 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 msgr2=0x7ff7fc06ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4009eb0 tx=0x7ff7f4004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 shutdown_connections 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7dc06ac00 0x7ff7dc06d0c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7fc15bc20 0x7ff7fc06ba50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7fc0cb0b0 0x7ff7fc13d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 --2- 172.21.15.192:0/3754216877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7fc0cacd0 0x7ff7fc1f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:34.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 >> 172.21.15.192:0/3754216877 conn(0x7ff7fc0ae960 msgr2=0x7ff7fc15d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:34.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 shutdown_connections 2024-09-13T18:35:34.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:34.437+0000 7ff804000640 1 -- 172.21.15.192:0/3754216877 wait complete. 2024-09-13T18:35:36.192 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:36.197 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:35:36.456 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.612+0000 7f75f9000640 1 Processor -- start 2024-09-13T18:35:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.612+0000 7f75f9000640 1 -- start start 2024-09-13T18:35:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f75f41604c0 0x7f75f4066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f75f4070f80 0x7f75f40cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f4066a50 con 0x7f75f41604c0 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f40707a0 con 0x7f75f4070f80 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f4070a80 con 0x7f75f40c9ae0 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f75f41604c0 0x7f75f4066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f75f41604c0 0x7f75f4066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34362/0 (socket says 172.21.15.192:34362) 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.613+0000 7f75f1e00640 1 -- 172.21.15.192:0/3580603770 learned_addr learned my addr 172.21.15.192:0/3580603770 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f2800640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1400640 1 --2- 172.21.15.192:0/3580603770 >> v2:172.21.15.194:3300/0 conn(0x7f75f4070f80 0x7f75f40cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1e00640 1 -- 172.21.15.192:0/3580603770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 msgr2=0x7f75f40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1e00640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f40cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1e00640 1 -- 172.21.15.192:0/3580603770 >> v2:172.21.15.194:3300/0 conn(0x7f75f4070f80 msgr2=0x7f75f40cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:36.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1e00640 1 --2- 172.21.15.192:0/3580603770 >> v2:172.21.15.194:3300/0 conn(0x7f75f4070f80 0x7f75f40cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.614+0000 7f75f1e00640 1 -- 172.21.15.192:0/3580603770 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f40cb830 con 0x7f75f41604c0 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.615+0000 7f75f1e00640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f41604c0 0x7f75f4066510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009870 tx=0x7f75e402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b395d9339abb1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.615+0000 7f75f0a00640 1 -- 172.21.15.192:0/3580603770 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4032440 con 0x7f75f41604c0 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.615+0000 7f75f0a00640 1 -- 172.21.15.192:0/3580603770 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e40325a0 con 0x7f75f41604c0 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.615+0000 7f75f0a00640 1 -- 172.21.15.192:0/3580603770 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4032930 con 0x7f75f41604c0 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 -- 172.21.15.192:0/3580603770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f41604c0 msgr2=0x7f75f4066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f41604c0 0x7f75f4066510 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009870 tx=0x7f75e402a210 comp rx=0 tx=0).stop 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 -- 172.21.15.192:0/3580603770 shutdown_connections 2024-09-13T18:35:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f40cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 --2- 172.21.15.192:0/3580603770 >> v2:172.21.15.194:3300/0 conn(0x7f75f4070f80 0x7f75f40cda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 --2- 172.21.15.192:0/3580603770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f41604c0 0x7f75f4066510 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 -- 172.21.15.192:0/3580603770 >> 172.21.15.192:0/3580603770 conn(0x7f75f40cf490 msgr2=0x7f75f40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 -- 172.21.15.192:0/3580603770 shutdown_connections 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.616+0000 7f75f9000640 1 -- 172.21.15.192:0/3580603770 wait complete. 2024-09-13T18:35:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.617+0000 7f75f9000640 1 Processor -- start 2024-09-13T18:35:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 -- start start 2024-09-13T18:35:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f414bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f41604c0 0x7f75f415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f414c450 con 0x7f75f4070f80 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40b37f0 con 0x7f75f41604c0 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.618+0000 7f75f9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f40b3ad0 con 0x7f75f40c9ae0 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34364/0 (socket says 172.21.15.192:34364) 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 -- 172.21.15.192:0/2708362057 learned_addr learned my addr 172.21.15.192:0/2708362057 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1400640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f414bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f2800640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f41604c0 0x7f75f415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 -- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 msgr2=0x7f75f414bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f414bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 -- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f41604c0 msgr2=0x7f75f415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f41604c0 0x7f75f415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 -- 172.21.15.192:0/2708362057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40094d0 con 0x7f75f4070f80 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.619+0000 7f75f1e00640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c00 tx=0x7f75e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.620+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e403d830 con 0x7f75f4070f80 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.620+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e403d990 con 0x7f75f4070f80 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.620+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e403dd40 con 0x7f75f4070f80 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.620+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f40b3db0 con 0x7f75f4070f80 2024-09-13T18:35:36.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.620+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f40b4370 con 0x7f75f4070f80 2024-09-13T18:35:36.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.621+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f40ca240 con 0x7f75f4070f80 2024-09-13T18:35:36.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.622+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75e4039040 con 0x7f75f4070f80 2024-09-13T18:35:36.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.622+0000 7f75ea000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 0x7f75d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:36.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.622+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75e40a9ab0 con 0x7f75f4070f80 2024-09-13T18:35:36.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.623+0000 7f75f1400640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 0x7f75d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:36.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.623+0000 7f75f1400640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 0x7f75d406d0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75f4156fb0 tx=0x7f75e0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:36.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.627+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75e4074f60 con 0x7f75f4070f80 2024-09-13T18:35:36.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.831+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f40c9f60 con 0x7f75f4070f80 2024-09-13T18:35:36.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.831+0000 7f75ea000640 1 -- 172.21.15.192:0/2708362057 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f75e4037090 con 0x7f75f4070f80 2024-09-13T18:35:36.834 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:36.834 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4285,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-09-13T18:35:36.834 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 3 2024-09-13T18:35:36.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.833+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 msgr2=0x7f75d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.833+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 0x7f75d406d0c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f75f4156fb0 tx=0x7f75e0009190 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.833+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 msgr2=0x7f75f4155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.833+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f75e4000c00 tx=0x7f75e40046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 shutdown_connections 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d406ac00 0x7f75d406d0c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f41604c0 0x7f75f415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f40c9ae0 0x7f75f414bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 --2- 172.21.15.192:0/2708362057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f4070f80 0x7f75f4155690 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 >> 172.21.15.192:0/2708362057 conn(0x7f75f40cf490 msgr2=0x7f75f415d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 shutdown_connections 2024-09-13T18:35:36.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:36.834+0000 7f75f9000640 1 -- 172.21.15.192:0/2708362057 wait complete. 2024-09-13T18:35:36.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.002+0000 7fb097600640 1 Processor -- start 2024-09-13T18:35:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.002+0000 7fb097600640 1 -- start start 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb097600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb090071810 0x7fb0900b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb097600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0900b2230 0x7fb0900cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb097600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb090071dd0 con 0x7fb090150480 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb097600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0900cb770 con 0x7fb0900b2230 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb097600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0900cba50 con 0x7fb090071810 2024-09-13T18:35:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb094c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb090150480 0x7fb09015a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33320/0 (socket says 172.21.15.192:33320) 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb094c00640 1 -- 172.21.15.192:0/471582071 learned_addr learned my addr 172.21.15.192:0/471582071 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb095600640 1 --2- 172.21.15.192:0/471582071 >> v2:172.21.15.192:3300/0 conn(0x7fb0900b2230 0x7fb0900cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb08fe00640 1 --2- 172.21.15.192:0/471582071 >> v2:172.21.15.194:3300/0 conn(0x7fb090071810 0x7fb0900b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb08f400640 1 -- 172.21.15.192:0/471582071 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394414602 0 0) 0x7fb090071dd0 con 0x7fb090150480 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb08f400640 1 -- 172.21.15.192:0/471582071 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb074003520 con 0x7fb090150480 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb095600640 1 -- 172.21.15.192:0/471582071 >> v2:172.21.15.194:3300/0 conn(0x7fb090071810 msgr2=0x7fb0900b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb095600640 1 --2- 172.21.15.192:0/471582071 >> v2:172.21.15.194:3300/0 conn(0x7fb090071810 0x7fb0900b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb095600640 1 -- 172.21.15.192:0/471582071 >> v1:172.21.15.192:6789/0 conn(0x7fb090150480 legacy=0x7fb09015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.004+0000 7fb095600640 1 -- 172.21.15.192:0/471582071 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0900cbd30 con 0x7fb0900b2230 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.005+0000 7fb095600640 1 --2- 172.21.15.192:0/471582071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0900b2230 0x7fb0900cc530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb09006cb50 tx=0x7fb08802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea14030f675d9339 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb08f400640 1 -- 172.21.15.192:0/471582071 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088007740 con 0x7fb0900b2230 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb08f400640 1 -- 172.21.15.192:0/471582071 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08802d050 con 0x7fb0900b2230 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb08f400640 1 -- 172.21.15.192:0/471582071 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb088007aa0 con 0x7fb0900b2230 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 -- 172.21.15.192:0/471582071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0900b2230 msgr2=0x7fb0900cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 --2- 172.21.15.192:0/471582071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0900b2230 0x7fb0900cc530 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb09006cb50 tx=0x7fb08802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 -- 172.21.15.192:0/471582071 shutdown_connections 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 --2- 172.21.15.192:0/471582071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0900b2230 0x7fb0900cc530 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 --2- 172.21.15.192:0/471582071 >> v2:172.21.15.194:3300/0 conn(0x7fb090071810 0x7fb0900b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 -- 172.21.15.192:0/471582071 >> 172.21.15.192:0/471582071 conn(0x7fb0900ae960 msgr2=0x7fb09006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 -- 172.21.15.192:0/471582071 shutdown_connections 2024-09-13T18:35:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.006+0000 7fb097600640 1 -- 172.21.15.192:0/471582071 wait complete. 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.008+0000 7fb097600640 1 Processor -- start 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.008+0000 7fb097600640 1 -- start start 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb090071810 0x7fb090154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 0x7fb090152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0901530b0 con 0x7fb090150480 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb090154c70 con 0x7fb0900b2230 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb097600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb090154f50 con 0x7fb090071810 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb095600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb08fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 0x7fb090152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb095600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34372/0 (socket says 172.21.15.192:34372) 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb095600640 1 -- 172.21.15.192:0/1930390528 learned_addr learned my addr 172.21.15.192:0/1930390528 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb094c00640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb090071810 0x7fb090154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb095600640 1 -- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb090071810 msgr2=0x7fb090154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.009+0000 7fb095600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb090071810 0x7fb090154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb095600640 1 -- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 msgr2=0x7fb090152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb095600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 0x7fb090152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb095600640 1 -- 172.21.15.192:0/1930390528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb088009a70 con 0x7fb090150480 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb08fe00640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 0x7fb090152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb095600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb08802abe0 tx=0x7fb088004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08803c830 con 0x7fb090150480 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb08803c9b0 con 0x7fb090150480 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08803cd60 con 0x7fb090150480 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb090155230 con 0x7fb090150480 2024-09-13T18:35:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.010+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0901557f0 con 0x7fb090150480 2024-09-13T18:35:37.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.011+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb090071dd0 con 0x7fb090150480 2024-09-13T18:35:37.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.012+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb088031400 con 0x7fb090150480 2024-09-13T18:35:37.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.013+0000 7fb08cc00640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 0x7fb07006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.013+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb0880aa310 con 0x7fb090150480 2024-09-13T18:35:37.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.013+0000 7fb094c00640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 0x7fb07006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.014+0000 7fb094c00640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 0x7fb07006d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb080005880 tx=0x7fb080009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.017+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0880758e0 con 0x7fb090150480 2024-09-13T18:35:37.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.188+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb09014bbe0 con 0x7fb090150480 2024-09-13T18:35:37.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.189+0000 7fb08cc00640 1 -- 172.21.15.192:0/1930390528 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12910 (secure 0 0 0) 0x7fb088078f00 con 0x7fb090150480 2024-09-13T18:35:37.192 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:37.192 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":17,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:32.051173+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:37.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.191+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 msgr2=0x7fb07006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.191+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 0x7fb07006d0c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fb080005880 tx=0x7fb080009040 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 msgr2=0x7fb0901f33c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb08802abe0 tx=0x7fb088004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 shutdown_connections 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb07006ac00 0x7fb07006d0c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb090150480 0x7fb0901f33c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0900b2230 0x7fb090152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 --2- 172.21.15.192:0/1930390528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb090071810 0x7fb090154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 >> 172.21.15.192:0/1930390528 conn(0x7fb0900ae960 msgr2=0x7fb090158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 shutdown_connections 2024-09-13T18:35:37.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.192+0000 7fb097600640 1 -- 172.21.15.192:0/1930390528 wait complete. 2024-09-13T18:35:37.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:37.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:37.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.363+0000 7f27cb200640 1 Processor -- start 2024-09-13T18:35:37.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.363+0000 7f27cb200640 1 -- start start 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27cb200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27c406d570 0x7f27c40b5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27cb200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 0x7f27c40b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27cb200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c406bd10 con 0x7f27c415b110 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27cb200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c40b3620 con 0x7f27c406d570 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27cb200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27c415b9d0 con 0x7f27c40b2c70 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27c3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27c406d570 0x7f27c40b5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27c3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27c406d570 0x7f27c40b5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34382/0 (socket says 172.21.15.192:34382) 2024-09-13T18:35:37.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.364+0000 7f27c3e00640 1 -- 172.21.15.192:0/1753261511 learned_addr learned my addr 172.21.15.192:0/1753261511 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c9200640 1 --2- 172.21.15.192:0/1753261511 >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 0x7f27c40b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c3e00640 1 -- 172.21.15.192:0/1753261511 >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 msgr2=0x7f27c40b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c3e00640 1 --2- 172.21.15.192:0/1753261511 >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 0x7f27c40b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c3e00640 1 -- 172.21.15.192:0/1753261511 >> v1:172.21.15.194:6789/0 conn(0x7f27c415b110 legacy=0x7f27c406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c3e00640 1 -- 172.21.15.192:0/1753261511 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c415bcb0 con 0x7f27c406d570 2024-09-13T18:35:37.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.365+0000 7f27c9200640 1 --2- 172.21.15.192:0/1753261511 >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 0x7f27c40b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:37.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.366+0000 7f27c3e00640 1 --2- 172.21.15.192:0/1753261511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c406d570 0x7f27c40b5250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27c40cc830 tx=0x7f27b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0de449b5d91f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.366+0000 7f27c3400640 1 -- 172.21.15.192:0/1753261511 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4032440 con 0x7f27c406d570 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.366+0000 7f27c3400640 1 -- 172.21.15.192:0/1753261511 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40325a0 con 0x7f27c406d570 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.366+0000 7f27c3400640 1 -- 172.21.15.192:0/1753261511 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4032930 con 0x7f27c406d570 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 -- 172.21.15.192:0/1753261511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c406d570 msgr2=0x7f27c40b5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 --2- 172.21.15.192:0/1753261511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c406d570 0x7f27c40b5250 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f27c40cc830 tx=0x7f27b402a270 comp rx=0 tx=0).stop 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 -- 172.21.15.192:0/1753261511 shutdown_connections 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 --2- 172.21.15.192:0/1753261511 >> v2:172.21.15.194:3300/0 conn(0x7f27c40b2c70 0x7f27c40b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 --2- 172.21.15.192:0/1753261511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c406d570 0x7f27c40b5250 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 -- 172.21.15.192:0/1753261511 >> 172.21.15.192:0/1753261511 conn(0x7f27c4069ea0 msgr2=0x7f27c406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 -- 172.21.15.192:0/1753261511 shutdown_connections 2024-09-13T18:35:37.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.367+0000 7f27cb200640 1 -- 172.21.15.192:0/1753261511 wait complete. 2024-09-13T18:35:37.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.368+0000 7f27cb200640 1 Processor -- start 2024-09-13T18:35:37.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.368+0000 7f27cb200640 1 -- start start 2024-09-13T18:35:37.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 0x7f27c41edb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27c415b110 0x7f27c40b0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c41f0690 con 0x7f27c40b2c70 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c41f0930 con 0x7f27c415b110 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.369+0000 7f27cb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c41f0c10 con 0x7f27c406d570 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27c3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 0x7f27c41edb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27c9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27c415b110 0x7f27c40b0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34388/0 (socket says 172.21.15.192:34388) 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27c3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 0x7f27c41edb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:44466/0 (socket says 172.21.15.192:44466) 2024-09-13T18:35:37.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 -- 172.21.15.192:0/1239583316 learned_addr learned my addr 172.21.15.192:0/1239583316 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:37.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 -- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 msgr2=0x7f27c41edb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 0x7f27c41edb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 -- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27c415b110 msgr2=0x7f27c40b0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27c415b110 0x7f27c40b0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 -- 172.21.15.192:0/1239583316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27b40094d0 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.370+0000 7f27bbe00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c400 tx=0x7f27ac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.371+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac0052d0 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.371+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ac005430 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.371+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac003830 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.371+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c41f0ef0 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.371+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c413c060 con 0x7f27c40b2c70 2024-09-13T18:35:37.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.372+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27c41f1410 con 0x7f27c40b2c70 2024-09-13T18:35:37.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.373+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27ac003990 con 0x7f27c40b2c70 2024-09-13T18:35:37.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.373+0000 7f27c0c00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.374+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f27ac088570 con 0x7f27c40b2c70 2024-09-13T18:35:37.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.374+0000 7f27c3e00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.374+0000 7f27c3e00640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27b4034000 tx=0x7f27b402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.378+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27c41f1410 con 0x7f27c40b2c70 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.544+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27c41f1410 con 0x7f27c40b2c70 2024-09-13T18:35:37.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.545+0000 7f27c0c00640 1 -- 172.21.15.192:0/1239583316 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27ac017020 con 0x7f27c40b2c70 2024-09-13T18:35:37.548 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 msgr2=0x7f27a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 0x7f27a006d0c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f27b4034000 tx=0x7f27b402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 msgr2=0x7f27c41524a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f27ac00c400 tx=0x7f27ac00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 shutdown_connections 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27a006ac00 0x7f27a006d0c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27c415b110 0x7f27c40b0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27c40b2c70 0x7f27c41524a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 --2- 172.21.15.192:0/1239583316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27c406d570 0x7f27c41edb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 >> 172.21.15.192:0/1239583316 conn(0x7f27c4069ea0 msgr2=0x7f27c40cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 shutdown_connections 2024-09-13T18:35:37.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.547+0000 7f27cb200640 1 -- 172.21.15.192:0/1239583316 wait complete. 2024-09-13T18:35:37.565 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:35:37.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.713+0000 7f58cba00640 1 Processor -- start 2024-09-13T18:35:37.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.713+0000 7f58cba00640 1 -- start start 2024-09-13T18:35:37.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58cba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f58c415dee0 0x7f58c40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58cba00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40b2f00 con 0x7f58c415e2c0 2024-09-13T18:35:37.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58cba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40b3150 con 0x7f58c40b3f10 2024-09-13T18:35:37.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58cba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40b3430 con 0x7f58c415dee0 2024-09-13T18:35:37.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58c9a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f58c415e2c0 0x7f58c41637e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33326/0 (socket says 172.21.15.192:33326) 2024-09-13T18:35:37.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58c9a00640 1 -- 172.21.15.192:0/3384886370 learned_addr learned my addr 172.21.15.192:0/3384886370 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:37.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58c9000640 1 --2- 172.21.15.192:0/3384886370 >> v2:172.21.15.194:3300/0 conn(0x7f58c415dee0 0x7f58c40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58c3e00640 1 -- 172.21.15.192:0/3384886370 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561748627 0 0) 0x7f58c40b2f00 con 0x7f58c415e2c0 2024-09-13T18:35:37.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.715+0000 7f58c3e00640 1 -- 172.21.15.192:0/3384886370 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a8003520 con 0x7f58c415e2c0 2024-09-13T18:35:37.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.716+0000 7f58c9000640 1 -- 172.21.15.192:0/3384886370 >> v1:172.21.15.194:6789/0 conn(0x7f58c40b3f10 legacy=0x7f58c415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.716+0000 7f58c9000640 1 -- 172.21.15.192:0/3384886370 >> v1:172.21.15.192:6789/0 conn(0x7f58c415e2c0 legacy=0x7f58c41637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.716+0000 7f58c9000640 1 -- 172.21.15.192:0/3384886370 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40b3710 con 0x7f58c415dee0 2024-09-13T18:35:37.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58c9000640 1 --2- 172.21.15.192:0/3384886370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415dee0 0x7f58c40afd80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58b40097a0 tx=0x7f58b402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39bd92ee32fd42f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58c3e00640 1 -- 172.21.15.192:0/3384886370 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4032440 con 0x7f58c415dee0 2024-09-13T18:35:37.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58c3e00640 1 -- 172.21.15.192:0/3384886370 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40325a0 con 0x7f58c415dee0 2024-09-13T18:35:37.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58c3e00640 1 -- 172.21.15.192:0/3384886370 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4032930 con 0x7f58c415dee0 2024-09-13T18:35:37.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58cba00640 1 -- 172.21.15.192:0/3384886370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415dee0 msgr2=0x7f58c40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.717+0000 7f58cba00640 1 --2- 172.21.15.192:0/3384886370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415dee0 0x7f58c40afd80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f58b40097a0 tx=0x7f58b402a230 comp rx=0 tx=0).stop 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.718+0000 7f58cba00640 1 -- 172.21.15.192:0/3384886370 shutdown_connections 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.718+0000 7f58cba00640 1 --2- 172.21.15.192:0/3384886370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415dee0 0x7f58c40afd80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.718+0000 7f58cba00640 1 -- 172.21.15.192:0/3384886370 >> 172.21.15.192:0/3384886370 conn(0x7f58c40ae960 msgr2=0x7f58c406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.718+0000 7f58cba00640 1 -- 172.21.15.192:0/3384886370 shutdown_connections 2024-09-13T18:35:37.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.718+0000 7f58cba00640 1 -- 172.21.15.192:0/3384886370 wait complete. 2024-09-13T18:35:37.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.719+0000 7f58cba00640 1 Processor -- start 2024-09-13T18:35:37.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.719+0000 7f58cba00640 1 -- start start 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 0x7f58c406a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 0x7f58c4130660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c4131650 con 0x7f58c415dee0 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c41408d0 con 0x7f58c415e2c0 2024-09-13T18:35:37.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58cba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c406ad20 con 0x7f58c406a890 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58c9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58c9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34394/0 (socket says 172.21.15.192:34394) 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.720+0000 7f58c9000640 1 -- 172.21.15.192:0/4001506400 learned_addr learned my addr 172.21.15.192:0/4001506400 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9a00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 0x7f58c4130660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58bbe00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 0x7f58c406a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 -- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 msgr2=0x7f58c4130660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 0x7f58c4130660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 -- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 msgr2=0x7f58c406a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 0x7f58c406a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 -- 172.21.15.192:0/4001506400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b4009400 con 0x7f58c415dee0 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58bbe00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 0x7f58c406a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9a00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 0x7f58c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:37.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c9000640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58b4035040 tx=0x7f58b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4006e10 con 0x7f58c415dee0 2024-09-13T18:35:37.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b4032e90 con 0x7f58c415dee0 2024-09-13T18:35:37.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c41f2950 con 0x7f58c415dee0 2024-09-13T18:35:37.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4030ba0 con 0x7f58c415dee0 2024-09-13T18:35:37.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.721+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c412e770 con 0x7f58c415dee0 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.723+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c412e5d0 con 0x7f58c415dee0 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.723+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58b4039040 con 0x7f58c415dee0 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.724+0000 7f58c1600640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 0x7f58a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.724+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f58b40a99f0 con 0x7f58c415dee0 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.724+0000 7f58bbe00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 0x7f58a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:37.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.725+0000 7f58bbe00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 0x7f58a006d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58c4150af0 tx=0x7f58ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:37.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.728+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f58c412e5d0 con 0x7f58c415dee0 2024-09-13T18:35:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.903+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f58c412e5d0 con 0x7f58c415dee0 2024-09-13T18:35:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.903+0000 7f58c1600640 1 -- 172.21.15.192:0/4001506400 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f58c412e5d0 con 0x7f58c415dee0 2024-09-13T18:35:37.906 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:37.906 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:35:37.907 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:35:37.907 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:35:37.907 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:35:37.907 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:35:37.907 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:35:37.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.905+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 msgr2=0x7f58a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.905+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 0x7f58a006d0c0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f58c4150af0 tx=0x7f58ac009040 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.905+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 msgr2=0x7f58c41513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.905+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f58b4035040 tx=0x7f58b40046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 shutdown_connections 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58a006ac00 0x7f58a006d0c0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58c406a890 0x7f58c4130660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58c415e2c0 0x7f58c406a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 --2- 172.21.15.192:0/4001506400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58c415dee0 0x7f58c41513a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 >> 172.21.15.192:0/4001506400 conn(0x7f58c40ae960 msgr2=0x7f58c413c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 shutdown_connections 2024-09-13T18:35:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:37.906+0000 7f58cba00640 1 -- 172.21.15.192:0/4001506400 wait complete. 2024-09-13T18:35:37.924 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:35:37.924 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:35:38.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.078+0000 7fab6de00640 1 Processor -- start 2024-09-13T18:35:38.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.078+0000 7fab6de00640 1 -- start start 2024-09-13T18:35:38.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab6de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab680b3d90 0x7fab680cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab6de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab6806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab6de00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab6815e110 con 0x7fab680cb730 2024-09-13T18:35:38.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab6de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab6815df20 con 0x7fab680b3d90 2024-09-13T18:35:38.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab6de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab680cceb0 con 0x7fab680cca60 2024-09-13T18:35:38.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab66a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fab680cb730 0x7fab6815d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33336/0 (socket says 172.21.15.192:33336) 2024-09-13T18:35:38.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab66a00640 1 -- 172.21.15.192:0/1365858043 learned_addr learned my addr 172.21.15.192:0/1365858043 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab67400640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab6806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564892992 0 0) 0x7fab6815e110 con 0x7fab680cb730 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab5e000640 1 --2- 172.21.15.192:0/1365858043 >> v2:172.21.15.194:3300/0 conn(0x7fab680b3d90 0x7fab680cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.080+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab4c003520 con 0x7fab680cb730 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3470731655 0 0) 0x7fab4c003520 con 0x7fab680cb730 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 msgr2=0x7fab6806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab6806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 >> v2:172.21.15.194:3300/0 conn(0x7fab680b3d90 msgr2=0x7fab680cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 --2- 172.21.15.192:0/1365858043 >> v2:172.21.15.194:3300/0 conn(0x7fab680b3d90 0x7fab680cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6815e3f0 con 0x7fab680cb730 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fab58001690 con 0x7fab680cb730 2024-09-13T18:35:38.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 >> v1:172.21.15.192:6789/0 conn(0x7fab680cb730 legacy=0x7fab6815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab4c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab680cceb0 con 0x7fab4c003970 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c00b980 con 0x7fab4c004d00 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c00bac0 con 0x7fab680cca60 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66a00640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab5e000640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab4c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab67400640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66a00640 1 -- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 msgr2=0x7fab4c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.081+0000 7fab66a00640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab680cca60 0x7fab4c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.082+0000 7fab66a00640 1 -- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c004d00 msgr2=0x7fab4c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:38.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.082+0000 7fab66a00640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c004d00 0x7fab4c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.082+0000 7fab66a00640 1 -- 172.21.15.192:0/1365858043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c003520 con 0x7fab4c003970 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.082+0000 7fab66a00640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab680b3c80 tx=0x7fab4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494b7a20cf5140ac server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58005ad0 con 0x7fab4c003970 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab5802d070 con 0x7fab4c003970 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab66000640 1 -- 172.21.15.192:0/1365858043 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab58005e90 con 0x7fab4c003970 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 -- 172.21.15.192:0/1365858043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4c003970 msgr2=0x7fab4c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 --2- 172.21.15.192:0/1365858043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4c003970 0x7fab4c003d90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab680b3c80 tx=0x7fab4c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab67400640 1 -- 172.21.15.192:0/1365858043 reap_dead start 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 -- 172.21.15.192:0/1365858043 shutdown_connections 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 -- 172.21.15.192:0/1365858043 >> 172.21.15.192:0/1365858043 conn(0x7fab680b0c40 msgr2=0x7fab680b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 -- 172.21.15.192:0/1365858043 shutdown_connections 2024-09-13T18:35:38.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.083+0000 7fab6de00640 1 -- 172.21.15.192:0/1365858043 wait complete. 2024-09-13T18:35:38.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.085+0000 7fab6de00640 1 Processor -- start 2024-09-13T18:35:38.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.085+0000 7fab6de00640 1 -- start start 2024-09-13T18:35:38.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c003970 0x7fab6813d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6813d210 0x7fab6813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815b240 con 0x7fab6813cdd0 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815a5c0 con 0x7fab4c003970 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab6de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6815a8a0 con 0x7fab6813d210 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab67400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab67400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34406/0 (socket says 172.21.15.192:34406) 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.086+0000 7fab67400640 1 -- 172.21.15.192:0/2578628276 learned_addr learned my addr 172.21.15.192:0/2578628276 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab66a00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c003970 0x7fab6813d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab5e000640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6813d210 0x7fab6813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 -- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6813d210 msgr2=0x7fab6813c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6813d210 0x7fab6813c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 -- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c003970 msgr2=0x7fab6813d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c003970 0x7fab6813d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 -- 172.21.15.192:0/2578628276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6815ab80 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab67400640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fab6806f490 tx=0x7fab6000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6000e040 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab6000f040 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60015430 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.087+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab6815ae60 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.088+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab6815bba0 con 0x7fab6813cdd0 2024-09-13T18:35:38.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.089+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab6815b380 con 0x7fab6813cdd0 2024-09-13T18:35:38.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.089+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab60015590 con 0x7fab6813cdd0 2024-09-13T18:35:38.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.091+0000 7fab5fe00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 0x7fab4406d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.091+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab60089530 con 0x7fab6813cdd0 2024-09-13T18:35:38.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.091+0000 7fab66a00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 0x7fab4406d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.092+0000 7fab66a00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 0x7fab4406d0e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab58032000 tx=0x7fab58034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.095+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab6815b380 con 0x7fab6813cdd0 2024-09-13T18:35:38.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.265+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fab6815b380 con 0x7fab6813cdd0 2024-09-13T18:35:38.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.796+0000 7fab5fe00640 1 -- 172.21.15.192:0/2578628276 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7fab6815b380 con 0x7fab6813cdd0 2024-09-13T18:35:38.799 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.799+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 msgr2=0x7fab4406d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.799+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 0x7fab4406d0e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab58032000 tx=0x7fab58034040 comp rx=0 tx=0).stop 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.799+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 msgr2=0x7fab6815b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.799+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fab6806f490 tx=0x7fab6000f1b0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 shutdown_connections 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab4406ac20 0x7fab4406d0e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab6813cdd0 0x7fab6815b660 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab6813d210 0x7fab6813c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 --2- 172.21.15.192:0/2578628276 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab4c003970 0x7fab6813d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 >> 172.21.15.192:0/2578628276 conn(0x7fab680b0c40 msgr2=0x7fab680ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 shutdown_connections 2024-09-13T18:35:38.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.800+0000 7fab6de00640 1 -- 172.21.15.192:0/2578628276 wait complete. 2024-09-13T18:35:38.818 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:35:38.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.976+0000 7f9cf5400640 1 Processor -- start 2024-09-13T18:35:38.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.976+0000 7f9cf5400640 1 -- start start 2024-09-13T18:35:38.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cf5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 0x7f9cf00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cf5400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf006cc40 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cf5400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf006b480 con 0x7f9cf01434c0 2024-09-13T18:35:38.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cf5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00b4060 con 0x7f9cf006c800 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cef200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9cf00b3bd0 0x7f9cf006e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33340/0 (socket says 172.21.15.192:33340) 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cef200640 1 -- 172.21.15.192:0/1989897818 learned_addr learned my addr 172.21.15.192:0/1989897818 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9ce5e00640 1 --2- 172.21.15.192:0/1989897818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 0x7f9cf00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.977+0000 7f9cee800640 1 --1- 172.21.15.192:0/1989897818 >> v1:172.21.15.194:6789/0 conn(0x7f9cf01434c0 0x7f9cf006a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:39612/0 (socket says 172.21.15.192:39612) 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 852408993 0 0) 0x7f9cf006cc40 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cd4005730 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283585573 0 0) 0x7f9cf006b480 con 0x7f9cf01434c0 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9ce5e00640 1 -- 172.21.15.192:0/1989897818 >> v1:172.21.15.194:6789/0 conn(0x7f9cf01434c0 legacy=0x7f9cf006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9ce5e00640 1 -- 172.21.15.192:0/1989897818 >> v1:172.21.15.192:6789/0 conn(0x7f9cf00b3bd0 legacy=0x7f9cf006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.978+0000 7f9ce5e00640 1 -- 172.21.15.192:0/1989897818 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf006b760 con 0x7f9cf006c800 2024-09-13T18:35:38.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.979+0000 7f9ce5e00640 1 --2- 172.21.15.192:0/1989897818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 0x7f9cf00b3690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009800 tx=0x7f9cd802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189ecca7e0a17b78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.979+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8032440 con 0x7f9cf006c800 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.979+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd80325a0 con 0x7f9cf006c800 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.979+0000 7f9cede00640 1 -- 172.21.15.192:0/1989897818 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8032930 con 0x7f9cf006c800 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 -- 172.21.15.192:0/1989897818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 msgr2=0x7f9cf00b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 --2- 172.21.15.192:0/1989897818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 0x7f9cf00b3690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009800 tx=0x7f9cd802a230 comp rx=0 tx=0).stop 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 -- 172.21.15.192:0/1989897818 shutdown_connections 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 --2- 172.21.15.192:0/1989897818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf006c800 0x7f9cf00b3690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 -- 172.21.15.192:0/1989897818 >> 172.21.15.192:0/1989897818 conn(0x7f9cf00b08f0 msgr2=0x7f9cf00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:38.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 -- 172.21.15.192:0/1989897818 shutdown_connections 2024-09-13T18:35:38.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.980+0000 7f9cf5400640 1 -- 172.21.15.192:0/1989897818 wait complete. 2024-09-13T18:35:38.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.982+0000 7f9cf5400640 1 Processor -- start 2024-09-13T18:35:38.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.982+0000 7f9cf5400640 1 -- start start 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.982+0000 7f9cf5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 0x7f9cf0138cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cf5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cf5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 0x7f9cf006f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cf5400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf0071960 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cf5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf00701b0 con 0x7f9cf006c800 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cf5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf006f200 con 0x7f9cf01434c0 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34412/0 (socket says 172.21.15.192:34412) 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 -- 172.21.15.192:0/2497156325 learned_addr learned my addr 172.21.15.192:0/2497156325 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cee800640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 0x7f9cf0138cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cef200640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 0x7f9cf006f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 -- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 msgr2=0x7f9cf006f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 0x7f9cf006f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 -- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 msgr2=0x7f9cf0138cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 0x7f9cf0138cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9ce5e00640 1 -- 172.21.15.192:0/2497156325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd8009400 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cee800640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 0x7f9cf0138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.983+0000 7f9cef200640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 0x7f9cf006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:38.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9ce5e00640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009800 tx=0x7f9cd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8032440 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd8004230 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd8006e10 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf006ec80 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.984+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf0139ae0 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.985+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf0070360 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.986+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9cd8039040 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.987+0000 7f9ce7400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 0x7f9ccc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.987+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9cd80a9a90 con 0x7f9cf00b3bd0 2024-09-13T18:35:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.987+0000 7f9cee800640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 0x7f9ccc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:38.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.987+0000 7f9cee800640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 0x7f9ccc06d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000f60 tx=0x7f9ce0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:38.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:38.991+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9cd8074e40 con 0x7f9cf00b3bd0 2024-09-13T18:35:39.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.160+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9cf00cc7d0 con 0x7f9cf00b3bd0 2024-09-13T18:35:39.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.798+0000 7f9ce7400640 1 -- 172.21.15.192:0/2497156325 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9cd80370d0 con 0x7f9cf00b3bd0 2024-09-13T18:35:39.801 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:35:39.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 msgr2=0x7f9ccc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 0x7f9ccc06d0c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9ce0000f60 tx=0x7f9ce0009040 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 msgr2=0x7f9cf0071420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9cd8009800 tx=0x7f9cd80046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 shutdown_connections 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ccc06ac00 0x7f9ccc06d0c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cf01434c0 0x7f9cf006f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9cf00b3bd0 0x7f9cf0071420 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 --2- 172.21.15.192:0/2497156325 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cf006c800 0x7f9cf0138cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.803+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 >> 172.21.15.192:0/2497156325 conn(0x7f9cf00b08f0 msgr2=0x7f9cf00b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.804+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 shutdown_connections 2024-09-13T18:35:39.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.804+0000 7f9cf5400640 1 -- 172.21.15.192:0/2497156325 wait complete. 2024-09-13T18:35:39.832 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:35:39.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.985+0000 7f0b79a00640 1 Processor -- start 2024-09-13T18:35:39.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.985+0000 7f0b79a00640 1 -- start start 2024-09-13T18:35:39.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b79a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b7415d040 0x7f0b740d2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b79a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b740711a0 0x7f0b740b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b79a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b740b6a40 con 0x7f0b740ce1f0 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b79a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b7415d420 con 0x7f0b7415d040 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b79a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b740b6110 con 0x7f0b740711a0 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b73e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b7415d040 0x7f0b740d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b73e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0b7415d040 0x7f0b740d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34418/0 (socket says 172.21.15.192:34418) 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.986+0000 7f0b73e00640 1 -- 172.21.15.192:0/1809040217 learned_addr learned my addr 172.21.15.192:0/1809040217 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.987+0000 7f0b79000640 1 --2- 172.21.15.192:0/1809040217 >> v2:172.21.15.194:3300/0 conn(0x7f0b740711a0 0x7f0b740b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.987+0000 7f0b73e00640 1 -- 172.21.15.192:0/1809040217 >> v2:172.21.15.194:3300/0 conn(0x7f0b740711a0 msgr2=0x7f0b740b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.987+0000 7f0b73e00640 1 --2- 172.21.15.192:0/1809040217 >> v2:172.21.15.194:3300/0 conn(0x7f0b740711a0 0x7f0b740b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.987+0000 7f0b73e00640 1 -- 172.21.15.192:0/1809040217 >> v1:172.21.15.194:6789/0 conn(0x7f0b740ce1f0 legacy=0x7f0b74070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:39.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.987+0000 7f0b73e00640 1 -- 172.21.15.192:0/1809040217 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b740b63f0 con 0x7f0b7415d040 2024-09-13T18:35:39.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.988+0000 7f0b73e00640 1 --2- 172.21.15.192:0/1809040217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740d2220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b740c6890 tx=0x7f0b6402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de5a82ee97473f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.988+0000 7f0b72a00640 1 -- 172.21.15.192:0/1809040217 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64032440 con 0x7f0b7415d040 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.988+0000 7f0b72a00640 1 -- 172.21.15.192:0/1809040217 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b640325a0 con 0x7f0b7415d040 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.988+0000 7f0b72a00640 1 -- 172.21.15.192:0/1809040217 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64032930 con 0x7f0b7415d040 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 -- 172.21.15.192:0/1809040217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 msgr2=0x7f0b740d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 --2- 172.21.15.192:0/1809040217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740d2220 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0b740c6890 tx=0x7f0b6402a230 comp rx=0 tx=0).stop 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 -- 172.21.15.192:0/1809040217 shutdown_connections 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 --2- 172.21.15.192:0/1809040217 >> v2:172.21.15.194:3300/0 conn(0x7f0b740711a0 0x7f0b740b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 --2- 172.21.15.192:0/1809040217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740d2220 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 -- 172.21.15.192:0/1809040217 >> 172.21.15.192:0/1809040217 conn(0x7f0b740d2fa0 msgr2=0x7f0b740d33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 -- 172.21.15.192:0/1809040217 shutdown_connections 2024-09-13T18:35:39.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.989+0000 7f0b79a00640 1 -- 172.21.15.192:0/1809040217 wait complete. 2024-09-13T18:35:39.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.990+0000 7f0b79a00640 1 Processor -- start 2024-09-13T18:35:39.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 -- start start 2024-09-13T18:35:39.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b740711a0 0x7f0b74159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740ce1f0 0x7f0b740cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740ca1a0 con 0x7f0b7415d040 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740ca480 con 0x7f0b740ce1f0 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.991+0000 7f0b79a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b740ca760 con 0x7f0b740711a0 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b73e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b740711a0 0x7f0b74159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34424/0 (socket says 172.21.15.192:34424) 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 -- 172.21.15.192:0/3117251433 learned_addr learned my addr 172.21.15.192:0/3117251433 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b73400640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740ce1f0 0x7f0b740cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 -- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b740711a0 msgr2=0x7f0b74159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b740711a0 0x7f0b74159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 -- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740ce1f0 msgr2=0x7f0b740cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740ce1f0 0x7f0b740cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 -- 172.21.15.192:0/3117251433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b640094d0 con 0x7f0b7415d040 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.992+0000 7f0b79000640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007e40 tx=0x7f0b6c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.993+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c014620 con 0x7f0b7415d040 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.993+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c00ee90 con 0x7f0b7415d040 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.993+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b740caa40 con 0x7f0b7415d040 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.993+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c0149e0 con 0x7f0b7415d040 2024-09-13T18:35:39.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.993+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b740c9e90 con 0x7f0b7415d040 2024-09-13T18:35:39.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.994+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b740b5da0 con 0x7f0b7415d040 2024-09-13T18:35:39.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.995+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b6c014b40 con 0x7f0b7415d040 2024-09-13T18:35:39.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.996+0000 7f0b6be00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 0x7f0b5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:39.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.996+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f0b6c089ba0 con 0x7f0b7415d040 2024-09-13T18:35:39.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.996+0000 7f0b73e00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 0x7f0b5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:39.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:39.997+0000 7f0b73e00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 0x7f0b5406d0c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b64034000 tx=0x7f0b6402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.001+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b740b5da0 con 0x7f0b7415d040 2024-09-13T18:35:40.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.211+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0b740caf60 con 0x7f0b7415d040 2024-09-13T18:35:40.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.222+0000 7f0b6be00640 1 -- 172.21.15.192:0/3117251433 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0b740caf60 con 0x7f0b7415d040 2024-09-13T18:35:40.225 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 2 and data pool 3 2024-09-13T18:35:40.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.233+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 msgr2=0x7f0b5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.233+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 0x7f0b5406d0c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0b64034000 tx=0x7f0b6402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:40.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.233+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 msgr2=0x7f0b740ab710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.233+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c007e40 tx=0x7f0b6c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 shutdown_connections 2024-09-13T18:35:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b5406ac00 0x7f0b5406d0c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b7415d040 0x7f0b740ab710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b740ce1f0 0x7f0b740cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 --2- 172.21.15.192:0/3117251433 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b740711a0 0x7f0b74159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.234+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 >> 172.21.15.192:0/3117251433 conn(0x7f0b740d2fa0 msgr2=0x7f0b740d3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.235+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 shutdown_connections 2024-09-13T18:35:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.235+0000 7f0b79a00640 1 -- 172.21.15.192:0/3117251433 wait complete. 2024-09-13T18:35:40.259 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:40.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.408+0000 7fd64ca00640 1 Processor -- start 2024-09-13T18:35:40.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.408+0000 7fd64ca00640 1 -- start start 2024-09-13T18:35:40.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.409+0000 7fd64ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd64815dee0 0x7fd6480afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd64ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd64815e2c0 0x7fd64815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd64ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6480b2f00 con 0x7fd6480b3f10 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd64ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6480b3150 con 0x7fd64815e2c0 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd64ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6480b3430 con 0x7fd64815dee0 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd646800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd64815e2c0 0x7fd64815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd63d400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd6480b3f10 0x7fd64815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38094/0 (socket says 172.21.15.192:38094) 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd63d400640 1 -- 172.21.15.192:0/504370949 learned_addr learned my addr 172.21.15.192:0/504370949 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:40.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd645e00640 1 --2- 172.21.15.192:0/504370949 >> v2:172.21.15.194:3300/0 conn(0x7fd64815dee0 0x7fd6480afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd646800640 1 -- 172.21.15.192:0/504370949 >> v2:172.21.15.194:3300/0 conn(0x7fd64815dee0 msgr2=0x7fd6480afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd646800640 1 --2- 172.21.15.192:0/504370949 >> v2:172.21.15.194:3300/0 conn(0x7fd64815dee0 0x7fd6480afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd646800640 1 -- 172.21.15.192:0/504370949 >> v1:172.21.15.192:6789/0 conn(0x7fd6480b3f10 legacy=0x7fd64815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.410+0000 7fd646800640 1 -- 172.21.15.192:0/504370949 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6480b3710 con 0x7fd64815e2c0 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.411+0000 7fd646800640 1 --2- 172.21.15.192:0/504370949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd64815ab50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd64806cd20 tx=0x7fd64002a570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c4e0ec0005956d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd645400640 1 -- 172.21.15.192:0/504370949 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640007740 con 0x7fd64815e2c0 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd645400640 1 -- 172.21.15.192:0/504370949 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64002d050 con 0x7fd64815e2c0 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd645400640 1 -- 172.21.15.192:0/504370949 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640007ac0 con 0x7fd64815e2c0 2024-09-13T18:35:40.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 -- 172.21.15.192:0/504370949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 msgr2=0x7fd64815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 --2- 172.21.15.192:0/504370949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd64815ab50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd64806cd20 tx=0x7fd64002a570 comp rx=0 tx=0).stop 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 -- 172.21.15.192:0/504370949 shutdown_connections 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 --2- 172.21.15.192:0/504370949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd64815ab50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 --2- 172.21.15.192:0/504370949 >> v2:172.21.15.194:3300/0 conn(0x7fd64815dee0 0x7fd6480afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 -- 172.21.15.192:0/504370949 >> 172.21.15.192:0/504370949 conn(0x7fd6480ae960 msgr2=0x7fd64806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 -- 172.21.15.192:0/504370949 shutdown_connections 2024-09-13T18:35:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.412+0000 7fd64ca00640 1 -- 172.21.15.192:0/504370949 wait complete. 2024-09-13T18:35:40.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.414+0000 7fd64ca00640 1 Processor -- start 2024-09-13T18:35:40.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.414+0000 7fd64ca00640 1 -- start start 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64815dee0 0x7fd64813c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd648151ff0 0x7fd648070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd648153150 con 0x7fd64815e2c0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481524d0 con 0x7fd648151ff0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd64ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6481527b0 con 0x7fd64815dee0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:32996/0 (socket says 172.21.15.192:32996) 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 -- 172.21.15.192:0/1817813043 learned_addr learned my addr 172.21.15.192:0/1817813043 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd645e00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64815dee0 0x7fd64813c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd646800640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd648151ff0 0x7fd648070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 -- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64815dee0 msgr2=0x7fd64813c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64815dee0 0x7fd64813c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 -- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd648151ff0 msgr2=0x7fd648070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd648151ff0 0x7fd648070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.415+0000 7fd63d400640 1 -- 172.21.15.192:0/1817813043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640009a70 con 0x7fd64815e2c0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd63d400640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd63000c780 tx=0x7fd63000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300072d0 con 0x7fd64815e2c0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd630007430 con 0x7fd64815e2c0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6300047e0 con 0x7fd64815e2c0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd648152a90 con 0x7fd64815e2c0 2024-09-13T18:35:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.416+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd648153570 con 0x7fd64815e2c0 2024-09-13T18:35:40.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.417+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd648153290 con 0x7fd64815e2c0 2024-09-13T18:35:40.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.418+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd630004940 con 0x7fd64815e2c0 2024-09-13T18:35:40.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.419+0000 7fd63ea00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 0x7fd62406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.419+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd630088790 con 0x7fd64815e2c0 2024-09-13T18:35:40.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.419+0000 7fd645e00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 0x7fd62406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.420+0000 7fd645e00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 0x7fd62406d0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd64815c810 tx=0x7fd638009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.423+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd648153290 con 0x7fd64815e2c0 2024-09-13T18:35:40.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.592+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd648153290 con 0x7fd64815e2c0 2024-09-13T18:35:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.593+0000 7fd63ea00640 1 -- 172.21.15.192:0/1817813043 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fd648153290 con 0x7fd64815e2c0 2024-09-13T18:35:40.596 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:40.596 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":20,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:40.212962+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.595+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 msgr2=0x7fd62406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.595+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 0x7fd62406d0c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd64815c810 tx=0x7fd638009190 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.595+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 msgr2=0x7fd648156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.595+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd63000c780 tx=0x7fd63000cc40 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 shutdown_connections 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62406ac00 0x7fd62406d0c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd648151ff0 0x7fd648070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64815e2c0 0x7fd648156e80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 --2- 172.21.15.192:0/1817813043 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64815dee0 0x7fd64813c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 >> 172.21.15.192:0/1817813043 conn(0x7fd6480ae960 msgr2=0x7fd64815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 shutdown_connections 2024-09-13T18:35:40.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.596+0000 7fd64ca00640 1 -- 172.21.15.192:0/1817813043 wait complete. 2024-09-13T18:35:40.614 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:40.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.764+0000 7f7a2e600640 1 Processor -- start 2024-09-13T18:35:40.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.764+0000 7f7a2e600640 1 -- start start 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a2e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7a2815cfa0 0x7f7a280d2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a2e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2806a5b0 0x7f7a280b6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a2e600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a280d2cf0 con 0x7f7a280d28c0 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a2e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a280b2790 con 0x7f7a2815cfa0 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a2e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2806abb0 con 0x7f7a2806a5b0 2024-09-13T18:35:40.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a26a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7a280d28c0 0x7f7a28069ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38098/0 (socket says 172.21.15.192:38098) 2024-09-13T18:35:40.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.765+0000 7f7a26a00640 1 -- 172.21.15.192:0/3968564376 learned_addr learned my addr 172.21.15.192:0/3968564376 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:40.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27400640 1 --2- 172.21.15.192:0/3968564376 >> v2:172.21.15.194:3300/0 conn(0x7f7a2815cfa0 0x7f7a280d2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27e00640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2806a5b0 0x7f7a280b6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a26000640 1 -- 172.21.15.192:0/3968564376 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249038989 0 0) 0x7f7a280d2cf0 con 0x7f7a280d28c0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a26000640 1 -- 172.21.15.192:0/3968564376 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a0c003520 con 0x7f7a280d28c0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27400640 1 -- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2806a5b0 msgr2=0x7f7a280b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27400640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2806a5b0 0x7f7a280b6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27400640 1 -- 172.21.15.192:0/3968564376 >> v1:172.21.15.192:6789/0 conn(0x7f7a280d28c0 legacy=0x7f7a28069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.766+0000 7f7a27400640 1 -- 172.21.15.192:0/3968564376 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2806ae90 con 0x7f7a2815cfa0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.767+0000 7f7a27400640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2815cfa0 0x7f7a280d2380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a180097a0 tx=0x7f7a1802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f380fb3163e7a99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.767+0000 7f7a26000640 1 -- 172.21.15.192:0/3968564376 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18032440 con 0x7f7a2815cfa0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.767+0000 7f7a26000640 1 -- 172.21.15.192:0/3968564376 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a180325a0 con 0x7f7a2815cfa0 2024-09-13T18:35:40.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.767+0000 7f7a26000640 1 -- 172.21.15.192:0/3968564376 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a18032910 con 0x7f7a2815cfa0 2024-09-13T18:35:40.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 -- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2815cfa0 msgr2=0x7f7a280d2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2815cfa0 0x7f7a280d2380 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7a180097a0 tx=0x7f7a1802a180 comp rx=0 tx=0).stop 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 -- 172.21.15.192:0/3968564376 shutdown_connections 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a2806a5b0 0x7f7a280b6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3968564376 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2815cfa0 0x7f7a280d2380 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 -- 172.21.15.192:0/3968564376 >> 172.21.15.192:0/3968564376 conn(0x7f7a280b49a0 msgr2=0x7f7a280b4db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 -- 172.21.15.192:0/3968564376 shutdown_connections 2024-09-13T18:35:40.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.768+0000 7f7a2e600640 1 -- 172.21.15.192:0/3968564376 wait complete. 2024-09-13T18:35:40.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.770+0000 7f7a2e600640 1 Processor -- start 2024-09-13T18:35:40.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.770+0000 7f7a2e600640 1 -- start start 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2806a5b0 0x7f7a28155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a280d28c0 0x7f7a281f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a281f5960 con 0x7f7a2815cfa0 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a280cb840 con 0x7f7a2806a5b0 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a2e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a28158020 con 0x7f7a280d28c0 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33000/0 (socket says 172.21.15.192:33000) 2024-09-13T18:35:40.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 -- 172.21.15.192:0/3532892259 learned_addr learned my addr 172.21.15.192:0/3532892259 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27400640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2806a5b0 0x7f7a28155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a26a00640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a280d28c0 0x7f7a281f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 -- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a280d28c0 msgr2=0x7f7a281f2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a280d28c0 0x7f7a281f2580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 -- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2806a5b0 msgr2=0x7f7a28155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2806a5b0 0x7f7a28155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.771+0000 7f7a27e00640 1 -- 172.21.15.192:0/3532892259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a18009400 con 0x7f7a2815cfa0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a27e00640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000efc0 tx=0x7f7a2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20014480 con 0x7f7a2815cfa0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2000f040 con 0x7f7a2815cfa0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20014820 con 0x7f7a2815cfa0 2024-09-13T18:35:40.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a28158300 con 0x7f7a2815cfa0 2024-09-13T18:35:40.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.772+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a281588c0 con 0x7f7a2815cfa0 2024-09-13T18:35:40.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.773+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a280d2380 con 0x7f7a2815cfa0 2024-09-13T18:35:40.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.774+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7a20014980 con 0x7f7a2815cfa0 2024-09-13T18:35:40.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.775+0000 7f7a1f400640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 0x7f7a0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:40.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.775+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2008a1e0 con 0x7f7a2815cfa0 2024-09-13T18:35:40.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.775+0000 7f7a27400640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 0x7f7a0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:40.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.776+0000 7f7a27400640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 0x7f7a0806d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a18034000 tx=0x7f7a1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:40.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.779+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7a20055340 con 0x7f7a2815cfa0 2024-09-13T18:35:40.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.949+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a28158a80 con 0x7f7a2815cfa0 2024-09-13T18:35:40.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.950+0000 7f7a1f400640 1 -- 172.21.15.192:0/3532892259 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f7a20058960 con 0x7f7a2815cfa0 2024-09-13T18:35:40.953 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:40.954 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":20,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:40.212962+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:40.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 msgr2=0x7f7a0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 0x7f7a0806d0c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7a18034000 tx=0x7f7a1802e000 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 msgr2=0x7f7a280caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a2000efc0 tx=0x7f7a2000c490 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 shutdown_connections 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7a0806ac00 0x7f7a0806d0c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2815cfa0 0x7f7a280caff0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7a280d28c0 0x7f7a281f2580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 --2- 172.21.15.192:0/3532892259 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7a2806a5b0 0x7f7a28155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 >> 172.21.15.192:0/3532892259 conn(0x7f7a280b49a0 msgr2=0x7f7a280704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 shutdown_connections 2024-09-13T18:35:40.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:40.953+0000 7f7a2e600640 1 -- 172.21.15.192:0/3532892259 wait complete. 2024-09-13T18:35:40.971 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:35:41.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.124+0000 7f58d1000640 1 Processor -- start 2024-09-13T18:35:41.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.124+0000 7f58d1000640 1 -- start start 2024-09-13T18:35:41.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58d1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58cc1589f0 0x7f58cc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58d1000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 0x7f58cc06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58d1000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc0b2000 con 0x7f58cc0b3af0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58d1000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc06ca30 con 0x7f58cc1589f0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58d1000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc15b970 con 0x7f58cc06c0b0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58c9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58cc1589f0 0x7f58cc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.125+0000 7f58c9400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f58cc0b3af0 0x7f58cc15b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38100/0 (socket says 172.21.15.192:38100) 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58c9400640 1 -- 172.21.15.192:0/2534999203 learned_addr learned my addr 172.21.15.192:0/2534999203 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58ca800640 1 --2- 172.21.15.192:0/2534999203 >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 0x7f58cc06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58c9e00640 1 -- 172.21.15.192:0/2534999203 >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 msgr2=0x7f58cc06c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58c9e00640 1 --2- 172.21.15.192:0/2534999203 >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 0x7f58cc06c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58c9e00640 1 -- 172.21.15.192:0/2534999203 >> v1:172.21.15.192:6789/0 conn(0x7f58cc0b3af0 legacy=0x7f58cc15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58c9e00640 1 -- 172.21.15.192:0/2534999203 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc15bbd0 con 0x7f58cc1589f0 2024-09-13T18:35:41.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.126+0000 7f58ca800640 1 --2- 172.21.15.192:0/2534999203 >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 0x7f58cc06c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:41.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.127+0000 7f58c9e00640 1 --2- 172.21.15.192:0/2534999203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc1589f0 0x7f58cc0b2490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0cb890 tx=0x7f58bc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d647a7aa9b862312 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.127+0000 7f58c8a00640 1 -- 172.21.15.192:0/2534999203 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc02ae60 con 0x7f58cc1589f0 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.127+0000 7f58c8a00640 1 -- 172.21.15.192:0/2534999203 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc032440 con 0x7f58cc1589f0 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.127+0000 7f58c8a00640 1 -- 172.21.15.192:0/2534999203 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0327d0 con 0x7f58cc1589f0 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 -- 172.21.15.192:0/2534999203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc1589f0 msgr2=0x7f58cc0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 --2- 172.21.15.192:0/2534999203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc1589f0 0x7f58cc0b2490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f58cc0cb890 tx=0x7f58bc02a110 comp rx=0 tx=0).stop 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 -- 172.21.15.192:0/2534999203 shutdown_connections 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 --2- 172.21.15.192:0/2534999203 >> v2:172.21.15.194:3300/0 conn(0x7f58cc06c0b0 0x7f58cc06c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 --2- 172.21.15.192:0/2534999203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc1589f0 0x7f58cc0b2490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 -- 172.21.15.192:0/2534999203 >> 172.21.15.192:0/2534999203 conn(0x7f58cc0b08f0 msgr2=0x7f58cc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 -- 172.21.15.192:0/2534999203 shutdown_connections 2024-09-13T18:35:41.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.128+0000 7f58d1000640 1 -- 172.21.15.192:0/2534999203 wait complete. 2024-09-13T18:35:41.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.129+0000 7f58d1000640 1 Processor -- start 2024-09-13T18:35:41.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.129+0000 7f58d1000640 1 -- start start 2024-09-13T18:35:41.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 0x7f58cc1f1f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58cc1589f0 0x7f58cc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc14ee10 con 0x7f58cc0b3af0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc14f040 con 0x7f58cc1589f0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.130+0000 7f58d1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc14f320 con 0x7f58cc06c0b0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33026/0 (socket says 172.21.15.192:33026) 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 -- 172.21.15.192:0/505322011 learned_addr learned my addr 172.21.15.192:0/505322011 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9e00640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 0x7f58cc1f1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58ca800640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58cc1589f0 0x7f58cc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 -- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 msgr2=0x7f58cc1f1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 0x7f58cc1f1f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 -- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58cc1589f0 msgr2=0x7f58cc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58cc1589f0 0x7f58cc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 -- 172.21.15.192:0/505322011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009400 con 0x7f58cc0b3af0 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9e00640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 0x7f58cc1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c9400640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c4a0 tx=0x7f58b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8005ce0 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b8005e40 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.131+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8007270 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.132+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc14f600 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.132+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc14fbc0 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.133+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58cc14fde0 con 0x7f58cc0b3af0 2024-09-13T18:35:41.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.134+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f58b8007490 con 0x7f58cc0b3af0 2024-09-13T18:35:41.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.134+0000 7f58c2000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 0x7f58ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:41.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.134+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b8088770 con 0x7f58cc0b3af0 2024-09-13T18:35:41.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.135+0000 7f58c9e00640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 0x7f58ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:41.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.135+0000 7f58c9e00640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 0x7f58ac06d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:41.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.138+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f58b80539f0 con 0x7f58cc0b3af0 2024-09-13T18:35:41.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:41.363+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f58cc06c4f0 con 0x7f58cc0b3af0 2024-09-13T18:35:42.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.237+0000 7f58c2000640 1 -- 172.21.15.192:0/505322011 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f58b80170b0 con 0x7f58cc0b3af0 2024-09-13T18:35:42.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 msgr2=0x7f58ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 0x7f58ac06d0c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58bc034000 tx=0x7f58bc02e000 comp rx=0 tx=0).stop 2024-09-13T18:35:42.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 msgr2=0x7f58cc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f58b800c4a0 tx=0x7f58b800c960 comp rx=0 tx=0).stop 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 shutdown_connections 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f58ac06ac00 0x7f58ac06d0c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58cc1589f0 0x7f58cc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58cc0b3af0 0x7f58cc0ad840 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 --2- 172.21.15.192:0/505322011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f58cc06c0b0 0x7f58cc1f1f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 >> 172.21.15.192:0/505322011 conn(0x7f58cc0b08f0 msgr2=0x7f58cc0ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 shutdown_connections 2024-09-13T18:35:42.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.239+0000 7f58d1000640 1 -- 172.21.15.192:0/505322011 wait complete. 2024-09-13T18:35:42.259 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['disabled']} 2024-09-13T18:35:42.260 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:35:42.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.413+0000 7f88a2000640 1 Processor -- start 2024-09-13T18:35:42.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.413+0000 7f88a2000640 1 -- start start 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.414+0000 7f88a2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 0x7f889c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.414+0000 7f88a2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f889c0b3da0 0x7f889c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f88a2000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c06b480 con 0x7f889c06a8b0 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f88a2000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c0ce770 con 0x7f889c0b3da0 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f88a2000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c06b760 con 0x7f889c1434c0 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f8893e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f889c06a8b0 0x7f889c0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38112/0 (socket says 172.21.15.192:38112) 2024-09-13T18:35:42.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f8893e00640 1 -- 172.21.15.192:0/4170724457 learned_addr learned my addr 172.21.15.192:0/4170724457 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889be00640 1 --2- 172.21.15.192:0/4170724457 >> v2:172.21.15.192:3300/0 conn(0x7f889c0b3da0 0x7f889c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889b400640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 0x7f889c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889aa00640 1 -- 172.21.15.192:0/4170724457 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686467438 0 0) 0x7f889c06b480 con 0x7f889c06a8b0 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889aa00640 1 -- 172.21.15.192:0/4170724457 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8880003520 con 0x7f889c06a8b0 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889be00640 1 -- 172.21.15.192:0/4170724457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 msgr2=0x7f889c06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889be00640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 0x7f889c06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889be00640 1 -- 172.21.15.192:0/4170724457 >> v1:172.21.15.192:6789/0 conn(0x7f889c06a8b0 legacy=0x7f889c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889be00640 1 -- 172.21.15.192:0/4170724457 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c06ba40 con 0x7f889c0b3da0 2024-09-13T18:35:42.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.415+0000 7f889b400640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 0x7f889c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:42.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.416+0000 7f889be00640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0b3da0 0x7f889c06e920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8894009dc0 tx=0x7f889402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c6d7957bcbd7a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f889aa00640 1 -- 172.21.15.192:0/4170724457 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007740 con 0x7f889c0b3da0 2024-09-13T18:35:42.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f889aa00640 1 -- 172.21.15.192:0/4170724457 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889402d050 con 0x7f889c0b3da0 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f889aa00640 1 -- 172.21.15.192:0/4170724457 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007ac0 con 0x7f889c0b3da0 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 -- 172.21.15.192:0/4170724457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0b3da0 msgr2=0x7f889c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0b3da0 0x7f889c06e920 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8894009dc0 tx=0x7f889402a5f0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 -- 172.21.15.192:0/4170724457 shutdown_connections 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0b3da0 0x7f889c06e920 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 --2- 172.21.15.192:0/4170724457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c1434c0 0x7f889c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 -- 172.21.15.192:0/4170724457 >> 172.21.15.192:0/4170724457 conn(0x7f889c0b08f0 msgr2=0x7f889c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 -- 172.21.15.192:0/4170724457 shutdown_connections 2024-09-13T18:35:42.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.417+0000 7f88a2000640 1 -- 172.21.15.192:0/4170724457 wait complete. 2024-09-13T18:35:42.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.419+0000 7f88a2000640 1 Processor -- start 2024-09-13T18:35:42.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.419+0000 7f88a2000640 1 -- start start 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c06a8b0 0x7f889c13fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 0x7f889c139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c13e4d0 con 0x7f889c1434c0 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c06f460 con 0x7f889c06a8b0 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f88a2000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c13de80 con 0x7f889c0b3da0 2024-09-13T18:35:42.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f889be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f889be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33034/0 (socket says 172.21.15.192:33034) 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f889be00640 1 -- 172.21.15.192:0/1505647311 learned_addr learned my addr 172.21.15.192:0/1505647311 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f889b400640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c06a8b0 0x7f889c13fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.420+0000 7f8893e00640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 0x7f889c139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 -- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 msgr2=0x7f889c139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 0x7f889c139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 -- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c06a8b0 msgr2=0x7f889c13fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c06a8b0 0x7f889c13fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 -- 172.21.15.192:0/1505647311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c009400 con 0x7f889c1434c0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f8893e00640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 0x7f889c139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f889be00640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8894009ee0 tx=0x7f8894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889403c830 con 0x7f889c1434c0 2024-09-13T18:35:42.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889403c990 con 0x7f889c1434c0 2024-09-13T18:35:42.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889403cd20 con 0x7f889c1434c0 2024-09-13T18:35:42.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8894009a70 con 0x7f889c1434c0 2024-09-13T18:35:42.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.421+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c06f740 con 0x7f889c1434c0 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.422+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c0cc7d0 con 0x7f889c1434c0 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.423+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8894031400 con 0x7f889c1434c0 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.424+0000 7f8893400640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 0x7f887806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.424+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88940aaf20 con 0x7f889c1434c0 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.424+0000 7f889b400640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 0x7f887806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:42.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.425+0000 7f889b400640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 0x7f887806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f889c1f6590 tx=0x7f888c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:42.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.428+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8894076210 con 0x7f889c1434c0 2024-09-13T18:35:42.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:42.631+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f889c15dc90 con 0x7f889c1434c0 2024-09-13T18:35:43.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.243+0000 7f8893400640 1 -- 172.21.15.192:0/1505647311 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8894079830 con 0x7f889c1434c0 2024-09-13T18:35:43.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 msgr2=0x7f887806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 0x7f887806d0c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f889c1f6590 tx=0x7f888c009190 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 msgr2=0x7f889c06ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8894009ee0 tx=0x7f8894004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 shutdown_connections 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887806ac00 0x7f887806d0c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c1434c0 0x7f889c06ebb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b3da0 0x7f889c139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 --2- 172.21.15.192:0/1505647311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c06a8b0 0x7f889c13fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 >> 172.21.15.192:0/1505647311 conn(0x7f889c0b08f0 msgr2=0x7f889c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 shutdown_connections 2024-09-13T18:35:43.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.246+0000 7f88a2000640 1 -- 172.21.15.192:0/1505647311 wait complete. 2024-09-13T18:35:43.265 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:35:43.266 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:43.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.415+0000 7f5310600640 1 Processor -- start 2024-09-13T18:35:43.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.415+0000 7f5310600640 1 -- start start 2024-09-13T18:35:43.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.416+0000 7f5310600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f530815dee0 0x7f53080afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f5310600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 0x7f53080b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f5310600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080b2f00 con 0x7f530815e2c0 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f5310600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080b3150 con 0x7f530815dee0 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f5310600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080b3430 con 0x7f53080b3f10 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f530815dee0 0x7f53080afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530e600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f530815e2c0 0x7f530815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38114/0 (socket says 172.21.15.192:38114) 2024-09-13T18:35:43.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530e600640 1 -- 172.21.15.192:0/1992968012 learned_addr learned my addr 172.21.15.192:0/1992968012 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:43.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530d200640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 0x7f53080b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530dc00640 1 -- 172.21.15.192:0/1992968012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 msgr2=0x7f53080b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530dc00640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 0x7f53080b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530dc00640 1 -- 172.21.15.192:0/1992968012 >> v1:172.21.15.192:6789/0 conn(0x7f530815e2c0 legacy=0x7f530815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f5307e00640 1 -- 172.21.15.192:0/1992968012 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155530225 0 0) 0x7f53080b2f00 con 0x7f530815e2c0 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530dc00640 1 -- 172.21.15.192:0/1992968012 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080b3710 con 0x7f530815dee0 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.417+0000 7f530d200640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 0x7f53080b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.418+0000 7f530dc00640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f53080afd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0097a0 tx=0x7f52fc02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5f876015e6f5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5307e00640 1 -- 172.21.15.192:0/1992968012 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc032440 con 0x7f530815dee0 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5307e00640 1 -- 172.21.15.192:0/1992968012 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc0325a0 con 0x7f530815dee0 2024-09-13T18:35:43.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5307e00640 1 -- 172.21.15.192:0/1992968012 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc032930 con 0x7f530815dee0 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 -- 172.21.15.192:0/1992968012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 msgr2=0x7f53080afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f53080afd80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0097a0 tx=0x7f52fc02a180 comp rx=0 tx=0).stop 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 -- 172.21.15.192:0/1992968012 shutdown_connections 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53080b3f10 0x7f53080b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 --2- 172.21.15.192:0/1992968012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f53080afd80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 -- 172.21.15.192:0/1992968012 >> 172.21.15.192:0/1992968012 conn(0x7f53080ae960 msgr2=0x7f530806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 -- 172.21.15.192:0/1992968012 shutdown_connections 2024-09-13T18:35:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.419+0000 7f5310600640 1 -- 172.21.15.192:0/1992968012 wait complete. 2024-09-13T18:35:43.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.421+0000 7f5310600640 1 Processor -- start 2024-09-13T18:35:43.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.421+0000 7f5310600640 1 -- start start 2024-09-13T18:35:43.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f530815e2c0 0x7f530806bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f530806c1d0 0x7f5308158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530806b240 con 0x7f530815dee0 2024-09-13T18:35:43.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530806b800 con 0x7f530806c1d0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f5310600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530813dd90 con 0x7f530815e2c0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33060/0 (socket says 172.21.15.192:33060) 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 -- 172.21.15.192:0/2737380782 learned_addr learned my addr 172.21.15.192:0/2737380782 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530d200640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f530815e2c0 0x7f530806bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530e600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f530806c1d0 0x7f5308158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 -- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f530815e2c0 msgr2=0x7f530806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f530815e2c0 0x7f530806bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 -- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f530806c1d0 msgr2=0x7f5308158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f530806c1d0 0x7f5308158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.422+0000 7f530dc00640 1 -- 172.21.15.192:0/2737380782 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009400 con 0x7f530815dee0 2024-09-13T18:35:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f530dc00640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52fc035040 tx=0x7f52fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc032440 con 0x7f530815dee0 2024-09-13T18:35:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52fc006e10 con 0x7f530815dee0 2024-09-13T18:35:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52fc030be0 con 0x7f530815dee0 2024-09-13T18:35:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530813e070 con 0x7f530815dee0 2024-09-13T18:35:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.423+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5308159080 con 0x7f530815dee0 2024-09-13T18:35:43.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.424+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530813e230 con 0x7f530815dee0 2024-09-13T18:35:43.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.425+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f52fc039040 con 0x7f530815dee0 2024-09-13T18:35:43.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.426+0000 7f5305600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 0x7f52e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.426+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52fc0a9be0 con 0x7f530815dee0 2024-09-13T18:35:43.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.426+0000 7f530d200640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 0x7f52e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.427+0000 7f530d200640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 0x7f52e806d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5308142e10 tx=0x7f52f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.430+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f52fc074e60 con 0x7f530815dee0 2024-09-13T18:35:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.632+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f530815a440 con 0x7f530815dee0 2024-09-13T18:35:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.633+0000 7f5305600640 1 -- 172.21.15.192:0/2737380782 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f52fc078480 con 0x7f530815dee0 2024-09-13T18:35:43.636 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:43.636 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:35:43.636 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:35:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 msgr2=0x7f52e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 0x7f52e806d0c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5308142e10 tx=0x7f52f4008040 comp rx=0 tx=0).stop 2024-09-13T18:35:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 msgr2=0x7f530813eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f52fc035040 tx=0x7f52fc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 shutdown_connections 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f52e806ac00 0x7f52e806d0c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f530806c1d0 0x7f5308158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f530815e2c0 0x7f530806bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 --2- 172.21.15.192:0/2737380782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f530815dee0 0x7f530813eeb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 >> 172.21.15.192:0/2737380782 conn(0x7f53080ae960 msgr2=0x7f5308136eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 shutdown_connections 2024-09-13T18:35:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.635+0000 7f5310600640 1 -- 172.21.15.192:0/2737380782 wait complete. 2024-09-13T18:35:43.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:43.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.804+0000 7f539ac00640 1 Processor -- start 2024-09-13T18:35:43.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.804+0000 7f539ac00640 1 -- start start 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f539ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f539415dee0 0x7f53940afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f539ac00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f539415e2c0 0x7f539415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f539ac00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53940b2f00 con 0x7f53940b3f10 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f539ac00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940b3150 con 0x7f539415e2c0 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f539ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53940b3430 con 0x7f539415dee0 2024-09-13T18:35:43.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f5398c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f539415e2c0 0x7f539415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f538be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f53940b3f10 0x7f539415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38122/0 (socket says 172.21.15.192:38122) 2024-09-13T18:35:43.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f538be00640 1 -- 172.21.15.192:0/640259404 learned_addr learned my addr 172.21.15.192:0/640259404 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:43.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.805+0000 7f5393e00640 1 --2- 172.21.15.192:0/640259404 >> v2:172.21.15.194:3300/0 conn(0x7f539415dee0 0x7f53940afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.806+0000 7f5398c00640 1 -- 172.21.15.192:0/640259404 >> v2:172.21.15.194:3300/0 conn(0x7f539415dee0 msgr2=0x7f53940afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:43.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.806+0000 7f5398c00640 1 --2- 172.21.15.192:0/640259404 >> v2:172.21.15.194:3300/0 conn(0x7f539415dee0 0x7f53940afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.806+0000 7f5398c00640 1 -- 172.21.15.192:0/640259404 >> v1:172.21.15.192:6789/0 conn(0x7f53940b3f10 legacy=0x7f539415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.806+0000 7f5393400640 1 -- 172.21.15.192:0/640259404 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 408897465 0 0) 0x7f53940b2f00 con 0x7f53940b3f10 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.806+0000 7f5398c00640 1 -- 172.21.15.192:0/640259404 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53940b3710 con 0x7f539415e2c0 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.807+0000 7f5398c00640 1 --2- 172.21.15.192:0/640259404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415e2c0 0x7f539415ab50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f539406cd20 tx=0x7f538c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b863b3e252a86f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.807+0000 7f5393400640 1 -- 172.21.15.192:0/640259404 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c02aea0 con 0x7f539415e2c0 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.807+0000 7f5393400640 1 -- 172.21.15.192:0/640259404 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c02d050 con 0x7f539415e2c0 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.807+0000 7f5393400640 1 -- 172.21.15.192:0/640259404 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c007960 con 0x7f539415e2c0 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.807+0000 7f539ac00640 1 -- 172.21.15.192:0/640259404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415e2c0 msgr2=0x7f539415ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 --2- 172.21.15.192:0/640259404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415e2c0 0x7f539415ab50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f539406cd20 tx=0x7f538c02a680 comp rx=0 tx=0).stop 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 -- 172.21.15.192:0/640259404 shutdown_connections 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 --2- 172.21.15.192:0/640259404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415e2c0 0x7f539415ab50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 --2- 172.21.15.192:0/640259404 >> v2:172.21.15.194:3300/0 conn(0x7f539415dee0 0x7f53940afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 -- 172.21.15.192:0/640259404 >> 172.21.15.192:0/640259404 conn(0x7f53940ae960 msgr2=0x7f539406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 -- 172.21.15.192:0/640259404 shutdown_connections 2024-09-13T18:35:43.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.808+0000 7f539ac00640 1 -- 172.21.15.192:0/640259404 wait complete. 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.809+0000 7f539ac00640 1 Processor -- start 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.809+0000 7f539ac00640 1 -- start start 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 0x7f5394135420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 0x7f539413bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539413df80 con 0x7f539415dee0 2024-09-13T18:35:43.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5394154930 con 0x7f539415e2c0 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f539ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539413e2a0 con 0x7f5394159250 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f5393e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f5393e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33078/0 (socket says 172.21.15.192:33078) 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.810+0000 7f5393e00640 1 -- 172.21.15.192:0/1581856432 learned_addr learned my addr 172.21.15.192:0/1581856432 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5398c00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 0x7f539413bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f538be00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 0x7f5394135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 -- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 msgr2=0x7f539413bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 0x7f539413bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 -- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 msgr2=0x7f5394135420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 0x7f5394135420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 -- 172.21.15.192:0/1581856432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f538c009a70 con 0x7f539415dee0 2024-09-13T18:35:43.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5398c00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 0x7f539413bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f538be00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 0x7f5394135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5393e00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f538400e9b0 tx=0x7f538400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5384009670 con 0x7f539415dee0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538400c9a0 con 0x7f539415dee0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538400cd50 con 0x7f539415dee0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539413e580 con 0x7f539415dee0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.811+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539413eb40 con 0x7f539415dee0 2024-09-13T18:35:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.812+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53940afd80 con 0x7f539415dee0 2024-09-13T18:35:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.813+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5384013470 con 0x7f539415dee0 2024-09-13T18:35:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.814+0000 7f5390c00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 0x7f537006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.815+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53840895f0 con 0x7f539415dee0 2024-09-13T18:35:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.815+0000 7f538be00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 0x7f537006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:43.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.815+0000 7f538be00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 0x7f537006d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53941f5e60 tx=0x7f537c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:43.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.819+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53840547d0 con 0x7f539415dee0 2024-09-13T18:35:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.990+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f539415ad70 con 0x7f539415dee0 2024-09-13T18:35:43.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.991+0000 7f5390c00640 1 -- 172.21.15.192:0/1581856432 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f5384057df0 con 0x7f539415dee0 2024-09-13T18:35:43.994 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:43.994 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:43.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 msgr2=0x7f537006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 0x7f537006d0c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f53941f5e60 tx=0x7f537c009040 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 msgr2=0x7f539413da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f538400e9b0 tx=0x7f538400ee70 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 shutdown_connections 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f537006ac00 0x7f537006d0c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5394159250 0x7f539413bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f539415e2c0 0x7f5394135420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 --2- 172.21.15.192:0/1581856432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f539415dee0 0x7f539413da40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.993+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 >> 172.21.15.192:0/1581856432 conn(0x7f53940ae960 msgr2=0x7f5394135d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.994+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 shutdown_connections 2024-09-13T18:35:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:43.994+0000 7f539ac00640 1 -- 172.21.15.192:0/1581856432 wait complete. 2024-09-13T18:35:44.012 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:35:44.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:44.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.160+0000 7f256be00640 1 Processor -- start 2024-09-13T18:35:44.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.160+0000 7f256be00640 1 -- start start 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.161+0000 7f256be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25640cacd0 0x7f256415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f256be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f256415bc20 0x7f25640afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f256be00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2564140480 con 0x7f25640cb0b0 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f256be00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640cb520 con 0x7f25640cacd0 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f256be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256415ee90 con 0x7f256415bc20 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25640cacd0 0x7f256415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2568a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f25640cb0b0 0x7f2564140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38138/0 (socket says 172.21.15.192:38138) 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2568a00640 1 -- 172.21.15.192:0/297248923 learned_addr learned my addr 172.21.15.192:0/297248923 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569e00640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f256415bc20 0x7f25640afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2563e00640 1 -- 172.21.15.192:0/297248923 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2058368989 0 0) 0x7f2564140480 con 0x7f25640cb0b0 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569400640 1 -- 172.21.15.192:0/297248923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f256415bc20 msgr2=0x7f25640afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569400640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f256415bc20 0x7f25640afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569400640 1 -- 172.21.15.192:0/297248923 >> v1:172.21.15.192:6789/0 conn(0x7f25640cb0b0 legacy=0x7f2564140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.162+0000 7f2569400640 1 -- 172.21.15.192:0/297248923 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256415f170 con 0x7f25640cacd0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.163+0000 7f2569400640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f256415e790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25580097d0 tx=0x7f255802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209c8eb08a463545 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.163+0000 7f2563e00640 1 -- 172.21.15.192:0/297248923 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558032440 con 0x7f25640cacd0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.163+0000 7f2563e00640 1 -- 172.21.15.192:0/297248923 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25580325a0 con 0x7f25640cacd0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.163+0000 7f2563e00640 1 -- 172.21.15.192:0/297248923 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558032930 con 0x7f25640cacd0 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 -- 172.21.15.192:0/297248923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 msgr2=0x7f256415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f256415e790 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f25580097d0 tx=0x7f255802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 -- 172.21.15.192:0/297248923 shutdown_connections 2024-09-13T18:35:44.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f256415bc20 0x7f25640afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 --2- 172.21.15.192:0/297248923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f256415e790 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 -- 172.21.15.192:0/297248923 >> 172.21.15.192:0/297248923 conn(0x7f25640ae960 msgr2=0x7f256406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 -- 172.21.15.192:0/297248923 shutdown_connections 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.164+0000 7f256be00640 1 -- 172.21.15.192:0/297248923 wait complete. 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.166+0000 7f256be00640 1 Processor -- start 2024-09-13T18:35:44.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.166+0000 7f256be00640 1 -- start start 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 0x7f2564165be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256415bc20 0x7f2564166120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640cc5b0 con 0x7f25640cacd0 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25640cc860 con 0x7f256415bc20 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f256be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25640ccb40 con 0x7f25640cb0b0 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33100/0 (socket says 172.21.15.192:33100) 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 -- 172.21.15.192:0/3558524528 learned_addr learned my addr 172.21.15.192:0/3558524528 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:44.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2568a00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 0x7f2564165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569e00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256415bc20 0x7f2564166120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 -- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 msgr2=0x7f2564165be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 0x7f2564165be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 -- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256415bc20 msgr2=0x7f2564166120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256415bc20 0x7f2564166120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2569400640 1 -- 172.21.15.192:0/3558524528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009400 con 0x7f25640cacd0 2024-09-13T18:35:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.167+0000 7f2568a00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 0x7f2564165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f2569400640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2558035040 tx=0x7f25580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558032440 con 0x7f25640cacd0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558030bc0 con 0x7f25640cacd0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2558006e10 con 0x7f25640cacd0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25640cce20 con 0x7f25640cacd0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.168+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25640cd3e0 con 0x7f25640cacd0 2024-09-13T18:35:44.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.169+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256415e790 con 0x7f25640cacd0 2024-09-13T18:35:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.170+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2558039040 con 0x7f25640cacd0 2024-09-13T18:35:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.171+0000 7f2561600640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 0x7f254406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.171+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25580a9cf0 con 0x7f25640cacd0 2024-09-13T18:35:44.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.171+0000 7f2568a00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 0x7f254406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.172+0000 7f2568a00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 0x7f254406d0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2564151610 tx=0x7f2550007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.175+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2558074ec0 con 0x7f25640cacd0 2024-09-13T18:35:44.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.340+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f256415c070 con 0x7f254406ac00 2024-09-13T18:35:44.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.348+0000 7f2561600640 1 -- 172.21.15.192:0/3558524528 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249309 (secure 0 0 0) 0x7f2550005c80 con 0x7f254406ac00 2024-09-13T18:35:44.353 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:44.354 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:44.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.351+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 msgr2=0x7f254406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.351+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 0x7f254406d0c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2564151610 tx=0x7f2550007ca0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.351+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 msgr2=0x7f25640cc070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.351+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2558035040 tx=0x7f25580046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 shutdown_connections 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f254406ac00 0x7f254406d0c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f256415bc20 0x7f2564166120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25640cb0b0 0x7f2564165be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 --2- 172.21.15.192:0/3558524528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25640cacd0 0x7f25640cc070 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 >> 172.21.15.192:0/3558524528 conn(0x7f25640ae960 msgr2=0x7f256413e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 shutdown_connections 2024-09-13T18:35:44.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.352+0000 7f256be00640 1 -- 172.21.15.192:0/3558524528 wait complete. 2024-09-13T18:35:44.370 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-13T18:35:42.734315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":10,"acting":10,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1552,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560947,"statfs":{"total":1600000000,"available":1598410535,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000590"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795725+0000","last_change":"2024-09-13T18:35:38.795725+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795725+0000","last_undegraded":"2024-09-13T18:35:38.795725+0000","last_fullsized":"2024-09-13T18:35:38.795725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795610+0000","last_change":"2024-09-13T18:35:38.795610+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795610+0000","last_undegraded":"2024-09-13T18:35:38.795610+0000","last_fullsized":"2024-09-13T18:35:38.795610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":161,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-09-13T18:35:32.668761+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:32.668761+0000","last_peered":"2024-09-13T18:35:32.668761+0000","last_clean":"2024-09-13T18:35:32.668761+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:32.668761+0000","last_undegraded":"2024-09-13T18:35:32.668761+0000","last_fullsized":"2024-09-13T18:35:32.668761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796150+0000","last_change":"2024-09-13T18:35:38.796150+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796150+0000","last_undegraded":"2024-09-13T18:35:38.796150+0000","last_fullsized":"2024-09-13T18:35:38.796150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796442+0000","last_change":"2024-09-13T18:35:38.796442+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796442+0000","last_undegraded":"2024-09-13T18:35:38.796442+0000","last_fullsized":"2024-09-13T18:35:38.796442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:38.788010+0000","last_change":"2024-09-13T18:35:38.788010+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.788010+0000","last_undegraded":"2024-09-13T18:35:38.788010+0000","last_fullsized":"2024-09-13T18:35:38.788010+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":625,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194686,"statfs":{"total":200000000,"available":199359268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":49,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195263,"statfs":{"total":200000000,"available":199949636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:44.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:44.478 INFO:tasks.ceph.mds.c.smithi192.stderr:2024-09-13T18:35:44.476+0000 7f7c3e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:35:44.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.560+0000 7fd8d1c00640 1 Processor -- start 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.560+0000 7fd8d1c00640 1 -- start start 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.561+0000 7fd8d1c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8cc0cacd0 0x7fd8cc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8d1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8d1c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8cc140480 con 0x7fd8cc140980 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8d1c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8cc15c160 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8d1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc15ee90 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8caa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8cc0cacd0 0x7fd8cc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8ca000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8ca000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40472/0 (socket says 172.21.15.192:40472) 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8caa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8cc0cacd0 0x7fd8cc15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:51476/0 (socket says 172.21.15.192:51476) 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8ca000640 1 -- 172.21.15.192:0/1802544096 learned_addr learned my addr 172.21.15.192:0/1802544096 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.562+0000 7fd8cb400640 1 --1- 172.21.15.192:0/1802544096 >> v1:172.21.15.194:6789/0 conn(0x7fd8cc140980 0x7fd8cc0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:46816/0 (socket says 172.21.15.192:46816) 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8c9600640 1 -- 172.21.15.192:0/1802544096 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022933465 0 0) 0x7fd8cc140480 con 0x7fd8cc140980 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8c9600640 1 -- 172.21.15.192:0/1802544096 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8b0003520 con 0x7fd8cc140980 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8caa00640 1 -- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 msgr2=0x7fd8cc15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8caa00640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8caa00640 1 -- 172.21.15.192:0/1802544096 >> v1:172.21.15.194:6789/0 conn(0x7fd8cc140980 legacy=0x7fd8cc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8caa00640 1 -- 172.21.15.192:0/1802544096 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8cc15f170 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.563+0000 7fd8ca000640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:44.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8caa00640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc15e790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0097a0 tx=0x7fd8bc02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf906537638c0df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8c9600640 1 -- 172.21.15.192:0/1802544096 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc032440 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8c9600640 1 -- 172.21.15.192:0/1802544096 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0325a0 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8c9600640 1 -- 172.21.15.192:0/1802544096 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc032930 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8d1c00640 1 -- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 msgr2=0x7fd8cc15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.564+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc15e790 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0097a0 tx=0x7fd8bc02a180 comp rx=0 tx=0).stop 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 -- 172.21.15.192:0/1802544096 shutdown_connections 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc0cb0b0 0x7fd8cc15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/1802544096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc15e790 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 -- 172.21.15.192:0/1802544096 >> 172.21.15.192:0/1802544096 conn(0x7fd8cc0ae960 msgr2=0x7fd8cc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 -- 172.21.15.192:0/1802544096 shutdown_connections 2024-09-13T18:35:44.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.565+0000 7fd8d1c00640 1 -- 172.21.15.192:0/1802544096 wait complete. 2024-09-13T18:35:44.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.566+0000 7fd8d1c00640 1 Processor -- start 2024-09-13T18:35:44.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.566+0000 7fd8d1c00640 1 -- start start 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 0x7fd8cc154df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1576a0 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc1f3e00 con 0x7fd8cc0cacd0 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.567+0000 7fd8d1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8cc15aad0 con 0x7fd8cc140980 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33112/0 (socket says 172.21.15.192:33112) 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 -- 172.21.15.192:0/2894866778 learned_addr learned my addr 172.21.15.192:0/2894866778 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8caa00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8cb400640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 0x7fd8cc154df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 -- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 msgr2=0x7fd8cc154df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 0x7fd8cc154df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 -- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 msgr2=0x7fd8cc069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 -- 172.21.15.192:0/2894866778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094d0 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8cb400640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 0x7fd8cc154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:44.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.568+0000 7fd8ca000640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800e9b0 tx=0x7fd8b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.569+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800c9a0 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.569+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b800cb00 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.569+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b800ce70 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.569+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8bc009400 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.569+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8cc1572c0 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.570+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8cc157910 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.570+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8b8013470 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.571+0000 7fd8c2a00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 0x7fd8ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.571+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8b80898e0 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.572+0000 7fd8caa00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 0x7fd8ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.572+0000 7fd8caa00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 0x7fd8ac06d0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.576+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd8b8054b60 con 0x7fd8cc0cb0b0 2024-09-13T18:35:44.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.740+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd8cc0cb4f0 con 0x7fd8ac06ac00 2024-09-13T18:35:44.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.747+0000 7fd8c2a00640 1 -- 172.21.15.192:0/2894866778 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258666 (secure 0 0 0) 0x7fd8bc032890 con 0x7fd8ac06ac00 2024-09-13T18:35:44.753 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:44.755 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:44.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 msgr2=0x7fd8ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 0x7fd8ac06d0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc034000 tx=0x7fd8bc02e000 comp rx=0 tx=0).stop 2024-09-13T18:35:44.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 msgr2=0x7fd8cc1f38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd8b800e9b0 tx=0x7fd8b800ee70 comp rx=0 tx=0).stop 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 shutdown_connections 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8ac06ac00 0x7fd8ac06d0c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8cc140980 0x7fd8cc154df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8cc0cb0b0 0x7fd8cc1f38c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 --2- 172.21.15.192:0/2894866778 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8cc0cacd0 0x7fd8cc069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 >> 172.21.15.192:0/2894866778 conn(0x7fd8cc0ae960 msgr2=0x7fd8cc15c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 shutdown_connections 2024-09-13T18:35:44.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.751+0000 7fd8d1c00640 1 -- 172.21.15.192:0/2894866778 wait complete. 2024-09-13T18:35:44.769 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:35:44.734609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560771,"statfs":{"total":1600000000,"available":1598229734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.940754"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795725+0000","last_change":"2024-09-13T18:35:38.795725+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795725+0000","last_undegraded":"2024-09-13T18:35:38.795725+0000","last_fullsized":"2024-09-13T18:35:38.795725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795610+0000","last_change":"2024-09-13T18:35:38.795610+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795610+0000","last_undegraded":"2024-09-13T18:35:38.795610+0000","last_fullsized":"2024-09-13T18:35:38.795610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796150+0000","last_change":"2024-09-13T18:35:38.796150+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796150+0000","last_undegraded":"2024-09-13T18:35:38.796150+0000","last_fullsized":"2024-09-13T18:35:38.796150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796442+0000","last_change":"2024-09-13T18:35:38.796442+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796442+0000","last_undegraded":"2024-09-13T18:35:38.796442+0000","last_fullsized":"2024-09-13T18:35:38.796442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:44.773 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:44.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.958+0000 7f7013e00640 1 Processor -- start 2024-09-13T18:35:44.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.958+0000 7f7013e00640 1 -- start start 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f70140b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f701406bc30 0x7f70140b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 0x7f701415a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701415af60 con 0x7f701406bc30 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f701406b7a0 con 0x7f7014159ee0 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f701415ac80 con 0x7f7014159b00 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f701406bc30 0x7f70140b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f701406bc30 0x7f70140b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33120/0 (socket says 172.21.15.192:33120) 2024-09-13T18:35:44.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 -- 172.21.15.192:0/1203753501 learned_addr learned my addr 172.21.15.192:0/1203753501 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 -- 172.21.15.192:0/1203753501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 msgr2=0x7f70140b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013400640 1 --2- 172.21.15.192:0/1203753501 >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 0x7f701415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7012a00640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f70140b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f70140b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 -- 172.21.15.192:0/1203753501 >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 msgr2=0x7f701415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 --2- 172.21.15.192:0/1203753501 >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 0x7f701415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f700a000640 1 -- 172.21.15.192:0/1203753501 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f701406b150 con 0x7f701406bc30 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7013400640 1 --2- 172.21.15.192:0/1203753501 >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 0x7f701415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:44.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.960+0000 7f7012a00640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f70140b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.961+0000 7f700a000640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f701406bc30 0x7f70140b32b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f701406b710 tx=0x7f6ffc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd238a3d1c4117d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7012000640 1 -- 172.21.15.192:0/1203753501 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc032440 con 0x7f701406bc30 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7012000640 1 -- 172.21.15.192:0/1203753501 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ffc0325a0 con 0x7f701406bc30 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7012000640 1 -- 172.21.15.192:0/1203753501 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc032930 con 0x7f701406bc30 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 -- 172.21.15.192:0/1203753501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f701406bc30 msgr2=0x7f70140b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f701406bc30 0x7f70140b32b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f701406b710 tx=0x7f6ffc02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 -- 172.21.15.192:0/1203753501 shutdown_connections 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 --2- 172.21.15.192:0/1203753501 >> v2:172.21.15.194:3300/0 conn(0x7f7014159ee0 0x7f701415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f701406bc30 0x7f70140b32b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 --2- 172.21.15.192:0/1203753501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f70140b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 -- 172.21.15.192:0/1203753501 >> 172.21.15.192:0/1203753501 conn(0x7f70140736d0 msgr2=0x7f70140b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 -- 172.21.15.192:0/1203753501 shutdown_connections 2024-09-13T18:35:44.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.962+0000 7f7013e00640 1 -- 172.21.15.192:0/1203753501 wait complete. 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.964+0000 7f7013e00640 1 Processor -- start 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.964+0000 7f7013e00640 1 -- start start 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 0x7f7014070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f701414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70141559a0 con 0x7f7014159ee0 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70140711e0 con 0x7f701406bc30 2024-09-13T18:35:44.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70141519d0 con 0x7f7014159b00 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33128/0 (socket says 172.21.15.192:33128) 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 -- 172.21.15.192:0/3650052809 learned_addr learned my addr 172.21.15.192:0/3650052809 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7012a00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 0x7f7014070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f700a000640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f701414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 -- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 msgr2=0x7f701414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f701414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 -- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 msgr2=0x7f7014070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 0x7f7014070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7013400640 1 -- 172.21.15.192:0/3650052809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ffc0094d0 con 0x7f7014159ee0 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.965+0000 7f7012a00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 0x7f7014070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f7013400640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cd50 tx=0x7f700c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00f680 con 0x7f7014159ee0 2024-09-13T18:35:44.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700c00f800 con 0x7f7014159ee0 2024-09-13T18:35:44.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f701415aa50 con 0x7f7014159ee0 2024-09-13T18:35:44.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700c00fbb0 con 0x7f7014159ee0 2024-09-13T18:35:44.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.966+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7014151380 con 0x7f7014159ee0 2024-09-13T18:35:44.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.967+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70141511e0 con 0x7f7014159ee0 2024-09-13T18:35:44.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.968+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f700c00b040 con 0x7f7014159ee0 2024-09-13T18:35:44.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.969+0000 7f700b400640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 0x7f6ff006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:44.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.969+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f700c089e30 con 0x7f7014159ee0 2024-09-13T18:35:44.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.969+0000 7f7012a00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 0x7f6ff006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:44.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.969+0000 7f7012a00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 0x7f6ff006d0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70141f41e0 tx=0x7f7004008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:44.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:44.973+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f70141511e0 con 0x7f7014159ee0 2024-09-13T18:35:45.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.138+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f701415a8d0 con 0x7f6ff006ac30 2024-09-13T18:35:45.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.144+0000 7f700b400640 1 -- 172.21.15.192:0/3650052809 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258666 (secure 0 0 0) 0x7f700400f830 con 0x7f6ff006ac30 2024-09-13T18:35:45.150 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:45.152 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:45.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 msgr2=0x7f6ff006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 0x7f6ff006d0f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f70141f41e0 tx=0x7f7004008040 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 msgr2=0x7f7014151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f700c00cd50 tx=0x7f700c00a650 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 shutdown_connections 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ff006ac30 0x7f6ff006d0f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7014159ee0 0x7f7014151e60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7014159b00 0x7f701414d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 --2- 172.21.15.192:0/3650052809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f701406bc30 0x7f7014070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.148+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 >> 172.21.15.192:0/3650052809 conn(0x7f70140736d0 msgr2=0x7f701414f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.149+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 shutdown_connections 2024-09-13T18:35:45.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.149+0000 7f7013e00640 1 -- 172.21.15.192:0/3650052809 wait complete. 2024-09-13T18:35:45.166 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:35:44.734609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560771,"statfs":{"total":1600000000,"available":1598229734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.940754"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795725+0000","last_change":"2024-09-13T18:35:38.795725+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795725+0000","last_undegraded":"2024-09-13T18:35:38.795725+0000","last_fullsized":"2024-09-13T18:35:38.795725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795610+0000","last_change":"2024-09-13T18:35:38.795610+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795610+0000","last_undegraded":"2024-09-13T18:35:38.795610+0000","last_fullsized":"2024-09-13T18:35:38.795610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796150+0000","last_change":"2024-09-13T18:35:38.796150+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796150+0000","last_undegraded":"2024-09-13T18:35:38.796150+0000","last_fullsized":"2024-09-13T18:35:38.796150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796442+0000","last_change":"2024-09-13T18:35:38.796442+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796442+0000","last_undegraded":"2024-09-13T18:35:38.796442+0000","last_fullsized":"2024-09-13T18:35:38.796442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:45.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2024-09-13T18:35:45.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-09-13T18:35:45.171 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.171 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2024-09-13T18:35:45.172 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:35:38.795725+0000', 'last_change': '2024-09-13T18:35:38.795725+0000', 'last_active': '2024-09-13T18:35:38.788010+0000', 'last_peered': '2024-09-13T18:35:38.788010+0000', 'last_clean': '2024-09-13T18:35:38.788010+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:38.795725+0000', 'last_undegraded': '2024-09-13T18:35:38.795725+0000', 'last_fullsized': '2024-09-13T18:35:38.795725+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:35:38.795610+0000', 'last_change': '2024-09-13T18:35:38.795610+0000', 'last_active': '2024-09-13T18:35:38.788010+0000', 'last_peered': '2024-09-13T18:35:38.788010+0000', 'last_clean': '2024-09-13T18:35:38.788010+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:38.795610+0000', 'last_undegraded': '2024-09-13T18:35:38.795610+0000', 'last_fullsized': '2024-09-13T18:35:38.795610+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:35:38.796150+0000', 'last_change': '2024-09-13T18:35:38.796150+0000', 'last_active': '2024-09-13T18:35:38.788010+0000', 'last_peered': '2024-09-13T18:35:38.788010+0000', 'last_clean': '2024-09-13T18:35:38.788010+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:38.796150+0000', 'last_undegraded': '2024-09-13T18:35:38.796150+0000', 'last_fullsized': '2024-09-13T18:35:38.796150+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:35:45.173 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-09-13T18:35:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2024-09-13T18:35:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:35:38.796442+0000', 'last_change': '2024-09-13T18:35:38.796442+0000', 'last_active': '2024-09-13T18:35:38.788010+0000', 'last_peered': '2024-09-13T18:35:38.788010+0000', 'last_clean': '2024-09-13T18:35:38.788010+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:38.796442+0000', 'last_undegraded': '2024-09-13T18:35:38.796442+0000', 'last_fullsized': '2024-09-13T18:35:38.796442+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:38.788010+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:35:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-09-13T18:35:45.174 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-13T18:35:39.793006+0000', 'last_change': '2024-09-13T18:35:39.793006+0000', 'last_active': '2024-09-13T18:35:39.793006+0000', 'last_peered': '2024-09-13T18:35:39.793006+0000', 'last_clean': '2024-09-13T18:35:39.793006+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:35:39.793006+0000', 'last_undegraded': '2024-09-13T18:35:39.793006+0000', 'last_fullsized': '2024-09-13T18:35:39.793006+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'last_clean_scrub_stamp': '2024-09-13T18:35:39.793006+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-13T18:35:45.174 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:35:45.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.357+0000 7fddfbe00640 1 Processor -- start 2024-09-13T18:35:45.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.358+0000 7fddfbe00640 1 -- start start 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddfc159b00 0x7fddfc0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 0x7fddfc0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddfc15af60 con 0x7fddfc06bc30 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc15aa40 con 0x7fddfc159b00 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddfc06b7a0 con 0x7fddfc15a5f0 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddfc159b00 0x7fddfc0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddfc159b00 0x7fddfc0b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33136/0 (socket says 172.21.15.192:33136) 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfaa00640 1 -- 172.21.15.192:0/1715634361 learned_addr learned my addr 172.21.15.192:0/1715634361 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfb400640 1 --2- 172.21.15.192:0/1715634361 >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 0x7fddfc0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfaa00640 1 -- 172.21.15.192:0/1715634361 >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 msgr2=0x7fddfc0b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.359+0000 7fddfaa00640 1 --2- 172.21.15.192:0/1715634361 >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 0x7fddfc0b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.360+0000 7fddfaa00640 1 -- 172.21.15.192:0/1715634361 >> v1:172.21.15.194:6789/0 conn(0x7fddfc06bc30 legacy=0x7fddfc159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.360+0000 7fddfaa00640 1 -- 172.21.15.192:0/1715634361 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc15ac80 con 0x7fddfc159b00 2024-09-13T18:35:45.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.360+0000 7fddfb400640 1 --2- 172.21.15.192:0/1715634361 >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 0x7fddfc0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.360+0000 7fddfaa00640 1 --2- 172.21.15.192:0/1715634361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc159b00 0x7fddfc0b2d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0ccce0 tx=0x7fddec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1fe1315d7383811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddf9600640 1 -- 172.21.15.192:0/1715634361 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec032440 con 0x7fddfc159b00 2024-09-13T18:35:45.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddf9600640 1 -- 172.21.15.192:0/1715634361 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec0325a0 con 0x7fddfc159b00 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddf9600640 1 -- 172.21.15.192:0/1715634361 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec032930 con 0x7fddfc159b00 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 -- 172.21.15.192:0/1715634361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc159b00 msgr2=0x7fddfc0b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 --2- 172.21.15.192:0/1715634361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc159b00 0x7fddfc0b2d70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fddfc0ccce0 tx=0x7fddec02a270 comp rx=0 tx=0).stop 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 -- 172.21.15.192:0/1715634361 shutdown_connections 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 --2- 172.21.15.192:0/1715634361 >> v2:172.21.15.194:3300/0 conn(0x7fddfc15a5f0 0x7fddfc0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 --2- 172.21.15.192:0/1715634361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc159b00 0x7fddfc0b2d70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.361+0000 7fddfbe00640 1 -- 172.21.15.192:0/1715634361 >> 172.21.15.192:0/1715634361 conn(0x7fddfc0736d0 msgr2=0x7fddfc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.362+0000 7fddfbe00640 1 -- 172.21.15.192:0/1715634361 shutdown_connections 2024-09-13T18:35:45.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.362+0000 7fddfbe00640 1 -- 172.21.15.192:0/1715634361 wait complete. 2024-09-13T18:35:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.363+0000 7fddfbe00640 1 Processor -- start 2024-09-13T18:35:45.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.363+0000 7fddfbe00640 1 -- start start 2024-09-13T18:35:45.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc159b00 0x7fddfc154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc15a5f0 0x7fddfc1e3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc070ef0 con 0x7fddfc06bc30 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc070130 con 0x7fddfc159b00 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddfc070410 con 0x7fddfc15a5f0 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33142/0 (socket says 172.21.15.192:33142) 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.364+0000 7fddfaa00640 1 -- 172.21.15.192:0/3699596388 learned_addr learned my addr 172.21.15.192:0/3699596388 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfa000640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc159b00 0x7fddfc154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfb400640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc15a5f0 0x7fddfc1e3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 -- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc15a5f0 msgr2=0x7fddfc1e3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc15a5f0 0x7fddfc1e3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 -- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc159b00 msgr2=0x7fddfc154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc159b00 0x7fddfc154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 -- 172.21.15.192:0/3699596388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0094d0 con 0x7fddfc06bc30 2024-09-13T18:35:45.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddfaa00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddec02a2b0 tx=0x7fddec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec032440 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.365+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddec030ba0 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.366+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddfc0706f0 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.366+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddec03d440 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.366+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddfc154d50 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.367+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddfc159ee0 con 0x7fddfc06bc30 2024-09-13T18:35:45.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.368+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fddec039040 con 0x7fddfc06bc30 2024-09-13T18:35:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.368+0000 7fddf2a00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 0x7fdddc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.368+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddec0a9e80 con 0x7fddfc06bc30 2024-09-13T18:35:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.369+0000 7fddfa000640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 0x7fdddc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.369+0000 7fddfa000640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 0x7fdddc06d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddfc06edf0 tx=0x7fdde8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.372+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fddec075070 con 0x7fddfc06bc30 2024-09-13T18:35:45.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.601+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fddfc0b3c70 con 0x7fddfc06bc30 2024-09-13T18:35:45.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.602+0000 7fddf2a00640 1 -- 172.21.15.192:0/3699596388 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1166 (secure 0 0 0) 0x7fddec0374a0 con 0x7fddfc06bc30 2024-09-13T18:35:45.605 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:45.605 INFO:teuthology.orchestra.run.smithi192.stdout:{"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252529,"num_in_osds":8,"osd_in_since":1726252524,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":81},{"state_name":"unknown","count":12},{"state_name":"creating+peering","count":4}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592660,"bytes_used":1770266,"bytes_avail":1598229734,"bytes_total":1600000000,"unknown_pgs_ratio":0.12371134012937546,"inactive_pgs_ratio":0.041237112134695053,"write_bytes_sec":2240,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4285}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-13T18:35:21.982015+0000","services":{}},"progress_events":{}} 2024-09-13T18:35:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 msgr2=0x7fdddc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 0x7fdddc06d0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fddfc06edf0 tx=0x7fdde8009040 comp rx=0 tx=0).stop 2024-09-13T18:35:45.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 msgr2=0x7fddfc155410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fddec02a2b0 tx=0x7fddec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 shutdown_connections 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdddc06ac00 0x7fdddc06d0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddfc15a5f0 0x7fddfc1e3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddfc159b00 0x7fddfc154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 --2- 172.21.15.192:0/3699596388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddfc06bc30 0x7fddfc155410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 >> 172.21.15.192:0/3699596388 conn(0x7fddfc0736d0 msgr2=0x7fddfc06aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.604+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 shutdown_connections 2024-09-13T18:35:45.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.605+0000 7fddfbe00640 1 -- 172.21.15.192:0/3699596388 wait complete. 2024-09-13T18:35:45.622 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:35:45.622 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.772+0000 7f0427a00640 1 Processor -- start 2024-09-13T18:35:45.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.772+0000 7f0427a00640 1 -- start start 2024-09-13T18:35:45.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.773+0000 7f0427a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04200cacd0 0x7f042015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.773+0000 7f0427a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.773+0000 7f0427a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0420140480 con 0x7f04200cb0b0 2024-09-13T18:35:45.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.773+0000 7f0427a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04200cb520 con 0x7f04200cacd0 2024-09-13T18:35:45.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.773+0000 7f0427a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042015ee90 con 0x7f042015bc20 2024-09-13T18:35:45.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04200cacd0 0x7f042015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40528/0 (socket says 172.21.15.192:40528) 2024-09-13T18:35:45.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04200cacd0 0x7f042015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:51544/0 (socket says 172.21.15.192:51544) 2024-09-13T18:35:45.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425a00640 1 -- 172.21.15.192:0/3834884948 learned_addr learned my addr 172.21.15.192:0/3834884948 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f041fe00640 1 --1- 172.21.15.192:0/3834884948 >> v1:172.21.15.194:6789/0 conn(0x7f04200cb0b0 0x7f0420140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:46834/0 (socket says 172.21.15.192:46834) 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f041f400640 1 -- 172.21.15.192:0/3834884948 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603113385 0 0) 0x7f0420140480 con 0x7f04200cb0b0 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 -- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 msgr2=0x7f04200afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 -- 172.21.15.192:0/3834884948 >> v1:172.21.15.194:6789/0 conn(0x7f04200cb0b0 legacy=0x7f0420140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425000640 1 -- 172.21.15.192:0/3834884948 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042015f170 con 0x7f04200cacd0 2024-09-13T18:35:45.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.774+0000 7f0425a00640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.775+0000 7f0425000640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f042015e790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04100097a0 tx=0x7f041002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7923cf5857788e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f041f400640 1 -- 172.21.15.192:0/3834884948 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410032440 con 0x7f04200cacd0 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f041f400640 1 -- 172.21.15.192:0/3834884948 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04100325a0 con 0x7f04200cacd0 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f041f400640 1 -- 172.21.15.192:0/3834884948 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0410032930 con 0x7f04200cacd0 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 -- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 msgr2=0x7f042015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f042015e790 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f04100097a0 tx=0x7f041002a180 comp rx=0 tx=0).stop 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 -- 172.21.15.192:0/3834884948 shutdown_connections 2024-09-13T18:35:45.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f04200afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 --2- 172.21.15.192:0/3834884948 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f042015e790 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 -- 172.21.15.192:0/3834884948 >> 172.21.15.192:0/3834884948 conn(0x7f04200ae960 msgr2=0x7f042006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 -- 172.21.15.192:0/3834884948 shutdown_connections 2024-09-13T18:35:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.776+0000 7f0427a00640 1 -- 172.21.15.192:0/3834884948 wait complete. 2024-09-13T18:35:45.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.778+0000 7f0427a00640 1 Processor -- start 2024-09-13T18:35:45.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.778+0000 7f0427a00640 1 -- start start 2024-09-13T18:35:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f04201521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f0420154490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04201549d0 con 0x7f04200cb0b0 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042006b5f0 con 0x7f04200cacd0 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0427a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0420153350 con 0x7f042015bc20 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f041fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f041fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33144/0 (socket says 172.21.15.192:33144) 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f041fe00640 1 -- 172.21.15.192:0/3012414268 learned_addr learned my addr 172.21.15.192:0/3012414268 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f0425a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f0420154490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.779+0000 7f0425000640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f04201521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 -- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 msgr2=0x7f0420154490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f0420154490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 -- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 msgr2=0x7f04201521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f04201521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 -- 172.21.15.192:0/3012414268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0418009b30 con 0x7f04200cb0b0 2024-09-13T18:35:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041fe00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c430 tx=0x7f040c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0074e0 con 0x7f04200cb0b0 2024-09-13T18:35:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c007660 con 0x7f04200cb0b0 2024-09-13T18:35:45.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c004a20 con 0x7f04200cb0b0 2024-09-13T18:35:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.780+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0410009400 con 0x7f04200cb0b0 2024-09-13T18:35:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.781+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0420152ab0 con 0x7f04200cb0b0 2024-09-13T18:35:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.781+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042015e790 con 0x7f04200cb0b0 2024-09-13T18:35:45.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.782+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f040c004b80 con 0x7f04200cb0b0 2024-09-13T18:35:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.783+0000 7f041cc00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 0x7f040006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.783+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f040c089130 con 0x7f04200cb0b0 2024-09-13T18:35:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.783+0000 7f0425000640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 0x7f040006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:45.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.784+0000 7f0425000640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 0x7f040006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0410034000 tx=0x7f041002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:45.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.787+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f040c054290 con 0x7f04200cb0b0 2024-09-13T18:35:45.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.953+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f042015c070 con 0x7f040006ac00 2024-09-13T18:35:45.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.959+0000 7f041cc00640 1 -- 172.21.15.192:0/3012414268 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+258666 (secure 0 0 0) 0x7f0410006e10 con 0x7f040006ac00 2024-09-13T18:35:45.965 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:45.967 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:45.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 msgr2=0x7f040006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 0x7f040006d0c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0410034000 tx=0x7f041002e000 comp rx=0 tx=0).stop 2024-09-13T18:35:45.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 msgr2=0x7f042006b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f040c00c430 tx=0x7f040c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 shutdown_connections 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040006ac00 0x7f040006d0c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042015bc20 0x7f0420154490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04200cb0b0 0x7f042006b910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 --2- 172.21.15.192:0/3012414268 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04200cacd0 0x7f04201521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 >> 172.21.15.192:0/3012414268 conn(0x7f04200ae960 msgr2=0x7f0420070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 shutdown_connections 2024-09-13T18:35:45.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:45.963+0000 7f0427a00640 1 -- 172.21.15.192:0/3012414268 wait complete. 2024-09-13T18:35:45.981 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-13T18:35:44.734609+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592660,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560771,"statfs":{"total":1600000000,"available":1598229734,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.940754"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795725+0000","last_change":"2024-09-13T18:35:38.795725+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795725+0000","last_undegraded":"2024-09-13T18:35:38.795725+0000","last_fullsized":"2024-09-13T18:35:38.795725+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.795610+0000","last_change":"2024-09-13T18:35:38.795610+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.795610+0000","last_undegraded":"2024-09-13T18:35:38.795610+0000","last_fullsized":"2024-09-13T18:35:38.795610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796150+0000","last_change":"2024-09-13T18:35:38.796150+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796150+0000","last_undegraded":"2024-09-13T18:35:38.796150+0000","last_fullsized":"2024-09-13T18:35:38.796150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-09-13T18:35:38.796442+0000","last_change":"2024-09-13T18:35:38.796442+0000","last_active":"2024-09-13T18:35:38.788010+0000","last_peered":"2024-09-13T18:35:38.788010+0000","last_clean":"2024-09-13T18:35:38.788010+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:38.796442+0000","last_undegraded":"2024-09-13T18:35:38.796442+0000","last_fullsized":"2024-09-13T18:35:38.796442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:35:39.793006+0000","last_change":"2024-09-13T18:35:39.793006+0000","last_active":"2024-09-13T18:35:39.793006+0000","last_peered":"2024-09-13T18:35:39.793006+0000","last_clean":"2024-09-13T18:35:39.793006+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:35:39.793006+0000","last_undegraded":"2024-09-13T18:35:39.793006+0000","last_fullsized":"2024-09-13T18:35:39.793006+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":104,"acting":104,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2292,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":631,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194681,"statfs":{"total":200000000,"available":199353451,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:48.986 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:49.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.145+0000 7f6db2800640 1 Processor -- start 2024-09-13T18:35:49.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.145+0000 7f6db2800640 1 -- start start 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6db2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6dac0b3f10 0x7f6dac15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6db2800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6db2800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dac0b2f00 con 0x7f6dac15dee0 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6db2800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dac15aec0 con 0x7f6dac0b3f10 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6db2800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac0b3150 con 0x7f6dac0b0490 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6dab400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6dac15dee0 0x7f6dac0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38148/0 (socket says 172.21.15.192:38148) 2024-09-13T18:35:49.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6dab400640 1 -- 172.21.15.192:0/3600890517 learned_addr learned my addr 172.21.15.192:0/3600890517 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6da2a00640 1 --2- 172.21.15.192:0/3600890517 >> v2:172.21.15.192:3300/0 conn(0x7f6dac0b3f10 0x7f6dac15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6dabe00640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6daaa00640 1 -- 172.21.15.192:0/3600890517 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4223147968 0 0) 0x7f6dac0b2f00 con 0x7f6dac15dee0 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6daaa00640 1 -- 172.21.15.192:0/3600890517 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d90003520 con 0x7f6dac15dee0 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6da2a00640 1 -- 172.21.15.192:0/3600890517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 msgr2=0x7f6dac15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6da2a00640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6da2a00640 1 -- 172.21.15.192:0/3600890517 >> v1:172.21.15.192:6789/0 conn(0x7f6dac15dee0 legacy=0x7f6dac0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.147+0000 7f6da2a00640 1 -- 172.21.15.192:0/3600890517 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac0b3430 con 0x7f6dac0b3f10 2024-09-13T18:35:49.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.148+0000 7f6da2a00640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac0b3f10 0x7f6dac15a440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d940097a0 tx=0x7f6d9402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af05843dea46b4a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6daaa00640 1 -- 172.21.15.192:0/3600890517 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94032440 con 0x7f6dac0b3f10 2024-09-13T18:35:49.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6daaa00640 1 -- 172.21.15.192:0/3600890517 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d940325a0 con 0x7f6dac0b3f10 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6daaa00640 1 -- 172.21.15.192:0/3600890517 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94032930 con 0x7f6dac0b3f10 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 -- 172.21.15.192:0/3600890517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac0b3f10 msgr2=0x7f6dac15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac0b3f10 0x7f6dac15a440 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6d940097a0 tx=0x7f6d9402a180 comp rx=0 tx=0).stop 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 -- 172.21.15.192:0/3600890517 shutdown_connections 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 --2- 172.21.15.192:0/3600890517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac0b3f10 0x7f6dac15a440 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 -- 172.21.15.192:0/3600890517 >> 172.21.15.192:0/3600890517 conn(0x7f6dac0ae960 msgr2=0x7f6dac06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 -- 172.21.15.192:0/3600890517 shutdown_connections 2024-09-13T18:35:49.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.149+0000 7f6db2800640 1 -- 172.21.15.192:0/3600890517 wait complete. 2024-09-13T18:35:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.151+0000 7f6db2800640 1 Processor -- start 2024-09-13T18:35:49.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.151+0000 7f6db2800640 1 -- start start 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 0x7f6dac158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac15cac0 con 0x7f6dac15dee0 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac136ae0 con 0x7f6dac15b210 2024-09-13T18:35:49.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6db2800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dac137780 con 0x7f6dac0b0490 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6da2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33168/0 (socket says 172.21.15.192:33168) 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.152+0000 7f6da2a00640 1 -- 172.21.15.192:0/2618987105 learned_addr learned my addr 172.21.15.192:0/2618987105 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6dabe00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 0x7f6dac158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6dab400640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 -- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 msgr2=0x7f6dac15c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 -- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 msgr2=0x7f6dac158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 0x7f6dac158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 -- 172.21.15.192:0/2618987105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d94009400 con 0x7f6dac15dee0 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6dabe00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 0x7f6dac158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:49.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6dab400640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da2a00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d94035040 tx=0x7f6d940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94006e10 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d94032e90 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d94030be0 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac15d120 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.153+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dac15b9d0 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.154+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dac0afd80 con 0x7f6dac15dee0 2024-09-13T18:35:49.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.155+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d94039040 con 0x7f6dac15dee0 2024-09-13T18:35:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.156+0000 7f6da3e00640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 0x7f6d8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.157+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d940a9e80 con 0x7f6dac15dee0 2024-09-13T18:35:49.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.157+0000 7f6dab400640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 0x7f6d8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.157+0000 7f6dab400640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 0x7f6d8806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0011e0 tx=0x7f6d9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.161+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d940750e0 con 0x7f6dac15dee0 2024-09-13T18:35:49.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.328+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6dac0b39f0 con 0x7f6d8806ac00 2024-09-13T18:35:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.335+0000 7f6da3e00640 1 -- 172.21.15.192:0/2618987105 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260267 (secure 0 0 0) 0x7f6d9c001c80 con 0x7f6d8806ac00 2024-09-13T18:35:49.340 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:49.342 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:49.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.338+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 msgr2=0x7f6d8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.338+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 0x7f6d8806d0c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c0011e0 tx=0x7f6d9c009040 comp rx=0 tx=0).stop 2024-09-13T18:35:49.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.338+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 msgr2=0x7f6dac1365a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.338+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6d94035040 tx=0x7f6d940046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 shutdown_connections 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8806ac00 0x7f6d8806d0c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dac15b210 0x7f6dac158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dac15dee0 0x7f6dac1365a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 --2- 172.21.15.192:0/2618987105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dac0b0490 0x7f6dac15c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 >> 172.21.15.192:0/2618987105 conn(0x7f6dac0ae960 msgr2=0x7f6dac13bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 shutdown_connections 2024-09-13T18:35:49.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.339+0000 7f6db2800640 1 -- 172.21.15.192:0/2618987105 wait complete. 2024-09-13T18:35:49.358 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-13T18:35:48.735491+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":149,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.515245"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251856+0000","last_change":"2024-09-13T18:35:40.236289+0000","last_active":"2024-09-13T18:35:41.251856+0000","last_peered":"2024-09-13T18:35:41.251856+0000","last_clean":"2024-09-13T18:35:41.251856+0000","last_became_active":"2024-09-13T18:35:40.235046+0000","last_became_peered":"2024-09-13T18:35:40.235046+0000","last_unstale":"2024-09-13T18:35:41.251856+0000","last_undegraded":"2024-09-13T18:35:41.251856+0000","last_fullsized":"2024-09-13T18:35:41.251856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250892+0000","last_change":"2024-09-13T18:35:40.232789+0000","last_active":"2024-09-13T18:35:41.250892+0000","last_peered":"2024-09-13T18:35:41.250892+0000","last_clean":"2024-09-13T18:35:41.250892+0000","last_became_active":"2024-09-13T18:35:40.230926+0000","last_became_peered":"2024-09-13T18:35:40.230926+0000","last_unstale":"2024-09-13T18:35:41.250892+0000","last_undegraded":"2024-09-13T18:35:41.250892+0000","last_fullsized":"2024-09-13T18:35:41.250892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250999+0000","last_change":"2024-09-13T18:35:40.242574+0000","last_active":"2024-09-13T18:35:41.250999+0000","last_peered":"2024-09-13T18:35:41.250999+0000","last_clean":"2024-09-13T18:35:41.250999+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.250999+0000","last_undegraded":"2024-09-13T18:35:41.250999+0000","last_fullsized":"2024-09-13T18:35:41.250999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251591+0000","last_change":"2024-09-13T18:35:40.243803+0000","last_active":"2024-09-13T18:35:41.251591+0000","last_peered":"2024-09-13T18:35:41.251591+0000","last_clean":"2024-09-13T18:35:41.251591+0000","last_became_active":"2024-09-13T18:35:40.243499+0000","last_became_peered":"2024-09-13T18:35:40.243499+0000","last_unstale":"2024-09-13T18:35:41.251591+0000","last_undegraded":"2024-09-13T18:35:41.251591+0000","last_fullsized":"2024-09-13T18:35:41.251591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251840+0000","last_change":"2024-09-13T18:35:40.240528+0000","last_active":"2024-09-13T18:35:41.251840+0000","last_peered":"2024-09-13T18:35:41.251840+0000","last_clean":"2024-09-13T18:35:41.251840+0000","last_became_active":"2024-09-13T18:35:40.240125+0000","last_became_peered":"2024-09-13T18:35:40.240125+0000","last_unstale":"2024-09-13T18:35:41.251840+0000","last_undegraded":"2024-09-13T18:35:41.251840+0000","last_fullsized":"2024-09-13T18:35:41.251840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251687+0000","last_change":"2024-09-13T18:35:40.242701+0000","last_active":"2024-09-13T18:35:41.251687+0000","last_peered":"2024-09-13T18:35:41.251687+0000","last_clean":"2024-09-13T18:35:41.251687+0000","last_became_active":"2024-09-13T18:35:40.235954+0000","last_became_peered":"2024-09-13T18:35:40.235954+0000","last_unstale":"2024-09-13T18:35:41.251687+0000","last_undegraded":"2024-09-13T18:35:41.251687+0000","last_fullsized":"2024-09-13T18:35:41.251687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250839+0000","last_change":"2024-09-13T18:35:40.241785+0000","last_active":"2024-09-13T18:35:41.250839+0000","last_peered":"2024-09-13T18:35:41.250839+0000","last_clean":"2024-09-13T18:35:41.250839+0000","last_became_active":"2024-09-13T18:35:40.241271+0000","last_became_peered":"2024-09-13T18:35:40.241271+0000","last_unstale":"2024-09-13T18:35:41.250839+0000","last_undegraded":"2024-09-13T18:35:41.250839+0000","last_fullsized":"2024-09-13T18:35:41.250839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239746+0000","last_change":"2024-09-13T18:35:39.815225+0000","last_active":"2024-09-13T18:35:40.239746+0000","last_peered":"2024-09-13T18:35:40.239746+0000","last_clean":"2024-09-13T18:35:40.239746+0000","last_became_active":"2024-09-13T18:35:39.814933+0000","last_became_peered":"2024-09-13T18:35:39.814933+0000","last_unstale":"2024-09-13T18:35:40.239746+0000","last_undegraded":"2024-09-13T18:35:40.239746+0000","last_fullsized":"2024-09-13T18:35:40.239746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251786+0000","last_change":"2024-09-13T18:35:40.236744+0000","last_active":"2024-09-13T18:35:41.251786+0000","last_peered":"2024-09-13T18:35:41.251786+0000","last_clean":"2024-09-13T18:35:41.251786+0000","last_became_active":"2024-09-13T18:35:40.235570+0000","last_became_peered":"2024-09-13T18:35:40.235570+0000","last_unstale":"2024-09-13T18:35:41.251786+0000","last_undegraded":"2024-09-13T18:35:41.251786+0000","last_fullsized":"2024-09-13T18:35:41.251786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:40.237581+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:40.237373+0000","last_became_peered":"2024-09-13T18:35:40.237373+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239755+0000","last_change":"2024-09-13T18:35:39.815819+0000","last_active":"2024-09-13T18:35:40.239755+0000","last_peered":"2024-09-13T18:35:40.239755+0000","last_clean":"2024-09-13T18:35:40.239755+0000","last_became_active":"2024-09-13T18:35:39.815608+0000","last_became_peered":"2024-09-13T18:35:39.815608+0000","last_unstale":"2024-09-13T18:35:40.239755+0000","last_undegraded":"2024-09-13T18:35:40.239755+0000","last_fullsized":"2024-09-13T18:35:40.239755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251062+0000","last_change":"2024-09-13T18:35:40.241481+0000","last_active":"2024-09-13T18:35:41.251062+0000","last_peered":"2024-09-13T18:35:41.251062+0000","last_clean":"2024-09-13T18:35:41.251062+0000","last_became_active":"2024-09-13T18:35:40.236707+0000","last_became_peered":"2024-09-13T18:35:40.236707+0000","last_unstale":"2024-09-13T18:35:41.251062+0000","last_undegraded":"2024-09-13T18:35:41.251062+0000","last_fullsized":"2024-09-13T18:35:41.251062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.233257+0000","last_change":"2024-09-13T18:35:39.814559+0000","last_active":"2024-09-13T18:35:40.233257+0000","last_peered":"2024-09-13T18:35:40.233257+0000","last_clean":"2024-09-13T18:35:40.233257+0000","last_became_active":"2024-09-13T18:35:39.814313+0000","last_became_peered":"2024-09-13T18:35:39.814313+0000","last_unstale":"2024-09-13T18:35:40.233257+0000","last_undegraded":"2024-09-13T18:35:40.233257+0000","last_fullsized":"2024-09-13T18:35:40.233257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251105+0000","last_change":"2024-09-13T18:35:40.240336+0000","last_active":"2024-09-13T18:35:41.251105+0000","last_peered":"2024-09-13T18:35:41.251105+0000","last_clean":"2024-09-13T18:35:41.251105+0000","last_became_active":"2024-09-13T18:35:40.235298+0000","last_became_peered":"2024-09-13T18:35:40.235298+0000","last_unstale":"2024-09-13T18:35:41.251105+0000","last_undegraded":"2024-09-13T18:35:41.251105+0000","last_fullsized":"2024-09-13T18:35:41.251105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.245172+0000","last_change":"2024-09-13T18:35:39.815215+0000","last_active":"2024-09-13T18:35:40.245172+0000","last_peered":"2024-09-13T18:35:40.245172+0000","last_clean":"2024-09-13T18:35:40.245172+0000","last_became_active":"2024-09-13T18:35:39.814835+0000","last_became_peered":"2024-09-13T18:35:39.814835+0000","last_unstale":"2024-09-13T18:35:40.245172+0000","last_undegraded":"2024-09-13T18:35:40.245172+0000","last_fullsized":"2024-09-13T18:35:40.245172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250944+0000","last_change":"2024-09-13T18:35:40.240536+0000","last_active":"2024-09-13T18:35:41.250944+0000","last_peered":"2024-09-13T18:35:41.250944+0000","last_clean":"2024-09-13T18:35:41.250944+0000","last_became_active":"2024-09-13T18:35:40.236412+0000","last_became_peered":"2024-09-13T18:35:40.236412+0000","last_unstale":"2024-09-13T18:35:41.250944+0000","last_undegraded":"2024-09-13T18:35:41.250944+0000","last_fullsized":"2024-09-13T18:35:41.250944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:49.363 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:35:49.364 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T18:35:49.364 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-13T18:35:49.364 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-13T18:35:49.365 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-13T18:35:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.548+0000 7fea2de00640 1 Processor -- start 2024-09-13T18:35:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.548+0000 7fea2de00640 1 -- start start 2024-09-13T18:35:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.549+0000 7fea2de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea280b3f10 0x7fea2815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.549+0000 7fea2de00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280b2f00 con 0x7fea280b0490 2024-09-13T18:35:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.549+0000 7fea2de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea280b3150 con 0x7fea2815dee0 2024-09-13T18:35:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.549+0000 7fea2de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b3430 con 0x7fea280b3f10 2024-09-13T18:35:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.549+0000 7fea27400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fea280b0490 0x7fea2815a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38164/0 (socket says 172.21.15.192:38164) 2024-09-13T18:35:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea27400640 1 -- 172.21.15.192:0/781859441 learned_addr learned my addr 172.21.15.192:0/781859441 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea26000640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea280b3f10 0x7fea2815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649032834 0 0) 0x7fea280b2f00 con 0x7fea280b0490 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea0c003520 con 0x7fea280b0490 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3522962484 0 0) 0x7fea0c003520 con 0x7fea280b0490 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea280b3f10 msgr2=0x7fea2815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea280b3f10 0x7fea2815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 >> v1:172.21.15.194:6789/0 conn(0x7fea2815dee0 legacy=0x7fea280afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea280b3710 con 0x7fea280b0490 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fea200019f0 con 0x7fea280b0490 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 >> v1:172.21.15.192:6789/0 conn(0x7fea280b0490 legacy=0x7fea2815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c0039a0 0x7fea0c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea0c0042c0 0x7fea0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea0c004f50 0x7fea0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea280b3430 con 0x7fea0c004f50 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c00bec0 con 0x7fea0c0042c0 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.550+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c00c000 con 0x7fea0c0039a0 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea26a00640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c0039a0 0x7fea0c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea26000640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea0c0042c0 0x7fea0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea0c004f50 0x7fea0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 -- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c0039a0 msgr2=0x7fea0c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c0039a0 0x7fea0c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 -- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea0c0042c0 msgr2=0x7fea0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea0c0042c0 0x7fea0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.551+0000 7fea27400640 1 -- 172.21.15.192:0/781859441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c003520 con 0x7fea0c004f50 2024-09-13T18:35:49.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.552+0000 7fea27400640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea0c004f50 0x7fea0c00b980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a830 tx=0x7fea0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ae17d790878840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.552+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2002ba40 con 0x7fea0c004f50 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.552+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2002bbc0 con 0x7fea0c004f50 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.552+0000 7fea25600640 1 -- 172.21.15.192:0/781859441 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20034470 con 0x7fea0c004f50 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 -- 172.21.15.192:0/781859441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea0c004f50 msgr2=0x7fea0c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 --2- 172.21.15.192:0/781859441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea0c004f50 0x7fea0c00b980 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a830 tx=0x7fea0c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea27400640 1 -- 172.21.15.192:0/781859441 reap_dead start 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 -- 172.21.15.192:0/781859441 shutdown_connections 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 -- 172.21.15.192:0/781859441 >> 172.21.15.192:0/781859441 conn(0x7fea280ae960 msgr2=0x7fea2806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 -- 172.21.15.192:0/781859441 shutdown_connections 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.553+0000 7fea2de00640 1 -- 172.21.15.192:0/781859441 wait complete. 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.555+0000 7fea2de00640 1 Processor -- start 2024-09-13T18:35:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.555+0000 7fea2de00640 1 -- start start 2024-09-13T18:35:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c004f50 0x7fea2813b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea2813fa70 0x7fea281f2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2815c3c0 con 0x7fea2815b9d0 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea281f3bf0 con 0x7fea2813fa70 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea2de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2813bcc0 con 0x7fea0c004f50 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33200/0 (socket says 172.21.15.192:33200) 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 -- 172.21.15.192:0/2683407661 learned_addr learned my addr 172.21.15.192:0/2683407661 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea26a00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c004f50 0x7fea2813b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea26000640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea2813fa70 0x7fea281f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 -- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c004f50 msgr2=0x7fea2813b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c004f50 0x7fea2813b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 -- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea2813fa70 msgr2=0x7fea281f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea2813fa70 0x7fea281f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.556+0000 7fea27400640 1 -- 172.21.15.192:0/2683407661 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea281f2f90 con 0x7fea2815b9d0 2024-09-13T18:35:49.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea27400640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a950 tx=0x7fea20001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20038070 con 0x7fea2815b9d0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2002ba50 con 0x7fea2815b9d0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20034890 con 0x7fea2815b9d0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea281f3270 con 0x7fea2815b9d0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.557+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea281f3880 con 0x7fea2815b9d0 2024-09-13T18:35:49.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.558+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea28067490 con 0x7fea2815b9d0 2024-09-13T18:35:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.559+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fea20031070 con 0x7fea2815b9d0 2024-09-13T18:35:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.560+0000 7fea1f400640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 0x7fea0806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.560+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fea2003b040 con 0x7fea2815b9d0 2024-09-13T18:35:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.560+0000 7fea26a00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 0x7fea0806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.560+0000 7fea26a00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 0x7fea0806d0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea18001910 tx=0x7fea18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.564+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fea20074340 con 0x7fea2815b9d0 2024-09-13T18:35:49.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.777+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fea280b3f10 con 0x7fea2815b9d0 2024-09-13T18:35:49.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.780+0000 7fea1f400640 1 -- 172.21.15.192:0/2683407661 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170957 (secure 0 0 0) 0x7fea20077960 con 0x7fea2815b9d0 2024-09-13T18:35:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 msgr2=0x7fea0806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 0x7fea0806d0f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fea18001910 tx=0x7fea18009040 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 msgr2=0x7fea2815be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fea2000a950 tx=0x7fea20001d80 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 shutdown_connections 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fea0806ac30 0x7fea0806d0f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea2815b9d0 0x7fea2815be80 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fea2813fa70 0x7fea281f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 --2- 172.21.15.192:0/2683407661 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fea0c004f50 0x7fea2813b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 >> 172.21.15.192:0/2683407661 conn(0x7fea280ae960 msgr2=0x7fea280b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 shutdown_connections 2024-09-13T18:35:49.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.783+0000 7fea2de00640 1 -- 172.21.15.192:0/2683407661 wait complete. 2024-09-13T18:35:49.802 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6832","nonce":2095686379},{"type":"v1","addr":"172.21.15.192:6833","nonce":2095686379}]},"active_addr":"172.21.15.192:6833/2095686379","active_change":"2024-09-13T18:35:26.721754+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3904948945}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":1477091685}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":47174047}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.192:0","nonce":3656001443}]}]} 2024-09-13T18:35:49.805 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-13T18:35:49.805 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-13T18:35:49.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:49.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.955+0000 7f1e5c600640 1 Processor -- start 2024-09-13T18:35:49.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.955+0000 7f1e5c600640 1 -- start start 2024-09-13T18:35:49.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.956+0000 7f1e5c600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e54146610 0x7f1e540ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.956+0000 7f1e5c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e540b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.956+0000 7f1e5c600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e540adf50 con 0x7f1e540b2780 2024-09-13T18:35:49.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.956+0000 7f1e5c600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e540cd920 con 0x7f1e54146610 2024-09-13T18:35:49.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.956+0000 7f1e5c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e540b0730 con 0x7f1e540afd80 2024-09-13T18:35:49.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e54146610 0x7f1e540ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e5a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e540b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e54146610 0x7f1e540ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:51610/0 (socket says 172.21.15.192:51610) 2024-09-13T18:35:49.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 -- 172.21.15.192:0/3853998969 learned_addr learned my addr 172.21.15.192:0/3853998969 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:49.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 -- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 msgr2=0x7f1e540b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 --2- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e540b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 -- 172.21.15.192:0/3853998969 >> v1:172.21.15.194:6789/0 conn(0x7f1e540b2780 legacy=0x7f1e540ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e59c00640 1 -- 172.21.15.192:0/3853998969 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e540ae770 con 0x7f1e54146610 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.957+0000 7f1e53e00640 1 -- 172.21.15.192:0/3853998969 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909613775 0 0) 0x7f1e540adf50 con 0x7f1e540b2780 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.958+0000 7f1e59c00640 1 --2- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e54146610 0x7f1e540ce2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e480098a0 tx=0x7f1e4802a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7d0913c5c9fc152 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e53e00640 1 -- 172.21.15.192:0/3853998969 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48032440 con 0x7f1e54146610 2024-09-13T18:35:49.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e53e00640 1 -- 172.21.15.192:0/3853998969 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e480325a0 con 0x7f1e54146610 2024-09-13T18:35:49.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e53e00640 1 -- 172.21.15.192:0/3853998969 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e48032930 con 0x7f1e54146610 2024-09-13T18:35:49.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e5c600640 1 -- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e54146610 msgr2=0x7f1e540ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e5c600640 1 --2- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e54146610 0x7f1e540ce2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1e480098a0 tx=0x7f1e4802a290 comp rx=0 tx=0).stop 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e5c600640 1 -- 172.21.15.192:0/3853998969 shutdown_connections 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.959+0000 7f1e5c600640 1 --2- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e540b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.960+0000 7f1e5c600640 1 --2- 172.21.15.192:0/3853998969 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e54146610 0x7f1e540ce2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.960+0000 7f1e5c600640 1 -- 172.21.15.192:0/3853998969 >> 172.21.15.192:0/3853998969 conn(0x7f1e540ae960 msgr2=0x7f1e5406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.960+0000 7f1e5c600640 1 -- 172.21.15.192:0/3853998969 shutdown_connections 2024-09-13T18:35:49.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.960+0000 7f1e5c600640 1 -- 172.21.15.192:0/3853998969 wait complete. 2024-09-13T18:35:49.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.961+0000 7f1e5c600640 1 Processor -- start 2024-09-13T18:35:49.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.961+0000 7f1e5c600640 1 -- start start 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e541f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e540b2780 0x7f1e5413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54140dd0 con 0x7f1e54146610 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54140250 con 0x7f1e540b2780 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.962+0000 7f1e5c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e54140530 con 0x7f1e540afd80 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e59c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e541f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e59200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e540b2780 0x7f1e5413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33214/0 (socket says 172.21.15.192:33214) 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e59c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e541f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40608/0 (socket says 172.21.15.192:40608) 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 -- 172.21.15.192:0/2373348875 learned_addr learned my addr 172.21.15.192:0/2373348875 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:49.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 -- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 msgr2=0x7f1e541f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e541f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 -- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e540b2780 msgr2=0x7f1e5413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e540b2780 0x7f1e5413f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 -- 172.21.15.192:0/2373348875 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480094d0 con 0x7f1e54146610 2024-09-13T18:35:49.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e5a600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00efc0 tx=0x7f1e4c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.963+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c014480 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.964+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e4c00f040 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.964+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c014820 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.964+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e54140810 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.964+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e541f2670 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.965+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e541469f0 con 0x7f1e54146610 2024-09-13T18:35:49.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.966+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e4c014980 con 0x7f1e54146610 2024-09-13T18:35:49.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.966+0000 7f1e51600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 0x7f1e3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:49.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.966+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e4c089db0 con 0x7f1e54146610 2024-09-13T18:35:49.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.967+0000 7f1e59c00640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 0x7f1e3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:49.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.967+0000 7f1e59c00640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 0x7f1e3406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e48034000 tx=0x7f1e4802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:49.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:49.971+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e4c055040 con 0x7f1e54146610 2024-09-13T18:35:50.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.142+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e540b32a0 con 0x7f1e54146610 2024-09-13T18:35:50.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.144+0000 7f1e51600640 1 -- 172.21.15.192:0/2373348875 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f1e4c018090 con 0x7f1e54146610 2024-09-13T18:35:50.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:50.149 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 msgr2=0x7f1e3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 0x7f1e3406d0c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1e48034000 tx=0x7f1e4802e000 comp rx=0 tx=0).stop 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 msgr2=0x7f1e540b3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00efc0 tx=0x7f1e4c00c490 comp rx=0 tx=0).stop 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 shutdown_connections 2024-09-13T18:35:50.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e3406ac00 0x7f1e3406d0c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e54146610 0x7f1e540b3a00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e540b2780 0x7f1e5413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 --2- 172.21.15.192:0/2373348875 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e540afd80 0x7f1e541f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 >> 172.21.15.192:0/2373348875 conn(0x7f1e540ae960 msgr2=0x7f1e540ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 shutdown_connections 2024-09-13T18:35:50.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.146+0000 7f1e5c600640 1 -- 172.21.15.192:0/2373348875 wait complete. 2024-09-13T18:35:50.164 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-13T18:35:50.165 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:50.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.313+0000 7f4a7e200640 1 Processor -- start 2024-09-13T18:35:50.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.314+0000 7f4a7e200640 1 -- start start 2024-09-13T18:35:50.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a78159b00 0x7f4a780b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 0x7f4a780b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a7815a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7815af60 con 0x7f4a78159b00 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a7806b7a0 con 0x7f4a7806bc30 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7815ac80 con 0x7f4a78159ee0 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a78159b00 0x7f4a780b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4a78159b00 0x7f4a780b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33228/0 (socket says 172.21.15.192:33228) 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7ce00640 1 -- 172.21.15.192:0/2914002926 learned_addr learned my addr 172.21.15.192:0/2914002926 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7ce00640 1 -- 172.21.15.192:0/2914002926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 msgr2=0x7f4a7815a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.315+0000 7f4a7d800640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a7815a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a77e00640 1 --2- 172.21.15.192:0/2914002926 >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 0x7f4a780b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a7815a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a7ce00640 1 -- 172.21.15.192:0/2914002926 >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 msgr2=0x7f4a780b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/2914002926 >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 0x7f4a780b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a7ce00640 1 -- 172.21.15.192:0/2914002926 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7806b150 con 0x7f4a78159b00 2024-09-13T18:35:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a7d800640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a7815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:50.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.316+0000 7f4a77e00640 1 --2- 172.21.15.192:0/2914002926 >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 0x7f4a780b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78159b00 0x7f4a780b2d70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a7806c830 tx=0x7f4a6802c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceea6a92c44f2a94 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a77400640 1 -- 172.21.15.192:0/2914002926 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68032790 con 0x7f4a78159b00 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a77400640 1 -- 172.21.15.192:0/2914002926 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a680328f0 con 0x7f4a78159b00 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a77400640 1 -- 172.21.15.192:0/2914002926 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a68032c80 con 0x7f4a78159b00 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 -- 172.21.15.192:0/2914002926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78159b00 msgr2=0x7f4a780b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78159b00 0x7f4a780b2d70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4a7806c830 tx=0x7f4a6802c890 comp rx=0 tx=0).stop 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 -- 172.21.15.192:0/2914002926 shutdown_connections 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a7815a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 --2- 172.21.15.192:0/2914002926 >> v2:172.21.15.194:3300/0 conn(0x7f4a7806bc30 0x7f4a780b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 --2- 172.21.15.192:0/2914002926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a78159b00 0x7f4a780b2d70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.317+0000 7f4a7e200640 1 -- 172.21.15.192:0/2914002926 >> 172.21.15.192:0/2914002926 conn(0x7f4a780736d0 msgr2=0x7f4a780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.318+0000 7f4a7e200640 1 -- 172.21.15.192:0/2914002926 shutdown_connections 2024-09-13T18:35:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.318+0000 7f4a7e200640 1 -- 172.21.15.192:0/2914002926 wait complete. 2024-09-13T18:35:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.319+0000 7f4a7e200640 1 Processor -- start 2024-09-13T18:35:50.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.319+0000 7f4a7e200640 1 -- start start 2024-09-13T18:35:50.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a78159b00 0x7f4a78070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a781532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78154000 con 0x7f4a7806bc30 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7815b7e0 con 0x7f4a78159b00 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7e200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a78153d20 con 0x7f4a78159ee0 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33244/0 (socket says 172.21.15.192:33244) 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.320+0000 7f4a7ce00640 1 -- 172.21.15.192:0/3099720288 learned_addr learned my addr 172.21.15.192:0/3099720288 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7d800640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a781532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a77e00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a78159b00 0x7f4a78070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 -- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 msgr2=0x7f4a781532d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a781532d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 -- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a78159b00 msgr2=0x7f4a78070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a78159b00 0x7f4a78070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 -- 172.21.15.192:0/3099720288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a6800b770 con 0x7f4a7806bc30 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7ce00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a6802c8d0 tx=0x7f4a68004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6803c830 con 0x7f4a7806bc30 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a6803c990 con 0x7f4a7806bc30 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7815b9f0 con 0x7f4a7806bc30 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a6803cd40 con 0x7f4a7806bc30 2024-09-13T18:35:50.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.321+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7815bfb0 con 0x7f4a7806bc30 2024-09-13T18:35:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.322+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7815a370 con 0x7f4a7806bc30 2024-09-13T18:35:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.323+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4a68033420 con 0x7f4a7806bc30 2024-09-13T18:35:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.324+0000 7f4a74c00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 0x7f4a5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.324+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a680aa210 con 0x7f4a7806bc30 2024-09-13T18:35:50.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.324+0000 7f4a77e00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 0x7f4a5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.325+0000 7f4a77e00640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 0x7f4a5806d0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a781477e0 tx=0x7f4a64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.328+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4a680753e0 con 0x7f4a7806bc30 2024-09-13T18:35:50.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.498+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4a780b3c70 con 0x7f4a7806bc30 2024-09-13T18:35:50.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.499+0000 7f4a74c00640 1 -- 172.21.15.192:0/3099720288 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f4a68043090 con 0x7f4a7806bc30 2024-09-13T18:35:50.502 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:50.503 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 msgr2=0x7f4a5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 0x7f4a5806d0f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a781477e0 tx=0x7f4a64008040 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 msgr2=0x7f4a78144d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4a6802c8d0 tx=0x7f4a68004730 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 shutdown_connections 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4a5806ac30 0x7f4a5806d0f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4a78159ee0 0x7f4a781532d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4a78159b00 0x7f4a78070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 --2- 172.21.15.192:0/3099720288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4a7806bc30 0x7f4a78144d10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 >> 172.21.15.192:0/3099720288 conn(0x7f4a780736d0 msgr2=0x7f4a780b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 shutdown_connections 2024-09-13T18:35:50.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.502+0000 7f4a7e200640 1 -- 172.21.15.192:0/3099720288 wait complete. 2024-09-13T18:35:50.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-13T18:35:50.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-13T18:35:50.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-13T18:35:50.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-13T18:35:50.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-13T18:35:50.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-13T18:35:50.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-13T18:35:50.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-13T18:35:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.788+0000 7f13a2a00640 1 Processor -- start 2024-09-13T18:35:50.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.788+0000 7f13a2a00640 1 -- start start 2024-09-13T18:35:50.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.791+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 0x7f139c0b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.791+0000 7f13a2a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c070d60 con 0x7f139c0b3c00 2024-09-13T18:35:50.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.791+0000 7f13a2a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f139c071000 con 0x7f139c146460 2024-09-13T18:35:50.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.791+0000 7f13a2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c0b4070 con 0x7f139c146840 2024-09-13T18:35:50.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.792+0000 7f7d91800640 1 Processor -- start 2024-09-13T18:35:50.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.792+0000 7f139b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 0x7f139c0b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.792+0000 7f13a0a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f139c0b3c00 0x7f139c15e6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54094/0 (socket says 172.21.15.192:54094) 2024-09-13T18:35:50.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.792+0000 7f13a0a00640 1 -- 172.21.15.192:0/1658530162 learned_addr learned my addr 172.21.15.192:0/1658530162 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:50.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.793+0000 7f139b400640 1 -- 172.21.15.192:0/1658530162 >> v1:172.21.15.194:6789/0 conn(0x7f139c146460 legacy=0x7f139c06f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.792+0000 7f7d91800640 1 -- start start 2024-09-13T18:35:50.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.794+0000 7f7d91800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d8c158ea0 0x7f7d8c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.794+0000 7f7d91800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c06eb50 con 0x7f7d8c0b24e0 2024-09-13T18:35:50.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.794+0000 7f7d91800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c15af20 con 0x7f7d8c0b02c0 2024-09-13T18:35:50.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.794+0000 7f7d91800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d8c0b06e0 con 0x7f7d8c158ea0 2024-09-13T18:35:50.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.793+0000 7f139b400640 1 -- 172.21.15.192:0/1658530162 >> v1:172.21.15.192:6789/0 conn(0x7f139c0b3c00 legacy=0x7f139c15e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.793+0000 7f139b400640 1 -- 172.21.15.192:0/1658530162 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f139c0712e0 con 0x7f139c146840 2024-09-13T18:35:50.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f139b400640 1 --2- 172.21.15.192:0/1658530162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 0x7f139c0b36c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f138c0097d0 tx=0x7f138c02a1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=413277072b80467f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f7d8aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d8c158ea0 0x7f7d8c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f7d8aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d8c158ea0 0x7f7d8c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57152/0 (socket says 172.21.15.192:57152) 2024-09-13T18:35:50.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f188ce00640 1 Processor -- start 2024-09-13T18:35:50.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f7d8aa00640 1 -- 172.21.15.192:0/2326016034 learned_addr learned my addr 172.21.15.192:0/2326016034 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f139aa00640 1 -- 172.21.15.192:0/1658530162 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c032440 con 0x7f139c146840 2024-09-13T18:35:50.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.796+0000 7f139aa00640 1 -- 172.21.15.192:0/1658530162 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c0325a0 con 0x7f139c146840 2024-09-13T18:35:50.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.797+0000 7f7d8aa00640 1 -- 172.21.15.192:0/2326016034 >> v1:172.21.15.194:6789/0 conn(0x7f7d8c0b02c0 legacy=0x7f7d8c0b1dd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:35:50.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.797+0000 7f139aa00640 1 -- 172.21.15.192:0/1658530162 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c032910 con 0x7f139c146840 2024-09-13T18:35:50.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.797+0000 7f7d8aa00640 1 -- 172.21.15.192:0/2326016034 >> v1:172.21.15.192:6789/0 conn(0x7f7d8c0b24e0 legacy=0x7f7d8c15b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.797+0000 7f7d8aa00640 1 -- 172.21.15.192:0/2326016034 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c15a610 con 0x7f7d8c158ea0 2024-09-13T18:35:50.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.798+0000 7f7d8aa00640 1 --2- 172.21.15.192:0/2326016034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c0afd80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d84008870 tx=0x7f7d8402c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f21e352b720451d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.798+0000 7f13a2a00640 1 -- 172.21.15.192:0/1658530162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 msgr2=0x7f139c0b36c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.798+0000 7f13a2a00640 1 --2- 172.21.15.192:0/1658530162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 0x7f139c0b36c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f138c0097d0 tx=0x7f138c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f13a2a00640 1 -- 172.21.15.192:0/1658530162 shutdown_connections 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f13a2a00640 1 --2- 172.21.15.192:0/1658530162 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146840 0x7f139c0b36c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f13a2a00640 1 -- 172.21.15.192:0/1658530162 >> 172.21.15.192:0/1658530162 conn(0x7f139c0b0f90 msgr2=0x7f139c0b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.797+0000 7f188ce00640 1 -- start start 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f188ce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18880cd7a0 0x7f1888152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f188ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 0x7f1888153460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f188ce00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1888070350 con 0x7f188806cae0 2024-09-13T18:35:50.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f188ce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880cb330 con 0x7f188806cec0 2024-09-13T18:35:50.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f188ce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18880ce7e0 con 0x7f18880cd7a0 2024-09-13T18:35:50.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f13a2a00640 1 -- 172.21.15.192:0/1658530162 shutdown_connections 2024-09-13T18:35:50.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.800+0000 7f187d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18880cd7a0 0x7f1888152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.799+0000 7f13a2a00640 1 -- 172.21.15.192:0/1658530162 wait complete. 2024-09-13T18:35:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.800+0000 7f187d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18880cd7a0 0x7f1888152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34784/0 (socket says 172.21.15.192:34784) 2024-09-13T18:35:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.800+0000 7f187d400640 1 -- 172.21.15.192:0/3923242202 learned_addr learned my addr 172.21.15.192:0/3923242202 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.801+0000 7f1886800640 1 --2- 172.21.15.192:0/3923242202 >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 0x7f1888153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.801+0000 7f7d89600640 1 -- 172.21.15.192:0/2326016034 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84032480 con 0x7f7d8c158ea0 2024-09-13T18:35:50.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.801+0000 7f7d89600640 1 -- 172.21.15.192:0/2326016034 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8402f030 con 0x7f7d8c158ea0 2024-09-13T18:35:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.801+0000 7f7d89600640 1 -- 172.21.15.192:0/2326016034 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84032800 con 0x7f7d8c158ea0 2024-09-13T18:35:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f187d400640 1 -- 172.21.15.192:0/3923242202 >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 msgr2=0x7f1888153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f187d400640 1 --2- 172.21.15.192:0/3923242202 >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 0x7f1888153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f187d400640 1 -- 172.21.15.192:0/3923242202 >> v1:172.21.15.192:6789/0 conn(0x7f188806cae0 legacy=0x7f1888159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f187d400640 1 -- 172.21.15.192:0/3923242202 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18880cdc60 con 0x7f18880cd7a0 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f1885400640 1 -- 172.21.15.192:0/3923242202 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231214753 0 0) 0x7f1888070350 con 0x7f188806cae0 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f1886800640 1 --2- 172.21.15.192:0/3923242202 >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 0x7f1888153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f13a2a00640 1 Processor -- start 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f13a2a00640 1 -- start start 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f7d91800640 1 -- 172.21.15.192:0/2326016034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c158ea0 msgr2=0x7f7d8c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7f7d91800640 1 --2- 172.21.15.192:0/2326016034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c0afd80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7d84008870 tx=0x7f7d8402c7e0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7febe2c00640 1 Processor -- start 2024-09-13T18:35:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.802+0000 7febe2c00640 1 -- start start 2024-09-13T18:35:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f7d91800640 1 -- 172.21.15.192:0/2326016034 shutdown_connections 2024-09-13T18:35:50.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f7d91800640 1 --2- 172.21.15.192:0/2326016034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c0afd80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f7d91800640 1 -- 172.21.15.192:0/2326016034 >> 172.21.15.192:0/2326016034 conn(0x7f7d8c0ae960 msgr2=0x7f7d8c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f7d91800640 1 -- 172.21.15.192:0/2326016034 shutdown_connections 2024-09-13T18:35:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f7d91800640 1 -- 172.21.15.192:0/2326016034 wait complete. 2024-09-13T18:35:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f3bd2600640 1 Processor -- start 2024-09-13T18:35:50.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.803+0000 7f187d400640 1 --2- 172.21.15.192:0/3923242202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 0x7f1888152f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1888071c70 tx=0x7f187802c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af9c9aa266689bcc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f3bd2600640 1 -- start start 2024-09-13T18:35:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe2c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7febdc165920 0x7febdc164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f139c0b3c00 0x7f139c13ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 0x7f139c14eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c146840 0x7f139c1f6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c13d270 con 0x7f139c146840 2024-09-13T18:35:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139c06ccd0 con 0x7f139c0b3c00 2024-09-13T18:35:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7f13a2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139c06c9f0 con 0x7f139c146460 2024-09-13T18:35:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe2c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc15bbe0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe2c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febdc0d0a80 con 0x7febdc1651e0 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f139b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 0x7f139c14eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f139b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 0x7f139c14eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:39998/0 (socket says 172.21.15.192:39998) 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f139b400640 1 -- 172.21.15.192:0/298400158 learned_addr learned my addr 172.21.15.192:0/298400158 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f13a0a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c146840 0x7f139c1f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe2c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febdc165650 con 0x7febdc165920 2024-09-13T18:35:50.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f1885400640 1 -- 172.21.15.192:0/3923242202 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878031710 con 0x7f18880cd7a0 2024-09-13T18:35:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f1885400640 1 -- 172.21.15.192:0/3923242202 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187802f050 con 0x7f18880cd7a0 2024-09-13T18:35:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f1885400640 1 -- 172.21.15.192:0/3923242202 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878031a90 con 0x7f18880cd7a0 2024-09-13T18:35:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe1800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7febdc0b3fd0 0x7febdc0d25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54118/0 (socket says 172.21.15.192:54118) 2024-09-13T18:35:50.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7f139be00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f139c0b3c00 0x7f139c13ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.804+0000 7febe1800640 1 -- 172.21.15.192:0/3088568366 learned_addr learned my addr 172.21.15.192:0/3088568366 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1629404802 0 0) 0x7febdc0d0a80 con 0x7febdc1651e0 2024-09-13T18:35:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.805+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc4003520 con 0x7febdc1651e0 2024-09-13T18:35:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7febe0e00640 1 --2- 172.21.15.192:0/3088568366 >> v2:172.21.15.194:3300/0 conn(0x7febdc165920 0x7febdc164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f8fcce00640 1 Processor -- start 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139b400640 1 -- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f139c0b3c00 msgr2=0x7f139c13ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139b400640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f139c0b3c00 0x7f139c13ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139b400640 1 -- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c146840 msgr2=0x7f139c1f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139b400640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c146840 0x7f139c1f6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139b400640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f138c009400 con 0x7f139c146460 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7febe0e00640 1 -- 172.21.15.192:0/3088568366 >> v1:172.21.15.194:6789/0 conn(0x7febdc1651e0 legacy=0x7febdc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7febe0e00640 1 -- 172.21.15.192:0/3088568366 >> v1:172.21.15.192:6789/0 conn(0x7febdc0b3fd0 legacy=0x7febdc0d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229931623 0 0) 0x7febdc15bbe0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f139be00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f139c0b3c00 0x7f139c13ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f13a0a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f139c146840 0x7f139c1f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0afd80 0x7f3bcc15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bcc13e270 0x7f3bcc140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bcc0b0160 0x7f3bcc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc141200 con 0x7f3bcc0b0160 2024-09-13T18:35:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bcc15b7f0 con 0x7f3bcc13e270 2024-09-13T18:35:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7f3bd2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc15bad0 con 0x7f3bcc0afd80 2024-09-13T18:35:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f8fcce00640 1 -- start start 2024-09-13T18:35:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f7d91800640 1 Processor -- start 2024-09-13T18:35:50.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f7d91800640 1 -- start start 2024-09-13T18:35:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f188ce00640 1 -- 172.21.15.192:0/3923242202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 msgr2=0x7f1888152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f188ce00640 1 --2- 172.21.15.192:0/3923242202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 0x7f1888152f20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1888071c70 tx=0x7f187802c490 comp rx=0 tx=0).stop 2024-09-13T18:35:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.806+0000 7febe0e00640 1 -- 172.21.15.192:0/3088568366 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc0d0d60 con 0x7febdc165920 2024-09-13T18:35:50.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f139b400640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 0x7f139c14eb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c035040 tx=0x7f138c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 -- 172.21.15.192:0/3923242202 shutdown_connections 2024-09-13T18:35:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 --2- 172.21.15.192:0/3923242202 >> v2:172.21.15.192:3300/0 conn(0x7f188806cec0 0x7f1888153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 --2- 172.21.15.192:0/3923242202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 0x7f1888152f20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7febe0e00640 1 --2- 172.21.15.192:0/3088568366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc165920 0x7febdc164ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febc80097d0 tx=0x7febc802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e420ee9d4ba30c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 -- 172.21.15.192:0/3923242202 >> 172.21.15.192:0/3923242202 conn(0x7f18880b0f90 msgr2=0x7f18880b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 -- 172.21.15.192:0/3923242202 shutdown_connections 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f3bcbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bcc0b0160 0x7f3bcc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f3bcbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bcc0b0160 0x7f3bcc0cd950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57194/0 (socket says 172.21.15.192:57194) 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f3bcbe00640 1 -- 172.21.15.192:0/1814991387 learned_addr learned my addr 172.21.15.192:0/1814991387 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f3bcaa00640 1 --2- 172.21.15.192:0/1814991387 >> v2:172.21.15.194:3300/0 conn(0x7f3bcc13e270 0x7f3bcc140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.807+0000 7f3bcb400640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0afd80 0x7f3bcc15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f3bcbe00640 1 -- 172.21.15.192:0/1814991387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0afd80 msgr2=0x7f3bcc15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0afd80 0x7f3bcc15b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f3bcbe00640 1 -- 172.21.15.192:0/1814991387 >> v2:172.21.15.194:3300/0 conn(0x7f3bcc13e270 msgr2=0x7f3bcc140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/1814991387 >> v2:172.21.15.194:3300/0 conn(0x7f3bcc13e270 0x7f3bcc140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f3bcbe00640 1 -- 172.21.15.192:0/1814991387 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bcc15bdb0 con 0x7f3bcc0b0160 2024-09-13T18:35:50.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8032440 con 0x7febdc165920 2024-09-13T18:35:50.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc80325a0 con 0x7febdc165920 2024-09-13T18:35:50.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7febdbe00640 1 -- 172.21.15.192:0/3088568366 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc8032930 con 0x7febdc165920 2024-09-13T18:35:50.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fcce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8fc815ce50 0x7f8fc80b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fcce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 0x7f8fc8166a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fcce00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc80b3760 con 0x7f8fc80d0b30 2024-09-13T18:35:50.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fcce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc80b67e0 con 0x7f8fc80d2980 2024-09-13T18:35:50.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fcce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc80b6ac0 con 0x7f8fc815ce50 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c0b02c0 0x7f7d8c14d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d8c0b24e0 0x7f7d8c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c1404d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14dd30 con 0x7f7d8c0b02c0 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c140a10 con 0x7f7d8c158ea0 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f7d91800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c151bd0 con 0x7f7d8c0b24e0 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fc5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8fc815ce50 0x7f8fc80b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fc5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8fc815ce50 0x7f8fc80b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34832/0 (socket says 172.21.15.192:34832) 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c1404d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c0b02c0 0x7f7d8c14d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c1404d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34838/0 (socket says 172.21.15.192:34838) 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 -- 172.21.15.192:0/3723993269 learned_addr learned my addr 172.21.15.192:0/3723993269 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7febe2c00640 1 -- 172.21.15.192:0/3088568366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc165920 msgr2=0x7febdc164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7febe2c00640 1 --2- 172.21.15.192:0/3088568366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc165920 0x7febdc164ca0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7febc80097d0 tx=0x7febc802a270 comp rx=0 tx=0).stop 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f8fc6800640 1 --2- 172.21.15.192:0/3978788114 >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 0x7f8fc8166a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.809+0000 7f8fc5e00640 1 -- 172.21.15.192:0/3978788114 learned_addr learned my addr 172.21.15.192:0/3978788114 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 -- 172.21.15.192:0/3723993269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d8c0b24e0 msgr2=0x7f7d8c1514d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d8c0b24e0 0x7f7d8c1514d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 -- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c0b02c0 msgr2=0x7f7d8c14d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d8c0b02c0 0x7f7d8c14d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f7d8b400640 1 -- 172.21.15.192:0/3723993269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d84008550 con 0x7f7d8c158ea0 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7febe2c00640 1 -- 172.21.15.192:0/3088568366 shutdown_connections 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7febe2c00640 1 --2- 172.21.15.192:0/3088568366 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc165920 0x7febdc164ca0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7febe2c00640 1 -- 172.21.15.192:0/3088568366 >> 172.21.15.192:0/3088568366 conn(0x7febdc0b4900 msgr2=0x7febdc0b4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f8fc4a00640 1 -- 172.21.15.192:0/3978788114 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484223754 0 0) 0x7f8fc80b3760 con 0x7f8fc80d0b30 2024-09-13T18:35:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0b0160 0x7f3bcc0cd950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0cea50 tx=0x7f3bc402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de3e3b639664cb5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc4a00640 1 -- 172.21.15.192:0/3978788114 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fac003520 con 0x7f8fc80d0b30 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc5e00640 1 -- 172.21.15.192:0/3978788114 >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 msgr2=0x7f8fc8166a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc5e00640 1 --2- 172.21.15.192:0/3978788114 >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 0x7f8fc8166a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc5e00640 1 -- 172.21.15.192:0/3978788114 >> v1:172.21.15.194:6789/0 conn(0x7f8fc80d0b30 legacy=0x7f8fc80d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc5e00640 1 -- 172.21.15.192:0/3978788114 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc80b6da0 con 0x7f8fc815ce50 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f8fc6800640 1 --2- 172.21.15.192:0/3978788114 >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 0x7f8fc8166a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f7d8b400640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c1404d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c390 tx=0x7f7d7400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d740035f0 con 0x7f7d8c158ea0 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74003770 con 0x7f7d8c158ea0 2024-09-13T18:35:50.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74003b20 con 0x7f7d8c158ea0 2024-09-13T18:35:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c151eb0 con 0x7f7d8c158ea0 2024-09-13T18:35:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f188ce00640 1 -- 172.21.15.192:0/3923242202 wait complete. 2024-09-13T18:35:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f3bca000640 1 -- 172.21.15.192:0/1814991387 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4031600 con 0x7f3bcc0b0160 2024-09-13T18:35:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f3bca000640 1 -- 172.21.15.192:0/1814991387 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc402d050 con 0x7f3bcc0b0160 2024-09-13T18:35:50.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f188ce00640 1 Processor -- start 2024-09-13T18:35:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f3bca000640 1 -- 172.21.15.192:0/1814991387 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4031980 con 0x7f3bcc0b0160 2024-09-13T18:35:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c152470 con 0x7f7d8c158ea0 2024-09-13T18:35:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c006e10 con 0x7f139c146460 2024-09-13T18:35:50.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138c003610 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f139c1f5f70 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f139c06c6b0 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.808+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138c0039e0 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.810+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f139c071b80 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.811+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f138c003b40 con 0x7f139c146460 2024-09-13T18:35:50.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7febe2c00640 1 -- 172.21.15.192:0/3088568366 shutdown_connections 2024-09-13T18:35:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7febe2c00640 1 -- 172.21.15.192:0/3088568366 wait complete. 2024-09-13T18:35:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.812+0000 7f8fc5e00640 1 --2- 172.21.15.192:0/3978788114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc815ce50 0x7f8fc80b5e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fc808c290 tx=0x7f8fb402a280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f6d03779e4b33a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f3bd2600640 1 -- 172.21.15.192:0/1814991387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0b0160 msgr2=0x7f3bcc0cd950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f8fc4a00640 1 -- 172.21.15.192:0/3978788114 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4032440 con 0x7f8fc815ce50 2024-09-13T18:35:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f8fc4a00640 1 -- 172.21.15.192:0/3978788114 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb40325a0 con 0x7f8fc815ce50 2024-09-13T18:35:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f8fc4a00640 1 -- 172.21.15.192:0/3978788114 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4032930 con 0x7f8fc815ce50 2024-09-13T18:35:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f3bd2600640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0b0160 0x7f3bcc0cd950 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0cea50 tx=0x7f3bc402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f188ce00640 1 -- start start 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 -- 172.21.15.192:0/1814991387 shutdown_connections 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0b0160 0x7f3bcc0cd950 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 --2- 172.21.15.192:0/1814991387 >> v2:172.21.15.194:3300/0 conn(0x7f3bcc13e270 0x7f3bcc140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 --2- 172.21.15.192:0/1814991387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0afd80 0x7f3bcc15b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 -- 172.21.15.192:0/1814991387 >> 172.21.15.192:0/1814991387 conn(0x7f3bcc0ae960 msgr2=0x7f3bcc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f1393e00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f137806ac50 0x7f137806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f138c0aa110 con 0x7f139c146460 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f1393e00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f1378072e70 0x7f1378075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1378075940 con 0x7f1378072e70 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.813+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f138c0ac6f0 con 0x7f139c146460 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f13a0a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f1378072e70 0x7f1378075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 0x7f18880ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188806cec0 0x7f1888153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 0x7f188814bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188814fa60 con 0x7f188806cae0 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1888153f40 con 0x7f18880cd7a0 2024-09-13T18:35:50.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f188ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18881faac0 con 0x7f188806cec0 2024-09-13T18:35:50.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f3bd2600640 1 -- 172.21.15.192:0/1814991387 shutdown_connections 2024-09-13T18:35:50.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f8fcce00640 1 -- 172.21.15.192:0/3978788114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc815ce50 msgr2=0x7f8fc80b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.814+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3978788114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc815ce50 0x7f8fc80b5e70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fc808c290 tx=0x7f8fb402a280 comp rx=0 tx=0).stop 2024-09-13T18:35:50.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f1885e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 0x7f18880ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7febe2c00640 1 Processor -- start 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 -- 172.21.15.192:0/3978788114 shutdown_connections 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3978788114 >> v2:172.21.15.192:3300/0 conn(0x7f8fc80d2980 0x7f8fc8166a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3978788114 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc815ce50 0x7f8fc80b5e70 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8fc808c290 tx=0x7f8fb402a280 comp rx=0 tx=0).stop 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 -- 172.21.15.192:0/3978788114 >> 172.21.15.192:0/3978788114 conn(0x7f8fc80d3000 msgr2=0x7f8fc80d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f1885e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 0x7f18880ade70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57208/0 (socket says 172.21.15.192:57208) 2024-09-13T18:35:50.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f1885e00640 1 -- 172.21.15.192:0/3773733937 learned_addr learned my addr 172.21.15.192:0/3773733937 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7febe2c00640 1 -- start start 2024-09-13T18:35:50.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 -- 172.21.15.192:0/3978788114 shutdown_connections 2024-09-13T18:35:50.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f3bd2600640 1 -- 172.21.15.192:0/1814991387 wait complete. 2024-09-13T18:35:50.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 -- 172.21.15.192:0/3773733937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188806cec0 msgr2=0x7f1888153a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:35:50.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188806cec0 0x7f1888153a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 -- 172.21.15.192:0/3773733937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 msgr2=0x7f188814bfd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:35:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18880cd7a0 0x7f188814bfd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18780094d0 con 0x7f188806cae0 2024-09-13T18:35:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f8fcce00640 1 -- 172.21.15.192:0/3978788114 wait complete. 2024-09-13T18:35:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7f1885e00640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 0x7f18880ade70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f187000c460 tx=0x7f187000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7febe2c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 0x7febdc1f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7febe2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc1651e0 0x7febdc0b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.816+0000 7febe2c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febdc165920 0x7febdc161960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe2c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc1f6820 con 0x7febdc0b3fd0 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febdc160310 con 0x7febdc1651e0 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe2c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febdc15f700 con 0x7febdc165920 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 0x7febdc1f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 0x7febdc1f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57216/0 (socket says 172.21.15.192:57216) 2024-09-13T18:35:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 -- 172.21.15.192:0/1677976323 learned_addr learned my addr 172.21.15.192:0/1677976323 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d74003c80 con 0x7f7d8c158ea0 2024-09-13T18:35:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe2200640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febdc165920 0x7febdc161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870005480 con 0x7f188806cae0 2024-09-13T18:35:50.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18700035f0 con 0x7f188806cae0 2024-09-13T18:35:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f139be00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f137806ac50 0x7f137806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.815+0000 7f13a0a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f1378072e70 0x7f1378075290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18700039a0 con 0x7f188806cae0 2024-09-13T18:35:50.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f3bd2600640 1 Processor -- start 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7f8fcce00640 1 Processor -- start 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 -- 172.21.15.192:0/1677976323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febdc165920 msgr2=0x7febdc161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febdc165920 0x7febdc161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 -- 172.21.15.192:0/1677976323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc1651e0 msgr2=0x7febdc0b7ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7febe1800640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febdc1651e0 0x7febdc0b7ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7f3bd2600640 1 -- start start 2024-09-13T18:35:50.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7f8fcce00640 1 -- start start 2024-09-13T18:35:50.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7fbbe2a00640 1 Processor -- start 2024-09-13T18:35:50.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7febe1800640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc8009400 con 0x7febdc0b3fd0 2024-09-13T18:35:50.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7febe1800640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 0x7febdc1f62e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febd000c4d0 tx=0x7febd000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== osd.0 v2:172.21.15.192:6823/4155920616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f1378075940 con 0x7f1378072e70 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7f7d82a00640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d6806acd0 0x7f7d6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d74088930 con 0x7f7d8c158ea0 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f7d91800640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f7d640015e0 0x7f7d64003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 --> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7d64006b40 con 0x7f7d640015e0 2024-09-13T18:35:50.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f7d8aa00640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d6806acd0 0x7f7d6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.817+0000 7f188ce00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18881fa520 con 0x7f188806cae0 2024-09-13T18:35:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.818+0000 7f188ce00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188814b7d0 con 0x7f188806cae0 2024-09-13T18:35:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7f139be00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f137806ac50 0x7f137806d110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13840017d0 tx=0x7f1384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f7d8a000640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f7d640015e0 0x7f7d64003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0afd80 0x7f3bcc0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0b0160 0x7f3bcc13cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 0x7f3bcc0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f8fcce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fc80d0b30 0x7f8fc813f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.819+0000 7fbbe2a00640 1 -- start start 2024-09-13T18:35:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f7d8a000640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f7d640015e0 0x7f7d64003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f7d8aa00640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d6806acd0 0x7f7d6806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d84037000 tx=0x7f7d8400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc1f1370 con 0x7f3bcc0afd80 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc0ad600 con 0x7f3bcc13e270 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f3bd2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bcc1f0d20 con 0x7f3bcc0b0160 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f8fcce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 0x7f8fc80ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7f8fcce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc80cd3e0 0x7f8fc80c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1870003b00 con 0x7f188806cae0 2024-09-13T18:35:50.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f188ce00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f185c000fc0 con 0x7f188806cae0 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f187ea00640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186406acd0 0x7f186406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1870088e90 con 0x7f188806cae0 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f187ea00640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7f1864072e70 0x7f1864075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f3bcbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 0x7f3bcc0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f3bcbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 0x7f3bcc0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34850/0 (socket says 172.21.15.192:34850) 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f3bcbe00640 1 -- 172.21.15.192:0/2527310652 learned_addr learned my addr 172.21.15.192:0/2527310652 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f3bcaa00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0b0160 0x7f3bcc13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f3bcb400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0afd80 0x7f3bcc0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcaa00640 1 -- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 msgr2=0x7f3bcc0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcaa00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 0x7f3bcc0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcaa00640 1 -- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0afd80 msgr2=0x7f3bcc0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcaa00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0afd80 0x7f3bcc0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcaa00640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc4009b30 con 0x7f3bcc0b0160 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcb400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bcc0afd80 0x7f3bcc0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bcc13e270 0x7f3bcc0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bcaa00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0b0160 0x7f3bcc13cd70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0ae930 tx=0x7f3bb800d980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fc5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fc80d0b30 0x7f8fc813f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fc5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 0x7f8fc80ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fc5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 0x7f8fc80ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57238/0 (socket says 172.21.15.192:57238) 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fc5400640 1 -- 172.21.15.192:0/3870446952 learned_addr learned my addr 172.21.15.192:0/3870446952 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc80cd890 con 0x7f8fc80d2980 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fc6800640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc80cd3e0 0x7f8fc80c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc81f6fb0 con 0x7f8fc80cd3e0 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc813f8b0 con 0x7f8fc80d0b30 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f8fc5400640 1 -- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fc80d0b30 msgr2=0x7f8fc813f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f8fc5400640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fc80d0b30 0x7f8fc813f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f8fc5400640 1 -- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc80cd3e0 msgr2=0x7f8fc80c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f8fc5400640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fc80cd3e0 0x7f8fc80c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f8fc5400640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40094d0 con 0x7f8fc80d2980 2024-09-13T18:35:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1864075940 con 0x7f1864072e70 2024-09-13T18:35:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8004240 con 0x7f3bcc0b0160 2024-09-13T18:35:50.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f8fc5400640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 0x7f8fc80ccea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800c490 tx=0x7f8fb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1870054050 con 0x7f188806cae0 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb80043a0 con 0x7f3bcc0b0160 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8003850 con 0x7f3bcc0b0160 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd00074e0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.820+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0007640 con 0x7febdc0b3fd0 2024-09-13T18:35:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.821+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0004a00 con 0x7febdc0b3fd0 2024-09-13T18:35:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f1886800640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7f1864072e70 0x7f1864075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.822+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== osd.2 v2:172.21.15.192:6808/1589536644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f7d64006b40 con 0x7f7d640015e0 2024-09-13T18:35:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80052d0 con 0x7f8fc80d2980 2024-09-13T18:35:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8005430 con 0x7f8fc80d2980 2024-09-13T18:35:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8012870 con 0x7f8fc80d2980 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7fbbe2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 0x7fbbdc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7fbbe2a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 0x7fbbdc159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7fbbe2a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbdc0b35f0 con 0x7fbbdc142330 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7fbbe2a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbdc159750 con 0x7fbbdc159b70 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7fbbe2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc06bac0 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febdc15f9e0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febdc15ffa0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bcc1f1000 con 0x7f3bcc0b0160 2024-09-13T18:35:50.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.823+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bcc1f09a0 con 0x7f3bcc0b0160 2024-09-13T18:35:50.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3ba4000fc0 con 0x7f3bcc0b0160 2024-09-13T18:35:50.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc80c94d0 con 0x7f8fc80d2980 2024-09-13T18:35:50.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc813fd60 con 0x7f8fc80d2980 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.824+0000 7fbbe1600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbbdc142330 0x7fbbdc069ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54128/0 (socket says 172.21.15.192:54128) 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7fbbe1600640 1 -- 172.21.15.192:0/1981020797 learned_addr learned my addr 172.21.15.192:0/1981020797 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7fbbe0c00640 1 --2- 172.21.15.192:0/1981020797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 0x7fbbdc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7fbbe2000640 1 --2- 172.21.15.192:0/1981020797 >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 0x7fbbdc159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7f1886800640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7f1864072e70 0x7f1864075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7f0d67e00640 1 Processor -- start 2024-09-13T18:35:50.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7fbbe0c00640 1 -- 172.21.15.192:0/1981020797 >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 msgr2=0x7fbbdc159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.825+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febdc0d1600 con 0x7febdc0b3fd0 2024-09-13T18:35:50.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7fbbe0c00640 1 --2- 172.21.15.192:0/1981020797 >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 0x7fbbdc159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7fbbe0c00640 1 -- 172.21.15.192:0/1981020797 >> v1:172.21.15.192:6789/0 conn(0x7fbbdc142330 legacy=0x7fbbdc069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7f0d67e00640 1 -- start start 2024-09-13T18:35:50.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7f187d400640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186406acd0 0x7f186406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7fbbe0c00640 1 -- 172.21.15.192:0/1981020797 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc06aa10 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.826+0000 7fbbe2000640 1 --2- 172.21.15.192:0/1981020797 >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 0x7fbbdc159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f187d400640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186406acd0 0x7f186406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1878035000 tx=0x7f1878008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f0d67e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0d601552d0 0x7f0d6015bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f0d67e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0d600cddf0 0x7f0d600cf960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f0d67e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6015c1e0 con 0x7f0d600cfea0 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f0d67e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d600d02b0 con 0x7f0d600cddf0 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.827+0000 7f0d67e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d601556b0 con 0x7f0d601552d0 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0d601552d0 0x7f0d6015bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0d601552d0 0x7f0d6015bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34876/0 (socket says 172.21.15.192:34876) 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 -- 172.21.15.192:0/4018043265 learned_addr learned my addr 172.21.15.192:0/4018043265 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7fbbe0c00640 1 --2- 172.21.15.192:0/1981020797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 0x7fbbdc0b30b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097a0 tx=0x7fbbc802a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d71273cc9c9a8bb6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 -- 172.21.15.192:0/4018043265 >> v2:172.21.15.192:3300/0 conn(0x7f0d600cddf0 msgr2=0x7f0d600cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 --2- 172.21.15.192:0/4018043265 >> v2:172.21.15.192:3300/0 conn(0x7f0d600cddf0 0x7f0d600cf960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 -- 172.21.15.192:0/4018043265 >> v1:172.21.15.192:6789/0 conn(0x7f0d600cfea0 legacy=0x7f0d6015e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f0d65400640 1 -- 172.21.15.192:0/4018043265 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d600ce290 con 0x7f0d601552d0 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.828+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8fa0000fc0 con 0x7f8fc80d2980 2024-09-13T18:35:50.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.829+0000 7fbbdbe00640 1 -- 172.21.15.192:0/1981020797 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc802ae40 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.829+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== osd.1 v2:172.21.15.192:6816/4129826895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f1864075940 con 0x7f1864072e70 2024-09-13T18:35:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.829+0000 7fbbdbe00640 1 -- 172.21.15.192:0/1981020797 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc8032440 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.829+0000 7fbbdbe00640 1 -- 172.21.15.192:0/1981020797 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc80327d0 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.829+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bb80039b0 con 0x7f3bcc0b0160 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.830+0000 7fbbe2a00640 1 -- 172.21.15.192:0/1981020797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 msgr2=0x7fbbdc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.830+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/1981020797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 0x7fbbdc0b30b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fbbc80097a0 tx=0x7fbbc802a0f0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.830+0000 7fbbe2a00640 1 -- 172.21.15.192:0/1981020797 shutdown_connections 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/1981020797 >> v2:172.21.15.194:3300/0 conn(0x7fbbdc159b70 0x7fbbdc159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/1981020797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc0b2c60 0x7fbbdc0b30b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7fbbe2a00640 1 -- 172.21.15.192:0/1981020797 >> 172.21.15.192:0/1981020797 conn(0x7fbbdc0734f0 msgr2=0x7fbbdc0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febd0004b60 con 0x7febdc0b3fd0 2024-09-13T18:35:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f0d65400640 1 --2- 172.21.15.192:0/4018043265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d601552d0 0x7f0d6015bca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d600b3820 tx=0x7f0d5402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd091b684dab34cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f0d5fe00640 1 -- 172.21.15.192:0/4018043265 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54032440 con 0x7f0d601552d0 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.830+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fb80129d0 con 0x7f8fc80d2980 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f8fbe000640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fa806acd0 0x7f8fa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fb8088da0 con 0x7f8fc80d2980 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f8fbe000640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f8fa8072e70 0x7f8fa8075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8fa8075940 con 0x7f8fa8072e70 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8fb8054010 con 0x7f8fc80d2980 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f0d5fe00640 1 -- 172.21.15.192:0/4018043265 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540325a0 con 0x7f0d601552d0 2024-09-13T18:35:50.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f0d5fe00640 1 -- 172.21.15.192:0/4018043265 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54032930 con 0x7f0d601552d0 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f3bc3400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bac06f0e0 0x7f3bac0715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bb8089590 con 0x7f3bcc0b0160 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f3bc3400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f3bac077300 0x7f3bac079720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3bac079dd0 con 0x7f3bac077300 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.831+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bb8089940 con 0x7f3bcc0b0160 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7f3bcb400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bac06f0e0 0x7f3bac0715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7febd9600640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febbc06acd0 0x7febbc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7f8fc5e00640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fa806acd0 0x7f8fa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febd00890d0 con 0x7febdc0b3fd0 2024-09-13T18:35:50.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7fbbe2a00640 1 -- 172.21.15.192:0/1981020797 shutdown_connections 2024-09-13T18:35:50.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f3bac077300 0x7f3bac079720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7f8fc6800640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f8fa8072e70 0x7f8fa8075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7fbbe2a00640 1 -- 172.21.15.192:0/1981020797 wait complete. 2024-09-13T18:35:50.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.832+0000 7febd9600640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7febbc072ef0 0x7febbc075310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7febbc0759c0 con 0x7febbc072ef0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7febd0089480 con 0x7febdc0b3fd0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7febe2200640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7febbc072ef0 0x7febbc075310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7febe0e00640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febbc06acd0 0x7febbc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.833+0000 7f3bcbe00640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f3bac077300 0x7f3bac079720 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.834+0000 7f8fc6800640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f8fa8072e70 0x7f8fa8075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.834+0000 7f8fc5e00640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fa806acd0 0x7f8fa806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4034000 tx=0x7f8fb402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.834+0000 7f0d67e00640 1 -- 172.21.15.192:0/4018043265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d601552d0 msgr2=0x7f0d6015bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.834+0000 7f0d67e00640 1 --2- 172.21.15.192:0/4018043265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d601552d0 0x7f0d6015bca0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0d600b3820 tx=0x7f0d5402a230 comp rx=0 tx=0).stop 2024-09-13T18:35:50.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.834+0000 7febe2200640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7febbc072ef0 0x7febbc075310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== osd.4 v2:172.21.15.194:6800/2064160374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f3bac079dd0 con 0x7f3bac077300 2024-09-13T18:35:50.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7febe0e00640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febbc06acd0 0x7febbc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 -- 172.21.15.192:0/4018043265 shutdown_connections 2024-09-13T18:35:50.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 --2- 172.21.15.192:0/4018043265 >> v2:172.21.15.192:3300/0 conn(0x7f0d600cddf0 0x7f0d600cf960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 --2- 172.21.15.192:0/4018043265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d601552d0 0x7f0d6015bca0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 -- 172.21.15.192:0/4018043265 >> 172.21.15.192:0/4018043265 conn(0x7f0d600b2bd0 msgr2=0x7f0d600b2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f3bcb400640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bac06f0e0 0x7f3bac0715a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06ed20 tx=0x7f3bbc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== osd.5 v2:172.21.15.194:6817/1215883585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f8fa8075940 con 0x7f8fa8072e70 2024-09-13T18:35:50.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 -- 172.21.15.192:0/4018043265 shutdown_connections 2024-09-13T18:35:50.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.835+0000 7f0d67e00640 1 -- 172.21.15.192:0/4018043265 wait complete. 2024-09-13T18:35:50.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.836+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== osd.3 v2:172.21.15.192:6800/2116235987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7febbc0759c0 con 0x7febbc072ef0 2024-09-13T18:35:50.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.836+0000 7fbbe2a00640 1 Processor -- start 2024-09-13T18:35:50.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.837+0000 7fbbe2a00640 1 -- start start 2024-09-13T18:35:50.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.838+0000 7f0d67e00640 1 Processor -- start 2024-09-13T18:35:50.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.838+0000 7f0d67e00640 1 -- start start 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.839+0000 7fbbe2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbdc0b2c60 0x7fbbdc13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.839+0000 7fbbe2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc142330 0x7fbbdc0ada50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.839+0000 7fbbe1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbdc0b2c60 0x7fbbdc13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7fbbe2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbdc159b70 0x7fbbdc0adf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7fbbe2a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1ee6c0 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7fbbe2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc1ef4c0 con 0x7fbbdc159b70 2024-09-13T18:35:50.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600cddf0 0x7f0d60159430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7fbbe2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbdc13d940 con 0x7fbbdc142330 2024-09-13T18:35:50.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 0x7f0d6014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.840+0000 7f0d67e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 0x7f0d601563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d65400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600cddf0 0x7f0d60159430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d65400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600cddf0 0x7f0d60159430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34878/0 (socket says 172.21.15.192:34878) 2024-09-13T18:35:50.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d64a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 0x7f0d6014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d64a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 0x7f0d6014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40082/0 (socket says 172.21.15.192:40082) 2024-09-13T18:35:50.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7fbbe0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc142330 0x7fbbdc0ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d65e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 0x7f0d601563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d65e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 0x7f0d601563b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57268/0 (socket says 172.21.15.192:57268) 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d65400640 1 -- 172.21.15.192:0/3658057404 learned_addr learned my addr 172.21.15.192:0/3658057404 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60159010 con 0x7f0d601552d0 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6015a790 con 0x7f0d600cddf0 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.841+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d60158410 con 0x7f0d600cfea0 2024-09-13T18:35:50.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe2000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbdc159b70 0x7fbbdc0adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc142330 0x7fbbdc0ada50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40074/0 (socket says 172.21.15.192:40074) 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe0c00640 1 -- 172.21.15.192:0/602558084 learned_addr learned my addr 172.21.15.192:0/602558084 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe1600640 1 -- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc142330 msgr2=0x7fbbdc0ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe1600640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbbdc142330 0x7fbbdc0ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe1600640 1 -- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbdc159b70 msgr2=0x7fbbdc0adf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe1600640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbbdc159b70 0x7fbbdc0adf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7fbbe1600640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd000ae30 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d65e00640 1 -- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 msgr2=0x7f0d6014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d65e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 0x7f0d6014e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d65e00640 1 -- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600cddf0 msgr2=0x7f0d60159430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d65e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d600cddf0 0x7f0d60159430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d65e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d540094d0 con 0x7f0d601552d0 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.842+0000 7f0d64a00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d600cfea0 0x7f0d6014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.843+0000 7f0d65e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 0x7f0d601563b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d58002210 tx=0x7f0d5800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.843+0000 7fbbe1600640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbdc0b2c60 0x7fbbdc13d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400cab0 tx=0x7fbbd400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58015030 con 0x7f0d601552d0 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d58003b70 con 0x7f0d601552d0 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58005070 con 0x7f0d601552d0 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd400ac30 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd400ad90 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4012600 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d601586b0 con 0x7f0d601552d0 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.844+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60158950 con 0x7f0d601552d0 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.845+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc8009400 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.845+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbdc1eeb90 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.847+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbbdc0cc220 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.849+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 --> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f139c0718a0 con 0x7f1378072e70 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.848+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d58018070 con 0x7f0d601552d0 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.849+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0d600ceb30 con 0x7f0d601552d0 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.850+0000 7f0d5d600640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d4006acd0 0x7f0d4006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.850+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d58016070 con 0x7f0d601552d0 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.850+0000 7f0d5d600640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f0d40072e70 0x7f0d40075290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.850+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0d40075940 con 0x7f0d40072e70 2024-09-13T18:35:50.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.851+0000 7f1393e00640 1 -- 172.21.15.192:0/298400158 <== osd.0 v2:172.21.15.192:6823/4155920616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1394001d10 con 0x7f1378072e70 2024-09-13T18:35:50.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.850+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbbd4007070 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.851+0000 7f0d65400640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d4006acd0 0x7f0d4006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.851+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d580016e0 con 0x7f0d601552d0 2024-09-13T18:35:50.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.851+0000 7f0d64a00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f0d40072e70 0x7f0d40075290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.852+0000 7f0d65400640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d4006acd0 0x7f0d4006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d540090b0 tx=0x7f0d5402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.852+0000 7f0d64a00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f0d40072e70 0x7f0d40075290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.852+0000 7fbbd9600640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbbbc06ce60 0x7fbbbc06f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.852+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f1378072e70 msgr2=0x7f1378075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f1378072e70 0x7f1378075290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f137806ac50 msgr2=0x7f137806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f137806ac50 0x7f137806d110 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f13840017d0 tx=0x7f1384009040 comp rx=0 tx=0).stop 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 msgr2=0x7f139c14eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 --2- 172.21.15.192:0/298400158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f139c146460 0x7f139c14eb10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f138c035040 tx=0x7f138c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a0a00640 1 -- 172.21.15.192:0/298400158 reap_dead start 2024-09-13T18:35:50.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 --> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7d64005c20 con 0x7f7d640015e0 2024-09-13T18:35:50.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbd4089630 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 shutdown_connections 2024-09-13T18:35:50.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 >> 172.21.15.192:0/298400158 conn(0x7f139c0b0f90 msgr2=0x7f139c13b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 shutdown_connections 2024-09-13T18:35:50.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== osd.7 v2:172.21.15.194:6816/4082236586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f0d40075940 con 0x7f0d40072e70 2024-09-13T18:35:50.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.853+0000 7f13a2a00640 1 -- 172.21.15.192:0/298400158 wait complete. 2024-09-13T18:35:50.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.854+0000 7f7d82a00640 1 -- 172.21.15.192:0/3723993269 <== osd.2 v2:172.21.15.192:6808/1589536644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7d64005c20 con 0x7f7d640015e0 2024-09-13T18:35:50.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.854+0000 7fbbe0c00640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbbbc06ce60 0x7fbbbc06f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.854+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f7d640015e0 msgr2=0x7f7d64003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.854+0000 7f7d91800640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f7d640015e0 0x7f7d64003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7fbbd9600640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7fbbbc075080 0x7fbbbc0774a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:50.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbbbc077b50 con 0x7fbbbc075080 2024-09-13T18:35:50.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f188ce00640 1 -- 172.21.15.192:0/3773733937 --> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f185c002cb0 con 0x7f1864072e70 2024-09-13T18:35:50.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbbd4089ad0 con 0x7fbbdc0b2c60 2024-09-13T18:35:50.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7fbbe0c00640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbbbc06ce60 0x7fbbbc06f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc06c580 tx=0x7fbbc802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d6806acd0 msgr2=0x7f7d6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f7d91800640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d6806acd0 0x7f7d6806d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d84037000 tx=0x7f7d8400b040 comp rx=0 tx=0).stop 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 msgr2=0x7f7d8c1404d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f7d91800640 1 --2- 172.21.15.192:0/3723993269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d8c158ea0 0x7f7d8c1404d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400c390 tx=0x7f7d7400c850 comp rx=0 tx=0).stop 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.855+0000 7f7d8b400640 1 -- 172.21.15.192:0/3723993269 reap_dead start 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f187ea00640 1 -- 172.21.15.192:0/3773733937 <== osd.1 v2:172.21.15.192:6816/4129826895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f185c002cb0 con 0x7f1864072e70 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7fbbe2000640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7fbbbc075080 0x7fbbbc0774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:50.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 shutdown_connections 2024-09-13T18:35:50.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 >> 172.21.15.192:0/3723993269 conn(0x7f7d8c0ae960 msgr2=0x7f7d8c0aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7f1864072e70 msgr2=0x7f1864075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 shutdown_connections 2024-09-13T18:35:50.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.856+0000 7f1877400640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7f1864072e70 0x7f1864075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186406acd0 msgr2=0x7f186406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186406acd0 0x7f186406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1878035000 tx=0x7f1878008030 comp rx=0 tx=0).stop 2024-09-13T18:35:50.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f7d91800640 1 -- 172.21.15.192:0/3723993269 wait complete. 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 msgr2=0x7f18880ade70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 --2- 172.21.15.192:0/3773733937 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f188806cae0 0x7f18880ade70 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f187000c460 tx=0x7f187000c920 comp rx=0 tx=0).stop 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1886800640 1 -- 172.21.15.192:0/3773733937 reap_dead start 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 shutdown_connections 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 >> 172.21.15.192:0/3773733937 conn(0x7f18880b0f90 msgr2=0x7f188815c060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 shutdown_connections 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.857+0000 7f1877400640 1 -- 172.21.15.192:0/3773733937 wait complete. 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.858+0000 7fbbe2000640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7fbbbc075080 0x7fbbbc0774a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:50.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.859+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== osd.6 v2:172.21.15.194:6808/3931263301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7fbbbc077b50 con 0x7fbbbc075080 2024-09-13T18:35:50.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.861+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 --> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febdc0d1320 con 0x7febbc072ef0 2024-09-13T18:35:50.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.862+0000 7febd9600640 1 -- 172.21.15.192:0/1677976323 <== osd.3 v2:172.21.15.192:6800/2116235987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febd4001b40 con 0x7febbc072ef0 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7febbc072ef0 msgr2=0x7febbc075310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7febbc072ef0 0x7febbc075310 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febbc06acd0 msgr2=0x7febbc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febbc06acd0 0x7febbc06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7febc8034000 tx=0x7febc802e000 comp rx=0 tx=0).stop 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 msgr2=0x7febdc1f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2c00640 1 --2- 172.21.15.192:0/1677976323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febdc0b3fd0 0x7febdc1f62e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7febd000c4d0 tx=0x7febd000c990 comp rx=0 tx=0).stop 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.864+0000 7febe2200640 1 -- 172.21.15.192:0/1677976323 reap_dead start 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.865+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 shutdown_connections 2024-09-13T18:35:50.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.865+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 >> 172.21.15.192:0/1677976323 conn(0x7febdc0b4900 msgr2=0x7febdc163b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.865+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 --> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3ba4002cb0 con 0x7f3bac077300 2024-09-13T18:35:50.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.866+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 --> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8fa0002cb0 con 0x7f8fa8072e70 2024-09-13T18:35:50.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.866+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 shutdown_connections 2024-09-13T18:35:50.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.866+0000 7febe2c00640 1 -- 172.21.15.192:0/1677976323 wait complete. 2024-09-13T18:35:50.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f3bc3400640 1 -- 172.21.15.192:0/2527310652 <== osd.4 v2:172.21.15.194:6800/2064160374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3ba4002cb0 con 0x7f3bac077300 2024-09-13T18:35:50.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f8fbe000640 1 -- 172.21.15.192:0/3870446952 <== osd.5 v2:172.21.15.194:6817/1215883585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8fa0002cb0 con 0x7f8fa8072e70 2024-09-13T18:35:50.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f8fa8072e70 msgr2=0x7f8fa8075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f8fa8072e70 0x7f8fa8075290 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f3bac077300 msgr2=0x7f3bac079720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f3bd2600640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f3bac077300 0x7f3bac079720 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fa806acd0 msgr2=0x7f8fa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.867+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fa806acd0 0x7f8fa806d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4034000 tx=0x7f8fb402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:50.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 msgr2=0x7f8fc80ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f8fcce00640 1 --2- 172.21.15.192:0/3870446952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fc80d2980 0x7f8fc80ccea0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800c490 tx=0x7f8fb800c950 comp rx=0 tx=0).stop 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f8fc6800640 1 -- 172.21.15.192:0/3870446952 reap_dead start 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bac06f0e0 msgr2=0x7f3bac0715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bac06f0e0 0x7f3bac0715a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc06ed20 tx=0x7f3bbc008040 comp rx=0 tx=0).stop 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0b0160 msgr2=0x7f3bcc13cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 --2- 172.21.15.192:0/2527310652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bcc0b0160 0x7f3bcc13cd70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc0ae930 tx=0x7f3bb800d980 comp rx=0 tx=0).stop 2024-09-13T18:35:50.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 shutdown_connections 2024-09-13T18:35:50.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 >> 172.21.15.192:0/3870446952 conn(0x7f8fc80d3000 msgr2=0x7f8fc80b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bcbe00640 1 -- 172.21.15.192:0/2527310652 reap_dead start 2024-09-13T18:35:50.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 shutdown_connections 2024-09-13T18:35:50.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.868+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 >> 172.21.15.192:0/2527310652 conn(0x7f3bcc0ae960 msgr2=0x7f3bcc0b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.869+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 shutdown_connections 2024-09-13T18:35:50.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.869+0000 7f8fcce00640 1 -- 172.21.15.192:0/3870446952 wait complete. 2024-09-13T18:35:50.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.869+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 shutdown_connections 2024-09-13T18:35:50.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.869+0000 7f3bd2600640 1 -- 172.21.15.192:0/2527310652 wait complete. 2024-09-13T18:35:50.904 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:35:50.905 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:35:50.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.885+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 --> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0d600ce850 con 0x7f0d40072e70 2024-09-13T18:35:50.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.886+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 --> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbbdc159320 con 0x7fbbbc075080 2024-09-13T18:35:50.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.886+0000 7f0d5d600640 1 -- 172.21.15.192:0/3658057404 <== osd.7 v2:172.21.15.194:6816/4082236586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0d4c016040 con 0x7f0d40072e70 2024-09-13T18:35:50.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.886+0000 7fbbd9600640 1 -- 172.21.15.192:0/602558084 <== osd.6 v2:172.21.15.194:6808/3931263301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbbd000a720 con 0x7fbbbc075080 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f0d40072e70 msgr2=0x7f0d40075290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f0d40072e70 0x7f0d40075290 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d4006acd0 msgr2=0x7f0d4006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d4006acd0 0x7f0d4006d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0d540090b0 tx=0x7f0d5402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 msgr2=0x7f0d601563b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 --2- 172.21.15.192:0/3658057404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d601552d0 0x7f0d601563b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0d58002210 tx=0x7f0d5800cb60 comp rx=0 tx=0).stop 2024-09-13T18:35:50.908 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d65e00640 1 -- 172.21.15.192:0/3658057404 reap_dead start 2024-09-13T18:35:50.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 shutdown_connections 2024-09-13T18:35:50.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 >> 172.21.15.192:0/3658057404 conn(0x7f0d600b2bd0 msgr2=0x7f0d6006e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:35:50.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7fbbbc075080 msgr2=0x7fbbbc0774a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7fbbbc075080 0x7fbbbc0774a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:50.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbbbc06ce60 msgr2=0x7fbbbc06f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbbbc06ce60 0x7fbbbc06f320 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc06c580 tx=0x7fbbc802e000 comp rx=0 tx=0).stop 2024-09-13T18:35:50.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbdc0b2c60 msgr2=0x7fbbdc13d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:50.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2a00640 1 --2- 172.21.15.192:0/602558084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbdc0b2c60 0x7fbbdc13d400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fbbd400cab0 tx=0x7fbbd400cf70 comp rx=0 tx=0).stop 2024-09-13T18:35:50.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7fbbe2000640 1 -- 172.21.15.192:0/602558084 reap_dead start 2024-09-13T18:35:50.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.887+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 shutdown_connections 2024-09-13T18:35:50.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.888+0000 7f0d67e00640 1 -- 172.21.15.192:0/3658057404 wait complete. 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.888+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 shutdown_connections 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.888+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 >> 172.21.15.192:0/602558084 conn(0x7fbbdc0734f0 msgr2=0x7fbbdc0b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.888+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 shutdown_connections 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:50.888+0000 7fbbe2a00640 1 -- 172.21.15.192:0/602558084 wait complete. 2024-09-13T18:35:50.911 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.912 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:35:50.912 INFO:teuthology.orchestra.run.smithi192.stdout:60129542152 2024-09-13T18:35:50.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:35:50.913 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.914 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:35:50.915 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:35:50.916 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:50.916 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:35:51.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.211+0000 7fcab9a00640 1 Processor -- start 2024-09-13T18:35:51.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.211+0000 7fcab9a00640 1 -- start start 2024-09-13T18:35:51.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.213+0000 7fcab9a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcaac055170 0x7fcaac04f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.213+0000 7fcab9a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0395f0 con 0x7fcaac00a4b0 2024-09-13T18:35:51.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.213+0000 7fcab9a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaac0398d0 con 0x7fcaac0366f0 2024-09-13T18:35:51.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.213+0000 7fcab9a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaac039bb0 con 0x7fcaac055170 2024-09-13T18:35:51.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.214+0000 7fcab3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcaac055170 0x7fcaac04f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.214+0000 7fcab3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcaac055170 0x7fcaac04f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57274/0 (socket says 172.21.15.192:57274) 2024-09-13T18:35:51.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.214+0000 7fcab3400640 1 -- 172.21.15.192:0/1647246478 learned_addr learned my addr 172.21.15.192:0/1647246478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.215+0000 7ff9b4000640 1 Processor -- start 2024-09-13T18:35:51.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.215+0000 7ff9b4000640 1 -- start start 2024-09-13T18:35:51.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.216+0000 7f5de8e00640 1 Processor -- start 2024-09-13T18:35:51.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.216+0000 7f5de8e00640 1 -- start start 2024-09-13T18:35:51.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.216+0000 7fcab3400640 1 -- 172.21.15.192:0/1647246478 >> v1:172.21.15.194:6789/0 conn(0x7fcaac0366f0 legacy=0x7fcaac04ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.216+0000 7fcab3400640 1 -- 172.21.15.192:0/1647246478 >> v1:172.21.15.192:6789/0 conn(0x7fcaac00a4b0 legacy=0x7fcaac035fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.216+0000 7fcab3400640 1 -- 172.21.15.192:0/1647246478 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaac039e90 con 0x7fcaac055170 2024-09-13T18:35:51.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7fcab3400640 1 --2- 172.21.15.192:0/1647246478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac055170 0x7fcaac04f610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcab4068fd0 tx=0x7fcab40a4b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e7aeba0d61f880 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 0x7f5de415b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7f5de8e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5de406c1b0 0x7f5de406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7ff9b4000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff9ac160410 0x7ff9ac0b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7ff9b4000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0b4190 0x7ff9ac0b5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7ff9b4000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ac0b2790 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7f5de3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5de40cd7b0 0x7f5de4070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54148/0 (socket says 172.21.15.192:54148) 2024-09-13T18:35:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7f5de3e00640 1 -- 172.21.15.192:0/2425287464 learned_addr learned my addr 172.21.15.192:0/2425287464 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7fcab1600640 1 -- 172.21.15.192:0/1647246478 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab40a6990 con 0x7fcaac055170 2024-09-13T18:35:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7fcab1600640 1 -- 172.21.15.192:0/1647246478 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcab40a6b30 con 0x7fcaac055170 2024-09-13T18:35:51.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7fcab1600640 1 -- 172.21.15.192:0/1647246478 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab40ae420 con 0x7fcaac055170 2024-09-13T18:35:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de406ad50 con 0x7f5de40cd7b0 2024-09-13T18:35:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de40707f0 con 0x7f5de406c1b0 2024-09-13T18:35:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de406afd0 con 0x7f5de4144600 2024-09-13T18:35:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7ff9b4000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ce410 con 0x7ff9ac160410 2024-09-13T18:35:51.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.218+0000 7ff9b4000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1607f0 con 0x7ff9ac0b4190 2024-09-13T18:35:51.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7ff9b0c00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff9ac0b21b0 0x7ff9ac0b3a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55036/0 (socket says 172.21.15.192:55036) 2024-09-13T18:35:51.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7f5de3400640 1 --2- 172.21.15.192:0/2425287464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 0x7f5de415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7ff9b0c00640 1 -- 172.21.15.192:0/115300423 learned_addr learned my addr 172.21.15.192:0/115300423 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:51.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3021408562 0 0) 0x7ff9ac0b2790 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff994003520 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.219+0000 7f5de2a00640 1 --2- 172.21.15.192:0/2425287464 >> v2:172.21.15.194:3300/0 conn(0x7f5de406c1b0 0x7f5de406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7f5de3400640 1 -- 172.21.15.192:0/2425287464 >> v2:172.21.15.194:3300/0 conn(0x7f5de406c1b0 msgr2=0x7f5de406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7f5de3400640 1 --2- 172.21.15.192:0/2425287464 >> v2:172.21.15.194:3300/0 conn(0x7f5de406c1b0 0x7f5de406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7f5de3400640 1 -- 172.21.15.192:0/2425287464 >> v1:172.21.15.192:6789/0 conn(0x7f5de40cd7b0 legacy=0x7f5de4070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7f5de3400640 1 -- 172.21.15.192:0/2425287464 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de406b2b0 con 0x7f5de4144600 2024-09-13T18:35:51.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9b2000640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0b4190 0x7ff9ac0b5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809574409 0 0) 0x7ff994003520 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0b4190 msgr2=0x7ff9ac0b5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0b4190 0x7ff9ac0b5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 >> v2:172.21.15.194:3300/0 conn(0x7ff9ac160410 msgr2=0x7ff9ac0b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9b1600640 1 --2- 172.21.15.192:0/115300423 >> v2:172.21.15.194:3300/0 conn(0x7ff9ac160410 0x7ff9ac0b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 --2- 172.21.15.192:0/115300423 >> v2:172.21.15.194:3300/0 conn(0x7ff9ac160410 0x7ff9ac0b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7fcab9a00640 1 -- 172.21.15.192:0/1647246478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac055170 msgr2=0x7fcaac04f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7fcab9a00640 1 --2- 172.21.15.192:0/1647246478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac055170 0x7fcaac04f610 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcab4068fd0 tx=0x7fcab40a4b70 comp rx=0 tx=0).stop 2024-09-13T18:35:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0b29e0 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7fcab9a00640 1 -- 172.21.15.192:0/1647246478 shutdown_connections 2024-09-13T18:35:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7fcab9a00640 1 --2- 172.21.15.192:0/1647246478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac055170 0x7fcaac04f610 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7ff9a0001670 con 0x7ff9ac0b21b0 2024-09-13T18:35:51.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.220+0000 7fcab9a00640 1 -- 172.21.15.192:0/1647246478 >> 172.21.15.192:0/1647246478 conn(0x7fcaac01d8f0 msgr2=0x7fcaac054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 >> v1:172.21.15.194:6789/0 conn(0x7ff9ac0b21b0 legacy=0x7ff9ac0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7fcab9a00640 1 -- 172.21.15.192:0/1647246478 shutdown_connections 2024-09-13T18:35:51.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff994003970 0x7ff994003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9940047c0 0x7ff994004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994005180 0x7ff99400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac1607f0 con 0x7ff994005180 2024-09-13T18:35:51.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99400bf70 con 0x7ff9940047c0 2024-09-13T18:35:51.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7ff9b1600640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff994003970 0x7ff994003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.222+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99400c100 con 0x7ff994003970 2024-09-13T18:35:51.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.222+0000 7ff9b0c00640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9940047c0 0x7ff994004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.221+0000 7fcab9a00640 1 -- 172.21.15.192:0/1647246478 wait complete. 2024-09-13T18:35:51.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b2000640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994005180 0x7ff99400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b1600640 1 -- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9940047c0 msgr2=0x7ff994004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b1600640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9940047c0 0x7ff994004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7fcab9a00640 1 Processor -- start 2024-09-13T18:35:51.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b1600640 1 -- 172.21.15.192:0/115300423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994005180 msgr2=0x7ff99400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b1600640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994005180 0x7ff99400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7fcab9a00640 1 -- start start 2024-09-13T18:35:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.223+0000 7ff9b1600640 1 -- 172.21.15.192:0/115300423 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994003520 con 0x7ff994003970 2024-09-13T18:35:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7f5de3400640 1 --2- 172.21.15.192:0/2425287464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 0x7f5de415b070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009d90 tx=0x7f5ddc02ea00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3472a9a9d6214d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7f5de2000640 1 -- 172.21.15.192:0/2425287464 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc033860 con 0x7f5de4144600 2024-09-13T18:35:51.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7f5de2000640 1 -- 172.21.15.192:0/2425287464 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0339c0 con 0x7f5de4144600 2024-09-13T18:35:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7f5de2000640 1 -- 172.21.15.192:0/2425287464 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc033d30 con 0x7f5de4144600 2024-09-13T18:35:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7ff9b2000640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994005180 0x7ff99400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7fb75be00640 1 Processor -- start 2024-09-13T18:35:51.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.224+0000 7fb75be00640 1 -- start start 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 0x7fcaac04e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 0x7fcaac0cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 0x7fcaac032650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac032b90 con 0x7fcaac0366f0 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac04d870 con 0x7fcaac0321a0 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7fcab9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaac0d2490 con 0x7fcaac055170 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 msgr2=0x7f5de415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2425287464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 0x7f5de415b070 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc009d90 tx=0x7f5ddc02ea00 comp rx=0 tx=0).stop 2024-09-13T18:35:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.225+0000 7ff9b1600640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff994003970 0x7ff994003d50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a9d0 tx=0x7ff9940057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a522464a45e2e5f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 shutdown_connections 2024-09-13T18:35:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c0d1c80 0x7fb75c0b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75be00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb75c0cd3c0 0x7fb75c0cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2425287464 >> v2:172.21.15.194:3300/0 conn(0x7f5de406c1b0 0x7f5de406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2425287464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de4144600 0x7f5de415b070 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb75c0b3360 con 0x7fb75c15ce40 2024-09-13T18:35:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75be00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb75c0cdd90 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0b4120 con 0x7fb75c0d1c80 2024-09-13T18:35:51.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fcab3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 0x7fcaac032650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fcab3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 0x7fcaac032650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34928/0 (socket says 172.21.15.192:34928) 2024-09-13T18:35:51.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 >> 172.21.15.192:0/2425287464 conn(0x7f5de40734f0 msgr2=0x7f5de40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fcab3400640 1 -- 172.21.15.192:0/499532766 learned_addr learned my addr 172.21.15.192:0/499532766 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fcab2000640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 0x7fcaac0cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 shutdown_connections 2024-09-13T18:35:51.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fcab2a00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 0x7fcaac04e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99802abc0 con 0x7ff994003970 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7f5de8e00640 1 -- 172.21.15.192:0/2425287464 wait complete. 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb75c0cd3c0 0x7fb75c0cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb75c0cd3c0 0x7fb75c0cd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34940/0 (socket says 172.21.15.192:34940) 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7fb75b400640 1 -- 172.21.15.192:0/2885997122 learned_addr learned my addr 172.21.15.192:0/2885997122 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fb75b400640 1 -- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c0d1c80 msgr2=0x7fb75c0b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fb75b400640 1 --2- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c0d1c80 0x7fb75c0b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fb75b400640 1 -- 172.21.15.192:0/2885997122 >> v1:172.21.15.194:6789/0 conn(0x7fb75c15ce40 legacy=0x7fb75c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fb75b400640 1 -- 172.21.15.192:0/2885997122 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0b35a0 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.226+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99802ad20 con 0x7ff994003970 2024-09-13T18:35:51.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2000640 1 -- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 msgr2=0x7fcaac032650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2000640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 0x7fcaac032650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7ff9abe00640 1 -- 172.21.15.192:0/115300423 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff998032640 con 0x7ff994003970 2024-09-13T18:35:51.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2000640 1 -- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 msgr2=0x7fcaac04e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2000640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 0x7fcaac04e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2000640 1 -- 172.21.15.192:0/499532766 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab4072850 con 0x7fcaac055170 2024-09-13T18:35:51.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7fcab2a00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 0x7fcaac04e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7ff9b4000640 1 -- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff994003970 msgr2=0x7ff994003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7ff9b4000640 1 --2- 172.21.15.192:0/115300423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff994003970 0x7ff994003d50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a9d0 tx=0x7ff9940057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.227+0000 7ff9b2000640 1 -- 172.21.15.192:0/115300423 reap_dead start 2024-09-13T18:35:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7fcab2000640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 0x7fcaac0cedc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c3c0 tx=0x7fcaa400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7ff9b4000640 1 -- 172.21.15.192:0/115300423 shutdown_connections 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7ff9b4000640 1 -- 172.21.15.192:0/115300423 >> 172.21.15.192:0/115300423 conn(0x7ff9ac0b4920 msgr2=0x7ff9ac0b4d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7ff9b4000640 1 -- 172.21.15.192:0/115300423 shutdown_connections 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40052d0 con 0x7fcaac055170 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa4005430 con 0x7fcaac055170 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa4003830 con 0x7fcaac055170 2024-09-13T18:35:51.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.229+0000 7fcab9a00640 1 -- 172.21.15.192:0/499532766 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaac04e0f0 con 0x7fcaac055170 2024-09-13T18:35:51.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.229+0000 7fcab9a00640 1 -- 172.21.15.192:0/499532766 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaac04daa0 con 0x7fcaac055170 2024-09-13T18:35:51.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.228+0000 7ff9b4000640 1 -- 172.21.15.192:0/115300423 wait complete. 2024-09-13T18:35:51.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7f5de8e00640 1 Processor -- start 2024-09-13T18:35:51.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7fe8f5000640 1 Processor -- start 2024-09-13T18:35:51.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7fb75b400640 1 --2- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c0cd850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb754009e50 tx=0x7fb75402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8b7f59607d8e9207 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7f5de8e00640 1 -- start start 2024-09-13T18:35:51.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7ff9b4000640 1 Processor -- start 2024-09-13T18:35:51.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.231+0000 7ff9b4000640 1 -- start start 2024-09-13T18:35:51.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.231+0000 7fcab9a00640 1 -- 172.21.15.192:0/499532766 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaac04e280 con 0x7fcaac055170 2024-09-13T18:35:51.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 0x7f5de4139eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 0x7f5de413a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415b980 con 0x7f5de4144600 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415bbd0 con 0x7f5de406c1b0 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7f5de8e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de415beb0 con 0x7f5de40cd7b0 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcaa4003990 con 0x7fcaac055170 2024-09-13T18:35:51.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7fb759600640 1 -- 172.21.15.192:0/2885997122 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75402aea0 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7fb759600640 1 -- 172.21.15.192:0/2885997122 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75402d050 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.232+0000 7fb759600640 1 -- 172.21.15.192:0/2885997122 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb754031820 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.230+0000 7fe8f5000640 1 -- start start 2024-09-13T18:35:51.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7f5de3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7f5de3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34944/0 (socket says 172.21.15.192:34944) 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7f5de3400640 1 -- 172.21.15.192:0/2828698139 learned_addr learned my addr 172.21.15.192:0/2828698139 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7f5de2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 0x7f5de4139eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7f5de3e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 0x7f5de413a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7fcaaaa00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 0x7fca9406d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f00b0460 0x7fe8f016bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7fe8f5000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00b2de0 con 0x7fe8f01615d0 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fb75be00640 1 -- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 msgr2=0x7fb75c0cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fb75be00640 1 --2- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c0cd850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fb754009e50 tx=0x7fb75402a680 comp rx=0 tx=0).stop 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8f5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f00b2540 con 0x7fe8f01611f0 2024-09-13T18:35:51.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8f5000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00b2820 con 0x7fe8f00b0460 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcaa40887e0 con 0x7fcaac055170 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0cb120 0x7ff9ac0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0cb5a0 0x7ff9ac0d1220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0cac90 con 0x7ff9ac0cb120 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ca080 con 0x7ff994003970 2024-09-13T18:35:51.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.233+0000 7ff9b4000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ca360 con 0x7ff9ac0cb5a0 2024-09-13T18:35:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8ede00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe8f01611f0 0x7fe8f00b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55054/0 (socket says 172.21.15.192:55054) 2024-09-13T18:35:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8ede00640 1 -- 172.21.15.192:0/2595232156 learned_addr learned my addr 172.21.15.192:0/2595232156 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7ff9b1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34946/0 (socket says 172.21.15.192:34946) 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7ff9b1600640 1 -- 172.21.15.192:0/3156136803 learned_addr learned my addr 172.21.15.192:0/3156136803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153563129 0 0) 0x7fe8f00b2540 con 0x7fe8f01611f0 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.234+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8d4003520 con 0x7fe8f01611f0 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987884867 0 0) 0x7fe8f00b2de0 con 0x7fe8f01615d0 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 -- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0cb5a0 msgr2=0x7ff9ac0d1220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:35:51.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0cb5a0 0x7ff9ac0d1220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 -- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0cb120 msgr2=0x7ff9ac0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0cb120 0x7ff9ac0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 -- 172.21.15.192:0/3156136803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0ca640 con 0x7ff994003970 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8f00b2540 con 0x7fe8f01615d0 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fb75be00640 1 -- 172.21.15.192:0/2885997122 shutdown_connections 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fb75be00640 1 --2- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c0cd850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fb75be00640 1 --2- 172.21.15.192:0/2885997122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c0d1c80 0x7fb75c0b53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fb75be00640 1 -- 172.21.15.192:0/2885997122 >> 172.21.15.192:0/2885997122 conn(0x7fb75c0b4860 msgr2=0x7fb75c0b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8ee800640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f00b0460 0x7fe8f016bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7ff9b1600640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a120 tx=0x7ff998004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2963702364 0 0) 0x7fe8d4003520 con 0x7fe8f01611f0 2024-09-13T18:35:51.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f00b0460 msgr2=0x7fe8f016bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f00b0460 0x7fe8f016bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 >> v1:172.21.15.192:6789/0 conn(0x7fe8f01615d0 legacy=0x7fe8f00afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f00b2b00 con 0x7fe8f01611f0 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe8dc001670 con 0x7fe8f01611f0 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 >> v1:172.21.15.194:6789/0 conn(0x7fe8f01611f0 legacy=0x7fe8f00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8d4003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d40047c0 0x7fe8d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d40052a0 0x7fe8d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f00b2820 con 0x7fe8d40047c0 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400c120 con 0x7fe8d4003b00 2024-09-13T18:35:51.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d400c2e0 con 0x7fe8d40052a0 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7fb75be00640 1 -- 172.21.15.192:0/2885997122 shutdown_connections 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de3e00640 1 -- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 msgr2=0x7f5de4139eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de3e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 0x7f5de4139eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de3e00640 1 -- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 msgr2=0x7f5de415d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de3e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de3e00640 1 -- 172.21.15.192:0/2828698139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ddc009a70 con 0x7f5de4144600 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.235+0000 7f5de2a00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 0x7f5de4139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7f5de3400640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99803e650 con 0x7ff994003970 2024-09-13T18:35:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99802ae90 con 0x7ff994003970 2024-09-13T18:35:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99803ea10 con 0x7ff994003970 2024-09-13T18:35:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7fe8ee800640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f00b0460 0x7fe8f016bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:51.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7fe8ede00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8d4003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac0ca920 con 0x7ff994003970 2024-09-13T18:35:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac0c75a0 con 0x7ff994003970 2024-09-13T18:35:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7fe8ee800640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d40052a0 0x7fe8d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7f5de3e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 0x7f5de413a3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c3c0 tx=0x7f5dd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.236+0000 7fb75be00640 1 -- 172.21.15.192:0/2885997122 wait complete. 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0005ce0 con 0x7f5de4144600 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fe8ede00640 1 -- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d40052a0 msgr2=0x7fe8d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fe8ede00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d40052a0 0x7fe8d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fe8ede00640 1 -- 172.21.15.192:0/2595232156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d40047c0 msgr2=0x7fe8d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fe8ede00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d40047c0 0x7fe8d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fe8ede00640 1 -- 172.21.15.192:0/2595232156 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d4003520 con 0x7fe8d4003b00 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7fcab2a00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 0x7fca9406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de415c190 con 0x7f5de4144600 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.237+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de415c990 con 0x7f5de4144600 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.238+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd0005e40 con 0x7f5de4144600 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.238+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0005ce0 con 0x7f5de4144600 2024-09-13T18:35:51.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.238+0000 7fb75be00640 1 Processor -- start 2024-09-13T18:35:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.238+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac0caab0 con 0x7ff994003970 2024-09-13T18:35:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.238+0000 7fb75be00640 1 -- start start 2024-09-13T18:35:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.239+0000 7fcab2a00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 0x7fca9406d110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0001bc0 tx=0x7fcaa0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb75c0d1c80 0x7fb75c0c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 0x7fb75c0c7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0c8ee0 con 0x7fb75c0d1c80 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c0c7be0 con 0x7fb75c0cd3c0 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb75c06af20 con 0x7fb75c15ce40 2024-09-13T18:35:51.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff99803eb70 con 0x7ff994003970 2024-09-13T18:35:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34960/0 (socket says 172.21.15.192:34960) 2024-09-13T18:35:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75aa00640 1 -- 172.21.15.192:0/1908401687 learned_addr learned my addr 172.21.15.192:0/1908401687 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75a000640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb75c0d1c80 0x7fb75c0c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.240+0000 7fb75b400640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 0x7fb75c0c7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcaa4053a50 con 0x7fcaac055170 2024-09-13T18:35:51.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75b400640 1 -- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 msgr2=0x7fb75c1506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75b400640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75b400640 1 -- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb75c0d1c80 msgr2=0x7fb75c0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75b400640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb75c0d1c80 0x7fb75c0c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75b400640 1 -- 172.21.15.192:0/1908401687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb754009b30 con 0x7fb75c15ce40 2024-09-13T18:35:51.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7ff9a9600640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 0x7ff98c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.242+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dbc005250 con 0x7f5de4144600 2024-09-13T18:35:51.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5dd00070d0 con 0x7f5de4144600 2024-09-13T18:35:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9980a9b20 con 0x7ff994003970 2024-09-13T18:35:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.242+0000 7ff9b0c00640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 0x7ff98c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.241+0000 7fb75aa00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.242+0000 7fb75b400640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 0x7fb75c0c7280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb754030000 tx=0x7fb754004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.242+0000 7fe8ede00640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8d4003f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc007f90 tx=0x7fe8d40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f1dd09b2081528 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75403d860 con 0x7fb75c15ce40 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75403d9e0 con 0x7fb75c15ce40 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75403dd90 con 0x7fb75c15ce40 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb75c0c7900 con 0x7fb75c15ce40 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb75c0c8b00 con 0x7fb75c15ce40 2024-09-13T18:35:51.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.243+0000 7ff9b0c00640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 0x7ff98c06d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0004870 tx=0x7ff9a0000f50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.244+0000 7f1381000640 1 Processor -- start 2024-09-13T18:35:51.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.244+0000 7f1381000640 1 -- start start 2024-09-13T18:35:51.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.245+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb734005250 con 0x7fb75c15ce40 2024-09-13T18:35:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.245+0000 7f5ddb400640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 0x7f5dc406d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc005ad0 con 0x7fe8d4003b00 2024-09-13T18:35:51.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.245+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dd00882f0 con 0x7f5de4144600 2024-09-13T18:35:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc02d070 con 0x7fe8d4003b00 2024-09-13T18:35:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7fe8eca00640 1 -- 172.21.15.192:0/2595232156 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc005e90 con 0x7fe8d4003b00 2024-09-13T18:35:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f5de3400640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 0x7f5dc406d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f0694a00640 1 Processor -- start 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f1381000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 0x7f137c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f1381000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f1381000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f137c0cd570 con 0x7f137c0b3c60 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f1381000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f137c0cd7a0 con 0x7f137c0cb490 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.246+0000 7f1381000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c0cda80 con 0x7f137c0b0460 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f137a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f137a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40178/0 (socket says 172.21.15.192:40178) 2024-09-13T18:35:51.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f137a800640 1 -- 172.21.15.192:0/302204335 learned_addr learned my addr 172.21.15.192:0/302204335 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f5de3400640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 0x7f5dc406d120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc02ea40 tx=0x7f5ddc034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f1379e00640 1 --2- 172.21.15.192:0/302204335 >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 0x7f137c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 -- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 msgr2=0x7fe8d4003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 --2- 172.21.15.192:0/2595232156 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8d4003f00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc007f90 tx=0x7fe8d40057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8ee800640 1 -- 172.21.15.192:0/2595232156 reap_dead start 2024-09-13T18:35:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.247+0000 7f0694a00640 1 -- start start 2024-09-13T18:35:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff998074c50 con 0x7ff994003970 2024-09-13T18:35:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7f137a800640 1 -- 172.21.15.192:0/302204335 >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 msgr2=0x7f137c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb75403b400 con 0x7fb75c15ce40 2024-09-13T18:35:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 -- 172.21.15.192:0/2595232156 shutdown_connections 2024-09-13T18:35:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 -- 172.21.15.192:0/2595232156 >> 172.21.15.192:0/2595232156 conn(0x7fe8f00ae960 msgr2=0x7fe8f006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 -- 172.21.15.192:0/2595232156 shutdown_connections 2024-09-13T18:35:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.249+0000 7fb752a00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 0x7fb73c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.249+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7540a9ea0 con 0x7fb75c15ce40 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7fe8f5000640 1 -- 172.21.15.192:0/2595232156 wait complete. 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7f137a800640 1 --2- 172.21.15.192:0/302204335 >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 0x7f137c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7f137a800640 1 -- 172.21.15.192:0/302204335 >> v1:172.21.15.192:6789/0 conn(0x7f137c0b3c60 legacy=0x7f137c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.248+0000 7f137a800640 1 -- 172.21.15.192:0/302204335 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0cdd60 con 0x7f137c0b0460 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.250+0000 7f0694a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f069013fd70 0x7f06900b7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.250+0000 7f0694a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0690140150 0x7f0690140640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.250+0000 7f1379e00640 1 --2- 172.21.15.192:0/302204335 >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 0x7f137c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f0694a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069015e4b0 con 0x7f0690140b80 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f0694a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06900b6fd0 con 0x7f069013fd70 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f0694a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0690141030 con 0x7f0690140150 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f068e800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0690140b80 0x7f06900d22d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54174/0 (socket says 172.21.15.192:54174) 2024-09-13T18:35:51.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f068e800640 1 -- 172.21.15.192:0/3855510932 learned_addr learned my addr 172.21.15.192:0/3855510932 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f137a800640 1 --2- 172.21.15.192:0/302204335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098d0 tx=0x7f136c02c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c33daecb03251e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7fb75aa00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 0x7fb73c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7fe8f5000640 1 Processor -- start 2024-09-13T18:35:51.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7fe8f5000640 1 -- start start 2024-09-13T18:35:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.251+0000 7f068de00640 1 --2- 172.21.15.192:0/3855510932 >> v2:172.21.15.192:3300/0 conn(0x7f069013fd70 0x7f06900b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f1378a00640 1 -- 172.21.15.192:0/302204335 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031710 con 0x7f137c0b0460 2024-09-13T18:35:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f1378a00640 1 -- 172.21.15.192:0/302204335 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c02f050 con 0x7f137c0b0460 2024-09-13T18:35:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f1378a00640 1 -- 172.21.15.192:0/302204335 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031ab0 con 0x7f137c0b0460 2024-09-13T18:35:51.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f068d400640 1 --2- 172.21.15.192:0/3855510932 >> v2:172.21.15.194:3300/0 conn(0x7f0690140150 0x7f0690140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.250+0000 7f4804c00640 1 Processor -- start 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.250+0000 7f4804c00640 1 -- start start 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f4804c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f48000b3d50 0x7f48000b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f4804c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48001616b0 con 0x7f48001612d0 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f4804c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f480006e8d0 con 0x7f48000b0490 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f4804c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48000b4190 con 0x7f48000b3d50 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f47fd400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f48000b0490 0x7f480006ed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55058/0 (socket says 172.21.15.192:55058) 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f47fd400640 1 -- 172.21.15.192:0/345909207 learned_addr learned my addr 172.21.15.192:0/345909207 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f47fe800640 1 --2- 172.21.15.192:0/345909207 >> v2:172.21.15.194:3300/0 conn(0x7f48000b3d50 0x7f48000b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7f47fca00640 1 -- 172.21.15.192:0/345909207 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946265918 0 0) 0x7f480006e8d0 con 0x7f48000b0490 2024-09-13T18:35:51.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f47fca00640 1 -- 172.21.15.192:0/345909207 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47e4003520 con 0x7f48000b0490 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f47fe800640 1 -- 172.21.15.192:0/345909207 >> v1:172.21.15.194:6789/0 conn(0x7f48000b0490 legacy=0x7f480006ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f47fe800640 1 -- 172.21.15.192:0/345909207 >> v1:172.21.15.192:6789/0 conn(0x7f48001612d0 legacy=0x7f48000afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f47fe800640 1 -- 172.21.15.192:0/345909207 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000b23f0 con 0x7f48000b3d50 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7fe8f5000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f0156ef0 0x7fe8f0159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f47fe800640 1 --2- 172.21.15.192:0/345909207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f48000b1cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009d90 tx=0x7f47f802a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59474944491a9d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.252+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7540750f0 con 0x7fb75c15ce40 2024-09-13T18:35:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7fe8ede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f47fca00640 1 -- 172.21.15.192:0/345909207 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8007740 con 0x7f48000b3d50 2024-09-13T18:35:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f47fca00640 1 -- 172.21.15.192:0/345909207 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f802d050 con 0x7f48000b3d50 2024-09-13T18:35:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f47fca00640 1 -- 172.21.15.192:0/345909207 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8007ac0 con 0x7f48000b3d50 2024-09-13T18:35:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f1381000640 1 -- 172.21.15.192:0/302204335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 msgr2=0x7f137c1637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7fe8ede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:34998/0 (socket says 172.21.15.192:34998) 2024-09-13T18:35:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f068de00640 1 -- 172.21.15.192:0/3855510932 >> v2:172.21.15.194:3300/0 conn(0x7f0690140150 msgr2=0x7f0690140640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f068de00640 1 --2- 172.21.15.192:0/3855510932 >> v2:172.21.15.194:3300/0 conn(0x7f0690140150 0x7f0690140640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f068de00640 1 -- 172.21.15.192:0/3855510932 >> v1:172.21.15.192:6789/0 conn(0x7f0690140b80 legacy=0x7f06900d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f068de00640 1 -- 172.21.15.192:0/3855510932 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069015e1d0 con 0x7f069013fd70 2024-09-13T18:35:51.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.253+0000 7f1381000640 1 --2- 172.21.15.192:0/302204335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f136c0098d0 tx=0x7f136c02c440 comp rx=0 tx=0).stop 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f1381000640 1 -- 172.21.15.192:0/302204335 shutdown_connections 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f1381000640 1 --2- 172.21.15.192:0/302204335 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c0b0460 0x7f137c1637c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f1381000640 1 --2- 172.21.15.192:0/302204335 >> v2:172.21.15.192:3300/0 conn(0x7f137c0cb490 0x7f137c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.254+0000 7f1381000640 1 -- 172.21.15.192:0/302204335 >> 172.21.15.192:0/302204335 conn(0x7f137c0ae960 msgr2=0x7f137c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7f1381000640 1 -- 172.21.15.192:0/302204335 shutdown_connections 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7f1381000640 1 -- 172.21.15.192:0/302204335 wait complete. 2024-09-13T18:35:51.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7fe8f5000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0200bd0 con 0x7fe8f0156a70 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7fe8ed400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57348/0 (socket says 172.21.15.192:57348) 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7f4804c00640 1 -- 172.21.15.192:0/345909207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 msgr2=0x7f48000b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.255+0000 7f4804c00640 1 --2- 172.21.15.192:0/345909207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f48000b1cf0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009d90 tx=0x7f47f802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f4804c00640 1 -- 172.21.15.192:0/345909207 shutdown_connections 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f4804c00640 1 --2- 172.21.15.192:0/345909207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f48000b1cf0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f4804c00640 1 -- 172.21.15.192:0/345909207 >> 172.21.15.192:0/345909207 conn(0x7f48000ae960 msgr2=0x7f480006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7fb75aa00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 0x7fb73c06d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb74c007fd0 tx=0x7fb74c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7fe8ed400640 1 -- 172.21.15.192:0/152924252 learned_addr learned my addr 172.21.15.192:0/152924252 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f0203e50 con 0x7fe8d4003b00 2024-09-13T18:35:51.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f015b3b0 con 0x7fe8f0156ef0 2024-09-13T18:35:51.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f4804c00640 1 -- 172.21.15.192:0/345909207 shutdown_connections 2024-09-13T18:35:51.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f4804c00640 1 -- 172.21.15.192:0/345909207 wait complete. 2024-09-13T18:35:51.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.256+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5dd0053570 con 0x7f5de4144600 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ee800640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f0156ef0 0x7fe8f0159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ede00640 1 -- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f0156ef0 msgr2=0x7fe8f0159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ede00640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f0156ef0 0x7fe8f0159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ede00640 1 -- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 msgr2=0x7fe8f01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ede00640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ede00640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f015b690 con 0x7fe8d4003b00 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.257+0000 7fe8ed400640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7fe8ede00640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc02f000 tx=0x7fe8dc001930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7f1381000640 1 Processor -- start 2024-09-13T18:35:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc005bc0 con 0x7fe8d4003b00 2024-09-13T18:35:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7f1381000640 1 -- start start 2024-09-13T18:35:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f015b970 con 0x7fe8d4003b00 2024-09-13T18:35:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f02033b0 con 0x7fe8d4003b00 2024-09-13T18:35:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8dc005d20 con 0x7fe8d4003b00 2024-09-13T18:35:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc005bc0 con 0x7fe8d4003b00 2024-09-13T18:35:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.258+0000 7f068de00640 1 --2- 172.21.15.192:0/3855510932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f06900b7460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0690154600 tx=0x7f068802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a690ce7e3fadcfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7f068ca00640 1 -- 172.21.15.192:0/3855510932 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688007740 con 0x7f069013fd70 2024-09-13T18:35:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7f068ca00640 1 -- 172.21.15.192:0/3855510932 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068802d050 con 0x7f069013fd70 2024-09-13T18:35:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.259+0000 7f068ca00640 1 -- 172.21.15.192:0/3855510932 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688007ac0 con 0x7f069013fd70 2024-09-13T18:35:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.260+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c8005250 con 0x7fe8d4003b00 2024-09-13T18:35:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.260+0000 7f0694a00640 1 -- 172.21.15.192:0/3855510932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 msgr2=0x7f06900b7460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.260+0000 7f0694a00640 1 --2- 172.21.15.192:0/3855510932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f06900b7460 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0690154600 tx=0x7f068802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.260+0000 7f4804c00640 1 Processor -- start 2024-09-13T18:35:51.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.260+0000 7f4804c00640 1 -- start start 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 0x7f137c1f9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f137c0cb490 0x7f137c157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1379e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 0x7f137c1f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1379e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 0x7f137c1f9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57358/0 (socket says 172.21.15.192:57358) 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 0x7f137c0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1577d0 con 0x7f137c0b0460 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1561f0 con 0x7f137c0cb490 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1381000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f137c1564d0 con 0x7f137c1ff380 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.261+0000 7f1379e00640 1 -- 172.21.15.192:0/1452045343 learned_addr learned my addr 172.21.15.192:0/1452045343 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f137a800640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 0x7f137c0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f0694a00640 1 -- 172.21.15.192:0/3855510932 shutdown_connections 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f4804c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 0x7f4800149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f4804c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f480014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f4804c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f0694a00640 1 --2- 172.21.15.192:0/3855510932 >> v2:172.21.15.194:3300/0 conn(0x7f0690140150 0x7f0690140640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f0694a00640 1 --2- 172.21.15.192:0/3855510932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f06900b7460 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f0694a00640 1 -- 172.21.15.192:0/3855510932 >> 172.21.15.192:0/3855510932 conn(0x7f06900b4c40 msgr2=0x7f06900b5050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f4804c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480014ebe0 con 0x7f48000b0490 2024-09-13T18:35:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f0694a00640 1 -- 172.21.15.192:0/3855510932 shutdown_connections 2024-09-13T18:35:51.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f4804c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48000ac5a0 con 0x7f48000b3d50 2024-09-13T18:35:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f47fe800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f47fe800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40194/0 (socket says 172.21.15.192:40194) 2024-09-13T18:35:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f47fe800640 1 -- 172.21.15.192:0/2206403802 learned_addr learned my addr 172.21.15.192:0/2206403802 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f4804c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48000ab9b0 con 0x7f48001612d0 2024-09-13T18:35:51.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f47fde00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 0x7f4800149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f1379400640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f137c0cb490 0x7f137c157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f137a800640 1 -- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f137c0cb490 msgr2=0x7f137c157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.262+0000 7f137a800640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f137c0cb490 0x7f137c157290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f137a800640 1 -- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 msgr2=0x7f137c1f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f137a800640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 0x7f137c1f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f137a800640 1 -- 172.21.15.192:0/1452045343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c0094d0 con 0x7f137c1ff380 2024-09-13T18:35:51.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fd400640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f480014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f137a800640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 0x7f137c0a98b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f136c033000 tx=0x7f136c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fde00640 1 -- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 msgr2=0x7f48001638c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7f0694a00640 1 -- 172.21.15.192:0/3855510932 wait complete. 2024-09-13T18:35:51.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fde00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fde00640 1 -- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 msgr2=0x7f480014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fde00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f480014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fde00640 1 -- 172.21.15.192:0/2206403802 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f8009a70 con 0x7f48000b0490 2024-09-13T18:35:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c004520 con 0x7f137c1ff380 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fe800640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f47fd400640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f480014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.263+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8dc02f030 con 0x7fe8d4003b00 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7fe8e6000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 0x7fe8d006d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8dc0a9310 con 0x7fe8d4003b00 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136c031730 con 0x7f137c1ff380 2024-09-13T18:35:51.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.264+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136c031ae0 con 0x7f137c1ff380 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.265+0000 7f47fde00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 0x7f4800149ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47f000c390 tx=0x7f47f000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.265+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00052d0 con 0x7f48000b0490 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.265+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0005430 con 0x7f48000b0490 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.265+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0003830 con 0x7f48000b0490 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.265+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48000abc70 con 0x7f48000b0490 2024-09-13T18:35:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7f0694a00640 1 Processor -- start 2024-09-13T18:35:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f137c1567b0 con 0x7f137c1ff380 2024-09-13T18:35:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48000ac230 con 0x7f48000b0490 2024-09-13T18:35:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7fe8ed400640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 0x7fe8d006d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7f0694a00640 1 -- start start 2024-09-13T18:35:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.266+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f137c156d70 con 0x7f137c1ff380 2024-09-13T18:35:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.267+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8dc074440 con 0x7fe8d4003b00 2024-09-13T18:35:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7fe8ed400640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 0x7fe8d006d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0000f60 tx=0x7fe8e0007e10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 0x7f069013de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f068de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f068de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57382/0 (socket says 172.21.15.192:57382) 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f068de00640 1 -- 172.21.15.192:0/3285181882 learned_addr learned my addr 172.21.15.192:0/3285181882 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 0x7f06901e5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069013cd80 con 0x7f069013fd70 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069013d060 con 0x7f0690140b80 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069013d340 con 0x7f06901e8580 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068e800640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 0x7f06901e5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068d400640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 0x7f069013de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068de00640 1 -- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 msgr2=0x7f06901e5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068de00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 0x7f06901e5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068de00640 1 -- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 msgr2=0x7f069013de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068de00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 0x7f069013de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068de00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0688009a70 con 0x7f069013fd70 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068e800640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 0x7f06901e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.269+0000 7f068d400640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 0x7f069013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.270+0000 7f068de00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0688009e80 tx=0x7f0688004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.270+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137c156f60 con 0x7f137c1ff380 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.268+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48000b1cf0 con 0x7f48000b0490 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.270+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47f0003990 con 0x7f48000b0490 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.271+0000 7f47f6000640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 0x7f47e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.271+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47f0088800 con 0x7f48000b0490 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.272+0000 7f47fd400640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 0x7f47e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.272+0000 7f47fd400640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 0x7f47e006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.273+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f136c03a070 con 0x7f137c1ff380 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.274+0000 7f1372000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 0x7f135c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.275+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f136c0aa0a0 con 0x7f137c1ff380 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.275+0000 7f1379e00640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 0x7f135c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.276+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f136c075260 con 0x7f137c1ff380 2024-09-13T18:35:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.276+0000 7f1379e00640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 0x7f135c06d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f137c0b2f40 tx=0x7f1374009930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f47f0053a70 con 0x7f48000b0490 2024-09-13T18:35:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688031890 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069013d620 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06901e8a10 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06880319f0 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.279+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0688031890 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.283+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0668005250 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.284+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0688031b60 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.285+0000 7f0686000640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 0x7f067006d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.285+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06880aa980 con 0x7f069013fd70 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.286+0000 7f068d400640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 0x7f067006d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.287+0000 7f068d400640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 0x7f067006d120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f069015c890 tx=0x7f067c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.295+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0688075ac0 con 0x7f069013fd70 2024-09-13T18:35:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.645+0000 7fcab9a00640 1 -- 172.21.15.192:0/499532766 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fcaac0e2260 con 0x7fcaac055170 2024-09-13T18:35:51.651 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.646+0000 7fcaaaa00640 1 -- 172.21.15.192:0/499532766 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcaa4057070 con 0x7fcaac055170 2024-09-13T18:35:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.649+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 msgr2=0x7fca9406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.649+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 0x7fca9406d110 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0001bc0 tx=0x7fcaa0009040 comp rx=0 tx=0).stop 2024-09-13T18:35:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.649+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 msgr2=0x7fcaac0cedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.649+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 0x7fcaac0cedc0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400c3c0 tx=0x7fcaa400c880 comp rx=0 tx=0).stop 2024-09-13T18:35:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 shutdown_connections 2024-09-13T18:35:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca9406ac50 0x7fca9406d110 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcaac0321a0 0x7fcaac032650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcaac055170 0x7fcaac0cedc0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 --2- 172.21.15.192:0/499532766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcaac0366f0 0x7fcaac04e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.651+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 >> 172.21.15.192:0/499532766 conn(0x7fcaac01d8f0 msgr2=0x7fcaac006570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.652+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 shutdown_connections 2024-09-13T18:35:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.652+0000 7fca9fe00640 1 -- 172.21.15.192:0/499532766 wait complete. 2024-09-13T18:35:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.652+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9ac0b1c70 con 0x7ff994003970 2024-09-13T18:35:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.653+0000 7ff9a9600640 1 -- 172.21.15.192:0/3156136803 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff998042020 con 0x7ff994003970 2024-09-13T18:35:51.659 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.659+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 msgr2=0x7ff98c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.659+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 0x7ff98c06d1c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9a0004870 tx=0x7ff9a0000f50 comp rx=0 tx=0).stop 2024-09-13T18:35:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.659+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 msgr2=0x7ff9ac153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.659+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff99800a120 tx=0x7ff998004730 comp rx=0 tx=0).stop 2024-09-13T18:35:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 shutdown_connections 2024-09-13T18:35:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff98c06ad00 0x7ff98c06d1c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9ac0cb5a0 0x7ff9ac0d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9ac0cb120 0x7ff9ac0d0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 --2- 172.21.15.192:0/3156136803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff994003970 0x7ff9ac153130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.660+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 >> 172.21.15.192:0/3156136803 conn(0x7ff9ac0b4920 msgr2=0x7ff9ac0b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.661+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 shutdown_connections 2024-09-13T18:35:51.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.661+0000 7ff9b4000640 1 -- 172.21.15.192:0/3156136803 wait complete. 2024-09-13T18:35:51.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.661+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb734005500 con 0x7fb75c15ce40 2024-09-13T18:35:51.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.662+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f5dbc005500 con 0x7f5de4144600 2024-09-13T18:35:51.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.662+0000 7fb752a00640 1 -- 172.21.15.192:0/1908401687 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb754009510 con 0x7fb75c15ce40 2024-09-13T18:35:51.665 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.665+0000 7f5ddb400640 1 -- 172.21.15.192:0/2828698139 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5dd0056b90 con 0x7f5de4144600 2024-09-13T18:35:51.670 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.666+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 msgr2=0x7fb73c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.666+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 0x7fb73c06d1c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb74c007fd0 tx=0x7fb74c009040 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.666+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 msgr2=0x7fb75c0c7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.666+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 0x7fb75c0c7280 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb754030000 tx=0x7fb754004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 shutdown_connections 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb73c06ad00 0x7fb73c06d1c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb75c15ce40 0x7fb75c0c7280 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb75c0d1c80 0x7fb75c0c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 --2- 172.21.15.192:0/1908401687 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb75c0cd3c0 0x7fb75c1506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 >> 172.21.15.192:0/1908401687 conn(0x7fb75c0b4860 msgr2=0x7fb75c0b4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 shutdown_connections 2024-09-13T18:35:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.667+0000 7fb75be00640 1 -- 172.21.15.192:0/1908401687 wait complete. 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.668+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fe8c80057d0 con 0x7fe8d4003b00 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.669+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 msgr2=0x7f5dc406d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.669+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 0x7f5dc406d120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc02ea40 tx=0x7f5ddc034000 comp rx=0 tx=0).stop 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.669+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 msgr2=0x7f5de413a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.669+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 0x7f5de413a3f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000c3c0 tx=0x7f5dd000c880 comp rx=0 tx=0).stop 2024-09-13T18:35:51.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.669+0000 7fe8e6000640 1 -- 172.21.15.192:0/152924252 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe8dc077a60 con 0x7fe8d4003b00 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 shutdown_connections 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dc406ac60 0x7f5dc406d120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5de4144600 0x7f5de413a3f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5de40cd7b0 0x7f5de4139eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 --2- 172.21.15.192:0/2828698139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5de406c1b0 0x7f5de415d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 >> 172.21.15.192:0/2828698139 conn(0x7f5de40734f0 msgr2=0x7f5de40cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 shutdown_connections 2024-09-13T18:35:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.670+0000 7f5de8e00640 1 -- 172.21.15.192:0/2828698139 wait complete. 2024-09-13T18:35:51.675 INFO:teuthology.orchestra.run.smithi192.stdout:60129542151 2024-09-13T18:35:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 msgr2=0x7fe8d006d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 0x7fe8d006d150 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0000f60 tx=0x7fe8e0007e10 comp rx=0 tx=0).stop 2024-09-13T18:35:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 msgr2=0x7fe8f0200690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc02f000 tx=0x7fe8dc001930 comp rx=0 tx=0).stop 2024-09-13T18:35:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 shutdown_connections 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8d006ac90 0x7fe8d006d150 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8f0156ef0 0x7fe8f0159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8f0156a70 0x7fe8f01592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 --2- 172.21.15.192:0/152924252 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d4003b00 0x7fe8f0200690 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.674+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 >> 172.21.15.192:0/152924252 conn(0x7fe8f00ae960 msgr2=0x7fe8f00b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.675+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 shutdown_connections 2024-09-13T18:35:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.676+0000 7fe8f5000640 1 -- 172.21.15.192:0/152924252 wait complete. 2024-09-13T18:35:51.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-09-13T18:35:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.683+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f137c0afd50 con 0x7f137c1ff380 2024-09-13T18:35:51.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.683+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f48000afdb0 con 0x7f48000b0490 2024-09-13T18:35:51.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.684+0000 7f1372000640 1 -- 172.21.15.192:0/1452045343 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f136c078880 con 0x7f137c1ff380 2024-09-13T18:35:51.687 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.684+0000 7f47f6000640 1 -- 172.21.15.192:0/2206403802 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47f0057090 con 0x7f48000b0490 2024-09-13T18:35:51.687 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.688+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 msgr2=0x7f47e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.688+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 0x7f47e006d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f47ec007fd0 tx=0x7f47ec007c20 comp rx=0 tx=0).stop 2024-09-13T18:35:51.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.688+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 msgr2=0x7f4800149ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.688+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 0x7f4800149ee0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f47f000c390 tx=0x7f47f000c850 comp rx=0 tx=0).stop 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.690+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 msgr2=0x7f135c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.690+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 0x7f135c06d1c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f137c0b2f40 tx=0x7f1374009930 comp rx=0 tx=0).stop 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.690+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 msgr2=0x7f137c0a98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.690+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 0x7f137c0a98b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f136c033000 tx=0x7f136c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 shutdown_connections 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f135c06ad00 0x7f135c06d1c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f137c1ff380 0x7f137c0a98b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f137c0cb490 0x7f137c157290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 --2- 172.21.15.192:0/1452045343 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c0b0460 0x7f137c1f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 >> 172.21.15.192:0/1452045343 conn(0x7f137c0ae960 msgr2=0x7f137c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 shutdown_connections 2024-09-13T18:35:51.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f47e006acd0 0x7f47e006d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48001612d0 0x7f48001638c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48000b3d50 0x7f480014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 --2- 172.21.15.192:0/2206403802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48000b0490 0x7f4800149ee0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 >> 172.21.15.192:0/2206403802 conn(0x7f48000ae960 msgr2=0x7f480015fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 shutdown_connections 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.689+0000 7f4804c00640 1 -- 172.21.15.192:0/2206403802 wait complete. 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 shutdown_connections 2024-09-13T18:35:51.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.691+0000 7f1381000640 1 -- 172.21.15.192:0/1452045343 wait complete. 2024-09-13T18:35:51.697 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-09-13T18:35:51.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-09-13T18:35:51.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.695+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0668005500 con 0x7f069013fd70 2024-09-13T18:35:51.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.696+0000 7f0686000640 1 -- 172.21.15.192:0/3285181882 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f06880790e0 con 0x7f069013fd70 2024-09-13T18:35:51.699 INFO:teuthology.orchestra.run.smithi192.stdout:55834574853 2024-09-13T18:35:51.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-09-13T18:35:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.698+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 msgr2=0x7f067006d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.698+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 0x7f067006d120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f069015c890 tx=0x7f067c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 msgr2=0x7f069013c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:51.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0688009e80 tx=0x7f0688004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 shutdown_connections 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f067006ac60 0x7f067006d120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06901e8580 0x7f06901e5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0690140b80 0x7f069013de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 --2- 172.21.15.192:0/3285181882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f069013fd70 0x7f069013c7a0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 >> 172.21.15.192:0/3285181882 conn(0x7f06900b4c40 msgr2=0x7f0690160160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:51.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 shutdown_connections 2024-09-13T18:35:51.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:51.699+0000 7f0694a00640 1 -- 172.21.15.192:0/3285181882 wait complete. 2024-09-13T18:35:51.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2024-09-13T18:35:51.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.7 2024-09-13T18:35:51.718 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-09-13T18:35:51.720 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-09-13T18:35:52.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-13T18:35:52.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-13T18:35:52.698 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-13T18:35:52.701 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-13T18:35:52.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-13T18:35:52.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-13T18:35:52.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-13T18:35:52.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.924+0000 7f6615800640 1 Processor -- start 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.924+0000 7f6615800640 1 -- start start 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.926+0000 7f6615800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6610070a10 0x7f6610070e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.926+0000 7f6615800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6610071380 con 0x7f66101616b0 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.926+0000 7f6615800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6610161d00 con 0x7f66100d1970 2024-09-13T18:35:52.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.926+0000 7f6615800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661015bb90 con 0x7f6610070a10 2024-09-13T18:35:52.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.927+0000 7f6614e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6610070a10 0x7f6610070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.927+0000 7f660fe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f66100d1970 0x7f66100b4090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55062/0 (socket says 172.21.15.192:55062) 2024-09-13T18:35:52.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.927+0000 7f660fe00640 1 -- 172.21.15.192:0/2503025878 learned_addr learned my addr 172.21.15.192:0/2503025878 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:52.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722594586 0 0) 0x7f6610161d00 con 0x7f66100d1970 2024-09-13T18:35:52.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f4003520 con 0x7f66100d1970 2024-09-13T18:35:52.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526529566 0 0) 0x7f6610071380 con 0x7f66101616b0 2024-09-13T18:35:52.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f4003840 con 0x7f66101616b0 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2386783715 0 0) 0x7f65f4003520 con 0x7f66100d1970 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 >> v2:172.21.15.194:3300/0 conn(0x7f6610070a10 msgr2=0x7f6610070e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 --2- 172.21.15.192:0/2503025878 >> v2:172.21.15.194:3300/0 conn(0x7f6610070a10 0x7f6610070e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 >> v1:172.21.15.192:6789/0 conn(0x7f66101616b0 legacy=0x7f66100d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610161fe0 con 0x7f66100d1970 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f65fc001650 con 0x7f66100d1970 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 >> v1:172.21.15.194:6789/0 conn(0x7f66100d1970 legacy=0x7f66100b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4003cb0 0x7f65f40040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f40047c0 0x7f65f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 0x7f65f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f400c1b0 con 0x7f65f4003cb0 2024-09-13T18:35:52.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f400c320 con 0x7f65f40047c0 2024-09-13T18:35:52.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.929+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f400c4e0 con 0x7f65f4005240 2024-09-13T18:35:52.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.930+0000 7f660fe00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4003cb0 0x7f65f40040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.931+0000 7f660f400640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f40047c0 0x7f65f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.931+0000 7f6614e00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 0x7f65f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.932+0000 7f6614e00640 1 -- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f40047c0 msgr2=0x7f65f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.932+0000 7f6614e00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f40047c0 0x7f65f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.932+0000 7f6614e00640 1 -- 172.21.15.192:0/2503025878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4003cb0 msgr2=0x7f65f40040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.932+0000 7f6614e00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4003cb0 0x7f65f40040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.932+0000 7f6614e00640 1 -- 172.21.15.192:0/2503025878 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6610161fe0 con 0x7f65f4005240 2024-09-13T18:35:52.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.933+0000 7f6614e00640 1 -- 172.21.15.192:0/2503025878 reap_dead start 2024-09-13T18:35:52.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.934+0000 7f660f400640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65f40047c0 0x7f65f4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:52.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.934+0000 7f660fe00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4003cb0 0x7f65f40040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:52.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.934+0000 7f6614e00640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 0x7f65f400b980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6608009fc0 tx=0x7f65f40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd7c561c6604494b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:52.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.935+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608003990 con 0x7f65f4005240 2024-09-13T18:35:52.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.935+0000 7f660ea00640 1 -- 172.21.15.192:0/2503025878 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660800f040 con 0x7f65f4005240 2024-09-13T18:35:52.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.936+0000 7f6615800640 1 -- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 msgr2=0x7f65f400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:52.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.936+0000 7f6615800640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 0x7f65f400b980 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6608009fc0 tx=0x7f65f40057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.937+0000 7f6615800640 1 -- 172.21.15.192:0/2503025878 shutdown_connections 2024-09-13T18:35:52.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.937+0000 7f6615800640 1 --2- 172.21.15.192:0/2503025878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65f4005240 0x7f65f400b980 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.937+0000 7f6615800640 1 -- 172.21.15.192:0/2503025878 >> 172.21.15.192:0/2503025878 conn(0x7f66100d2fd0 msgr2=0x7f66100d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:52.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.937+0000 7f6615800640 1 -- 172.21.15.192:0/2503025878 shutdown_connections 2024-09-13T18:35:52.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.937+0000 7f6615800640 1 -- 172.21.15.192:0/2503025878 wait complete. 2024-09-13T18:35:52.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.941+0000 7f6615800640 1 Processor -- start 2024-09-13T18:35:52.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.942+0000 7f6615800640 1 -- start start 2024-09-13T18:35:52.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.944+0000 7f6615800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 0x7f661015b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.945+0000 7f6615800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 0x7f66100b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.945+0000 7f6615800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 0x7f66100b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f660fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 0x7f661015b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f660f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 0x7f66100b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f660f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 0x7f66100b7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40226/0 (socket says 172.21.15.192:40226) 2024-09-13T18:35:52.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f660f400640 1 -- 172.21.15.192:0/3143612523 learned_addr learned my addr 172.21.15.192:0/3143612523 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:52.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66101ebf10 con 0x7f661015a3d0 2024-09-13T18:35:52.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f6614e00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 0x7f66100b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66100b89a0 con 0x7f66100b8520 2024-09-13T18:35:52.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.946+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661015ab80 con 0x7f66100b7a90 2024-09-13T18:35:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f6614e00640 1 -- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 msgr2=0x7f66100b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f6614e00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 0x7f66100b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f6614e00640 1 -- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 msgr2=0x7f661015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f6614e00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 0x7f661015b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f6614e00640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661015ae40 con 0x7f66100b8520 2024-09-13T18:35:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.948+0000 7f660fe00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 0x7f661015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.949+0000 7f6614e00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 0x7f66100b5bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66100c65e0 tx=0x7f6608009750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.950+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660800f040 con 0x7f66100b8520 2024-09-13T18:35:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.950+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66101eb570 con 0x7f66100b8520 2024-09-13T18:35:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.950+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66101ebb30 con 0x7f66100b8520 2024-09-13T18:35:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.951+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6608039450 con 0x7f66100b8520 2024-09-13T18:35:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.951+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6608039800 con 0x7f66100b8520 2024-09-13T18:35:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.953+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e8005250 con 0x7f66100b8520 2024-09-13T18:35:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.956+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6608039960 con 0x7f66100b8520 2024-09-13T18:35:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.957+0000 7f6607e00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 0x7f65f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.958+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f660802d070 con 0x7f66100b8520 2024-09-13T18:35:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.959+0000 7f660fe00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 0x7f65f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:52.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.960+0000 7f660fe00640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 0x7f65f006d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000c00 tx=0x7f65fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:52.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.961+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6608074e20 con 0x7f66100b8520 2024-09-13T18:35:53.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.997+0000 7f3868800640 1 Processor -- start 2024-09-13T18:35:53.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.997+0000 7f3868800640 1 -- start start 2024-09-13T18:35:53.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:52.999+0000 7fe31e000640 1 Processor -- start 2024-09-13T18:35:53.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.000+0000 7f3868800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f386006cae0 0x7f3860159e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.000+0000 7f3868800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3860070350 con 0x7f38600cd7a0 2024-09-13T18:35:53.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.000+0000 7f3868800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386015a380 con 0x7f3860153630 2024-09-13T18:35:53.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.000+0000 7f3868800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38600cb330 con 0x7f386006cae0 2024-09-13T18:35:53.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.000+0000 7fe31e000640 1 -- start start 2024-09-13T18:35:53.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.001+0000 7f3866800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3860153630 0x7f386006ec70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55064/0 (socket says 172.21.15.192:55064) 2024-09-13T18:35:53.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.001+0000 7f3866800640 1 -- 172.21.15.192:0/3285651118 learned_addr learned my addr 172.21.15.192:0/3285651118 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:53.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.002+0000 7f3865e00640 1 --2- 172.21.15.192:0/3285651118 >> v2:172.21.15.192:3300/0 conn(0x7f386006cae0 0x7f3860159e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.002+0000 7fe31e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe3180cd7a0 0x7fe318152f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.002+0000 7fe31e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3180b13a0 0x7fe318153460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.002+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835792689 0 0) 0x7f386015a380 con 0x7f3860153630 2024-09-13T18:35:53.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.002+0000 7fe317400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe31806cae0 0x7fe318159e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54202/0 (socket says 172.21.15.192:54202) 2024-09-13T18:35:53.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3848003520 con 0x7f3860153630 2024-09-13T18:35:53.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7fe31e000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe318070350 con 0x7fe31806cae0 2024-09-13T18:35:53.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7fe31e000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31806fd80 con 0x7fe3180cd7a0 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7fe31e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180cb330 con 0x7fe3180b13a0 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7fe317400640 1 -- 172.21.15.192:0/3756553387 learned_addr learned my addr 172.21.15.192:0/3756553387 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 <== mon.1 v1:172.21.15.194:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015915413 0 0) 0x7f3848003520 con 0x7f3860153630 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 >> v2:172.21.15.192:3300/0 conn(0x7f386006cae0 msgr2=0x7f3860159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 --2- 172.21.15.192:0/3285651118 >> v2:172.21.15.192:3300/0 conn(0x7f386006cae0 0x7f3860159e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 >> v1:172.21.15.192:6789/0 conn(0x7f38600cd7a0 legacy=0x7f3860152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 --> v1:172.21.15.194:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600ce7e0 con 0x7f3860153630 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 <== mon.1 v1:172.21.15.194:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f385c0019f0 con 0x7f3860153630 2024-09-13T18:35:53.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.003+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 >> v1:172.21.15.194:6789/0 conn(0x7f3860153630 legacy=0x7f386006ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3848003970 0x7f3848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3848005180 0x7f384800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38600cb330 con 0x7f3848005180 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384800c120 con 0x7f38480047c0 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384800c2e0 con 0x7f3848003970 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.004+0000 7f3865400640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865e00640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3848003970 0x7f3848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865400640 1 -- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3848003970 msgr2=0x7f3848003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7fe316a00640 1 --2- 172.21.15.192:0/3756553387 >> v2:172.21.15.192:3300/0 conn(0x7fe3180cd7a0 0x7fe318152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865400640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3848003970 0x7f3848003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3866800640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3848005180 0x7f384800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865400640 1 -- 172.21.15.192:0/3285651118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3848005180 msgr2=0x7f384800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865400640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3848005180 0x7f384800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865400640 1 -- 172.21.15.192:0/3285651118 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38600ce7e0 con 0x7f38480047c0 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.005+0000 7f3865e00640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3848003970 0x7f3848003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316000640 1 -- 172.21.15.192:0/3756553387 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1224860417 0 0) 0x7fe318070350 con 0x7fe31806cae0 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316000640 1 -- 172.21.15.192:0/3756553387 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2fc003520 con 0x7fe31806cae0 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316a00640 1 -- 172.21.15.192:0/3756553387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3180b13a0 msgr2=0x7fe318153460 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-13T18:35:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316a00640 1 --2- 172.21.15.192:0/3756553387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3180b13a0 0x7fe318153460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316a00640 1 -- 172.21.15.192:0/3756553387 >> v1:172.21.15.192:6789/0 conn(0x7fe31806cae0 legacy=0x7fe318159e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7fe316a00640 1 -- 172.21.15.192:0/3756553387 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3180ce7e0 con 0x7fe3180cd7a0 2024-09-13T18:35:53.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.006+0000 7f3866800640 1 -- 172.21.15.192:0/3285651118 reap_dead start 2024-09-13T18:35:53.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7f3865400640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3848004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f386006c630 tx=0x7f38480057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c274cf36fbd062da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.008+0000 7fe316a00640 1 --2- 172.21.15.192:0/3756553387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3180cd7a0 0x7fe318152f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe310009d90 tx=0x7fe31002a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becb97f0d59d0f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385002bca0 con 0x7f38480047c0 2024-09-13T18:35:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7fe316000640 1 -- 172.21.15.192:0/3756553387 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310007740 con 0x7fe3180cd7a0 2024-09-13T18:35:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7fe316000640 1 -- 172.21.15.192:0/3756553387 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31002d050 con 0x7fe3180cd7a0 2024-09-13T18:35:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7fe316000640 1 -- 172.21.15.192:0/3756553387 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310007ac0 con 0x7fe3180cd7a0 2024-09-13T18:35:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.009+0000 7f3864a00640 1 -- 172.21.15.192:0/3285651118 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385002be00 con 0x7f38480047c0 2024-09-13T18:35:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 -- 172.21.15.192:0/3756553387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3180cd7a0 msgr2=0x7fe318152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 --2- 172.21.15.192:0/3756553387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3180cd7a0 0x7fe318152f20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe310009d90 tx=0x7fe31002a590 comp rx=0 tx=0).stop 2024-09-13T18:35:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 -- 172.21.15.192:0/3756553387 shutdown_connections 2024-09-13T18:35:53.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 --2- 172.21.15.192:0/3756553387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3180b13a0 0x7fe318153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 --2- 172.21.15.192:0/3756553387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3180cd7a0 0x7fe318152f20 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe310009d90 tx=0x7fe31002a590 comp rx=0 tx=0).stop 2024-09-13T18:35:53.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7f3868800640 1 -- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 msgr2=0x7f3848004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7f3868800640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3848004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f386006c630 tx=0x7f38480057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7fe31e000640 1 -- 172.21.15.192:0/3756553387 >> 172.21.15.192:0/3756553387 conn(0x7fe3180b0f90 msgr2=0x7fe3180b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7f3868800640 1 -- 172.21.15.192:0/3285651118 shutdown_connections 2024-09-13T18:35:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7f3868800640 1 --2- 172.21.15.192:0/3285651118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3848004c40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.010+0000 7f3868800640 1 -- 172.21.15.192:0/3285651118 >> 172.21.15.192:0/3285651118 conn(0x7f38600b0f90 msgr2=0x7f38600b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.011+0000 7fe31e000640 1 -- 172.21.15.192:0/3756553387 shutdown_connections 2024-09-13T18:35:53.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.011+0000 7fe31e000640 1 -- 172.21.15.192:0/3756553387 wait complete. 2024-09-13T18:35:53.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.011+0000 7f3868800640 1 -- 172.21.15.192:0/3285651118 shutdown_connections 2024-09-13T18:35:53.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.011+0000 7f3868800640 1 -- 172.21.15.192:0/3285651118 wait complete. 2024-09-13T18:35:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.012+0000 7f75e1a00640 1 Processor -- start 2024-09-13T18:35:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.013+0000 7f75e1a00640 1 -- start start 2024-09-13T18:35:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7fe31e000640 1 Processor -- start 2024-09-13T18:35:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7f051ac00640 1 Processor -- start 2024-09-13T18:35:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7fe31e000640 1 -- start start 2024-09-13T18:35:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7f88a1400640 1 Processor -- start 2024-09-13T18:35:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f3868800640 1 Processor -- start 2024-09-13T18:35:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f75e1a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f75dc0b3cd0 0x7f75dc167f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f75e1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc0b2830 con 0x7f75dc0d1d40 2024-09-13T18:35:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f75e1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75dc0d2190 con 0x7f75dc15d150 2024-09-13T18:35:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f75e1a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75dc0b2570 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7f051ac00640 1 -- start start 2024-09-13T18:35:53.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.015+0000 7f3868800640 1 -- start start 2024-09-13T18:35:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.014+0000 7f88a1400640 1 -- start start 2024-09-13T18:35:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f75db400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f75dc0b3cd0 0x7f75dc167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f75db400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f75dc0b3cd0 0x7f75dc167f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35084/0 (socket says 172.21.15.192:35084) 2024-09-13T18:35:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f75db400640 1 -- 172.21.15.192:0/561121089 learned_addr learned my addr 172.21.15.192:0/561121089 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386006c270 0x7f386006b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f386006bad0 0x7f386015eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f7f60 con 0x7f386006bad0 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3860148740 con 0x7f38480047c0 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f3868800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38601f72e0 con 0x7f386006c270 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f88a1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f889c0b2890 0x7f889c0b2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f88a1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c0b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f88a1400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c0b3580 con 0x7f889c0cd580 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f88a1400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f889c0b3860 con 0x7f889c0b2890 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.016+0000 7f88a1400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0b3b40 con 0x7f889c0b5e80 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f889a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f889c0cd580 0x7f889c0cd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54216/0 (socket says 172.21.15.192:54216) 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f889a800640 1 -- 172.21.15.192:0/585565271 learned_addr learned my addr 172.21.15.192:0/585565271 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:53.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7fe31e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 0x7fe3180addf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f3865e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f3865e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35088/0 (socket says 172.21.15.192:35088) 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f3865e00640 1 -- 172.21.15.192:0/1175051478 learned_addr learned my addr 172.21.15.192:0/1175051478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f3865400640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386006c270 0x7f386006b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f88a0a00640 1 --2- 172.21.15.192:0/585565271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c0b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7fe31e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f3866800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f386006bad0 0x7f386015eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f75db400640 1 -- 172.21.15.192:0/561121089 >> v1:172.21.15.194:6789/0 conn(0x7f75dc15d150 legacy=0x7f75dc0cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f75db400640 1 -- 172.21.15.192:0/561121089 >> v1:172.21.15.192:6789/0 conn(0x7f75dc0d1d40 legacy=0x7f75dc0cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f8899400640 1 -- 172.21.15.192:0/585565271 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 121282214 0 0) 0x7f889c0b3580 con 0x7f889c0cd580 2024-09-13T18:35:53.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f8899400640 1 -- 172.21.15.192:0/585565271 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8880003520 con 0x7f889c0cd580 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7f051ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f05140b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f3865e00640 1 -- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386006c270 msgr2=0x7f386006b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f3865e00640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386006c270 0x7f386006b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f3865e00640 1 -- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f386006bad0 msgr2=0x7f386015eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f3865e00640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f386006bad0 0x7f386015eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f3865e00640 1 -- 172.21.15.192:0/1175051478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38601f75c0 con 0x7f38480047c0 2024-09-13T18:35:53.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f75db400640 1 -- 172.21.15.192:0/561121089 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75dc0ce440 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f92cc200640 1 Processor -- start 2024-09-13T18:35:53.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f051ac00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05140d2980 0x7f0514166a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f051ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05140b3760 con 0x7f05140d0b30 2024-09-13T18:35:53.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f051ac00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05140b67e0 con 0x7f05140d2980 2024-09-13T18:35:53.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f051ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05140b6ac0 con 0x7f051415ce50 2024-09-13T18:35:53.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f92cc200640 1 -- start start 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.017+0000 7fe317400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 0x7fe3180addf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7fe31e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318151ed0 0x7fe3180aed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7fe31e000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe318159c10 con 0x7fe31806cae0 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7fe31e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31814ceb0 con 0x7fe3180b13a0 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7fe31e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3180ae330 con 0x7fe318151ed0 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7fe316a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7fe316a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35094/0 (socket says 172.21.15.192:35094) 2024-09-13T18:35:53.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7fe316a00640 1 -- 172.21.15.192:0/693374786 learned_addr learned my addr 172.21.15.192:0/693374786 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7fe317e00640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318151ed0 0x7fe3180aed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05140d2980 0x7f0514166a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05140d2980 0x7f0514166a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57464/0 (socket says 172.21.15.192:57464) 2024-09-13T18:35:53.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 -- 172.21.15.192:0/2110019502 learned_addr learned my addr 172.21.15.192:0/2110019502 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0513e00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f05140b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f88a0a00640 1 -- 172.21.15.192:0/585565271 >> v2:172.21.15.192:3300/0 conn(0x7f889c0b2890 msgr2=0x7f889c0b2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f88a0a00640 1 --2- 172.21.15.192:0/585565271 >> v2:172.21.15.192:3300/0 conn(0x7f889c0b2890 0x7f889c0b2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f88a0a00640 1 -- 172.21.15.192:0/585565271 >> v1:172.21.15.192:6789/0 conn(0x7f889c0cd580 legacy=0x7f889c0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.018+0000 7f88a0a00640 1 -- 172.21.15.192:0/585565271 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c0b3e20 con 0x7f889c0b5e80 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 -- 172.21.15.192:0/2110019502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 msgr2=0x7f05140b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f05140b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 -- 172.21.15.192:0/2110019502 >> v1:172.21.15.194:6789/0 conn(0x7f05140d0b30 legacy=0x7f05140d2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f88a0a00640 1 --2- 172.21.15.192:0/585565271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c0b6310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8894009d90 tx=0x7f889402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65bcdad38c932c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f75db400640 1 --2- 172.21.15.192:0/561121089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc167f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e50 tx=0x7f75d402a7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ce75a6e5e2760cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.019+0000 7f0518c00640 1 -- 172.21.15.192:0/2110019502 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05140b6da0 con 0x7f05140d2980 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f8899400640 1 -- 172.21.15.192:0/585565271 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007740 con 0x7f889c0b5e80 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7fe316a00640 1 -- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318151ed0 msgr2=0x7fe3180aed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7fe316a00640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318151ed0 0x7fe3180aed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7fe316a00640 1 -- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 msgr2=0x7fe3180addf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f8899400640 1 -- 172.21.15.192:0/585565271 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889402d050 con 0x7f889c0b5e80 2024-09-13T18:35:53.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f8899400640 1 -- 172.21.15.192:0/585565271 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894007ac0 con 0x7f889c0b5e80 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f75d9600640 1 -- 172.21.15.192:0/561121089 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4031600 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f75d9600640 1 -- 172.21.15.192:0/561121089 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d402d050 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f75d9600640 1 -- 172.21.15.192:0/561121089 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4031980 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f92cc200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92c415cf50 0x7f92c40d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f92cc200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92c40d0620 0x7f92c40cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f92cc200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c40d1300 con 0x7f92c40b2080 2024-09-13T18:35:53.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f92cc200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40b2860 con 0x7f92c40d0620 2024-09-13T18:35:53.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f92cc200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92c40d10f0 con 0x7f92c415cf50 2024-09-13T18:35:53.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.020+0000 7f3865e00640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3854011ca0 tx=0x7f385400f610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c8e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f92c40b2080 0x7f92c40cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55084/0 (socket says 172.21.15.192:55084) 2024-09-13T18:35:53.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385400fd20 con 0x7f38480047c0 2024-09-13T18:35:53.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c8e00640 1 -- 172.21.15.192:0/1271751334 learned_addr learned my addr 172.21.15.192:0/1271751334 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:53.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c9800640 1 --2- 172.21.15.192:0/1271751334 >> v2:172.21.15.194:3300/0 conn(0x7f92c415cf50 0x7f92c40d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f88a1400640 1 -- 172.21.15.192:0/585565271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 msgr2=0x7f889c0b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f88a1400640 1 --2- 172.21.15.192:0/585565271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c0b6310 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8894009d90 tx=0x7f889402a660 comp rx=0 tx=0).stop 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385400fe80 con 0x7f38480047c0 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854014660 con 0x7f38480047c0 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7fe316a00640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 0x7fe3180addf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7fe316a00640 1 -- 172.21.15.192:0/693374786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009a70 con 0x7fe3180b13a0 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7fe317400640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 0x7fe3180addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:53.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7fe316a00640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe310000f80 tx=0x7fe310004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f75e1a00640 1 -- 172.21.15.192:0/561121089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 msgr2=0x7f75dc167f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f75e1a00640 1 --2- 172.21.15.192:0/561121089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc167f60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75d4009e50 tx=0x7f75d402a7a0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f75e1a00640 1 -- 172.21.15.192:0/561121089 shutdown_connections 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f75e1a00640 1 --2- 172.21.15.192:0/561121089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc167f60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f75e1a00640 1 -- 172.21.15.192:0/561121089 >> 172.21.15.192:0/561121089 conn(0x7f75dc0b4b60 msgr2=0x7f75dc0b4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f0518c00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d2980 0x7f0514166a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0504009870 tx=0x7f050402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4698841af3b14fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f0512a00640 1 -- 172.21.15.192:0/2110019502 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504032440 con 0x7f05140d2980 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f0512a00640 1 -- 172.21.15.192:0/2110019502 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05040325a0 con 0x7f05140d2980 2024-09-13T18:35:53.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f0512a00640 1 -- 172.21.15.192:0/2110019502 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0504032930 con 0x7f05140d2980 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c3e00640 1 -- 172.21.15.192:0/1271751334 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3800027763 0 0) 0x7f92c40d1300 con 0x7f92c40b2080 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c3e00640 1 -- 172.21.15.192:0/1271751334 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92ac003520 con 0x7f92c40b2080 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c9800640 1 -- 172.21.15.192:0/1271751334 >> v2:172.21.15.192:3300/0 conn(0x7f92c40d0620 msgr2=0x7f92c40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c9800640 1 --2- 172.21.15.192:0/1271751334 >> v2:172.21.15.192:3300/0 conn(0x7f92c40d0620 0x7f92c40cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.021+0000 7f92c9800640 1 -- 172.21.15.192:0/1271751334 >> v1:172.21.15.194:6789/0 conn(0x7f92c40b2080 legacy=0x7f92c40cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f92c9800640 1 -- 172.21.15.192:0/1271751334 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4161970 con 0x7f92c415cf50 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.022+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38601f78a0 con 0x7f38480047c0 2024-09-13T18:35:53.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386015f070 con 0x7f38480047c0 2024-09-13T18:35:53.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31003c830 con 0x7fe3180b13a0 2024-09-13T18:35:53.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31003c990 con 0x7fe3180b13a0 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31003cd00 con 0x7fe3180b13a0 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe318152440 con 0x7fe3180b13a0 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f88a1400640 1 -- 172.21.15.192:0/585565271 shutdown_connections 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f88a1400640 1 --2- 172.21.15.192:0/585565271 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c0b6310 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f88a1400640 1 --2- 172.21.15.192:0/585565271 >> v2:172.21.15.192:3300/0 conn(0x7f889c0b2890 0x7f889c0b2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f88a1400640 1 -- 172.21.15.192:0/585565271 >> 172.21.15.192:0/585565271 conn(0x7f889c0b4a20 msgr2=0x7f889c0b4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f051ac00640 1 -- 172.21.15.192:0/2110019502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d2980 msgr2=0x7f0514166a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f92c9800640 1 --2- 172.21.15.192:0/1271751334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c40d0bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92c4072560 tx=0x7f92b802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e96f1227508b947 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7f051ac00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d2980 0x7f0514166a40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0504009870 tx=0x7f050402a250 comp rx=0 tx=0).stop 2024-09-13T18:35:53.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f92c3e00640 1 -- 172.21.15.192:0/1271751334 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b802ae60 con 0x7f92c415cf50 2024-09-13T18:35:53.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 -- 172.21.15.192:0/2110019502 shutdown_connections 2024-09-13T18:35:53.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d2980 0x7f0514166a40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 --2- 172.21.15.192:0/2110019502 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f05140b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.023+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe318152a00 con 0x7fe3180b13a0 2024-09-13T18:35:53.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 -- 172.21.15.192:0/2110019502 >> 172.21.15.192:0/2110019502 conn(0x7f05140d3000 msgr2=0x7f05140d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f88a1400640 1 -- 172.21.15.192:0/585565271 shutdown_connections 2024-09-13T18:35:53.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f88a1400640 1 -- 172.21.15.192:0/585565271 wait complete. 2024-09-13T18:35:53.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f75e1a00640 1 -- 172.21.15.192:0/561121089 shutdown_connections 2024-09-13T18:35:53.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 -- 172.21.15.192:0/2110019502 shutdown_connections 2024-09-13T18:35:53.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f92c3e00640 1 -- 172.21.15.192:0/1271751334 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b8032440 con 0x7f92c415cf50 2024-09-13T18:35:53.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f051ac00640 1 -- 172.21.15.192:0/2110019502 wait complete. 2024-09-13T18:35:53.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.024+0000 7f92c3e00640 1 -- 172.21.15.192:0/1271751334 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b80327d0 con 0x7f92c415cf50 2024-09-13T18:35:53.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f75e1a00640 1 -- 172.21.15.192:0/561121089 wait complete. 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3860067b10 con 0x7f38480047c0 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 -- 172.21.15.192:0/1271751334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 msgr2=0x7f92c40d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 --2- 172.21.15.192:0/1271751334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c40d0bb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f92c4072560 tx=0x7f92b802a110 comp rx=0 tx=0).stop 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 -- 172.21.15.192:0/1271751334 shutdown_connections 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 --2- 172.21.15.192:0/1271751334 >> v2:172.21.15.192:3300/0 conn(0x7f92c40d0620 0x7f92c40cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 --2- 172.21.15.192:0/1271751334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c40d0bb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.025+0000 7f92cc200640 1 -- 172.21.15.192:0/1271751334 >> 172.21.15.192:0/1271751334 conn(0x7f92c40d3400 msgr2=0x7f92c40d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.026+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe318067b10 con 0x7fe3180b13a0 2024-09-13T18:35:53.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.026+0000 7f051ac00640 1 Processor -- start 2024-09-13T18:35:53.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7f051ac00640 1 -- start start 2024-09-13T18:35:53.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe310031400 con 0x7fe3180b13a0 2024-09-13T18:35:53.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7f88a1400640 1 Processor -- start 2024-09-13T18:35:53.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7f88a1400640 1 -- start start 2024-09-13T18:35:53.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7f0ef9400640 1 Processor -- start 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7f051ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7f051ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05140d2980 0x7f051415fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f051ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f0514149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7f75e1a00640 1 Processor -- start 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.027+0000 7f75e1a00640 1 -- start start 2024-09-13T18:35:53.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f92cc200640 1 -- 172.21.15.192:0/1271751334 shutdown_connections 2024-09-13T18:35:53.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7fe30f400640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 0x7fe2f806d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe3100aaab0 con 0x7fe3180b13a0 2024-09-13T18:35:53.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f38540147c0 con 0x7f38480047c0 2024-09-13T18:35:53.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f051ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05141599f0 con 0x7f05140d0b30 2024-09-13T18:35:53.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f88a1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f88a1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f88a1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 0x7f889c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f051ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0514158e70 con 0x7f05140d2980 2024-09-13T18:35:53.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 0x7f75dc1f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc157db0 con 0x7f75dc15d150 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc158090 con 0x7f75dc0b3cd0 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f75e1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75dc158370 con 0x7f75dc0d1d40 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.028+0000 7f0ef9400640 1 -- start start 2024-09-13T18:35:53.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f051ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0514159150 con 0x7f051415ce50 2024-09-13T18:35:53.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f0513e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f385a000640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 0x7f384406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f0513e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57478/0 (socket says 172.21.15.192:57478) 2024-09-13T18:35:53.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f0513e00640 1 -- 172.21.15.192:0/1652999016 learned_addr learned my addr 172.21.15.192:0/1652999016 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3854089fc0 con 0x7f38480047c0 2024-09-13T18:35:53.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f889a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f889a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35114/0 (socket says 172.21.15.192:35114) 2024-09-13T18:35:53.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f0518c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f0514149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f8899e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f8899e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40316/0 (socket says 172.21.15.192:40316) 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f889a800640 1 -- 172.21.15.192:0/3065545450 learned_addr learned my addr 172.21.15.192:0/3065545450 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0b8300 con 0x7f889c0cd580 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0cb180 con 0x7f889c0b2890 2024-09-13T18:35:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0cb460 con 0x7f889c0b5e80 2024-09-13T18:35:53.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0513e00640 1 -- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 msgr2=0x7f0514149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0513e00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f0514149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0ef9400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef40d1300 con 0x7f0ef40b2080 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0513e00640 1 -- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05140d2980 msgr2=0x7f051415fd40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0513e00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05140d2980 0x7f051415fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0513e00640 1 -- 172.21.15.192:0/1652999016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040094d0 con 0x7f05140d0b30 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.030+0000 7f0518c00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f0514149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:53.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f88a0a00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 0x7f889c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef9400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef4161970 con 0x7f0ef415cf50 2024-09-13T18:35:53.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40b2860 con 0x7f0ef40d0620 2024-09-13T18:35:53.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef2800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0ef415cf50 0x7f0ef40cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55094/0 (socket says 172.21.15.192:55094) 2024-09-13T18:35:53.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef2800640 1 -- 172.21.15.192:0/3541537877 learned_addr learned my addr 172.21.15.192:0/3541537877 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:53.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef1e00640 1 --2- 172.21.15.192:0/3541537877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f889a800640 1 -- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 msgr2=0x7f889c155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f889a800640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0513e00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f050c00efc0 tx=0x7f050c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef1e00640 1 -- 172.21.15.192:0/3541537877 >> v1:172.21.15.194:6789/0 conn(0x7f0ef415cf50 legacy=0x7f0ef40cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f0ef1400640 1 -- 172.21.15.192:0/3541537877 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281788381 0 0) 0x7f0ef40d1300 con 0x7f0ef40b2080 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f0ef1e00640 1 -- 172.21.15.192:0/3541537877 >> v1:172.21.15.192:6789/0 conn(0x7f0ef40b2080 legacy=0x7f0ef40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f0ef1e00640 1 -- 172.21.15.192:0/3541537877 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef4160bb0 con 0x7f0ef40d0620 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f75db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f75db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57490/0 (socket says 172.21.15.192:57490) 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f75db400640 1 -- 172.21.15.192:0/1001256322 learned_addr learned my addr 172.21.15.192:0/1001256322 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f889a800640 1 -- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 msgr2=0x7f889c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75da000640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 0x7f75dc1f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75daa00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.031+0000 7f8899e00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:53.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f889a800640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 0x7f889c15f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.029+0000 7f92cc200640 1 -- 172.21.15.192:0/1271751334 wait complete. 2024-09-13T18:35:53.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f3865400640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 0x7f384406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f889a800640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009a70 con 0x7f889c0b2890 2024-09-13T18:35:53.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f88a0a00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 0x7f889c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:53.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f92cc200640 1 Processor -- start 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c009b80 con 0x7f05140d0b30 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050c00f040 con 0x7f05140d0b30 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c0146a0 con 0x7f05140d0b30 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75db400640 1 -- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 msgr2=0x7f75dc1f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75db400640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 0x7f75dc1f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75db400640 1 -- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 msgr2=0x7f75dc1565a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75db400640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc1565a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75db400640 1 -- 172.21.15.192:0/1001256322 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4009b30 con 0x7f75dc15d150 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7f75da000640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 0x7f75dc1f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.032+0000 7fe317400640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 0x7fe2f806d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f889a800640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f888800c390 tx=0x7f888800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f92cc200640 1 -- start start 2024-09-13T18:35:53.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0514159430 con 0x7f05140d0b30 2024-09-13T18:35:53.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051415eee0 con 0x7f05140d0b30 2024-09-13T18:35:53.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f0ef1e00640 1 --2- 172.21.15.192:0/3541537877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40d0bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00097d0 tx=0x7f0ee002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51ee9b6ac8820892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f75db400640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75d40093e0 tx=0x7f75d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f0ef1400640 1 -- 172.21.15.192:0/3541537877 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0032440 con 0x7f0ef40d0620 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f0ef1400640 1 -- 172.21.15.192:0/3541537877 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee00325a0 con 0x7f0ef40d0620 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.033+0000 7f0ef1400640 1 -- 172.21.15.192:0/3541537877 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee0032930 con 0x7f0ef40d0620 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f0ef9400640 1 -- 172.21.15.192:0/3541537877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 msgr2=0x7f0ef40d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f0ef9400640 1 --2- 172.21.15.192:0/3541537877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40d0bb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f0ee00097d0 tx=0x7f0ee002a180 comp rx=0 tx=0).stop 2024-09-13T18:35:53.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f3865400640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 0x7f384406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3850033000 tx=0x7f3850035040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7fe317400640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 0x7fe2f806d110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe308001eb0 tx=0x7fe308001790 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe310075c70 con 0x7fe3180b13a0 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 0x7f92c415fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 0x7f92c41f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c41f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b6340 con 0x7f92c40d0620 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c4160700 con 0x7f92c415cf50 2024-09-13T18:35:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f92cc200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c40b83b0 con 0x7f92c40b2080 2024-09-13T18:35:53.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.034+0000 7f0ef9400640 1 -- 172.21.15.192:0/3541537877 shutdown_connections 2024-09-13T18:35:53.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f0ef9400640 1 --2- 172.21.15.192:0/3541537877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40d0bb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f0ef9400640 1 -- 172.21.15.192:0/3541537877 >> 172.21.15.192:0/3541537877 conn(0x7f0ef40d3400 msgr2=0x7f0ef40d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d4003b90 con 0x7f75dc15d150 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f92c9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 0x7f92c415fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f92c9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 0x7f92c415fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40344/0 (socket says 172.21.15.192:40344) 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f92c9800640 1 -- 172.21.15.192:0/3652884092 learned_addr learned my addr 172.21.15.192:0/3652884092 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f92ca200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c41f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d4003d10 con 0x7f75dc15d150 2024-09-13T18:35:53.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d403c870 con 0x7f75dc15d150 2024-09-13T18:35:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75dc158650 con 0x7f75dc15d150 2024-09-13T18:35:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75dc158930 con 0x7f75dc15d150 2024-09-13T18:35:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05140d2270 con 0x7f05140d0b30 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.035+0000 7f92c8e00640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 0x7f92c41f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 -- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 msgr2=0x7f92c415fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 0x7f92c415fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 -- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 msgr2=0x7f92c41f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c41f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 -- 172.21.15.192:0/3652884092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b8009400 con 0x7f92c40d0620 2024-09-13T18:35:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f0ef9400640 1 -- 172.21.15.192:0/3541537877 shutdown_connections 2024-09-13T18:35:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.036+0000 7f92c8e00640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 0x7f92c41f6020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c430 tx=0x7f92b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75dc0cc470 con 0x7f75dc15d150 2024-09-13T18:35:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0005ce0 con 0x7f92c40d0620 2024-09-13T18:35:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0005e40 con 0x7f92c40d0620 2024-09-13T18:35:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00072d0 con 0x7f92c40d0620 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f0ef9400640 1 -- 172.21.15.192:0/3541537877 wait complete. 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c40b8650 con 0x7f92c40d0620 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.037+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c40b8c10 con 0x7f92c40d0620 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888005ce0 con 0x7f889c0b2890 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888005e40 con 0x7f889c0b2890 2024-09-13T18:35:53.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88880072f0 con 0x7f889c0b2890 2024-09-13T18:35:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3854055100 con 0x7f38480047c0 2024-09-13T18:35:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f050c014800 con 0x7f05140d0b30 2024-09-13T18:35:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f889c0cb740 con 0x7f889c0b2890 2024-09-13T18:35:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.038+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0b7f20 con 0x7f889c0b2890 2024-09-13T18:35:53.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.039+0000 7f050be00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 0x7f04f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.040+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92c415d330 con 0x7f92c40d0620 2024-09-13T18:35:53.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.040+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f050c089d80 con 0x7f05140d0b30 2024-09-13T18:35:53.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.041+0000 7f0ef9400640 1 Processor -- start 2024-09-13T18:35:53.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.041+0000 7f0513400640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 0x7f04f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0513400640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 0x7f04f406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0500000f60 tx=0x7f05000079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c0cbc60 con 0x7f889c0b2890 2024-09-13T18:35:53.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75d403c9d0 con 0x7f75dc15d150 2024-09-13T18:35:53.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8888007450 con 0x7f889c0b2890 2024-09-13T18:35:53.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.044+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f92b0007430 con 0x7f92c40d0620 2024-09-13T18:35:53.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.044+0000 7f75d2a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 0x7f75bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.044+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75d40aa1c0 con 0x7f75dc15d150 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.044+0000 7f8892a00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 0x7f887c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.044+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88880888d0 con 0x7f889c0b2890 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.045+0000 7f8899e00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 0x7f887c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.041+0000 7f0ef9400640 1 -- start start 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef415cf50 0x7f0ef41f5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef4147cc0 con 0x7f0ef40b2080 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40b8730 con 0x7f0ef415cf50 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef40b62d0 con 0x7f0ef40d0620 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57518/0 (socket says 172.21.15.192:57518) 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.042+0000 7f0ef2800640 1 -- 172.21.15.192:0/2802123461 learned_addr learned my addr 172.21.15.192:0/2802123461 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 -- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 msgr2=0x7f0ef40b54a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40b54a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 -- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef415cf50 msgr2=0x7f0ef41f5fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef415cf50 0x7f0ef41f5fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 -- 172.21.15.192:0/2802123461 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee0009400 con 0x7f0ef40b2080 2024-09-13T18:35:53.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.043+0000 7f0ef2800640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00caa0 tx=0x7f0eec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.045+0000 7f75daa00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 0x7f75bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.045+0000 7f92c1600640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 0x7f92a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.046+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92b00887d0 con 0x7f92c40d0620 2024-09-13T18:35:53.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.046+0000 7f92c9800640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 0x7f92a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.046+0000 7f8899e00640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 0x7f887c06d1c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f889c156bd0 tx=0x7f888c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.047+0000 7f75daa00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 0x7f75bc06d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0b0ff0 tx=0x7f75cc007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.047+0000 7f92c9800640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 0x7f92a406d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92b802a150 tx=0x7f92b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.048+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f889c0cbc60 con 0x7f889c0b2890 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.050+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f050c054fd0 con 0x7f05140d0b30 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.054+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75d4075500 con 0x7f75dc15d150 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.062+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00ac00 con 0x7f0ef40b2080 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.062+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec00ad60 con 0x7f0ef40b2080 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.062+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec012600 con 0x7f0ef40b2080 2024-09-13T18:35:53.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.063+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef40b89a0 con 0x7f0ef40b2080 2024-09-13T18:35:53.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.063+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef40b59e0 con 0x7f0ef40b2080 2024-09-13T18:35:53.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.064+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f92b0053af0 con 0x7f92c40d0620 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.064+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef40b8ec0 con 0x7f0ef40b2080 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.071+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0eec012760 con 0x7f0ef40b2080 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.076+0000 7f0eeaa00640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 0x7f0ed406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.076+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0eec0891c0 con 0x7f0ef40b2080 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.077+0000 7f0ef1e00640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 0x7f0ed406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.078+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0eec054430 con 0x7f0ef40b2080 2024-09-13T18:35:53.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.079+0000 7f0ef1e00640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 0x7f0ed406d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0034000 tx=0x7f0ee002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.329+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f65e8005500 con 0x7f66100b8520 2024-09-13T18:35:53.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.330+0000 7f6607e00640 1 -- 172.21.15.192:0/3143612523 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6608034020 con 0x7f66100b8520 2024-09-13T18:35:53.333 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.334+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 msgr2=0x7f65f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.334+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 0x7f65f006d0c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65fc000c00 tx=0x7f65fc009040 comp rx=0 tx=0).stop 2024-09-13T18:35:53.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.334+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 msgr2=0x7f66100b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 0x7f66100b5bf0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f66100c65e0 tx=0x7f6608009750 comp rx=0 tx=0).stop 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 shutdown_connections 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f65f006ac00 0x7f65f006d0c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66100b8520 0x7f66100b5bf0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66100b7a90 0x7f66100b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 --2- 172.21.15.192:0/3143612523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f661015a3d0 0x7f661015b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 >> 172.21.15.192:0/3143612523 conn(0x7f66100d2fd0 msgr2=0x7f661006b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.335+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 shutdown_connections 2024-09-13T18:35:53.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.336+0000 7f6615800640 1 -- 172.21.15.192:0/3143612523 wait complete. 2024-09-13T18:35:53.364 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-09-13T18:35:53.365 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.407+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f0ef40d0b90 con 0x7f0ef40b2080 2024-09-13T18:35:53.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.408+0000 7f0eeaa00640 1 -- 172.21.15.192:0/2802123461 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0eec057a50 con 0x7f0ef40b2080 2024-09-13T18:35:53.411 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 msgr2=0x7f0ed406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 0x7f0ed406d1c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0034000 tx=0x7f0ee002e000 comp rx=0 tx=0).stop 2024-09-13T18:35:53.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 msgr2=0x7f0ef4147780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00caa0 tx=0x7f0eec00cf60 comp rx=0 tx=0).stop 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 shutdown_connections 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed406ad00 0x7f0ed406d1c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef415cf50 0x7f0ef41f5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef40d0620 0x7f0ef40b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 --2- 172.21.15.192:0/2802123461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef40b2080 0x7f0ef4147780 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.410+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 >> 172.21.15.192:0/2802123461 conn(0x7f0ef40d3400 msgr2=0x7f0ef41599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.411+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 shutdown_connections 2024-09-13T18:35:53.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.411+0000 7f0ef9400640 1 -- 172.21.15.192:0/2802123461 wait complete. 2024-09-13T18:35:53.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-13T18:35:53.430 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.437+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe318159d50 con 0x7fe3180b13a0 2024-09-13T18:35:53.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.438+0000 7fe30f400640 1 -- 172.21.15.192:0/693374786 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe318159d50 con 0x7fe3180b13a0 2024-09-13T18:35:53.440 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.440+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f386006fe70 con 0x7f38480047c0 2024-09-13T18:35:53.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.440+0000 7f385a000640 1 -- 172.21.15.192:0/1175051478 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3854058720 con 0x7f38480047c0 2024-09-13T18:35:53.443 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.441+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 msgr2=0x7fe2f806d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 0x7fe2f806d110 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe308001eb0 tx=0x7fe308001790 comp rx=0 tx=0).stop 2024-09-13T18:35:53.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 msgr2=0x7fe3181ee2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe310000f80 tx=0x7fe310004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 shutdown_connections 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe2f806ac50 0x7fe2f806d110 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe318151ed0 0x7fe3180aed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe3180b13a0 0x7fe3181ee2b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 --2- 172.21.15.192:0/693374786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe31806cae0 0x7fe3180addf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 >> 172.21.15.192:0/693374786 conn(0x7fe3180b0f90 msgr2=0x7fe3180b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 shutdown_connections 2024-09-13T18:35:53.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.442+0000 7fe31e000640 1 -- 172.21.15.192:0/693374786 wait complete. 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.443+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 msgr2=0x7f384406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 0x7f384406d0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3850033000 tx=0x7f3850035040 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 msgr2=0x7f3860148200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3854011ca0 tx=0x7f385400f610 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 shutdown_connections 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f384406ac00 0x7f384406d0c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f386006bad0 0x7f386015eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f386006c270 0x7f386006b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 --2- 172.21.15.192:0/1175051478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f38480047c0 0x7f3860148200 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 >> 172.21.15.192:0/1175051478 conn(0x7f38600b0f90 msgr2=0x7f386006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 shutdown_connections 2024-09-13T18:35:53.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.444+0000 7f3868800640 1 -- 172.21.15.192:0/1175051478 wait complete. 2024-09-13T18:35:53.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.454+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f889c0cbc60 con 0x7f889c0b2890 2024-09-13T18:35:53.457 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.454+0000 7f8892a00640 1 -- 172.21.15.192:0/3065545450 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f889c0cbc60 con 0x7f889c0b2890 2024-09-13T18:35:53.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.456+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f92c40ceb60 con 0x7f92c40d0620 2024-09-13T18:35:53.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f92c1600640 1 -- 172.21.15.192:0/3652884092 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f92b0017090 con 0x7f92c40d0620 2024-09-13T18:35:53.459 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 msgr2=0x7f887c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 0x7f887c06d1c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f889c156bd0 tx=0x7f888c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:53.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 msgr2=0x7f889c159c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f888800c390 tx=0x7f888800c790 comp rx=0 tx=0).stop 2024-09-13T18:35:53.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 shutdown_connections 2024-09-13T18:35:53.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ad00 0x7f887c06d1c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f889c0cd580 0x7f889c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f889c0b5e80 0x7f889c155c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.457+0000 7f88a1400640 1 --2- 172.21.15.192:0/3065545450 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f889c0b2890 0x7f889c159c30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.458+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 >> 172.21.15.192:0/3065545450 conn(0x7f889c0b4a20 msgr2=0x7f889c0b6380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.458+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 shutdown_connections 2024-09-13T18:35:53.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.458+0000 7f88a1400640 1 -- 172.21.15.192:0/3065545450 wait complete. 2024-09-13T18:35:53.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 msgr2=0x7f92a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 0x7f92a406d0c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f92b802a150 tx=0x7f92b802e000 comp rx=0 tx=0).stop 2024-09-13T18:35:53.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 msgr2=0x7f92c41f6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 0x7f92c41f6020 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c430 tx=0x7f92b000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 shutdown_connections 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f92a406ac00 0x7f92a406d0c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92c415cf50 0x7f92c41f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c40d0620 0x7f92c41f6020 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 --2- 172.21.15.192:0/3652884092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92c40b2080 0x7f92c415fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.459+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 >> 172.21.15.192:0/3652884092 conn(0x7f92c40d3400 msgr2=0x7f92c40cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.460+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f75dc0d2ca0 con 0x7f75dc15d150 2024-09-13T18:35:53.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.460+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 shutdown_connections 2024-09-13T18:35:53.466 INFO:teuthology.orchestra.run.smithi192.stdout:55834574854 2024-09-13T18:35:53.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.460+0000 7f75d2a00640 1 -- 172.21.15.192:0/1001256322 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75d407de60 con 0x7f75dc15d150 2024-09-13T18:35:53.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.461+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f051415b060 con 0x7f05140d0b30 2024-09-13T18:35:53.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.461+0000 7f92cc200640 1 -- 172.21.15.192:0/3652884092 wait complete. 2024-09-13T18:35:53.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.461+0000 7f050be00640 1 -- 172.21.15.192:0/1652999016 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f050c0585f0 con 0x7f05140d0b30 2024-09-13T18:35:53.467 INFO:teuthology.orchestra.run.smithi192.stdout:60129542152 2024-09-13T18:35:53.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 msgr2=0x7f75bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 0x7f75bc06d0c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f75dc0b0ff0 tx=0x7f75cc007e30 comp rx=0 tx=0).stop 2024-09-13T18:35:53.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 msgr2=0x7f75dc156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75d40093e0 tx=0x7f75d4004a40 comp rx=0 tx=0).stop 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 shutdown_connections 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75bc06ac00 0x7f75bc06d0c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75dc15d150 0x7f75dc156e50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75dc0d1d40 0x7f75dc1f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 --2- 172.21.15.192:0/1001256322 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75dc0b3cd0 0x7f75dc1565a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 >> 172.21.15.192:0/1001256322 conn(0x7f75dc0b4b60 msgr2=0x7f75dc0cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 shutdown_connections 2024-09-13T18:35:53.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.464+0000 7f75e1a00640 1 -- 172.21.15.192:0/1001256322 wait complete. 2024-09-13T18:35:53.470 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-09-13T18:35:53.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 msgr2=0x7f04f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 0x7f04f406d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0500000f60 tx=0x7f05000079b0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 msgr2=0x7f051415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f050c00efc0 tx=0x7f050c00c490 comp rx=0 tx=0).stop 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 shutdown_connections 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f04f406acd0 0x7f04f406d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f051415ce50 0x7f0514149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05140d2980 0x7f051415fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 --2- 172.21.15.192:0/1652999016 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05140d0b30 0x7f051415e9a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 >> 172.21.15.192:0/1652999016 conn(0x7f05140d3000 msgr2=0x7f05140d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.465+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 shutdown_connections 2024-09-13T18:35:53.471 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.472 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-09-13T18:35:53.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.466+0000 7f051ac00640 1 -- 172.21.15.192:0/1652999016 wait complete. 2024-09-13T18:35:53.473 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.485 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-13T18:35:53.486 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.7 2024-09-13T18:35:53.486 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-09-13T18:35:53.496 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2024-09-13T18:35:53.497 DEBUG:teuthology.parallel:result is None 2024-09-13T18:35:53.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:35:53.497 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:53.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.684+0000 7ff2fc000640 1 Processor -- start 2024-09-13T18:35:53.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.684+0000 7ff2fc000640 1 -- start start 2024-09-13T18:35:53.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fc000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2f415e790 0x7ff2f40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fc000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fc000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f415ec00 con 0x7ff2f40cacd0 2024-09-13T18:35:53.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fc000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2f40cb5f0 con 0x7ff2f415e790 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fc000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f4140480 con 0x7ff2f415bc20 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2f415e790 0x7ff2f40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2f415e790 0x7ff2f40cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57524/0 (socket says 172.21.15.192:57524) 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 -- 172.21.15.192:0/2153539918 learned_addr learned my addr 172.21.15.192:0/2153539918 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2fa000640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 -- 172.21.15.192:0/2153539918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 msgr2=0x7ff2f40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 -- 172.21.15.192:0/2153539918 >> v1:172.21.15.194:6789/0 conn(0x7ff2f40cacd0 legacy=0x7ff2f4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.686+0000 7ff2f8c00640 1 -- 172.21.15.192:0/2153539918 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f415ee90 con 0x7ff2f415e790 2024-09-13T18:35:53.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.687+0000 7ff2f8c00640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f415e790 0x7ff2f40cb0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009870 tx=0x7ff2e002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3046467f6a64542c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.687+0000 7ff2f3e00640 1 -- 172.21.15.192:0/2153539918 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0032440 con 0x7ff2f415e790 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2f3e00640 1 -- 172.21.15.192:0/2153539918 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e00325a0 con 0x7ff2f415e790 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2f3e00640 1 -- 172.21.15.192:0/2153539918 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e0032930 con 0x7ff2f415e790 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 -- 172.21.15.192:0/2153539918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f415e790 msgr2=0x7ff2f40cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f415e790 0x7ff2f40cb0b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0009870 tx=0x7ff2e002a250 comp rx=0 tx=0).stop 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 -- 172.21.15.192:0/2153539918 shutdown_connections 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2153539918 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f415e790 0x7ff2f40cb0b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 -- 172.21.15.192:0/2153539918 >> 172.21.15.192:0/2153539918 conn(0x7ff2f40ae960 msgr2=0x7ff2f406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 -- 172.21.15.192:0/2153539918 shutdown_connections 2024-09-13T18:35:53.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.688+0000 7ff2fc000640 1 -- 172.21.15.192:0/2153539918 wait complete. 2024-09-13T18:35:53.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.690+0000 7ff2fc000640 1 Processor -- start 2024-09-13T18:35:53.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.690+0000 7ff2fc000640 1 -- start start 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 0x7ff2f40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40cc480 con 0x7ff2f40cacd0 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40cc760 con 0x7ff2f415e790 2024-09-13T18:35:53.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fc000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f40cca40 con 0x7ff2f415bc20 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57526/0 (socket says 172.21.15.192:57526) 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 -- 172.21.15.192:0/2815239639 learned_addr learned my addr 172.21.15.192:0/2815239639 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f8c00640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fa000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 0x7ff2f40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 -- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 msgr2=0x7ff2f40cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 -- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 msgr2=0x7ff2f40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 0x7ff2f40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2f9600640 1 -- 172.21.15.192:0/2815239639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e00094d0 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.691+0000 7ff2fa000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 0x7ff2f40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2f9600640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c730 tx=0x7ff2e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8006d50 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2e800ce40 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f40ccd20 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8003bb0 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.692+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f40cd520 con 0x7ff2f40cacd0 2024-09-13T18:35:53.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.693+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f40cd240 con 0x7ff2f40cacd0 2024-09-13T18:35:53.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.694+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2e8003d10 con 0x7ff2f40cacd0 2024-09-13T18:35:53.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.695+0000 7ff2f1600640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 0x7ff2d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:53.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.695+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2e8088df0 con 0x7ff2f40cacd0 2024-09-13T18:35:53.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.695+0000 7ff2f8c00640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 0x7ff2d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:53.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.696+0000 7ff2f8c00640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 0x7ff2d406d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0034000 tx=0x7ff2e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:53.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.699+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2e8057af0 con 0x7ff2f40cacd0 2024-09-13T18:35:53.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.868+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2f415f450 con 0x7ff2d406ac00 2024-09-13T18:35:53.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.874+0000 7ff2f1600640 1 -- 172.21.15.192:0/2815239639 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260198 (secure 0 0 0) 0x7ff2e0032a10 con 0x7ff2d406ac00 2024-09-13T18:35:53.880 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:53.882 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:53.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 msgr2=0x7ff2d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 0x7ff2d406d0c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0034000 tx=0x7ff2e002e000 comp rx=0 tx=0).stop 2024-09-13T18:35:53.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 msgr2=0x7ff2f413d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff2e800c730 tx=0x7ff2e800cbf0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 shutdown_connections 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2d406ac00 0x7ff2d406d0c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2f415e790 0x7ff2f40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2f415bc20 0x7ff2f40cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 --2- 172.21.15.192:0/2815239639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2f40cacd0 0x7ff2f413d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.878+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 >> 172.21.15.192:0/2815239639 conn(0x7ff2f40ae960 msgr2=0x7ff2f415d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.879+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 shutdown_connections 2024-09-13T18:35:53.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:53.879+0000 7ff2fc000640 1 -- 172.21.15.192:0/2815239639 wait complete. 2024-09-13T18:35:53.897 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:35:52.736894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.510722"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251856+0000","last_change":"2024-09-13T18:35:40.236289+0000","last_active":"2024-09-13T18:35:41.251856+0000","last_peered":"2024-09-13T18:35:41.251856+0000","last_clean":"2024-09-13T18:35:41.251856+0000","last_became_active":"2024-09-13T18:35:40.235046+0000","last_became_peered":"2024-09-13T18:35:40.235046+0000","last_unstale":"2024-09-13T18:35:41.251856+0000","last_undegraded":"2024-09-13T18:35:41.251856+0000","last_fullsized":"2024-09-13T18:35:41.251856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250892+0000","last_change":"2024-09-13T18:35:40.232789+0000","last_active":"2024-09-13T18:35:41.250892+0000","last_peered":"2024-09-13T18:35:41.250892+0000","last_clean":"2024-09-13T18:35:41.250892+0000","last_became_active":"2024-09-13T18:35:40.230926+0000","last_became_peered":"2024-09-13T18:35:40.230926+0000","last_unstale":"2024-09-13T18:35:41.250892+0000","last_undegraded":"2024-09-13T18:35:41.250892+0000","last_fullsized":"2024-09-13T18:35:41.250892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250999+0000","last_change":"2024-09-13T18:35:40.242574+0000","last_active":"2024-09-13T18:35:41.250999+0000","last_peered":"2024-09-13T18:35:41.250999+0000","last_clean":"2024-09-13T18:35:41.250999+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.250999+0000","last_undegraded":"2024-09-13T18:35:41.250999+0000","last_fullsized":"2024-09-13T18:35:41.250999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251591+0000","last_change":"2024-09-13T18:35:40.243803+0000","last_active":"2024-09-13T18:35:41.251591+0000","last_peered":"2024-09-13T18:35:41.251591+0000","last_clean":"2024-09-13T18:35:41.251591+0000","last_became_active":"2024-09-13T18:35:40.243499+0000","last_became_peered":"2024-09-13T18:35:40.243499+0000","last_unstale":"2024-09-13T18:35:41.251591+0000","last_undegraded":"2024-09-13T18:35:41.251591+0000","last_fullsized":"2024-09-13T18:35:41.251591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251840+0000","last_change":"2024-09-13T18:35:40.240528+0000","last_active":"2024-09-13T18:35:41.251840+0000","last_peered":"2024-09-13T18:35:41.251840+0000","last_clean":"2024-09-13T18:35:41.251840+0000","last_became_active":"2024-09-13T18:35:40.240125+0000","last_became_peered":"2024-09-13T18:35:40.240125+0000","last_unstale":"2024-09-13T18:35:41.251840+0000","last_undegraded":"2024-09-13T18:35:41.251840+0000","last_fullsized":"2024-09-13T18:35:41.251840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251687+0000","last_change":"2024-09-13T18:35:40.242701+0000","last_active":"2024-09-13T18:35:41.251687+0000","last_peered":"2024-09-13T18:35:41.251687+0000","last_clean":"2024-09-13T18:35:41.251687+0000","last_became_active":"2024-09-13T18:35:40.235954+0000","last_became_peered":"2024-09-13T18:35:40.235954+0000","last_unstale":"2024-09-13T18:35:41.251687+0000","last_undegraded":"2024-09-13T18:35:41.251687+0000","last_fullsized":"2024-09-13T18:35:41.251687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250839+0000","last_change":"2024-09-13T18:35:40.241785+0000","last_active":"2024-09-13T18:35:41.250839+0000","last_peered":"2024-09-13T18:35:41.250839+0000","last_clean":"2024-09-13T18:35:41.250839+0000","last_became_active":"2024-09-13T18:35:40.241271+0000","last_became_peered":"2024-09-13T18:35:40.241271+0000","last_unstale":"2024-09-13T18:35:41.250839+0000","last_undegraded":"2024-09-13T18:35:41.250839+0000","last_fullsized":"2024-09-13T18:35:41.250839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239746+0000","last_change":"2024-09-13T18:35:39.815225+0000","last_active":"2024-09-13T18:35:40.239746+0000","last_peered":"2024-09-13T18:35:40.239746+0000","last_clean":"2024-09-13T18:35:40.239746+0000","last_became_active":"2024-09-13T18:35:39.814933+0000","last_became_peered":"2024-09-13T18:35:39.814933+0000","last_unstale":"2024-09-13T18:35:40.239746+0000","last_undegraded":"2024-09-13T18:35:40.239746+0000","last_fullsized":"2024-09-13T18:35:40.239746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251786+0000","last_change":"2024-09-13T18:35:40.236744+0000","last_active":"2024-09-13T18:35:41.251786+0000","last_peered":"2024-09-13T18:35:41.251786+0000","last_clean":"2024-09-13T18:35:41.251786+0000","last_became_active":"2024-09-13T18:35:40.235570+0000","last_became_peered":"2024-09-13T18:35:40.235570+0000","last_unstale":"2024-09-13T18:35:41.251786+0000","last_undegraded":"2024-09-13T18:35:41.251786+0000","last_fullsized":"2024-09-13T18:35:41.251786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:40.237581+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:40.237373+0000","last_became_peered":"2024-09-13T18:35:40.237373+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239755+0000","last_change":"2024-09-13T18:35:39.815819+0000","last_active":"2024-09-13T18:35:40.239755+0000","last_peered":"2024-09-13T18:35:40.239755+0000","last_clean":"2024-09-13T18:35:40.239755+0000","last_became_active":"2024-09-13T18:35:39.815608+0000","last_became_peered":"2024-09-13T18:35:39.815608+0000","last_unstale":"2024-09-13T18:35:40.239755+0000","last_undegraded":"2024-09-13T18:35:40.239755+0000","last_fullsized":"2024-09-13T18:35:40.239755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251062+0000","last_change":"2024-09-13T18:35:40.241481+0000","last_active":"2024-09-13T18:35:41.251062+0000","last_peered":"2024-09-13T18:35:41.251062+0000","last_clean":"2024-09-13T18:35:41.251062+0000","last_became_active":"2024-09-13T18:35:40.236707+0000","last_became_peered":"2024-09-13T18:35:40.236707+0000","last_unstale":"2024-09-13T18:35:41.251062+0000","last_undegraded":"2024-09-13T18:35:41.251062+0000","last_fullsized":"2024-09-13T18:35:41.251062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.233257+0000","last_change":"2024-09-13T18:35:39.814559+0000","last_active":"2024-09-13T18:35:40.233257+0000","last_peered":"2024-09-13T18:35:40.233257+0000","last_clean":"2024-09-13T18:35:40.233257+0000","last_became_active":"2024-09-13T18:35:39.814313+0000","last_became_peered":"2024-09-13T18:35:39.814313+0000","last_unstale":"2024-09-13T18:35:40.233257+0000","last_undegraded":"2024-09-13T18:35:40.233257+0000","last_fullsized":"2024-09-13T18:35:40.233257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251105+0000","last_change":"2024-09-13T18:35:40.240336+0000","last_active":"2024-09-13T18:35:41.251105+0000","last_peered":"2024-09-13T18:35:41.251105+0000","last_clean":"2024-09-13T18:35:41.251105+0000","last_became_active":"2024-09-13T18:35:40.235298+0000","last_became_peered":"2024-09-13T18:35:40.235298+0000","last_unstale":"2024-09-13T18:35:41.251105+0000","last_undegraded":"2024-09-13T18:35:41.251105+0000","last_fullsized":"2024-09-13T18:35:41.251105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.245172+0000","last_change":"2024-09-13T18:35:39.815215+0000","last_active":"2024-09-13T18:35:40.245172+0000","last_peered":"2024-09-13T18:35:40.245172+0000","last_clean":"2024-09-13T18:35:40.245172+0000","last_became_active":"2024-09-13T18:35:39.814835+0000","last_became_peered":"2024-09-13T18:35:39.814835+0000","last_unstale":"2024-09-13T18:35:40.245172+0000","last_undegraded":"2024-09-13T18:35:40.245172+0000","last_fullsized":"2024-09-13T18:35:40.245172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250944+0000","last_change":"2024-09-13T18:35:40.240536+0000","last_active":"2024-09-13T18:35:41.250944+0000","last_peered":"2024-09-13T18:35:41.250944+0000","last_clean":"2024-09-13T18:35:41.250944+0000","last_became_active":"2024-09-13T18:35:40.236412+0000","last_became_peered":"2024-09-13T18:35:40.236412+0000","last_unstale":"2024-09-13T18:35:41.250944+0000","last_undegraded":"2024-09-13T18:35:41.250944+0000","last_fullsized":"2024-09-13T18:35:41.250944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:53.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:35:54.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.088+0000 7ffa89a00640 1 Processor -- start 2024-09-13T18:35:54.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.088+0000 7ffa89a00640 1 -- start start 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa89a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa841604c0 0x7ffa84066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa89a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 0x7ffa840cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa89a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa84070570 con 0x7ffa84070f80 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa89a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa840ce180 con 0x7ffa841604c0 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa89a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa84066a50 con 0x7ffa840c9ae0 2024-09-13T18:35:54.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa82a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa841604c0 0x7ffa84066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa82a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffa841604c0 0x7ffa84066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57540/0 (socket says 172.21.15.192:57540) 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa82a00640 1 -- 172.21.15.192:0/823738948 learned_addr learned my addr 172.21.15.192:0/823738948 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.089+0000 7ffa83400640 1 --2- 172.21.15.192:0/823738948 >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 0x7ffa840cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.090+0000 7ffa82a00640 1 -- 172.21.15.192:0/823738948 >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 msgr2=0x7ffa840cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.090+0000 7ffa82a00640 1 --2- 172.21.15.192:0/823738948 >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 0x7ffa840cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.090+0000 7ffa82a00640 1 -- 172.21.15.192:0/823738948 >> v1:172.21.15.194:6789/0 conn(0x7ffa84070f80 legacy=0x7ffa840cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.090+0000 7ffa82a00640 1 -- 172.21.15.192:0/823738948 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa840707a0 con 0x7ffa841604c0 2024-09-13T18:35:54.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.090+0000 7ffa83400640 1 --2- 172.21.15.192:0/823738948 >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 0x7ffa840cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:54.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa82a00640 1 --2- 172.21.15.192:0/823738948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa841604c0 0x7ffa84066510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb363b9b7e37145 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa81600640 1 -- 172.21.15.192:0/823738948 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74032440 con 0x7ffa841604c0 2024-09-13T18:35:54.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa81600640 1 -- 172.21.15.192:0/823738948 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa740325a0 con 0x7ffa841604c0 2024-09-13T18:35:54.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa81600640 1 -- 172.21.15.192:0/823738948 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74032930 con 0x7ffa841604c0 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 -- 172.21.15.192:0/823738948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa841604c0 msgr2=0x7ffa84066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 --2- 172.21.15.192:0/823738948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa841604c0 0x7ffa84066510 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ffa74009870 tx=0x7ffa7402a2a0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 -- 172.21.15.192:0/823738948 shutdown_connections 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 --2- 172.21.15.192:0/823738948 >> v2:172.21.15.194:3300/0 conn(0x7ffa840c9ae0 0x7ffa840cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 --2- 172.21.15.192:0/823738948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa841604c0 0x7ffa84066510 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.091+0000 7ffa89a00640 1 -- 172.21.15.192:0/823738948 >> 172.21.15.192:0/823738948 conn(0x7ffa840cf490 msgr2=0x7ffa840cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.092+0000 7ffa89a00640 1 -- 172.21.15.192:0/823738948 shutdown_connections 2024-09-13T18:35:54.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.092+0000 7ffa89a00640 1 -- 172.21.15.192:0/823738948 wait complete. 2024-09-13T18:35:54.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.093+0000 7ffa89a00640 1 Processor -- start 2024-09-13T18:35:54.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.093+0000 7ffa89a00640 1 -- start start 2024-09-13T18:35:54.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa840c9ae0 0x7ffa8415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 0x7ffa840ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa8415ad40 con 0x7ffa84070f80 2024-09-13T18:35:54.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b2800 con 0x7ffa841604c0 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa89a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa840b2ae0 con 0x7ffa840c9ae0 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa82a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa82a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57550/0 (socket says 172.21.15.192:57550) 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.094+0000 7ffa82a00640 1 -- 172.21.15.192:0/1400340801 learned_addr learned my addr 172.21.15.192:0/1400340801 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa83400640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 0x7ffa840ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82000640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa840c9ae0 0x7ffa8415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 -- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa840c9ae0 msgr2=0x7ffa8415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa840c9ae0 0x7ffa8415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 -- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 msgr2=0x7ffa840ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 0x7ffa840ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 -- 172.21.15.192:0/1400340801 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa740094d0 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa83400640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 0x7ffa840ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa82a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa74000c00 tx=0x7ffa740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa74032440 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa74030b80 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa840b2dc0 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.095+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa7403d440 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.096+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa840b3380 con 0x7ffa84070f80 2024-09-13T18:35:54.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.097+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa840b3570 con 0x7ffa84070f80 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.097+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffa74039040 con 0x7ffa84070f80 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.098+0000 7ffa7aa00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 0x7ffa6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.098+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffa740a9f20 con 0x7ffa84070f80 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.098+0000 7ffa82000640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 0x7ffa6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.099+0000 7ffa82000640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 0x7ffa6406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa841f6220 tx=0x7ffa70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.103+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffa740750f0 con 0x7ffa84070f80 2024-09-13T18:35:54.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.267+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa840aea60 con 0x7ffa6406ac00 2024-09-13T18:35:54.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.274+0000 7ffa7aa00640 1 -- 172.21.15.192:0/1400340801 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260198 (secure 0 0 0) 0x7ffa840aea60 con 0x7ffa6406ac00 2024-09-13T18:35:54.280 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 msgr2=0x7ffa6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 0x7ffa6406d0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffa841f6220 tx=0x7ffa70009040 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 msgr2=0x7ffa84153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ffa74000c00 tx=0x7ffa740046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 shutdown_connections 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffa6406ac00 0x7ffa6406d0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffa841604c0 0x7ffa840ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffa840c9ae0 0x7ffa8415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 --2- 172.21.15.192:0/1400340801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffa84070f80 0x7ffa84153060 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 >> 172.21.15.192:0/1400340801 conn(0x7ffa840cf490 msgr2=0x7ffa840af0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 shutdown_connections 2024-09-13T18:35:54.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.278+0000 7ffa89a00640 1 -- 172.21.15.192:0/1400340801 wait complete. 2024-09-13T18:35:54.296 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-13T18:35:52.736894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1747,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560752,"statfs":{"total":1600000000,"available":1598210292,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.510722"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251676+0000","last_change":"2024-09-13T18:35:40.232931+0000","last_active":"2024-09-13T18:35:41.251676+0000","last_peered":"2024-09-13T18:35:41.251676+0000","last_clean":"2024-09-13T18:35:41.251676+0000","last_became_active":"2024-09-13T18:35:40.232616+0000","last_became_peered":"2024-09-13T18:35:40.232616+0000","last_unstale":"2024-09-13T18:35:41.251676+0000","last_undegraded":"2024-09-13T18:35:41.251676+0000","last_fullsized":"2024-09-13T18:35:41.251676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:07:14.403753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251856+0000","last_change":"2024-09-13T18:35:40.236289+0000","last_active":"2024-09-13T18:35:41.251856+0000","last_peered":"2024-09-13T18:35:41.251856+0000","last_clean":"2024-09-13T18:35:41.251856+0000","last_became_active":"2024-09-13T18:35:40.235046+0000","last_became_peered":"2024-09-13T18:35:40.235046+0000","last_unstale":"2024-09-13T18:35:41.251856+0000","last_undegraded":"2024-09-13T18:35:41.251856+0000","last_fullsized":"2024-09-13T18:35:41.251856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250892+0000","last_change":"2024-09-13T18:35:40.232789+0000","last_active":"2024-09-13T18:35:41.250892+0000","last_peered":"2024-09-13T18:35:41.250892+0000","last_clean":"2024-09-13T18:35:41.250892+0000","last_became_active":"2024-09-13T18:35:40.230926+0000","last_became_peered":"2024-09-13T18:35:40.230926+0000","last_unstale":"2024-09-13T18:35:41.250892+0000","last_undegraded":"2024-09-13T18:35:41.250892+0000","last_fullsized":"2024-09-13T18:35:41.250892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230349+0000","last_change":"2024-09-13T18:35:40.231133+0000","last_active":"2024-09-13T18:35:41.230349+0000","last_peered":"2024-09-13T18:35:41.230349+0000","last_clean":"2024-09-13T18:35:41.230349+0000","last_became_active":"2024-09-13T18:35:40.230518+0000","last_became_peered":"2024-09-13T18:35:40.230518+0000","last_unstale":"2024-09-13T18:35:41.230349+0000","last_undegraded":"2024-09-13T18:35:41.230349+0000","last_fullsized":"2024-09-13T18:35:41.230349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252288+0000","last_change":"2024-09-13T18:35:40.241164+0000","last_active":"2024-09-13T18:35:41.252288+0000","last_peered":"2024-09-13T18:35:41.252288+0000","last_clean":"2024-09-13T18:35:41.252288+0000","last_became_active":"2024-09-13T18:35:40.240948+0000","last_became_peered":"2024-09-13T18:35:40.240948+0000","last_unstale":"2024-09-13T18:35:41.252288+0000","last_undegraded":"2024-09-13T18:35:41.252288+0000","last_fullsized":"2024-09-13T18:35:41.252288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231276+0000","last_change":"2024-09-13T18:35:40.230724+0000","last_active":"2024-09-13T18:35:41.231276+0000","last_peered":"2024-09-13T18:35:41.231276+0000","last_clean":"2024-09-13T18:35:41.231276+0000","last_became_active":"2024-09-13T18:35:40.230026+0000","last_became_peered":"2024-09-13T18:35:40.230026+0000","last_unstale":"2024-09-13T18:35:41.231276+0000","last_undegraded":"2024-09-13T18:35:41.231276+0000","last_fullsized":"2024-09-13T18:35:41.231276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251448+0000","last_change":"2024-09-13T18:35:40.235843+0000","last_active":"2024-09-13T18:35:41.251448+0000","last_peered":"2024-09-13T18:35:41.251448+0000","last_clean":"2024-09-13T18:35:41.251448+0000","last_became_active":"2024-09-13T18:35:40.235641+0000","last_became_peered":"2024-09-13T18:35:40.235641+0000","last_unstale":"2024-09-13T18:35:41.251448+0000","last_undegraded":"2024-09-13T18:35:41.251448+0000","last_fullsized":"2024-09-13T18:35:41.251448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250999+0000","last_change":"2024-09-13T18:35:40.242574+0000","last_active":"2024-09-13T18:35:41.250999+0000","last_peered":"2024-09-13T18:35:41.250999+0000","last_clean":"2024-09-13T18:35:41.250999+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.250999+0000","last_undegraded":"2024-09-13T18:35:41.250999+0000","last_fullsized":"2024-09-13T18:35:41.250999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250650+0000","last_change":"2024-09-13T18:35:40.236070+0000","last_active":"2024-09-13T18:35:41.250650+0000","last_peered":"2024-09-13T18:35:41.250650+0000","last_clean":"2024-09-13T18:35:41.250650+0000","last_became_active":"2024-09-13T18:35:40.235769+0000","last_became_peered":"2024-09-13T18:35:40.235769+0000","last_unstale":"2024-09-13T18:35:41.250650+0000","last_undegraded":"2024-09-13T18:35:41.250650+0000","last_fullsized":"2024-09-13T18:35:41.250650+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252363+0000","last_change":"2024-09-13T18:35:40.236779+0000","last_active":"2024-09-13T18:35:41.252363+0000","last_peered":"2024-09-13T18:35:41.252363+0000","last_clean":"2024-09-13T18:35:41.252363+0000","last_became_active":"2024-09-13T18:35:40.233811+0000","last_became_peered":"2024-09-13T18:35:40.233811+0000","last_unstale":"2024-09-13T18:35:41.252363+0000","last_undegraded":"2024-09-13T18:35:41.252363+0000","last_fullsized":"2024-09-13T18:35:41.252363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251751+0000","last_change":"2024-09-13T18:35:40.232815+0000","last_active":"2024-09-13T18:35:41.251751+0000","last_peered":"2024-09-13T18:35:41.251751+0000","last_clean":"2024-09-13T18:35:41.251751+0000","last_became_active":"2024-09-13T18:35:40.232349+0000","last_became_peered":"2024-09-13T18:35:40.232349+0000","last_unstale":"2024-09-13T18:35:41.251751+0000","last_undegraded":"2024-09-13T18:35:41.251751+0000","last_fullsized":"2024-09-13T18:35:41.251751+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:32.025857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251163+0000","last_change":"2024-09-13T18:35:40.230355+0000","last_active":"2024-09-13T18:35:41.251163+0000","last_peered":"2024-09-13T18:35:41.251163+0000","last_clean":"2024-09-13T18:35:41.251163+0000","last_became_active":"2024-09-13T18:35:40.229259+0000","last_became_peered":"2024-09-13T18:35:40.229259+0000","last_unstale":"2024-09-13T18:35:41.251163+0000","last_undegraded":"2024-09-13T18:35:41.251163+0000","last_fullsized":"2024-09-13T18:35:41.251163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251526+0000","last_change":"2024-09-13T18:35:40.242620+0000","last_active":"2024-09-13T18:35:41.251526+0000","last_peered":"2024-09-13T18:35:41.251526+0000","last_clean":"2024-09-13T18:35:41.251526+0000","last_became_active":"2024-09-13T18:35:40.241946+0000","last_became_peered":"2024-09-13T18:35:40.241946+0000","last_unstale":"2024-09-13T18:35:41.251526+0000","last_undegraded":"2024-09-13T18:35:41.251526+0000","last_fullsized":"2024-09-13T18:35:41.251526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:38.838728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250997+0000","last_change":"2024-09-13T18:35:40.229996+0000","last_active":"2024-09-13T18:35:41.250997+0000","last_peered":"2024-09-13T18:35:41.250997+0000","last_clean":"2024-09-13T18:35:41.250997+0000","last_became_active":"2024-09-13T18:35:40.229684+0000","last_became_peered":"2024-09-13T18:35:40.229684+0000","last_unstale":"2024-09-13T18:35:41.250997+0000","last_undegraded":"2024-09-13T18:35:41.250997+0000","last_fullsized":"2024-09-13T18:35:41.250997+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251591+0000","last_change":"2024-09-13T18:35:40.243803+0000","last_active":"2024-09-13T18:35:41.251591+0000","last_peered":"2024-09-13T18:35:41.251591+0000","last_clean":"2024-09-13T18:35:41.251591+0000","last_became_active":"2024-09-13T18:35:40.243499+0000","last_became_peered":"2024-09-13T18:35:40.243499+0000","last_unstale":"2024-09-13T18:35:41.251591+0000","last_undegraded":"2024-09-13T18:35:41.251591+0000","last_fullsized":"2024-09-13T18:35:41.251591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230727+0000","last_change":"2024-09-13T18:35:40.234705+0000","last_active":"2024-09-13T18:35:41.230727+0000","last_peered":"2024-09-13T18:35:41.230727+0000","last_clean":"2024-09-13T18:35:41.230727+0000","last_became_active":"2024-09-13T18:35:40.233898+0000","last_became_peered":"2024-09-13T18:35:40.233898+0000","last_unstale":"2024-09-13T18:35:41.230727+0000","last_undegraded":"2024-09-13T18:35:41.230727+0000","last_fullsized":"2024-09-13T18:35:41.230727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:25.624840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230828+0000","last_change":"2024-09-13T18:35:40.243450+0000","last_active":"2024-09-13T18:35:41.230828+0000","last_peered":"2024-09-13T18:35:41.230828+0000","last_clean":"2024-09-13T18:35:41.230828+0000","last_became_active":"2024-09-13T18:35:40.242985+0000","last_became_peered":"2024-09-13T18:35:40.242985+0000","last_unstale":"2024-09-13T18:35:41.230828+0000","last_undegraded":"2024-09-13T18:35:41.230828+0000","last_fullsized":"2024-09-13T18:35:41.230828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.498858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226726+0000","last_change":"2024-09-13T18:35:40.239050+0000","last_active":"2024-09-13T18:35:41.226726+0000","last_peered":"2024-09-13T18:35:41.226726+0000","last_clean":"2024-09-13T18:35:41.226726+0000","last_became_active":"2024-09-13T18:35:40.238478+0000","last_became_peered":"2024-09-13T18:35:40.238478+0000","last_unstale":"2024-09-13T18:35:41.226726+0000","last_undegraded":"2024-09-13T18:35:41.226726+0000","last_fullsized":"2024-09-13T18:35:41.226726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:06.387416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230550+0000","last_change":"2024-09-13T18:35:40.229468+0000","last_active":"2024-09-13T18:35:41.230550+0000","last_peered":"2024-09-13T18:35:41.230550+0000","last_clean":"2024-09-13T18:35:41.230550+0000","last_became_active":"2024-09-13T18:35:40.229169+0000","last_became_peered":"2024-09-13T18:35:40.229169+0000","last_unstale":"2024-09-13T18:35:41.230550+0000","last_undegraded":"2024-09-13T18:35:41.230550+0000","last_fullsized":"2024-09-13T18:35:41.230550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:44:23.767297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252437+0000","last_change":"2024-09-13T18:35:40.225965+0000","last_active":"2024-09-13T18:35:41.252437+0000","last_peered":"2024-09-13T18:35:41.252437+0000","last_clean":"2024-09-13T18:35:41.252437+0000","last_became_active":"2024-09-13T18:35:40.224737+0000","last_became_peered":"2024-09-13T18:35:40.224737+0000","last_unstale":"2024-09-13T18:35:41.252437+0000","last_undegraded":"2024-09-13T18:35:41.252437+0000","last_fullsized":"2024-09-13T18:35:41.252437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:57.282565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251663+0000","last_change":"2024-09-13T18:35:40.233343+0000","last_active":"2024-09-13T18:35:41.251663+0000","last_peered":"2024-09-13T18:35:41.251663+0000","last_clean":"2024-09-13T18:35:41.251663+0000","last_became_active":"2024-09-13T18:35:40.231682+0000","last_became_peered":"2024-09-13T18:35:40.231682+0000","last_unstale":"2024-09-13T18:35:41.251663+0000","last_undegraded":"2024-09-13T18:35:41.251663+0000","last_fullsized":"2024-09-13T18:35:41.251663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:37.913812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.225539+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.225276+0000","last_became_peered":"2024-09-13T18:35:40.225276+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251840+0000","last_change":"2024-09-13T18:35:40.240528+0000","last_active":"2024-09-13T18:35:41.251840+0000","last_peered":"2024-09-13T18:35:41.251840+0000","last_clean":"2024-09-13T18:35:41.251840+0000","last_became_active":"2024-09-13T18:35:40.240125+0000","last_became_peered":"2024-09-13T18:35:40.240125+0000","last_unstale":"2024-09-13T18:35:41.251840+0000","last_undegraded":"2024-09-13T18:35:41.251840+0000","last_fullsized":"2024-09-13T18:35:41.251840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:54:01.187143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230288+0000","last_change":"2024-09-13T18:35:40.241972+0000","last_active":"2024-09-13T18:35:41.230288+0000","last_peered":"2024-09-13T18:35:41.230288+0000","last_clean":"2024-09-13T18:35:41.230288+0000","last_became_active":"2024-09-13T18:35:40.241757+0000","last_became_peered":"2024-09-13T18:35:40.241757+0000","last_unstale":"2024-09-13T18:35:41.230288+0000","last_undegraded":"2024-09-13T18:35:41.230288+0000","last_fullsized":"2024-09-13T18:35:41.230288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:25:33.349616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251687+0000","last_change":"2024-09-13T18:35:40.242701+0000","last_active":"2024-09-13T18:35:41.251687+0000","last_peered":"2024-09-13T18:35:41.251687+0000","last_clean":"2024-09-13T18:35:41.251687+0000","last_became_active":"2024-09-13T18:35:40.235954+0000","last_became_peered":"2024-09-13T18:35:40.235954+0000","last_unstale":"2024-09-13T18:35:41.251687+0000","last_undegraded":"2024-09-13T18:35:41.251687+0000","last_fullsized":"2024-09-13T18:35:41.251687+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231355+0000","last_change":"2024-09-13T18:35:40.237139+0000","last_active":"2024-09-13T18:35:41.231355+0000","last_peered":"2024-09-13T18:35:41.231355+0000","last_clean":"2024-09-13T18:35:41.231355+0000","last_became_active":"2024-09-13T18:35:40.236781+0000","last_became_peered":"2024-09-13T18:35:40.236781+0000","last_unstale":"2024-09-13T18:35:41.231355+0000","last_undegraded":"2024-09-13T18:35:41.231355+0000","last_fullsized":"2024-09-13T18:35:41.231355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252088+0000","last_change":"2024-09-13T18:35:40.232924+0000","last_active":"2024-09-13T18:35:41.252088+0000","last_peered":"2024-09-13T18:35:41.252088+0000","last_clean":"2024-09-13T18:35:41.252088+0000","last_became_active":"2024-09-13T18:35:40.232637+0000","last_became_peered":"2024-09-13T18:35:40.232637+0000","last_unstale":"2024-09-13T18:35:41.252088+0000","last_undegraded":"2024-09-13T18:35:41.252088+0000","last_fullsized":"2024-09-13T18:35:41.252088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251612+0000","last_change":"2024-09-13T18:35:40.242480+0000","last_active":"2024-09-13T18:35:41.251612+0000","last_peered":"2024-09-13T18:35:41.251612+0000","last_clean":"2024-09-13T18:35:41.251612+0000","last_became_active":"2024-09-13T18:35:40.241665+0000","last_became_peered":"2024-09-13T18:35:40.241665+0000","last_unstale":"2024-09-13T18:35:41.251612+0000","last_undegraded":"2024-09-13T18:35:41.251612+0000","last_fullsized":"2024-09-13T18:35:41.251612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250839+0000","last_change":"2024-09-13T18:35:40.241785+0000","last_active":"2024-09-13T18:35:41.250839+0000","last_peered":"2024-09-13T18:35:41.250839+0000","last_clean":"2024-09-13T18:35:41.250839+0000","last_became_active":"2024-09-13T18:35:40.241271+0000","last_became_peered":"2024-09-13T18:35:40.241271+0000","last_unstale":"2024-09-13T18:35:41.250839+0000","last_undegraded":"2024-09-13T18:35:41.250839+0000","last_fullsized":"2024-09-13T18:35:41.250839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230392+0000","last_change":"2024-09-13T18:35:40.244504+0000","last_active":"2024-09-13T18:35:41.230392+0000","last_peered":"2024-09-13T18:35:41.230392+0000","last_clean":"2024-09-13T18:35:41.230392+0000","last_became_active":"2024-09-13T18:35:40.244166+0000","last_became_peered":"2024-09-13T18:35:40.244166+0000","last_unstale":"2024-09-13T18:35:41.230392+0000","last_undegraded":"2024-09-13T18:35:41.230392+0000","last_fullsized":"2024-09-13T18:35:41.230392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:12.263429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226962+0000","last_change":"2024-09-13T18:35:40.234605+0000","last_active":"2024-09-13T18:35:41.226962+0000","last_peered":"2024-09-13T18:35:41.226962+0000","last_clean":"2024-09-13T18:35:41.226962+0000","last_became_active":"2024-09-13T18:35:40.234341+0000","last_became_peered":"2024-09-13T18:35:40.234341+0000","last_unstale":"2024-09-13T18:35:41.226962+0000","last_undegraded":"2024-09-13T18:35:41.226962+0000","last_fullsized":"2024-09-13T18:35:41.226962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:30.770384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230586+0000","last_change":"2024-09-13T18:35:40.235181+0000","last_active":"2024-09-13T18:35:41.230586+0000","last_peered":"2024-09-13T18:35:41.230586+0000","last_clean":"2024-09-13T18:35:41.230586+0000","last_became_active":"2024-09-13T18:35:40.234548+0000","last_became_peered":"2024-09-13T18:35:40.234548+0000","last_unstale":"2024-09-13T18:35:41.230586+0000","last_undegraded":"2024-09-13T18:35:41.230586+0000","last_fullsized":"2024-09-13T18:35:41.230586+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250531+0000","last_change":"2024-09-13T18:35:40.231386+0000","last_active":"2024-09-13T18:35:41.250531+0000","last_peered":"2024-09-13T18:35:41.250531+0000","last_clean":"2024-09-13T18:35:41.250531+0000","last_became_active":"2024-09-13T18:35:40.231036+0000","last_became_peered":"2024-09-13T18:35:40.231036+0000","last_unstale":"2024-09-13T18:35:41.250531+0000","last_undegraded":"2024-09-13T18:35:41.250531+0000","last_fullsized":"2024-09-13T18:35:41.250531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239746+0000","last_change":"2024-09-13T18:35:39.815225+0000","last_active":"2024-09-13T18:35:40.239746+0000","last_peered":"2024-09-13T18:35:40.239746+0000","last_clean":"2024-09-13T18:35:40.239746+0000","last_became_active":"2024-09-13T18:35:39.814933+0000","last_became_peered":"2024-09-13T18:35:39.814933+0000","last_unstale":"2024-09-13T18:35:40.239746+0000","last_undegraded":"2024-09-13T18:35:40.239746+0000","last_fullsized":"2024-09-13T18:35:40.239746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251049+0000","last_change":"2024-09-13T18:35:40.237451+0000","last_active":"2024-09-13T18:35:41.251049+0000","last_peered":"2024-09-13T18:35:41.251049+0000","last_clean":"2024-09-13T18:35:41.251049+0000","last_became_active":"2024-09-13T18:35:40.237088+0000","last_became_peered":"2024-09-13T18:35:40.237088+0000","last_unstale":"2024-09-13T18:35:41.251049+0000","last_undegraded":"2024-09-13T18:35:41.251049+0000","last_fullsized":"2024-09-13T18:35:41.251049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:26:48.016586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230320+0000","last_change":"2024-09-13T18:35:39.814941+0000","last_active":"2024-09-13T18:35:41.230320+0000","last_peered":"2024-09-13T18:35:41.230320+0000","last_clean":"2024-09-13T18:35:41.230320+0000","last_became_active":"2024-09-13T18:35:39.814701+0000","last_became_peered":"2024-09-13T18:35:39.814701+0000","last_unstale":"2024-09-13T18:35:41.230320+0000","last_undegraded":"2024-09-13T18:35:41.230320+0000","last_fullsized":"2024-09-13T18:35:41.230320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:41.755010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251852+0000","last_change":"2024-09-13T18:35:39.814398+0000","last_active":"2024-09-13T18:35:41.251852+0000","last_peered":"2024-09-13T18:35:41.251852+0000","last_clean":"2024-09-13T18:35:41.251852+0000","last_became_active":"2024-09-13T18:35:39.814146+0000","last_became_peered":"2024-09-13T18:35:39.814146+0000","last_unstale":"2024-09-13T18:35:41.251852+0000","last_undegraded":"2024-09-13T18:35:41.251852+0000","last_fullsized":"2024-09-13T18:35:41.251852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251786+0000","last_change":"2024-09-13T18:35:40.236744+0000","last_active":"2024-09-13T18:35:41.251786+0000","last_peered":"2024-09-13T18:35:41.251786+0000","last_clean":"2024-09-13T18:35:41.251786+0000","last_became_active":"2024-09-13T18:35:40.235570+0000","last_became_peered":"2024-09-13T18:35:40.235570+0000","last_unstale":"2024-09-13T18:35:41.251786+0000","last_undegraded":"2024-09-13T18:35:41.251786+0000","last_fullsized":"2024-09-13T18:35:41.251786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230700+0000","last_change":"2024-09-13T18:35:39.809245+0000","last_active":"2024-09-13T18:35:41.230700+0000","last_peered":"2024-09-13T18:35:41.230700+0000","last_clean":"2024-09-13T18:35:41.230700+0000","last_became_active":"2024-09-13T18:35:39.809012+0000","last_became_peered":"2024-09-13T18:35:39.809012+0000","last_unstale":"2024-09-13T18:35:41.230700+0000","last_undegraded":"2024-09-13T18:35:41.230700+0000","last_fullsized":"2024-09-13T18:35:41.230700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:19.675340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251123+0000","last_change":"2024-09-13T18:35:40.237703+0000","last_active":"2024-09-13T18:35:41.251123+0000","last_peered":"2024-09-13T18:35:41.251123+0000","last_clean":"2024-09-13T18:35:41.251123+0000","last_became_active":"2024-09-13T18:35:40.237478+0000","last_became_peered":"2024-09-13T18:35:40.237478+0000","last_unstale":"2024-09-13T18:35:41.251123+0000","last_undegraded":"2024-09-13T18:35:41.251123+0000","last_fullsized":"2024-09-13T18:35:41.251123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:29:20.680337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252138+0000","last_change":"2024-09-13T18:35:39.808459+0000","last_active":"2024-09-13T18:35:41.252138+0000","last_peered":"2024-09-13T18:35:41.252138+0000","last_clean":"2024-09-13T18:35:41.252138+0000","last_became_active":"2024-09-13T18:35:39.808234+0000","last_became_peered":"2024-09-13T18:35:39.808234+0000","last_unstale":"2024-09-13T18:35:41.252138+0000","last_undegraded":"2024-09-13T18:35:41.252138+0000","last_fullsized":"2024-09-13T18:35:41.252138+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230662+0000","last_change":"2024-09-13T18:35:40.235359+0000","last_active":"2024-09-13T18:35:41.230662+0000","last_peered":"2024-09-13T18:35:41.230662+0000","last_clean":"2024-09-13T18:35:41.230662+0000","last_became_active":"2024-09-13T18:35:40.234838+0000","last_became_peered":"2024-09-13T18:35:40.234838+0000","last_unstale":"2024-09-13T18:35:41.230662+0000","last_undegraded":"2024-09-13T18:35:41.230662+0000","last_fullsized":"2024-09-13T18:35:41.230662+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:44.359706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251373+0000","last_change":"2024-09-13T18:35:39.815433+0000","last_active":"2024-09-13T18:35:41.251373+0000","last_peered":"2024-09-13T18:35:41.251373+0000","last_clean":"2024-09-13T18:35:41.251373+0000","last_became_active":"2024-09-13T18:35:39.812156+0000","last_became_peered":"2024-09-13T18:35:39.812156+0000","last_unstale":"2024-09-13T18:35:41.251373+0000","last_undegraded":"2024-09-13T18:35:41.251373+0000","last_fullsized":"2024-09-13T18:35:41.251373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:40.237581+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:40.237373+0000","last_became_peered":"2024-09-13T18:35:40.237373+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227088+0000","last_change":"2024-09-13T18:35:39.804837+0000","last_active":"2024-09-13T18:35:41.227088+0000","last_peered":"2024-09-13T18:35:41.227088+0000","last_clean":"2024-09-13T18:35:41.227088+0000","last_became_active":"2024-09-13T18:35:39.804516+0000","last_became_peered":"2024-09-13T18:35:39.804516+0000","last_unstale":"2024-09-13T18:35:41.227088+0000","last_undegraded":"2024-09-13T18:35:41.227088+0000","last_fullsized":"2024-09-13T18:35:41.227088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230388+0000","last_change":"2024-09-13T18:35:40.235027+0000","last_active":"2024-09-13T18:35:41.230388+0000","last_peered":"2024-09-13T18:35:41.230388+0000","last_clean":"2024-09-13T18:35:41.230388+0000","last_became_active":"2024-09-13T18:35:40.234823+0000","last_became_peered":"2024-09-13T18:35:40.234823+0000","last_unstale":"2024-09-13T18:35:41.230388+0000","last_undegraded":"2024-09-13T18:35:41.230388+0000","last_fullsized":"2024-09-13T18:35:41.230388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:57:38.857838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230525+0000","last_change":"2024-09-13T18:35:39.812301+0000","last_active":"2024-09-13T18:35:41.230525+0000","last_peered":"2024-09-13T18:35:41.230525+0000","last_clean":"2024-09-13T18:35:41.230525+0000","last_became_active":"2024-09-13T18:35:39.812023+0000","last_became_peered":"2024-09-13T18:35:39.812023+0000","last_unstale":"2024-09-13T18:35:41.230525+0000","last_undegraded":"2024-09-13T18:35:41.230525+0000","last_fullsized":"2024-09-13T18:35:41.230525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:03:22.366823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251561+0000","last_change":"2024-09-13T18:35:40.238389+0000","last_active":"2024-09-13T18:35:41.251561+0000","last_peered":"2024-09-13T18:35:41.251561+0000","last_clean":"2024-09-13T18:35:41.251561+0000","last_became_active":"2024-09-13T18:35:40.237734+0000","last_became_peered":"2024-09-13T18:35:40.237734+0000","last_unstale":"2024-09-13T18:35:41.251561+0000","last_undegraded":"2024-09-13T18:35:41.251561+0000","last_fullsized":"2024-09-13T18:35:41.251561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:07:48.447064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227064+0000","last_change":"2024-09-13T18:35:39.816055+0000","last_active":"2024-09-13T18:35:41.227064+0000","last_peered":"2024-09-13T18:35:41.227064+0000","last_clean":"2024-09-13T18:35:41.227064+0000","last_became_active":"2024-09-13T18:35:39.815774+0000","last_became_peered":"2024-09-13T18:35:39.815774+0000","last_unstale":"2024-09-13T18:35:41.227064+0000","last_undegraded":"2024-09-13T18:35:41.227064+0000","last_fullsized":"2024-09-13T18:35:41.227064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251405+0000","last_change":"2024-09-13T18:35:40.235767+0000","last_active":"2024-09-13T18:35:41.251405+0000","last_peered":"2024-09-13T18:35:41.251405+0000","last_clean":"2024-09-13T18:35:41.251405+0000","last_became_active":"2024-09-13T18:35:40.235536+0000","last_became_peered":"2024-09-13T18:35:40.235536+0000","last_unstale":"2024-09-13T18:35:41.251405+0000","last_undegraded":"2024-09-13T18:35:41.251405+0000","last_fullsized":"2024-09-13T18:35:41.251405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230867+0000","last_change":"2024-09-13T18:35:39.812041+0000","last_active":"2024-09-13T18:35:41.230867+0000","last_peered":"2024-09-13T18:35:41.230867+0000","last_clean":"2024-09-13T18:35:41.230867+0000","last_became_active":"2024-09-13T18:35:39.810552+0000","last_became_peered":"2024-09-13T18:35:39.810552+0000","last_unstale":"2024-09-13T18:35:41.230867+0000","last_undegraded":"2024-09-13T18:35:41.230867+0000","last_fullsized":"2024-09-13T18:35:41.230867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:46.601799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230551+0000","last_change":"2024-09-13T18:35:40.243949+0000","last_active":"2024-09-13T18:35:41.230551+0000","last_peered":"2024-09-13T18:35:41.230551+0000","last_clean":"2024-09-13T18:35:41.230551+0000","last_became_active":"2024-09-13T18:35:40.242908+0000","last_became_peered":"2024-09-13T18:35:40.242908+0000","last_unstale":"2024-09-13T18:35:41.230551+0000","last_undegraded":"2024-09-13T18:35:41.230551+0000","last_fullsized":"2024-09-13T18:35:41.230551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:38.639301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251518+0000","last_change":"2024-09-13T18:35:39.808513+0000","last_active":"2024-09-13T18:35:41.251518+0000","last_peered":"2024-09-13T18:35:41.251518+0000","last_clean":"2024-09-13T18:35:41.251518+0000","last_became_active":"2024-09-13T18:35:39.807588+0000","last_became_peered":"2024-09-13T18:35:39.807588+0000","last_unstale":"2024-09-13T18:35:41.251518+0000","last_undegraded":"2024-09-13T18:35:41.251518+0000","last_fullsized":"2024-09-13T18:35:41.251518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:40.645553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250615+0000","last_change":"2024-09-13T18:35:40.231247+0000","last_active":"2024-09-13T18:35:41.250615+0000","last_peered":"2024-09-13T18:35:41.250615+0000","last_clean":"2024-09-13T18:35:41.250615+0000","last_became_active":"2024-09-13T18:35:40.230765+0000","last_became_peered":"2024-09-13T18:35:40.230765+0000","last_unstale":"2024-09-13T18:35:41.250615+0000","last_undegraded":"2024-09-13T18:35:41.250615+0000","last_fullsized":"2024-09-13T18:35:41.250615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:33.455592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":19,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251615+0000","last_change":"2024-09-13T18:35:39.804310+0000","last_active":"2024-09-13T18:35:41.251615+0000","last_peered":"2024-09-13T18:35:41.251615+0000","last_clean":"2024-09-13T18:35:41.251615+0000","last_became_active":"2024-09-13T18:35:39.803312+0000","last_became_peered":"2024-09-13T18:35:39.803312+0000","last_unstale":"2024-09-13T18:35:41.251615+0000","last_undegraded":"2024-09-13T18:35:41.251615+0000","last_fullsized":"2024-09-13T18:35:41.251615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230873+0000","last_change":"2024-09-13T18:35:40.233912+0000","last_active":"2024-09-13T18:35:41.230873+0000","last_peered":"2024-09-13T18:35:41.230873+0000","last_clean":"2024-09-13T18:35:41.230873+0000","last_became_active":"2024-09-13T18:35:40.233697+0000","last_became_peered":"2024-09-13T18:35:40.233697+0000","last_unstale":"2024-09-13T18:35:41.230873+0000","last_undegraded":"2024-09-13T18:35:41.230873+0000","last_fullsized":"2024-09-13T18:35:41.230873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:58.476236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250841+0000","last_change":"2024-09-13T18:35:39.816011+0000","last_active":"2024-09-13T18:35:41.250841+0000","last_peered":"2024-09-13T18:35:41.250841+0000","last_clean":"2024-09-13T18:35:41.250841+0000","last_became_active":"2024-09-13T18:35:39.815792+0000","last_became_peered":"2024-09-13T18:35:39.815792+0000","last_unstale":"2024-09-13T18:35:41.250841+0000","last_undegraded":"2024-09-13T18:35:41.250841+0000","last_fullsized":"2024-09-13T18:35:41.250841+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:08:29.765387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230647+0000","last_change":"2024-09-13T18:35:40.238867+0000","last_active":"2024-09-13T18:35:41.230647+0000","last_peered":"2024-09-13T18:35:41.230647+0000","last_clean":"2024-09-13T18:35:41.230647+0000","last_became_active":"2024-09-13T18:35:40.238671+0000","last_became_peered":"2024-09-13T18:35:40.238671+0000","last_unstale":"2024-09-13T18:35:41.230647+0000","last_undegraded":"2024-09-13T18:35:41.230647+0000","last_fullsized":"2024-09-13T18:35:41.230647+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251622+0000","last_change":"2024-09-13T18:35:39.817986+0000","last_active":"2024-09-13T18:35:41.251622+0000","last_peered":"2024-09-13T18:35:41.251622+0000","last_clean":"2024-09-13T18:35:41.251622+0000","last_became_active":"2024-09-13T18:35:39.817657+0000","last_became_peered":"2024-09-13T18:35:39.817657+0000","last_unstale":"2024-09-13T18:35:41.251622+0000","last_undegraded":"2024-09-13T18:35:41.251622+0000","last_fullsized":"2024-09-13T18:35:41.251622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250760+0000","last_change":"2024-09-13T18:35:40.223178+0000","last_active":"2024-09-13T18:35:41.250760+0000","last_peered":"2024-09-13T18:35:41.250760+0000","last_clean":"2024-09-13T18:35:41.250760+0000","last_became_active":"2024-09-13T18:35:40.222660+0000","last_became_peered":"2024-09-13T18:35:40.222660+0000","last_unstale":"2024-09-13T18:35:41.250760+0000","last_undegraded":"2024-09-13T18:35:41.250760+0000","last_fullsized":"2024-09-13T18:35:41.250760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:05.395014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.239755+0000","last_change":"2024-09-13T18:35:39.815819+0000","last_active":"2024-09-13T18:35:40.239755+0000","last_peered":"2024-09-13T18:35:40.239755+0000","last_clean":"2024-09-13T18:35:40.239755+0000","last_became_active":"2024-09-13T18:35:39.815608+0000","last_became_peered":"2024-09-13T18:35:39.815608+0000","last_unstale":"2024-09-13T18:35:40.239755+0000","last_undegraded":"2024-09-13T18:35:40.239755+0000","last_fullsized":"2024-09-13T18:35:40.239755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251304+0000","last_change":"2024-09-13T18:35:40.230099+0000","last_active":"2024-09-13T18:35:41.251304+0000","last_peered":"2024-09-13T18:35:41.251304+0000","last_clean":"2024-09-13T18:35:41.251304+0000","last_became_active":"2024-09-13T18:35:40.226548+0000","last_became_peered":"2024-09-13T18:35:40.226548+0000","last_unstale":"2024-09-13T18:35:41.251304+0000","last_undegraded":"2024-09-13T18:35:41.251304+0000","last_fullsized":"2024-09-13T18:35:41.251304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252174+0000","last_change":"2024-09-13T18:35:39.817007+0000","last_active":"2024-09-13T18:35:41.252174+0000","last_peered":"2024-09-13T18:35:41.252174+0000","last_clean":"2024-09-13T18:35:41.252174+0000","last_became_active":"2024-09-13T18:35:39.815375+0000","last_became_peered":"2024-09-13T18:35:39.815375+0000","last_unstale":"2024-09-13T18:35:41.252174+0000","last_undegraded":"2024-09-13T18:35:41.252174+0000","last_fullsized":"2024-09-13T18:35:41.252174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230949+0000","last_change":"2024-09-13T18:35:40.234915+0000","last_active":"2024-09-13T18:35:41.230949+0000","last_peered":"2024-09-13T18:35:41.230949+0000","last_clean":"2024-09-13T18:35:41.230949+0000","last_became_active":"2024-09-13T18:35:40.234454+0000","last_became_peered":"2024-09-13T18:35:40.234454+0000","last_unstale":"2024-09-13T18:35:41.230949+0000","last_undegraded":"2024-09-13T18:35:41.230949+0000","last_fullsized":"2024-09-13T18:35:41.230949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:27.582937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.219516+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:35:40.219516+0000","last_peered":"2024-09-13T18:35:40.219516+0000","last_clean":"2024-09-13T18:35:40.219516+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:35:40.219516+0000","last_undegraded":"2024-09-13T18:35:40.219516+0000","last_fullsized":"2024-09-13T18:35:40.219516+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231027+0000","last_change":"2024-09-13T18:35:39.813498+0000","last_active":"2024-09-13T18:35:41.231027+0000","last_peered":"2024-09-13T18:35:41.231027+0000","last_clean":"2024-09-13T18:35:41.231027+0000","last_became_active":"2024-09-13T18:35:39.811808+0000","last_became_peered":"2024-09-13T18:35:39.811808+0000","last_unstale":"2024-09-13T18:35:41.231027+0000","last_undegraded":"2024-09-13T18:35:41.231027+0000","last_fullsized":"2024-09-13T18:35:41.231027+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:38.569472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251258+0000","last_change":"2024-09-13T18:35:40.231292+0000","last_active":"2024-09-13T18:35:41.251258+0000","last_peered":"2024-09-13T18:35:41.251258+0000","last_clean":"2024-09-13T18:35:41.251258+0000","last_became_active":"2024-09-13T18:35:40.231030+0000","last_became_peered":"2024-09-13T18:35:40.231030+0000","last_unstale":"2024-09-13T18:35:41.251258+0000","last_undegraded":"2024-09-13T18:35:41.251258+0000","last_fullsized":"2024-09-13T18:35:41.251258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230699+0000","last_change":"2024-09-13T18:35:39.817114+0000","last_active":"2024-09-13T18:35:41.230699+0000","last_peered":"2024-09-13T18:35:41.230699+0000","last_clean":"2024-09-13T18:35:41.230699+0000","last_became_active":"2024-09-13T18:35:39.816970+0000","last_became_peered":"2024-09-13T18:35:39.816970+0000","last_unstale":"2024-09-13T18:35:41.230699+0000","last_undegraded":"2024-09-13T18:35:41.230699+0000","last_fullsized":"2024-09-13T18:35:41.230699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:32.450595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251696+0000","last_change":"2024-09-13T18:35:40.233863+0000","last_active":"2024-09-13T18:35:41.251696+0000","last_peered":"2024-09-13T18:35:41.251696+0000","last_clean":"2024-09-13T18:35:41.251696+0000","last_became_active":"2024-09-13T18:35:40.233555+0000","last_became_peered":"2024-09-13T18:35:40.233555+0000","last_unstale":"2024-09-13T18:35:41.251696+0000","last_undegraded":"2024-09-13T18:35:41.251696+0000","last_fullsized":"2024-09-13T18:35:41.251696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:43:47.606796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.227137+0000","last_change":"2024-09-13T18:35:39.816294+0000","last_active":"2024-09-13T18:35:41.227137+0000","last_peered":"2024-09-13T18:35:41.227137+0000","last_clean":"2024-09-13T18:35:41.227137+0000","last_became_active":"2024-09-13T18:35:39.816011+0000","last_became_peered":"2024-09-13T18:35:39.816011+0000","last_unstale":"2024-09-13T18:35:41.227137+0000","last_undegraded":"2024-09-13T18:35:41.227137+0000","last_fullsized":"2024-09-13T18:35:41.227137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:54.537238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251062+0000","last_change":"2024-09-13T18:35:40.241481+0000","last_active":"2024-09-13T18:35:41.251062+0000","last_peered":"2024-09-13T18:35:41.251062+0000","last_clean":"2024-09-13T18:35:41.251062+0000","last_became_active":"2024-09-13T18:35:40.236707+0000","last_became_peered":"2024-09-13T18:35:40.236707+0000","last_unstale":"2024-09-13T18:35:41.251062+0000","last_undegraded":"2024-09-13T18:35:41.251062+0000","last_fullsized":"2024-09-13T18:35:41.251062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230952+0000","last_change":"2024-09-13T18:35:39.814049+0000","last_active":"2024-09-13T18:35:41.230952+0000","last_peered":"2024-09-13T18:35:41.230952+0000","last_clean":"2024-09-13T18:35:41.230952+0000","last_became_active":"2024-09-13T18:35:39.813061+0000","last_became_peered":"2024-09-13T18:35:39.813061+0000","last_unstale":"2024-09-13T18:35:41.230952+0000","last_undegraded":"2024-09-13T18:35:41.230952+0000","last_fullsized":"2024-09-13T18:35:41.230952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:05.274196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251826+0000","last_change":"2024-09-13T18:35:40.229053+0000","last_active":"2024-09-13T18:35:41.251826+0000","last_peered":"2024-09-13T18:35:41.251826+0000","last_clean":"2024-09-13T18:35:41.251826+0000","last_became_active":"2024-09-13T18:35:40.228817+0000","last_became_peered":"2024-09-13T18:35:40.228817+0000","last_unstale":"2024-09-13T18:35:41.251826+0000","last_undegraded":"2024-09-13T18:35:41.251826+0000","last_fullsized":"2024-09-13T18:35:41.251826+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:51.965650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.233257+0000","last_change":"2024-09-13T18:35:39.814559+0000","last_active":"2024-09-13T18:35:40.233257+0000","last_peered":"2024-09-13T18:35:40.233257+0000","last_clean":"2024-09-13T18:35:40.233257+0000","last_became_active":"2024-09-13T18:35:39.814313+0000","last_became_peered":"2024-09-13T18:35:39.814313+0000","last_unstale":"2024-09-13T18:35:40.233257+0000","last_undegraded":"2024-09-13T18:35:40.233257+0000","last_fullsized":"2024-09-13T18:35:40.233257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:40.111769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230437+0000","last_change":"2024-09-13T18:35:40.231277+0000","last_active":"2024-09-13T18:35:41.230437+0000","last_peered":"2024-09-13T18:35:41.230437+0000","last_clean":"2024-09-13T18:35:41.230437+0000","last_became_active":"2024-09-13T18:35:40.230898+0000","last_became_peered":"2024-09-13T18:35:40.230898+0000","last_unstale":"2024-09-13T18:35:41.230437+0000","last_undegraded":"2024-09-13T18:35:41.230437+0000","last_fullsized":"2024-09-13T18:35:41.230437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:50.597980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230626+0000","last_change":"2024-09-13T18:35:39.806373+0000","last_active":"2024-09-13T18:35:41.230626+0000","last_peered":"2024-09-13T18:35:41.230626+0000","last_clean":"2024-09-13T18:35:41.230626+0000","last_became_active":"2024-09-13T18:35:39.806144+0000","last_became_peered":"2024-09-13T18:35:39.806144+0000","last_unstale":"2024-09-13T18:35:41.230626+0000","last_undegraded":"2024-09-13T18:35:41.230626+0000","last_fullsized":"2024-09-13T18:35:41.230626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252218+0000","last_change":"2024-09-13T18:35:40.238495+0000","last_active":"2024-09-13T18:35:41.252218+0000","last_peered":"2024-09-13T18:35:41.252218+0000","last_clean":"2024-09-13T18:35:41.252218+0000","last_became_active":"2024-09-13T18:35:40.238281+0000","last_became_peered":"2024-09-13T18:35:40.238281+0000","last_unstale":"2024-09-13T18:35:41.252218+0000","last_undegraded":"2024-09-13T18:35:41.252218+0000","last_fullsized":"2024-09-13T18:35:41.252218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:42.760007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:43.473712+0000","last_change":"2024-09-13T18:35:39.803660+0000","last_active":"2024-09-13T18:35:43.473712+0000","last_peered":"2024-09-13T18:35:43.473712+0000","last_clean":"2024-09-13T18:35:43.473712+0000","last_became_active":"2024-09-13T18:35:39.802915+0000","last_became_peered":"2024-09-13T18:35:39.802915+0000","last_unstale":"2024-09-13T18:35:43.473712+0000","last_undegraded":"2024-09-13T18:35:43.473712+0000","last_fullsized":"2024-09-13T18:35:43.473712+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:34.972390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251154+0000","last_change":"2024-09-13T18:35:40.236826+0000","last_active":"2024-09-13T18:35:41.251154+0000","last_peered":"2024-09-13T18:35:41.251154+0000","last_clean":"2024-09-13T18:35:41.251154+0000","last_became_active":"2024-09-13T18:35:40.234442+0000","last_became_peered":"2024-09-13T18:35:40.234442+0000","last_unstale":"2024-09-13T18:35:41.251154+0000","last_undegraded":"2024-09-13T18:35:41.251154+0000","last_fullsized":"2024-09-13T18:35:41.251154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230914+0000","last_change":"2024-09-13T18:35:39.811280+0000","last_active":"2024-09-13T18:35:41.230914+0000","last_peered":"2024-09-13T18:35:41.230914+0000","last_clean":"2024-09-13T18:35:41.230914+0000","last_became_active":"2024-09-13T18:35:39.810851+0000","last_became_peered":"2024-09-13T18:35:39.810851+0000","last_unstale":"2024-09-13T18:35:41.230914+0000","last_undegraded":"2024-09-13T18:35:41.230914+0000","last_fullsized":"2024-09-13T18:35:41.230914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:34:49.592984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251502+0000","last_change":"2024-09-13T18:35:40.229829+0000","last_active":"2024-09-13T18:35:41.251502+0000","last_peered":"2024-09-13T18:35:41.251502+0000","last_clean":"2024-09-13T18:35:41.251502+0000","last_became_active":"2024-09-13T18:35:40.229526+0000","last_became_peered":"2024-09-13T18:35:40.229526+0000","last_unstale":"2024-09-13T18:35:41.251502+0000","last_undegraded":"2024-09-13T18:35:41.251502+0000","last_fullsized":"2024-09-13T18:35:41.251502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:29.414947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251968+0000","last_change":"2024-09-13T18:35:39.811896+0000","last_active":"2024-09-13T18:35:41.251968+0000","last_peered":"2024-09-13T18:35:41.251968+0000","last_clean":"2024-09-13T18:35:41.251968+0000","last_became_active":"2024-09-13T18:35:39.811240+0000","last_became_peered":"2024-09-13T18:35:39.811240+0000","last_unstale":"2024-09-13T18:35:41.251968+0000","last_undegraded":"2024-09-13T18:35:41.251968+0000","last_fullsized":"2024-09-13T18:35:41.251968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230631+0000","last_change":"2024-09-13T18:35:40.233182+0000","last_active":"2024-09-13T18:35:41.230631+0000","last_peered":"2024-09-13T18:35:41.230631+0000","last_clean":"2024-09-13T18:35:41.230631+0000","last_became_active":"2024-09-13T18:35:40.232921+0000","last_became_peered":"2024-09-13T18:35:40.232921+0000","last_unstale":"2024-09-13T18:35:41.230631+0000","last_undegraded":"2024-09-13T18:35:41.230631+0000","last_fullsized":"2024-09-13T18:35:41.230631+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:05:02.245777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251718+0000","last_change":"2024-09-13T18:35:39.803461+0000","last_active":"2024-09-13T18:35:41.251718+0000","last_peered":"2024-09-13T18:35:41.251718+0000","last_clean":"2024-09-13T18:35:41.251718+0000","last_became_active":"2024-09-13T18:35:39.802324+0000","last_became_peered":"2024-09-13T18:35:39.802324+0000","last_unstale":"2024-09-13T18:35:41.251718+0000","last_undegraded":"2024-09-13T18:35:41.251718+0000","last_fullsized":"2024-09-13T18:35:41.251718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251766+0000","last_change":"2024-09-13T18:35:40.232844+0000","last_active":"2024-09-13T18:35:41.251766+0000","last_peered":"2024-09-13T18:35:41.251766+0000","last_clean":"2024-09-13T18:35:41.251766+0000","last_became_active":"2024-09-13T18:35:40.230443+0000","last_became_peered":"2024-09-13T18:35:40.230443+0000","last_unstale":"2024-09-13T18:35:41.251766+0000","last_undegraded":"2024-09-13T18:35:41.251766+0000","last_fullsized":"2024-09-13T18:35:41.251766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:06.279193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251947+0000","last_change":"2024-09-13T18:35:39.816930+0000","last_active":"2024-09-13T18:35:41.251947+0000","last_peered":"2024-09-13T18:35:41.251947+0000","last_clean":"2024-09-13T18:35:41.251947+0000","last_became_active":"2024-09-13T18:35:39.816689+0000","last_became_peered":"2024-09-13T18:35:39.816689+0000","last_unstale":"2024-09-13T18:35:41.251947+0000","last_undegraded":"2024-09-13T18:35:41.251947+0000","last_fullsized":"2024-09-13T18:35:41.251947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:48:52.004639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.226846+0000","last_change":"2024-09-13T18:35:40.239241+0000","last_active":"2024-09-13T18:35:41.226846+0000","last_peered":"2024-09-13T18:35:41.226846+0000","last_clean":"2024-09-13T18:35:41.226846+0000","last_became_active":"2024-09-13T18:35:40.238765+0000","last_became_peered":"2024-09-13T18:35:40.238765+0000","last_unstale":"2024-09-13T18:35:41.226846+0000","last_undegraded":"2024-09-13T18:35:41.226846+0000","last_fullsized":"2024-09-13T18:35:41.226846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:03:41.650550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.231002+0000","last_change":"2024-09-13T18:35:39.811713+0000","last_active":"2024-09-13T18:35:41.231002+0000","last_peered":"2024-09-13T18:35:41.231002+0000","last_clean":"2024-09-13T18:35:41.231002+0000","last_became_active":"2024-09-13T18:35:39.811509+0000","last_became_peered":"2024-09-13T18:35:39.811509+0000","last_unstale":"2024-09-13T18:35:41.231002+0000","last_undegraded":"2024-09-13T18:35:41.231002+0000","last_fullsized":"2024-09-13T18:35:41.231002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:48:43.354709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230473+0000","last_change":"2024-09-13T18:35:40.238225+0000","last_active":"2024-09-13T18:35:41.230473+0000","last_peered":"2024-09-13T18:35:41.230473+0000","last_clean":"2024-09-13T18:35:41.230473+0000","last_became_active":"2024-09-13T18:35:40.237433+0000","last_became_peered":"2024-09-13T18:35:40.237433+0000","last_unstale":"2024-09-13T18:35:41.230473+0000","last_undegraded":"2024-09-13T18:35:41.230473+0000","last_fullsized":"2024-09-13T18:35:41.230473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:13.031773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.230474+0000","last_change":"2024-09-13T18:35:40.244372+0000","last_active":"2024-09-13T18:35:41.230474+0000","last_peered":"2024-09-13T18:35:41.230474+0000","last_clean":"2024-09-13T18:35:41.230474+0000","last_became_active":"2024-09-13T18:35:40.243736+0000","last_became_peered":"2024-09-13T18:35:40.243736+0000","last_unstale":"2024-09-13T18:35:41.230474+0000","last_undegraded":"2024-09-13T18:35:41.230474+0000","last_fullsized":"2024-09-13T18:35:41.230474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:20:52.138842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251899+0000","last_change":"2024-09-13T18:35:39.813353+0000","last_active":"2024-09-13T18:35:41.251899+0000","last_peered":"2024-09-13T18:35:41.251899+0000","last_clean":"2024-09-13T18:35:41.251899+0000","last_became_active":"2024-09-13T18:35:39.811686+0000","last_became_peered":"2024-09-13T18:35:39.811686+0000","last_unstale":"2024-09-13T18:35:41.251899+0000","last_undegraded":"2024-09-13T18:35:41.251899+0000","last_fullsized":"2024-09-13T18:35:41.251899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:08:05.382419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251895+0000","last_change":"2024-09-13T18:35:40.225723+0000","last_active":"2024-09-13T18:35:41.251895+0000","last_peered":"2024-09-13T18:35:41.251895+0000","last_clean":"2024-09-13T18:35:41.251895+0000","last_became_active":"2024-09-13T18:35:40.223821+0000","last_became_peered":"2024-09-13T18:35:40.223821+0000","last_unstale":"2024-09-13T18:35:41.251895+0000","last_undegraded":"2024-09-13T18:35:41.251895+0000","last_fullsized":"2024-09-13T18:35:41.251895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:58:39.574469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.252611+0000","last_change":"2024-09-13T18:35:39.816245+0000","last_active":"2024-09-13T18:35:41.252611+0000","last_peered":"2024-09-13T18:35:41.252611+0000","last_clean":"2024-09-13T18:35:41.252611+0000","last_became_active":"2024-09-13T18:35:39.814585+0000","last_became_peered":"2024-09-13T18:35:39.814585+0000","last_unstale":"2024-09-13T18:35:41.252611+0000","last_undegraded":"2024-09-13T18:35:41.252611+0000","last_fullsized":"2024-09-13T18:35:41.252611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:17:12.937271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251105+0000","last_change":"2024-09-13T18:35:40.240336+0000","last_active":"2024-09-13T18:35:41.251105+0000","last_peered":"2024-09-13T18:35:41.251105+0000","last_clean":"2024-09-13T18:35:41.251105+0000","last_became_active":"2024-09-13T18:35:40.235298+0000","last_became_peered":"2024-09-13T18:35:40.235298+0000","last_unstale":"2024-09-13T18:35:41.251105+0000","last_undegraded":"2024-09-13T18:35:41.251105+0000","last_fullsized":"2024-09-13T18:35:41.251105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:34.322130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-13T18:35:40.245172+0000","last_change":"2024-09-13T18:35:39.815215+0000","last_active":"2024-09-13T18:35:40.245172+0000","last_peered":"2024-09-13T18:35:40.245172+0000","last_clean":"2024-09-13T18:35:40.245172+0000","last_became_active":"2024-09-13T18:35:39.814835+0000","last_became_peered":"2024-09-13T18:35:39.814835+0000","last_unstale":"2024-09-13T18:35:40.245172+0000","last_undegraded":"2024-09-13T18:35:40.245172+0000","last_fullsized":"2024-09-13T18:35:40.245172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:51.967173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.250944+0000","last_change":"2024-09-13T18:35:40.240536+0000","last_active":"2024-09-13T18:35:41.250944+0000","last_peered":"2024-09-13T18:35:41.250944+0000","last_clean":"2024-09-13T18:35:41.250944+0000","last_became_active":"2024-09-13T18:35:40.236412+0000","last_became_peered":"2024-09-13T18:35:40.236412+0000","last_unstale":"2024-09-13T18:35:41.250944+0000","last_undegraded":"2024-09-13T18:35:41.250944+0000","last_fullsized":"2024-09-13T18:35:41.250944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:39.793006+0000","last_clean_scrub_stamp":"2024-09-13T18:35:39.793006+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:31.752765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-13T18:35:41.251400+0000","last_change":"2024-09-13T18:35:39.805495+0000","last_active":"2024-09-13T18:35:41.251400+0000","last_peered":"2024-09-13T18:35:41.251400+0000","last_clean":"2024-09-13T18:35:41.251400+0000","last_became_active":"2024-09-13T18:35:39.804557+0000","last_became_peered":"2024-09-13T18:35:39.804557+0000","last_unstale":"2024-09-13T18:35:41.251400+0000","last_undegraded":"2024-09-13T18:35:41.251400+0000","last_fullsized":"2024-09-13T18:35:41.251400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:38.788010+0000","last_clean_scrub_stamp":"2024-09-13T18:35:38.788010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:38.019665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334009,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.442}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924345,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924469,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195236,"statfs":{"total":200000000,"available":199922233,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":74,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199923887,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":75,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195237,"statfs":{"total":200000000,"available":199922905,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334031,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":73,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195238,"statfs":{"total":200000000,"available":199924413,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:35:54.300 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:35:54.301 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T18:35:54.301 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-13T18:35:54.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-13T18:35:54.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.486+0000 7f18c3600640 1 Processor -- start 2024-09-13T18:35:54.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.486+0000 7f18c3600640 1 -- start start 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c3600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f18bc0b3f10 0x7f18bc15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c3600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0b2f00 con 0x7f18bc15dee0 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c3600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18bc0b3150 con 0x7f18bc0b0490 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c3600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18bc0b3430 con 0x7f18bc0b3f10 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c0c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f18bc15dee0 0x7f18bc0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54236/0 (socket says 172.21.15.192:54236) 2024-09-13T18:35:54.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.487+0000 7f18c0c00640 1 -- 172.21.15.192:0/3634480316 learned_addr learned my addr 172.21.15.192:0/3634480316 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:54.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bbe00640 1 --2- 172.21.15.192:0/3634480316 >> v2:172.21.15.192:3300/0 conn(0x7f18bc0b3f10 0x7f18bc15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bb400640 1 -- 172.21.15.192:0/3634480316 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 728662725 0 0) 0x7f18bc0b2f00 con 0x7f18bc15dee0 2024-09-13T18:35:54.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bb400640 1 -- 172.21.15.192:0/3634480316 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18a4005730 con 0x7f18bc15dee0 2024-09-13T18:35:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bbe00640 1 -- 172.21.15.192:0/3634480316 >> v1:172.21.15.194:6789/0 conn(0x7f18bc0b0490 legacy=0x7f18bc15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bbe00640 1 -- 172.21.15.192:0/3634480316 >> v1:172.21.15.192:6789/0 conn(0x7f18bc15dee0 legacy=0x7f18bc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.488+0000 7f18bbe00640 1 -- 172.21.15.192:0/3634480316 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18bc0b3710 con 0x7f18bc0b3f10 2024-09-13T18:35:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.489+0000 7f18bbe00640 1 --2- 172.21.15.192:0/3634480316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b3f10 0x7f18bc15a440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097a0 tx=0x7f18a802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17735aad4ebf585c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.489+0000 7f18bb400640 1 -- 172.21.15.192:0/3634480316 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8032440 con 0x7f18bc0b3f10 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.489+0000 7f18bb400640 1 -- 172.21.15.192:0/3634480316 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80325a0 con 0x7f18bc0b3f10 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.489+0000 7f18bb400640 1 -- 172.21.15.192:0/3634480316 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8032930 con 0x7f18bc0b3f10 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 -- 172.21.15.192:0/3634480316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b3f10 msgr2=0x7f18bc15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 --2- 172.21.15.192:0/3634480316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b3f10 0x7f18bc15a440 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f18a80097a0 tx=0x7f18a802a230 comp rx=0 tx=0).stop 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 -- 172.21.15.192:0/3634480316 shutdown_connections 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 --2- 172.21.15.192:0/3634480316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b3f10 0x7f18bc15a440 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 -- 172.21.15.192:0/3634480316 >> 172.21.15.192:0/3634480316 conn(0x7f18bc0ae960 msgr2=0x7f18bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 -- 172.21.15.192:0/3634480316 shutdown_connections 2024-09-13T18:35:54.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.490+0000 7f18c3600640 1 -- 172.21.15.192:0/3634480316 wait complete. 2024-09-13T18:35:54.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.492+0000 7f18c3600640 1 Processor -- start 2024-09-13T18:35:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.492+0000 7f18c3600640 1 -- start start 2024-09-13T18:35:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.492+0000 7f18c3600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c3600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18bc15dee0 0x7f18bc151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c3600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18bc154250 0x7f18bc1516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c3600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc13da70 con 0x7f18bc0b0490 2024-09-13T18:35:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c3600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc134330 con 0x7f18bc154250 2024-09-13T18:35:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c3600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18bc133e50 con 0x7f18bc15dee0 2024-09-13T18:35:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57580/0 (socket says 172.21.15.192:57580) 2024-09-13T18:35:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 -- 172.21.15.192:0/4275684960 learned_addr learned my addr 172.21.15.192:0/4275684960 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 -- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18bc15dee0 msgr2=0x7f18bc151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18bc15dee0 0x7f18bc151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 -- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18bc154250 msgr2=0x7f18bc1516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18bc154250 0x7f18bc1516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 -- 172.21.15.192:0/4275684960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009400 con 0x7f18bc0b0490 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.493+0000 7f18c0c00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c410 tx=0x7f18b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.494+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0005ce0 con 0x7f18bc0b0490 2024-09-13T18:35:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.494+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b0005e40 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.494+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18bc13dc80 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.494+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b00072f0 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.494+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc0afbe0 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.495+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18bc133cb0 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.496+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18b0007510 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.497+0000 7f18b8c00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 0x7f189c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.497+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18b0088870 con 0x7f18bc0b0490 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.497+0000 7f18bbe00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 0x7f189c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.498+0000 7f18bbe00640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 0x7f189c06d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18a8034000 tx=0x7f18a802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.501+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f18bc133cb0 con 0x7f18bc0b0490 2024-09-13T18:35:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.704+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f18bc133cb0 con 0x7f18bc0b0490 2024-09-13T18:35:54.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.705+0000 7f18b8c00640 1 -- 172.21.15.192:0/4275684960 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f18bc133cb0 con 0x7f18bc0b0490 2024-09-13T18:35:54.708 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:54.708 INFO:teuthology.orchestra.run.smithi192.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T18:35:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 msgr2=0x7f189c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 0x7f189c06d0c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18a8034000 tx=0x7f18a802c000 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 msgr2=0x7f18bc13f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f18b000c410 tx=0x7f18b000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 shutdown_connections 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f189c06ac00 0x7f189c06d0c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18bc154250 0x7f18bc1516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f18bc15dee0 0x7f18bc151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 --2- 172.21.15.192:0/4275684960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18bc0b0490 0x7f18bc13f680 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 >> 172.21.15.192:0/4275684960 conn(0x7f18bc0ae960 msgr2=0x7f18bc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 shutdown_connections 2024-09-13T18:35:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.707+0000 7f18c3600640 1 -- 172.21.15.192:0/4275684960 wait complete. 2024-09-13T18:35:54.725 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-13T18:35:54.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:54.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.877+0000 7fb266200640 1 Processor -- start 2024-09-13T18:35:54.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.877+0000 7fb266200640 1 -- start start 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb266200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb2600b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb266200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb2600b2230 0x7fb2600cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb266200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb260071dd0 con 0x7fb260150480 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb266200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600cb770 con 0x7fb2600b2230 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb266200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600cba50 con 0x7fb260071810 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb25f400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb260150480 0x7fb26015a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54246/0 (socket says 172.21.15.192:54246) 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.878+0000 7fb25f400640 1 -- 172.21.15.192:0/873380269 learned_addr learned my addr 172.21.15.192:0/873380269 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25fe00640 1 --2- 172.21.15.192:0/873380269 >> v2:172.21.15.194:3300/0 conn(0x7fb2600b2230 0x7fb2600cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25ea00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb2600b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425205626 0 0) 0x7fb260071dd0 con 0x7fb260150480 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003520 con 0x7fb260150480 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1900261112 0 0) 0x7fb244003520 con 0x7fb260150480 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 msgr2=0x7fb2600b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb2600b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 >> v2:172.21.15.194:3300/0 conn(0x7fb2600b2230 msgr2=0x7fb2600cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 --2- 172.21.15.192:0/873380269 >> v2:172.21.15.194:3300/0 conn(0x7fb2600b2230 0x7fb2600cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600cbd30 con 0x7fb260150480 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fb250001670 con 0x7fb260150480 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 >> v1:172.21.15.192:6789/0 conn(0x7fb260150480 legacy=0x7fb26015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb244003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb244003ef0 0x7fb2440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb244005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600cb770 con 0x7fb244004d00 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600cba50 con 0x7fb244003ef0 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb24400b9d0 con 0x7fb260071810 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.879+0000 7fb25fe00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb244005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25ea00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb244003ef0 0x7fb2440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25f400640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb244003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25fe00640 1 -- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 msgr2=0x7fb244003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25fe00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb260071810 0x7fb244003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25fe00640 1 -- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb244003ef0 msgr2=0x7fb2440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:54.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25fe00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb244003ef0 0x7fb2440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25fe00640 1 -- 172.21.15.192:0/873380269 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb244003520 con 0x7fb244004d00 2024-09-13T18:35:54.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.880+0000 7fb25ea00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb244003ef0 0x7fb2440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb25fe00640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb244005180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb258009fc0 tx=0x7fb2440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1bbf5ea6f3b178 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258031670 con 0x7fb244004d00 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25800f040 con 0x7fb244004d00 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb25e000640 1 -- 172.21.15.192:0/873380269 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb258031a10 con 0x7fb244004d00 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb266200640 1 -- 172.21.15.192:0/873380269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 msgr2=0x7fb244005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.881+0000 7fb266200640 1 --2- 172.21.15.192:0/873380269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb244005180 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb258009fc0 tx=0x7fb2440057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.882+0000 7fb25fe00640 1 -- 172.21.15.192:0/873380269 reap_dead start 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.882+0000 7fb266200640 1 -- 172.21.15.192:0/873380269 shutdown_connections 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.882+0000 7fb266200640 1 -- 172.21.15.192:0/873380269 >> 172.21.15.192:0/873380269 conn(0x7fb2600ae960 msgr2=0x7fb26006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.882+0000 7fb266200640 1 -- 172.21.15.192:0/873380269 shutdown_connections 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.882+0000 7fb266200640 1 -- 172.21.15.192:0/873380269 wait complete. 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.883+0000 7fb266200640 1 Processor -- start 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 -- start start 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 0x7fb260146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2600ad840 0x7fb2600adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600ae210 con 0x7fb244004d00 2024-09-13T18:35:54.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb260148090 con 0x7fb26006b7a0 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.884+0000 7fb266200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600715f0 con 0x7fb2600ad840 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57598/0 (socket says 172.21.15.192:57598) 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 -- 172.21.15.192:0/4247841378 learned_addr learned my addr 172.21.15.192:0/4247841378 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25ea00640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 0x7fb260146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 -- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2600ad840 msgr2=0x7fb2600adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2600ad840 0x7fb2600adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 -- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 msgr2=0x7fb260146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 0x7fb260146f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 -- 172.21.15.192:0/4247841378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb260147e60 con 0x7fb244004d00 2024-09-13T18:35:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25ea00640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 0x7fb260146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb25f400640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb250001cc0 tx=0x7fb250007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.885+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25000f9f0 con 0x7fb244004d00 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.886+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25000fb90 con 0x7fb244004d00 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.886+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb26006bd40 con 0x7fb244004d00 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.886+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2500133f0 con 0x7fb244004d00 2024-09-13T18:35:54.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.886+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb260070df0 con 0x7fb244004d00 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.887+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26006c260 con 0x7fb244004d00 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.887+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb250013550 con 0x7fb244004d00 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.888+0000 7fb257400640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 0x7fb24006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.888+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2500896f0 con 0x7fb244004d00 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.889+0000 7fb25ea00640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 0x7fb24006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:54.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.889+0000 7fb25ea00640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 0x7fb24006d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00a910 tx=0x7fb24c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:54.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:54.892+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb2500548c0 con 0x7fb244004d00 2024-09-13T18:35:55.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.060+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb260071dd0 con 0x7fb244004d00 2024-09-13T18:35:55.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.061+0000 7fb257400640 1 -- 172.21.15.192:0/4247841378 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fb250057ee0 con 0x7fb244004d00 2024-09-13T18:35:55.065 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:55.065 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 msgr2=0x7fb24006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 0x7fb24006d0c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb24c00a910 tx=0x7fb24c008040 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 msgr2=0x7fb260147920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb250001cc0 tx=0x7fb250007720 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 shutdown_connections 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb24006ac00 0x7fb24006d0c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2600ad840 0x7fb2600adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb26006b7a0 0x7fb260146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 --2- 172.21.15.192:0/4247841378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb244004d00 0x7fb260147920 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 >> 172.21.15.192:0/4247841378 conn(0x7fb2600ae960 msgr2=0x7fb26015ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 shutdown_connections 2024-09-13T18:35:55.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.064+0000 7fb266200640 1 -- 172.21.15.192:0/4247841378 wait complete. 2024-09-13T18:35:55.083 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:55.083 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:55.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.235+0000 7fe4aea00640 1 Processor -- start 2024-09-13T18:35:55.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.235+0000 7fe4aea00640 1 -- start start 2024-09-13T18:35:55.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.236+0000 7fe4aea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4a806c800 0x7fe4a80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.236+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a80b3bd0 0x7fe4a806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.236+0000 7fe4aea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4a806cc70 con 0x7fe4a81434c0 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.236+0000 7fe4aea00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4a80b4060 con 0x7fe4a806c800 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.236+0000 7fe4aea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a80ce770 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4a806c800 0x7fe4a80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4a806c800 0x7fe4a80b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57602/0 (socket says 172.21.15.192:57602) 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 -- 172.21.15.192:0/3739153585 learned_addr learned my addr 172.21.15.192:0/3739153585 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:55.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4aca00640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a80b3bd0 0x7fe4a806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 -- 172.21.15.192:0/3739153585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a80b3bd0 msgr2=0x7fe4a806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a80b3bd0 0x7fe4a806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 -- 172.21.15.192:0/3739153585 >> v1:172.21.15.194:6789/0 conn(0x7fe4a81434c0 legacy=0x7fe4a806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.237+0000 7fe4a7400640 1 -- 172.21.15.192:0/3739153585 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4a806b480 con 0x7fe4a806c800 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.238+0000 7fe4a7400640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a806c800 0x7fe4a80b3690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe4940098a0 tx=0x7fe49402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a474ce004f3041e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.238+0000 7fe4a6a00640 1 -- 172.21.15.192:0/3739153585 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494032440 con 0x7fe4a806c800 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.238+0000 7fe4a6a00640 1 -- 172.21.15.192:0/3739153585 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4940325a0 con 0x7fe4a806c800 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.238+0000 7fe4a6a00640 1 -- 172.21.15.192:0/3739153585 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494032930 con 0x7fe4a806c800 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 -- 172.21.15.192:0/3739153585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a806c800 msgr2=0x7fe4a80b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a806c800 0x7fe4a80b3690 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe4940098a0 tx=0x7fe49402a290 comp rx=0 tx=0).stop 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 -- 172.21.15.192:0/3739153585 shutdown_connections 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a80b3bd0 0x7fe4a806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 --2- 172.21.15.192:0/3739153585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a806c800 0x7fe4a80b3690 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 -- 172.21.15.192:0/3739153585 >> 172.21.15.192:0/3739153585 conn(0x7fe4a80b08f0 msgr2=0x7fe4a80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 -- 172.21.15.192:0/3739153585 shutdown_connections 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.239+0000 7fe4aea00640 1 -- 172.21.15.192:0/3739153585 wait complete. 2024-09-13T18:35:55.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.241+0000 7fe4aea00640 1 Processor -- start 2024-09-13T18:35:55.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.241+0000 7fe4aea00640 1 -- start start 2024-09-13T18:35:55.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a806c800 0x7fe4a815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4a81434c0 0x7fe4a813be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a815c1d0 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a813f9a0 con 0x7fe4a81434c0 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4a81f0ec0 con 0x7fe4a806c800 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57604/0 (socket says 172.21.15.192:57604) 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 -- 172.21.15.192:0/613742206 learned_addr learned my addr 172.21.15.192:0/613742206 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4aca00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4a81434c0 0x7fe4a813be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7e00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a806c800 0x7fe4a815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 -- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a806c800 msgr2=0x7fe4a815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a806c800 0x7fe4a815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 -- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4a81434c0 msgr2=0x7fe4a813be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4a81434c0 0x7fe4a813be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.242+0000 7fe4a7400640 1 -- 172.21.15.192:0/613742206 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940094d0 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe4a7400640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe494000c00 tx=0x7fe4940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494032440 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe494030980 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe494030d30 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4a81f11a0 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.243+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4a81f1760 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.244+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4a813fb30 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.245+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe494039040 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.246+0000 7fe49fe00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 0x7fe48806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.246+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4940a9aa0 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.246+0000 7fe4a7e00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 0x7fe48806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.247+0000 7fe4a7e00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 0x7fe48806d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8141180 tx=0x7fe498009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.250+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe494074d30 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.418+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe4a80cc7d0 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.419+0000 7fe49fe00640 1 -- 172.21.15.192:0/613742206 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe49403d440 con 0x7fe4a80b3bd0 2024-09-13T18:35:55.422 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 msgr2=0x7fe48806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 0x7fe48806d0c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe4a8141180 tx=0x7fe498009040 comp rx=0 tx=0).stop 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 msgr2=0x7fe4a80adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe494000c00 tx=0x7fe4940046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 shutdown_connections 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe48806ac00 0x7fe48806d0c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe4a81434c0 0x7fe4a813be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4a80b3bd0 0x7fe4a80adbf0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 --2- 172.21.15.192:0/613742206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4a806c800 0x7fe4a815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 >> 172.21.15.192:0/613742206 conn(0x7fe4a80b08f0 msgr2=0x7fe4a80b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 shutdown_connections 2024-09-13T18:35:55.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.421+0000 7fe4aea00640 1 -- 172.21.15.192:0/613742206 wait complete. 2024-09-13T18:35:55.440 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:55.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.591+0000 7f465bc00640 1 Processor -- start 2024-09-13T18:35:55.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.591+0000 7f465bc00640 1 -- start start 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.592+0000 7f465bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f465406c800 0x7f46540b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.592+0000 7f465bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f465406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.592+0000 7f465bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465406cc70 con 0x7f46541434c0 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f465bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540b4060 con 0x7f465406c800 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f465bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540ce770 con 0x7f46540b3bd0 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f465406c800 0x7f46540b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f465406c800 0x7f46540b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57618/0 (socket says 172.21.15.192:57618) 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 -- 172.21.15.192:0/4275407015 learned_addr learned my addr 172.21.15.192:0/4275407015 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:55.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4659c00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f465406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 -- 172.21.15.192:0/4275407015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 msgr2=0x7f465406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f465406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 -- 172.21.15.192:0/4275407015 >> v1:172.21.15.194:6789/0 conn(0x7f46541434c0 legacy=0x7f465406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.593+0000 7f4653e00640 1 -- 172.21.15.192:0/4275407015 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465406b480 con 0x7f465406c800 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.594+0000 7f4653e00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46540b3690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46400098a0 tx=0x7f464002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d6dd4b4f5b0755 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.594+0000 7f4653400640 1 -- 172.21.15.192:0/4275407015 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640032440 con 0x7f465406c800 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f4653400640 1 -- 172.21.15.192:0/4275407015 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46400325a0 con 0x7f465406c800 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f4653400640 1 -- 172.21.15.192:0/4275407015 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640032930 con 0x7f465406c800 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 -- 172.21.15.192:0/4275407015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 msgr2=0x7f46540b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46540b3690 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f46400098a0 tx=0x7f464002a290 comp rx=0 tx=0).stop 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 -- 172.21.15.192:0/4275407015 shutdown_connections 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f465406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 --2- 172.21.15.192:0/4275407015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46540b3690 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 -- 172.21.15.192:0/4275407015 >> 172.21.15.192:0/4275407015 conn(0x7f46540b08f0 msgr2=0x7f46540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 -- 172.21.15.192:0/4275407015 shutdown_connections 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.595+0000 7f465bc00640 1 -- 172.21.15.192:0/4275407015 wait complete. 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.597+0000 7f465bc00640 1 Processor -- start 2024-09-13T18:35:55.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.597+0000 7f465bc00640 1 -- start start 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f46540709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46541434c0 0x7f465413bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654139fb0 con 0x7f465406c800 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f1030 con 0x7f46541434c0 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f465bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46541f1310 con 0x7f46540b3bd0 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57634/0 (socket says 172.21.15.192:57634) 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 -- 172.21.15.192:0/2135232487 learned_addr learned my addr 172.21.15.192:0/2135232487 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:55.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659c00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46541434c0 0x7f465413bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4653e00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f46540709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 -- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 msgr2=0x7f46540709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f46540709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 -- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46541434c0 msgr2=0x7f465413bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46541434c0 0x7f465413bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.598+0000 7f4659200640 1 -- 172.21.15.192:0/2135232487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46400094d0 con 0x7f465406c800 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f4659200640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f464400c400 tx=0x7f464400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440052d0 con 0x7f465406c800 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644005430 con 0x7f465406c800 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644003830 con 0x7f465406c800 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46541f15f0 con 0x7f465406c800 2024-09-13T18:35:55.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.599+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654070ee0 con 0x7f465406c800 2024-09-13T18:35:55.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.600+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f465413a120 con 0x7f465406c800 2024-09-13T18:35:55.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.601+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4644003990 con 0x7f465406c800 2024-09-13T18:35:55.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.602+0000 7f4650c00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 0x7f463406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.602+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4644088820 con 0x7f465406c800 2024-09-13T18:35:55.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.602+0000 7f4653e00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 0x7f463406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.603+0000 7f4653e00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 0x7f463406d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4640034000 tx=0x7f464002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.606+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4644053ab0 con 0x7f465406c800 2024-09-13T18:35:55.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.776+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f46540cc7d0 con 0x7f465406c800 2024-09-13T18:35:55.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.777+0000 7f4650c00640 1 -- 172.21.15.192:0/2135232487 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4644017020 con 0x7f465406c800 2024-09-13T18:35:55.780 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 msgr2=0x7f463406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 0x7f463406d0c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4640034000 tx=0x7f464002e000 comp rx=0 tx=0).stop 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 msgr2=0x7f46541f1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f464400c400 tx=0x7f464400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 shutdown_connections 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f463406ac00 0x7f463406d0c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46541434c0 0x7f465413bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46540b3bd0 0x7f46540709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 --2- 172.21.15.192:0/2135232487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f465406c800 0x7f46541f1c50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 >> 172.21.15.192:0/2135232487 conn(0x7f46540b08f0 msgr2=0x7f46540ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 shutdown_connections 2024-09-13T18:35:55.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.779+0000 7f465bc00640 1 -- 172.21.15.192:0/2135232487 wait complete. 2024-09-13T18:35:55.798 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:55.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.951+0000 7f8d41e00640 1 Processor -- start 2024-09-13T18:35:55.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.951+0000 7f8d41e00640 1 -- start start 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d41e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d3c0cff70 0x7f8d3c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d41e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c0ce070 con 0x7f8d3c160540 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d41e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d3c0cd460 con 0x7f8d3c071170 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d41e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0cd740 con 0x7f8d3c0cff70 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d3aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8d3c160540 0x7f8d3c0cf860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54260/0 (socket says 172.21.15.192:54260) 2024-09-13T18:35:55.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.952+0000 7f8d3aa00640 1 -- 172.21.15.192:0/1940132123 learned_addr learned my addr 172.21.15.192:0/1940132123 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d33e00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d3c0cff70 0x7f8d3c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397046435 0 0) 0x7f8d3c0ce070 con 0x7f8d3c160540 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d20003520 con 0x7f8d3c160540 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386163636 0 0) 0x7f8d3c0cd460 con 0x7f8d3c071170 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d3c0ce070 con 0x7f8d3c071170 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128640641 0 0) 0x7f8d20003520 con 0x7f8d3c160540 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d3c0cff70 msgr2=0x7f8d3c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d3c0cff70 0x7f8d3c070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 >> v1:172.21.15.194:6789/0 conn(0x7f8d3c071170 legacy=0x7f8d3c0b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c0cda20 con 0x7f8d3c160540 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f8d2c0015f0 con 0x7f8d3c160540 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 >> v1:172.21.15.192:6789/0 conn(0x7f8d3c160540 legacy=0x7f8d3c0cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20003b30 0x7f8d20003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200047c0 0x7f8d20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d20005180 0x7f8d2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c0cd740 con 0x7f8d20005180 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2000bfa0 con 0x7f8d200047c0 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2000c160 con 0x7f8d20003b30 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.953+0000 7f8d33e00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d3c0cff70 0x7f8d3c070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d20005180 0x7f8d2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3aa00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20003b30 0x7f8d20003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d33e00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200047c0 0x7f8d20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 -- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20003b30 msgr2=0x7f8d20003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20003b30 0x7f8d20003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 -- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200047c0 msgr2=0x7f8d20004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200047c0 0x7f8d20004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d3b400640 1 -- 172.21.15.192:0/1940132123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d20003520 con 0x7f8d20005180 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.954+0000 7f8d33e00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200047c0 0x7f8d20004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.955+0000 7f8d3b400640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d20005180 0x7f8d2000b980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001fd0 tx=0x7f8d200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b8b81acf9c1232 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.955+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34003b70 con 0x7f8d20005180 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.955+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3402d050 con 0x7f8d20005180 2024-09-13T18:35:55.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.955+0000 7f8d3a000640 1 -- 172.21.15.192:0/1940132123 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340050d0 con 0x7f8d20005180 2024-09-13T18:35:55.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 -- 172.21.15.192:0/1940132123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d20005180 msgr2=0x7f8d2000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 --2- 172.21.15.192:0/1940132123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d20005180 0x7f8d2000b980 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8d34001fd0 tx=0x7f8d200057f0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d3b400640 1 -- 172.21.15.192:0/1940132123 reap_dead start 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 -- 172.21.15.192:0/1940132123 shutdown_connections 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 -- 172.21.15.192:0/1940132123 >> 172.21.15.192:0/1940132123 conn(0x7f8d3c06a2c0 msgr2=0x7f8d3c06a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 -- 172.21.15.192:0/1940132123 shutdown_connections 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.956+0000 7f8d41e00640 1 -- 172.21.15.192:0/1940132123 wait complete. 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.957+0000 7f8d41e00640 1 Processor -- start 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.957+0000 7f8d41e00640 1 -- start start 2024-09-13T18:35:55.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20005180 0x7f8d3c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1574d0 0x7f8d3c143620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c15b880 con 0x7f8d3c15afc0 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c15bb60 con 0x7f8d3c1574d0 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.958+0000 7f8d41e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d3c15be40 con 0x7f8d20005180 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57646/0 (socket says 172.21.15.192:57646) 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 -- 172.21.15.192:0/3411686424 learned_addr learned my addr 172.21.15.192:0/3411686424 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3aa00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20005180 0x7f8d3c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d33e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1574d0 0x7f8d3c143620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 -- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20005180 msgr2=0x7f8d3c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20005180 0x7f8d3c15c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 -- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1574d0 msgr2=0x7f8d3c143620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1574d0 0x7f8d3c143620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 -- 172.21.15.192:0/3411686424 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c15c120 con 0x7f8d3c15afc0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d3b400640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005040 tx=0x7f8d34001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.959+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340052e0 con 0x7f8d3c15afc0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.960+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34005440 con 0x7f8d3c15afc0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.960+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340057f0 con 0x7f8d3c15afc0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.960+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d3c15c400 con 0x7f8d3c15afc0 2024-09-13T18:35:55.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.960+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d3c15b650 con 0x7f8d3c15afc0 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.961+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d3c15f160 con 0x7f8d3c15afc0 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.961+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d34048460 con 0x7f8d3c15afc0 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.962+0000 7f8d33400640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 0x7f8d1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.962+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d340a9cb0 con 0x7f8d3c15afc0 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.962+0000 7f8d3aa00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 0x7f8d1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:55.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.963+0000 7f8d3aa00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 0x7f8d1806d0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c001050 tx=0x7f8d2c000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:55.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:55.966+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d34074e80 con 0x7f8d3c15afc0 2024-09-13T18:35:56.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.132+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d3c15ee80 con 0x7f8d3c15afc0 2024-09-13T18:35:56.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.132+0000 7f8d33400640 1 -- 172.21.15.192:0/3411686424 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d340784a0 con 0x7f8d3c15afc0 2024-09-13T18:35:56.135 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:35:56.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 msgr2=0x7f8d1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 0x7f8d1806d0f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c001050 tx=0x7f8d2c000f80 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 msgr2=0x7f8d3c145de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d34005040 tx=0x7f8d34001650 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 shutdown_connections 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d1806ac30 0x7f8d1806d0f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d3c15afc0 0x7f8d3c145de0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d3c1574d0 0x7f8d3c143620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 --2- 172.21.15.192:0/3411686424 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20005180 0x7f8d3c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 >> 172.21.15.192:0/3411686424 conn(0x7f8d3c06a2c0 msgr2=0x7f8d3c15f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 shutdown_connections 2024-09-13T18:35:56.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.135+0000 7f8d41e00640 1 -- 172.21.15.192:0/3411686424 wait complete. 2024-09-13T18:35:56.154 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:56.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.307+0000 7fbaa5c00640 1 Processor -- start 2024-09-13T18:35:56.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.307+0000 7fbaa5c00640 1 -- start start 2024-09-13T18:35:56.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.308+0000 7fbaa5c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbaa00b3f10 0x7fbaa015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.308+0000 7fbaa5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 0x7fbaa015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.308+0000 7fbaa5c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa00b2f00 con 0x7fbaa015dee0 2024-09-13T18:35:56.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.308+0000 7fbaa5c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa015aec0 con 0x7fbaa00b0490 2024-09-13T18:35:56.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.308+0000 7fbaa5c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa00b3150 con 0x7fbaa00b3f10 2024-09-13T18:35:56.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 0x7fbaa015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbaa00b3f10 0x7fbaa015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 0x7fbaa015a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57662/0 (socket says 172.21.15.192:57662) 2024-09-13T18:35:56.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9f400640 1 -- 172.21.15.192:0/3021522374 learned_addr learned my addr 172.21.15.192:0/3021522374 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9e000640 1 -- 172.21.15.192:0/3021522374 >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 msgr2=0x7fbaa015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9e000640 1 --2- 172.21.15.192:0/3021522374 >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 0x7fbaa015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9e000640 1 -- 172.21.15.192:0/3021522374 >> v1:172.21.15.194:6789/0 conn(0x7fbaa015dee0 legacy=0x7fbaa00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.309+0000 7fba9e000640 1 -- 172.21.15.192:0/3021522374 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00b3430 con 0x7fbaa00b3f10 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.310+0000 7fba9e000640 1 --2- 172.21.15.192:0/3021522374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b3f10 0x7fbaa015a440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00b4700 tx=0x7fba8c02c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fde08bc74a7b063 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.310+0000 7fba9d600640 1 -- 172.21.15.192:0/3021522374 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c032770 con 0x7fbaa00b3f10 2024-09-13T18:35:56.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.310+0000 7fba9d600640 1 -- 172.21.15.192:0/3021522374 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c0328d0 con 0x7fbaa00b3f10 2024-09-13T18:35:56.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.310+0000 7fba9d600640 1 -- 172.21.15.192:0/3021522374 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c032c60 con 0x7fbaa00b3f10 2024-09-13T18:35:56.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 -- 172.21.15.192:0/3021522374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b3f10 msgr2=0x7fbaa015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/3021522374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b3f10 0x7fbaa015a440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbaa00b4700 tx=0x7fba8c02c870 comp rx=0 tx=0).stop 2024-09-13T18:35:56.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 -- 172.21.15.192:0/3021522374 shutdown_connections 2024-09-13T18:35:56.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/3021522374 >> v2:172.21.15.192:3300/0 conn(0x7fbaa00b0490 0x7fbaa015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/3021522374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b3f10 0x7fbaa015a440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 -- 172.21.15.192:0/3021522374 >> 172.21.15.192:0/3021522374 conn(0x7fbaa00ae960 msgr2=0x7fbaa006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 -- 172.21.15.192:0/3021522374 shutdown_connections 2024-09-13T18:35:56.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.311+0000 7fbaa5c00640 1 -- 172.21.15.192:0/3021522374 wait complete. 2024-09-13T18:35:56.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.313+0000 7fbaa5c00640 1 Processor -- start 2024-09-13T18:35:56.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.313+0000 7fbaa5c00640 1 -- start start 2024-09-13T18:35:56.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b0490 0x7fbaa013ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa01f2ba0 0x7fbaa01f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01f3d60 con 0x7fbaa015dee0 2024-09-13T18:35:56.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01f3fb0 con 0x7fbaa00b0490 2024-09-13T18:35:56.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fbaa5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa01f4290 con 0x7fbaa01f2ba0 2024-09-13T18:35:56.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57678/0 (socket says 172.21.15.192:57678) 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 -- 172.21.15.192:0/1366947290 learned_addr learned my addr 172.21.15.192:0/1366947290 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9ea00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b0490 0x7fbaa013ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9f400640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa01f2ba0 0x7fbaa01f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 -- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa01f2ba0 msgr2=0x7fbaa01f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa01f2ba0 0x7fbaa01f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 -- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b0490 msgr2=0x7fbaa013ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b0490 0x7fbaa013ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.314+0000 7fba9e000640 1 -- 172.21.15.192:0/1366947290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c00b6a0 con 0x7fbaa015dee0 2024-09-13T18:35:56.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fba9e000640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba8c035040 tx=0x7fba8c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c033c40 con 0x7fbaa015dee0 2024-09-13T18:35:56.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c033da0 con 0x7fbaa015dee0 2024-09-13T18:35:56.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c046650 con 0x7fbaa015dee0 2024-09-13T18:35:56.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa01f4570 con 0x7fbaa015dee0 2024-09-13T18:35:56.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.315+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa013e840 con 0x7fbaa015dee0 2024-09-13T18:35:56.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.316+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa01f4a90 con 0x7fbaa015dee0 2024-09-13T18:35:56.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.317+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba8c0467b0 con 0x7fbaa015dee0 2024-09-13T18:35:56.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.318+0000 7fba96a00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.318+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba8c0aa7e0 con 0x7fbaa015dee0 2024-09-13T18:35:56.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.318+0000 7fba9ea00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.319+0000 7fba9ea00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbaa015ae60 tx=0x7fba90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.322+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbaa01f4a90 con 0x7fbaa015dee0 2024-09-13T18:35:56.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.524+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbaa01f4a90 con 0x7fbaa015dee0 2024-09-13T18:35:56.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.525+0000 7fba96a00640 1 -- 172.21.15.192:0/1366947290 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fbaa01f4a90 con 0x7fbaa015dee0 2024-09-13T18:35:56.528 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:56.528 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:35:56.528 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:35:56.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 msgr2=0x7fba8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbaa015ae60 tx=0x7fba90009040 comp rx=0 tx=0).stop 2024-09-13T18:35:56.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 msgr2=0x7fbaa013e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fba8c035040 tx=0x7fba8c004730 comp rx=0 tx=0).stop 2024-09-13T18:35:56.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 shutdown_connections 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa01f2ba0 0x7fbaa01f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015dee0 0x7fbaa013e300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 --2- 172.21.15.192:0/1366947290 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa00b0490 0x7fbaa013ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 >> 172.21.15.192:0/1366947290 conn(0x7fbaa00ae960 msgr2=0x7fbaa0158ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 shutdown_connections 2024-09-13T18:35:56.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.527+0000 7fbaa5c00640 1 -- 172.21.15.192:0/1366947290 wait complete. 2024-09-13T18:35:56.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:56.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.697+0000 7f1757000640 1 Processor -- start 2024-09-13T18:35:56.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.697+0000 7f1757000640 1 -- start start 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1757000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 0x7f175015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1757000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1750140480 con 0x7f17500cb0b0 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1757000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f175015ee90 con 0x7f175015bc20 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1757000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175015f170 con 0x7f17500cacd0 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1747e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f17500cb0b0 0x7f1750140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54268/0 (socket says 172.21.15.192:54268) 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.698+0000 7f1747e00640 1 -- 172.21.15.192:0/2522933049 learned_addr learned my addr 172.21.15.192:0/2522933049 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:56.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174fe00640 1 --2- 172.21.15.192:0/2522933049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 0x7f175015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213386340 0 0) 0x7f1750140480 con 0x7f17500cb0b0 2024-09-13T18:35:56.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1734003520 con 0x7f17500cb0b0 2024-09-13T18:35:56.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963429142 0 0) 0x7f175015ee90 con 0x7f175015bc20 2024-09-13T18:35:56.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1750140480 con 0x7f175015bc20 2024-09-13T18:35:56.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174fe00640 1 -- 172.21.15.192:0/2522933049 >> v1:172.21.15.194:6789/0 conn(0x7f175015bc20 legacy=0x7f17500afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174fe00640 1 -- 172.21.15.192:0/2522933049 >> v1:172.21.15.192:6789/0 conn(0x7f17500cb0b0 legacy=0x7f1750140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2385707696 0 0) 0x7f1734003520 con 0x7f17500cb0b0 2024-09-13T18:35:56.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.699+0000 7f174fe00640 1 -- 172.21.15.192:0/2522933049 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175015f450 con 0x7f17500cacd0 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.700+0000 7f174fe00640 1 --2- 172.21.15.192:0/2522933049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 0x7f175015e790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17400097d0 tx=0x7f174002a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd26750dfb0762f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.700+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1738001670 con 0x7f17500cacd0 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174002ac30 con 0x7f17500cacd0 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f174f400640 1 -- 172.21.15.192:0/2522933049 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740032440 con 0x7f17500cacd0 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 -- 172.21.15.192:0/2522933049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 msgr2=0x7f175015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 --2- 172.21.15.192:0/2522933049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 0x7f175015e790 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f17400097d0 tx=0x7f174002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 -- 172.21.15.192:0/2522933049 shutdown_connections 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 --2- 172.21.15.192:0/2522933049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17500cacd0 0x7f175015e790 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 -- 172.21.15.192:0/2522933049 >> 172.21.15.192:0/2522933049 conn(0x7f17500ae960 msgr2=0x7f175006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 -- 172.21.15.192:0/2522933049 shutdown_connections 2024-09-13T18:35:56.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.701+0000 7f1757000640 1 -- 172.21.15.192:0/2522933049 wait complete. 2024-09-13T18:35:56.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.703+0000 7f1757000640 1 Processor -- start 2024-09-13T18:35:56.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.703+0000 7f1757000640 1 -- start start 2024-09-13T18:35:56.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.703+0000 7f1757000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1757000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17500cb0b0 0x7f175015a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1757000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f175015bc20 0x7f175015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1757000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175006ad60 con 0x7f17500cacd0 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1757000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1750155870 con 0x7f17500cb0b0 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1757000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1750155b50 con 0x7f175015bc20 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57686/0 (socket says 172.21.15.192:57686) 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 -- 172.21.15.192:0/117003531 learned_addr learned my addr 172.21.15.192:0/117003531 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f1747e00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17500cb0b0 0x7f175015a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 -- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f175015bc20 msgr2=0x7f175015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f175015bc20 0x7f175015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 -- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17500cb0b0 msgr2=0x7f175015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17500cb0b0 0x7f175015a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 -- 172.21.15.192:0/117003531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740009400 con 0x7f17500cacd0 2024-09-13T18:35:56.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.704+0000 7f174fe00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17400097d0 tx=0x7f17400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.705+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174003c820 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.705+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174003c980 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.705+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174003ccf0 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.705+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1750155e30 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.705+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1750069ff0 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.706+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17500cb4d0 con 0x7f17500cacd0 2024-09-13T18:35:56.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.707+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1740039050 con 0x7f17500cacd0 2024-09-13T18:35:56.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.707+0000 7f174cc00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 0x7f172c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:56.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.707+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17400a9d70 con 0x7f17500cacd0 2024-09-13T18:35:56.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.708+0000 7f1747e00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 0x7f172c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:56.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.708+0000 7f1747e00640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 0x7f172c06d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f17380017a0 tx=0x7f1738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:56.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.711+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f17500cb4d0 con 0x7f17500cacd0 2024-09-13T18:35:56.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.884+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1750156350 con 0x7f17500cacd0 2024-09-13T18:35:56.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.886+0000 7f174cc00640 1 -- 172.21.15.192:0/117003531 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f1750156350 con 0x7f17500cacd0 2024-09-13T18:35:56.889 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:56.889 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 msgr2=0x7f172c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 0x7f172c06d0c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f17380017a0 tx=0x7f1738009040 comp rx=0 tx=0).stop 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 msgr2=0x7f175013d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f17400097d0 tx=0x7f17400046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 shutdown_connections 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172c06ac00 0x7f172c06d0c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f175015bc20 0x7f175015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17500cb0b0 0x7f175015a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 --2- 172.21.15.192:0/117003531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17500cacd0 0x7f175013d560 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:56.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 >> 172.21.15.192:0/117003531 conn(0x7f17500ae960 msgr2=0x7f175015da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:56.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 shutdown_connections 2024-09-13T18:35:56.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:56.888+0000 7f1757000640 1 -- 172.21.15.192:0/117003531 wait complete. 2024-09-13T18:35:56.906 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:35:56.906 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:35:57.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.059+0000 7f9e1aa00640 1 Processor -- start 2024-09-13T18:35:57.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.059+0000 7f9e1aa00640 1 -- start start 2024-09-13T18:35:57.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.060+0000 7f9e1aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.060+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 0x7f9e14160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e1aa00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e140b2b40 con 0x7f9e140ad840 2024-09-13T18:35:57.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e1aa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e140b21e0 con 0x7f9e1415a910 2024-09-13T18:35:57.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e140b1bf0 con 0x7f9e14160ac0 2024-09-13T18:35:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 0x7f9e14160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35290/0 (socket says 172.21.15.192:35290) 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13e00640 1 -- 172.21.15.192:0/183053975 learned_addr learned my addr 172.21.15.192:0/183053975 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13400640 1 -- 172.21.15.192:0/183053975 >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 msgr2=0x7f9e140b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13400640 1 --2- 172.21.15.192:0/183053975 >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13400640 1 -- 172.21.15.192:0/183053975 >> v1:172.21.15.194:6789/0 conn(0x7f9e140ad840 legacy=0x7f9e140cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13400640 1 -- 172.21.15.192:0/183053975 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e14161510 con 0x7f9e14160ac0 2024-09-13T18:35:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.061+0000 7f9e13e00640 1 --2- 172.21.15.192:0/183053975 >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.062+0000 7f9e13400640 1 --2- 172.21.15.192:0/183053975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 0x7f9e14160f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097a0 tx=0x7f9e0002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4497cdf60247b811 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e12a00640 1 -- 172.21.15.192:0/183053975 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0002ae50 con 0x7f9e14160ac0 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e12a00640 1 -- 172.21.15.192:0/183053975 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e00032440 con 0x7f9e14160ac0 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e12a00640 1 -- 172.21.15.192:0/183053975 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e000327d0 con 0x7f9e14160ac0 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 -- 172.21.15.192:0/183053975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 msgr2=0x7f9e14160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/183053975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 0x7f9e14160f00 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9e000097a0 tx=0x7f9e0002a100 comp rx=0 tx=0).stop 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 -- 172.21.15.192:0/183053975 shutdown_connections 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/183053975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e14160ac0 0x7f9e14160f00 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/183053975 >> v2:172.21.15.194:3300/0 conn(0x7f9e1415a910 0x7f9e140b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 -- 172.21.15.192:0/183053975 >> 172.21.15.192:0/183053975 conn(0x7f9e140b08f0 msgr2=0x7f9e140b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 -- 172.21.15.192:0/183053975 shutdown_connections 2024-09-13T18:35:57.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.063+0000 7f9e1aa00640 1 -- 172.21.15.192:0/183053975 wait complete. 2024-09-13T18:35:57.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.065+0000 7f9e1aa00640 1 Processor -- start 2024-09-13T18:35:57.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.065+0000 7f9e1aa00640 1 -- start start 2024-09-13T18:35:57.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e140ad840 0x7f9e14149890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e14160ac0 0x7f9e141586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1415c4f0 con 0x7f9e1415a910 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1415b8e0 con 0x7f9e14160ac0 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e1aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1415bbc0 con 0x7f9e140ad840 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57700/0 (socket says 172.21.15.192:57700) 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e13400640 1 -- 172.21.15.192:0/2679513956 learned_addr learned my addr 172.21.15.192:0/2679513956 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:57.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.066+0000 7f9e13e00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e140ad840 0x7f9e14149890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e18a00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e14160ac0 0x7f9e141586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 -- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e140ad840 msgr2=0x7f9e14149890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e140ad840 0x7f9e14149890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 -- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e14160ac0 msgr2=0x7f9e141586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e14160ac0 0x7f9e141586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 -- 172.21.15.192:0/2679513956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e040094d0 con 0x7f9e1415a910 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e13400640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e00035040 tx=0x7f9e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0003d710 con 0x7f9e1415a910 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0003d890 con 0x7f9e1415a910 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e00009400 con 0x7f9e1415a910 2024-09-13T18:35:57.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.067+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0003dc40 con 0x7f9e1415a910 2024-09-13T18:35:57.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.068+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e1415c180 con 0x7f9e1415a910 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.069+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e1415c660 con 0x7f9e1415a910 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.069+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e00039040 con 0x7f9e1415a910 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.070+0000 7f9e0be00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 0x7f9df406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.070+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e000a9ad0 con 0x7f9e1415a910 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.070+0000 7f9e13e00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 0x7f9df406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.071+0000 7f9e13e00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 0x7f9df406d0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006ca0 tx=0x7f9e04009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.075+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e00074d50 con 0x7f9e1415a910 2024-09-13T18:35:57.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.243+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e1415acf0 con 0x7f9e1415a910 2024-09-13T18:35:57.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.243+0000 7f9e0be00640 1 -- 172.21.15.192:0/2679513956 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e00041020 con 0x7f9e1415a910 2024-09-13T18:35:57.246 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:35:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 msgr2=0x7f9df406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 0x7f9df406d0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006ca0 tx=0x7f9e04009240 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 msgr2=0x7f9e1415af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9e00035040 tx=0x7f9e000046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 shutdown_connections 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9df406ac30 0x7f9df406d0f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e14160ac0 0x7f9e141586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e1415a910 0x7f9e1415af00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 --2- 172.21.15.192:0/2679513956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e140ad840 0x7f9e14149890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 >> 172.21.15.192:0/2679513956 conn(0x7f9e140b08f0 msgr2=0x7f9e140cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.245+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 shutdown_connections 2024-09-13T18:35:57.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.246+0000 7f9e1aa00640 1 -- 172.21.15.192:0/2679513956 wait complete. 2024-09-13T18:35:57.265 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:35:57.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.417+0000 7ffb5a000640 1 Processor -- start 2024-09-13T18:35:57.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.417+0000 7ffb5a000640 1 -- start start 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.418+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 0x7ffb5406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.418+0000 7ffb5a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb5406a8b0 0x7ffb540b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.418+0000 7ffb5a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb5406b480 con 0x7ffb540b3bd0 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.418+0000 7ffb5a000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb540b4060 con 0x7ffb5406a8b0 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.418+0000 7ffb5a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540ce770 con 0x7ffb541434c0 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb4aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb5406a8b0 0x7ffb540b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb53e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ffb540b3bd0 0x7ffb5406e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54270/0 (socket says 172.21.15.192:54270) 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb53e00640 1 -- 172.21.15.192:0/3198601948 learned_addr learned my addr 172.21.15.192:0/3198601948 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb53400640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 0x7ffb5406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb4aa00640 1 -- 172.21.15.192:0/3198601948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 msgr2=0x7ffb5406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:57.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb4aa00640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 0x7ffb5406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb4aa00640 1 -- 172.21.15.192:0/3198601948 >> v1:172.21.15.192:6789/0 conn(0x7ffb540b3bd0 legacy=0x7ffb5406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb4aa00640 1 -- 172.21.15.192:0/3198601948 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5406b760 con 0x7ffb5406a8b0 2024-09-13T18:35:57.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb52a00640 1 -- 172.21.15.192:0/3198601948 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211104205 0 0) 0x7ffb5406b480 con 0x7ffb540b3bd0 2024-09-13T18:35:57.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.419+0000 7ffb53400640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 0x7ffb5406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.420+0000 7ffb4aa00640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb5406a8b0 0x7ffb540b3690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0097d0 tx=0x7ffb3c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71493f53ba95c515 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.420+0000 7ffb52a00640 1 -- 172.21.15.192:0/3198601948 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c032440 con 0x7ffb5406a8b0 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb52a00640 1 -- 172.21.15.192:0/3198601948 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c0325a0 con 0x7ffb5406a8b0 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb52a00640 1 -- 172.21.15.192:0/3198601948 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c032930 con 0x7ffb5406a8b0 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 -- 172.21.15.192:0/3198601948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb5406a8b0 msgr2=0x7ffb540b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb5406a8b0 0x7ffb540b3690 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c0097d0 tx=0x7ffb3c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 -- 172.21.15.192:0/3198601948 shutdown_connections 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb5406a8b0 0x7ffb540b3690 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 --2- 172.21.15.192:0/3198601948 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb541434c0 0x7ffb5406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 -- 172.21.15.192:0/3198601948 >> 172.21.15.192:0/3198601948 conn(0x7ffb540b08f0 msgr2=0x7ffb540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 -- 172.21.15.192:0/3198601948 shutdown_connections 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.421+0000 7ffb5a000640 1 -- 172.21.15.192:0/3198601948 wait complete. 2024-09-13T18:35:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.423+0000 7ffb5a000640 1 Processor -- start 2024-09-13T18:35:57.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.423+0000 7ffb5a000640 1 -- start start 2024-09-13T18:35:57.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb5406a8b0 0x7ffb5413a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 0x7ffb54071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb5406feb0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540719a0 con 0x7ffb541434c0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb5a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb540716d0 con 0x7ffb5406a8b0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57720/0 (socket says 172.21.15.192:57720) 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 -- 172.21.15.192:0/2631494143 learned_addr learned my addr 172.21.15.192:0/2631494143 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb53400640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb5406a8b0 0x7ffb5413a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb53e00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 0x7ffb54071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 -- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb5406a8b0 msgr2=0x7ffb5413a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb5406a8b0 0x7ffb5413a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 -- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 msgr2=0x7ffb54071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 0x7ffb54071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb4aa00640 1 -- 172.21.15.192:0/2631494143 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb3c009400 con 0x7ffb540b3bd0 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.424+0000 7ffb53e00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 0x7ffb54071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:35:57.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb4aa00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c035040 tx=0x7ffb3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c032440 con 0x7ffb540b3bd0 2024-09-13T18:35:57.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c006e10 con 0x7ffb540b3bd0 2024-09-13T18:35:57.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c030be0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb54070090 con 0x7ffb540b3bd0 2024-09-13T18:35:57.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.425+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb54070650 con 0x7ffb540b3bd0 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.426+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb5406acf0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.427+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb3c039040 con 0x7ffb540b3bd0 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.428+0000 7ffb4be00640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.428+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb3c0a9dd0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.428+0000 7ffb53400640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.429+0000 7ffb53400640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.432+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffb3c0ae070 con 0x7ffb540b3bd0 2024-09-13T18:35:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.601+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffb5406f2c0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.602+0000 7ffb4be00640 1 -- 172.21.15.192:0/2631494143 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffb3c0750c0 con 0x7ffb540b3bd0 2024-09-13T18:35:57.605 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 msgr2=0x7ffb3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ffb44006fd0 tx=0x7ffb44008040 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 msgr2=0x7ffb54139900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c035040 tx=0x7ffb3c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 shutdown_connections 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb541434c0 0x7ffb54071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb540b3bd0 0x7ffb54139900 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 --2- 172.21.15.192:0/2631494143 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb5406a8b0 0x7ffb5413a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 >> 172.21.15.192:0/2631494143 conn(0x7ffb540b08f0 msgr2=0x7ffb540af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 shutdown_connections 2024-09-13T18:35:57.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.604+0000 7ffb5a000640 1 -- 172.21.15.192:0/2631494143 wait complete. 2024-09-13T18:35:57.624 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:35:57.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.776+0000 7f5eb9c00640 1 Processor -- start 2024-09-13T18:35:57.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.776+0000 7f5eb9c00640 1 -- start start 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 0x7f5eb415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb415b070 con 0x7f5eb415b810 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb415eba0 con 0x7f5eb40b02f0 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb415ee20 con 0x7f5eb41402c0 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb9200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 0x7f5eb415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:40562/0 (socket says 172.21.15.192:40562) 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.777+0000 7f5eb3e00640 1 -- 172.21.15.192:0/254159933 learned_addr learned my addr 172.21.15.192:0/254159933 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.778+0000 7f5eb3e00640 1 -- 172.21.15.192:0/254159933 >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 msgr2=0x7f5eb415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.778+0000 7f5eb3e00640 1 --2- 172.21.15.192:0/254159933 >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 0x7f5eb415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.778+0000 7f5eb3e00640 1 -- 172.21.15.192:0/254159933 >> v1:172.21.15.194:6789/0 conn(0x7f5eb415b810 legacy=0x7f5eb40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.778+0000 7f5eb3e00640 1 -- 172.21.15.192:0/254159933 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb415f100 con 0x7f5eb41402c0 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.778+0000 7f5eb9200640 1 --2- 172.21.15.192:0/254159933 >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 0x7f5eb415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.779+0000 7f5eb3e00640 1 --2- 172.21.15.192:0/254159933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009e50 tx=0x7f5ea402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28062031b43f4f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.779+0000 7f5eb3400640 1 -- 172.21.15.192:0/254159933 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4031600 con 0x7f5eb41402c0 2024-09-13T18:35:57.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.779+0000 7f5eb3400640 1 -- 172.21.15.192:0/254159933 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea402d050 con 0x7f5eb41402c0 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.779+0000 7f5eb3400640 1 -- 172.21.15.192:0/254159933 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4031980 con 0x7f5eb41402c0 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 -- 172.21.15.192:0/254159933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 msgr2=0x7f5eb415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/254159933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4009e50 tx=0x7f5ea402a730 comp rx=0 tx=0).stop 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 -- 172.21.15.192:0/254159933 shutdown_connections 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/254159933 >> v2:172.21.15.194:3300/0 conn(0x7f5eb40b02f0 0x7f5eb415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/254159933 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb41402c0 0x7f5eb415e660 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 -- 172.21.15.192:0/254159933 >> 172.21.15.192:0/254159933 conn(0x7f5eb40ae7f0 msgr2=0x7f5eb406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 -- 172.21.15.192:0/254159933 shutdown_connections 2024-09-13T18:35:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.780+0000 7f5eb9c00640 1 -- 172.21.15.192:0/254159933 wait complete. 2024-09-13T18:35:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.781+0000 7f5eb9c00640 1 Processor -- start 2024-09-13T18:35:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.781+0000 7f5eb9c00640 1 -- start start 2024-09-13T18:35:57.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 0x7f5eb413cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb415b810 0x7f5eb4152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb415dc00 con 0x7f5eb41402c0 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb415d2d0 con 0x7f5eb40b02f0 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.782+0000 7f5eb9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb415d5b0 con 0x7f5eb415b810 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eb3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 0x7f5eb413cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57724/0 (socket says 172.21.15.192:57724) 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 -- 172.21.15.192:0/2664305387 learned_addr learned my addr 172.21.15.192:0/2664305387 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eb9200640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb415b810 0x7f5eb4152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 -- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb415b810 msgr2=0x7f5eb4152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb415b810 0x7f5eb4152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 -- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 msgr2=0x7f5eb413cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 0x7f5eb413cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 -- 172.21.15.192:0/2664305387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eac009400 con 0x7f5eb41402c0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eb3e00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 0x7f5eb413cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.783+0000 7f5eab400640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c400 tx=0x7f5e9c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.784+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c0052d0 con 0x7f5eb41402c0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.784+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9c005430 con 0x7f5eb41402c0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.784+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea4009b30 con 0x7f5eb41402c0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.784+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e9c003830 con 0x7f5eb41402c0 2024-09-13T18:35:57.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.784+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb413d530 con 0x7f5eb41402c0 2024-09-13T18:35:57.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.785+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb415d410 con 0x7f5eb41402c0 2024-09-13T18:35:57.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.786+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e9c003990 con 0x7f5eb41402c0 2024-09-13T18:35:57.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.786+0000 7f5eb0c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 0x7f5e9006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:57.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.787+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e9c088910 con 0x7f5eb41402c0 2024-09-13T18:35:57.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.787+0000 7f5eb3e00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 0x7f5e9006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:57.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.787+0000 7f5eb3e00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 0x7f5e9006d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4033000 tx=0x7f5ea4009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:57.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.791+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5eb415d410 con 0x7f5eb41402c0 2024-09-13T18:35:57.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.965+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5eb415d410 con 0x7f5eb41402c0 2024-09-13T18:35:57.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.966+0000 7f5eb0c00640 1 -- 172.21.15.192:0/2664305387 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5eb415d410 con 0x7f5eb41402c0 2024-09-13T18:35:57.969 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:35:57.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 msgr2=0x7f5e9006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 0x7f5e9006d0c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5ea4033000 tx=0x7f5ea4009000 comp rx=0 tx=0).stop 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 msgr2=0x7f5eb413c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c00c400 tx=0x7f5e9c00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 shutdown_connections 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e9006ac00 0x7f5e9006d0c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5eb415b810 0x7f5eb4152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5eb41402c0 0x7f5eb413c740 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 --2- 172.21.15.192:0/2664305387 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5eb40b02f0 0x7f5eb413cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:57.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 >> 172.21.15.192:0/2664305387 conn(0x7f5eb40ae7f0 msgr2=0x7f5eb40cc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:57.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 shutdown_connections 2024-09-13T18:35:57.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:57.968+0000 7f5eb9c00640 1 -- 172.21.15.192:0/2664305387 wait complete. 2024-09-13T18:35:57.987 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:58.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.137+0000 7f4699600640 1 Processor -- start 2024-09-13T18:35:58.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.137+0000 7f4699600640 1 -- start start 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4699600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 0x7f4694066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4699600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4694070570 con 0x7f4694070f80 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4699600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46940ce180 con 0x7f46940c9ae0 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4699600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4694066a50 con 0x7f46941604c0 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4692000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4694070f80 0x7f46940cda70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54280/0 (socket says 172.21.15.192:54280) 2024-09-13T18:35:58.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.138+0000 7f4692000640 1 -- 172.21.15.192:0/1953947074 learned_addr learned my addr 172.21.15.192:0/1953947074 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4692a00640 1 --2- 172.21.15.192:0/1953947074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 0x7f4694066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2491973000 0 0) 0x7f4694070570 con 0x7f4694070f80 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4678003520 con 0x7f4694070f80 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1339391618 0 0) 0x7f46940ce180 con 0x7f46940c9ae0 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4694070570 con 0x7f46940c9ae0 2024-09-13T18:35:58.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4692a00640 1 -- 172.21.15.192:0/1953947074 >> v1:172.21.15.194:6789/0 conn(0x7f46940c9ae0 legacy=0x7f46940cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 199659557 0 0) 0x7f4678003520 con 0x7f4694070f80 2024-09-13T18:35:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4692a00640 1 -- 172.21.15.192:0/1953947074 >> v1:172.21.15.192:6789/0 conn(0x7f4694070f80 legacy=0x7f46940cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.139+0000 7f4692a00640 1 -- 172.21.15.192:0/1953947074 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46940707a0 con 0x7f46941604c0 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.140+0000 7f4692a00640 1 --2- 172.21.15.192:0/1953947074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 0x7f4694066510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46840097d0 tx=0x7f468402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=911b01e743ca63ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.140+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680001670 con 0x7f46941604c0 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468402ac30 con 0x7f46941604c0 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4691600640 1 -- 172.21.15.192:0/1953947074 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684032440 con 0x7f46941604c0 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 -- 172.21.15.192:0/1953947074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 msgr2=0x7f4694066510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 --2- 172.21.15.192:0/1953947074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 0x7f4694066510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f46840097d0 tx=0x7f468402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 -- 172.21.15.192:0/1953947074 shutdown_connections 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 --2- 172.21.15.192:0/1953947074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46941604c0 0x7f4694066510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 -- 172.21.15.192:0/1953947074 >> 172.21.15.192:0/1953947074 conn(0x7f46940cf490 msgr2=0x7f46940cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:58.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 -- 172.21.15.192:0/1953947074 shutdown_connections 2024-09-13T18:35:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.141+0000 7f4699600640 1 -- 172.21.15.192:0/1953947074 wait complete. 2024-09-13T18:35:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.143+0000 7f4699600640 1 Processor -- start 2024-09-13T18:35:58.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.143+0000 7f4699600640 1 -- start start 2024-09-13T18:35:58.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 0x7f46940b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46941604c0 0x7f469406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4694157550 con 0x7f4694070f80 2024-09-13T18:35:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46940b2d60 con 0x7f46941604c0 2024-09-13T18:35:58.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4699600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46940b3040 con 0x7f46940c9ae0 2024-09-13T18:35:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4692a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4692a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57740/0 (socket says 172.21.15.192:57740) 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4692000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 0x7f46940b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.144+0000 7f4692a00640 1 -- 172.21.15.192:0/3963737722 learned_addr learned my addr 172.21.15.192:0/3963737722 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4693400640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46941604c0 0x7f469406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 -- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46941604c0 msgr2=0x7f469406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46941604c0 0x7f469406c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 -- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 msgr2=0x7f4694157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 -- 172.21.15.192:0/3963737722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009400 con 0x7f46940c9ae0 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692a00640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4692000640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 0x7f46940b2460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f468000c4d0 tx=0x7f468000c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4680005ce0 con 0x7f46940c9ae0 2024-09-13T18:35:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4680005e60 con 0x7f46940c9ae0 2024-09-13T18:35:58.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.145+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46940b3320 con 0x7f46940c9ae0 2024-09-13T18:35:58.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.146+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800072b0 con 0x7f46940c9ae0 2024-09-13T18:35:58.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.146+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46940b3b70 con 0x7f46940c9ae0 2024-09-13T18:35:58.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.147+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46941608a0 con 0x7f46940c9ae0 2024-09-13T18:35:58.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.148+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4680007410 con 0x7f46940c9ae0 2024-09-13T18:35:58.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.148+0000 7f468aa00640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 0x7f467406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:58.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.149+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4680088a20 con 0x7f46940c9ae0 2024-09-13T18:35:58.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.149+0000 7f4692a00640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 0x7f467406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:58.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.149+0000 7f4692a00640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 0x7f467406d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4684000c00 tx=0x7f468402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:58.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.153+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4680053d20 con 0x7f46940c9ae0 2024-09-13T18:35:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.352+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46940b3d30 con 0x7f46940c9ae0 2024-09-13T18:35:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.353+0000 7f468aa00640 1 -- 172.21.15.192:0/3963737722 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f4680017090 con 0x7f46940c9ae0 2024-09-13T18:35:58.356 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:58.356 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:35:58.356 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 msgr2=0x7f467406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 0x7f467406d0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4684000c00 tx=0x7f468402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 msgr2=0x7f46940b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 0x7f46940b2460 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f468000c4d0 tx=0x7f468000c990 comp rx=0 tx=0).stop 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 shutdown_connections 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f467406ac30 0x7f467406d0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f46941604c0 0x7f469406c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f46940c9ae0 0x7f46940b2460 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 --2- 172.21.15.192:0/3963737722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4694070f80 0x7f4694157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 >> 172.21.15.192:0/3963737722 conn(0x7f46940cf490 msgr2=0x7f46940b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 shutdown_connections 2024-09-13T18:35:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.355+0000 7f4699600640 1 -- 172.21.15.192:0/3963737722 wait complete. 2024-09-13T18:35:58.375 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:35:58.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.524+0000 7fc75ca00640 1 Processor -- start 2024-09-13T18:35:59.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.524+0000 7fc75ca00640 1 -- start start 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc75ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7580b3f10 0x7fc75815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc75ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 0x7fc75815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc75ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7580b2f00 con 0x7fc75815dee0 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc75ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75815aec0 con 0x7fc7580b3f10 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc75ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7580b3150 con 0x7fc7580b0490 2024-09-13T18:35:59.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc755e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc75815dee0 0x7fc7580afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54294/0 (socket says 172.21.15.192:54294) 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc755400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7580b3f10 0x7fc75815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.525+0000 7fc755e00640 1 -- 172.21.15.192:0/1238947818 learned_addr learned my addr 172.21.15.192:0/1238947818 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc756800640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 0x7fc75815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc755400640 1 -- 172.21.15.192:0/1238947818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 msgr2=0x7fc75815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc755400640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 0x7fc75815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc755400640 1 -- 172.21.15.192:0/1238947818 >> v1:172.21.15.192:6789/0 conn(0x7fc75815dee0 legacy=0x7fc7580afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc755400640 1 -- 172.21.15.192:0/1238947818 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7580b3430 con 0x7fc7580b3f10 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.526+0000 7fc756800640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 0x7fc75815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.527+0000 7fc755400640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b3f10 0x7fc75815a440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097a0 tx=0x7fc74402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf19131c524029a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.527+0000 7fc754a00640 1 -- 172.21.15.192:0/1238947818 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744032440 con 0x7fc7580b3f10 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.527+0000 7fc754a00640 1 -- 172.21.15.192:0/1238947818 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7440325a0 con 0x7fc7580b3f10 2024-09-13T18:35:59.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.527+0000 7fc754a00640 1 -- 172.21.15.192:0/1238947818 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc744032930 con 0x7fc7580b3f10 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 -- 172.21.15.192:0/1238947818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b3f10 msgr2=0x7fc75815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b3f10 0x7fc75815a440 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7440097a0 tx=0x7fc74402a180 comp rx=0 tx=0).stop 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 -- 172.21.15.192:0/1238947818 shutdown_connections 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7580b0490 0x7fc75815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 --2- 172.21.15.192:0/1238947818 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b3f10 0x7fc75815a440 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 -- 172.21.15.192:0/1238947818 >> 172.21.15.192:0/1238947818 conn(0x7fc7580ae960 msgr2=0x7fc75806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 -- 172.21.15.192:0/1238947818 shutdown_connections 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.528+0000 7fc75ca00640 1 -- 172.21.15.192:0/1238947818 wait complete. 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.529+0000 7fc75ca00640 1 Processor -- start 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.529+0000 7fc75ca00640 1 -- start start 2024-09-13T18:35:59.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc75815dee0 0x7fc758139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc75813a150 0x7fc7581e3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758139780 con 0x7fc7580b0490 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc758138b70 con 0x7fc75813a150 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc75ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc758138e50 con 0x7fc75815dee0 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc755e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc755e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57768/0 (socket says 172.21.15.192:57768) 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.530+0000 7fc755e00640 1 -- 172.21.15.192:0/4012881479 learned_addr learned my addr 172.21.15.192:0/4012881479 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc756800640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc75813a150 0x7fc7581e3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755400640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc75815dee0 0x7fc758139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 -- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc75815dee0 msgr2=0x7fc758139c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc75815dee0 0x7fc758139c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 -- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc75813a150 msgr2=0x7fc7581e3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc75813a150 0x7fc7581e3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 -- 172.21.15.192:0/4012881479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc744009400 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc755e00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c480 tx=0x7fc74800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc748005ce0 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc748005e40 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc758139130 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7480072f0 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.531+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc758136470 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.532+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7580afd80 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.533+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc748007450 con 0x7fc7580b0490 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.534+0000 7fc74e000640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 0x7fc73806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.534+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc748088810 con 0x7fc7580b0490 2024-09-13T18:35:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.534+0000 7fc755400640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 0x7fc73806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.535+0000 7fc755400640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 0x7fc73806d0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc74402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.538+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc748053a90 con 0x7fc7580b0490 2024-09-13T18:35:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.707+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc75806c180 con 0x7fc7580b0490 2024-09-13T18:35:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.708+0000 7fc74e000640 1 -- 172.21.15.192:0/4012881479 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fc748017090 con 0x7fc7580b0490 2024-09-13T18:35:59.330 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:59.330 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:35:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 msgr2=0x7fc73806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 0x7fc73806d0f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc744034000 tx=0x7fc74402e000 comp rx=0 tx=0).stop 2024-09-13T18:35:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 msgr2=0x7fc758135f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc74800c480 tx=0x7fc74800c940 comp rx=0 tx=0).stop 2024-09-13T18:35:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 shutdown_connections 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc73806ac30 0x7fc73806d0f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc75813a150 0x7fc7581e3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc75815dee0 0x7fc758139c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 --2- 172.21.15.192:0/4012881479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7580b0490 0x7fc758135f30 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 >> 172.21.15.192:0/4012881479 conn(0x7fc7580ae960 msgr2=0x7fc7580b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 shutdown_connections 2024-09-13T18:35:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:58.710+0000 7fc75ca00640 1 -- 172.21.15.192:0/4012881479 wait complete. 2024-09-13T18:35:59.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:35:59.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.484+0000 7f5e47800640 1 Processor -- start 2024-09-13T18:35:59.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.484+0000 7f5e47800640 1 -- start start 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e47800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5e400cacd0 0x7f5e4015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e47800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e40140480 con 0x7f5e400cb0b0 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e47800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e400cb520 con 0x7f5e4015bc20 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e47800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e4015ee90 con 0x7f5e400cacd0 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e44e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5e400cacd0 0x7f5e4015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e3fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5e400cb0b0 0x7f5e40140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:54308/0 (socket says 172.21.15.192:54308) 2024-09-13T18:35:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.485+0000 7f5e3fe00640 1 -- 172.21.15.192:0/2537937234 learned_addr learned my addr 172.21.15.192:0/2537937234 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:35:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.486+0000 7f5e44e00640 1 -- 172.21.15.192:0/2537937234 >> v1:172.21.15.194:6789/0 conn(0x7f5e4015bc20 legacy=0x7f5e400afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.486+0000 7f5e44e00640 1 -- 172.21.15.192:0/2537937234 >> v1:172.21.15.192:6789/0 conn(0x7f5e400cb0b0 legacy=0x7f5e40140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.486+0000 7f5e44e00640 1 -- 172.21.15.192:0/2537937234 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4015f170 con 0x7f5e400cacd0 2024-09-13T18:35:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.486+0000 7f5e3f400640 1 -- 172.21.15.192:0/2537937234 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787148003 0 0) 0x7f5e40140480 con 0x7f5e400cb0b0 2024-09-13T18:35:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.487+0000 7f5e44e00640 1 --2- 172.21.15.192:0/2537937234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e4015e790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097a0 tx=0x7f5e3402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b8ce226cea280 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.487+0000 7f5e3f400640 1 -- 172.21.15.192:0/2537937234 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34032440 con 0x7f5e400cacd0 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.487+0000 7f5e3f400640 1 -- 172.21.15.192:0/2537937234 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e340325a0 con 0x7f5e400cacd0 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.487+0000 7f5e3f400640 1 -- 172.21.15.192:0/2537937234 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34032930 con 0x7f5e400cacd0 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 -- 172.21.15.192:0/2537937234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 msgr2=0x7f5e4015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 --2- 172.21.15.192:0/2537937234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e4015e790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5e340097a0 tx=0x7f5e3402a230 comp rx=0 tx=0).stop 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 -- 172.21.15.192:0/2537937234 shutdown_connections 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 --2- 172.21.15.192:0/2537937234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e4015e790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 -- 172.21.15.192:0/2537937234 >> 172.21.15.192:0/2537937234 conn(0x7f5e400ae960 msgr2=0x7f5e4006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 -- 172.21.15.192:0/2537937234 shutdown_connections 2024-09-13T18:35:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.488+0000 7f5e47800640 1 -- 172.21.15.192:0/2537937234 wait complete. 2024-09-13T18:35:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.489+0000 7f5e47800640 1 Processor -- start 2024-09-13T18:35:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.489+0000 7f5e47800640 1 -- start start 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 0x7f5e40157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 0x7f5e40157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40155d80 con 0x7f5e400cacd0 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401e4bc0 con 0x7f5e400cb0b0 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.490+0000 7f5e47800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e40158b20 con 0x7f5e4015bc20 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57792/0 (socket says 172.21.15.192:57792) 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 -- 172.21.15.192:0/4023760535 learned_addr learned my addr 172.21.15.192:0/4023760535 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e3fe00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 0x7f5e40157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e45800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 0x7f5e40157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 -- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 msgr2=0x7f5e40157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 0x7f5e40157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 -- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 msgr2=0x7f5e40157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 0x7f5e40157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 -- 172.21.15.192:0/4023760535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e34009400 con 0x7f5e400cacd0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e3fe00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 0x7f5e40157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e45800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 0x7f5e40157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.491+0000 7f5e44e00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.492+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e34030b80 con 0x7f5e400cacd0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.492+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e34030ce0 con 0x7f5e400cacd0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.492+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e401e4890 con 0x7f5e400cacd0 2024-09-13T18:35:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.492+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3403d680 con 0x7f5e400cacd0 2024-09-13T18:35:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.492+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e40158840 con 0x7f5e400cacd0 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.493+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4015e790 con 0x7f5e400cacd0 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.494+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5e34039040 con 0x7f5e400cacd0 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.494+0000 7f5e3cc00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.494+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e340a9f20 con 0x7f5e400cacd0 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.495+0000 7f5e3fe00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:35:59.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.495+0000 7f5e3fe00640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 0x7f5e2006d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e401f3f30 tx=0x7f5e2c007c50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:35:59.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.498+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5e340751a0 con 0x7f5e400cacd0 2024-09-13T18:35:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.701+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e4006c6c0 con 0x7f5e400cacd0 2024-09-13T18:35:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.702+0000 7f5e3cc00640 1 -- 172.21.15.192:0/4023760535 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f5e340787c0 con 0x7f5e400cacd0 2024-09-13T18:35:59.704 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:35:59.705 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:35:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 msgr2=0x7f5e2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 0x7f5e2006d0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5e401f3f30 tx=0x7f5e2c007c50 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 msgr2=0x7f5e40155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000c00 tx=0x7f5e340046c0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 shutdown_connections 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5e2006ac00 0x7f5e2006d0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5e4015bc20 0x7f5e40157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5e400cb0b0 0x7f5e40157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 --2- 172.21.15.192:0/4023760535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e400cacd0 0x7f5e40155840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 >> 172.21.15.192:0/4023760535 conn(0x7f5e400ae960 msgr2=0x7f5e4015d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 shutdown_connections 2024-09-13T18:35:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:35:59.704+0000 7f5e47800640 1 -- 172.21.15.192:0/4023760535 wait complete. 2024-09-13T18:36:00.125 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:35:40.213331+0000', 'modified': '2024-09-13T18:35:43.236945+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4285}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4285': {'gid': 4285, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/978606429', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 978606429}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 978606429}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:36:00.125 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:36:00.125 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:36:00.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.276+0000 7f99d9000640 1 Processor -- start 2024-09-13T18:36:00.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.276+0000 7f99d9000640 1 -- start start 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d41604c0 0x7f99d4066510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99d40c9ae0 0x7f99d40cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d9000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d4070570 con 0x7f99d4070f80 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d9000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40ce180 con 0x7f99d40c9ae0 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4066a50 con 0x7f99d41604c0 2024-09-13T18:36:00.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99d40c9ae0 0x7f99d40cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f99d40c9ae0 0x7f99d40cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57806/0 (socket says 172.21.15.192:57806) 2024-09-13T18:36:00.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.277+0000 7f99d2800640 1 -- 172.21.15.192:0/541819462 learned_addr learned my addr 172.21.15.192:0/541819462 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.278+0000 7f99d1e00640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d41604c0 0x7f99d4066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.278+0000 7f99d2800640 1 -- 172.21.15.192:0/541819462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d41604c0 msgr2=0x7f99d4066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.278+0000 7f99d2800640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d41604c0 0x7f99d4066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.278+0000 7f99d2800640 1 -- 172.21.15.192:0/541819462 >> v1:172.21.15.194:6789/0 conn(0x7f99d4070f80 legacy=0x7f99d40cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.278+0000 7f99d2800640 1 -- 172.21.15.192:0/541819462 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40707a0 con 0x7f99d40c9ae0 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.279+0000 7f99d2800640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d40cd060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009e50 tx=0x7f99cc02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3d4985b058ed82 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.279+0000 7f99d1400640 1 -- 172.21.15.192:0/541819462 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc031600 con 0x7f99d40c9ae0 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.279+0000 7f99d1400640 1 -- 172.21.15.192:0/541819462 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc02d050 con 0x7f99d40c9ae0 2024-09-13T18:36:00.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.279+0000 7f99d1400640 1 -- 172.21.15.192:0/541819462 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc031980 con 0x7f99d40c9ae0 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 -- 172.21.15.192:0/541819462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 msgr2=0x7f99d40cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d40cd060 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009e50 tx=0x7f99cc02a710 comp rx=0 tx=0).stop 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 -- 172.21.15.192:0/541819462 shutdown_connections 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d40cd060 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 --2- 172.21.15.192:0/541819462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d41604c0 0x7f99d4066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 -- 172.21.15.192:0/541819462 >> 172.21.15.192:0/541819462 conn(0x7f99d40cf490 msgr2=0x7f99d40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 -- 172.21.15.192:0/541819462 shutdown_connections 2024-09-13T18:36:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.280+0000 7f99d9000640 1 -- 172.21.15.192:0/541819462 wait complete. 2024-09-13T18:36:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.281+0000 7f99d9000640 1 Processor -- start 2024-09-13T18:36:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.281+0000 7f99d9000640 1 -- start start 2024-09-13T18:36:00.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d4070f80 0x7f99d40b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 0x7f99d4151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d41527e0 con 0x7f99d40c9ae0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4155a80 con 0x7f99d41604c0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.282+0000 7f99d9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d4159300 con 0x7f99d4070f80 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57810/0 (socket says 172.21.15.192:57810) 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 -- 172.21.15.192:0/3435965991 learned_addr learned my addr 172.21.15.192:0/3435965991 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99d2800640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 0x7f99d4151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d4070f80 0x7f99d40b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 -- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d4070f80 msgr2=0x7f99d40b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d4070f80 0x7f99d40b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 -- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 msgr2=0x7f99d4151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 0x7f99d4151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 -- 172.21.15.192:0/3435965991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc009b30 con 0x7f99d40c9ae0 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99d2800640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 0x7f99d4151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99cbe00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c480 tx=0x7f99bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99ca000640 1 -- 172.21.15.192:0/3435965991 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc0052d0 con 0x7f99d40c9ae0 2024-09-13T18:36:00.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99ca000640 1 -- 172.21.15.192:0/3435965991 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99bc005430 con 0x7f99d40c9ae0 2024-09-13T18:36:00.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.283+0000 7f99ca000640 1 -- 172.21.15.192:0/3435965991 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99bc012870 con 0x7f99d40c9ae0 2024-09-13T18:36:00.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.284+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d4158d40 con 0x7f99d40c9ae0 2024-09-13T18:36:00.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.284+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d4155cb0 con 0x7f99d40c9ae0 2024-09-13T18:36:00.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.285+0000 7f99ca000640 1 -- 172.21.15.192:0/3435965991 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f99bc0129d0 con 0x7f99d40c9ae0 2024-09-13T18:36:00.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.286+0000 7f99ca000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 0x7f99b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.286+0000 7f99ca000640 1 -- 172.21.15.192:0/3435965991 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99bc088f20 con 0x7f99d40c9ae0 2024-09-13T18:36:00.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.287+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 0x7f99b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.287+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 0x7f99b006d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c4006fd0 tx=0x7f99c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.287+0000 7f99dbdff740 1 Processor -- start 2024-09-13T18:36:00.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.287+0000 7f99dbdff740 1 -- start start 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea11f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f0e90 0x561ea1240ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea115cab0 con 0x561ea121ab80 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea115a240 con 0x561ea11f36d0 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea1155b30 con 0x561ea11f0e90 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57816/0 (socket says 172.21.15.192:57816) 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99d2800640 1 -- 172.21.15.192:0/3819453312 learned_addr learned my addr 172.21.15.192:0/3819453312 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99cbe00640 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f0e90 0x561ea1240ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.288+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea11f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 -- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f0e90 msgr2=0x561ea1240ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f0e90 0x561ea1240ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 -- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 msgr2=0x561ea11f3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea11f3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 -- 172.21.15.192:0/3819453312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea1120bd0 con 0x561ea121ab80 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99d2800640 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009f70 tx=0x7f99cc02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d3aeff75bf1783 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99c2a00640 1 -- 172.21.15.192:0/3819453312 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03c680 con 0x561ea121ab80 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99c2a00640 1 -- 172.21.15.192:0/3819453312 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc03c7e0 con 0x561ea121ab80 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.289+0000 7f99c2a00640 1 -- 172.21.15.192:0/3819453312 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03cb90 con 0x561ea121ab80 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 -- 172.21.15.192:0/3819453312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 msgr2=0x561ea12410e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009f70 tx=0x7f99cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 -- 172.21.15.192:0/3819453312 shutdown_connections 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121ab80 0x561ea12410e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f0e90 0x561ea1240ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3819453312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea11f3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 -- 172.21.15.192:0/3819453312 >> 172.21.15.192:0/3819453312 conn(0x561ea11efe00 msgr2=0x561ea12382b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 -- 172.21.15.192:0/3819453312 shutdown_connections 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.290+0000 7f99dbdff740 1 -- 172.21.15.192:0/3819453312 wait complete. 2024-09-13T18:36:00.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.291+0000 7f99dbdff740 1 -- start start 2024-09-13T18:36:00.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.291+0000 7f99dbdff740 1 Processor -- start 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea1205570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1235850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea10f7260 con 0x561ea121e6f0 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea10f6f00 con 0x561ea11f36d0 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea0ebcf20 con 0x561ea121ab80 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99dbdff740 10 client.0 _ll_register_callbacks cb 0x561ea114f1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57828/0 (socket says 172.21.15.192:57828) 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99d2800640 1 -- 172.21.15.192:0/3006961337 learned_addr learned my addr 172.21.15.192:0/3006961337 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99cbe00640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1235850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.292+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea1205570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 -- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 msgr2=0x561ea1235850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1235850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 -- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 msgr2=0x561ea1205570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea1205570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 -- 172.21.15.192:0/3006961337 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d40707a0 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99d2800640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009e50 tx=0x7f99cc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b0038b0cb284a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99b7400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03cb50 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99cc03ccb0 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ea117fcd0 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99cc03ce70 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99dbdff740 10 client.4677 fetch_fsmap learned FSMap version 8 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561ea11541b0 con 0x561ea121e6f0 2024-09-13T18:36:00.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.293+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561ea117fcd0 con 0x561ea121e6f0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f99cc045070 con 0x561ea121e6f0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 10 client.4677 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 10 client.4677 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 20 client.4677 populate_metadata read hostname 'smithi192' 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea12074d0 0x561ea1208360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 4 client.4677 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 --> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ea0e493c0 con 0x561ea12074d0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea12074d0 0x561ea1208360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99d1e00640 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea12074d0 0x561ea1208360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b77ffa258998be server_cookie=ea47dabcfdb7b415 in_seq=0 out_seq=0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.294+0000 7f99b7400640 10 client.4677 ms_handle_connect on v2:172.21.15.192:6836/978606429 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99b7400640 1 -- 172.21.15.192:0/3006961337 <== mds.0 v2:172.21.15.192:6836/978606429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x561ea0e493c0 con 0x561ea12074d0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99b7400640 10 client.4677 handle_command_reply: tid=0 2024-09-13T18:36:00.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 client.4677 shutdown 2024-09-13T18:36:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 msgr2=0x561ea121c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009e50 tx=0x7f99cc004ab0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 shutdown_connections 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea12074d0 0x561ea1208360 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea121c0f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1235850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 --2- 172.21.15.192:0/3006961337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea11f36d0 0x561ea1205570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99b7400640 0 client.4677 ms_handle_reset on v2:172.21.15.192:6836/978606429 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.295+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 >> 172.21.15.192:0/3006961337 conn(0x561ea11f0e90 msgr2=0x561ea1239080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.296+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 shutdown_connections 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.296+0000 7f99dbdff740 1 -- 172.21.15.192:0/3006961337 wait complete. 2024-09-13T18:36:00.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.296+0000 7f99dbdff740 20 client.4677 trim_cache size 0 max 16384 2024-09-13T18:36:00.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.311+0000 7f99dbdff740 1 Processor -- start 2024-09-13T18:36:00.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.311+0000 7f99dbdff740 1 -- start start 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f36d0 0x561ea1205190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121ab80 0x561ea1218e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea12093f0 con 0x561ea121e6f0 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea123a5e0 con 0x561ea121ab80 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea121ee80 con 0x561ea11f36d0 2024-09-13T18:36:00.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57838/0 (socket says 172.21.15.192:57838) 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 -- 172.21.15.192:0/1154944747 learned_addr learned my addr 172.21.15.192:0/1154944747 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d1e00640 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f36d0 0x561ea1205190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99cbe00640 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121ab80 0x561ea1218e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 -- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f36d0 msgr2=0x561ea1205190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f36d0 0x561ea1205190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 -- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121ab80 msgr2=0x561ea1218e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121ab80 0x561ea1218e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.312+0000 7f99d2800640 1 -- 172.21.15.192:0/1154944747 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea1189170 con 0x561ea121e6f0 2024-09-13T18:36:00.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99d2800640 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000f80 tx=0x7f99cc047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a061e1ea72e8bd57 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99c3400640 1 -- 172.21.15.192:0/1154944747 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03c950 con 0x561ea121e6f0 2024-09-13T18:36:00.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99c3400640 1 -- 172.21.15.192:0/1154944747 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc03cad0 con 0x561ea121e6f0 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99c3400640 1 -- 172.21.15.192:0/1154944747 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc03ce80 con 0x561ea121e6f0 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99dbdff740 1 -- 172.21.15.192:0/1154944747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 msgr2=0x561ea12340d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99dbdff740 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000f80 tx=0x7f99cc047000 comp rx=0 tx=0).stop 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99dbdff740 1 -- 172.21.15.192:0/1154944747 shutdown_connections 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.313+0000 7f99dbdff740 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea121e6f0 0x561ea12340d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121ab80 0x561ea1218e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 --2- 172.21.15.192:0/1154944747 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea11f36d0 0x561ea1205190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 -- 172.21.15.192:0/1154944747 >> 172.21.15.192:0/1154944747 conn(0x561ea11f0e90 msgr2=0x561ea1235430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 -- 172.21.15.192:0/1154944747 shutdown_connections 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 -- 172.21.15.192:0/1154944747 wait complete. 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 -- start start 2024-09-13T18:36:00.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.314+0000 7f99dbdff740 1 Processor -- start 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1251720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121e6f0 0x561ea129c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1209520 con 0x561ea11f36d0 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1251d20 con 0x561ea121e6f0 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x561ea124a5d0 con 0x561ea121ab80 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.315+0000 7f99dbdff740 10 client.0 _ll_register_callbacks cb 0x7f99c400b1e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57840/0 (socket says 172.21.15.192:57840) 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 -- 172.21.15.192:0/827122398 learned_addr learned my addr 172.21.15.192:0/827122398 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99cbe00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1251720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 -- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 msgr2=0x561ea1251720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1251720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 -- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121e6f0 msgr2=0x561ea129c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121e6f0 0x561ea129c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 -- 172.21.15.192:0/827122398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea11541b0 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99d1e00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99c400bfd0 tx=0x7f99c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4da961e0200d4102 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99b7400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c4014c40 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99c4014da0 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.316+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99cc03c7e0 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c400fed0 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 10 client.4683 fetch_fsmap learned FSMap version 8 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561ea10f6470 con 0x561ea11f36d0 2024-09-13T18:36:00.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc03c7e0 con 0x561ea11f36d0 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f99c40291b0 con 0x561ea11f36d0 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 10 client.4683 fetch_fsmap finished waiting for FSMap version 8 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 10 client.4683 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 20 client.4683 populate_metadata read hostname 'smithi192' 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea1236820 0x561ea1236c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 4 client.4683 mds_command: new command op to 4285 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 --> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] -- command(tid 0: {"prefix": "status"}) v1 -- 0x561ea0e5a6c0 con 0x561ea1236820 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.317+0000 7f99cbe00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea1236820 0x561ea1236c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99cbe00640 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea1236820 0x561ea1236c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65476289ce108860 server_cookie=67ca819ba0ddbc28 in_seq=0 out_seq=0 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99b7400640 10 client.4683 ms_handle_connect on v2:172.21.15.192:6836/978606429 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99b7400640 1 -- 172.21.15.192:0/827122398 <== mds.0 v2:172.21.15.192:6836/978606429 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x561ea0e5a6c0 con 0x561ea1236820 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99b7400640 10 client.4683 handle_command_reply: tid=0 2024-09-13T18:36:00.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 client.4683 shutdown 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 msgr2=0x561ea1208e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f99c400bfd0 tx=0x7f99c4004730 comp rx=0 tx=0).stop 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 shutdown_connections 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561ea121e6f0 0x561ea129c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x561ea121ab80 0x561ea1251720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:6836/978606429,v1:172.21.15.192:6837/978606429] conn(0x561ea1236820 0x561ea1236c20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 --2- 172.21.15.192:0/827122398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x561ea11f36d0 0x561ea1208e10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99b7400640 0 client.4683 ms_handle_reset on v2:172.21.15.192:6836/978606429 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 >> 172.21.15.192:0/827122398 conn(0x561ea11f0e90 msgr2=0x561ea1251010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 shutdown_connections 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.318+0000 7f99dbdff740 1 -- 172.21.15.192:0/827122398 wait complete. 2024-09-13T18:36:00.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99dbdff740 20 client.4683 trim_cache size 0 max 16384 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4285, 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:36:00.326 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 20.100695448, 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 8, 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 21, 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 21, 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 26.850921441000001 2024-09-13T18:36:00.327 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 msgr2=0x7f99b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 0x7f99b006d0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f99c4006fd0 tx=0x7f99c4008040 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 msgr2=0x7f99d4151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f99bc00c480 tx=0x7f99bc00c940 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 shutdown_connections 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f99b006ac00 0x7f99b006d0c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f99d41604c0 0x7f99d4151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f99d40c9ae0 0x7f99d4151ed0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 --2- 172.21.15.192:0/3435965991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f99d4070f80 0x7f99d40b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 >> 172.21.15.192:0/3435965991 conn(0x7f99d40cf490 msgr2=0x7f99d40c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:00.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 shutdown_connections 2024-09-13T18:36:00.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:00.319+0000 7f99d9000640 1 -- 172.21.15.192:0/3435965991 wait complete. 2024-09-13T18:36:00.337 INFO:teuthology.run_tasks:Running task sequential... 2024-09-13T18:36:00.347 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-13T18:36:00.347 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-13T18:36:00.348 INFO:teuthology.task.print:Enabling mgr modules 2024-09-13T18:36:00.348 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T18:36:00.383 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T18:36:00.384 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-13T18:36:00.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.384 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:36:00.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.420 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-13T18:36:00.518 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-13T18:36:00.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:00.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.521 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:36:00.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-13T18:36:00.653 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-13T18:36:00.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:00.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.657 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:36:00.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.697 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-09-13T18:36:00.801 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-09-13T18:36:00.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:00.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.804 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:36:00.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:00.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-09-13T18:36:00.940 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-09-13T18:36:00.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:36:00.943 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-09-13T18:36:00.943 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:36:00.943 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:00.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:01.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.092+0000 7fa9c7a00640 1 Processor -- start 2024-09-13T18:36:01.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.092+0000 7fa9c7a00640 1 -- start start 2024-09-13T18:36:01.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9c0150480 0x7fa9c015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9c0071810 0x7fa9c00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c00b2230 0x7fa9c00cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c0071dd0 con 0x7fa9c0071810 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9c00cb770 con 0x7fa9c0150480 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c7a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00cba50 con 0x7fa9c00b2230 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9bfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9c0071810 0x7fa9c00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9bfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa9c0071810 0x7fa9c00b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34736/0 (socket says 172.21.15.192:34736) 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9bfe00640 1 -- 172.21.15.192:0/1334429206 learned_addr learned my addr 172.21.15.192:0/1334429206 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c5000640 1 --2- 172.21.15.192:0/1334429206 >> v2:172.21.15.194:3300/0 conn(0x7fa9c0150480 0x7fa9c015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.093+0000 7fa9c5a00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c00b2230 0x7fa9c00cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.094+0000 7fa9bfe00640 1 -- 172.21.15.192:0/1334429206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c00b2230 msgr2=0x7fa9c00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.094+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c00b2230 0x7fa9c00cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.094+0000 7fa9bfe00640 1 -- 172.21.15.192:0/1334429206 >> v2:172.21.15.194:3300/0 conn(0x7fa9c0150480 msgr2=0x7fa9c015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.094+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/1334429206 >> v2:172.21.15.194:3300/0 conn(0x7fa9c0150480 0x7fa9c015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.094+0000 7fa9bfe00640 1 -- 172.21.15.192:0/1334429206 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9c00cbd30 con 0x7fa9c0071810 2024-09-13T18:36:01.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c00b1cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00b07c0 tx=0x7fa9ac02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7629c27b0698ea01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9bf400640 1 -- 172.21.15.192:0/1334429206 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac02ae90 con 0x7fa9c0071810 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9bf400640 1 -- 172.21.15.192:0/1334429206 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac032440 con 0x7fa9c0071810 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9bf400640 1 -- 172.21.15.192:0/1334429206 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac0327d0 con 0x7fa9c0071810 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9c7a00640 1 -- 172.21.15.192:0/1334429206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 msgr2=0x7fa9c00b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.095+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c00b1cf0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa9c00b07c0 tx=0x7fa9ac02a140 comp rx=0 tx=0).stop 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 -- 172.21.15.192:0/1334429206 shutdown_connections 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c00b2230 0x7fa9c00cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/1334429206 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c00b1cf0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/1334429206 >> v2:172.21.15.194:3300/0 conn(0x7fa9c0150480 0x7fa9c015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 -- 172.21.15.192:0/1334429206 >> 172.21.15.192:0/1334429206 conn(0x7fa9c00ae960 msgr2=0x7fa9c006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 -- 172.21.15.192:0/1334429206 shutdown_connections 2024-09-13T18:36:01.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.096+0000 7fa9c7a00640 1 -- 172.21.15.192:0/1334429206 wait complete. 2024-09-13T18:36:01.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.097+0000 7fa9c7a00640 1 Processor -- start 2024-09-13T18:36:01.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.097+0000 7fa9c7a00640 1 -- start start 2024-09-13T18:36:01.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c00b2230 0x7fa9c0151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 0x7fa9c00af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c00703a0 con 0x7fa9c0071810 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c0070680 con 0x7fa9c00b2230 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c7a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9c0070960 con 0x7fa9c0150480 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34744/0 (socket says 172.21.15.192:34744) 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.098+0000 7fa9c5000640 1 -- 172.21.15.192:0/4035715344 learned_addr learned my addr 172.21.15.192:0/4035715344 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 0x7fa9c00af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c00b2230 0x7fa9c0151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 -- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 msgr2=0x7fa9c00af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 0x7fa9c00af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 -- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c00b2230 msgr2=0x7fa9c0151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c00b2230 0x7fa9c0151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 -- 172.21.15.192:0/4035715344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9ac0094d0 con 0x7fa9c0071810 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 0x7fa9c00af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c5000640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e870 tx=0x7fa9b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b40094f0 con 0x7fa9c0071810 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9b400c940 con 0x7fa9c0071810 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9b400ccf0 con 0x7fa9c0071810 2024-09-13T18:36:01.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.099+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9c0070c40 con 0x7fa9c0071810 2024-09-13T18:36:01.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.100+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9c0070030 con 0x7fa9c0071810 2024-09-13T18:36:01.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.100+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9c00cc530 con 0x7fa9c0071810 2024-09-13T18:36:01.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.101+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa9b4013470 con 0x7fa9c0071810 2024-09-13T18:36:01.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.102+0000 7fa9bcc00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 0x7fa9a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:01.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.102+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9b40893a0 con 0x7fa9c0071810 2024-09-13T18:36:01.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.102+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 0x7fa9a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:01.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.103+0000 7fa9bfe00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 0x7fa9a006d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac034000 tx=0x7fa9ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:01.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.106+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa9b4054620 con 0x7fa9c0071810 2024-09-13T18:36:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.308+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa9c0066a20 con 0x7fa9c0071810 2024-09-13T18:36:01.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.309+0000 7fa9bcc00640 1 -- 172.21.15.192:0/4035715344 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa9b4057c40 con 0x7fa9c0071810 2024-09-13T18:36:01.312 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 msgr2=0x7fa9a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 0x7fa9a006d0c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac034000 tx=0x7fa9ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 msgr2=0x7fa9c014f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa9b400e870 tx=0x7fa9b400ed30 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 shutdown_connections 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa9a006ac00 0x7fa9a006d0c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9c0150480 0x7fa9c00af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9c00b2230 0x7fa9c0151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 --2- 172.21.15.192:0/4035715344 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9c0071810 0x7fa9c014f950 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.311+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 >> 172.21.15.192:0/4035715344 conn(0x7fa9c00ae960 msgr2=0x7fa9c00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.312+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 shutdown_connections 2024-09-13T18:36:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:01.312+0000 7fa9c7a00640 1 -- 172.21.15.192:0/4035715344 wait complete. 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:01.330 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:01.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:01.331 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:01.366 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42748sec preferred_lft 42748sec 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:36:01.367 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:01.368 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:36:01.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:01.368 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:01.368 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:01.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:36:01.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2024-09-13T18:36:01.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2024-09-13T18:36:01.369 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:36:01.369 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:01.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:01.728 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:01.785 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:36:01.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:01.788 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:36:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:36:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:01.849 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:01.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:01.850 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:02.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.433 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:36:02.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.469 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-13T18:36:02.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.547 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:02.547 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:02.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:36:02.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T18:36:02.547 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:02.676 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T18:36:02.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T18:36:02.677 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:02.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:02.869 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:02.869 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:02.869 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:36:02.869 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:36:02.870 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:02.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:02.985 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:03.019 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:03.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:03.020 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:03.094 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:36:03.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:03.094 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:03.230 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:03.231 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:03.880 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:03.880 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:03.880 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:03.880 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:03.880 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:03.882 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:36:03.882 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:03.882 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:03.882 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:03.882 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:03.885 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:03.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:03.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:03.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:03.944 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:03.988 INFO:teuthology.orchestra.run.smithi192.stdout:client4692 2024-09-13T18:36:03.988 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:03.988 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:04.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.064 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:04.147 INFO:teuthology.orchestra.run.smithi192.stdout:client4692 2024-09-13T18:36:04.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.148 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:04.232 INFO:teuthology.orchestra.run.smithi192.stdout:client4692 2024-09-13T18:36:04.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.233 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client4692/status') 2024-09-13T18:36:04.332 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4692 (3)192.168.0.1:0/2332504354 2024-09-13T18:36:04.332 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-13T18:36:04.332 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-13T18:36:04.333 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-13T18:36:04.333 INFO:teuthology.orchestra.run.smithi192.stderr:69 bytes copied, 5.5538e-05 s, 1.2 MB/s 2024-09-13T18:36:04.335 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-09-13T18:36:04.335 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:36:04.335 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:36:04.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:04.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.484+0000 7f7bcea00640 1 Processor -- start 2024-09-13T18:36:04.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.484+0000 7f7bcea00640 1 -- start start 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7bc815dee0 0x7f7bc80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc80b3f10 0x7f7bc80b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcea00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bc80b2f00 con 0x7f7bc815e2c0 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcea00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bc80b3150 con 0x7f7bc815dee0 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc80b3430 con 0x7f7bc80b3f10 2024-09-13T18:36:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7bc815dee0 0x7f7bc80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7bc815dee0 0x7f7bc80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34746/0 (socket says 172.21.15.192:34746) 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bcca00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7bc815e2c0 0x7f7bc815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41884/0 (socket says 172.21.15.192:41884) 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 -- 172.21.15.192:0/3528398681 learned_addr learned my addr 172.21.15.192:0/3528398681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7400640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc80b3f10 0x7f7bc80b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 -- 172.21.15.192:0/3528398681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc80b3f10 msgr2=0x7f7bc80b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc80b3f10 0x7f7bc80b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.486+0000 7f7bc7e00640 1 -- 172.21.15.192:0/3528398681 >> v1:172.21.15.192:6789/0 conn(0x7f7bc815e2c0 legacy=0x7f7bc815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.487+0000 7f7bc6a00640 1 -- 172.21.15.192:0/3528398681 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1223562704 0 0) 0x7f7bc80b2f00 con 0x7f7bc815e2c0 2024-09-13T18:36:04.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.487+0000 7f7bc7e00640 1 -- 172.21.15.192:0/3528398681 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc80b3710 con 0x7f7bc815dee0 2024-09-13T18:36:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bc7e00640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815dee0 0x7f7bc80afd80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009870 tx=0x7f7bb802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02c57601d8b2a3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bc6a00640 1 -- 172.21.15.192:0/3528398681 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8032440 con 0x7f7bc815dee0 2024-09-13T18:36:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bc6a00640 1 -- 172.21.15.192:0/3528398681 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bb80325a0 con 0x7f7bc815dee0 2024-09-13T18:36:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bc6a00640 1 -- 172.21.15.192:0/3528398681 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bb8032930 con 0x7f7bc815dee0 2024-09-13T18:36:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 -- 172.21.15.192:0/3528398681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815dee0 msgr2=0x7f7bc80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815dee0 0x7f7bc80afd80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8009870 tx=0x7f7bb802a270 comp rx=0 tx=0).stop 2024-09-13T18:36:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 -- 172.21.15.192:0/3528398681 shutdown_connections 2024-09-13T18:36:04.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc80b3f10 0x7f7bc80b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 --2- 172.21.15.192:0/3528398681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815dee0 0x7f7bc80afd80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.488+0000 7f7bcea00640 1 -- 172.21.15.192:0/3528398681 >> 172.21.15.192:0/3528398681 conn(0x7f7bc80ae960 msgr2=0x7f7bc806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.489+0000 7f7bcea00640 1 -- 172.21.15.192:0/3528398681 shutdown_connections 2024-09-13T18:36:04.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.489+0000 7f7bcea00640 1 -- 172.21.15.192:0/3528398681 wait complete. 2024-09-13T18:36:04.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.490+0000 7f7bcea00640 1 Processor -- start 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.490+0000 7f7bcea00640 1 -- start start 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 0x7f7bc81f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bc815e2c0 0x7f7bc815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc815bf50 con 0x7f7bc815c6a0 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc81f5fa0 con 0x7f7bc815e2c0 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.491+0000 7f7bcea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc815b340 con 0x7f7bc815dee0 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bc7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 0x7f7bc81f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34762/0 (socket says 172.21.15.192:34762) 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bc7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 0x7f7bc81f5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:41690/0 (socket says 172.21.15.192:41690) 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 -- 172.21.15.192:0/2651731432 learned_addr learned my addr 172.21.15.192:0/2651731432 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:04.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bc7400640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bc815e2c0 0x7f7bc815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 -- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 msgr2=0x7f7bc81f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 0x7f7bc81f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 -- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bc815e2c0 msgr2=0x7f7bc815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bc815e2c0 0x7f7bc815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 -- 172.21.15.192:0/2651731432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb80094d0 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.492+0000 7f7bcca00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c730 tx=0x7f7bc000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.493+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000ce40 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.493+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000a640 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.493+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc815b620 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.493+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bc000aa30 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.493+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc815bbe0 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.494+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc815c100 con 0x7f7bc815c6a0 2024-09-13T18:36:04.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.495+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bc000ab90 con 0x7f7bc815c6a0 2024-09-13T18:36:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.496+0000 7f7bbfe00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 0x7f7ba806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.496+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bc0088a10 con 0x7f7bc815c6a0 2024-09-13T18:36:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.496+0000 7f7bc7e00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 0x7f7ba806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:04.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.497+0000 7f7bc7e00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 0x7f7ba806d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:04.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.500+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7bc815c100 con 0x7f7bc815c6a0 2024-09-13T18:36:04.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.703+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7bc815c100 con 0x7f7bc815c6a0 2024-09-13T18:36:04.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.703+0000 7f7bbfe00640 1 -- 172.21.15.192:0/2651731432 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7bc815c100 con 0x7f7bc815c6a0 2024-09-13T18:36:04.706 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:04.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 msgr2=0x7f7ba806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 0x7f7ba806d0c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8034000 tx=0x7f7bb802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:04.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 msgr2=0x7f7bc813f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:04.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c730 tx=0x7f7bc000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 shutdown_connections 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ba806ac00 0x7f7ba806d0c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7bc815c6a0 0x7f7bc813f4b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7bc815e2c0 0x7f7bc815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 --2- 172.21.15.192:0/2651731432 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7bc815dee0 0x7f7bc81f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 >> 172.21.15.192:0/2651731432 conn(0x7f7bc80ae960 msgr2=0x7f7bc806ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 shutdown_connections 2024-09-13T18:36:04.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:04.705+0000 7f7bcea00640 1 -- 172.21.15.192:0/2651731432 wait complete. 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:36:04.723 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:36:04.724 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:04.724 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:36:04.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.724 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:04.760 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:04.761 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:04.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.762 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:04.855 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:36:04.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.858 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:36:04.894 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:36:04.894 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:04.895 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:04.895 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:04.895 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:04.895 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:04.895 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:04.895 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:04.895 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:04.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:04.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:04.896 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:05.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.040 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:36:05.075 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:36:05.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.075 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-13T18:36:05.150 INFO:teuthology.orchestra.run.smithi192.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-13T18:36:05.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.151 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:05.151 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:05.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:36:05.151 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-13T18:36:05.151 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:05.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.277 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 3e:ca:aa:9a:9c:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.333 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::3cca:aaff:fe9a:9c40/64 scope link 2024-09-13T18:36:05.334 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-13T18:36:05.390 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 3e:ca:aa:9a:9c:40 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::3cca:aaff:fe9a:9c40/64 scope link 2024-09-13T18:36:05.391 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:05.393 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-13T18:36:05.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-13T18:36:05.394 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:05.559 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.559 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:05.559 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:05.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.1 up 2024-09-13T18:36:05.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:36:05.560 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:05.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:05.674 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-13T18:36:05.712 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-13T18:36:05.713 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:05.713 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:36:05.787 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-09-13T18:36:05.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:05.915 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:05.915 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:05.942 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:05.942 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:05.942 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:05.942 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 2@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:05.942 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:05.943 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-09-13T18:36:05.944 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:05.944 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:05.944 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:05.944 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:05.947 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:05.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:05.947 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-13T18:36:06.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.003 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:06.041 INFO:teuthology.orchestra.run.smithi192.stdout:client4511 2024-09-13T18:36:06.041 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:06.041 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:06.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.117 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:06.194 INFO:teuthology.orchestra.run.smithi192.stdout:client4511 2024-09-13T18:36:06.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.195 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:06.272 INFO:teuthology.orchestra.run.smithi192.stdout:client4511 2024-09-13T18:36:06.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.273 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client4511/status') 2024-09-13T18:36:06.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:06.361 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:06.367 INFO:teuthology.orchestra.run.smithi192.stdout:instance: client.4511 (3)172.21.15.192:0/2323545087 2024-09-13T18:36:06.368 INFO:teuthology.orchestra.run.smithi192.stdout:blocklisted: false 2024-09-13T18:36:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records in 2024-09-13T18:36:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:0+1 records out 2024-09-13T18:36:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:71 bytes copied, 7.3701e-05 s, 963 kB/s 2024-09-13T18:36:06.371 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-09-13T18:36:06.371 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:36:06.371 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:06.371 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:06.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.561+0000 7f7367600640 1 Processor -- start 2024-09-13T18:36:06.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.561+0000 7f7367600640 1 -- start start 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.562+0000 7f7367600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7360146610 0x7f73600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.562+0000 7f7367600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600b2780 0x7f73600ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.562+0000 7f7367600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600ae770 con 0x7f73600afd80 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.562+0000 7f7367600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73600cd920 con 0x7f7360146610 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.562+0000 7f7367600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600cdb30 con 0x7f73600b2780 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7360146610 0x7f73600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7360146610 0x7f73600ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34778/0 (socket says 172.21.15.192:34778) 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 -- 172.21.15.192:0/3736262940 learned_addr learned my addr 172.21.15.192:0/3736262940 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7357e00640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600b2780 0x7f73600ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 -- 172.21.15.192:0/3736262940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600b2780 msgr2=0x7f73600ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600b2780 0x7f73600ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 -- 172.21.15.192:0/3736262940 >> v1:172.21.15.194:6789/0 conn(0x7f73600afd80 legacy=0x7f73600b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f7364c00640 1 -- 172.21.15.192:0/3736262940 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600ae1b0 con 0x7f7360146610 2024-09-13T18:36:06.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.563+0000 7f735fe00640 1 -- 172.21.15.192:0/3736262940 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2131223078 0 0) 0x7f73600ae770 con 0x7f73600afd80 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.564+0000 7f7364c00640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73600ce2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7350009870 tx=0x7f735002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0a278c372fd7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.564+0000 7f735fe00640 1 -- 172.21.15.192:0/3736262940 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350032440 con 0x7f7360146610 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f735fe00640 1 -- 172.21.15.192:0/3736262940 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73500325a0 con 0x7f7360146610 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f735fe00640 1 -- 172.21.15.192:0/3736262940 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7350032930 con 0x7f7360146610 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 -- 172.21.15.192:0/3736262940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 msgr2=0x7f73600ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73600ce2f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7350009870 tx=0x7f735002a270 comp rx=0 tx=0).stop 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 -- 172.21.15.192:0/3736262940 shutdown_connections 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600b2780 0x7f73600ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 --2- 172.21.15.192:0/3736262940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73600ce2f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 -- 172.21.15.192:0/3736262940 >> 172.21.15.192:0/3736262940 conn(0x7f73600ae960 msgr2=0x7f736006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 -- 172.21.15.192:0/3736262940 shutdown_connections 2024-09-13T18:36:06.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.565+0000 7f7367600640 1 -- 172.21.15.192:0/3736262940 wait complete. 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.567+0000 7f7367600640 1 Processor -- start 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.567+0000 7f7367600640 1 -- start start 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600afd80 0x7f73600c3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73600b2780 0x7f73601f25c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601584c0 con 0x7f7360146610 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73601587a0 con 0x7f73600b2780 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7367600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7360158a80 con 0x7f73600afd80 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34780/0 (socket says 172.21.15.192:34780) 2024-09-13T18:36:06.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 -- 172.21.15.192:0/4142130354 learned_addr learned my addr 172.21.15.192:0/4142130354 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7364c00640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600afd80 0x7f73600c3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7357e00640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73600b2780 0x7f73601f25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 -- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600afd80 msgr2=0x7f73600c3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600afd80 0x7f73600c3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 -- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73600b2780 msgr2=0x7f73601f25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73600b2780 0x7f73601f25c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.568+0000 7f7365600640 1 -- 172.21.15.192:0/4142130354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73500094d0 con 0x7f7360146610 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f7365600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f735800c760 tx=0x7f735800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358003da0 con 0x7f7360146610 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735800ce70 con 0x7f7360146610 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7358005290 con 0x7f7360146610 2024-09-13T18:36:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7360158d60 con 0x7f7360146610 2024-09-13T18:36:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.569+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73600c41a0 con 0x7f7360146610 2024-09-13T18:36:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.570+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7360159280 con 0x7f7360146610 2024-09-13T18:36:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.571+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73580053f0 con 0x7f7360146610 2024-09-13T18:36:06.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.572+0000 7f735d600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 0x7f733c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:06.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.572+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73580890f0 con 0x7f7360146610 2024-09-13T18:36:06.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.573+0000 7f7364c00640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 0x7f733c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:06.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.573+0000 7f7364c00640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 0x7f733c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7350034000 tx=0x7f735002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:06.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.577+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7360159280 con 0x7f7360146610 2024-09-13T18:36:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.778+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7360159280 con 0x7f7360146610 2024-09-13T18:36:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.778+0000 7f735d600640 1 -- 172.21.15.192:0/4142130354 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7360159280 con 0x7f7360146610 2024-09-13T18:36:06.781 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 msgr2=0x7f733c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 0x7f733c06d0c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7350034000 tx=0x7f735002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 msgr2=0x7f73601f2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f735800c760 tx=0x7f735800cc20 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 shutdown_connections 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f733c06ac00 0x7f733c06d0c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7360146610 0x7f73601f2b00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73600b2780 0x7f73601f25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 --2- 172.21.15.192:0/4142130354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73600afd80 0x7f73600c3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 >> 172.21.15.192:0/4142130354 conn(0x7f73600ae960 msgr2=0x7f736006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 shutdown_connections 2024-09-13T18:36:06.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:06.781+0000 7f7367600640 1 -- 172.21.15.192:0/4142130354 wait complete. 2024-09-13T18:36:06.799 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:06.800 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:36:06.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.800 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:06.840 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:36:06.841 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:06.842 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T18:36:06.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add name ceph-brx type bridge 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr flush dev ceph-brx 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set ceph-brx up 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T18:36:06.842 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:07.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:07.201 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:07.258 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:36:07.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:07.261 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:36:07.304 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:36:07.304 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:07.304 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:07.305 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:07.305 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:07.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:07.305 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:07.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:07.913 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:36:07.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:07.948 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-09-13T18:36:08.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:08.025 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:08.025 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:08.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:36:08.025 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T18:36:08.025 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:08.149 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T18:36:08.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T18:36:08.150 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:08.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:08.348 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:08.348 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:08.348 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:36:08.348 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T18:36:08.348 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:08.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:08.464 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:08.499 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:36:08.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:08.500 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:08.574 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:36:08.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:08.575 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:08.712 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:08.712 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:09.342 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:09.344 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:09.347 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:09.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:09.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:09.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:09.403 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:09.443 INFO:teuthology.orchestra.run.smithi194.stdout:client4710 2024-09-13T18:36:09.444 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:09.444 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:09.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:09.519 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:09.597 INFO:teuthology.orchestra.run.smithi194.stdout:client4710 2024-09-13T18:36:09.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:09.597 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:09.675 INFO:teuthology.orchestra.run.smithi194.stdout:client4710 2024-09-13T18:36:09.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:09.675 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client4710/status') 2024-09-13T18:36:09.770 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4710 (3)172.21.15.194:0/1220497135 2024-09-13T18:36:09.771 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-09-13T18:36:09.771 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-09-13T18:36:09.771 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-09-13T18:36:09.771 INFO:teuthology.orchestra.run.smithi194.stderr:71 bytes copied, 5.3302e-05 s, 1.3 MB/s 2024-09-13T18:36:09.773 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-09-13T18:36:09.773 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T18:36:09.773 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:36:09.773 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:09.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.933+0000 7feedfe00640 1 Processor -- start 2024-09-13T18:36:09.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.933+0000 7feedfe00640 1 -- start start 2024-09-13T18:36:09.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.934+0000 7feedfe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.934+0000 7feedfe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.934+0000 7feedfe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed80b2f00 con 0x7feed815dee0 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.934+0000 7feedfe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed815aec0 con 0x7feed80b3f10 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.934+0000 7feedfe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b3150 con 0x7feed80b0490 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:41706/0 (socket says 172.21.15.192:41706) 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:37064/0 (socket says 172.21.15.192:37064) 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 -- 172.21.15.192:0/1141434604 learned_addr learned my addr 172.21.15.192:0/1141434604 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:09.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedd400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7feed815dee0 0x7feed80afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:41808/0 (socket says 172.21.15.192:41808) 2024-09-13T18:36:09.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feed7e00640 1 -- 172.21.15.192:0/1141434604 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178858184 0 0) 0x7feed80b2f00 con 0x7feed815dee0 2024-09-13T18:36:09.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feed7e00640 1 -- 172.21.15.192:0/1141434604 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec0003520 con 0x7feed815dee0 2024-09-13T18:36:09.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 -- 172.21.15.192:0/1141434604 >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 msgr2=0x7feed815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 --2- 172.21.15.192:0/1141434604 >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 -- 172.21.15.192:0/1141434604 >> v1:172.21.15.194:6789/0 conn(0x7feed815dee0 legacy=0x7feed80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedde00640 1 -- 172.21.15.192:0/1141434604 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80b3430 con 0x7feed80b0490 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.935+0000 7feedca00640 1 --2- 172.21.15.192:0/1141434604 >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.936+0000 7feedde00640 1 --2- 172.21.15.192:0/1141434604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feed000d150 tx=0x7feed002c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26b323c95b18de18 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feed7e00640 1 -- 172.21.15.192:0/1141434604 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0009600 con 0x7feed80b0490 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feed7e00640 1 -- 172.21.15.192:0/1141434604 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0009760 con 0x7feed80b0490 2024-09-13T18:36:09.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feed7e00640 1 -- 172.21.15.192:0/1141434604 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0009af0 con 0x7feed80b0490 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 -- 172.21.15.192:0/1141434604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 msgr2=0x7feed815a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 --2- 172.21.15.192:0/1141434604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7feed000d150 tx=0x7feed002c930 comp rx=0 tx=0).stop 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 -- 172.21.15.192:0/1141434604 shutdown_connections 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 --2- 172.21.15.192:0/1141434604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed80b0490 0x7feed815a980 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 --2- 172.21.15.192:0/1141434604 >> v2:172.21.15.194:3300/0 conn(0x7feed80b3f10 0x7feed815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 -- 172.21.15.192:0/1141434604 >> 172.21.15.192:0/1141434604 conn(0x7feed80ae960 msgr2=0x7feed806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 -- 172.21.15.192:0/1141434604 shutdown_connections 2024-09-13T18:36:09.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.937+0000 7feedfe00640 1 -- 172.21.15.192:0/1141434604 wait complete. 2024-09-13T18:36:09.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.939+0000 7feedfe00640 1 Processor -- start 2024-09-13T18:36:09.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.939+0000 7feedfe00640 1 -- start start 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed80b0490 0x7feed806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 0x7feed8070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed81569d0 con 0x7feed815dee0 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed8071210 con 0x7feed80b0490 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedfe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed806acf0 con 0x7feed8070840 2024-09-13T18:36:09.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34790/0 (socket says 172.21.15.192:34790) 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 0x7feed8070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedca00640 1 -- 172.21.15.192:0/925013350 learned_addr learned my addr 172.21.15.192:0/925013350 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.940+0000 7feedd400640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed80b0490 0x7feed806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 -- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 msgr2=0x7feed8070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 0x7feed8070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 -- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed80b0490 msgr2=0x7feed806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed80b0490 0x7feed806bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 -- 172.21.15.192:0/925013350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4009400 con 0x7feed815dee0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedde00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 0x7feed8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedca00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feec400ebe0 tx=0x7feec400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4009760 con 0x7feed815dee0 2024-09-13T18:36:09.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400cc30 con 0x7feed815dee0 2024-09-13T18:36:09.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed000bd40 con 0x7feed815dee0 2024-09-13T18:36:09.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400eee0 con 0x7feed815dee0 2024-09-13T18:36:09.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.941+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed806b4f0 con 0x7feed815dee0 2024-09-13T18:36:09.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.942+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed813bd00 con 0x7feed815dee0 2024-09-13T18:36:09.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.943+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feec4013470 con 0x7feed815dee0 2024-09-13T18:36:09.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.944+0000 7feed5600640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 0x7feeb806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:09.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.944+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec40896b0 con 0x7feed815dee0 2024-09-13T18:36:09.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.944+0000 7feedd400640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 0x7feeb806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:09.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.945+0000 7feedd400640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 0x7feeb806d0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feecc0011e0 tx=0x7feecc007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:09.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:09.948+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feec4054810 con 0x7feed815dee0 2024-09-13T18:36:10.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.152+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7feed80afd80 con 0x7feed815dee0 2024-09-13T18:36:10.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.152+0000 7feed5600640 1 -- 172.21.15.192:0/925013350 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7feec4057e30 con 0x7feed815dee0 2024-09-13T18:36:10.155 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:10.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.154+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 msgr2=0x7feeb806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.154+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 0x7feeb806d0f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feecc0011e0 tx=0x7feecc007d30 comp rx=0 tx=0).stop 2024-09-13T18:36:10.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.154+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 msgr2=0x7feed8137060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.154+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7feec400ebe0 tx=0x7feec400c520 comp rx=0 tx=0).stop 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 shutdown_connections 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeb806ac30 0x7feeb806d0f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed8070840 0x7feed8070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed815dee0 0x7feed8137060 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 --2- 172.21.15.192:0/925013350 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed80b0490 0x7feed806bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 >> 172.21.15.192:0/925013350 conn(0x7feed80ae960 msgr2=0x7feed81589f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 shutdown_connections 2024-09-13T18:36:10.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:10.155+0000 7feedfe00640 1 -- 172.21.15.192:0/925013350 wait complete. 2024-09-13T18:36:10.175 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T18:36:10.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:10.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:36:10.175 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-13T18:36:10.175 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-13T18:36:10.176 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T18:36:10.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T18:36:10.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:10.176 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:36:10.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.177 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:36:10.214 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:10.214 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:10.214 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:10.214 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.214 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:10.215 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.216 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:36:10.217 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.218 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:10.307 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:36:10.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.310 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:10.346 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:10.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:10.347 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:10.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.490 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:36:10.525 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:36:10.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.525 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list-id 2024-09-13T18:36:10.599 INFO:teuthology.orchestra.run.smithi194.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-13T18:36:10.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.601 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:10.601 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:10.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:36:10.601 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-13T18:36:10.601 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:10.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.724 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:10.779 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 52:41:a5:c4:d1:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::5041:a5ff:fec4:d19c/64 scope link 2024-09-13T18:36:10.780 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.782 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-13T18:36:10.837 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:10.837 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 52:41:a5:c4:d1:9c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::5041:a5ff:fec4:d19c/64 scope link 2024-09-13T18:36:10.838 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:10.840 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-13T18:36:10.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:10.840 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:10.840 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:10.840 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-13T18:36:10.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-13T18:36:10.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-13T18:36:10.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-13T18:36:10.841 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-13T18:36:10.841 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:11.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.006 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:11.006 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:11.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.1 up 2024-09-13T18:36:11.006 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set dev brx.1 master ceph-brx 2024-09-13T18:36:11.006 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:11.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:11.120 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-13T18:36:11.155 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-13T18:36:11.155 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:11.155 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:36:11.229 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-09-13T18:36:11.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:11.358 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:11.358 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:11.385 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:11.386 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:11.386 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:11.386 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 3@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:11.386 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:11.387 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-09-13T18:36:11.387 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:11.387 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:11.388 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:11.388 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:11.390 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:11.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.391 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-13T18:36:11.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.446 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:11.484 INFO:teuthology.orchestra.run.smithi194.stdout:client4526 2024-09-13T18:36:11.485 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:11.485 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:11.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.560 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:11.638 INFO:teuthology.orchestra.run.smithi194.stdout:client4526 2024-09-13T18:36:11.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.638 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:11.717 INFO:teuthology.orchestra.run.smithi194.stdout:client4526 2024-09-13T18:36:11.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:11.717 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client4526/status') 2024-09-13T18:36:11.814 INFO:teuthology.orchestra.run.smithi194.stdout:instance: client.4526 (3)192.168.0.2:0/2755567058 2024-09-13T18:36:11.814 INFO:teuthology.orchestra.run.smithi194.stdout:blocklisted: false 2024-09-13T18:36:11.814 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records in 2024-09-13T18:36:11.814 INFO:teuthology.orchestra.run.smithi194.stderr:0+1 records out 2024-09-13T18:36:11.814 INFO:teuthology.orchestra.run.smithi194.stderr:69 bytes copied, 5.6179e-05 s, 1.2 MB/s 2024-09-13T18:36:11.816 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-13T18:36:11.836 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:11.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.995+0000 7f61b5000640 1 Processor -- start 2024-09-13T18:36:11.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.995+0000 7f61b5000640 1 -- start start 2024-09-13T18:36:11.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61b5000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61b00b3480 0x7f61b0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61b5000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61b006bc30 0x7f61b015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:11.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61b5000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61b015af60 con 0x7f61b0159b00 2024-09-13T18:36:11.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61b5000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b006b7a0 con 0x7f61b00b3480 2024-09-13T18:36:11.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61b5000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61b015ac80 con 0x7f61b006bc30 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61a6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61b00b3480 0x7f61b0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61a6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61b00b3480 0x7f61b0159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33404/0 (socket says 172.21.15.192:33404) 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61a6a00640 1 -- 172.21.15.192:0/165532437 learned_addr learned my addr 172.21.15.192:0/165532437 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.996+0000 7f61afe00640 1 --2- 172.21.15.192:0/165532437 >> v2:172.21.15.194:3300/0 conn(0x7f61b006bc30 0x7f61b015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.997+0000 7f61a6a00640 1 -- 172.21.15.192:0/165532437 >> v2:172.21.15.194:3300/0 conn(0x7f61b006bc30 msgr2=0x7f61b015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.997+0000 7f61a6a00640 1 --2- 172.21.15.192:0/165532437 >> v2:172.21.15.194:3300/0 conn(0x7f61b006bc30 0x7f61b015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.997+0000 7f61a6a00640 1 -- 172.21.15.192:0/165532437 >> v1:172.21.15.194:6789/0 conn(0x7f61b0159b00 legacy=0x7f61b00b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.997+0000 7f61a6a00640 1 -- 172.21.15.192:0/165532437 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61b006b150 con 0x7f61b00b3480 2024-09-13T18:36:12.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.998+0000 7f61a6a00640 1 --2- 172.21.15.192:0/165532437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b00b3480 0x7f61b0159ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f61b00ccce0 tx=0x7f619802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7afe3435a62ed2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.998+0000 7f61aea00640 1 -- 172.21.15.192:0/165532437 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198033640 con 0x7f61b00b3480 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.998+0000 7f61aea00640 1 -- 172.21.15.192:0/165532437 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619802f070 con 0x7f61b00b3480 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.998+0000 7f61aea00640 1 -- 172.21.15.192:0/165532437 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61980339c0 con 0x7f61b00b3480 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 -- 172.21.15.192:0/165532437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b00b3480 msgr2=0x7f61b0159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 --2- 172.21.15.192:0/165532437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b00b3480 0x7f61b0159ee0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f61b00ccce0 tx=0x7f619802c8b0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 -- 172.21.15.192:0/165532437 shutdown_connections 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 --2- 172.21.15.192:0/165532437 >> v2:172.21.15.194:3300/0 conn(0x7f61b006bc30 0x7f61b015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 --2- 172.21.15.192:0/165532437 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b00b3480 0x7f61b0159ee0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 -- 172.21.15.192:0/165532437 >> 172.21.15.192:0/165532437 conn(0x7f61b00736d0 msgr2=0x7f61b00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 -- 172.21.15.192:0/165532437 shutdown_connections 2024-09-13T18:36:12.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:11.999+0000 7f61b5000640 1 -- 172.21.15.192:0/165532437 wait complete. 2024-09-13T18:36:12.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.000+0000 7f61b5000640 1 Processor -- start 2024-09-13T18:36:12.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 -- start start 2024-09-13T18:36:12.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b006bc30 0x7f61b01f6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b0159b00 0x7f61b01585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b014fb10 con 0x7f61b0159b00 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61b01f73f0 con 0x7f61b00b3480 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.001+0000 7f61b5000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61b015d0e0 con 0x7f61b006bc30 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61af400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b006bc30 0x7f61b01f6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61afe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b0159b00 0x7f61b01585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44474/0 (socket says 172.21.15.192:44474) 2024-09-13T18:36:12.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 -- 172.21.15.192:0/1369039556 learned_addr learned my addr 172.21.15.192:0/1369039556 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:12.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 -- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b006bc30 msgr2=0x7f61b01f6eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b006bc30 0x7f61b01f6eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 -- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b0159b00 msgr2=0x7f61b01585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b0159b00 0x7f61b01585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 -- 172.21.15.192:0/1369039556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f619800b770 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.002+0000 7f61a6a00640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f619800b2c0 tx=0x7f6198004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.003+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619803c830 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.003+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f619803c990 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.003+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61b0155d40 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.003+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f619803cd20 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.003+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61b0154d50 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.004+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61b00b2d70 con 0x7f61b00b3480 2024-09-13T18:36:12.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.005+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f61980323a0 con 0x7f61b00b3480 2024-09-13T18:36:12.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.006+0000 7f61a7e00640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 0x7f618c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.006+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61980aa0f0 con 0x7f61b00b3480 2024-09-13T18:36:12.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.006+0000 7f61af400640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 0x7f618c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.006+0000 7f61af400640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 0x7f618c06d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61a0000f60 tx=0x7f61a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.010+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6198075490 con 0x7f61b00b3480 2024-09-13T18:36:12.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.182+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61b00b3c70 con 0x7f61b00b3480 2024-09-13T18:36:12.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.184+0000 7f61a7e00640 1 -- 172.21.15.192:0/1369039556 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f6198043090 con 0x7f61b00b3480 2024-09-13T18:36:12.187 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:12.187 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 msgr2=0x7f618c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 0x7f618c06d0c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f61a0000f60 tx=0x7f61a0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 msgr2=0x7f61b014ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f619800b2c0 tx=0x7f6198004730 comp rx=0 tx=0).stop 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 shutdown_connections 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618c06ac00 0x7f618c06d0c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61b0159b00 0x7f61b01585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61b00b3480 0x7f61b014ef20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 --2- 172.21.15.192:0/1369039556 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61b006bc30 0x7f61b01f6eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 >> 172.21.15.192:0/1369039556 conn(0x7f61b00736d0 msgr2=0x7f61b00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 shutdown_connections 2024-09-13T18:36:12.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.186+0000 7f61b5000640 1 -- 172.21.15.192:0/1369039556 wait complete. 2024-09-13T18:36:12.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:12.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:12.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.360+0000 7f6132600640 1 Processor -- start 2024-09-13T18:36:12.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.360+0000 7f6132600640 1 -- start start 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6132600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f612c159b00 0x7f612c0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6132600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612c06bc30 0x7f612c0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6132600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c15af60 con 0x7f612c159ee0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6132600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c15aa40 con 0x7f612c06bc30 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6132600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c06b7a0 con 0x7f612c159b00 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612c06bc30 0x7f612c0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6131c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f612c159ee0 0x7f612c15a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46416/0 (socket says 172.21.15.192:46416) 2024-09-13T18:36:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612c06bc30 0x7f612c0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33410/0 (socket says 172.21.15.192:33410) 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6131c00640 1 -- 172.21.15.192:0/3256177943 learned_addr learned my addr 172.21.15.192:0/3256177943 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6131200640 1 --2- 172.21.15.192:0/3256177943 >> v2:172.21.15.194:3300/0 conn(0x7f612c159b00 0x7f612c0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 -- 172.21.15.192:0/3256177943 >> v2:172.21.15.194:3300/0 conn(0x7f612c159b00 msgr2=0x7f612c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 --2- 172.21.15.192:0/3256177943 >> v2:172.21.15.194:3300/0 conn(0x7f612c159b00 0x7f612c0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 -- 172.21.15.192:0/3256177943 >> v1:172.21.15.192:6789/0 conn(0x7f612c159ee0 legacy=0x7f612c15a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.362+0000 7f6123e00640 1 -- 172.21.15.192:0/3256177943 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c15ac80 con 0x7f612c06bc30 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.363+0000 7f6123e00640 1 --2- 172.21.15.192:0/3256177943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c0b32b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f612c06cc90 tx=0x7f611402c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39c5705ebbbff29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f612be00640 1 -- 172.21.15.192:0/3256177943 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114032770 con 0x7f612c06bc30 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f612be00640 1 -- 172.21.15.192:0/3256177943 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61140328d0 con 0x7f612c06bc30 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f612be00640 1 -- 172.21.15.192:0/3256177943 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114032c60 con 0x7f612c06bc30 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 -- 172.21.15.192:0/3256177943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 msgr2=0x7f612c0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 --2- 172.21.15.192:0/3256177943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c0b32b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f612c06cc90 tx=0x7f611402c870 comp rx=0 tx=0).stop 2024-09-13T18:36:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 -- 172.21.15.192:0/3256177943 shutdown_connections 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 --2- 172.21.15.192:0/3256177943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c0b32b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 --2- 172.21.15.192:0/3256177943 >> v2:172.21.15.194:3300/0 conn(0x7f612c159b00 0x7f612c0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 -- 172.21.15.192:0/3256177943 >> 172.21.15.192:0/3256177943 conn(0x7f612c0736d0 msgr2=0x7f612c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 -- 172.21.15.192:0/3256177943 shutdown_connections 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.364+0000 7f6132600640 1 -- 172.21.15.192:0/3256177943 wait complete. 2024-09-13T18:36:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.366+0000 7f6132600640 1 Processor -- start 2024-09-13T18:36:12.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.366+0000 7f6132600640 1 -- start start 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612c159b00 0x7f612c1f6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 0x7f612c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1f7400 con 0x7f612c06bc30 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0713b0 con 0x7f612c159ee0 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6132600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c14dc90 con 0x7f612c159b00 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6131200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6131200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33418/0 (socket says 172.21.15.192:33418) 2024-09-13T18:36:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6131200640 1 -- 172.21.15.192:0/405492850 learned_addr learned my addr 172.21.15.192:0/405492850 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6123e00640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612c159b00 0x7f612c1f6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.367+0000 7f6131c00640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 0x7f612c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 -- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612c159b00 msgr2=0x7f612c1f6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612c159b00 0x7f612c1f6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 -- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 msgr2=0x7f612c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 0x7f612c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 -- 172.21.15.192:0/405492850 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611400b6a0 con 0x7f612c06bc30 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131c00640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 0x7f612c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6131200640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9e0 tx=0x7f611c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c009670 con 0x7f612c06bc30 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c00c970 con 0x7f612c06bc30 2024-09-13T18:36:12.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c00cd20 con 0x7f612c06bc30 2024-09-13T18:36:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c0703d0 con 0x7f612c06bc30 2024-09-13T18:36:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.368+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c070990 con 0x7f612c06bc30 2024-09-13T18:36:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.369+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c15a330 con 0x7f612c06bc30 2024-09-13T18:36:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.370+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f611c013470 con 0x7f612c06bc30 2024-09-13T18:36:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.371+0000 7f6129600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.371+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f611c089840 con 0x7f612c06bc30 2024-09-13T18:36:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.371+0000 7f6123e00640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.372+0000 7f6123e00640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6114037000 tx=0x7f6114032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.375+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f611c054ac0 con 0x7f612c06bc30 2024-09-13T18:36:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.543+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f612c0b3c70 con 0x7f612c06bc30 2024-09-13T18:36:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.543+0000 7f6129600640 1 -- 172.21.15.192:0/405492850 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f611c0580e0 con 0x7f612c06bc30 2024-09-13T18:36:12.546 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:12.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 msgr2=0x7f610806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6114037000 tx=0x7f6114032000 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 msgr2=0x7f612c14d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f611c00e9e0 tx=0x7f611c00eea0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 shutdown_connections 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f612c159ee0 0x7f612c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612c159b00 0x7f612c1f6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.545+0000 7f6132600640 1 --2- 172.21.15.192:0/405492850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612c06bc30 0x7f612c14d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.546+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 >> 172.21.15.192:0/405492850 conn(0x7f612c0736d0 msgr2=0x7f612c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.546+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 shutdown_connections 2024-09-13T18:36:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.546+0000 7f6132600640 1 -- 172.21.15.192:0/405492850 wait complete. 2024-09-13T18:36:12.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:12.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.715+0000 7fd8e2600640 1 Processor -- start 2024-09-13T18:36:12.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.715+0000 7fd8e2600640 1 -- start start 2024-09-13T18:36:12.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.716+0000 7fd8e2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd8dc1434c0 0x7fd8dc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.716+0000 7fd8e2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 0x7fd8dc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.716+0000 7fd8e2600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8dc06b480 con 0x7fd8dc06a8b0 2024-09-13T18:36:12.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.716+0000 7fd8e2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8dc0ce770 con 0x7fd8dc1434c0 2024-09-13T18:36:12.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.716+0000 7fd8e2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc06b760 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8daa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd8dc06a8b0 0x7fd8dc0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46420/0 (socket says 172.21.15.192:46420) 2024-09-13T18:36:12.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8daa00640 1 -- 172.21.15.192:0/1309044222 learned_addr learned my addr 172.21.15.192:0/1309044222 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8db400640 1 --2- 172.21.15.192:0/1309044222 >> v2:172.21.15.194:3300/0 conn(0x7fd8dc1434c0 0x7fd8dc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8dbe00640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 0x7fd8dc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8da000640 1 -- 172.21.15.192:0/1309044222 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468810539 0 0) 0x7fd8dc06b480 con 0x7fd8dc06a8b0 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8da000640 1 -- 172.21.15.192:0/1309044222 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c0003520 con 0x7fd8dc06a8b0 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8db400640 1 -- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 msgr2=0x7fd8dc06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8db400640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 0x7fd8dc06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8db400640 1 -- 172.21.15.192:0/1309044222 >> v1:172.21.15.192:6789/0 conn(0x7fd8dc06a8b0 legacy=0x7fd8dc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8db400640 1 -- 172.21.15.192:0/1309044222 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8dc06ba40 con 0x7fd8dc1434c0 2024-09-13T18:36:12.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.717+0000 7fd8dbe00640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 0x7fd8dc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:12.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.718+0000 7fd8db400640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc06c800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0097a0 tx=0x7fd8cc02a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6547278dafd08788 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.718+0000 7fd8da000640 1 -- 172.21.15.192:0/1309044222 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc02ae40 con 0x7fd8dc1434c0 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8da000640 1 -- 172.21.15.192:0/1309044222 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8cc032440 con 0x7fd8dc1434c0 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8da000640 1 -- 172.21.15.192:0/1309044222 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc0327b0 con 0x7fd8dc1434c0 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 -- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 msgr2=0x7fd8dc06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc06c800 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0097a0 tx=0x7fd8cc02a0f0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 -- 172.21.15.192:0/1309044222 shutdown_connections 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc0b3da0 0x7fd8dc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 --2- 172.21.15.192:0/1309044222 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc06c800 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 -- 172.21.15.192:0/1309044222 >> 172.21.15.192:0/1309044222 conn(0x7fd8dc0b08f0 msgr2=0x7fd8dc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 -- 172.21.15.192:0/1309044222 shutdown_connections 2024-09-13T18:36:12.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.719+0000 7fd8e2600640 1 -- 172.21.15.192:0/1309044222 wait complete. 2024-09-13T18:36:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.721+0000 7fd8e2600640 1 Processor -- start 2024-09-13T18:36:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.721+0000 7fd8e2600640 1 -- start start 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc06a8b0 0x7fd8dc141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc1554f0 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc141620 con 0x7fd8dc1434c0 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8e2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8dc154280 con 0x7fd8dc06a8b0 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33424/0 (socket says 172.21.15.192:33424) 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8daa00640 1 -- 172.21.15.192:0/3480310700 learned_addr learned my addr 172.21.15.192:0/3480310700 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:12.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8db400640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc06a8b0 0x7fd8dc141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.722+0000 7fd8dbe00640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 -- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc06a8b0 msgr2=0x7fd8dc141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc06a8b0 0x7fd8dc141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 -- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 msgr2=0x7fd8dc154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc154fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 -- 172.21.15.192:0/3480310700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d4009a70 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8dbe00640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8daa00640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c430 tx=0x7fd8c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8005ce0 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8cc009400 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8005e40 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80072f0 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.723+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8dc1418e0 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.724+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8dc141b00 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.725+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd8c8007450 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.726+0000 7fd8d3400640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 0x7fd8bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:12.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.726+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8c8088a10 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.726+0000 7fd8db400640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 0x7fd8bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:12.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.727+0000 7fd8db400640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 0x7fd8bc06d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc034000 tx=0x7fd8cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:12.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.730+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd8c8053c10 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.907+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd8dc0ccf90 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.908+0000 7fd8d3400640 1 -- 172.21.15.192:0/3480310700 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd8c8057230 con 0x7fd8dc0b3da0 2024-09-13T18:36:12.911 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:12.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.910+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 msgr2=0x7fd8bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.910+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 0x7fd8bc06d0c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc034000 tx=0x7fd8cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.910+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 msgr2=0x7fd8dc154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.910+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd8c800c430 tx=0x7fd8c800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 shutdown_connections 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd8bc06ac00 0x7fd8bc06d0c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd8dc1434c0 0x7fd8dc154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd8dc0b3da0 0x7fd8dc154a70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 --2- 172.21.15.192:0/3480310700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd8dc06a8b0 0x7fd8dc141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 >> 172.21.15.192:0/3480310700 conn(0x7fd8dc0b08f0 msgr2=0x7fd8dc069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 shutdown_connections 2024-09-13T18:36:12.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:12.911+0000 7fd8e2600640 1 -- 172.21.15.192:0/3480310700 wait complete. 2024-09-13T18:36:12.929 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:13.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.080+0000 7fc48e400640 1 Processor -- start 2024-09-13T18:36:13.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.080+0000 7fc48e400640 1 -- start start 2024-09-13T18:36:13.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc48e400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc48806c800 0x7fc4880b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc48e400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48806cc70 con 0x7fc4880b3bd0 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc48e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48806b480 con 0x7fc4881434c0 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc48e400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880ce770 con 0x7fc48806c800 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc48806c800 0x7fc4880b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc487e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc4880b3bd0 0x7fc48806e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46426/0 (socket says 172.21.15.192:46426) 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc48806c800 0x7fc4880b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33436/0 (socket says 172.21.15.192:33436) 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 -- 172.21.15.192:0/1743711528 learned_addr learned my addr 172.21.15.192:0/1743711528 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 -- 172.21.15.192:0/1743711528 >> v1:172.21.15.194:6789/0 conn(0x7fc4881434c0 legacy=0x7fc48806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 -- 172.21.15.192:0/1743711528 >> v1:172.21.15.192:6789/0 conn(0x7fc4880b3bd0 legacy=0x7fc48806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.082+0000 7fc47ea00640 1 -- 172.21.15.192:0/1743711528 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48806b760 con 0x7fc48806c800 2024-09-13T18:36:13.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.083+0000 7fc47ea00640 1 --2- 172.21.15.192:0/1743711528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48806c800 0x7fc4880b3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc4700098a0 tx=0x7fc47002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c395f12143beefa6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc486a00640 1 -- 172.21.15.192:0/1743711528 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470032440 con 0x7fc48806c800 2024-09-13T18:36:13.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc486a00640 1 -- 172.21.15.192:0/1743711528 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4700325a0 con 0x7fc48806c800 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc486a00640 1 -- 172.21.15.192:0/1743711528 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470032930 con 0x7fc48806c800 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 -- 172.21.15.192:0/1743711528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48806c800 msgr2=0x7fc4880b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 --2- 172.21.15.192:0/1743711528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48806c800 0x7fc4880b3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc4700098a0 tx=0x7fc47002a290 comp rx=0 tx=0).stop 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 -- 172.21.15.192:0/1743711528 shutdown_connections 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 --2- 172.21.15.192:0/1743711528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48806c800 0x7fc4880b3690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 -- 172.21.15.192:0/1743711528 >> 172.21.15.192:0/1743711528 conn(0x7fc4880b08f0 msgr2=0x7fc4880b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 -- 172.21.15.192:0/1743711528 shutdown_connections 2024-09-13T18:36:13.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.084+0000 7fc48e400640 1 -- 172.21.15.192:0/1743711528 wait complete. 2024-09-13T18:36:13.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.086+0000 7fc48e400640 1 Processor -- start 2024-09-13T18:36:13.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.086+0000 7fc48e400640 1 -- start start 2024-09-13T18:36:13.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc48806c800 0x7fc48806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4881434c0 0x7fc488138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48813b310 con 0x7fc4880b3bd0 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48806fbf0 con 0x7fc4881434c0 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc48e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48806efe0 con 0x7fc48806c800 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc47ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33440/0 (socket says 172.21.15.192:33440) 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc47ea00640 1 -- 172.21.15.192:0/2186161223 learned_addr learned my addr 172.21.15.192:0/2186161223 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc487e00640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4881434c0 0x7fc488138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.087+0000 7fc487400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc48806c800 0x7fc48806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 -- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc48806c800 msgr2=0x7fc48806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc48806c800 0x7fc48806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 -- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4881434c0 msgr2=0x7fc488138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4881434c0 0x7fc488138c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 -- 172.21.15.192:0/2186161223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4700094d0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47ea00640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470030b80 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470030d00 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47003d680 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.088+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48806f2c0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.089+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48806f880 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.090+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4880cc7d0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.090+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc470039040 con 0x7fc4880b3bd0 2024-09-13T18:36:13.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.091+0000 7fc47fe00640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 0x7fc46406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.091+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4700aa0b0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.092+0000 7fc487400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 0x7fc46406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.092+0000 7fc487400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 0x7fc46406d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc478000f60 tx=0x7fc478009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.095+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc4700752a0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.263+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4880b23a0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.264+0000 7fc47fe00640 1 -- 172.21.15.192:0/2186161223 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4700788c0 con 0x7fc4880b3bd0 2024-09-13T18:36:13.267 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 msgr2=0x7fc46406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 0x7fc46406d0c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc478000f60 tx=0x7fc478009040 comp rx=0 tx=0).stop 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 msgr2=0x7fc4880710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 shutdown_connections 2024-09-13T18:36:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc46406ac00 0x7fc46406d0c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4881434c0 0x7fc488138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4880b3bd0 0x7fc4880710c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 --2- 172.21.15.192:0/2186161223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc48806c800 0x7fc48806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 >> 172.21.15.192:0/2186161223 conn(0x7fc4880b08f0 msgr2=0x7fc4880aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 shutdown_connections 2024-09-13T18:36:13.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.266+0000 7fc48e400640 1 -- 172.21.15.192:0/2186161223 wait complete. 2024-09-13T18:36:13.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:13.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.433+0000 7ff4ffa00640 1 Processor -- start 2024-09-13T18:36:13.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.433+0000 7ff4ffa00640 1 -- start start 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4ffa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4f8150480 0x7ff4f815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4ffa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f80cc530 0x7ff4f80cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4ffa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4f80ccec0 con 0x7ff4f8071810 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4ffa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4f8071dd0 con 0x7ff4f8150480 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4ffa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f80cb770 con 0x7ff4f80cc530 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4f8150480 0x7ff4f815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4f7e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff4f8071810 0x7ff4f80b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46438/0 (socket says 172.21.15.192:46438) 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4f7e00640 1 -- 172.21.15.192:0/2956825096 learned_addr learned my addr 172.21.15.192:0/2956825096 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4f8150480 0x7ff4f815a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33444/0 (socket says 172.21.15.192:33444) 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fda00640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f80cc530 0x7ff4f80cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 -- 172.21.15.192:0/2956825096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f80cc530 msgr2=0x7ff4f80cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f80cc530 0x7ff4f80cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 -- 172.21.15.192:0/2956825096 >> v1:172.21.15.192:6789/0 conn(0x7ff4f8071810 legacy=0x7ff4f80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.436+0000 7ff4fd000640 1 -- 172.21.15.192:0/2956825096 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80cba50 con 0x7ff4f8150480 2024-09-13T18:36:13.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.437+0000 7ff4fd000640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8150480 0x7ff4f815a3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0097a0 tx=0x7ff4ec02a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3593f48a331bd53 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.438+0000 7ff4f7400640 1 -- 172.21.15.192:0/2956825096 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec02ae50 con 0x7ff4f8150480 2024-09-13T18:36:13.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.438+0000 7ff4f7400640 1 -- 172.21.15.192:0/2956825096 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec032440 con 0x7ff4f8150480 2024-09-13T18:36:13.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.438+0000 7ff4f7400640 1 -- 172.21.15.192:0/2956825096 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0327d0 con 0x7ff4f8150480 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.438+0000 7ff4ffa00640 1 -- 172.21.15.192:0/2956825096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8150480 msgr2=0x7ff4f815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.438+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8150480 0x7ff4f815a3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec0097a0 tx=0x7ff4ec02a100 comp rx=0 tx=0).stop 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 -- 172.21.15.192:0/2956825096 shutdown_connections 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f80cc530 0x7ff4f80cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/2956825096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8150480 0x7ff4f815a3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 -- 172.21.15.192:0/2956825096 >> 172.21.15.192:0/2956825096 conn(0x7ff4f80ae960 msgr2=0x7ff4f806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 -- 172.21.15.192:0/2956825096 shutdown_connections 2024-09-13T18:36:13.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.439+0000 7ff4ffa00640 1 -- 172.21.15.192:0/2956825096 wait complete. 2024-09-13T18:36:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.441+0000 7ff4ffa00640 1 Processor -- start 2024-09-13T18:36:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.442+0000 7ff4ffa00640 1 -- start start 2024-09-13T18:36:13.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f80cc530 0x7ff4f81f6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f8150480 0x7ff4f81f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f806a940 con 0x7ff4f8071810 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f63a0 con 0x7ff4f80cc530 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4ffa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81f3260 con 0x7ff4f8150480 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4fd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33448/0 (socket says 172.21.15.192:33448) 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4fd000640 1 -- 172.21.15.192:0/103514733 learned_addr learned my addr 172.21.15.192:0/103514733 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.443+0000 7ff4f7e00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f80cc530 0x7ff4f81f6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fda00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f8150480 0x7ff4f81f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 -- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f8150480 msgr2=0x7ff4f81f29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f8150480 0x7ff4f81f29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 -- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f80cc530 msgr2=0x7ff4f81f6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f80cc530 0x7ff4f81f6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 -- 172.21.15.192:0/103514733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec009400 con 0x7ff4f8071810 2024-09-13T18:36:13.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4fd000640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec035040 tx=0x7ff4ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.444+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec03d710 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.445+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ec03d890 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.445+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81f3540 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.445+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec03dc40 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.445+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81f3820 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.446+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f8150860 con 0x7ff4f8071810 2024-09-13T18:36:13.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.447+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4ec039040 con 0x7ff4f8071810 2024-09-13T18:36:13.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.448+0000 7ff4f4c00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 0x7ff4d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.448+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ec0a9a40 con 0x7ff4f8071810 2024-09-13T18:36:13.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.448+0000 7ff4f7e00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 0x7ff4d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.449+0000 7ff4f7e00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 0x7ff4d806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f806bb00 tx=0x7ff4e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.452+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4ec074d50 con 0x7ff4f8071810 2024-09-13T18:36:13.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.626+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4f8157f50 con 0x7ff4f8071810 2024-09-13T18:36:13.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.627+0000 7ff4f4c00640 1 -- 172.21.15.192:0/103514733 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7ff4ec078370 con 0x7ff4f8071810 2024-09-13T18:36:13.630 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:13.630 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:13.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 msgr2=0x7ff4d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 0x7ff4d806d0c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff4f806bb00 tx=0x7ff4e4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:13.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 msgr2=0x7ff4f814b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec035040 tx=0x7ff4ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 shutdown_connections 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff4d806ac00 0x7ff4d806d0c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4f8150480 0x7ff4f81f29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4f80cc530 0x7ff4f81f6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 --2- 172.21.15.192:0/103514733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4f8071810 0x7ff4f814b1b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 >> 172.21.15.192:0/103514733 conn(0x7ff4f80ae960 msgr2=0x7ff4f81577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.629+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 shutdown_connections 2024-09-13T18:36:13.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.630+0000 7ff4ffa00640 1 -- 172.21.15.192:0/103514733 wait complete. 2024-09-13T18:36:13.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:13.649 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:13.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.801+0000 7fb2c3800640 1 Processor -- start 2024-09-13T18:36:13.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.801+0000 7fb2c3800640 1 -- start start 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2c3800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 0x7fb2bc164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2c3800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb2bc0cdd40 0x7fb2bc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2c3800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2bc0b2000 con 0x7fb2bc165420 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2c3800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2bc165e40 con 0x7fb2bc0cdd40 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2c3800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc165860 con 0x7fb2bc144150 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2bbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb2bc165420 0x7fb2bc0cd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46444/0 (socket says 172.21.15.192:46444) 2024-09-13T18:36:13.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.802+0000 7fb2bbe00640 1 -- 172.21.15.192:0/2174947103 learned_addr learned my addr 172.21.15.192:0/2174947103 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:13.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2174947103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 0x7fb2bc164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c1800640 1 --2- 172.21.15.192:0/2174947103 >> v2:172.21.15.194:3300/0 conn(0x7fb2bc0cdd40 0x7fb2bc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2bb400640 1 -- 172.21.15.192:0/2174947103 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3658361856 0 0) 0x7fb2bc0b2000 con 0x7fb2bc165420 2024-09-13T18:36:13.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2bb400640 1 -- 172.21.15.192:0/2174947103 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2a4003520 con 0x7fb2bc165420 2024-09-13T18:36:13.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c0e00640 1 -- 172.21.15.192:0/2174947103 >> v2:172.21.15.194:3300/0 conn(0x7fb2bc0cdd40 msgr2=0x7fb2bc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:13.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2174947103 >> v2:172.21.15.194:3300/0 conn(0x7fb2bc0cdd40 0x7fb2bc0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c0e00640 1 -- 172.21.15.192:0/2174947103 >> v1:172.21.15.192:6789/0 conn(0x7fb2bc165420 legacy=0x7fb2bc0cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.803+0000 7fb2c0e00640 1 -- 172.21.15.192:0/2174947103 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2bc0ce900 con 0x7fb2bc144150 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.804+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2174947103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 0x7fb2bc164ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097a0 tx=0x7fb2b002a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dfdc5970778c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2bb400640 1 -- 172.21.15.192:0/2174947103 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0032440 con 0x7fb2bc144150 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2bb400640 1 -- 172.21.15.192:0/2174947103 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b00325a0 con 0x7fb2bc144150 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2bb400640 1 -- 172.21.15.192:0/2174947103 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0032930 con 0x7fb2bc144150 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 -- 172.21.15.192:0/2174947103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 msgr2=0x7fb2bc164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2174947103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 0x7fb2bc164ee0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb2b00097a0 tx=0x7fb2b002a180 comp rx=0 tx=0).stop 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 -- 172.21.15.192:0/2174947103 shutdown_connections 2024-09-13T18:36:13.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2174947103 >> v2:172.21.15.194:3300/0 conn(0x7fb2bc0cdd40 0x7fb2bc0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2174947103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc144150 0x7fb2bc164ee0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 -- 172.21.15.192:0/2174947103 >> 172.21.15.192:0/2174947103 conn(0x7fb2bc0b08f0 msgr2=0x7fb2bc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 -- 172.21.15.192:0/2174947103 shutdown_connections 2024-09-13T18:36:13.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.805+0000 7fb2c3800640 1 -- 172.21.15.192:0/2174947103 wait complete. 2024-09-13T18:36:13.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.807+0000 7fb2c3800640 1 Processor -- start 2024-09-13T18:36:13.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.807+0000 7fb2c3800640 1 -- start start 2024-09-13T18:36:13.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc0cdd40 0x7fb2bc070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2bc165420 0x7fb2bc06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15bf00 con 0x7fb2bc144150 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15c150 con 0x7fb2bc165420 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2c3800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2bc15c430 con 0x7fb2bc0cdd40 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33462/0 (socket says 172.21.15.192:33462) 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.808+0000 7fb2bbe00640 1 -- 172.21.15.192:0/2414135283 learned_addr learned my addr 172.21.15.192:0/2414135283 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2c1800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2bc165420 0x7fb2bc06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc0cdd40 0x7fb2bc070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 -- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc0cdd40 msgr2=0x7fb2bc070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc0cdd40 0x7fb2bc070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 -- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2bc165420 msgr2=0x7fb2bc06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2bc165420 0x7fb2bc06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 -- 172.21.15.192:0/2414135283 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b0009400 con 0x7fb2bc144150 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2bbe00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800c500 tx=0x7fb2a800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8005ce0 con 0x7fb2bc144150 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8005e40 con 0x7fb2bc144150 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8007330 con 0x7fb2bc144150 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.809+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2bc15c710 con 0x7fb2bc144150 2024-09-13T18:36:13.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.810+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2bc15ccd0 con 0x7fb2bc144150 2024-09-13T18:36:13.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.811+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2bc164ee0 con 0x7fb2bc144150 2024-09-13T18:36:13.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.811+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb2a8007550 con 0x7fb2bc144150 2024-09-13T18:36:13.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.812+0000 7fb2b8c00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:13.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.812+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2a8088900 con 0x7fb2bc144150 2024-09-13T18:36:13.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.812+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:13.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.813+0000 7fb2c0e00640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 0x7fb29c06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0034000 tx=0x7fb2b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:13.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.816+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb2a8053c40 con 0x7fb2bc144150 2024-09-13T18:36:13.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.984+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2bc0b0e40 con 0x7fb2bc144150 2024-09-13T18:36:13.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.984+0000 7fb2b8c00640 1 -- 172.21.15.192:0/2414135283 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2a8017020 con 0x7fb2bc144150 2024-09-13T18:36:13.987 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:13.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 msgr2=0x7fb29c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 0x7fb29c06d0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0034000 tx=0x7fb2b002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 msgr2=0x7fb2bc142e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800c500 tx=0x7fb2a800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 shutdown_connections 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb29c06ac00 0x7fb29c06d0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb2bc165420 0x7fb2bc06fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2bc144150 0x7fb2bc142e90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 --2- 172.21.15.192:0/2414135283 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb2bc0cdd40 0x7fb2bc070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 >> 172.21.15.192:0/2414135283 conn(0x7fb2bc0b08f0 msgr2=0x7fb2bc0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 shutdown_connections 2024-09-13T18:36:13.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:13.986+0000 7fb2c3800640 1 -- 172.21.15.192:0/2414135283 wait complete. 2024-09-13T18:36:14.006 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:14.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.158+0000 7f9ec9a00640 1 Processor -- start 2024-09-13T18:36:14.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.158+0000 7f9ec9a00640 1 -- start start 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 0x7f9ec406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec9a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ec406a8b0 0x7f9ec40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec9a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ec406b480 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec9a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ec40b4060 con 0x7f9ec406a8b0 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec40ce770 con 0x7f9ec41434c0 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ec406a8b0 0x7f9ec40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9ec406a8b0 0x7f9ec40b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33468/0 (socket says 172.21.15.192:33468) 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 -- 172.21.15.192:0/718000398 learned_addr learned my addr 172.21.15.192:0/718000398 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:14.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 -- 172.21.15.192:0/718000398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 msgr2=0x7f9ec406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec2a00640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 0x7f9ec406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 0x7f9ec406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 -- 172.21.15.192:0/718000398 >> v1:172.21.15.194:6789/0 conn(0x7f9ec40b3bd0 legacy=0x7f9ec406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9eba000640 1 -- 172.21.15.192:0/718000398 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ec406b760 con 0x7f9ec406a8b0 2024-09-13T18:36:14.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.160+0000 7f9ec2a00640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 0x7f9ec406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.161+0000 7f9eba000640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec406a8b0 0x7f9ec40b3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098a0 tx=0x7f9eac02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7330b341380a8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec2000640 1 -- 172.21.15.192:0/718000398 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac032440 con 0x7f9ec406a8b0 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec2000640 1 -- 172.21.15.192:0/718000398 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac0325a0 con 0x7f9ec406a8b0 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec2000640 1 -- 172.21.15.192:0/718000398 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac032930 con 0x7f9ec406a8b0 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 -- 172.21.15.192:0/718000398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec406a8b0 msgr2=0x7f9ec40b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec406a8b0 0x7f9ec40b3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098a0 tx=0x7f9eac02a250 comp rx=0 tx=0).stop 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 -- 172.21.15.192:0/718000398 shutdown_connections 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec406a8b0 0x7f9ec40b3690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/718000398 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec41434c0 0x7f9ec406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 -- 172.21.15.192:0/718000398 >> 172.21.15.192:0/718000398 conn(0x7f9ec40b08f0 msgr2=0x7f9ec40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 -- 172.21.15.192:0/718000398 shutdown_connections 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.162+0000 7f9ec9a00640 1 -- 172.21.15.192:0/718000398 wait complete. 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.164+0000 7f9ec9a00640 1 Processor -- start 2024-09-13T18:36:14.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.164+0000 7f9ec9a00640 1 -- start start 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec406a8b0 0x7f9ec415bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ec41434c0 0x7f9ec413fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415b9b0 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec4159db0 con 0x7f9ec41434c0 2024-09-13T18:36:14.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec415c3c0 con 0x7f9ec406a8b0 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33476/0 (socket says 172.21.15.192:33476) 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 -- 172.21.15.192:0/3244630620 learned_addr learned my addr 172.21.15.192:0/3244630620 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec2a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec406a8b0 0x7f9ec415bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9ec3400640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ec41434c0 0x7f9ec413fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 -- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec406a8b0 msgr2=0x7f9ec415bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec406a8b0 0x7f9ec415bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.165+0000 7f9eba000640 1 -- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ec41434c0 msgr2=0x7f9ec413fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9eba000640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ec41434c0 0x7f9ec413fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9eba000640 1 -- 172.21.15.192:0/3244630620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0094d0 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9eba000640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098a0 tx=0x7f9eac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac032440 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac030b80 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ec415a020 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac004030 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.166+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ec415a5e0 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.167+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ec406acf0 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.168+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9eac039040 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.169+0000 7f9ebb400640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 0x7f9ea006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.169+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9eac0a9e80 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.169+0000 7f9ec2a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 0x7f9ea006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.170+0000 7f9ec2a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 0x7f9ea006d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400a950 tx=0x7f9eb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.173+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9eac075050 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.338+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ec415bb50 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.339+0000 7f9ebb400640 1 -- 172.21.15.192:0/3244630620 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9eac078670 con 0x7f9ec40b3bd0 2024-09-13T18:36:14.342 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 msgr2=0x7f9ea006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 0x7f9ea006d0c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9eb400a950 tx=0x7f9eb4008040 comp rx=0 tx=0).stop 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 msgr2=0x7f9ec415b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0098a0 tx=0x7f9eac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 shutdown_connections 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ea006ac00 0x7f9ea006d0c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ec41434c0 0x7f9ec413fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ec40b3bd0 0x7f9ec415b470 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 --2- 172.21.15.192:0/3244630620 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9ec406a8b0 0x7f9ec415bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 >> 172.21.15.192:0/3244630620 conn(0x7f9ec40b08f0 msgr2=0x7f9ec40aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 shutdown_connections 2024-09-13T18:36:14.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.341+0000 7f9ec9a00640 1 -- 172.21.15.192:0/3244630620 wait complete. 2024-09-13T18:36:14.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.514+0000 7f9e53e00640 1 Processor -- start 2024-09-13T18:36:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.514+0000 7f9e53e00640 1 -- start start 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.515+0000 7f9e53e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9e54161700 0x7f9e54160a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.515+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e540d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.515+0000 7f9e53e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e5415d3f0 con 0x7f9e5415d010 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.515+0000 7f9e53e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e540b60e0 con 0x7f9e54161700 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.515+0000 7f9e53e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54161450 con 0x7f9e54160fc0 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9e5415d010 0x7f9e5406adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46450/0 (socket says 172.21.15.192:46450) 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52a00640 1 -- 172.21.15.192:0/2100234560 learned_addr learned my addr 172.21.15.192:0/2100234560 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e53400640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e540d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e4a000640 1 --2- 172.21.15.192:0/2100234560 >> v2:172.21.15.194:3300/0 conn(0x7f9e54161700 0x7f9e54160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3127280920 0 0) 0x7f9e5415d3f0 con 0x7f9e5415d010 2024-09-13T18:36:14.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e38003520 con 0x7f9e5415d010 2024-09-13T18:36:14.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1024432828 0 0) 0x7f9e38003520 con 0x7f9e5415d010 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 msgr2=0x7f9e540d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e540d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 >> v2:172.21.15.194:3300/0 conn(0x7f9e54161700 msgr2=0x7f9e54160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 --2- 172.21.15.192:0/2100234560 >> v2:172.21.15.194:3300/0 conn(0x7f9e54161700 0x7f9e54160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5406b4c0 con 0x7f9e5415d010 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.516+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f9e44001670 con 0x7f9e5415d010 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 >> v1:172.21.15.192:6789/0 conn(0x7f9e5415d010 legacy=0x7f9e5406adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e38003970 0x7f9e38003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38004d00 0x7f9e38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54161450 con 0x7f9e38003970 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3800b980 con 0x7f9e38004d00 2024-09-13T18:36:14.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3800bac0 con 0x7f9e54160fc0 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e38003970 0x7f9e38003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e4a000640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e53400640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38004d00 0x7f9e38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 -- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 msgr2=0x7f9e380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e54160fc0 0x7f9e380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 -- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38004d00 msgr2=0x7f9e38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e38004d00 0x7f9e38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.517+0000 7f9e52a00640 1 -- 172.21.15.192:0/2100234560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38003520 con 0x7f9e38003970 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.518+0000 7f9e52a00640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e38003970 0x7f9e38003d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c240 tx=0x7f9e380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9737090a5f8b6330 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44005ad0 con 0x7f9e38003970 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e44005c30 con 0x7f9e38003970 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e52000640 1 -- 172.21.15.192:0/2100234560 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e44007070 con 0x7f9e38003970 2024-09-13T18:36:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 -- 172.21.15.192:0/2100234560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e38003970 msgr2=0x7f9e38003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 --2- 172.21.15.192:0/2100234560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e38003970 0x7f9e38003d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400c240 tx=0x7f9e380057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53400640 1 -- 172.21.15.192:0/2100234560 reap_dead start 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 -- 172.21.15.192:0/2100234560 shutdown_connections 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 -- 172.21.15.192:0/2100234560 >> 172.21.15.192:0/2100234560 conn(0x7f9e540d2e20 msgr2=0x7f9e540d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 -- 172.21.15.192:0/2100234560 shutdown_connections 2024-09-13T18:36:14.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.519+0000 7f9e53e00640 1 -- 172.21.15.192:0/2100234560 wait complete. 2024-09-13T18:36:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.521+0000 7f9e53e00640 1 Processor -- start 2024-09-13T18:36:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.521+0000 7f9e53e00640 1 -- start start 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e38003970 0x7f9e541f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e541602e0 0x7f9e540ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e541f3970 con 0x7f9e541f6b90 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e54160040 con 0x7f9e541602e0 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e541f6700 con 0x7f9e38003970 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33496/0 (socket says 172.21.15.192:33496) 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e53400640 1 -- 172.21.15.192:0/4043138769 learned_addr learned my addr 172.21.15.192:0/4043138769 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e4a000640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e541602e0 0x7f9e540ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.522+0000 7f9e52a00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e38003970 0x7f9e541f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 -- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e38003970 msgr2=0x7f9e541f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e38003970 0x7f9e541f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 -- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e541602e0 msgr2=0x7f9e540ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e541602e0 0x7f9e540ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 -- 172.21.15.192:0/4043138769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e5415faf0 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53400640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e540b5ed0 tx=0x7f9e4c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c00e040 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c00f040 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c015430 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e5415fd60 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.523+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e541f6390 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.525+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e54067460 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.525+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e4c015590 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.526+0000 7f9e4be00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 0x7f9e3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.526+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e4c089830 con 0x7f9e541f6b90 2024-09-13T18:36:14.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.526+0000 7f9e52a00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 0x7f9e3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.527+0000 7f9e52a00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 0x7f9e3006d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e44033000 tx=0x7f9e44009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.530+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e4c054a40 con 0x7f9e541f6b90 2024-09-13T18:36:14.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.699+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e541f6890 con 0x7f9e541f6b90 2024-09-13T18:36:14.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.699+0000 7f9e4be00640 1 -- 172.21.15.192:0/4043138769 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e4c058060 con 0x7f9e541f6b90 2024-09-13T18:36:14.702 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:14.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 msgr2=0x7f9e3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 0x7f9e3006d0f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9e44033000 tx=0x7f9e44009030 comp rx=0 tx=0).stop 2024-09-13T18:36:14.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 msgr2=0x7f9e54157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9e540b5ed0 tx=0x7f9e4c00f1b0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 shutdown_connections 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e3006ac30 0x7f9e3006d0f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e541f6b90 0x7f9e54157e50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e541602e0 0x7f9e540ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 --2- 172.21.15.192:0/4043138769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e38003970 0x7f9e541f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 >> 172.21.15.192:0/4043138769 conn(0x7f9e540d2e20 msgr2=0x7f9e540b8690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 shutdown_connections 2024-09-13T18:36:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.701+0000 7f9e53e00640 1 -- 172.21.15.192:0/4043138769 wait complete. 2024-09-13T18:36:14.720 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:14.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.869+0000 7f0649800640 1 Processor -- start 2024-09-13T18:36:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.870+0000 7f0649800640 1 -- start start 2024-09-13T18:36:14.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0649800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f064406e990 0x7f06440cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0649800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 0x7f06440cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0649800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064406c5d0 con 0x7f064415a9e0 2024-09-13T18:36:14.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0649800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440b3730 con 0x7f064406e990 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0649800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06440b3920 con 0x7f06440ce6c0 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0643400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f064406e990 0x7f06440cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0643400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f064406e990 0x7f06440cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33510/0 (socket says 172.21.15.192:33510) 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0643400640 1 -- 172.21.15.192:0/4240921250 learned_addr learned my addr 172.21.15.192:0/4240921250 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.871+0000 7f0648e00640 1 --2- 172.21.15.192:0/4240921250 >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 0x7f06440cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.872+0000 7f0643400640 1 -- 172.21.15.192:0/4240921250 >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 msgr2=0x7f06440cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.872+0000 7f0643400640 1 --2- 172.21.15.192:0/4240921250 >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 0x7f06440cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.872+0000 7f0643400640 1 -- 172.21.15.192:0/4240921250 >> v1:172.21.15.194:6789/0 conn(0x7f064415a9e0 legacy=0x7f064406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.872+0000 7f0643400640 1 -- 172.21.15.192:0/4240921250 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06440b3c00 con 0x7f064406e990 2024-09-13T18:36:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.872+0000 7f0648e00640 1 --2- 172.21.15.192:0/4240921250 >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 0x7f06440cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.873+0000 7f0643400640 1 --2- 172.21.15.192:0/4240921250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440cd8c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06440b1490 tx=0x7f063002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb5fb8a40556659 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.875+0000 7f0642a00640 1 -- 172.21.15.192:0/4240921250 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630032440 con 0x7f064406e990 2024-09-13T18:36:14.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.875+0000 7f0642a00640 1 -- 172.21.15.192:0/4240921250 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06300325a0 con 0x7f064406e990 2024-09-13T18:36:14.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.875+0000 7f0642a00640 1 -- 172.21.15.192:0/4240921250 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630032930 con 0x7f064406e990 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 -- 172.21.15.192:0/4240921250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 msgr2=0x7f06440cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 --2- 172.21.15.192:0/4240921250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440cd8c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06440b1490 tx=0x7f063002a270 comp rx=0 tx=0).stop 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 -- 172.21.15.192:0/4240921250 shutdown_connections 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 --2- 172.21.15.192:0/4240921250 >> v2:172.21.15.194:3300/0 conn(0x7f06440ce6c0 0x7f06440cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 --2- 172.21.15.192:0/4240921250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440cd8c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 -- 172.21.15.192:0/4240921250 >> 172.21.15.192:0/4240921250 conn(0x7f06440736d0 msgr2=0x7f06440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:14.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 -- 172.21.15.192:0/4240921250 shutdown_connections 2024-09-13T18:36:14.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.876+0000 7f0649800640 1 -- 172.21.15.192:0/4240921250 wait complete. 2024-09-13T18:36:14.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.878+0000 7f0649800640 1 Processor -- start 2024-09-13T18:36:14.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.878+0000 7f0649800640 1 -- start start 2024-09-13T18:36:14.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06440ce6c0 0x7f06440adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064415a9e0 0x7f06441485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06441e4c70 con 0x7f064406e990 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06440cd710 con 0x7f064415a9e0 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0649800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06441499d0 con 0x7f06440ce6c0 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0643e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0643e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33514/0 (socket says 172.21.15.192:33514) 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.879+0000 7f0643e00640 1 -- 172.21.15.192:0/2621596083 learned_addr learned my addr 172.21.15.192:0/2621596083 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0648e00640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064415a9e0 0x7f06441485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643400640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06440ce6c0 0x7f06440adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 -- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06440ce6c0 msgr2=0x7f06440adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06440ce6c0 0x7f06440adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 -- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064415a9e0 msgr2=0x7f06441485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:14.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064415a9e0 0x7f06441485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:14.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 -- 172.21.15.192:0/2621596083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06300094d0 con 0x7f064406e990 2024-09-13T18:36:14.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0643e00640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f063400c430 tx=0x7f063400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340052d0 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0634005430 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0634003830 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.880+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06440cd430 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.881+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06441e4890 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.882+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06441e4db0 con 0x7f064406e990 2024-09-13T18:36:14.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.883+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0634003990 con 0x7f064406e990 2024-09-13T18:36:14.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.883+0000 7f063be00640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 0x7f062406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:14.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.883+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06340887e0 con 0x7f064406e990 2024-09-13T18:36:14.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.884+0000 7f0643400640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 0x7f062406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:14.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.884+0000 7f0643400640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 0x7f062406d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:14.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:14.888+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f06441e4db0 con 0x7f064406e990 2024-09-13T18:36:15.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.057+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06441e4db0 con 0x7f064406e990 2024-09-13T18:36:15.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.058+0000 7f063be00640 1 -- 172.21.15.192:0/2621596083 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f06441e4db0 con 0x7f064406e990 2024-09-13T18:36:15.061 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:15.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 msgr2=0x7f062406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 0x7f062406d0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0630034000 tx=0x7f063002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:15.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 msgr2=0x7f06440ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f063400c430 tx=0x7f063400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 shutdown_connections 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f062406ac00 0x7f062406d0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f064415a9e0 0x7f06441485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f06440ce6c0 0x7f06440adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 --2- 172.21.15.192:0/2621596083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f064406e990 0x7f06440ccd50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.060+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 >> 172.21.15.192:0/2621596083 conn(0x7f06440736d0 msgr2=0x7f0644155830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.061+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 shutdown_connections 2024-09-13T18:36:15.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.061+0000 7f0649800640 1 -- 172.21.15.192:0/2621596083 wait complete. 2024-09-13T18:36:15.079 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:15.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.231+0000 7fa01a000640 1 Processor -- start 2024-09-13T18:36:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.231+0000 7fa01a000640 1 -- start start 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa01406a8b0 0x7fa0140b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 0x7fa01406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140b4060 con 0x7fa01406a8b0 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140ce770 con 0x7fa0140b3bd0 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa01a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01406b480 con 0x7fa0141434c0 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa012a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa01406a8b0 0x7fa0140b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa012a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa01406a8b0 0x7fa0140b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33522/0 (socket says 172.21.15.192:33522) 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.232+0000 7fa012a00640 1 -- 172.21.15.192:0/2700940793 learned_addr learned my addr 172.21.15.192:0/2700940793 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa013400640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa013e00640 1 --2- 172.21.15.192:0/2700940793 >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 0x7fa01406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa012a00640 1 -- 172.21.15.192:0/2700940793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 msgr2=0x7fa01406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa012a00640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa012a00640 1 -- 172.21.15.192:0/2700940793 >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 msgr2=0x7fa01406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa012a00640 1 --2- 172.21.15.192:0/2700940793 >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 0x7fa01406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa012a00640 1 -- 172.21.15.192:0/2700940793 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01406b760 con 0x7fa01406a8b0 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa013400640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.233+0000 7fa013e00640 1 --2- 172.21.15.192:0/2700940793 >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 0x7fa01406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.234+0000 7fa012a00640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa0140b3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa000009870 tx=0x7fa00002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de0bb5b82d7516e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.234+0000 7fa012000640 1 -- 172.21.15.192:0/2700940793 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000032440 con 0x7fa01406a8b0 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.234+0000 7fa012000640 1 -- 172.21.15.192:0/2700940793 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0000325a0 con 0x7fa01406a8b0 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.234+0000 7fa012000640 1 -- 172.21.15.192:0/2700940793 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000032930 con 0x7fa01406a8b0 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 -- 172.21.15.192:0/2700940793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 msgr2=0x7fa0140b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa0140b3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa000009870 tx=0x7fa00002a200 comp rx=0 tx=0).stop 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 -- 172.21.15.192:0/2700940793 shutdown_connections 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 --2- 172.21.15.192:0/2700940793 >> v2:172.21.15.194:3300/0 conn(0x7fa0140b3bd0 0x7fa01406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa0140b3690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 --2- 172.21.15.192:0/2700940793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 -- 172.21.15.192:0/2700940793 >> 172.21.15.192:0/2700940793 conn(0x7fa0140b08f0 msgr2=0x7fa0140b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 -- 172.21.15.192:0/2700940793 shutdown_connections 2024-09-13T18:36:15.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.235+0000 7fa01a000640 1 -- 172.21.15.192:0/2700940793 wait complete. 2024-09-13T18:36:15.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.236+0000 7fa01a000640 1 Processor -- start 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 -- start start 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0140b3bd0 0x7fa01413e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01413ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01413ee70 con 0x7fa01406a8b0 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01413f080 con 0x7fa0140b3bd0 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.237+0000 7fa01a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01413f360 con 0x7fa0141434c0 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33538/0 (socket says 172.21.15.192:33538) 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 -- 172.21.15.192:0/1793656285 learned_addr learned my addr 172.21.15.192:0/1793656285 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa012a00640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0140b3bd0 0x7fa01413e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013e00640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01413ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 -- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 msgr2=0x7fa01413ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01413ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 -- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0140b3bd0 msgr2=0x7fa01413e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0140b3bd0 0x7fa01413e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 -- 172.21.15.192:0/1793656285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0000094d0 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.238+0000 7fa013400640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa00400c7f0 tx=0x7fa00400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.239+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004007820 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.239+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004007980 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.239+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004007cf0 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.239+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01413d6d0 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.239+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01413e410 con 0x7fa01406a8b0 2024-09-13T18:36:15.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.240+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01413d530 con 0x7fa01406a8b0 2024-09-13T18:36:15.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.241+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa0040113f0 con 0x7fa01406a8b0 2024-09-13T18:36:15.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.242+0000 7fa00b400640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 0x7f9ff406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.242+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0040896b0 con 0x7fa01406a8b0 2024-09-13T18:36:15.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.242+0000 7fa012a00640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 0x7f9ff406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.243+0000 7fa012a00640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 0x7f9ff406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa000034000 tx=0x7fa00002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.246+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa01413d530 con 0x7fa01406a8b0 2024-09-13T18:36:15.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.413+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa01413d530 con 0x7fa01406a8b0 2024-09-13T18:36:15.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.413+0000 7fa00b400640 1 -- 172.21.15.192:0/1793656285 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa01413d530 con 0x7fa01406a8b0 2024-09-13T18:36:15.416 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:15.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 msgr2=0x7f9ff406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 0x7f9ff406d0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa000034000 tx=0x7fa00002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 msgr2=0x7fa014158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa00400c7f0 tx=0x7fa00400ccb0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 shutdown_connections 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ff406ac00 0x7f9ff406d0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0141434c0 0x7fa01413ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0140b3bd0 0x7fa01413e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.415+0000 7fa01a000640 1 --2- 172.21.15.192:0/1793656285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa01406a8b0 0x7fa014158140 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.416+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 >> 172.21.15.192:0/1793656285 conn(0x7fa0140b08f0 msgr2=0x7fa01413ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.416+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 shutdown_connections 2024-09-13T18:36:15.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.416+0000 7fa01a000640 1 -- 172.21.15.192:0/1793656285 wait complete. 2024-09-13T18:36:15.434 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:15.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.588+0000 7f1d23e00640 1 Processor -- start 2024-09-13T18:36:15.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.588+0000 7f1d23e00640 1 -- start start 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.589+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.589+0000 7f1d23e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d1c0add80 0x7f1d1c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.589+0000 7f1d23e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1c161510 con 0x7f1d1c15a910 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.589+0000 7f1d23e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b21e0 con 0x7f1d1c0add80 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.589+0000 7f1d23e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0b1bf0 con 0x7f1d1c0b2600 2024-09-13T18:36:15.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1d1c15a910 0x7f1d1c160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46462/0 (socket says 172.21.15.192:46462) 2024-09-13T18:36:15.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21400640 1 -- 172.21.15.192:0/3067743077 learned_addr learned my addr 172.21.15.192:0/3067743077 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:15.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21e00640 1 --2- 172.21.15.192:0/3067743077 >> v2:172.21.15.194:3300/0 conn(0x7f1d1c0add80 0x7f1d1c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d20a00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d1be00640 1 -- 172.21.15.192:0/3067743077 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779202863 0 0) 0x7f1d1c161510 con 0x7f1d1c15a910 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d1be00640 1 -- 172.21.15.192:0/3067743077 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d04003520 con 0x7f1d1c15a910 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21e00640 1 -- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 msgr2=0x7f1d1c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21e00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21e00640 1 -- 172.21.15.192:0/3067743077 >> v1:172.21.15.192:6789/0 conn(0x7f1d1c15a910 legacy=0x7f1d1c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d21e00640 1 -- 172.21.15.192:0/3067743077 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c1617f0 con 0x7f1d1c0add80 2024-09-13T18:36:15.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.590+0000 7f1d20a00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.591+0000 7f1d21e00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c0add80 0x7f1d1c0cc760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009d90 tx=0x7f1d1402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=612c83b35e4456a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d1be00640 1 -- 172.21.15.192:0/3067743077 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14031600 con 0x7f1d1c0add80 2024-09-13T18:36:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d1be00640 1 -- 172.21.15.192:0/3067743077 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1402d050 con 0x7f1d1c0add80 2024-09-13T18:36:15.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d1be00640 1 -- 172.21.15.192:0/3067743077 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d14031980 con 0x7f1d1c0add80 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 -- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c0add80 msgr2=0x7f1d1c0cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c0add80 0x7f1d1c0cc760 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1d14009d90 tx=0x7f1d1402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 -- 172.21.15.192:0/3067743077 shutdown_connections 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c0add80 0x7f1d1c0cc760 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 --2- 172.21.15.192:0/3067743077 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 -- 172.21.15.192:0/3067743077 >> 172.21.15.192:0/3067743077 conn(0x7f1d1c0b08f0 msgr2=0x7f1d1c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 -- 172.21.15.192:0/3067743077 shutdown_connections 2024-09-13T18:36:15.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.592+0000 7f1d23e00640 1 -- 172.21.15.192:0/3067743077 wait complete. 2024-09-13T18:36:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.594+0000 7f1d23e00640 1 Processor -- start 2024-09-13T18:36:15.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.594+0000 7f1d23e00640 1 -- start start 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c1485d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 0x7f1d1c15bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c06ff80 con 0x7f1d1c0add80 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c0717d0 con 0x7f1d1c15a910 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d23e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c069ea0 con 0x7f1d1c0b2600 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d21400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d21400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33542/0 (socket says 172.21.15.192:33542) 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d21400640 1 -- 172.21.15.192:0/39690815 learned_addr learned my addr 172.21.15.192:0/39690815 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d20a00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c1485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.595+0000 7f1d21e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 0x7f1d1c15bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 -- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 msgr2=0x7f1d1c1485d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c1485d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 -- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 msgr2=0x7f1d1c15bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 0x7f1d1c15bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 -- 172.21.15.192:0/39690815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c009400 con 0x7f1d1c0add80 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 0x7f1d1c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d21400640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c410 tx=0x7f1d1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10005ce0 con 0x7f1d1c0add80 2024-09-13T18:36:15.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d10005e40 con 0x7f1d1c0add80 2024-09-13T18:36:15.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14009a70 con 0x7f1d1c0add80 2024-09-13T18:36:15.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d100072f0 con 0x7f1d1c0add80 2024-09-13T18:36:15.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.596+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c06a740 con 0x7f1d1c0add80 2024-09-13T18:36:15.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.597+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c06a290 con 0x7f1d1c0add80 2024-09-13T18:36:15.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.599+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d10007510 con 0x7f1d1c0add80 2024-09-13T18:36:15.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.599+0000 7f1d19600640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 0x7f1d0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.600+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d10088990 con 0x7f1d1c0add80 2024-09-13T18:36:15.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.600+0000 7f1d20a00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 0x7f1d0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.600+0000 7f1d20a00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 0x7f1d0006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c15d460 tx=0x7f1d0c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.604+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d10053c40 con 0x7f1d1c0add80 2024-09-13T18:36:15.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.773+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d1c06a060 con 0x7f1d1c0add80 2024-09-13T18:36:15.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.774+0000 7f1d19600640 1 -- 172.21.15.192:0/39690815 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d10017020 con 0x7f1d1c0add80 2024-09-13T18:36:15.776 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 msgr2=0x7f1d0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 0x7f1d0006d0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c15d460 tx=0x7f1d0c009190 comp rx=0 tx=0).stop 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 msgr2=0x7f1d1c1569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000c410 tx=0x7f1d1000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 shutdown_connections 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d0006ac00 0x7f1d0006d0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d1c15a910 0x7f1d1c15bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1c0b2600 0x7f1d1c1485d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 --2- 172.21.15.192:0/39690815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d1c0add80 0x7f1d1c1569c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 >> 172.21.15.192:0/39690815 conn(0x7f1d1c0b08f0 msgr2=0x7f1d1c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 shutdown_connections 2024-09-13T18:36:15.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.776+0000 7f1d23e00640 1 -- 172.21.15.192:0/39690815 wait complete. 2024-09-13T18:36:15.794 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:15.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.947+0000 7f4acc400640 1 Processor -- start 2024-09-13T18:36:15.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.947+0000 7f4acc400640 1 -- start start 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4acc400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4ac40b3af0 0x7f4ac415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4acc400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40b2000 con 0x7f4ac41589f0 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4acc400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40b2ba0 con 0x7f4ac406c0b0 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4acc400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac415bbd0 con 0x7f4ac40b3af0 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4ac9a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4ac41589f0 0x7f4ac40b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46464/0 (socket says 172.21.15.192:46464) 2024-09-13T18:36:15.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.948+0000 7f4ac9a00640 1 -- 172.21.15.192:0/1519987499 learned_addr learned my addr 172.21.15.192:0/1519987499 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac9000640 1 --2- 172.21.15.192:0/1519987499 >> v2:172.21.15.194:3300/0 conn(0x7f4ac40b3af0 0x7f4ac415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 338317825 0 0) 0x7f4ac40b2000 con 0x7f4ac41589f0 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4aac003520 con 0x7f4ac41589f0 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac9000640 1 -- 172.21.15.192:0/1519987499 >> v1:172.21.15.194:6789/0 conn(0x7f4ac406c0b0 legacy=0x7f4ac40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac9000640 1 -- 172.21.15.192:0/1519987499 >> v1:172.21.15.192:6789/0 conn(0x7f4ac41589f0 legacy=0x7f4ac40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2646482987 0 0) 0x7f4aac003520 con 0x7f4ac41589f0 2024-09-13T18:36:15.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.949+0000 7f4ac9000640 1 -- 172.21.15.192:0/1519987499 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac415beb0 con 0x7f4ac40b3af0 2024-09-13T18:36:15.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.950+0000 7f4ac9000640 1 --2- 172.21.15.192:0/1519987499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac40b3af0 0x7f4ac415b260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37457c5a88b8fda7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8001670 con 0x7f4ac40b3af0 2024-09-13T18:36:15.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab002abc0 con 0x7f4ac40b3af0 2024-09-13T18:36:15.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1519987499 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab0032440 con 0x7f4ac40b3af0 2024-09-13T18:36:15.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 -- 172.21.15.192:0/1519987499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac40b3af0 msgr2=0x7f4ac415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 --2- 172.21.15.192:0/1519987499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac40b3af0 0x7f4ac415b260 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4ab00097a0 tx=0x7f4ab002a130 comp rx=0 tx=0).stop 2024-09-13T18:36:15.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 -- 172.21.15.192:0/1519987499 shutdown_connections 2024-09-13T18:36:15.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 --2- 172.21.15.192:0/1519987499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac40b3af0 0x7f4ac415b260 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 -- 172.21.15.192:0/1519987499 >> 172.21.15.192:0/1519987499 conn(0x7f4ac40b08f0 msgr2=0x7f4ac40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:15.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 -- 172.21.15.192:0/1519987499 shutdown_connections 2024-09-13T18:36:15.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.951+0000 7f4acc400640 1 -- 172.21.15.192:0/1519987499 wait complete. 2024-09-13T18:36:15.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.953+0000 7f4acc400640 1 Processor -- start 2024-09-13T18:36:15.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.953+0000 7f4acc400640 1 -- start start 2024-09-13T18:36:15.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41f4340 con 0x7f4ac41589f0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41f37c0 con 0x7f4ac406c0b0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4acc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41f3aa0 con 0x7f4ac40b3af0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4aca400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4aca400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33546/0 (socket says 172.21.15.192:33546) 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4aca400640 1 -- 172.21.15.192:0/2458784197 learned_addr learned my addr 172.21.15.192:0/2458784197 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4ac9a00640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.954+0000 7f4ac9000640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 -- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 msgr2=0x7f4ac4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 -- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 msgr2=0x7f4ac4154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:15.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:15.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 -- 172.21.15.192:0/2458784197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab0009400 con 0x7f4ac41589f0 2024-09-13T18:36:15.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4aca400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7a0 tx=0x7f4abc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc003b70 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc003cf0 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc003ea0 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac41f3d80 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.955+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac4154bd0 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.957+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac415b260 con 0x7f4ac41589f0 2024-09-13T18:36:15.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.957+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4abc00aa90 con 0x7f4ac41589f0 2024-09-13T18:36:15.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.958+0000 7f4ac1600640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:15.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.958+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4abc088ff0 con 0x7f4ac41589f0 2024-09-13T18:36:15.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.958+0000 7f4ac9a00640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:15.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.959+0000 7f4ac9a00640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8001eb0 tx=0x7f4ab8000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:15.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:15.962+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4abc054310 con 0x7f4ac41589f0 2024-09-13T18:36:16.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.131+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ac40cc0b0 con 0x7f4ac41589f0 2024-09-13T18:36:16.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.132+0000 7f4ac1600640 1 -- 172.21.15.192:0/2458784197 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4abc057930 con 0x7f4ac41589f0 2024-09-13T18:36:16.135 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 msgr2=0x7f4aa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8001eb0 tx=0x7f4ab8000bc0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 msgr2=0x7f4ac40ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7a0 tx=0x7f4abc00cc60 comp rx=0 tx=0).stop 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 shutdown_connections 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 --2- 172.21.15.192:0/2458784197 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 >> 172.21.15.192:0/2458784197 conn(0x7f4ac40b08f0 msgr2=0x7f4ac40716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 shutdown_connections 2024-09-13T18:36:16.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.134+0000 7f4acc400640 1 -- 172.21.15.192:0/2458784197 wait complete. 2024-09-13T18:36:16.153 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:16.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.301+0000 7feec4400640 1 Processor -- start 2024-09-13T18:36:16.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.301+0000 7feec4400640 1 -- start start 2024-09-13T18:36:16.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec4400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feebc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec4400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feebc0afd80 0x7feebc0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec4400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feebc0b06f0 con 0x7feebc146610 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec4400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feebc0cd920 con 0x7feebc0afd80 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec4400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0ae770 con 0x7feebc0b2780 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec1a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7feebc146610 0x7feebc0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46474/0 (socket says 172.21.15.192:46474) 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec1a00640 1 -- 172.21.15.192:0/2772286238 learned_addr learned my addr 172.21.15.192:0/2772286238 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec1000640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feebc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feec2400640 1 --2- 172.21.15.192:0/2772286238 >> v2:172.21.15.194:3300/0 conn(0x7feebc0afd80 0x7feebc0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614721699 0 0) 0x7feebc0b06f0 con 0x7feebc146610 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.303+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea4003520 con 0x7feebc146610 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686501275 0 0) 0x7feea4003520 con 0x7feebc146610 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 msgr2=0x7feebc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feebc0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 >> v2:172.21.15.194:3300/0 conn(0x7feebc0afd80 msgr2=0x7feebc0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 --2- 172.21.15.192:0/2772286238 >> v2:172.21.15.194:3300/0 conn(0x7feebc0afd80 0x7feebc0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc0cdb30 con 0x7feebc146610 2024-09-13T18:36:16.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7feeb0001670 con 0x7feebc146610 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 >> v1:172.21.15.192:6789/0 conn(0x7feebc146610 legacy=0x7feebc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea4003970 0x7feea4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea40047c0 0x7feea4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feea4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0cd920 con 0x7feea4003970 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc0ae770 con 0x7feea40047c0 2024-09-13T18:36:16.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea400b980 con 0x7feebc0b2780 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feec1000640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea40047c0 0x7feea4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feec1a00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea4003970 0x7feea4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.304+0000 7feec2400640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feea4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1000640 1 -- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 msgr2=0x7feea4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1000640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc0b2780 0x7feea4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1000640 1 -- 172.21.15.192:0/2772286238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea4003970 msgr2=0x7feea4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1000640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea4003970 0x7feea4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1000640 1 -- 172.21.15.192:0/2772286238 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea4003520 con 0x7feea40047c0 2024-09-13T18:36:16.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.305+0000 7feec1a00640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea4003970 0x7feea4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:16.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec1000640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea40047c0 0x7feea4004c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feea8009a90 tx=0x7feea40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80e56f9b2a70e390 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8031400 con 0x7feea40047c0 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea802d050 con 0x7feea40047c0 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feebbe00640 1 -- 172.21.15.192:0/2772286238 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8031780 con 0x7feea40047c0 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec4400640 1 -- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea40047c0 msgr2=0x7feea4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec4400640 1 --2- 172.21.15.192:0/2772286238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feea40047c0 0x7feea4004c40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feea8009a90 tx=0x7feea40057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec2400640 1 -- 172.21.15.192:0/2772286238 reap_dead start 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec4400640 1 -- 172.21.15.192:0/2772286238 shutdown_connections 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.306+0000 7feec4400640 1 -- 172.21.15.192:0/2772286238 >> 172.21.15.192:0/2772286238 conn(0x7feebc0ae960 msgr2=0x7feebc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.307+0000 7feec4400640 1 -- 172.21.15.192:0/2772286238 shutdown_connections 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.307+0000 7feec4400640 1 -- 172.21.15.192:0/2772286238 wait complete. 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.308+0000 7feec4400640 1 Processor -- start 2024-09-13T18:36:16.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.308+0000 7feec4400640 1 -- start start 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feebc15c6a0 0x7feebc13e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc13fec0 0x7feebc0b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc13ae40 con 0x7feea40047c0 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feebc13ee20 con 0x7feebc15c6a0 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec4400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feebc13f100 con 0x7feebc13fec0 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.309+0000 7feec1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33574/0 (socket says 172.21.15.192:33574) 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 -- 172.21.15.192:0/2128502931 learned_addr learned my addr 172.21.15.192:0/2128502931 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec2400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc13fec0 0x7feebc0b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1000640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feebc15c6a0 0x7feebc13e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 -- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc13fec0 msgr2=0x7feebc0b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc13fec0 0x7feebc0b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 -- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feebc15c6a0 msgr2=0x7feebc13e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feebc15c6a0 0x7feebc13e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 -- 172.21.15.192:0/2128502931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feebc13f3e0 con 0x7feea40047c0 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec1a00640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feeb0007310 tx=0x7feeb00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000fa20 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000fb80 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00133f0 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.310+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feebc13f6c0 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.311+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc13eb10 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.312+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feebc13fbe0 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.312+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feeb0013550 con 0x7feea40047c0 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.313+0000 7feeb9600640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 0x7fee9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.313+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feeb0089730 con 0x7feea40047c0 2024-09-13T18:36:16.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.313+0000 7feec1000640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 0x7fee9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.314+0000 7feec1000640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 0x7fee9c06d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feea8033000 tx=0x7feea8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.317+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feebc13fbe0 con 0x7feea40047c0 2024-09-13T18:36:16.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.487+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feebc13fbe0 con 0x7feea40047c0 2024-09-13T18:36:16.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.488+0000 7feeb9600640 1 -- 172.21.15.192:0/2128502931 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7feebc13fbe0 con 0x7feea40047c0 2024-09-13T18:36:16.492 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:16.493 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 msgr2=0x7fee9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 0x7fee9c06d0f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feea8033000 tx=0x7feea8008030 comp rx=0 tx=0).stop 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 msgr2=0x7feebc13a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feeb0007310 tx=0x7feeb00077d0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 shutdown_connections 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee9c06ac30 0x7fee9c06d0f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feebc13fec0 0x7feebc0b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feebc15c6a0 0x7feebc13e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 --2- 172.21.15.192:0/2128502931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea40047c0 0x7feebc13a900 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.490+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 >> 172.21.15.192:0/2128502931 conn(0x7feebc0ae960 msgr2=0x7feebc1448a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.491+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 shutdown_connections 2024-09-13T18:36:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.491+0000 7feec4400640 1 -- 172.21.15.192:0/2128502931 wait complete. 2024-09-13T18:36:16.510 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:16.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:16.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.662+0000 7fec25c00640 1 Processor -- start 2024-09-13T18:36:16.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.662+0000 7fec25c00640 1 -- start start 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.663+0000 7fec25c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec201589f0 0x7fec200b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.663+0000 7fec25c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec200b3af0 0x7fec2015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.663+0000 7fec25c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec200b2000 con 0x7fec2006c0b0 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.663+0000 7fec25c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec2015bbd0 con 0x7fec200b3af0 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.663+0000 7fec25c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec2015beb0 con 0x7fec201589f0 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec200b3af0 0x7fec2015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec201589f0 0x7fec200b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec200b3af0 0x7fec2015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44668/0 (socket says 172.21.15.192:44668) 2024-09-13T18:36:16.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 -- 172.21.15.192:0/4245189203 learned_addr learned my addr 172.21.15.192:0/4245189203 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:16.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 -- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec201589f0 msgr2=0x7fec200b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:16.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 --2- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec201589f0 0x7fec200b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 -- 172.21.15.192:0/4245189203 >> v1:172.21.15.194:6789/0 conn(0x7fec2006c0b0 legacy=0x7fec200cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.664+0000 7fec1e000640 1 -- 172.21.15.192:0/4245189203 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2015c190 con 0x7fec200b3af0 2024-09-13T18:36:16.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.665+0000 7fec1e000640 1 --2- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec200b3af0 0x7fec2015b260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009870 tx=0x7fec0c02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f5a2fbcd6803781 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec1d600640 1 -- 172.21.15.192:0/4245189203 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032440 con 0x7fec200b3af0 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec1d600640 1 -- 172.21.15.192:0/4245189203 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c0325a0 con 0x7fec200b3af0 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec1d600640 1 -- 172.21.15.192:0/4245189203 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c032930 con 0x7fec200b3af0 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 -- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec200b3af0 msgr2=0x7fec2015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 --2- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec200b3af0 0x7fec2015b260 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec0c009870 tx=0x7fec0c02a270 comp rx=0 tx=0).stop 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 -- 172.21.15.192:0/4245189203 shutdown_connections 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 --2- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec200b3af0 0x7fec2015b260 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 --2- 172.21.15.192:0/4245189203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec201589f0 0x7fec200b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 -- 172.21.15.192:0/4245189203 >> 172.21.15.192:0/4245189203 conn(0x7fec200b08f0 msgr2=0x7fec200b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 -- 172.21.15.192:0/4245189203 shutdown_connections 2024-09-13T18:36:16.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.666+0000 7fec25c00640 1 -- 172.21.15.192:0/4245189203 wait complete. 2024-09-13T18:36:16.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.668+0000 7fec25c00640 1 Processor -- start 2024-09-13T18:36:16.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.668+0000 7fec25c00640 1 -- start start 2024-09-13T18:36:16.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec2006c0b0 0x7fec2014d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec200b3af0 0x7fec201f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20157b00 con 0x7fec201589f0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec20156e80 con 0x7fec2006c0b0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec25c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec20157160 con 0x7fec200b3af0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec1f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec1f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33588/0 (socket says 172.21.15.192:33588) 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec1f400640 1 -- 172.21.15.192:0/3198183041 learned_addr learned my addr 172.21.15.192:0/3198183041 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec1ea00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec2006c0b0 0x7fec2014d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.669+0000 7fec1e000640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec200b3af0 0x7fec201f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 -- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec200b3af0 msgr2=0x7fec201f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec200b3af0 0x7fec201f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 -- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec2006c0b0 msgr2=0x7fec2014d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec2006c0b0 0x7fec2014d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 -- 172.21.15.192:0/3198183041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0094d0 con 0x7fec201589f0 2024-09-13T18:36:16.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec1f400640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c7a0 tx=0x7fec1800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18003b70 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18003cf0 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec20157440 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec18003ea0 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.670+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec201f4ad0 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.671+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec20157c40 con 0x7fec201589f0 2024-09-13T18:36:16.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.672+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec1800aa90 con 0x7fec201589f0 2024-09-13T18:36:16.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.673+0000 7fec16a00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:16.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.673+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec18089090 con 0x7fec201589f0 2024-09-13T18:36:16.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.673+0000 7fec1ea00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:16.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.674+0000 7fec1ea00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 0x7fec0006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec10009aa0 tx=0x7fec10009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:16.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.678+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec20157c40 con 0x7fec201589f0 2024-09-13T18:36:16.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.844+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fec20157c40 con 0x7fec201589f0 2024-09-13T18:36:16.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.845+0000 7fec16a00640 1 -- 172.21.15.192:0/3198183041 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fec20157c40 con 0x7fec201589f0 2024-09-13T18:36:16.848 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 msgr2=0x7fec0006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 0x7fec0006d0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fec10009aa0 tx=0x7fec10009190 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 msgr2=0x7fec201f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fec1800c7a0 tx=0x7fec1800cc60 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 shutdown_connections 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fec0006ac00 0x7fec0006d0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec201589f0 0x7fec201f4590 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec200b3af0 0x7fec201f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 --2- 172.21.15.192:0/3198183041 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec2006c0b0 0x7fec2014d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:16.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 >> 172.21.15.192:0/3198183041 conn(0x7fec200b08f0 msgr2=0x7fec200b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:16.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 shutdown_connections 2024-09-13T18:36:16.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:16.847+0000 7fec25c00640 1 -- 172.21.15.192:0/3198183041 wait complete. 2024-09-13T18:36:16.865 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:17.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.019+0000 7f3356200640 1 Processor -- start 2024-09-13T18:36:17.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.019+0000 7f3356200640 1 -- start start 2024-09-13T18:36:17.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3356200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3350167ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3356200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500cd1e0 con 0x7f335006cbe0 2024-09-13T18:36:17.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3356200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500cf0d0 con 0x7f33500cec60 2024-09-13T18:36:17.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3356200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33500cd430 con 0x7f33500cc8d0 2024-09-13T18:36:17.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3354e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f335006cbe0 0x7f335006cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46478/0 (socket says 172.21.15.192:46478) 2024-09-13T18:36:17.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3354e00640 1 -- 172.21.15.192:0/1091196984 learned_addr learned my addr 172.21.15.192:0/1091196984 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:17.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.020+0000 7f3355800640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3350167ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559779829 0 0) 0x7f33500cd1e0 con 0x7f335006cbe0 2024-09-13T18:36:17.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338003520 con 0x7f335006cbe0 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2763281342 0 0) 0x7f3338003520 con 0x7f335006cbe0 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 msgr2=0x7f3350167ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3350167ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 >> v1:172.21.15.194:6789/0 conn(0x7f33500cec60 legacy=0x7f335015c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500ae2f0 con 0x7f335006cbe0 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f3344001670 con 0x7f335006cbe0 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 >> v1:172.21.15.192:6789/0 conn(0x7f335006cbe0 legacy=0x7f335006cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33380039a0 0x7f3338003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338004350 0x7f3338004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3338005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33500cd430 con 0x7f33380039a0 2024-09-13T18:36:17.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333800b980 con 0x7f3338004350 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333800bb40 con 0x7f33500cc8d0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f3354e00640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33380039a0 0x7f3338003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f3355800640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3338005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.021+0000 7f334fe00640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338004350 0x7f3338004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.022+0000 7f3354e00640 1 -- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 msgr2=0x7f3338005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.022+0000 7f3354e00640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33500cc8d0 0x7f3338005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.022+0000 7f3354e00640 1 -- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338004350 msgr2=0x7f3338004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.022+0000 7f3354e00640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3338004350 0x7f3338004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.022+0000 7f3354e00640 1 -- 172.21.15.192:0/1091196984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338003520 con 0x7f33380039a0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f3354e00640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33380039a0 0x7f3338003d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f334400c210 tx=0x7f33380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66df4b3480094c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344005ad0 con 0x7f33380039a0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344005c50 con 0x7f33380039a0 2024-09-13T18:36:17.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f334f400640 1 -- 172.21.15.192:0/1091196984 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3344007070 con 0x7f33380039a0 2024-09-13T18:36:17.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f3356200640 1 -- 172.21.15.192:0/1091196984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33380039a0 msgr2=0x7f3338003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f3356200640 1 --2- 172.21.15.192:0/1091196984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33380039a0 0x7f3338003d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f334400c210 tx=0x7f33380057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.023+0000 7f3355800640 1 -- 172.21.15.192:0/1091196984 reap_dead start 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.024+0000 7f3356200640 1 -- 172.21.15.192:0/1091196984 shutdown_connections 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.024+0000 7f3356200640 1 -- 172.21.15.192:0/1091196984 >> 172.21.15.192:0/1091196984 conn(0x7f33500cf2e0 msgr2=0x7f33500cf6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.024+0000 7f3356200640 1 -- 172.21.15.192:0/1091196984 shutdown_connections 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.024+0000 7f3356200640 1 -- 172.21.15.192:0/1091196984 wait complete. 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.025+0000 7f3356200640 1 Processor -- start 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.025+0000 7f3356200640 1 -- start start 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 0x7f33501f5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f335015b3e0 0x7f3350154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350155870 con 0x7f33501f4210 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335015b860 con 0x7f335015b3e0 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f3356200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33501f63a0 con 0x7f33380039a0 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f334fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f334fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33598/0 (socket says 172.21.15.192:33598) 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.026+0000 7f334fe00640 1 -- 172.21.15.192:0/2496144527 learned_addr learned my addr 172.21.15.192:0/2496144527 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f3354e00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 0x7f33501f5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f3355800640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f335015b3e0 0x7f3350154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 -- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 msgr2=0x7f33501f5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 0x7f33501f5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 -- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f335015b3e0 msgr2=0x7f3350154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f335015b3e0 0x7f3350154880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 -- 172.21.15.192:0/2496144527 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3350155590 con 0x7f33501f4210 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f3354e00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 0x7f33501f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334fe00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f333c00f750 tx=0x7f333c00fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00fe60 con 0x7f33501f4210 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333c0052e0 con 0x7f33501f4210 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.027+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c00d730 con 0x7f33501f4210 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.028+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33501591d0 con 0x7f33501f4210 2024-09-13T18:36:17.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.028+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3350159790 con 0x7f33501f4210 2024-09-13T18:36:17.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.029+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3350067490 con 0x7f33501f4210 2024-09-13T18:36:17.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.030+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f333c00d890 con 0x7f33501f4210 2024-09-13T18:36:17.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.030+0000 7f334cc00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 0x7f333006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.030+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f333c089300 con 0x7f33501f4210 2024-09-13T18:36:17.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.031+0000 7f3354e00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 0x7f333006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.031+0000 7f3354e00640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 0x7f333006d0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f334400c210 tx=0x7f334402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.036+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f333c054440 con 0x7f33501f4210 2024-09-13T18:36:17.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.201+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3350159030 con 0x7f33501f4210 2024-09-13T18:36:17.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.201+0000 7f334cc00640 1 -- 172.21.15.192:0/2496144527 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3350159030 con 0x7f33501f4210 2024-09-13T18:36:17.204 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:17.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 msgr2=0x7f333006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 0x7f333006d0f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f334400c210 tx=0x7f334402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 msgr2=0x7f335015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f333c00f750 tx=0x7f333c00fc10 comp rx=0 tx=0).stop 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 shutdown_connections 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f333006ac30 0x7f333006d0f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f335015b3e0 0x7f3350154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33501f4210 0x7f335015aea0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 --2- 172.21.15.192:0/2496144527 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33380039a0 0x7f33501f5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.203+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 >> 172.21.15.192:0/2496144527 conn(0x7f33500cf2e0 msgr2=0x7f3350071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.204+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 shutdown_connections 2024-09-13T18:36:17.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.204+0000 7f3356200640 1 -- 172.21.15.192:0/2496144527 wait complete. 2024-09-13T18:36:17.222 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:17.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.374+0000 7fc246600640 1 Processor -- start 2024-09-13T18:36:17.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.375+0000 7fc246600640 1 -- start start 2024-09-13T18:36:17.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc246600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2400b02f0 0x7fc2400b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc246600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b2d90 0x7fc24006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc246600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc24006f940 con 0x7fc240142e00 2024-09-13T18:36:17.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc246600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24006f610 con 0x7fc2400b02f0 2024-09-13T18:36:17.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc246600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400b3530 con 0x7fc2400b2d90 2024-09-13T18:36:17.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2400b02f0 0x7fc2400b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc245c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b2d90 0x7fc24006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2400b02f0 0x7fc2400b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44708/0 (socket says 172.21.15.192:44708) 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 -- 172.21.15.192:0/3998149675 learned_addr learned my addr 172.21.15.192:0/3998149675 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc245200640 1 --1- 172.21.15.192:0/3998149675 >> v1:172.21.15.194:6789/0 conn(0x7fc240142e00 0x7fc2400afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:36268/0 (socket says 172.21.15.192:36268) 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc23fe00640 1 -- 172.21.15.192:0/3998149675 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3112123972 0 0) 0x7fc24006f940 con 0x7fc240142e00 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 -- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b2d90 msgr2=0x7fc24006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 --2- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b2d90 0x7fc24006fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 -- 172.21.15.192:0/3998149675 >> v1:172.21.15.194:6789/0 conn(0x7fc240142e00 legacy=0x7fc2400afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.377+0000 7fc237e00640 1 -- 172.21.15.192:0/3998149675 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400b3810 con 0x7fc2400b02f0 2024-09-13T18:36:17.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.378+0000 7fc237e00640 1 --2- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b02f0 0x7fc2400b4910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc228009870 tx=0x7fc22802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce404d6a86374456 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.378+0000 7fc23fe00640 1 -- 172.21.15.192:0/3998149675 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228032440 con 0x7fc2400b02f0 2024-09-13T18:36:17.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.378+0000 7fc23fe00640 1 -- 172.21.15.192:0/3998149675 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2280325a0 con 0x7fc2400b02f0 2024-09-13T18:36:17.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.378+0000 7fc23fe00640 1 -- 172.21.15.192:0/3998149675 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228032930 con 0x7fc2400b02f0 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 -- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b02f0 msgr2=0x7fc2400b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 --2- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b02f0 0x7fc2400b4910 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc228009870 tx=0x7fc22802a270 comp rx=0 tx=0).stop 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 -- 172.21.15.192:0/3998149675 shutdown_connections 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 --2- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b2d90 0x7fc24006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 --2- 172.21.15.192:0/3998149675 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b02f0 0x7fc2400b4910 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 -- 172.21.15.192:0/3998149675 >> 172.21.15.192:0/3998149675 conn(0x7fc2400ae7f0 msgr2=0x7fc24006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 -- 172.21.15.192:0/3998149675 shutdown_connections 2024-09-13T18:36:17.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.379+0000 7fc246600640 1 -- 172.21.15.192:0/3998149675 wait complete. 2024-09-13T18:36:17.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.381+0000 7fc246600640 1 Processor -- start 2024-09-13T18:36:17.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.381+0000 7fc246600640 1 -- start start 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.381+0000 7fc246600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc246600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 0x7fc240152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc246600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 0x7fc240152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc246600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24014f880 con 0x7fc2400b02f0 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc246600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24014f570 con 0x7fc2400b2d90 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc246600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400b0130 con 0x7fc240142e00 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33600/0 (socket says 172.21.15.192:33600) 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 -- 172.21.15.192:0/60693367 learned_addr learned my addr 172.21.15.192:0/60693367 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245c00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 0x7fc240152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc237e00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 0x7fc240152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 -- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 msgr2=0x7fc240152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 0x7fc240152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 -- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 msgr2=0x7fc240152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 0x7fc240152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 -- 172.21.15.192:0/60693367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2280094d0 con 0x7fc2400b02f0 2024-09-13T18:36:17.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245c00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 0x7fc240152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:17.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc237e00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 0x7fc240152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:17.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.382+0000 7fc245200640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc23000c500 tx=0x7fc23000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.383+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230007560 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.383+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2300047e0 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.383+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc240143360 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.383+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc230004b90 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.383+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc240150260 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.384+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2400b4910 con 0x7fc2400b02f0 2024-09-13T18:36:17.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.385+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc230004cf0 con 0x7fc2400b02f0 2024-09-13T18:36:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.385+0000 7fc23d600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 0x7fc21c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.386+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2300884c0 con 0x7fc2400b02f0 2024-09-13T18:36:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.386+0000 7fc237e00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 0x7fc21c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.387+0000 7fc237e00640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 0x7fc21c06d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc228034000 tx=0x7fc22802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.390+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc230053690 con 0x7fc2400b02f0 2024-09-13T18:36:17.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.558+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc240131820 con 0x7fc2400b02f0 2024-09-13T18:36:17.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.558+0000 7fc23d600640 1 -- 172.21.15.192:0/60693367 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc230018020 con 0x7fc2400b02f0 2024-09-13T18:36:17.561 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:17.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 msgr2=0x7fc21c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 0x7fc21c06d0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc228034000 tx=0x7fc22802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:17.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 msgr2=0x7fc2401312e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc23000c500 tx=0x7fc23000c9c0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 shutdown_connections 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc21c06ac30 0x7fc21c06d0f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc240142e00 0x7fc240152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b2d90 0x7fc240152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 --2- 172.21.15.192:0/60693367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2400b02f0 0x7fc2401312e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 >> 172.21.15.192:0/60693367 conn(0x7fc2400ae7f0 msgr2=0x7fc2400ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 shutdown_connections 2024-09-13T18:36:17.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.561+0000 7fc246600640 1 -- 172.21.15.192:0/60693367 wait complete. 2024-09-13T18:36:17.606 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-13T18:36:17.606 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2024-09-13T18:36:17.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:17.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.755+0000 7fe66ca00640 1 Processor -- start 2024-09-13T18:36:17.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.756+0000 7fe66ca00640 1 -- start start 2024-09-13T18:36:17.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe66ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe66806e990 0x7fe6680cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe66ca00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 0x7fe6680cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe66ca00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe66806c5d0 con 0x7fe66815a9e0 2024-09-13T18:36:17.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe66ca00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680b3730 con 0x7fe66806e990 2024-09-13T18:36:17.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe66ca00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6680b3920 con 0x7fe6680ce6c0 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe65ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe66806e990 0x7fe6680cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe65ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe66806e990 0x7fe6680cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33604/0 (socket says 172.21.15.192:33604) 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe65ea00640 1 -- 172.21.15.192:0/2648137143 learned_addr learned my addr 172.21.15.192:0/2648137143 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe667400640 1 --1- 172.21.15.192:0/2648137143 >> v1:172.21.15.192:6789/0 conn(0x7fe66815a9e0 0x7fe66806ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46490/0 (socket says 172.21.15.192:46490) 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.757+0000 7fe667e00640 1 --2- 172.21.15.192:0/2648137143 >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 0x7fe6680cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe65ea00640 1 -- 172.21.15.192:0/2648137143 >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 msgr2=0x7fe6680cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe65ea00640 1 --2- 172.21.15.192:0/2648137143 >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 0x7fe6680cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe65ea00640 1 -- 172.21.15.192:0/2648137143 >> v1:172.21.15.192:6789/0 conn(0x7fe66815a9e0 legacy=0x7fe66806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe65ea00640 1 -- 172.21.15.192:0/2648137143 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6680b3c00 con 0x7fe66806e990 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe666a00640 1 -- 172.21.15.192:0/2648137143 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166500556 0 0) 0x7fe66806c5d0 con 0x7fe66815a9e0 2024-09-13T18:36:17.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.758+0000 7fe667e00640 1 --2- 172.21.15.192:0/2648137143 >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 0x7fe6680cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:17.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe65ea00640 1 --2- 172.21.15.192:0/2648137143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6680cd8c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe6680b1490 tx=0x7fe65002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d48ce5ff8bc912 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe666a00640 1 -- 172.21.15.192:0/2648137143 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650032440 con 0x7fe66806e990 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe666a00640 1 -- 172.21.15.192:0/2648137143 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6500325a0 con 0x7fe66806e990 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe666a00640 1 -- 172.21.15.192:0/2648137143 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650032930 con 0x7fe66806e990 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 -- 172.21.15.192:0/2648137143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 msgr2=0x7fe6680cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2648137143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6680cd8c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe6680b1490 tx=0x7fe65002a270 comp rx=0 tx=0).stop 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 -- 172.21.15.192:0/2648137143 shutdown_connections 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2648137143 >> v2:172.21.15.194:3300/0 conn(0x7fe6680ce6c0 0x7fe6680cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2648137143 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6680cd8c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 -- 172.21.15.192:0/2648137143 >> 172.21.15.192:0/2648137143 conn(0x7fe6680736d0 msgr2=0x7fe6680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.759+0000 7fe66ca00640 1 -- 172.21.15.192:0/2648137143 shutdown_connections 2024-09-13T18:36:17.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.760+0000 7fe66ca00640 1 -- 172.21.15.192:0/2648137143 wait complete. 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.761+0000 7fe66ca00640 1 Processor -- start 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.761+0000 7fe66ca00640 1 -- start start 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6680ce6c0 0x7fe66815afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe66815a9e0 0x7fe66815b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681f66e0 con 0x7fe66806e990 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe66815df30 con 0x7fe6680ce6c0 2024-09-13T18:36:17.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe66ca00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6681f5e20 con 0x7fe66815a9e0 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe667400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe667400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33608/0 (socket says 172.21.15.192:33608) 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.762+0000 7fe667400640 1 -- 172.21.15.192:0/2428220949 learned_addr learned my addr 172.21.15.192:0/2428220949 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe65ea00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6680ce6c0 0x7fe66815afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667e00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe66815a9e0 0x7fe66815b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 -- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe66815a9e0 msgr2=0x7fe66815b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe66815a9e0 0x7fe66815b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 -- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6680ce6c0 msgr2=0x7fe66815afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6680ce6c0 0x7fe66815afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 -- 172.21.15.192:0/2428220949 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6500094d0 con 0x7fe66806e990 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe667400640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c490 tx=0x7fe65800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6580074e0 con 0x7fe66806e990 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe658007660 con 0x7fe66806e990 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe658004a20 con 0x7fe66806e990 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6681f6090 con 0x7fe66806e990 2024-09-13T18:36:17.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.763+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6681f00a0 con 0x7fe66806e990 2024-09-13T18:36:17.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.764+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe66815adc0 con 0x7fe66806e990 2024-09-13T18:36:17.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.765+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe658004b80 con 0x7fe66806e990 2024-09-13T18:36:17.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.766+0000 7fe65fe00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 0x7fe64406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:17.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.766+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe658088440 con 0x7fe66806e990 2024-09-13T18:36:17.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.766+0000 7fe65ea00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 0x7fe64406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:17.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.767+0000 7fe65ea00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 0x7fe64406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe65002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:17.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.770+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe658053610 con 0x7fe66806e990 2024-09-13T18:36:17.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.939+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe668155d00 con 0x7fe66806e990 2024-09-13T18:36:17.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.940+0000 7fe65fe00640 1 -- 172.21.15.192:0/2428220949 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fe658056c30 con 0x7fe66806e990 2024-09-13T18:36:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:17.943 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:17.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 msgr2=0x7fe64406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 0x7fe64406d0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe650034000 tx=0x7fe65002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:17.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 msgr2=0x7fe6681efb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c490 tx=0x7fe65800c950 comp rx=0 tx=0).stop 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 shutdown_connections 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe64406ac00 0x7fe64406d0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe66815a9e0 0x7fe66815b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6680ce6c0 0x7fe66815afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 --2- 172.21.15.192:0/2428220949 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe66806e990 0x7fe6681efb60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 >> 172.21.15.192:0/2428220949 conn(0x7fe6680736d0 msgr2=0x7fe66806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 shutdown_connections 2024-09-13T18:36:17.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:17.942+0000 7fe66ca00640 1 -- 172.21.15.192:0/2428220949 wait complete. 2024-09-13T18:36:17.961 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:17.962 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:18.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.116+0000 7f0b57000640 1 Processor -- start 2024-09-13T18:36:18.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.116+0000 7f0b57000640 1 -- start start 2024-09-13T18:36:18.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.117+0000 7f0b57000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b5006c800 0x7f0b500b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.117+0000 7f0b57000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b5006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.117+0000 7f0b57000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5006cc70 con 0x7f0b501434c0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.117+0000 7f0b57000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b500b4060 con 0x7f0b5006c800 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.117+0000 7f0b57000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500ce770 con 0x7f0b500b3bd0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0b501434c0 0x7f0b5006a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46506/0 (socket says 172.21.15.192:46506) 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4fe00640 1 -- 172.21.15.192:0/3552154369 learned_addr learned my addr 172.21.15.192:0/3552154369 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b55000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b5006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4f400640 1 --2- 172.21.15.192:0/3552154369 >> v2:172.21.15.194:3300/0 conn(0x7f0b5006c800 0x7f0b500b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340986818 0 0) 0x7f0b5006cc70 con 0x7f0b501434c0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b34003500 con 0x7f0b501434c0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697723154 0 0) 0x7f0b34003500 con 0x7f0b501434c0 2024-09-13T18:36:18.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 msgr2=0x7f0b5006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b5006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 >> v2:172.21.15.194:3300/0 conn(0x7f0b5006c800 msgr2=0x7f0b500b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 --2- 172.21.15.192:0/3552154369 >> v2:172.21.15.194:3300/0 conn(0x7f0b5006c800 0x7f0b500b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5006b480 con 0x7f0b501434c0 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f0b40001670 con 0x7f0b501434c0 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 >> v1:172.21.15.192:6789/0 conn(0x7f0b501434c0 legacy=0x7f0b5006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34004b30 0x7f0b34004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.118+0000 7f0b4ea00640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b34003740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4ea00640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b34003cd0 0x7f0b34004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500b4060 con 0x7f0b34003cd0 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b500ce770 con 0x7f0b34004b30 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3400b8c0 con 0x7f0b500b3bd0 2024-09-13T18:36:18.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b34003cd0 0x7f0b34004130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4fe00640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34004b30 0x7f0b34004f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b4f400640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b34003740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 -- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 msgr2=0x7f0b34003740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b500b3bd0 0x7f0b34003740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 -- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34004b30 msgr2=0x7f0b34004f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b34004b30 0x7f0b34004f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.119+0000 7f0b55000640 1 -- 172.21.15.192:0/3552154369 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b34003500 con 0x7f0b34003cd0 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.120+0000 7f0b55000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b34003cd0 0x7f0b34004130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b48012510 tx=0x7f0b340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5519ed6eddffccfa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.120+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800d2d0 con 0x7f0b34003cd0 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.120+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b48013040 con 0x7f0b34003cd0 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.120+0000 7f0b4ea00640 1 -- 172.21.15.192:0/3552154369 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800b740 con 0x7f0b34003cd0 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 -- 172.21.15.192:0/3552154369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b34003cd0 msgr2=0x7f0b34004130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 --2- 172.21.15.192:0/3552154369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b34003cd0 0x7f0b34004130 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b48012510 tx=0x7f0b340047c0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b55000640 1 -- 172.21.15.192:0/3552154369 reap_dead start 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 -- 172.21.15.192:0/3552154369 shutdown_connections 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 -- 172.21.15.192:0/3552154369 >> 172.21.15.192:0/3552154369 conn(0x7f0b500b08f0 msgr2=0x7f0b500b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 -- 172.21.15.192:0/3552154369 shutdown_connections 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.121+0000 7f0b57000640 1 -- 172.21.15.192:0/3552154369 wait complete. 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.123+0000 7f0b57000640 1 Processor -- start 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.123+0000 7f0b57000640 1 -- start start 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 0x7f0b50157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 0x7f0b501f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b50139e20 con 0x7f0b5013f4c0 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006f330 con 0x7f0b501f1fe0 2024-09-13T18:36:18.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b57000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5006f580 con 0x7f0b34003cd0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33638/0 (socket says 172.21.15.192:33638) 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 -- 172.21.15.192:0/971346938 learned_addr learned my addr 172.21.15.192:0/971346938 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4fe00640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 0x7f0b50157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 -- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 msgr2=0x7f0b50157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b55000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 0x7f0b501f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 0x7f0b50157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 -- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 msgr2=0x7f0b501f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 0x7f0b501f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4f400640 1 -- 172.21.15.192:0/971346938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5006f860 con 0x7f0b5013f4c0 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b4fe00640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 0x7f0b50157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.124+0000 7f0b55000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 0x7f0b501f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:18.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b4f400640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c011aa0 tx=0x7f0b3c011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c009680 con 0x7f0b5013f4c0 2024-09-13T18:36:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b3c00fb80 con 0x7f0b5013f4c0 2024-09-13T18:36:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c014440 con 0x7f0b5013f4c0 2024-09-13T18:36:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5006fb40 con 0x7f0b5013f4c0 2024-09-13T18:36:18.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.125+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5013f940 con 0x7f0b5013f4c0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.126+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5006c2e0 con 0x7f0b5013f4c0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.127+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b3c0145a0 con 0x7f0b5013f4c0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.128+0000 7f0b47e00640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 0x7f0b3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.128+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b3c089c00 con 0x7f0b5013f4c0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.128+0000 7f0b4fe00640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 0x7f0b3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.129+0000 7f0b4fe00640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 0x7f0b3006d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001b40 tx=0x7f0b40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.132+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b3c054e80 con 0x7f0b5013f4c0 2024-09-13T18:36:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.299+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0b50142ce0 con 0x7f0b5013f4c0 2024-09-13T18:36:18.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.300+0000 7f0b47e00640 1 -- 172.21.15.192:0/971346938 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0b3c022020 con 0x7f0b5013f4c0 2024-09-13T18:36:18.302 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 msgr2=0x7f0b3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 0x7f0b3006d0f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0b40001b40 tx=0x7f0b40009040 comp rx=0 tx=0).stop 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 msgr2=0x7f0b501f1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c011aa0 tx=0x7f0b3c011f60 comp rx=0 tx=0).stop 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 shutdown_connections 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0b3006ac30 0x7f0b3006d0f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b501f1fe0 0x7f0b501f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b5013f4c0 0x7f0b501f1aa0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 --2- 172.21.15.192:0/971346938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b34003cd0 0x7f0b50157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 >> 172.21.15.192:0/971346938 conn(0x7f0b500b08f0 msgr2=0x7f0b500af680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 shutdown_connections 2024-09-13T18:36:18.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.302+0000 7f0b57000640 1 -- 172.21.15.192:0/971346938 wait complete. 2024-09-13T18:36:18.319 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.472+0000 7f4bad600640 1 Processor -- start 2024-09-13T18:36:18.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.473+0000 7f4bad600640 1 -- start start 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4bad600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ba80b02f0 0x7f4ba80b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4bad600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba806f940 con 0x7f4ba80b2d90 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4bad600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba806f610 con 0x7f4ba8142e00 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4bad600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80b3530 con 0x7f4ba80b02f0 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4b9f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ba80b02f0 0x7f4ba80b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4b9f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ba80b02f0 0x7f4ba80b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33654/0 (socket says 172.21.15.192:33654) 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4bacc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4ba80b2d90 0x7f4ba806fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46514/0 (socket says 172.21.15.192:46514) 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4b9f400640 1 -- 172.21.15.192:0/3303230851 learned_addr learned my addr 172.21.15.192:0/3303230851 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.474+0000 7f4b9f400640 1 -- 172.21.15.192:0/3303230851 >> v1:172.21.15.194:6789/0 conn(0x7f4ba8142e00 legacy=0x7f4ba80afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.475+0000 7f4b9f400640 1 -- 172.21.15.192:0/3303230851 >> v1:172.21.15.192:6789/0 conn(0x7f4ba80b2d90 legacy=0x7f4ba806fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.475+0000 7f4ba7400640 1 -- 172.21.15.192:0/3303230851 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859902885 0 0) 0x7f4ba806f940 con 0x7f4ba80b2d90 2024-09-13T18:36:18.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.475+0000 7f4b9f400640 1 -- 172.21.15.192:0/3303230851 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba80b3810 con 0x7f4ba80b02f0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4b9f400640 1 --2- 172.21.15.192:0/3303230851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba80b4910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009870 tx=0x7f4b9002c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f975d9356a44baa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4ba7400640 1 -- 172.21.15.192:0/3303230851 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90031710 con 0x7f4ba80b02f0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4ba7400640 1 -- 172.21.15.192:0/3303230851 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9002f050 con 0x7f4ba80b02f0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4ba7400640 1 -- 172.21.15.192:0/3303230851 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b90031a90 con 0x7f4ba80b02f0 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 -- 172.21.15.192:0/3303230851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 msgr2=0x7f4ba80b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 --2- 172.21.15.192:0/3303230851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba80b4910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009870 tx=0x7f4b9002c510 comp rx=0 tx=0).stop 2024-09-13T18:36:18.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 -- 172.21.15.192:0/3303230851 shutdown_connections 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 --2- 172.21.15.192:0/3303230851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba80b4910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 -- 172.21.15.192:0/3303230851 >> 172.21.15.192:0/3303230851 conn(0x7f4ba80ae7f0 msgr2=0x7f4ba806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.476+0000 7f4bad600640 1 -- 172.21.15.192:0/3303230851 shutdown_connections 2024-09-13T18:36:18.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.477+0000 7f4bad600640 1 -- 172.21.15.192:0/3303230851 wait complete. 2024-09-13T18:36:18.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.478+0000 7f4bad600640 1 Processor -- start 2024-09-13T18:36:18.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.478+0000 7f4bad600640 1 -- start start 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ba80b2d90 0x7f4ba8139480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 0x7f4ba8140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8140520 con 0x7f4ba80b02f0 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8133530 con 0x7f4ba80b2d90 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4bad600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba813fea0 con 0x7f4ba8142e00 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4ba7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33660/0 (socket says 172.21.15.192:33660) 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.479+0000 7f4ba7e00640 1 -- 172.21.15.192:0/2025545565 learned_addr learned my addr 172.21.15.192:0/2025545565 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4b9f400640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ba80b2d90 0x7f4ba8139480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4bacc00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 0x7f4ba8140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 -- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 msgr2=0x7f4ba8140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 0x7f4ba8140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 -- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ba80b2d90 msgr2=0x7f4ba8139480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ba80b2d90 0x7f4ba8139480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 -- 172.21.15.192:0/2025545565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900094d0 con 0x7f4ba80b02f0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4bacc00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 0x7f4ba8140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba7e00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c400 tx=0x7f4b9800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b980052d0 con 0x7f4ba80b02f0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98005430 con 0x7f4ba80b02f0 2024-09-13T18:36:18.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98003830 con 0x7f4ba80b02f0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba8143360 con 0x7f4ba80b02f0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.480+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba8140140 con 0x7f4ba80b02f0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.482+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba80b4910 con 0x7f4ba80b02f0 2024-09-13T18:36:18.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.482+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4b98003990 con 0x7f4ba80b02f0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.483+0000 7f4ba4c00640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 0x7f4b8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.483+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b98088910 con 0x7f4ba80b02f0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.483+0000 7f4b9f400640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 0x7f4b8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.484+0000 7f4b9f400640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 0x7f4b8406d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b90035000 tx=0x7f4b90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.487+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4b98053ae0 con 0x7f4ba80b02f0 2024-09-13T18:36:18.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.654+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ba80707b0 con 0x7f4ba80b02f0 2024-09-13T18:36:18.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.654+0000 7f4ba4c00640 1 -- 172.21.15.192:0/2025545565 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4b98017020 con 0x7f4ba80b02f0 2024-09-13T18:36:18.656 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 msgr2=0x7f4b8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 0x7f4b8406d0c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4b90035000 tx=0x7f4b90008030 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 msgr2=0x7f4ba8138f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c400 tx=0x7f4b9800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 shutdown_connections 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4b8406ac00 0x7f4b8406d0c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ba8142e00 0x7f4ba8140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ba80b2d90 0x7f4ba8139480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 --2- 172.21.15.192:0/2025545565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ba80b02f0 0x7f4ba8138f40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 >> 172.21.15.192:0/2025545565 conn(0x7f4ba80ae7f0 msgr2=0x7f4ba8070cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 shutdown_connections 2024-09-13T18:36:18.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.657+0000 7f4bad600640 1 -- 172.21.15.192:0/2025545565 wait complete. 2024-09-13T18:36:18.675 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:18.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.828+0000 7f3743000640 1 Processor -- start 2024-09-13T18:36:18.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.828+0000 7f3743000640 1 -- start start 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.829+0000 7f3743000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.829+0000 7f3743000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f373c0b3bd0 0x7f373c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.829+0000 7f3743000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c06cc40 con 0x7f373c1434c0 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.829+0000 7f3743000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c0b4060 con 0x7f373c0b3bd0 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.829+0000 7f3743000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0ce770 con 0x7f373c06c800 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f373c0b3bd0 0x7f373c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f373c0b3bd0 0x7f373c06e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33674/0 (socket says 172.21.15.192:33674) 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 -- 172.21.15.192:0/2772782722 learned_addr learned my addr 172.21.15.192:0/2772782722 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3733400640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 -- 172.21.15.192:0/2772782722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 msgr2=0x7f373c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 -- 172.21.15.192:0/2772782722 >> v1:172.21.15.194:6789/0 conn(0x7f373c1434c0 legacy=0x7f373c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.830+0000 7f3741000640 1 -- 172.21.15.192:0/2772782722 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c06b480 con 0x7f373c0b3bd0 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.831+0000 7f3741000640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c0b3bd0 0x7f373c06e920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3734009e80 tx=0x7f373402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e86411fe647b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.831+0000 7f373b400640 1 -- 172.21.15.192:0/2772782722 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734031600 con 0x7f373c0b3bd0 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.831+0000 7f373b400640 1 -- 172.21.15.192:0/2772782722 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373402d050 con 0x7f373c0b3bd0 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f373b400640 1 -- 172.21.15.192:0/2772782722 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734031980 con 0x7f373c0b3bd0 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 -- 172.21.15.192:0/2772782722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c0b3bd0 msgr2=0x7f373c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c0b3bd0 0x7f373c06e920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3734009e80 tx=0x7f373402a750 comp rx=0 tx=0).stop 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 -- 172.21.15.192:0/2772782722 shutdown_connections 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c0b3bd0 0x7f373c06e920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 --2- 172.21.15.192:0/2772782722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 -- 172.21.15.192:0/2772782722 >> 172.21.15.192:0/2772782722 conn(0x7f373c0b08f0 msgr2=0x7f373c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:18.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 -- 172.21.15.192:0/2772782722 shutdown_connections 2024-09-13T18:36:18.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.832+0000 7f3743000640 1 -- 172.21.15.192:0/2772782722 wait complete. 2024-09-13T18:36:18.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.834+0000 7f3743000640 1 Processor -- start 2024-09-13T18:36:18.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.834+0000 7f3743000640 1 -- start start 2024-09-13T18:36:18.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f373c0b3bd0 0x7f373c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c153460 con 0x7f373c1434c0 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c152280 con 0x7f373c0b3bd0 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3743000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c1511e0 con 0x7f373c06c800 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3741000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f373be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3733400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f373c0b3bd0 0x7f373c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3741000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33686/0 (socket says 172.21.15.192:33686) 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.835+0000 7f3741000640 1 -- 172.21.15.192:0/1073740352 learned_addr learned my addr 172.21.15.192:0/1073740352 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 -- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f373c0b3bd0 msgr2=0x7f373c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f373c0b3bd0 0x7f373c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 -- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 msgr2=0x7f373c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 -- 172.21.15.192:0/1073740352 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3734009b30 con 0x7f373c06c800 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3741000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:18.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f373be00640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c152f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c3c0 tx=0x7f372c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c0052d0 con 0x7f373c06c800 2024-09-13T18:36:18.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c005430 con 0x7f373c06c800 2024-09-13T18:36:18.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c003810 con 0x7f373c06c800 2024-09-13T18:36:18.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c1514c0 con 0x7f373c06c800 2024-09-13T18:36:18.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.836+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c151a80 con 0x7f373c06c800 2024-09-13T18:36:18.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.837+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f373c06c2e0 con 0x7f373c06c800 2024-09-13T18:36:18.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.839+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f372c003970 con 0x7f373c06c800 2024-09-13T18:36:18.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.839+0000 7f3738c00640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 0x7f371806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:18.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.840+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f372c088bc0 con 0x7f373c06c800 2024-09-13T18:36:18.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.840+0000 7f3733400640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 0x7f371806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:18.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.840+0000 7f3733400640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 0x7f371806d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f373c0cbfc0 tx=0x7f3724009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:18.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:18.843+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f372c053ec0 con 0x7f373c06c800 2024-09-13T18:36:19.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.012+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f373c0b0360 con 0x7f373c06c800 2024-09-13T18:36:19.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.013+0000 7f3738c00640 1 -- 172.21.15.192:0/1073740352 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f372c0574e0 con 0x7f373c06c800 2024-09-13T18:36:19.015 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:19.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 msgr2=0x7f371806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 0x7f371806d0c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f373c0cbfc0 tx=0x7f3724009190 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 msgr2=0x7f373c152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c152f20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f372c00c3c0 tx=0x7f372c00c880 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 shutdown_connections 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f371806ac00 0x7f371806d0c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f373c1434c0 0x7f373c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f373c0b3bd0 0x7f373c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 --2- 172.21.15.192:0/1073740352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f373c06c800 0x7f373c152f20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 >> 172.21.15.192:0/1073740352 conn(0x7f373c0b08f0 msgr2=0x7f373c0b2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 shutdown_connections 2024-09-13T18:36:19.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.015+0000 7f3743000640 1 -- 172.21.15.192:0/1073740352 wait complete. 2024-09-13T18:36:19.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-13T18:36:19.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.188+0000 7f4692000640 1 Processor -- start 2024-09-13T18:36:19.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.188+0000 7f4692000640 1 -- start start 2024-09-13T18:36:19.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4692000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f468c0b3480 0x7f468c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4692000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f468c06bc30 0x7f468c15a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4692000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c15af60 con 0x7f468c159b00 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4692000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c06b7a0 con 0x7f468c06bc30 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4692000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c15ac80 con 0x7f468c0b3480 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f468c06bc30 0x7f468c15a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f468c06bc30 0x7f468c15a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33690/0 (socket says 172.21.15.192:33690) 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 -- 172.21.15.192:0/243092188 learned_addr learned my addr 172.21.15.192:0/243092188 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4690c00640 1 --1- 172.21.15.192:0/243092188 >> v1:172.21.15.192:6789/0 conn(0x7f468c159b00 0x7f468c0b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46522/0 (socket says 172.21.15.192:46522) 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f468be00640 1 --2- 172.21.15.192:0/243092188 >> v2:172.21.15.194:3300/0 conn(0x7f468c0b3480 0x7f468c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 -- 172.21.15.192:0/243092188 >> v2:172.21.15.194:3300/0 conn(0x7f468c0b3480 msgr2=0x7f468c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 --2- 172.21.15.192:0/243092188 >> v2:172.21.15.194:3300/0 conn(0x7f468c0b3480 0x7f468c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 -- 172.21.15.192:0/243092188 >> v1:172.21.15.192:6789/0 conn(0x7f468c159b00 legacy=0x7f468c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f4691600640 1 -- 172.21.15.192:0/243092188 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c06b150 con 0x7f468c06bc30 2024-09-13T18:36:19.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.190+0000 7f468b400640 1 -- 172.21.15.192:0/243092188 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1422174411 0 0) 0x7f468c15af60 con 0x7f468c159b00 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.191+0000 7f4691600640 1 --2- 172.21.15.192:0/243092188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c06bc30 0x7f468c15a420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f468c06c830 tx=0x7f468402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151e9be5c4a019cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f468b400640 1 -- 172.21.15.192:0/243092188 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468400b2d0 con 0x7f468c06bc30 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f468b400640 1 -- 172.21.15.192:0/243092188 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468402f070 con 0x7f468c06bc30 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f468b400640 1 -- 172.21.15.192:0/243092188 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4684009820 con 0x7f468c06bc30 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 -- 172.21.15.192:0/243092188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c06bc30 msgr2=0x7f468c15a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 --2- 172.21.15.192:0/243092188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c06bc30 0x7f468c15a420 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f468c06c830 tx=0x7f468402c8b0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 -- 172.21.15.192:0/243092188 shutdown_connections 2024-09-13T18:36:19.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 --2- 172.21.15.192:0/243092188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c06bc30 0x7f468c15a420 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 --2- 172.21.15.192:0/243092188 >> v2:172.21.15.194:3300/0 conn(0x7f468c0b3480 0x7f468c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 -- 172.21.15.192:0/243092188 >> 172.21.15.192:0/243092188 conn(0x7f468c0736d0 msgr2=0x7f468c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 -- 172.21.15.192:0/243092188 shutdown_connections 2024-09-13T18:36:19.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.192+0000 7f4692000640 1 -- 172.21.15.192:0/243092188 wait complete. 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.194+0000 7f4692000640 1 Processor -- start 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.194+0000 7f4692000640 1 -- start start 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 0x7f468c148400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f468c159b00 0x7f468c157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15bf50 con 0x7f468c0b3480 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15b340 con 0x7f468c06bc30 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f4692000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c15b620 con 0x7f468c159b00 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f468be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f468be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33706/0 (socket says 172.21.15.192:33706) 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.195+0000 7f468be00640 1 -- 172.21.15.192:0/1660871346 learned_addr learned my addr 172.21.15.192:0/1660871346 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f4690c00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 0x7f468c148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f4691600640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f468c159b00 0x7f468c157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 -- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f468c159b00 msgr2=0x7f468c157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f468c159b00 0x7f468c157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 -- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 msgr2=0x7f468c148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 0x7f468c148400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 -- 172.21.15.192:0/1660871346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468400bd40 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f4690c00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 0x7f468c148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.196+0000 7f468be00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f467800e9b0 tx=0x7f467800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.197+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4678009670 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.197+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467800c9a0 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.197+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c15b900 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.197+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467800cd50 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.197+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c154e20 con 0x7f468c0b3480 2024-09-13T18:36:19.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.198+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c0b2d70 con 0x7f468c0b3480 2024-09-13T18:36:19.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.199+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4678013470 con 0x7f468c0b3480 2024-09-13T18:36:19.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.200+0000 7f4688c00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 0x7f466c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:19.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.200+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4678089660 con 0x7f468c0b3480 2024-09-13T18:36:19.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.200+0000 7f4690c00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 0x7f466c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:19.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.201+0000 7f4690c00640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 0x7f466c06d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4680007fd0 tx=0x7f4680007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:19.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.204+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f46780547c0 con 0x7f468c0b3480 2024-09-13T18:36:19.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.445+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f468c0b3c70 con 0x7f468c0b3480 2024-09-13T18:36:19.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.897+0000 7f4688c00640 1 -- 172.21.15.192:0/1660871346 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v52) v1 ==== 133+0+0 (secure 0 0 0) 0x7f4678057de0 con 0x7f468c0b3480 2024-09-13T18:36:19.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 msgr2=0x7f466c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 0x7f466c06d0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4680007fd0 tx=0x7f4680007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 msgr2=0x7f468c06f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:19.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f467800e9b0 tx=0x7f467800ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 shutdown_connections 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f466c06ac00 0x7f466c06d0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f468c159b00 0x7f468c157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f468c0b3480 0x7f468c06f580 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 --2- 172.21.15.192:0/1660871346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f468c06bc30 0x7f468c148400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 >> 172.21.15.192:0/1660871346 conn(0x7f468c0736d0 msgr2=0x7f468c156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 shutdown_connections 2024-09-13T18:36:19.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:19.900+0000 7f4692000640 1 -- 172.21.15.192:0/1660871346 wait complete. 2024-09-13T18:36:19.918 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-13T18:36:20.089 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_objectstore":"memstore"} 2024-09-13T18:36:20.089 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-13T18:36:20.089 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:36:20.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.247+0000 7f0d77e00640 1 Processor -- start 2024-09-13T18:36:20.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.247+0000 7f0d77e00640 1 -- start start 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.248+0000 7f0d77e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0d781604b0 0x7f0d780b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0d780cf990 0x7f0d780cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780b75c0 con 0x7f0d78160890 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780d0380 con 0x7f0d780cf990 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780b69b0 con 0x7f0d781604b0 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0d780cf990 0x7f0d780cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d76000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0d78160890 0x7f0d780d2030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46524/0 (socket says 172.21.15.192:46524) 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d76000640 1 -- 172.21.15.192:0/2800984071 learned_addr learned my addr 172.21.15.192:0/2800984071 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0d780cf990 0x7f0d780cfe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33710/0 (socket says 172.21.15.192:33710) 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d76a00640 1 --2- 172.21.15.192:0/2800984071 >> v2:172.21.15.194:3300/0 conn(0x7f0d781604b0 0x7f0d780b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 -- 172.21.15.192:0/2800984071 >> v2:172.21.15.194:3300/0 conn(0x7f0d781604b0 msgr2=0x7f0d780b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 --2- 172.21.15.192:0/2800984071 >> v2:172.21.15.194:3300/0 conn(0x7f0d781604b0 0x7f0d780b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 -- 172.21.15.192:0/2800984071 >> v1:172.21.15.192:6789/0 conn(0x7f0d78160890 legacy=0x7f0d780d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d77400640 1 -- 172.21.15.192:0/2800984071 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d780b6c90 con 0x7f0d780cf990 2024-09-13T18:36:20.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.249+0000 7f0d75600640 1 -- 172.21.15.192:0/2800984071 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2026166234 0 0) 0x7f0d780b75c0 con 0x7f0d78160890 2024-09-13T18:36:20.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.250+0000 7f0d77400640 1 --2- 172.21.15.192:0/2800984071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d780cf990 0x7f0d780cfe40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d780cd480 tx=0x7f0d7002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221965f0da822f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d75600640 1 -- 172.21.15.192:0/2800984071 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7002aea0 con 0x7f0d780cf990 2024-09-13T18:36:20.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d75600640 1 -- 172.21.15.192:0/2800984071 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7002d050 con 0x7f0d780cf990 2024-09-13T18:36:20.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d75600640 1 -- 172.21.15.192:0/2800984071 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70007960 con 0x7f0d780cf990 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 -- 172.21.15.192:0/2800984071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d780cf990 msgr2=0x7f0d780cfe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2800984071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d780cf990 0x7f0d780cfe40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0d780cd480 tx=0x7f0d7002a680 comp rx=0 tx=0).stop 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 -- 172.21.15.192:0/2800984071 shutdown_connections 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2800984071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d780cf990 0x7f0d780cfe40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2800984071 >> v2:172.21.15.194:3300/0 conn(0x7f0d781604b0 0x7f0d780b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.251+0000 7f0d77e00640 1 -- 172.21.15.192:0/2800984071 >> 172.21.15.192:0/2800984071 conn(0x7f0d780b4bb0 msgr2=0x7f0d780b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.252+0000 7f0d77e00640 1 -- 172.21.15.192:0/2800984071 shutdown_connections 2024-09-13T18:36:20.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.252+0000 7f0d77e00640 1 -- 172.21.15.192:0/2800984071 wait complete. 2024-09-13T18:36:20.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.253+0000 7f0d77e00640 1 Processor -- start 2024-09-13T18:36:20.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.253+0000 7f0d77e00640 1 -- start start 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d780cf990 0x7f0d780cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d781604b0 0x7f0d78153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780ccf00 con 0x7f0d78156630 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780c77f0 con 0x7f0d781604b0 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.254+0000 7f0d77e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d781f5c20 con 0x7f0d780cf990 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33714/0 (socket says 172.21.15.192:33714) 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 -- 172.21.15.192:0/2500304182 learned_addr learned my addr 172.21.15.192:0/2500304182 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:20.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d76000640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d781604b0 0x7f0d78153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d76a00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d780cf990 0x7f0d780cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 -- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d780cf990 msgr2=0x7f0d780cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d780cf990 0x7f0d780cc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 -- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d781604b0 msgr2=0x7f0d78153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d781604b0 0x7f0d78153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 -- 172.21.15.192:0/2500304182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009a70 con 0x7f0d78156630 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.255+0000 7f0d77400640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d7002ac70 tx=0x7f0d70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.256+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7003c830 con 0x7f0d78156630 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.256+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7003c990 con 0x7f0d78156630 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.256+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7003cd20 con 0x7f0d78156630 2024-09-13T18:36:20.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.256+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d78156b30 con 0x7f0d78156630 2024-09-13T18:36:20.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.256+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780c7a40 con 0x7f0d78156630 2024-09-13T18:36:20.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.257+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d78067450 con 0x7f0d78156630 2024-09-13T18:36:20.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.258+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0d70031400 con 0x7f0d78156630 2024-09-13T18:36:20.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.258+0000 7f0d6f400640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 0x7f0d5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:20.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.259+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d700aad90 con 0x7f0d78156630 2024-09-13T18:36:20.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.259+0000 7f0d76a00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 0x7f0d5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:20.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.260+0000 7f0d76a00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 0x7f0d5806d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009b40 tx=0x7f0d68009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:20.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.263+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0d70075f90 con 0x7f0d78156630 2024-09-13T18:36:20.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.437+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0d780cfe40 con 0x7f0d78156630 2024-09-13T18:36:20.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.442+0000 7f0d6f400640 1 -- 172.21.15.192:0/2500304182 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0d70009450 con 0x7f0d78156630 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 msgr2=0x7f0d5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 0x7f0d5806d0c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009b40 tx=0x7f0d68009190 comp rx=0 tx=0).stop 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 msgr2=0x7f0d78149040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0d7002ac70 tx=0x7f0d70004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 shutdown_connections 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0d5806ac00 0x7f0d5806d0c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0d78156630 0x7f0d78149040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0d781604b0 0x7f0d78153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 --2- 172.21.15.192:0/2500304182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0d780cf990 0x7f0d780cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:20.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 >> 172.21.15.192:0/2500304182 conn(0x7f0d780b4bb0 msgr2=0x7f0d7806ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:20.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 shutdown_connections 2024-09-13T18:36:20.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:20.444+0000 7f0d77e00640 1 -- 172.21.15.192:0/2500304182 wait complete. 2024-09-13T18:36:20.462 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:36:20.462 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:20.540 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:36:20.647 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:36:20.647 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:20.647 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:20.683 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:20.683 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:20.757 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:20.758 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:20.833 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:21.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.025+0000 7f3dc1000640 1 Processor -- start 2024-09-13T18:36:21.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.025+0000 7f3dc1000640 1 -- start start 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3dc1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 0x7f3dbc167ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3dc1000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc0ce610 con 0x7f3dbc0cd5e0 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3dc1000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dbc06b260 con 0x7f3dbc15d230 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3dc1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc15d610 con 0x7f3dbc06acc0 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3db3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3dbc0cd5e0 0x7f3dbc06a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56616/0 (socket says 172.21.15.192:56616) 2024-09-13T18:36:21.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3db3e00640 1 -- 172.21.15.192:0/111353004 learned_addr learned my addr 172.21.15.192:0/111353004 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:21.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.026+0000 7f3dbbe00640 1 --2- 172.21.15.192:0/111353004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 0x7f3dbc167ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277428352 0 0) 0x7f3dbc0ce610 con 0x7f3dbc0cd5e0 2024-09-13T18:36:21.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da0003520 con 0x7f3dbc0cd5e0 2024-09-13T18:36:21.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1295773301 0 0) 0x7f3dbc06b260 con 0x7f3dbc15d230 2024-09-13T18:36:21.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dbc0ce610 con 0x7f3dbc15d230 2024-09-13T18:36:21.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbbe00640 1 -- 172.21.15.192:0/111353004 >> v1:172.21.15.194:6789/0 conn(0x7f3dbc15d230 legacy=0x7f3dbc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3991432549 0 0) 0x7f3da0003520 con 0x7f3dbc0cd5e0 2024-09-13T18:36:21.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbbe00640 1 -- 172.21.15.192:0/111353004 >> v1:172.21.15.192:6789/0 conn(0x7f3dbc0cd5e0 legacy=0x7f3dbc06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.027+0000 7f3dbbe00640 1 -- 172.21.15.192:0/111353004 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dbc06b520 con 0x7f3dbc06acc0 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.028+0000 7f3dbbe00640 1 --2- 172.21.15.192:0/111353004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 0x7f3dbc167ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009dc0 tx=0x7f3db402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb56ac0ba11afee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.028+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4001670 con 0x7f3dbc06acc0 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.028+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db402d050 con 0x7f3dbc06acc0 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.028+0000 7f3dbaa00640 1 -- 172.21.15.192:0/111353004 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db4007740 con 0x7f3dbc06acc0 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 -- 172.21.15.192:0/111353004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 msgr2=0x7f3dbc167ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 --2- 172.21.15.192:0/111353004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 0x7f3dbc167ca0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009dc0 tx=0x7f3db402a660 comp rx=0 tx=0).stop 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 -- 172.21.15.192:0/111353004 shutdown_connections 2024-09-13T18:36:21.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 --2- 172.21.15.192:0/111353004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc06acc0 0x7f3dbc167ca0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 -- 172.21.15.192:0/111353004 >> 172.21.15.192:0/111353004 conn(0x7f3dbc0cf800 msgr2=0x7f3dbc0cfc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 -- 172.21.15.192:0/111353004 shutdown_connections 2024-09-13T18:36:21.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.029+0000 7f3dc1000640 1 -- 172.21.15.192:0/111353004 wait complete. 2024-09-13T18:36:21.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.031+0000 7f3dc1000640 1 Processor -- start 2024-09-13T18:36:21.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.031+0000 7f3dc1000640 1 -- start start 2024-09-13T18:36:21.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.031+0000 7f3dc1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dbc06acc0 0x7f3dbc154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.031+0000 7f3dc1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 0x7f3dbc1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dc1000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dc1000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1564b0 con 0x7f3dbc15d230 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dc1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc155ef0 con 0x7f3dbc06acc0 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dc1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dbc1561d0 con 0x7f3dbc0cd5e0 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57846/0 (socket says 172.21.15.192:57846) 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 -- 172.21.15.192:0/1426695633 learned_addr learned my addr 172.21.15.192:0/1426695633 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbb400640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dbc06acc0 0x7f3dbc154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3db3e00640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 0x7f3dbc1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 -- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 msgr2=0x7f3dbc1556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 0x7f3dbc1556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 -- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dbc06acc0 msgr2=0x7f3dbc154330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dbc06acc0 0x7f3dbc154330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3dbbe00640 1 -- 172.21.15.192:0/1426695633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4009a70 con 0x7f3dbc15d230 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.032+0000 7f3db3e00640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 0x7f3dbc1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3dbbe00640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009ee0 tx=0x7f3db4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db403b820 con 0x7f3dbc15d230 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db403b980 con 0x7f3dbc15d230 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db403bd10 con 0x7f3dbc15d230 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dbc0c69c0 con 0x7f3dbc15d230 2024-09-13T18:36:21.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.033+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dbc154870 con 0x7f3dbc15d230 2024-09-13T18:36:21.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.034+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dbc0c6ee0 con 0x7f3dbc15d230 2024-09-13T18:36:21.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.035+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3db4031400 con 0x7f3dbc15d230 2024-09-13T18:36:21.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.036+0000 7f3db3400640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 0x7f3d9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.036+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3db40aa320 con 0x7f3dbc15d230 2024-09-13T18:36:21.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.036+0000 7f3dbb400640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 0x7f3d9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.037+0000 7f3dbb400640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 0x7f3d9806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0011e0 tx=0x7f3dac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.041+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3dbc0c6ee0 con 0x7f3dbc15d230 2024-09-13T18:36:21.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.210+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dbc0c6ee0 con 0x7f3dbc15d230 2024-09-13T18:36:21.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.211+0000 7f3db3400640 1 -- 172.21.15.192:0/1426695633 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f3dbc0c6ee0 con 0x7f3dbc15d230 2024-09-13T18:36:21.213 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:21.214 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:21.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 msgr2=0x7f3d9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 0x7f3d9806d0c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0011e0 tx=0x7f3dac009040 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 msgr2=0x7f3dbc157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009ee0 tx=0x7f3db4004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 shutdown_connections 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d9806ac00 0x7f3d9806d0c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dbc15d230 0x7f3dbc157280 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dbc0cd5e0 0x7f3dbc1556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.213+0000 7f3dc1000640 1 --2- 172.21.15.192:0/1426695633 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dbc06acc0 0x7f3dbc154330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.214+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 >> 172.21.15.192:0/1426695633 conn(0x7f3dbc0cf800 msgr2=0x7f3dbc0d1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.214+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 shutdown_connections 2024-09-13T18:36:21.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.214+0000 7f3dc1000640 1 -- 172.21.15.192:0/1426695633 wait complete. 2024-09-13T18:36:21.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:21.232 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.384+0000 7f206de00640 1 Processor -- start 2024-09-13T18:36:21.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.384+0000 7f206de00640 1 -- start start 2024-09-13T18:36:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.385+0000 7f206de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f20680cd670 0x7f20680b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.385+0000 7f206de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f20680b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.385+0000 7f206de00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20680b2e30 con 0x7f20680b47a0 2024-09-13T18:36:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.385+0000 7f206de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2068159940 con 0x7f20680cd670 2024-09-13T18:36:21.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.385+0000 7f206de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2068159b40 con 0x7f20680719a0 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f20680b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f20680cd670 0x7f20680b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f20680b4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:38126/0 (socket says 172.21.15.192:38126) 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f20680cd670 0x7f20680b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:50144/0 (socket says 172.21.15.192:50144) 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066000640 1 -- 172.21.15.192:0/3610614342 learned_addr learned my addr 172.21.15.192:0/3610614342 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 -- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 msgr2=0x7f20680b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 --2- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f20680b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 -- 172.21.15.192:0/3610614342 >> v1:172.21.15.194:6789/0 conn(0x7f20680b47a0 legacy=0x7f206815cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.386+0000 7f2066a00640 1 -- 172.21.15.192:0/3610614342 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068159e20 con 0x7f20680cd670 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.387+0000 7f2066a00640 1 --2- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f20680b2600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20580097a0 tx=0x7f205802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f069083c3d96de14 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f2065600640 1 -- 172.21.15.192:0/3610614342 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058032440 con 0x7f20680cd670 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f2065600640 1 -- 172.21.15.192:0/3610614342 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580325a0 con 0x7f20680cd670 2024-09-13T18:36:21.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f2065600640 1 -- 172.21.15.192:0/3610614342 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2058032930 con 0x7f20680cd670 2024-09-13T18:36:21.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 -- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 msgr2=0x7f20680b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 --2- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f20680b2600 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f20580097a0 tx=0x7f205802a180 comp rx=0 tx=0).stop 2024-09-13T18:36:21.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 -- 172.21.15.192:0/3610614342 shutdown_connections 2024-09-13T18:36:21.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 --2- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f20680b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 --2- 172.21.15.192:0/3610614342 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f20680b2600 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 -- 172.21.15.192:0/3610614342 >> 172.21.15.192:0/3610614342 conn(0x7f20680cebc0 msgr2=0x7f20680cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 -- 172.21.15.192:0/3610614342 shutdown_connections 2024-09-13T18:36:21.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.388+0000 7f206de00640 1 -- 172.21.15.192:0/3610614342 wait complete. 2024-09-13T18:36:21.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.390+0000 7f206de00640 1 Processor -- start 2024-09-13T18:36:21.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.390+0000 7f206de00640 1 -- start start 2024-09-13T18:36:21.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f206814e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f206806fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f206814e580 con 0x7f20680b47a0 2024-09-13T18:36:21.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2068158fd0 con 0x7f20680cd670 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f206de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f206806e820 con 0x7f20680719a0 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f2066000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f2066000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57850/0 (socket says 172.21.15.192:57850) 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.391+0000 7f2066000640 1 -- 172.21.15.192:0/304199707 learned_addr learned my addr 172.21.15.192:0/304199707 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066a00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f206814e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2067400640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f206806fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 -- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 msgr2=0x7f206814e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f206814e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 -- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 msgr2=0x7f206806fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f206806fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 -- 172.21.15.192:0/304199707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009400 con 0x7f20680b47a0 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f2066000640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f205400e840 tx=0x7f205400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.392+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400c8e0 con 0x7f20680b47a0 2024-09-13T18:36:21.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.393+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f205400ca40 con 0x7f20680b47a0 2024-09-13T18:36:21.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.393+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f206806eb00 con 0x7f20680b47a0 2024-09-13T18:36:21.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.393+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205400cdf0 con 0x7f20680b47a0 2024-09-13T18:36:21.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.393+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206806f0c0 con 0x7f20680b47a0 2024-09-13T18:36:21.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.394+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20680cda50 con 0x7f20680b47a0 2024-09-13T18:36:21.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.395+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2054013470 con 0x7f20680b47a0 2024-09-13T18:36:21.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.395+0000 7f205f400640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 0x7f204806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.396+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2054089430 con 0x7f20680b47a0 2024-09-13T18:36:21.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.396+0000 7f2066a00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 0x7f204806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.396+0000 7f2066a00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 0x7f204806d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2058034000 tx=0x7f205802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.399+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2054054620 con 0x7f20680b47a0 2024-09-13T18:36:21.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.569+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2068150890 con 0x7f20680b47a0 2024-09-13T18:36:21.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.569+0000 7f205f400640 1 -- 172.21.15.192:0/304199707 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2054057c40 con 0x7f20680b47a0 2024-09-13T18:36:21.572 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:21.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 msgr2=0x7f204806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 0x7f204806d0c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2058034000 tx=0x7f205802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 msgr2=0x7f2068158510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f205400e840 tx=0x7f205400ed00 comp rx=0 tx=0).stop 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 shutdown_connections 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f204806ac00 0x7f204806d0c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20680cd670 0x7f206806fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20680b47a0 0x7f2068158510 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 --2- 172.21.15.192:0/304199707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20680719a0 0x7f206814e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 >> 172.21.15.192:0/304199707 conn(0x7f20680cebc0 msgr2=0x7f206806a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 shutdown_connections 2024-09-13T18:36:21.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.572+0000 7f206de00640 1 -- 172.21.15.192:0/304199707 wait complete. 2024-09-13T18:36:21.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:21.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.741+0000 7f1772c00640 1 Processor -- start 2024-09-13T18:36:21.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.741+0000 7f1772c00640 1 -- start start 2024-09-13T18:36:21.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.742+0000 7f1772c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c1542c0 0x7f176c15abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.742+0000 7f1772c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f176c0b3f70 0x7f176c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.742+0000 7f1772c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c070e50 con 0x7f176c0702e0 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.742+0000 7f1772c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c15b1a0 con 0x7f176c0b3f70 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.742+0000 7f1772c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1546a0 con 0x7f176c1542c0 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f176c0b3f70 0x7f176c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f176c0b3f70 0x7f176c071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57862/0 (socket says 172.21.15.192:57862) 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 -- 172.21.15.192:0/4026073819 learned_addr learned my addr 172.21.15.192:0/4026073819 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1763400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f176c0702e0 0x7f176c0b3860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56632/0 (socket says 172.21.15.192:56632) 2024-09-13T18:36:21.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f176be00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c1542c0 0x7f176c15abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 -- 172.21.15.192:0/4026073819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c1542c0 msgr2=0x7f176c15abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c1542c0 0x7f176c15abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 -- 172.21.15.192:0/4026073819 >> v1:172.21.15.192:6789/0 conn(0x7f176c0702e0 legacy=0x7f176c0b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f1770c00640 1 -- 172.21.15.192:0/4026073819 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c071130 con 0x7f176c0b3f70 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.743+0000 7f176b400640 1 -- 172.21.15.192:0/4026073819 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721809679 0 0) 0x7f176c070e50 con 0x7f176c0702e0 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.744+0000 7f1770c00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c0b3f70 0x7f176c071c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1074b73afb807a96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.744+0000 7f176b400640 1 -- 172.21.15.192:0/4026073819 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764031600 con 0x7f176c0b3f70 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.744+0000 7f176b400640 1 -- 172.21.15.192:0/4026073819 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176402d050 con 0x7f176c0b3f70 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.744+0000 7f176b400640 1 -- 172.21.15.192:0/4026073819 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764031980 con 0x7f176c0b3f70 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 -- 172.21.15.192:0/4026073819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c0b3f70 msgr2=0x7f176c071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c0b3f70 0x7f176c071c10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176402a710 comp rx=0 tx=0).stop 2024-09-13T18:36:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 -- 172.21.15.192:0/4026073819 shutdown_connections 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c0b3f70 0x7f176c071c10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 --2- 172.21.15.192:0/4026073819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c1542c0 0x7f176c15abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 -- 172.21.15.192:0/4026073819 >> 172.21.15.192:0/4026073819 conn(0x7f176c069ea0 msgr2=0x7f176c06a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 -- 172.21.15.192:0/4026073819 shutdown_connections 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.745+0000 7f1772c00640 1 -- 172.21.15.192:0/4026073819 wait complete. 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.747+0000 7f1772c00640 1 Processor -- start 2024-09-13T18:36:21.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.747+0000 7f1772c00640 1 -- start start 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 0x7f176c14fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c0b3f70 0x7f176c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1f3380 con 0x7f176c1542c0 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c14cd60 con 0x7f176c0702e0 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1772c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c06b570 con 0x7f176c0b3f70 2024-09-13T18:36:21.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57864/0 (socket says 172.21.15.192:57864) 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 -- 172.21.15.192:0/1974969685 learned_addr learned my addr 172.21.15.192:0/1974969685 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1763400640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c0b3f70 0x7f176c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f176be00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 0x7f176c14fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 -- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c0b3f70 msgr2=0x7f176c1f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c0b3f70 0x7f176c1f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 -- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 msgr2=0x7f176c14fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.748+0000 7f1770c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 0x7f176c14fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1770c00640 1 -- 172.21.15.192:0/1974969685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764009b30 con 0x7f176c1542c0 2024-09-13T18:36:21.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f176be00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 0x7f176c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:21.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1770c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f1764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764003b90 con 0x7f176c1542c0 2024-09-13T18:36:21.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1764003cf0 con 0x7f176c1542c0 2024-09-13T18:36:21.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764003ea0 con 0x7f176c1542c0 2024-09-13T18:36:21.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c1effc0 con 0x7f176c1542c0 2024-09-13T18:36:21.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.749+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c1f38c0 con 0x7f176c1542c0 2024-09-13T18:36:21.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.750+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c071c10 con 0x7f176c1542c0 2024-09-13T18:36:21.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.751+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1764038050 con 0x7f176c1542c0 2024-09-13T18:36:21.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.752+0000 7f1768c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 0x7f174806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:21.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.752+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17640a99e0 con 0x7f176c1542c0 2024-09-13T18:36:21.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.752+0000 7f176be00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 0x7f174806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:21.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.753+0000 7f176be00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 0x7f174806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f175c009af0 tx=0x7f175c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:21.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.756+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1764074b20 con 0x7f176c1542c0 2024-09-13T18:36:21.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.927+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f176c073c50 con 0x7f176c1542c0 2024-09-13T18:36:21.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.928+0000 7f1768c00640 1 -- 172.21.15.192:0/1974969685 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1764009510 con 0x7f176c1542c0 2024-09-13T18:36:21.930 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:21.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 msgr2=0x7f174806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 0x7f174806d0c0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f175c009af0 tx=0x7f175c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:21.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 msgr2=0x7f176c14c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:21.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f1764004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:21.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 shutdown_connections 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174806ac00 0x7f174806d0c0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1542c0 0x7f176c14c820 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c0b3f70 0x7f176c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 --2- 172.21.15.192:0/1974969685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0702e0 0x7f176c14fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 >> 172.21.15.192:0/1974969685 conn(0x7f176c069ea0 msgr2=0x7f176c0730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 shutdown_connections 2024-09-13T18:36:21.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:21.930+0000 7f1772c00640 1 -- 172.21.15.192:0/1974969685 wait complete. 2024-09-13T18:36:21.948 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:22.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.101+0000 7f00f1800640 1 Processor -- start 2024-09-13T18:36:22.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.101+0000 7f00f1800640 1 -- start start 2024-09-13T18:36:22.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00f1800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f00ec1434c0 0x7f00ec06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00f1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00f1800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00ec06b480 con 0x7f00ec06a8b0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00f1800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00ec0ce770 con 0x7f00ec1434c0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00f1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec06b760 con 0x7f00ec0b3da0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00eaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f00ec1434c0 0x7f00ec06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00eaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f00ec1434c0 0x7f00ec06c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57866/0 (socket says 172.21.15.192:57866) 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.102+0000 7f00eaa00640 1 -- 172.21.15.192:0/1265286627 learned_addr learned my addr 172.21.15.192:0/1265286627 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.103+0000 7f00eb400640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.103+0000 7f00eaa00640 1 -- 172.21.15.192:0/1265286627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 msgr2=0x7f00ec06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.103+0000 7f00eaa00640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.103+0000 7f00eaa00640 1 -- 172.21.15.192:0/1265286627 >> v1:172.21.15.194:6789/0 conn(0x7f00ec06a8b0 legacy=0x7f00ec0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.103+0000 7f00eaa00640 1 -- 172.21.15.192:0/1265286627 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec06ba40 con 0x7f00ec1434c0 2024-09-13T18:36:22.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.104+0000 7f00eaa00640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec1434c0 0x7f00ec06c800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00bb10 tx=0x7f00dc02c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8a04c68c59c169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.104+0000 7f00e9600640 1 -- 172.21.15.192:0/1265286627 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0326f0 con 0x7f00ec1434c0 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.104+0000 7f00e9600640 1 -- 172.21.15.192:0/1265286627 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc032850 con 0x7f00ec1434c0 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.104+0000 7f00e9600640 1 -- 172.21.15.192:0/1265286627 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc032be0 con 0x7f00ec1434c0 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 -- 172.21.15.192:0/1265286627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec1434c0 msgr2=0x7f00ec06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec1434c0 0x7f00ec06c800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00bb10 tx=0x7f00dc02c830 comp rx=0 tx=0).stop 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 -- 172.21.15.192:0/1265286627 shutdown_connections 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 --2- 172.21.15.192:0/1265286627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec1434c0 0x7f00ec06c800 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 -- 172.21.15.192:0/1265286627 >> 172.21.15.192:0/1265286627 conn(0x7f00ec0b08f0 msgr2=0x7f00ec0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 -- 172.21.15.192:0/1265286627 shutdown_connections 2024-09-13T18:36:22.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.105+0000 7f00f1800640 1 -- 172.21.15.192:0/1265286627 wait complete. 2024-09-13T18:36:22.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.106+0000 7f00f1800640 1 Processor -- start 2024-09-13T18:36:22.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.106+0000 7f00f1800640 1 -- start start 2024-09-13T18:36:22.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec138ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 0x7f00ec13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec159dd0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec139430 con 0x7f00ec1434c0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.107+0000 7f00f1800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ec158010 con 0x7f00ec0b3da0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57878/0 (socket says 172.21.15.192:57878) 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 -- 172.21.15.192:0/1996665647 learned_addr learned my addr 172.21.15.192:0/1996665647 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00ea000640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec138ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eb400640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 0x7f00ec13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 -- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 msgr2=0x7f00ec138ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec138ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 -- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 msgr2=0x7f00ec13f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 0x7f00ec13f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 -- 172.21.15.192:0/1996665647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc00b770 con 0x7f00ec06a8b0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00ea000640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eb400640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 0x7f00ec13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00eaa00640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f00dc02c870 tx=0x7f00dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc040680 con 0x7f00ec06a8b0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.108+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00dc0407e0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.109+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00ec1582f0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.109+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc040b90 con 0x7f00ec06a8b0 2024-09-13T18:36:22.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.109+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00ec1588b0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.110+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00ec06ad00 con 0x7f00ec06a8b0 2024-09-13T18:36:22.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.110+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f00dc040cf0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.111+0000 7f00e2a00640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 0x7f00cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.111+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00dc0aa5d0 con 0x7f00ec06a8b0 2024-09-13T18:36:22.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.111+0000 7f00ea000640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 0x7f00cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.112+0000 7f00ea000640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 0x7f00cc06d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00ec157f40 tx=0x7f00d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.116+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f00ec06ad00 con 0x7f00ec06a8b0 2024-09-13T18:36:22.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.281+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f00ec06ad00 con 0x7f00ec06a8b0 2024-09-13T18:36:22.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.282+0000 7f00e2a00640 1 -- 172.21.15.192:0/1996665647 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f00dc03a020 con 0x7f00ec06a8b0 2024-09-13T18:36:22.284 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 msgr2=0x7f00cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 0x7f00cc06d0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f00ec157f40 tx=0x7f00d8009040 comp rx=0 tx=0).stop 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 msgr2=0x7f00ec157a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f00dc02c870 tx=0x7f00dc004730 comp rx=0 tx=0).stop 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 shutdown_connections 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00cc06ac00 0x7f00cc06d0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00ec1434c0 0x7f00ec13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f00ec0b3da0 0x7f00ec138ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 --2- 172.21.15.192:0/1996665647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00ec06a8b0 0x7f00ec157a00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 >> 172.21.15.192:0/1996665647 conn(0x7f00ec0b08f0 msgr2=0x7f00ec070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 shutdown_connections 2024-09-13T18:36:22.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.284+0000 7f00f1800640 1 -- 172.21.15.192:0/1996665647 wait complete. 2024-09-13T18:36:22.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:22.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.452+0000 7fe844200640 1 Processor -- start 2024-09-13T18:36:22.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.452+0000 7fe844200640 1 -- start start 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe83c0b3f10 0x7fe83c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe83c15e2c0 0x7fe83c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0b2f00 con 0x7fe83c15e2c0 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe83c0b3150 con 0x7fe83c0b3f10 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe844200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0b3430 con 0x7fe83c15dee0 2024-09-13T18:36:22.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe83c15e2c0 0x7fe83c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe83c15e2c0 0x7fe83c15a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57888/0 (socket says 172.21.15.192:57888) 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 -- 172.21.15.192:0/4211210920 learned_addr learned my addr 172.21.15.192:0/4211210920 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe841800640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe840e00640 1 --2- 172.21.15.192:0/4211210920 >> v2:172.21.15.194:3300/0 conn(0x7fe83c0b3f10 0x7fe83c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 -- 172.21.15.192:0/4211210920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 msgr2=0x7fe83c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 -- 172.21.15.192:0/4211210920 >> v2:172.21.15.194:3300/0 conn(0x7fe83c0b3f10 msgr2=0x7fe83c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 --2- 172.21.15.192:0/4211210920 >> v2:172.21.15.194:3300/0 conn(0x7fe83c0b3f10 0x7fe83c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.454+0000 7fe842200640 1 -- 172.21.15.192:0/4211210920 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c0b3710 con 0x7fe83c15e2c0 2024-09-13T18:36:22.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.455+0000 7fe842200640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c15e2c0 0x7fe83c15a440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe83c06cee0 tx=0x7fe83402c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc01eee3d5d18e8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe83be00640 1 -- 172.21.15.192:0/4211210920 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83402f070 con 0x7fe83c15e2c0 2024-09-13T18:36:22.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe83be00640 1 -- 172.21.15.192:0/4211210920 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83400b2e0 con 0x7fe83c15e2c0 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe83be00640 1 -- 172.21.15.192:0/4211210920 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834009820 con 0x7fe83c15e2c0 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 -- 172.21.15.192:0/4211210920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c15e2c0 msgr2=0x7fe83c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c15e2c0 0x7fe83c15a440 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe83c06cee0 tx=0x7fe83402c8a0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 -- 172.21.15.192:0/4211210920 shutdown_connections 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c15e2c0 0x7fe83c15a440 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 --2- 172.21.15.192:0/4211210920 >> v2:172.21.15.194:3300/0 conn(0x7fe83c0b3f10 0x7fe83c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 --2- 172.21.15.192:0/4211210920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 -- 172.21.15.192:0/4211210920 >> 172.21.15.192:0/4211210920 conn(0x7fe83c0ae960 msgr2=0x7fe83c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 -- 172.21.15.192:0/4211210920 shutdown_connections 2024-09-13T18:36:22.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.456+0000 7fe844200640 1 -- 172.21.15.192:0/4211210920 wait complete. 2024-09-13T18:36:22.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.458+0000 7fe844200640 1 Processor -- start 2024-09-13T18:36:22.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.458+0000 7fe844200640 1 -- start start 2024-09-13T18:36:22.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c13fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe83c15e2c0 0x7fe83c13bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1543f0 con 0x7fe83c13adf0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1514c0 con 0x7fe83c15e2c0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe844200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c1517a0 con 0x7fe83c15dee0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe842200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.459+0000 7fe840e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe83c15e2c0 0x7fe83c13bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57894/0 (socket says 172.21.15.192:57894) 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 -- 172.21.15.192:0/4231784964 learned_addr learned my addr 172.21.15.192:0/4231784964 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe841800640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c13fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 -- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 msgr2=0x7fe83c13fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c13fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 -- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe83c15e2c0 msgr2=0x7fe83c13bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe83c15e2c0 0x7fe83c13bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 -- 172.21.15.192:0/4231784964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83400bd40 con 0x7fe83c13adf0 2024-09-13T18:36:22.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe842200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d240 tx=0x7fe834004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83400b720 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83400b450 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.460+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83403c880 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.461+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c153bf0 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.461+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c151190 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.462+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c067490 con 0x7fe83c13adf0 2024-09-13T18:36:22.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.463+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe83403c9e0 con 0x7fe83c13adf0 2024-09-13T18:36:22.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.463+0000 7fe839600640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 0x7fe81c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:22.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.463+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8340a9f30 con 0x7fe83c13adf0 2024-09-13T18:36:22.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.464+0000 7fe841800640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 0x7fe81c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:22.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.464+0000 7fe841800640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 0x7fe81c06d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe830009ac0 tx=0x7fe830009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:22.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.468+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8340751b0 con 0x7fe83c13adf0 2024-09-13T18:36:22.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.646+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe83c154110 con 0x7fe83c13adf0 2024-09-13T18:36:22.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.646+0000 7fe839600640 1 -- 172.21.15.192:0/4231784964 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe83c154110 con 0x7fe83c13adf0 2024-09-13T18:36:22.648 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:36:22.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 msgr2=0x7fe81c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 0x7fe81c06d0f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe830009ac0 tx=0x7fe830009190 comp rx=0 tx=0).stop 2024-09-13T18:36:22.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 msgr2=0x7fe83c13c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:22.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fe83400d240 tx=0x7fe834004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 shutdown_connections 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe81c06ac30 0x7fe81c06d0f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe83c13adf0 0x7fe83c13c020 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe83c15e2c0 0x7fe83c13bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 --2- 172.21.15.192:0/4231784964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe83c15dee0 0x7fe83c13fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.648+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 >> 172.21.15.192:0/4231784964 conn(0x7fe83c0ae960 msgr2=0x7fe83c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.649+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 shutdown_connections 2024-09-13T18:36:22.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:22.649+0000 7fe844200640 1 -- 172.21.15.192:0/4231784964 wait complete. 2024-09-13T18:36:22.666 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:36:22.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:22.666 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-13T18:36:22.727 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:36:22.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:22.727 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:36:22.777 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:22.777 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:22.820 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:22.821 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:22.898 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:22.898 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:22.976 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:23.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.127+0000 7fba1d000640 1 Processor -- start 2024-09-13T18:36:23.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.128+0000 7fba1d000640 1 -- start start 2024-09-13T18:36:23.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba181592d0 0x7fba18070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba180b3600 0x7fba180b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 0x7fba1806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180b3fb0 con 0x7fba180b3600 2024-09-13T18:36:23.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba1806f830 con 0x7fba181592d0 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba1d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba1806fa80 con 0x7fba1806bca0 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba16a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba180b3600 0x7fba180b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba16a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fba180b3600 0x7fba180b3a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57896/0 (socket says 172.21.15.192:57896) 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba16a00640 1 -- 172.21.15.192:0/128956159 learned_addr learned my addr 172.21.15.192:0/128956159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba17400640 1 --2- 172.21.15.192:0/128956159 >> v2:172.21.15.194:3300/0 conn(0x7fba181592d0 0x7fba18070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.129+0000 7fba17e00640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 0x7fba1806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba16a00640 1 -- 172.21.15.192:0/128956159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 msgr2=0x7fba1806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba16a00640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 0x7fba1806c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba16a00640 1 -- 172.21.15.192:0/128956159 >> v2:172.21.15.194:3300/0 conn(0x7fba181592d0 msgr2=0x7fba18070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba16a00640 1 --2- 172.21.15.192:0/128956159 >> v2:172.21.15.194:3300/0 conn(0x7fba181592d0 0x7fba18070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba16a00640 1 -- 172.21.15.192:0/128956159 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1806fd60 con 0x7fba180b3600 2024-09-13T18:36:23.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.130+0000 7fba17e00640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 0x7fba1806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:23.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba16a00640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba180b3600 0x7fba180b3a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba180b41c0 tx=0x7fba0402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ddff3f37c93e83f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba16000640 1 -- 172.21.15.192:0/128956159 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04032440 con 0x7fba180b3600 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba16000640 1 -- 172.21.15.192:0/128956159 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba040325a0 con 0x7fba180b3600 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba16000640 1 -- 172.21.15.192:0/128956159 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04032930 con 0x7fba180b3600 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba1d000640 1 -- 172.21.15.192:0/128956159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba180b3600 msgr2=0x7fba180b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.131+0000 7fba1d000640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba180b3600 0x7fba180b3a70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fba180b41c0 tx=0x7fba0402a210 comp rx=0 tx=0).stop 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 -- 172.21.15.192:0/128956159 shutdown_connections 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba1806bca0 0x7fba1806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 --2- 172.21.15.192:0/128956159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba180b3600 0x7fba180b3a70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 --2- 172.21.15.192:0/128956159 >> v2:172.21.15.194:3300/0 conn(0x7fba181592d0 0x7fba18070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 -- 172.21.15.192:0/128956159 >> 172.21.15.192:0/128956159 conn(0x7fba180736d0 msgr2=0x7fba180b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 -- 172.21.15.192:0/128956159 shutdown_connections 2024-09-13T18:36:23.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.132+0000 7fba1d000640 1 -- 172.21.15.192:0/128956159 wait complete. 2024-09-13T18:36:23.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.133+0000 7fba1d000640 1 Processor -- start 2024-09-13T18:36:23.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.133+0000 7fba1d000640 1 -- start start 2024-09-13T18:36:23.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba180b3600 0x7fba1813fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba181592d0 0x7fba18141530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181410a0 con 0x7fba1806bca0 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba181404d0 con 0x7fba180b3600 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba1d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba18140770 con 0x7fba181592d0 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba17400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba17400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57902/0 (socket says 172.21.15.192:57902) 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.134+0000 7fba17400640 1 -- 172.21.15.192:0/3203518239 learned_addr learned my addr 172.21.15.192:0/3203518239 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17e00640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba181592d0 0x7fba18141530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba16a00640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba180b3600 0x7fba1813fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 -- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba181592d0 msgr2=0x7fba18141530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba181592d0 0x7fba18141530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 -- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba180b3600 msgr2=0x7fba1813fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba180b3600 0x7fba1813fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 -- 172.21.15.192:0/3203518239 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba040094d0 con 0x7fba1806bca0 2024-09-13T18:36:23.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba17400640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba0800efc0 tx=0x7fba0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08009b80 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800f040 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba080146a0 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.135+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba18140a50 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.136+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18141fc0 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.137+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18142150 con 0x7fba1806bca0 2024-09-13T18:36:23.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.137+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba08014800 con 0x7fba1806bca0 2024-09-13T18:36:23.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.138+0000 7fba0f400640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 0x7fb9f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.138+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba08089e60 con 0x7fba1806bca0 2024-09-13T18:36:23.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.139+0000 7fba16a00640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 0x7fb9f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.139+0000 7fba16a00640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 0x7fb9f806d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba04034000 tx=0x7fba0402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.143+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fba08055050 con 0x7fba1806bca0 2024-09-13T18:36:23.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.315+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba1806c0d0 con 0x7fba1806bca0 2024-09-13T18:36:23.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.316+0000 7fba0f400640 1 -- 172.21.15.192:0/3203518239 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fba08058670 con 0x7fba1806bca0 2024-09-13T18:36:23.318 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:23.318 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:23.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 msgr2=0x7fb9f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 0x7fb9f806d0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fba04034000 tx=0x7fba0402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:23.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 msgr2=0x7fba180af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fba0800efc0 tx=0x7fba0800c490 comp rx=0 tx=0).stop 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 shutdown_connections 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9f806ac00 0x7fb9f806d0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba181592d0 0x7fba18141530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba180b3600 0x7fba1813fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 --2- 172.21.15.192:0/3203518239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba1806bca0 0x7fba180af2c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.318+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 >> 172.21.15.192:0/3203518239 conn(0x7fba180736d0 msgr2=0x7fba18156ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.319+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 shutdown_connections 2024-09-13T18:36:23.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.319+0000 7fba1d000640 1 -- 172.21.15.192:0/3203518239 wait complete. 2024-09-13T18:36:23.337 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:23.338 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:23.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.490+0000 7f90b0200640 1 Processor -- start 2024-09-13T18:36:23.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.490+0000 7f90b0200640 1 -- start start 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90b0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80cb330 0x7f90a806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90b0200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f90a80cdf60 0x7f90a80ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90b0200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a815a8e0 con 0x7f90a80b3470 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90b0200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90a80b2fe0 con 0x7f90a80cdf60 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90b0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80b26b0 con 0x7f90a80cb330 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90ae200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f90a80b3470 0x7f90a80b38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56640/0 (socket says 172.21.15.192:56640) 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.491+0000 7f90ae200640 1 -- 172.21.15.192:0/1329974468 learned_addr learned my addr 172.21.15.192:0/1329974468 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ad800640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80cb330 0x7f90a806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ace00640 1 --2- 172.21.15.192:0/1329974468 >> v2:172.21.15.194:3300/0 conn(0x7f90a80cdf60 0x7f90a80ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90a7e00640 1 -- 172.21.15.192:0/1329974468 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823761588 0 0) 0x7f90a815a8e0 con 0x7f90a80b3470 2024-09-13T18:36:23.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90a7e00640 1 -- 172.21.15.192:0/1329974468 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9090003440 con 0x7f90a80b3470 2024-09-13T18:36:23.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ace00640 1 -- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80cb330 msgr2=0x7f90a806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ace00640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80cb330 0x7f90a806ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ace00640 1 -- 172.21.15.192:0/1329974468 >> v1:172.21.15.192:6789/0 conn(0x7f90a80b3470 legacy=0x7f90a80b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.492+0000 7f90ace00640 1 -- 172.21.15.192:0/1329974468 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80b2990 con 0x7f90a80cdf60 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.493+0000 7f90ace00640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cdf60 0x7f90a80ce3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90940097a0 tx=0x7f909402a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ae923a994a5b0fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90a7e00640 1 -- 172.21.15.192:0/1329974468 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909402adb0 con 0x7f90a80cdf60 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90a7e00640 1 -- 172.21.15.192:0/1329974468 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9094032440 con 0x7f90a80cdf60 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90a7e00640 1 -- 172.21.15.192:0/1329974468 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90940327d0 con 0x7f90a80cdf60 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 -- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cdf60 msgr2=0x7f90a80ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cdf60 0x7f90a80ce3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f90940097a0 tx=0x7f909402a060 comp rx=0 tx=0).stop 2024-09-13T18:36:23.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 -- 172.21.15.192:0/1329974468 shutdown_connections 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cdf60 0x7f90a80ce3c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 --2- 172.21.15.192:0/1329974468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80cb330 0x7f90a806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 -- 172.21.15.192:0/1329974468 >> 172.21.15.192:0/1329974468 conn(0x7f90a80b08f0 msgr2=0x7f90a80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 -- 172.21.15.192:0/1329974468 shutdown_connections 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.494+0000 7f90b0200640 1 -- 172.21.15.192:0/1329974468 wait complete. 2024-09-13T18:36:23.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.496+0000 7f90b0200640 1 Processor -- start 2024-09-13T18:36:23.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.496+0000 7f90b0200640 1 -- start start 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80b3470 0x7f90a81e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cb330 0x7f90a81e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8156a30 con 0x7f90a80cdf60 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8156d10 con 0x7f90a80cb330 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90b0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a815c500 con 0x7f90a80b3470 2024-09-13T18:36:23.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90ae200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90ae200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57910/0 (socket says 172.21.15.192:57910) 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90ae200640 1 -- 172.21.15.192:0/4017246069 learned_addr learned my addr 172.21.15.192:0/4017246069 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90ad800640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80b3470 0x7f90a81e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.497+0000 7f90ace00640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cb330 0x7f90a81e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 -- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80b3470 msgr2=0x7f90a81e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80b3470 0x7f90a81e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 -- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cb330 msgr2=0x7f90a81e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cb330 0x7f90a81e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 -- 172.21.15.192:0/4017246069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9094009400 con 0x7f90a80cdf60 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90ae200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90a000caa0 tx=0x7f90a000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a000ac00 con 0x7f90a80cdf60 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a000ad60 con 0x7f90a80cdf60 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a815c7e0 con 0x7f90a80cdf60 2024-09-13T18:36:23.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0012620 con 0x7f90a80cdf60 2024-09-13T18:36:23.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.498+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a815c160 con 0x7f90a80cdf60 2024-09-13T18:36:23.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.499+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a815ca20 con 0x7f90a80cdf60 2024-09-13T18:36:23.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.500+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90a0007070 con 0x7f90a80cdf60 2024-09-13T18:36:23.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.501+0000 7f90a5600640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 0x7f908806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.501+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90a00892d0 con 0x7f90a80cdf60 2024-09-13T18:36:23.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.501+0000 7f90ad800640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 0x7f908806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.502+0000 7f90ad800640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 0x7f908806d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0850 tx=0x7f909c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.505+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90a815ca20 con 0x7f90a80cdf60 2024-09-13T18:36:23.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.671+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90a815ca20 con 0x7f90a80cdf60 2024-09-13T18:36:23.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.671+0000 7f90a5600640 1 -- 172.21.15.192:0/4017246069 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90a815ca20 con 0x7f90a80cdf60 2024-09-13T18:36:23.674 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 msgr2=0x7f908806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 0x7f908806d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f90a80b0850 tx=0x7f909c009190 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 msgr2=0x7f90a815cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90a000caa0 tx=0x7f90a000cf60 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 shutdown_connections 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f908806ac00 0x7f908806d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90a80cdf60 0x7f90a815cd00 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90a80cb330 0x7f90a81e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 --2- 172.21.15.192:0/4017246069 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90a80b3470 0x7f90a81e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 >> 172.21.15.192:0/4017246069 conn(0x7f90a80b08f0 msgr2=0x7f90a8153490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 shutdown_connections 2024-09-13T18:36:23.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.674+0000 7f90b0200640 1 -- 172.21.15.192:0/4017246069 wait complete. 2024-09-13T18:36:23.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.844+0000 7fc44ec00640 1 Processor -- start 2024-09-13T18:36:23.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.844+0000 7fc44ec00640 1 -- start start 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.845+0000 7fc44ec00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc4481589f0 0x7fc4480b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.845+0000 7fc44ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc4480b3af0 0x7fc44815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.845+0000 7fc44ec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4480b2000 con 0x7fc44806c0b0 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.845+0000 7fc44ec00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44815bbd0 con 0x7fc4481589f0 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.845+0000 7fc44ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc44815beb0 con 0x7fc4480b3af0 2024-09-13T18:36:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc4481589f0 0x7fc4480b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc44cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc44806c0b0 0x7fc4480cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56644/0 (socket says 172.21.15.192:56644) 2024-09-13T18:36:23.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc44cc00640 1 -- 172.21.15.192:0/1145212519 learned_addr learned my addr 172.21.15.192:0/1145212519 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:23.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447400640 1 --2- 172.21.15.192:0/1145212519 >> v2:172.21.15.194:3300/0 conn(0x7fc4480b3af0 0x7fc44815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447e00640 1 -- 172.21.15.192:0/1145212519 >> v2:172.21.15.194:3300/0 conn(0x7fc4480b3af0 msgr2=0x7fc44815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447e00640 1 --2- 172.21.15.192:0/1145212519 >> v2:172.21.15.194:3300/0 conn(0x7fc4480b3af0 0x7fc44815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447e00640 1 -- 172.21.15.192:0/1145212519 >> v1:172.21.15.192:6789/0 conn(0x7fc44806c0b0 legacy=0x7fc4480cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc447e00640 1 -- 172.21.15.192:0/1145212519 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc44815c190 con 0x7fc4481589f0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.846+0000 7fc446a00640 1 -- 172.21.15.192:0/1145212519 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 99235147 0 0) 0x7fc4480b2000 con 0x7fc44806c0b0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.847+0000 7fc447e00640 1 --2- 172.21.15.192:0/1145212519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4481589f0 0x7fc4480b2490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc44806edf0 tx=0x7fc43802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae80e7de67eca201 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.847+0000 7fc446a00640 1 -- 172.21.15.192:0/1145212519 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc43802ae60 con 0x7fc4481589f0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.847+0000 7fc446a00640 1 -- 172.21.15.192:0/1145212519 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc438032440 con 0x7fc4481589f0 2024-09-13T18:36:23.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.847+0000 7fc446a00640 1 -- 172.21.15.192:0/1145212519 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4380327d0 con 0x7fc4481589f0 2024-09-13T18:36:23.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 -- 172.21.15.192:0/1145212519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4481589f0 msgr2=0x7fc4480b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1145212519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4481589f0 0x7fc4480b2490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc44806edf0 tx=0x7fc43802a110 comp rx=0 tx=0).stop 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 -- 172.21.15.192:0/1145212519 shutdown_connections 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1145212519 >> v2:172.21.15.194:3300/0 conn(0x7fc4480b3af0 0x7fc44815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1145212519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4481589f0 0x7fc4480b2490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 -- 172.21.15.192:0/1145212519 >> 172.21.15.192:0/1145212519 conn(0x7fc4480b08f0 msgr2=0x7fc4480b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 -- 172.21.15.192:0/1145212519 shutdown_connections 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.848+0000 7fc44ec00640 1 -- 172.21.15.192:0/1145212519 wait complete. 2024-09-13T18:36:23.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.850+0000 7fc44ec00640 1 Processor -- start 2024-09-13T18:36:23.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.850+0000 7fc44ec00640 1 -- start start 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4480b3af0 0x7fc4481e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4481589f0 0x7fc4481e6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448145530 con 0x7fc44806c0b0 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc448145280 con 0x7fc4481589f0 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4481e2830 con 0x7fc4480b3af0 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57934/0 (socket says 172.21.15.192:57934) 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 -- 172.21.15.192:0/1289204686 learned_addr learned my addr 172.21.15.192:0/1289204686 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc44cc00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4481589f0 0x7fc4481e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447400640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4480b3af0 0x7fc4481e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 -- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4480b3af0 msgr2=0x7fc4481e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4480b3af0 0x7fc4481e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 -- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4481589f0 msgr2=0x7fc4481e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4481589f0 0x7fc4481e6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.851+0000 7fc447e00640 1 -- 172.21.15.192:0/1289204686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc438009400 con 0x7fc44806c0b0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc447e00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc438000c00 tx=0x7fc4380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438004230 con 0x7fc44806c0b0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4380043b0 con 0x7fc44806c0b0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc438004520 con 0x7fc44806c0b0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4481e2b10 con 0x7fc44806c0b0 2024-09-13T18:36:23.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.852+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc448145a60 con 0x7fc44806c0b0 2024-09-13T18:36:23.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.853+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc44815b260 con 0x7fc44806c0b0 2024-09-13T18:36:23.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.854+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc438003850 con 0x7fc44806c0b0 2024-09-13T18:36:23.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.855+0000 7fc43fe00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 0x7fc42806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:23.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.855+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4380a9e80 con 0x7fc44806c0b0 2024-09-13T18:36:23.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.855+0000 7fc447400640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 0x7fc42806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:23.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.856+0000 7fc447400640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 0x7fc42806d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4481f5c20 tx=0x7fc434009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:23.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:23.859+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc438075100 con 0x7fc44806c0b0 2024-09-13T18:36:24.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.030+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4480cb8f0 con 0x7fc44806c0b0 2024-09-13T18:36:24.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.030+0000 7fc43fe00640 1 -- 172.21.15.192:0/1289204686 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc43804b0a0 con 0x7fc44806c0b0 2024-09-13T18:36:24.033 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:24.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 msgr2=0x7fc42806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 0x7fc42806d0c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc4481f5c20 tx=0x7fc434009190 comp rx=0 tx=0).stop 2024-09-13T18:36:24.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 msgr2=0x7fc448144d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc438000c00 tx=0x7fc4380046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 shutdown_connections 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc42806ac00 0x7fc42806d0c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4481589f0 0x7fc4481e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4480b3af0 0x7fc4481e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 --2- 172.21.15.192:0/1289204686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc44806c0b0 0x7fc448144d40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.032+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 >> 172.21.15.192:0/1289204686 conn(0x7fc4480b08f0 msgr2=0x7fc448069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.033+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 shutdown_connections 2024-09-13T18:36:24.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.033+0000 7fc44ec00640 1 -- 172.21.15.192:0/1289204686 wait complete. 2024-09-13T18:36:24.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:24.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.204+0000 7fbce6800640 1 Processor -- start 2024-09-13T18:36:24.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.205+0000 7fbce6800640 1 -- start start 2024-09-13T18:36:24.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbce00b2d90 0x7fbce00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbce00b0120 0x7fbce015d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce00b0570 con 0x7fbce00b2d90 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce006f940 con 0x7fbce00b0120 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce006f610 con 0x7fbce0142e00 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbce00b2d90 0x7fbce00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbce00b2d90 0x7fbce00afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57946/0 (socket says 172.21.15.192:57946) 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce4a00640 1 -- 172.21.15.192:0/3839755503 learned_addr learned my addr 172.21.15.192:0/3839755503 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce5400640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.206+0000 7fbce5e00640 1 --2- 172.21.15.192:0/3839755503 >> v2:172.21.15.194:3300/0 conn(0x7fbce00b0120 0x7fbce015d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.207+0000 7fbce4a00640 1 -- 172.21.15.192:0/3839755503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 msgr2=0x7fbce00b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.207+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce00b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.207+0000 7fbce4a00640 1 -- 172.21.15.192:0/3839755503 >> v2:172.21.15.194:3300/0 conn(0x7fbce00b0120 msgr2=0x7fbce015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.207+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3839755503 >> v2:172.21.15.194:3300/0 conn(0x7fbce00b0120 0x7fbce015d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.207+0000 7fbce4a00640 1 -- 172.21.15.192:0/3839755503 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce00b3530 con 0x7fbce00b2d90 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce00afbe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbce0071e90 tx=0x7fbccc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c6188b3bd2715cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbcdfe00640 1 -- 172.21.15.192:0/3839755503 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc032440 con 0x7fbce00b2d90 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbcdfe00640 1 -- 172.21.15.192:0/3839755503 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc0325a0 con 0x7fbce00b2d90 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbcdfe00640 1 -- 172.21.15.192:0/3839755503 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc032930 con 0x7fbce00b2d90 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbce6800640 1 -- 172.21.15.192:0/3839755503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 msgr2=0x7fbce00afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.208+0000 7fbce6800640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce00afbe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbce0071e90 tx=0x7fbccc02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 -- 172.21.15.192:0/3839755503 shutdown_connections 2024-09-13T18:36:24.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 --2- 172.21.15.192:0/3839755503 >> v2:172.21.15.194:3300/0 conn(0x7fbce00b0120 0x7fbce015d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce00afbe0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 --2- 172.21.15.192:0/3839755503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 -- 172.21.15.192:0/3839755503 >> 172.21.15.192:0/3839755503 conn(0x7fbce00ae7f0 msgr2=0x7fbce006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 -- 172.21.15.192:0/3839755503 shutdown_connections 2024-09-13T18:36:24.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.209+0000 7fbce6800640 1 -- 172.21.15.192:0/3839755503 wait complete. 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.210+0000 7fbce6800640 1 Processor -- start 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.210+0000 7fbce6800640 1 -- start start 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbce00b0120 0x7fbce0158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce015cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015d3c0 con 0x7fbce00b2d90 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015d6a0 con 0x7fbce00b0120 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce015d980 con 0x7fbce0142e00 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57948/0 (socket says 172.21.15.192:57948) 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.211+0000 7fbce4a00640 1 -- 172.21.15.192:0/3889188735 learned_addr learned my addr 172.21.15.192:0/3889188735 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce5400640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbce00b0120 0x7fbce0158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce5e00640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce015cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 -- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 msgr2=0x7fbce015cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce015cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 -- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbce00b0120 msgr2=0x7fbce0158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbce00b0120 0x7fbce0158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 -- 172.21.15.192:0/3889188735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbccc0094d0 con 0x7fbce00b2d90 2024-09-13T18:36:24.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbce4a00640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbccc02a220 tx=0x7fbccc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.212+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc03d830 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.213+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbccc03d990 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.213+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce015dc60 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.213+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbccc03dd40 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.213+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce0158f50 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.214+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce015e180 con 0x7fbce00b2d90 2024-09-13T18:36:24.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.215+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbccc039040 con 0x7fbce00b2d90 2024-09-13T18:36:24.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.215+0000 7fbcdd600640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 0x7fbcc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.215+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbccc0a9d10 con 0x7fbce00b2d90 2024-09-13T18:36:24.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.216+0000 7fbce5400640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 0x7fbcc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.216+0000 7fbce5400640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 0x7fbcc006d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009ac0 tx=0x7fbcd4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.220+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbce015e180 con 0x7fbce00b2d90 2024-09-13T18:36:24.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.387+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbce015e180 con 0x7fbce00b2d90 2024-09-13T18:36:24.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.388+0000 7fbcdd600640 1 -- 172.21.15.192:0/3889188735 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbce015e180 con 0x7fbce00b2d90 2024-09-13T18:36:24.391 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 msgr2=0x7fbcc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 0x7fbcc006d0c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4009ac0 tx=0x7fbcd4009190 comp rx=0 tx=0).stop 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 msgr2=0x7fbce015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbccc02a220 tx=0x7fbccc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 shutdown_connections 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbcc006ac00 0x7fbcc006d0c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbce0142e00 0x7fbce015cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbce00b2d90 0x7fbce015c840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 --2- 172.21.15.192:0/3889188735 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbce00b0120 0x7fbce0158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 >> 172.21.15.192:0/3889188735 conn(0x7fbce00ae7f0 msgr2=0x7fbce013c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:24.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 shutdown_connections 2024-09-13T18:36:24.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.390+0000 7fbce6800640 1 -- 172.21.15.192:0/3889188735 wait complete. 2024-09-13T18:36:24.409 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:24.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.557+0000 7fab4a600640 1 Processor -- start 2024-09-13T18:36:24.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.557+0000 7fab4a600640 1 -- start start 2024-09-13T18:36:24.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab4a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab440b3f10 0x7fab4415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab4a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab440b0490 0x7fab4415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab4a600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab440b2f00 con 0x7fab4415dee0 2024-09-13T18:36:24.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab4a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4415aec0 con 0x7fab440b3f10 2024-09-13T18:36:24.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab4a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab440b3150 con 0x7fab440b0490 2024-09-13T18:36:24.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab42a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab440b3f10 0x7fab4415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab42a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab440b3f10 0x7fab4415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:50250/0 (socket says 172.21.15.192:50250) 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab42a00640 1 -- 172.21.15.192:0/3635592854 learned_addr learned my addr 172.21.15.192:0/3635592854 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.559+0000 7fab43e00640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab440b0490 0x7fab4415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.560+0000 7fab42a00640 1 -- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab440b0490 msgr2=0x7fab4415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.560+0000 7fab42a00640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab440b0490 0x7fab4415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.560+0000 7fab42a00640 1 -- 172.21.15.192:0/3635592854 >> v1:172.21.15.194:6789/0 conn(0x7fab4415dee0 legacy=0x7fab440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.560+0000 7fab42000640 1 -- 172.21.15.192:0/3635592854 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400803827 0 0) 0x7fab440b2f00 con 0x7fab4415dee0 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.560+0000 7fab42a00640 1 -- 172.21.15.192:0/3635592854 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab440b3430 con 0x7fab440b3f10 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab42a00640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b3f10 0x7fab4415a440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab30009870 tx=0x7fab3002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f6bdc836706c30c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab42000640 1 -- 172.21.15.192:0/3635592854 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30032440 con 0x7fab440b3f10 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab42000640 1 -- 172.21.15.192:0/3635592854 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab300325a0 con 0x7fab440b3f10 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab42000640 1 -- 172.21.15.192:0/3635592854 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab30032930 con 0x7fab440b3f10 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab4a600640 1 -- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b3f10 msgr2=0x7fab4415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.561+0000 7fab4a600640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b3f10 0x7fab4415a440 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fab30009870 tx=0x7fab3002a270 comp rx=0 tx=0).stop 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 -- 172.21.15.192:0/3635592854 shutdown_connections 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab440b0490 0x7fab4415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 --2- 172.21.15.192:0/3635592854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b3f10 0x7fab4415a440 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 -- 172.21.15.192:0/3635592854 >> 172.21.15.192:0/3635592854 conn(0x7fab440ae960 msgr2=0x7fab4406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 -- 172.21.15.192:0/3635592854 shutdown_connections 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.562+0000 7fab4a600640 1 -- 172.21.15.192:0/3635592854 wait complete. 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.563+0000 7fab4a600640 1 Processor -- start 2024-09-13T18:36:24.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.563+0000 7fab4a600640 1 -- start start 2024-09-13T18:36:24.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 0x7fab441391a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 0x7fab44134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab44142930 con 0x7fab441382b0 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab44141d20 con 0x7fab440b0490 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.564+0000 7fab4a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab44142000 con 0x7fab4415dee0 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 0x7fab441391a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab42a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 0x7fab44134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57960/0 (socket says 172.21.15.192:57960) 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 -- 172.21.15.192:0/2755218218 learned_addr learned my addr 172.21.15.192:0/2755218218 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 -- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 msgr2=0x7fab44134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 0x7fab44134580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 -- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 msgr2=0x7fab441391a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 0x7fab441391a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43e00640 1 -- 172.21.15.192:0/2755218218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab300094d0 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab43400640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 0x7fab441391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.565+0000 7fab42a00640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 0x7fab44134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab43e00640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00efc0 tx=0x7fab3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c014480 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3c00f040 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3c014820 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab441422e0 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.566+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab44141a10 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.567+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab440afd80 con 0x7fab441382b0 2024-09-13T18:36:24.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.568+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab3c014980 con 0x7fab441382b0 2024-09-13T18:36:24.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.569+0000 7fab3b400640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 0x7fab2406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:24.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.569+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab3c089ef0 con 0x7fab441382b0 2024-09-13T18:36:24.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.569+0000 7fab43400640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 0x7fab2406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:24.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.570+0000 7fab43400640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 0x7fab2406d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f60 tx=0x7fab34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:24.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.573+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab3c055060 con 0x7fab441382b0 2024-09-13T18:36:24.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.752+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fab4415d640 con 0x7fab441382b0 2024-09-13T18:36:24.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.753+0000 7fab3b400640 1 -- 172.21.15.192:0/2755218218 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fab3c058680 con 0x7fab441382b0 2024-09-13T18:36:24.755 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 msgr2=0x7fab2406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 0x7fab2406d0f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fab34000f60 tx=0x7fab34009040 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 msgr2=0x7fab44142dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fab3c00efc0 tx=0x7fab3c00c490 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 shutdown_connections 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2406ac30 0x7fab2406d0f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab441382b0 0x7fab44142dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab4415dee0 0x7fab44134580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 --2- 172.21.15.192:0/2755218218 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab440b0490 0x7fab441391a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:24.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 >> 172.21.15.192:0/2755218218 conn(0x7fab440ae960 msgr2=0x7fab440ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:24.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 shutdown_connections 2024-09-13T18:36:24.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:24.755+0000 7fab4a600640 1 -- 172.21.15.192:0/2755218218 wait complete. 2024-09-13T18:36:24.774 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:36:24.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:24.774 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-13T18:36:24.843 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:36:24.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:24.843 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:36:24.890 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:24.890 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:24.926 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:24.926 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:25.002 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:25.002 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:25.078 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:25.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.266+0000 7fd7bc400640 1 Processor -- start 2024-09-13T18:36:25.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.266+0000 7fd7bc400640 1 -- start start 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.267+0000 7fd7bc400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd7b415e790 0x7fd7b40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.267+0000 7fd7bc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 0x7fd7b40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.267+0000 7fd7bc400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7b415ec00 con 0x7fd7b40cacd0 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.267+0000 7fd7bc400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7b40cb5f0 con 0x7fd7b415e790 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.267+0000 7fd7bc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b4140480 con 0x7fd7b415bc20 2024-09-13T18:36:25.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7b9a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd7b40cacd0 0x7fd7b4140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56660/0 (socket says 172.21.15.192:56660) 2024-09-13T18:36:25.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7b9a00640 1 -- 172.21.15.192:0/1001378051 learned_addr learned my addr 172.21.15.192:0/1001378051 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:25.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7b9000640 1 --2- 172.21.15.192:0/1001378051 >> v2:172.21.15.194:3300/0 conn(0x7fd7b415e790 0x7fd7b40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7ba400640 1 --2- 172.21.15.192:0/1001378051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 0x7fd7b40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7b3e00640 1 -- 172.21.15.192:0/1001378051 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570985657 0 0) 0x7fd7b415ec00 con 0x7fd7b40cacd0 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7b3e00640 1 -- 172.21.15.192:0/1001378051 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd79c003520 con 0x7fd7b40cacd0 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7ba400640 1 -- 172.21.15.192:0/1001378051 >> v2:172.21.15.194:3300/0 conn(0x7fd7b415e790 msgr2=0x7fd7b40cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7ba400640 1 --2- 172.21.15.192:0/1001378051 >> v2:172.21.15.194:3300/0 conn(0x7fd7b415e790 0x7fd7b40cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7ba400640 1 -- 172.21.15.192:0/1001378051 >> v1:172.21.15.192:6789/0 conn(0x7fd7b40cacd0 legacy=0x7fd7b4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.268+0000 7fd7ba400640 1 -- 172.21.15.192:0/1001378051 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b415ee90 con 0x7fd7b415bc20 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.269+0000 7fd7ba400640 1 --2- 172.21.15.192:0/1001378051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 0x7fd7b40afd80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=438187644bba9abf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7b3e00640 1 -- 172.21.15.192:0/1001378051 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007740 con 0x7fd7b415bc20 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7b3e00640 1 -- 172.21.15.192:0/1001378051 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ac02d050 con 0x7fd7b415bc20 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7b3e00640 1 -- 172.21.15.192:0/1001378051 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ac007ac0 con 0x7fd7b415bc20 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 -- 172.21.15.192:0/1001378051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 msgr2=0x7fd7b40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 --2- 172.21.15.192:0/1001378051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 0x7fd7b40afd80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7ac009d90 tx=0x7fd7ac02a660 comp rx=0 tx=0).stop 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 -- 172.21.15.192:0/1001378051 shutdown_connections 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 --2- 172.21.15.192:0/1001378051 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415bc20 0x7fd7b40afd80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 --2- 172.21.15.192:0/1001378051 >> v2:172.21.15.194:3300/0 conn(0x7fd7b415e790 0x7fd7b40cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 -- 172.21.15.192:0/1001378051 >> 172.21.15.192:0/1001378051 conn(0x7fd7b40ae960 msgr2=0x7fd7b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.270+0000 7fd7bc400640 1 -- 172.21.15.192:0/1001378051 shutdown_connections 2024-09-13T18:36:25.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.271+0000 7fd7bc400640 1 -- 172.21.15.192:0/1001378051 wait complete. 2024-09-13T18:36:25.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.272+0000 7fd7bc400640 1 Processor -- start 2024-09-13T18:36:25.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.272+0000 7fd7bc400640 1 -- start start 2024-09-13T18:36:25.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 0x7fd7b4151420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 0x7fd7b4157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b413f4e0 con 0x7fd7b40cacd0 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b413feb0 con 0x7fd7b415bc20 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7bc400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7b413e8d0 con 0x7fd7b415e790 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7b9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7b9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57964/0 (socket says 172.21.15.192:57964) 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.273+0000 7fd7b9a00640 1 -- 172.21.15.192:0/2334020101 learned_addr learned my addr 172.21.15.192:0/2334020101 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7ba400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 0x7fd7b4157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9000640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 0x7fd7b4151420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 -- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 msgr2=0x7fd7b4157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 0x7fd7b4157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 -- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 msgr2=0x7fd7b4151420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 0x7fd7b4151420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 -- 172.21.15.192:0/2334020101 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac009a70 con 0x7fd7b40cacd0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7ba400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 0x7fd7b4157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9000640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 0x7fd7b4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b9a00640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800c410 tx=0x7fd7a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a8005ce0 con 0x7fd7b40cacd0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7a8005e40 con 0x7fd7b40cacd0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7b413ebb0 con 0x7fd7b40cacd0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.274+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7a80072f0 con 0x7fd7b40cacd0 2024-09-13T18:36:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.275+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7b413f170 con 0x7fd7b40cacd0 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.276+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7b413f330 con 0x7fd7b40cacd0 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.276+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd7a8007510 con 0x7fd7b40cacd0 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.277+0000 7fd7b1600640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 0x7fd79406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.277+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7a8088b10 con 0x7fd7b40cacd0 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.277+0000 7fd7b9000640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 0x7fd79406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.278+0000 7fd7b9000640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 0x7fd79406d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4071390 tx=0x7fd7a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.281+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd7a8053c80 con 0x7fd7b40cacd0 2024-09-13T18:36:25.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.450+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7b40cb0b0 con 0x7fd7b40cacd0 2024-09-13T18:36:25.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.451+0000 7fd7b1600640 1 -- 172.21.15.192:0/2334020101 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fd7a8017020 con 0x7fd7b40cacd0 2024-09-13T18:36:25.454 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:25.454 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":21,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:35:41.217364+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.453+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 msgr2=0x7fd79406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.453+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 0x7fd79406d0c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4071390 tx=0x7fd7a0008040 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.453+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 msgr2=0x7fd7b413f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.453+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd7a800c410 tx=0x7fd7a800c8d0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 shutdown_connections 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd79406ac00 0x7fd79406d0c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7b415e790 0x7fd7b4157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7b415bc20 0x7fd7b4151420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 --2- 172.21.15.192:0/2334020101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7b40cacd0 0x7fd7b413f970 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 >> 172.21.15.192:0/2334020101 conn(0x7fd7b40ae960 msgr2=0x7fd7b40ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 shutdown_connections 2024-09-13T18:36:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.454+0000 7fd7bc400640 1 -- 172.21.15.192:0/2334020101 wait complete. 2024-09-13T18:36:25.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:25.473 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:25.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.628+0000 7f1771200640 1 Processor -- start 2024-09-13T18:36:25.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.628+0000 7f1771200640 1 -- start start 2024-09-13T18:36:25.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.629+0000 7f1771200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 0x7f176c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.629+0000 7f1771200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.629+0000 7f1771200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0b2000 con 0x7f176c0b3af0 2024-09-13T18:36:25.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.629+0000 7f1771200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c06ca80 con 0x7f176c1589f0 2024-09-13T18:36:25.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.629+0000 7f1771200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c15b970 con 0x7f176c06c0b0 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:38352/0 (socket says 172.21.15.192:38352) 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f1769e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 0x7f176c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 -- 172.21.15.192:0/751661492 learned_addr learned my addr 172.21.15.192:0/751661492 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 -- 172.21.15.192:0/751661492 >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 msgr2=0x7f176c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 --2- 172.21.15.192:0/751661492 >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 0x7f176c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 -- 172.21.15.192:0/751661492 >> v1:172.21.15.194:6789/0 conn(0x7f176c0b3af0 legacy=0x7f176c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f176a800640 1 -- 172.21.15.192:0/751661492 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c15bbd0 con 0x7f176c06c0b0 2024-09-13T18:36:25.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f1768a00640 1 -- 172.21.15.192:0/751661492 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085096092 0 0) 0x7f176c0b2000 con 0x7f176c0b3af0 2024-09-13T18:36:25.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.630+0000 7f1769e00640 1 --2- 172.21.15.192:0/751661492 >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 0x7f176c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.631+0000 7f176a800640 1 --2- 172.21.15.192:0/751661492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176402a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce38d61831ff8ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.631+0000 7f1768a00640 1 -- 172.21.15.192:0/751661492 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764031600 con 0x7f176c06c0b0 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.631+0000 7f1768a00640 1 -- 172.21.15.192:0/751661492 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176402d050 con 0x7f176c06c0b0 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.631+0000 7f1768a00640 1 -- 172.21.15.192:0/751661492 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1764031980 con 0x7f176c06c0b0 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 -- 172.21.15.192:0/751661492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 msgr2=0x7f176c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 --2- 172.21.15.192:0/751661492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1764009e50 tx=0x7f176402a710 comp rx=0 tx=0).stop 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 -- 172.21.15.192:0/751661492 shutdown_connections 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 --2- 172.21.15.192:0/751661492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c06c540 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 --2- 172.21.15.192:0/751661492 >> v2:172.21.15.194:3300/0 conn(0x7f176c1589f0 0x7f176c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 -- 172.21.15.192:0/751661492 >> 172.21.15.192:0/751661492 conn(0x7f176c0b08f0 msgr2=0x7f176c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 -- 172.21.15.192:0/751661492 shutdown_connections 2024-09-13T18:36:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.632+0000 7f1771200640 1 -- 172.21.15.192:0/751661492 wait complete. 2024-09-13T18:36:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.634+0000 7f1771200640 1 Processor -- start 2024-09-13T18:36:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.634+0000 7f1771200640 1 -- start start 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c1561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0b3af0 0x7f176c152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c0afe60 con 0x7f176c1589f0 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1531e0 con 0x7f176c0b3af0 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1771200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c069ea0 con 0x7f176c06c0b0 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57970/0 (socket says 172.21.15.192:57970) 2024-09-13T18:36:25.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 -- 172.21.15.192:0/570768689 learned_addr learned my addr 172.21.15.192:0/570768689 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:25.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1769400640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0b3af0 0x7f176c152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f1769e00640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c1561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 -- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 msgr2=0x7f176c1561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c1561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 -- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0b3af0 msgr2=0x7f176c152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0b3af0 0x7f176c152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.635+0000 7f176a800640 1 -- 172.21.15.192:0/570768689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175c009400 con 0x7f176c1589f0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f176a800640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1764009f70 tx=0x7f1764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176403b810 con 0x7f176c1589f0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176403b970 con 0x7f176c1589f0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176403bd20 con 0x7f176c1589f0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1764009b30 con 0x7f176c1589f0 2024-09-13T18:36:25.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.636+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c06a160 con 0x7f176c1589f0 2024-09-13T18:36:25.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.637+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c06a2f0 con 0x7f176c1589f0 2024-09-13T18:36:25.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.638+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f176403a3a0 con 0x7f176c1589f0 2024-09-13T18:36:25.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.639+0000 7f1762000640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.639+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17640a9ed0 con 0x7f176c1589f0 2024-09-13T18:36:25.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.639+0000 7f1769e00640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.640+0000 7f1769e00640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 0x7f174c06d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f175c009c30 tx=0x7f175c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.643+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1764075160 con 0x7f176c1589f0 2024-09-13T18:36:25.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.812+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f176c06c540 con 0x7f176c1589f0 2024-09-13T18:36:25.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.813+0000 7f1762000640 1 -- 172.21.15.192:0/570768689 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1764049020 con 0x7f176c1589f0 2024-09-13T18:36:25.816 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 msgr2=0x7f174c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 0x7f174c06d0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f175c009c30 tx=0x7f175c009190 comp rx=0 tx=0).stop 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 msgr2=0x7f176c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1764009f70 tx=0x7f1764004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 shutdown_connections 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f174c06ac00 0x7f174c06d0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f176c1589f0 0x7f176c0ad840 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f176c0b3af0 0x7f176c152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 --2- 172.21.15.192:0/570768689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f176c06c0b0 0x7f176c1561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 >> 172.21.15.192:0/570768689 conn(0x7f176c0b08f0 msgr2=0x7f176c0cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 shutdown_connections 2024-09-13T18:36:25.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.815+0000 7f1771200640 1 -- 172.21.15.192:0/570768689 wait complete. 2024-09-13T18:36:25.833 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:25.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.986+0000 7f2d62c00640 1 Processor -- start 2024-09-13T18:36:25.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.986+0000 7f2d62c00640 1 -- start start 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d62c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 0x7f2d5c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d62c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d5c06c0b0 0x7f2d5c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d62c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5c0b2000 con 0x7f2d5c1589f0 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d62c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5c06ca80 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d62c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c0b2ba0 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d5be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2d5c1589f0 0x7f2d5c0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56666/0 (socket says 172.21.15.192:56666) 2024-09-13T18:36:25.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d5be00640 1 -- 172.21.15.192:0/2714483534 learned_addr learned my addr 172.21.15.192:0/2714483534 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:25.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d53e00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 0x7f2d5c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.987+0000 7f2d60c00640 1 --2- 172.21.15.192:0/2714483534 >> v2:172.21.15.192:3300/0 conn(0x7f2d5c06c0b0 0x7f2d5c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d5b400640 1 -- 172.21.15.192:0/2714483534 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859591184 0 0) 0x7f2d5c0b2000 con 0x7f2d5c1589f0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d5b400640 1 -- 172.21.15.192:0/2714483534 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d40003520 con 0x7f2d5c1589f0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d60c00640 1 -- 172.21.15.192:0/2714483534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 msgr2=0x7f2d5c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d60c00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 0x7f2d5c15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d60c00640 1 -- 172.21.15.192:0/2714483534 >> v1:172.21.15.192:6789/0 conn(0x7f2d5c1589f0 legacy=0x7f2d5c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d60c00640 1 -- 172.21.15.192:0/2714483534 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d5c15bbd0 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.988+0000 7f2d53e00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 0x7f2d5c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.989+0000 7f2d60c00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c06c0b0 0x7f2d5c06c540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009d90 tx=0x7f2d5402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c375a44fb32cc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.989+0000 7f2d5b400640 1 -- 172.21.15.192:0/2714483534 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54007740 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.989+0000 7f2d5b400640 1 -- 172.21.15.192:0/2714483534 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5402d050 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.989+0000 7f2d5b400640 1 -- 172.21.15.192:0/2714483534 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d54007aa0 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 -- 172.21.15.192:0/2714483534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c06c0b0 msgr2=0x7f2d5c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c06c0b0 0x7f2d5c06c540 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2d54009d90 tx=0x7f2d5402a660 comp rx=0 tx=0).stop 2024-09-13T18:36:25.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 -- 172.21.15.192:0/2714483534 shutdown_connections 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c06c0b0 0x7f2d5c06c540 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2714483534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c0b3af0 0x7f2d5c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 -- 172.21.15.192:0/2714483534 >> 172.21.15.192:0/2714483534 conn(0x7f2d5c0b08f0 msgr2=0x7f2d5c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 -- 172.21.15.192:0/2714483534 shutdown_connections 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.990+0000 7f2d62c00640 1 -- 172.21.15.192:0/2714483534 wait complete. 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.991+0000 7f2d62c00640 1 Processor -- start 2024-09-13T18:36:25.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 -- start start 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c06c0b0 0x7f2d5c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d5c1589f0 0x7f2d5c0afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1f2500 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1f2770 con 0x7f2d5c1589f0 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.992+0000 7f2d62c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5c1f2a50 con 0x7f2d5c06c0b0 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57994/0 (socket says 172.21.15.192:57994) 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 -- 172.21.15.192:0/2124986370 learned_addr learned my addr 172.21.15.192:0/2124986370 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:25.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d60c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d5c1589f0 0x7f2d5c0afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d5be00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c06c0b0 0x7f2d5c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 -- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c06c0b0 msgr2=0x7f2d5c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c06c0b0 0x7f2d5c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 -- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d5c1589f0 msgr2=0x7f2d5c0afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d5c1589f0 0x7f2d5c0afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 -- 172.21.15.192:0/2124986370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d44009400 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.993+0000 7f2d53e00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400e980 tx=0x7f2d4400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.994+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400ca00 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.994+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4400cb60 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.994+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44013470 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.994+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d54009a70 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.994+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d5c1f6860 con 0x7f2d5c0b3af0 2024-09-13T18:36:25.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.995+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d5c06c540 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.996+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d440135d0 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.996+0000 7f2d58c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 0x7f2d3806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.996+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d440891d0 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.997+0000 7f2d5be00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 0x7f2d3806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:25.997+0000 7f2d5be00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 0x7f2d3806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005880 tx=0x7f2d4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.000+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d44054450 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.170+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2d5c0cb8f0 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.171+0000 7f2d58c00640 1 -- 172.21.15.192:0/2124986370 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2d44057a70 con 0x7f2d5c0b3af0 2024-09-13T18:36:26.174 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 msgr2=0x7f2d3806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 0x7f2d3806d0f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c005880 tx=0x7f2d4c009040 comp rx=0 tx=0).stop 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 msgr2=0x7f2d5c0af500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400e980 tx=0x7f2d4400ee40 comp rx=0 tx=0).stop 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 shutdown_connections 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d3806ac30 0x7f2d3806d0f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d5c1589f0 0x7f2d5c0afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d5c0b3af0 0x7f2d5c0af500 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 --2- 172.21.15.192:0/2124986370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d5c06c0b0 0x7f2d5c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 >> 172.21.15.192:0/2124986370 conn(0x7f2d5c0b08f0 msgr2=0x7f2d5c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 shutdown_connections 2024-09-13T18:36:26.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.173+0000 7f2d62c00640 1 -- 172.21.15.192:0/2124986370 wait complete. 2024-09-13T18:36:26.192 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:26.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.346+0000 7f651b000640 1 Processor -- start 2024-09-13T18:36:26.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.346+0000 7f651b000640 1 -- start start 2024-09-13T18:36:26.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.347+0000 7f651b000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6514142e00 0x7f65140b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f651b000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651406f940 con 0x7f65140b2d90 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f651b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f651406f610 con 0x7f65140b02f0 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f651b000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65140b3530 con 0x7f6514142e00 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6514142e00 0x7f65140b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f65140b2d90 0x7f65140afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56682/0 (socket says 172.21.15.192:56682) 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519200640 1 -- 172.21.15.192:0/973936369 learned_addr learned my addr 172.21.15.192:0/973936369 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:26.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519c00640 1 -- 172.21.15.192:0/973936369 >> v1:172.21.15.194:6789/0 conn(0x7f65140b02f0 legacy=0x7f651406fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519c00640 1 -- 172.21.15.192:0/973936369 >> v1:172.21.15.192:6789/0 conn(0x7f65140b2d90 legacy=0x7f65140afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.348+0000 7f6519c00640 1 -- 172.21.15.192:0/973936369 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65140b3810 con 0x7f6514142e00 2024-09-13T18:36:26.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.349+0000 7f6519c00640 1 --2- 172.21.15.192:0/973936369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514142e00 0x7f65140b4910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f65080097a0 tx=0x7f650802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469cf2af398f029d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.349+0000 7f6513e00640 1 -- 172.21.15.192:0/973936369 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508032440 con 0x7f6514142e00 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f6513e00640 1 -- 172.21.15.192:0/973936369 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65080325a0 con 0x7f6514142e00 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f6513e00640 1 -- 172.21.15.192:0/973936369 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508032930 con 0x7f6514142e00 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 -- 172.21.15.192:0/973936369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514142e00 msgr2=0x7f65140b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 --2- 172.21.15.192:0/973936369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514142e00 0x7f65140b4910 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f65080097a0 tx=0x7f650802a230 comp rx=0 tx=0).stop 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 -- 172.21.15.192:0/973936369 shutdown_connections 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 --2- 172.21.15.192:0/973936369 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6514142e00 0x7f65140b4910 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 -- 172.21.15.192:0/973936369 >> 172.21.15.192:0/973936369 conn(0x7f65140ae7f0 msgr2=0x7f651406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 -- 172.21.15.192:0/973936369 shutdown_connections 2024-09-13T18:36:26.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.350+0000 7f651b000640 1 -- 172.21.15.192:0/973936369 wait complete. 2024-09-13T18:36:26.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.352+0000 7f651b000640 1 Processor -- start 2024-09-13T18:36:26.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.352+0000 7f651b000640 1 -- start start 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65140b02f0 0x7f6514136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6514142e00 0x7f6514159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514136530 con 0x7f65140b2d90 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6514136ca0 con 0x7f6514142e00 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f651415a490 con 0x7f65140b02f0 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58012/0 (socket says 172.21.15.192:58012) 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 -- 172.21.15.192:0/2876881952 learned_addr learned my addr 172.21.15.192:0/2876881952 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519c00640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65140b02f0 0x7f6514136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f651a600640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6514142e00 0x7f6514159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 -- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65140b02f0 msgr2=0x7f6514136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65140b02f0 0x7f6514136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 -- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6514142e00 msgr2=0x7f6514159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6514142e00 0x7f6514159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.353+0000 7f6519200640 1 -- 172.21.15.192:0/2876881952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6508009400 con 0x7f65140b2d90 2024-09-13T18:36:26.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f6519200640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f650000c4a0 tx=0x7f650000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500005ce0 con 0x7f65140b2d90 2024-09-13T18:36:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6500005e40 con 0x7f65140b2d90 2024-09-13T18:36:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6514143360 con 0x7f65140b2d90 2024-09-13T18:36:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6500007270 con 0x7f65140b2d90 2024-09-13T18:36:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.354+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651415aa50 con 0x7f65140b2d90 2024-09-13T18:36:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.355+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f651413f090 con 0x7f65140b2d90 2024-09-13T18:36:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.356+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6500007490 con 0x7f65140b2d90 2024-09-13T18:36:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.357+0000 7f6511600640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 0x7f64f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.357+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65000887b0 con 0x7f65140b2d90 2024-09-13T18:36:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.357+0000 7f6519c00640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 0x7f64f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.358+0000 7f6519c00640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 0x7f64f406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6508034000 tx=0x7f650802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.361+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f651413f090 con 0x7f65140b2d90 2024-09-13T18:36:26.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.527+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f651413f090 con 0x7f65140b2d90 2024-09-13T18:36:26.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.528+0000 7f6511600640 1 -- 172.21.15.192:0/2876881952 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f651413f090 con 0x7f65140b2d90 2024-09-13T18:36:26.531 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 msgr2=0x7f64f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 0x7f64f406d0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6508034000 tx=0x7f650802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 msgr2=0x7f65140adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f650000c4a0 tx=0x7f650000c960 comp rx=0 tx=0).stop 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 shutdown_connections 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f64f406ac00 0x7f64f406d0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6514142e00 0x7f6514159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65140b2d90 0x7f65140adab0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 --2- 172.21.15.192:0/2876881952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65140b02f0 0x7f6514136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 >> 172.21.15.192:0/2876881952 conn(0x7f65140ae7f0 msgr2=0x7f651413d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 shutdown_connections 2024-09-13T18:36:26.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.530+0000 7f651b000640 1 -- 172.21.15.192:0/2876881952 wait complete. 2024-09-13T18:36:26.549 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:26.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.700+0000 7f6d1c200640 1 Processor -- start 2024-09-13T18:36:26.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.700+0000 7f6d1c200640 1 -- start start 2024-09-13T18:36:26.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.701+0000 7f6d1c200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d140cacd0 0x7f6d1415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.701+0000 7f6d1c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d140cb0b0 0x7f6d1415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.701+0000 7f6d1c200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d14140480 con 0x7f6d14140980 2024-09-13T18:36:26.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.701+0000 7f6d1c200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d1415c160 con 0x7f6d140cacd0 2024-09-13T18:36:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.701+0000 7f6d1c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d140cb520 con 0x7f6d140cb0b0 2024-09-13T18:36:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d140cacd0 0x7f6d1415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6d140cacd0 0x7f6d1415e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58014/0 (socket says 172.21.15.192:58014) 2024-09-13T18:36:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 -- 172.21.15.192:0/2930653649 learned_addr learned my addr 172.21.15.192:0/2930653649 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d18e00640 1 --2- 172.21.15.192:0/2930653649 >> v2:172.21.15.194:3300/0 conn(0x7f6d140cb0b0 0x7f6d1415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 -- 172.21.15.192:0/2930653649 >> v2:172.21.15.194:3300/0 conn(0x7f6d140cb0b0 msgr2=0x7f6d1415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 --2- 172.21.15.192:0/2930653649 >> v2:172.21.15.194:3300/0 conn(0x7f6d140cb0b0 0x7f6d1415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 -- 172.21.15.192:0/2930653649 >> v1:172.21.15.194:6789/0 conn(0x7f6d14140980 legacy=0x7f6d140afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.702+0000 7f6d19800640 1 -- 172.21.15.192:0/2930653649 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d1415ee90 con 0x7f6d140cacd0 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.703+0000 7f6d19800640 1 --2- 172.21.15.192:0/2930653649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cacd0 0x7f6d1415e790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d140ce9e0 tx=0x7f6d0802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e4f98b2be2fbb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.703+0000 7f6d13e00640 1 -- 172.21.15.192:0/2930653649 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08032440 con 0x7f6d140cacd0 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.703+0000 7f6d13e00640 1 -- 172.21.15.192:0/2930653649 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d080325a0 con 0x7f6d140cacd0 2024-09-13T18:36:26.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.703+0000 7f6d13e00640 1 -- 172.21.15.192:0/2930653649 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d08032930 con 0x7f6d140cacd0 2024-09-13T18:36:26.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 -- 172.21.15.192:0/2930653649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cacd0 msgr2=0x7f6d1415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 --2- 172.21.15.192:0/2930653649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cacd0 0x7f6d1415e790 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6d140ce9e0 tx=0x7f6d0802a270 comp rx=0 tx=0).stop 2024-09-13T18:36:26.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 -- 172.21.15.192:0/2930653649 shutdown_connections 2024-09-13T18:36:26.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 --2- 172.21.15.192:0/2930653649 >> v2:172.21.15.194:3300/0 conn(0x7f6d140cb0b0 0x7f6d1415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 --2- 172.21.15.192:0/2930653649 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cacd0 0x7f6d1415e790 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 -- 172.21.15.192:0/2930653649 >> 172.21.15.192:0/2930653649 conn(0x7f6d140ae960 msgr2=0x7f6d1406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 -- 172.21.15.192:0/2930653649 shutdown_connections 2024-09-13T18:36:26.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.704+0000 7f6d1c200640 1 -- 172.21.15.192:0/2930653649 wait complete. 2024-09-13T18:36:26.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.706+0000 7f6d1c200640 1 Processor -- start 2024-09-13T18:36:26.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.706+0000 7f6d1c200640 1 -- start start 2024-09-13T18:36:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d140cacd0 0x7f6d1413cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d14140980 0x7f6d140ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14159940 con 0x7f6d140cb0b0 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14158d30 con 0x7f6d140cacd0 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d14159010 con 0x7f6d14140980 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58028/0 (socket says 172.21.15.192:58028) 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 -- 172.21.15.192:0/1108453122 learned_addr learned my addr 172.21.15.192:0/1108453122 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d19800640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d140cacd0 0x7f6d1413cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d1a200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d14140980 0x7f6d140ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 -- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d14140980 msgr2=0x7f6d140ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d14140980 0x7f6d140ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 -- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d140cacd0 msgr2=0x7f6d1413cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d140cacd0 0x7f6d1413cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.707+0000 7f6d18e00640 1 -- 172.21.15.192:0/1108453122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d080094d0 con 0x7f6d140cb0b0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d18e00640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e9b0 tx=0x7f6d0000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00009670 con 0x7f6d140cb0b0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d0000c9a0 con 0x7f6d140cb0b0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d0000cd50 con 0x7f6d140cb0b0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d141592f0 con 0x7f6d140cb0b0 2024-09-13T18:36:26.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.708+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d140ca960 con 0x7f6d140cb0b0 2024-09-13T18:36:26.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.709+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d1415bc20 con 0x7f6d140cb0b0 2024-09-13T18:36:26.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.710+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d00013470 con 0x7f6d140cb0b0 2024-09-13T18:36:26.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.711+0000 7f6d11600640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 0x7f6cf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:26.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.711+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d000895b0 con 0x7f6d140cb0b0 2024-09-13T18:36:26.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.711+0000 7f6d19800640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 0x7f6cf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:26.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.712+0000 7f6d19800640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 0x7f6cf406d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d08034000 tx=0x7f6d0802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:26.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.715+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d00054830 con 0x7f6d140cb0b0 2024-09-13T18:36:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.899+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d1406c6c0 con 0x7f6d140cb0b0 2024-09-13T18:36:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.899+0000 7f6d11600640 1 -- 172.21.15.192:0/1108453122 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6d00057e50 con 0x7f6d140cb0b0 2024-09-13T18:36:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:36:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 msgr2=0x7f6cf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 0x7f6cf406d0c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6d08034000 tx=0x7f6d0802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 msgr2=0x7f6d140ca420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000e9b0 tx=0x7f6d0000ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 shutdown_connections 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cf406ac00 0x7f6cf406d0c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d14140980 0x7f6d140ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d140cb0b0 0x7f6d140ca420 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 --2- 172.21.15.192:0/1108453122 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d140cacd0 0x7f6d1413cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 >> 172.21.15.192:0/1108453122 conn(0x7f6d140ae960 msgr2=0x7f6d1415cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 shutdown_connections 2024-09-13T18:36:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:26.901+0000 7f6d1c200640 1 -- 172.21.15.192:0/1108453122 wait complete. 2024-09-13T18:36:26.919 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-13T18:36:26.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:26.920 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-13T18:36:26.981 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:36:26.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:26.981 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-13T18:36:27.017 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:27.017 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.057 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:27.058 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.135 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:27.136 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:27.212 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:27.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.362+0000 7f7cb0800640 1 Processor -- start 2024-09-13T18:36:27.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.362+0000 7f7cb0800640 1 -- start start 2024-09-13T18:36:27.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.363+0000 7f7cb0800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cacd0 0x7f7ca815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cb0800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ca815bc20 0x7f7ca80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cb0800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ca8140480 con 0x7f7ca80cb0b0 2024-09-13T18:36:27.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cb0800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ca815ee90 con 0x7f7ca815bc20 2024-09-13T18:36:27.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cb0800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca815f170 con 0x7f7ca80cacd0 2024-09-13T18:36:27.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cae800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7ca815bc20 0x7f7ca80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cad400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7ca80cb0b0 0x7f7ca8140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56696/0 (socket says 172.21.15.192:56696) 2024-09-13T18:36:27.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cad400640 1 -- 172.21.15.192:0/3326570806 learned_addr learned my addr 172.21.15.192:0/3326570806 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cade00640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cacd0 0x7f7ca815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cae800640 1 -- 172.21.15.192:0/3326570806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cacd0 msgr2=0x7f7ca815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cae800640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cacd0 0x7f7ca815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cae800640 1 -- 172.21.15.192:0/3326570806 >> v1:172.21.15.192:6789/0 conn(0x7f7ca80cb0b0 legacy=0x7f7ca8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7cae800640 1 -- 172.21.15.192:0/3326570806 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca815f450 con 0x7f7ca815bc20 2024-09-13T18:36:27.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.364+0000 7f7caca00640 1 -- 172.21.15.192:0/3326570806 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523300011 0 0) 0x7f7ca8140480 con 0x7f7ca80cb0b0 2024-09-13T18:36:27.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.365+0000 7f7cae800640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca815bc20 0x7f7ca80afd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf35a73bda197061 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7caca00640 1 -- 172.21.15.192:0/3326570806 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007740 con 0x7f7ca815bc20 2024-09-13T18:36:27.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7caca00640 1 -- 172.21.15.192:0/3326570806 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca402d050 con 0x7f7ca815bc20 2024-09-13T18:36:27.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7caca00640 1 -- 172.21.15.192:0/3326570806 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4007ac0 con 0x7f7ca815bc20 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 -- 172.21.15.192:0/3326570806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca815bc20 msgr2=0x7f7ca80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca815bc20 0x7f7ca80afd80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4009d90 tx=0x7f7ca402a660 comp rx=0 tx=0).stop 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 -- 172.21.15.192:0/3326570806 shutdown_connections 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca815bc20 0x7f7ca80afd80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 --2- 172.21.15.192:0/3326570806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cacd0 0x7f7ca815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 -- 172.21.15.192:0/3326570806 >> 172.21.15.192:0/3326570806 conn(0x7f7ca80ae960 msgr2=0x7f7ca806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 -- 172.21.15.192:0/3326570806 shutdown_connections 2024-09-13T18:36:27.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.366+0000 7f7cb0800640 1 -- 172.21.15.192:0/3326570806 wait complete. 2024-09-13T18:36:27.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.368+0000 7f7cb0800640 1 Processor -- start 2024-09-13T18:36:27.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.368+0000 7f7cb0800640 1 -- start start 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cb0b0 0x7f7ca813c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 0x7f7ca813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca813d360 con 0x7f7ca80cacd0 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80cc400 con 0x7f7ca815bc20 2024-09-13T18:36:27.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cb0800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca80cc6e0 con 0x7f7ca80cb0b0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cade00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cade00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58052/0 (socket says 172.21.15.192:58052) 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cade00640 1 -- 172.21.15.192:0/249469207 learned_addr learned my addr 172.21.15.192:0/249469207 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cad400640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cb0b0 0x7f7ca813c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.369+0000 7f7cae800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 0x7f7ca813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 -- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cb0b0 msgr2=0x7f7ca813c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cb0b0 0x7f7ca813c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 -- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 msgr2=0x7f7ca813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 0x7f7ca813ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 -- 172.21.15.192:0/249469207 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca4009a70 con 0x7f7ca80cacd0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cae800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 0x7f7ca813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cade00640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00d5f0 tx=0x7f7c9c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c0125f0 con 0x7f7ca80cacd0 2024-09-13T18:36:27.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c012750 con 0x7f7ca80cacd0 2024-09-13T18:36:27.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ca80cc9c0 con 0x7f7ca80cacd0 2024-09-13T18:36:27.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c012b00 con 0x7f7ca80cacd0 2024-09-13T18:36:27.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.370+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ca80ccf80 con 0x7f7ca80cacd0 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.371+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ca80cd140 con 0x7f7ca80cacd0 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.372+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c9c012c60 con 0x7f7ca80cacd0 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.373+0000 7f7ca2000640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.373+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7c9c089710 con 0x7f7ca80cacd0 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.373+0000 7f7cad400640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.374+0000 7f7cad400640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ca813fef0 tx=0x7f7c98007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.377+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c9c054960 con 0x7f7ca80cacd0 2024-09-13T18:36:27.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.544+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ca815e790 con 0x7f7ca80cacd0 2024-09-13T18:36:27.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.545+0000 7f7ca2000640 1 -- 172.21.15.192:0/249469207 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f7c9c057f80 con 0x7f7ca80cacd0 2024-09-13T18:36:27.548 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:27.549 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":22,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:26.918470+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.547+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 msgr2=0x7f7c8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.547+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ca813fef0 tx=0x7f7c98007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.547+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 msgr2=0x7f7ca80adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.547+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c00d5f0 tx=0x7f7c9c00dab0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 shutdown_connections 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7ca815bc20 0x7f7ca813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7ca80cb0b0 0x7f7ca813c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 --2- 172.21.15.192:0/249469207 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ca80cacd0 0x7f7ca80adab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 >> 172.21.15.192:0/249469207 conn(0x7f7ca80ae960 msgr2=0x7f7ca815b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 shutdown_connections 2024-09-13T18:36:27.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.548+0000 7f7cb0800640 1 -- 172.21.15.192:0/249469207 wait complete. 2024-09-13T18:36:27.567 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:27.567 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:27.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.720+0000 7f1fc7000640 1 Processor -- start 2024-09-13T18:36:27.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.720+0000 7f1fc7000640 1 -- start start 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fc7000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1fc00b3af0 0x7f1fc015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fc7000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00b2000 con 0x7f1fc01589f0 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fc7000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fc00b2ba0 con 0x7f1fc006c0b0 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fc7000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fc015bbd0 con 0x7f1fc00b3af0 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fbfe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1fc01589f0 0x7f1fc00b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56710/0 (socket says 172.21.15.192:56710) 2024-09-13T18:36:27.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.721+0000 7f1fbfe00640 1 -- 172.21.15.192:0/2347538217 learned_addr learned my addr 172.21.15.192:0/2347538217 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:27.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fb7e00640 1 --2- 172.21.15.192:0/2347538217 >> v2:172.21.15.194:3300/0 conn(0x7f1fc00b3af0 0x7f1fc015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2214345133 0 0) 0x7f1fc00b2000 con 0x7f1fc01589f0 2024-09-13T18:36:27.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fa4003520 con 0x7f1fc01589f0 2024-09-13T18:36:27.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 656008805 0 0) 0x7f1fa4003520 con 0x7f1fc01589f0 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 >> v2:172.21.15.194:3300/0 conn(0x7f1fc00b3af0 msgr2=0x7f1fc015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 --2- 172.21.15.192:0/2347538217 >> v2:172.21.15.194:3300/0 conn(0x7f1fc00b3af0 0x7f1fc015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 >> v1:172.21.15.194:6789/0 conn(0x7f1fc006c0b0 legacy=0x7f1fc00cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc015beb0 con 0x7f1fc01589f0 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f1fb0001670 con 0x7f1fc01589f0 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 >> v1:172.21.15.192:6789/0 conn(0x7f1fc01589f0 legacy=0x7f1fc00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fa4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa40047c0 0x7f1fa4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4005180 0x7f1fa400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc015bbd0 con 0x7f1fa4003970 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400c120 con 0x7f1fa4005180 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa400c2e0 con 0x7f1fa40047c0 2024-09-13T18:36:27.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.722+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fa4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fb7e00640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa40047c0 0x7f1fa4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fc5000640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4005180 0x7f1fa400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fbfe00640 1 -- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa40047c0 msgr2=0x7f1fa4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa40047c0 0x7f1fa4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fbfe00640 1 -- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4005180 msgr2=0x7f1fa400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4005180 0x7f1fa400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fbfe00640 1 -- 172.21.15.192:0/2347538217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa4003520 con 0x7f1fa4003970 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fc5000640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa4005180 0x7f1fa400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.723+0000 7f1fc5000640 1 -- 172.21.15.192:0/2347538217 reap_dead start 2024-09-13T18:36:27.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.724+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fa4003d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c240 tx=0x7f1fa40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2856cca113ce3637 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.724+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb002e070 con 0x7f1fa4003970 2024-09-13T18:36:27.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.724+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb00058d0 con 0x7f1fa4003970 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.724+0000 7f1fbf400640 1 -- 172.21.15.192:0/2347538217 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0005d00 con 0x7f1fa4003970 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 -- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 msgr2=0x7f1fa4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fa4003d90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1fb000c240 tx=0x7f1fa40057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 -- 172.21.15.192:0/2347538217 shutdown_connections 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 --2- 172.21.15.192:0/2347538217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fa4003d90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 -- 172.21.15.192:0/2347538217 >> 172.21.15.192:0/2347538217 conn(0x7f1fc00b08f0 msgr2=0x7f1fc00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 -- 172.21.15.192:0/2347538217 shutdown_connections 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.725+0000 7f1fc7000640 1 -- 172.21.15.192:0/2347538217 wait complete. 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.726+0000 7f1fc7000640 1 Processor -- start 2024-09-13T18:36:27.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.727+0000 7f1fc7000640 1 -- start start 2024-09-13T18:36:27.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.727+0000 7f1fc7000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.727+0000 7f1fc7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc01524f0 0x7f1fc00adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fc7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fc014d2a0 0x7f1fc014d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fc7000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc014dc90 con 0x7f1fa4003970 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fc7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc006b0e0 con 0x7f1fc01524f0 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fc7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc006b3c0 con 0x7f1fc014d2a0 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58084/0 (socket says 172.21.15.192:58084) 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 -- 172.21.15.192:0/1191043535 learned_addr learned my addr 172.21.15.192:0/1191043535 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fb7e00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc01524f0 0x7f1fc00adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fc5000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fc014d2a0 0x7f1fc014d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 -- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fc014d2a0 msgr2=0x7f1fc014d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fc014d2a0 0x7f1fc014d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 -- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc01524f0 msgr2=0x7f1fc00adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc01524f0 0x7f1fc00adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 -- 172.21.15.192:0/1191043535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fc006b6a0 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.728+0000 7f1fbfe00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fb002ad70 tx=0x7f1fb0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.729+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0004e10 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.729+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fb0000ed0 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.729+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fb0005260 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.729+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc006b980 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.729+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc006adf0 con 0x7f1fa4003970 2024-09-13T18:36:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.730+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc00b2490 con 0x7f1fa4003970 2024-09-13T18:36:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.731+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fb00053c0 con 0x7f1fa4003970 2024-09-13T18:36:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.731+0000 7f1fbcc00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.731+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1fb00a8600 con 0x7f1fa4003970 2024-09-13T18:36:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.732+0000 7f1fb7e00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.732+0000 7f1fb7e00640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00b2a40 tx=0x7f1fa8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:27.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.736+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1fb0073960 con 0x7f1fa4003970 2024-09-13T18:36:27.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.906+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fc00cc0b0 con 0x7f1fa4003970 2024-09-13T18:36:27.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.907+0000 7f1fbcc00640 1 -- 172.21.15.192:0/1191043535 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fb0076f80 con 0x7f1fa4003970 2024-09-13T18:36:27.910 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:27.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 msgr2=0x7f1f9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00b2a40 tx=0x7f1fa8009190 comp rx=0 tx=0).stop 2024-09-13T18:36:27.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 msgr2=0x7f1fc006a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:27.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1fb002ad70 tx=0x7f1fb0001a00 comp rx=0 tx=0).stop 2024-09-13T18:36:27.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 shutdown_connections 2024-09-13T18:36:27.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f9c06ac30 0x7f1f9c06d0f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fc014d2a0 0x7f1fc014d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fc01524f0 0x7f1fc00adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 --2- 172.21.15.192:0/1191043535 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa4003970 0x7f1fc006a8b0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 >> 172.21.15.192:0/1191043535 conn(0x7f1fc00b08f0 msgr2=0x7f1fc00b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 shutdown_connections 2024-09-13T18:36:27.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:27.909+0000 7f1fc7000640 1 -- 172.21.15.192:0/1191043535 wait complete. 2024-09-13T18:36:27.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.081+0000 7f7cf6e00640 1 Processor -- start 2024-09-13T18:36:28.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.082+0000 7f7cf6e00640 1 -- start start 2024-09-13T18:36:28.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 0x7f7cf00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7cf00b2d90 0x7f7cf00afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf00b0570 con 0x7f7cf00b0120 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf006f940 con 0x7f7cf00b2d90 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf006f610 con 0x7f7cf0142e00 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7cf00b0120 0x7f7cf015d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56724/0 (socket says 172.21.15.192:56724) 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf6400640 1 -- 172.21.15.192:0/3892192586 learned_addr learned my addr 172.21.15.192:0/3892192586 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf5000640 1 --2- 172.21.15.192:0/3892192586 >> v2:172.21.15.194:3300/0 conn(0x7f7cf00b2d90 0x7f7cf00afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.083+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/3892192586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 0x7f7cf00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cefe00640 1 -- 172.21.15.192:0/3892192586 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383715575 0 0) 0x7f7ce8001490 con 0x7f7cf00b0120 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cefe00640 1 -- 172.21.15.192:0/3892192586 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd8003520 con 0x7f7cf00b0120 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cf5a00640 1 -- 172.21.15.192:0/3892192586 >> v2:172.21.15.194:3300/0 conn(0x7f7cf00b2d90 msgr2=0x7f7cf00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:28.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/3892192586 >> v2:172.21.15.194:3300/0 conn(0x7f7cf00b2d90 0x7f7cf00afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cf5a00640 1 -- 172.21.15.192:0/3892192586 >> v1:172.21.15.192:6789/0 conn(0x7f7cf00b0120 legacy=0x7f7cf015d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.084+0000 7f7cf5a00640 1 -- 172.21.15.192:0/3892192586 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00b3530 con 0x7f7cf0142e00 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.085+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/3892192586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 0x7f7cf00b4910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40097a0 tx=0x7f7ce402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c420856dd5b0f3d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.085+0000 7f7cefe00640 1 -- 172.21.15.192:0/3892192586 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4032440 con 0x7f7cf0142e00 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.085+0000 7f7cefe00640 1 -- 172.21.15.192:0/3892192586 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce40325a0 con 0x7f7cf0142e00 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.085+0000 7f7cefe00640 1 -- 172.21.15.192:0/3892192586 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4032930 con 0x7f7cf0142e00 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 -- 172.21.15.192:0/3892192586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 msgr2=0x7f7cf00b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/3892192586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 0x7f7cf00b4910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40097a0 tx=0x7f7ce402a180 comp rx=0 tx=0).stop 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 -- 172.21.15.192:0/3892192586 shutdown_connections 2024-09-13T18:36:28.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/3892192586 >> v2:172.21.15.194:3300/0 conn(0x7f7cf00b2d90 0x7f7cf00afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/3892192586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf0142e00 0x7f7cf00b4910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 -- 172.21.15.192:0/3892192586 >> 172.21.15.192:0/3892192586 conn(0x7f7cf00ae7f0 msgr2=0x7f7cf006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 -- 172.21.15.192:0/3892192586 shutdown_connections 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.086+0000 7f7cf6e00640 1 -- 172.21.15.192:0/3892192586 wait complete. 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.087+0000 7f7cf6e00640 1 Processor -- start 2024-09-13T18:36:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.087+0000 7f7cf6e00640 1 -- start start 2024-09-13T18:36:28.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 0x7f7cf0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 0x7f7cf01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf015df40 con 0x7f7cf00b2d90 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0159a30 con 0x7f7cf0142e00 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.088+0000 7f7cf6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf0158220 con 0x7f7cf00b0120 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58086/0 (socket says 172.21.15.192:58086) 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 -- 172.21.15.192:0/1552273354 learned_addr learned my addr 172.21.15.192:0/1552273354 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 0x7f7cf0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf6400640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 0x7f7cf01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 -- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 msgr2=0x7f7cf0156760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 0x7f7cf0156760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 -- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 msgr2=0x7f7cf01416f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 0x7f7cf01416f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 -- 172.21.15.192:0/1552273354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4009400 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf6400640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 0x7f7cf01416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 0x7f7cf0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7cf5000640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00e870 tx=0x7f7cdc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.089+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0094f0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.090+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cdc00c940 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.090+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc00ccf0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.090+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf01578f0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.090+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf0157eb0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.091+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf006c9a0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.092+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7cdc013470 con 0x7f7cf00b2d90 2024-09-13T18:36:28.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.092+0000 7f7ced600640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 0x7f7cd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.093+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f7cdc089560 con 0x7f7cf00b2d90 2024-09-13T18:36:28.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.093+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 0x7f7cd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.093+0000 7f7cf5a00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 0x7f7cd006d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4034000 tx=0x7f7ce402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.097+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7cdc054600 con 0x7f7cf00b2d90 2024-09-13T18:36:28.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.268+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cf00719b0 con 0x7f7cf00b2d90 2024-09-13T18:36:28.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.269+0000 7f7ced600640 1 -- 172.21.15.192:0/1552273354 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cdc057c20 con 0x7f7cf00b2d90 2024-09-13T18:36:28.272 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:28.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 msgr2=0x7f7cd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 0x7f7cd006d0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4034000 tx=0x7f7ce402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:28.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 msgr2=0x7f7cf01411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00e870 tx=0x7f7cdc00ed30 comp rx=0 tx=0).stop 2024-09-13T18:36:28.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 shutdown_connections 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7cd006ac00 0x7f7cd006d0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cf0142e00 0x7f7cf01416f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cf00b2d90 0x7f7cf01411b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 --2- 172.21.15.192:0/1552273354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cf00b0120 0x7f7cf0156760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 >> 172.21.15.192:0/1552273354 conn(0x7f7cf00ae7f0 msgr2=0x7f7cf0069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 shutdown_connections 2024-09-13T18:36:28.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.271+0000 7f7cf6e00640 1 -- 172.21.15.192:0/1552273354 wait complete. 2024-09-13T18:36:28.289 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:28.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.441+0000 7f2b67c00640 1 Processor -- start 2024-09-13T18:36:28.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.441+0000 7f2b67c00640 1 -- start start 2024-09-13T18:36:28.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b67c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2b600cdf60 0x7f2b600ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b67c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 0x7f2b600b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b67c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b6015a8e0 con 0x7f2b600cb330 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b67c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b600b2fe0 con 0x7f2b600cdf60 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b67c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b600b26b0 con 0x7f2b600b3470 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b65200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2b600cb330 0x7f2b6006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56726/0 (socket says 172.21.15.192:56726) 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.442+0000 7f2b65200640 1 -- 172.21.15.192:0/1983636204 learned_addr learned my addr 172.21.15.192:0/1983636204 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1983636204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 0x7f2b600b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b5fe00640 1 --2- 172.21.15.192:0/1983636204 >> v2:172.21.15.194:3300/0 conn(0x7f2b600cdf60 0x7f2b600ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b5f400640 1 -- 172.21.15.192:0/1983636204 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305353860 0 0) 0x7f2b6015a8e0 con 0x7f2b600cb330 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b5f400640 1 -- 172.21.15.192:0/1983636204 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b48003520 con 0x7f2b600cb330 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b65c00640 1 -- 172.21.15.192:0/1983636204 >> v2:172.21.15.194:3300/0 conn(0x7f2b600cdf60 msgr2=0x7f2b600ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1983636204 >> v2:172.21.15.194:3300/0 conn(0x7f2b600cdf60 0x7f2b600ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b65c00640 1 -- 172.21.15.192:0/1983636204 >> v1:172.21.15.192:6789/0 conn(0x7f2b600cb330 legacy=0x7f2b6006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.443+0000 7f2b65c00640 1 -- 172.21.15.192:0/1983636204 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b600b2990 con 0x7f2b600b3470 2024-09-13T18:36:28.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.444+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1983636204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 0x7f2b600b3870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b580097a0 tx=0x7f2b5802a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7687c6753dcf404b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.444+0000 7f2b5f400640 1 -- 172.21.15.192:0/1983636204 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5802adb0 con 0x7f2b600b3470 2024-09-13T18:36:28.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b5f400640 1 -- 172.21.15.192:0/1983636204 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b58032440 con 0x7f2b600b3470 2024-09-13T18:36:28.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b5f400640 1 -- 172.21.15.192:0/1983636204 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580327b0 con 0x7f2b600b3470 2024-09-13T18:36:28.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 -- 172.21.15.192:0/1983636204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 msgr2=0x7f2b600b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1983636204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 0x7f2b600b3870 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2b580097a0 tx=0x7f2b5802a060 comp rx=0 tx=0).stop 2024-09-13T18:36:28.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 -- 172.21.15.192:0/1983636204 shutdown_connections 2024-09-13T18:36:28.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1983636204 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600b3470 0x7f2b600b3870 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1983636204 >> v2:172.21.15.194:3300/0 conn(0x7f2b600cdf60 0x7f2b600ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 -- 172.21.15.192:0/1983636204 >> 172.21.15.192:0/1983636204 conn(0x7f2b600b08f0 msgr2=0x7f2b600b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 -- 172.21.15.192:0/1983636204 shutdown_connections 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.445+0000 7f2b67c00640 1 -- 172.21.15.192:0/1983636204 wait complete. 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.447+0000 7f2b67c00640 1 Processor -- start 2024-09-13T18:36:28.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.447+0000 7f2b67c00640 1 -- start start 2024-09-13T18:36:28.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 0x7f2b60070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600cb330 0x7f2b60154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60141ef0 con 0x7f2b600cdf60 2024-09-13T18:36:28.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60153560 con 0x7f2b600b3470 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b67c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60156240 con 0x7f2b600cb330 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58098/0 (socket says 172.21.15.192:58098) 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 -- 172.21.15.192:0/1138041824 learned_addr learned my addr 172.21.15.192:0/1138041824 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65200640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 0x7f2b60070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b5fe00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600cb330 0x7f2b60154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 -- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600cb330 msgr2=0x7f2b60154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600cb330 0x7f2b60154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 -- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 msgr2=0x7f2b60070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 0x7f2b60070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65c00640 1 -- 172.21.15.192:0/1138041824 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58009400 con 0x7f2b600cdf60 2024-09-13T18:36:28.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.448+0000 7f2b65200640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 0x7f2b60070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b65c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b580098c0 tx=0x7f2b580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5803c810 con 0x7f2b600cdf60 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b5803c970 con 0x7f2b600cdf60 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5803cd00 con 0x7f2b600cdf60 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b601537b0 con 0x7f2b600cdf60 2024-09-13T18:36:28.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.449+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b60070570 con 0x7f2b600cdf60 2024-09-13T18:36:28.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.450+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60070730 con 0x7f2b600cdf60 2024-09-13T18:36:28.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.451+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b5803b3a0 con 0x7f2b600cdf60 2024-09-13T18:36:28.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.452+0000 7f2b5cc00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 0x7f2b4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.452+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2b580a9f10 con 0x7f2b600cdf60 2024-09-13T18:36:28.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.452+0000 7f2b65200640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 0x7f2b4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.453+0000 7f2b65200640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 0x7f2b4006d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005c00 tx=0x7f2b54009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.456+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b58075190 con 0x7f2b600cdf60 2024-09-13T18:36:28.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.626+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2b60153cd0 con 0x7f2b600cdf60 2024-09-13T18:36:28.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.626+0000 7f2b5cc00640 1 -- 172.21.15.192:0/1138041824 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2b5803ce60 con 0x7f2b600cdf60 2024-09-13T18:36:28.629 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:28.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.628+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 msgr2=0x7f2b4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.628+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 0x7f2b4006d0c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2b54005c00 tx=0x7f2b54009040 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.628+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 msgr2=0x7f2b60154540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.628+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b580098c0 tx=0x7f2b580046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 shutdown_connections 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b4006ac00 0x7f2b4006d0c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b600cdf60 0x7f2b60154540 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b600cb330 0x7f2b60154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 --2- 172.21.15.192:0/1138041824 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b600b3470 0x7f2b60070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 >> 172.21.15.192:0/1138041824 conn(0x7f2b600b08f0 msgr2=0x7f2b60157540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 shutdown_connections 2024-09-13T18:36:28.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.629+0000 7f2b67c00640 1 -- 172.21.15.192:0/1138041824 wait complete. 2024-09-13T18:36:28.647 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:36:28.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.798+0000 7f1a4a000640 1 Processor -- start 2024-09-13T18:36:28.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.798+0000 7f1a4a000640 1 -- start start 2024-09-13T18:36:28.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.799+0000 7f1a4a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a440cacd0 0x7f1a4415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.799+0000 7f1a4a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a440cb0b0 0x7f1a4415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.799+0000 7f1a4a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a44140480 con 0x7f1a44140980 2024-09-13T18:36:28.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.799+0000 7f1a4a000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4415c160 con 0x7f1a440cacd0 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.799+0000 7f1a4a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a440cb520 con 0x7f1a440cb0b0 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1a44140980 0x7f1a440afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56732/0 (socket says 172.21.15.192:56732) 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43e00640 1 -- 172.21.15.192:0/3345472721 learned_addr learned my addr 172.21.15.192:0/3345472721 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43400640 1 --2- 172.21.15.192:0/3345472721 >> v2:172.21.15.192:3300/0 conn(0x7f1a440cacd0 0x7f1a4415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a3aa00640 1 --2- 172.21.15.192:0/3345472721 >> v2:172.21.15.194:3300/0 conn(0x7f1a440cb0b0 0x7f1a4415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a42a00640 1 -- 172.21.15.192:0/3345472721 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013248079 0 0) 0x7f1a44140480 con 0x7f1a44140980 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43400640 1 -- 172.21.15.192:0/3345472721 >> v2:172.21.15.194:3300/0 conn(0x7f1a440cb0b0 msgr2=0x7f1a4415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43400640 1 --2- 172.21.15.192:0/3345472721 >> v2:172.21.15.194:3300/0 conn(0x7f1a440cb0b0 0x7f1a4415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43400640 1 -- 172.21.15.192:0/3345472721 >> v1:172.21.15.192:6789/0 conn(0x7f1a44140980 legacy=0x7f1a440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.800+0000 7f1a43400640 1 -- 172.21.15.192:0/3345472721 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4415ee90 con 0x7f1a440cacd0 2024-09-13T18:36:28.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.801+0000 7f1a43400640 1 --2- 172.21.15.192:0/3345472721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4415e790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a440ce9e0 tx=0x7f1a3402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89f62ce0da2440b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a42a00640 1 -- 172.21.15.192:0/3345472721 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34032440 con 0x7f1a440cacd0 2024-09-13T18:36:28.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a42a00640 1 -- 172.21.15.192:0/3345472721 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a340325a0 con 0x7f1a440cacd0 2024-09-13T18:36:28.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a42a00640 1 -- 172.21.15.192:0/3345472721 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34032930 con 0x7f1a440cacd0 2024-09-13T18:36:28.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 -- 172.21.15.192:0/3345472721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 msgr2=0x7f1a4415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 --2- 172.21.15.192:0/3345472721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4415e790 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a440ce9e0 tx=0x7f1a3402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 -- 172.21.15.192:0/3345472721 shutdown_connections 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 --2- 172.21.15.192:0/3345472721 >> v2:172.21.15.194:3300/0 conn(0x7f1a440cb0b0 0x7f1a4415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 --2- 172.21.15.192:0/3345472721 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4415e790 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 -- 172.21.15.192:0/3345472721 >> 172.21.15.192:0/3345472721 conn(0x7f1a440ae960 msgr2=0x7f1a4406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 -- 172.21.15.192:0/3345472721 shutdown_connections 2024-09-13T18:36:28.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.802+0000 7f1a4a000640 1 -- 172.21.15.192:0/3345472721 wait complete. 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.804+0000 7f1a4a000640 1 Processor -- start 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.804+0000 7f1a4a000640 1 -- start start 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a440cb0b0 0x7f1a4406b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44140980 0x7f1a4406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44159640 con 0x7f1a440cacd0 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a441f6ca0 con 0x7f1a44140980 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a4a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a44158d10 con 0x7f1a440cb0b0 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a43400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a43400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58114/0 (socket says 172.21.15.192:58114) 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a43400640 1 -- 172.21.15.192:0/2531100759 learned_addr learned my addr 172.21.15.192:0/2531100759 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.805+0000 7f1a43e00640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44140980 0x7f1a4406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a3aa00640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a440cb0b0 0x7f1a4406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 -- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a440cb0b0 msgr2=0x7f1a4406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a440cb0b0 0x7f1a4406b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 -- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44140980 msgr2=0x7f1a4406b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44140980 0x7f1a4406b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:28.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 -- 172.21.15.192:0/2531100759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a34009400 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a43400640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000c00 tx=0x7f1a340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004230 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a340043b0 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004520 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a44158ff0 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.806+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4413d920 con 0x7f1a440cacd0 2024-09-13T18:36:28.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.807+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4415bc20 con 0x7f1a440cacd0 2024-09-13T18:36:28.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.808+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a34039050 con 0x7f1a440cacd0 2024-09-13T18:36:28.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.809+0000 7f1a3be00640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 0x7f1a2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:28.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.809+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1a340a9de0 con 0x7f1a440cacd0 2024-09-13T18:36:28.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.809+0000 7f1a3aa00640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 0x7f1a2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:28.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.810+0000 7f1a3aa00640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 0x7f1a2006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a440b4e80 tx=0x7f1a2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:28.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.814+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a34074f00 con 0x7f1a440cacd0 2024-09-13T18:36:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.999+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a4406c6c0 con 0x7f1a440cacd0 2024-09-13T18:36:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:28.999+0000 7f1a3be00640 1 -- 172.21.15.192:0/2531100759 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1a3404b020 con 0x7f1a440cacd0 2024-09-13T18:36:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:36:29.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 msgr2=0x7f1a2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 0x7f1a2006d0c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1a440b4e80 tx=0x7f1a2c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 msgr2=0x7f1a4413d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1a34000c00 tx=0x7f1a340046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 shutdown_connections 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.001+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2006ac00 0x7f1a2006d0c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a44140980 0x7f1a4406b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a440cb0b0 0x7f1a4406b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 --2- 172.21.15.192:0/2531100759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a440cacd0 0x7f1a4413d3e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 >> 172.21.15.192:0/2531100759 conn(0x7f1a440ae960 msgr2=0x7f1a4415e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 shutdown_connections 2024-09-13T18:36:29.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.002+0000 7f1a4a000640 1 -- 172.21.15.192:0/2531100759 wait complete. 2024-09-13T18:36:29.021 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-13T18:36:29.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:29.021 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-13T18:36:29.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:36:29.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:29.088 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-13T18:36:29.126 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:36:29.126 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.274+0000 7f1654a00640 1 Processor -- start 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.274+0000 7f1654a00640 1 -- start start 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16500cacd0 0x7f165015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500cb0b0 0x7f165015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1650140980 0x7f1650140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165015c160 con 0x7f16500cb0b0 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1650140480 con 0x7f16500cacd0 2024-09-13T18:36:29.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f1654a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16500cb520 con 0x7f1650140980 2024-09-13T18:36:29.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f164d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500cb0b0 0x7f165015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f164d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500cb0b0 0x7f165015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58126/0 (socket says 172.21.15.192:58126) 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.275+0000 7f164d400640 1 -- 172.21.15.192:0/34526491 learned_addr learned my addr 172.21.15.192:0/34526491 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164e800640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1650140980 0x7f1650140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164de00640 1 --2- 172.21.15.192:0/34526491 >> v2:172.21.15.194:3300/0 conn(0x7f16500cacd0 0x7f165015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164d400640 1 -- 172.21.15.192:0/34526491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1650140980 msgr2=0x7f1650140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164d400640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1650140980 0x7f1650140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164d400640 1 -- 172.21.15.192:0/34526491 >> v2:172.21.15.194:3300/0 conn(0x7f16500cacd0 msgr2=0x7f165015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164d400640 1 --2- 172.21.15.192:0/34526491 >> v2:172.21.15.194:3300/0 conn(0x7f16500cacd0 0x7f165015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.276+0000 7f164d400640 1 -- 172.21.15.192:0/34526491 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165015ee90 con 0x7f16500cb0b0 2024-09-13T18:36:29.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.277+0000 7f164d400640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cb0b0 0x7f165015bc20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f16500b2350 tx=0x7f163c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29378c7f572bab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.277+0000 7f164ca00640 1 -- 172.21.15.192:0/34526491 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c032440 con 0x7f16500cb0b0 2024-09-13T18:36:29.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.277+0000 7f164ca00640 1 -- 172.21.15.192:0/34526491 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163c0325a0 con 0x7f16500cb0b0 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.277+0000 7f164ca00640 1 -- 172.21.15.192:0/34526491 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163c032930 con 0x7f16500cb0b0 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 -- 172.21.15.192:0/34526491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cb0b0 msgr2=0x7f165015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cb0b0 0x7f165015bc20 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f16500b2350 tx=0x7f163c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 -- 172.21.15.192:0/34526491 shutdown_connections 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1650140980 0x7f1650140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 --2- 172.21.15.192:0/34526491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cb0b0 0x7f165015bc20 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 --2- 172.21.15.192:0/34526491 >> v2:172.21.15.194:3300/0 conn(0x7f16500cacd0 0x7f165015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 -- 172.21.15.192:0/34526491 >> 172.21.15.192:0/34526491 conn(0x7f16500ae960 msgr2=0x7f165006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 -- 172.21.15.192:0/34526491 shutdown_connections 2024-09-13T18:36:29.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.278+0000 7f1654a00640 1 -- 172.21.15.192:0/34526491 wait complete. 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.279+0000 7f1654a00640 1 Processor -- start 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 -- start start 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb0b0 0x7f165006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1650140980 0x7f165006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650157870 con 0x7f16500cacd0 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165013da50 con 0x7f1650140980 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.280+0000 7f1654a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650156c60 con 0x7f16500cb0b0 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58128/0 (socket says 172.21.15.192:58128) 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 -- 172.21.15.192:0/2795233521 learned_addr learned my addr 172.21.15.192:0/2795233521 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:29.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164d400640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb0b0 0x7f165006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164e800640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1650140980 0x7f165006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 -- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb0b0 msgr2=0x7f165006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb0b0 0x7f165006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 -- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1650140980 msgr2=0x7f165006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1650140980 0x7f165006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 -- 172.21.15.192:0/2795233521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163c0094d0 con 0x7f16500cacd0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.281+0000 7f164de00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164000e870 tx=0x7f164000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.282+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000ee60 con 0x7f16500cacd0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.282+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164000c940 con 0x7f16500cacd0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.282+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164000ccf0 con 0x7f16500cacd0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.282+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650156f40 con 0x7f16500cacd0 2024-09-13T18:36:29.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.282+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650157500 con 0x7f16500cacd0 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.283+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16501e4ac0 con 0x7f16500cacd0 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.284+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1640013470 con 0x7f16500cacd0 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.284+0000 7f1646000640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 0x7f163006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.285+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f16400893f0 con 0x7f16500cacd0 2024-09-13T18:36:29.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.285+0000 7f164d400640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 0x7f163006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.285+0000 7f164d400640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 0x7f163006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f163c034000 tx=0x7f163c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.289+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f16400545c0 con 0x7f16500cacd0 2024-09-13T18:36:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.489+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165015bc20 con 0x7f16500cacd0 2024-09-13T18:36:29.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.490+0000 7f1646000640 1 -- 172.21.15.192:0/2795233521 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f1640057be0 con 0x7f16500cacd0 2024-09-13T18:36:29.493 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:29.493 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:36:29.493 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:36:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 msgr2=0x7f163006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 0x7f163006d0c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f163c034000 tx=0x7f163c02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 msgr2=0x7f165013d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164000e870 tx=0x7f164000ed30 comp rx=0 tx=0).stop 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 shutdown_connections 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163006ac00 0x7f163006d0c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1650140980 0x7f165006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb0b0 0x7f165006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 --2- 172.21.15.192:0/2795233521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500cacd0 0x7f165013d510 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 >> 172.21.15.192:0/2795233521 conn(0x7f16500ae960 msgr2=0x7f1650070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 shutdown_connections 2024-09-13T18:36:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.492+0000 7f1654a00640 1 -- 172.21.15.192:0/2795233521 wait complete. 2024-09-13T18:36:29.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:29.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.661+0000 7f1a1fe00640 1 Processor -- start 2024-09-13T18:36:29.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.661+0000 7f1a1fe00640 1 -- start start 2024-09-13T18:36:29.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a200b3480 0x7f1a20159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a2006bc30 0x7f1a2015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a2015af60 con 0x7f1a20159b00 2024-09-13T18:36:29.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2006b7a0 con 0x7f1a200b3480 2024-09-13T18:36:29.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1fe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a2015ac80 con 0x7f1a2006bc30 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a200b3480 0x7f1a20159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a200b3480 0x7f1a20159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58132/0 (socket says 172.21.15.192:58132) 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 -- 172.21.15.192:0/259013737 learned_addr learned my addr 172.21.15.192:0/259013737 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a1f400640 1 --2- 172.21.15.192:0/259013737 >> v2:172.21.15.194:3300/0 conn(0x7f1a2006bc30 0x7f1a2015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 -- 172.21.15.192:0/259013737 >> v2:172.21.15.194:3300/0 conn(0x7f1a2006bc30 msgr2=0x7f1a2015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 --2- 172.21.15.192:0/259013737 >> v2:172.21.15.194:3300/0 conn(0x7f1a2006bc30 0x7f1a2015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 -- 172.21.15.192:0/259013737 >> v1:172.21.15.194:6789/0 conn(0x7f1a20159b00 legacy=0x7f1a200b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.663+0000 7f1a16000640 1 -- 172.21.15.192:0/259013737 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2006b150 con 0x7f1a200b3480 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.664+0000 7f1a16000640 1 --2- 172.21.15.192:0/259013737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a20159ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ccce0 tx=0x7f1a0802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455503a60b724db3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1e000640 1 -- 172.21.15.192:0/259013737 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08032440 con 0x7f1a200b3480 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1e000640 1 -- 172.21.15.192:0/259013737 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a080325a0 con 0x7f1a200b3480 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1e000640 1 -- 172.21.15.192:0/259013737 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08032930 con 0x7f1a200b3480 2024-09-13T18:36:29.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 -- 172.21.15.192:0/259013737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 msgr2=0x7f1a20159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/259013737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a20159ee0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1a200ccce0 tx=0x7f1a0802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 -- 172.21.15.192:0/259013737 shutdown_connections 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/259013737 >> v2:172.21.15.194:3300/0 conn(0x7f1a2006bc30 0x7f1a2015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/259013737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a20159ee0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 -- 172.21.15.192:0/259013737 >> 172.21.15.192:0/259013737 conn(0x7f1a200736d0 msgr2=0x7f1a200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 -- 172.21.15.192:0/259013737 shutdown_connections 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.665+0000 7f1a1fe00640 1 -- 172.21.15.192:0/259013737 wait complete. 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.667+0000 7f1a1fe00640 1 Processor -- start 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.667+0000 7f1a1fe00640 1 -- start start 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a2006bc30 0x7f1a2014c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a20159b00 0x7f1a200ad870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a2014e2c0 con 0x7f1a200b3480 2024-09-13T18:36:29.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20154780 con 0x7f1a2006bc30 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20153c00 con 0x7f1a20159b00 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a16000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a16000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58138/0 (socket says 172.21.15.192:58138) 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a16000640 1 -- 172.21.15.192:0/1476639734 learned_addr learned my addr 172.21.15.192:0/1476639734 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1ea00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a2006bc30 0x7f1a2014c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.668+0000 7f1a1f400640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a20159b00 0x7f1a200ad870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 -- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a20159b00 msgr2=0x7f1a200ad870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a20159b00 0x7f1a200ad870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 -- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a2006bc30 msgr2=0x7f1a2014c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a2006bc30 0x7f1a2014c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 -- 172.21.15.192:0/1476639734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080094d0 con 0x7f1a200b3480 2024-09-13T18:36:29.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a16000640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000c00 tx=0x7f1a080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a08032440 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a08030b80 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a0803d420 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.669+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a20153ee0 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.670+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a201544a0 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.671+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a2014e450 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.671+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a08039040 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.673+0000 7f1a17400640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 0x7f19fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.673+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1a080a9e20 con 0x7f1a200b3480 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.673+0000 7f1a1ea00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 0x7f19fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.673+0000 7f1a1ea00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 0x7f19fc06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a10006fd0 tx=0x7f1a10009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:29.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.677+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a2014e450 con 0x7f1a200b3480 2024-09-13T18:36:29.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.848+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a2014e400 con 0x7f1a200b3480 2024-09-13T18:36:29.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.849+0000 7f1a17400640 1 -- 172.21.15.192:0/1476639734 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f1a08075090 con 0x7f1a200b3480 2024-09-13T18:36:29.966 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:29.966 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":23,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:27.925064+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 msgr2=0x7f19fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 0x7f19fc06d0c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a10006fd0 tx=0x7f1a10009060 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 msgr2=0x7f1a201551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1a08000c00 tx=0x7f1a080046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 shutdown_connections 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19fc06ac00 0x7f19fc06d0c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a20159b00 0x7f1a200ad870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a200b3480 0x7f1a201551b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 --2- 172.21.15.192:0/1476639734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a2006bc30 0x7f1a2014c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 >> 172.21.15.192:0/1476639734 conn(0x7f1a200736d0 msgr2=0x7f1a200cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:29.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 shutdown_connections 2024-09-13T18:36:29.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:29.852+0000 7f1a1fe00640 1 -- 172.21.15.192:0/1476639734 wait complete. 2024-09-13T18:36:29.969 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:35:38.305854+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:35:39.200936+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:29.969 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:30.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.126+0000 7f33b7600640 1 Processor -- start 2024-09-13T18:36:30.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.126+0000 7f33b7600640 1 -- start start 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b7600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33b00d1100 0x7f33b00b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b7600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 0x7f33b0161050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b7600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b015ddd0 con 0x7f33b00d14e0 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b7600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b00cdf50 con 0x7f33b00d1100 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b7600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b00d1d80 con 0x7f33b00d2940 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b4c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33b00d1100 0x7f33b00b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b4c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33b00d1100 0x7f33b00b2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58150/0 (socket says 172.21.15.192:58150) 2024-09-13T18:36:30.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.127+0000 7f33b4c00640 1 -- 172.21.15.192:0/3003543720 learned_addr learned my addr 172.21.15.192:0/3003543720 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b5600640 1 --2- 172.21.15.192:0/3003543720 >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 0x7f33b0161050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b4c00640 1 -- 172.21.15.192:0/3003543720 >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 msgr2=0x7f33b0161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b4c00640 1 --2- 172.21.15.192:0/3003543720 >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 0x7f33b0161050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b4c00640 1 -- 172.21.15.192:0/3003543720 >> v1:172.21.15.194:6789/0 conn(0x7f33b00d14e0 legacy=0x7f33b0160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b4c00640 1 -- 172.21.15.192:0/3003543720 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b006aeb0 con 0x7f33b00d1100 2024-09-13T18:36:30.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.128+0000 7f33b5600640 1 --2- 172.21.15.192:0/3003543720 >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 0x7f33b0161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.129+0000 7f33b4c00640 1 --2- 172.21.15.192:0/3003543720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d1100 0x7f33b00b2260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33b00b5e10 tx=0x7f33a402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600415f1586a5565 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.129+0000 7f33af400640 1 -- 172.21.15.192:0/3003543720 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4032440 con 0x7f33b00d1100 2024-09-13T18:36:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.129+0000 7f33af400640 1 -- 172.21.15.192:0/3003543720 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a40325a0 con 0x7f33b00d1100 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.129+0000 7f33af400640 1 -- 172.21.15.192:0/3003543720 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a4032930 con 0x7f33b00d1100 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 -- 172.21.15.192:0/3003543720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d1100 msgr2=0x7f33b00b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 --2- 172.21.15.192:0/3003543720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d1100 0x7f33b00b2260 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f33b00b5e10 tx=0x7f33a402a230 comp rx=0 tx=0).stop 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 -- 172.21.15.192:0/3003543720 shutdown_connections 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 --2- 172.21.15.192:0/3003543720 >> v2:172.21.15.194:3300/0 conn(0x7f33b00d2940 0x7f33b0161050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 --2- 172.21.15.192:0/3003543720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d1100 0x7f33b00b2260 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 -- 172.21.15.192:0/3003543720 >> 172.21.15.192:0/3003543720 conn(0x7f33b00b4a20 msgr2=0x7f33b00b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 -- 172.21.15.192:0/3003543720 shutdown_connections 2024-09-13T18:36:30.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.130+0000 7f33b7600640 1 -- 172.21.15.192:0/3003543720 wait complete. 2024-09-13T18:36:30.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.131+0000 7f33b7600640 1 Processor -- start 2024-09-13T18:36:30.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 -- start start 2024-09-13T18:36:30.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 0x7f33b01526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 0x7f33b01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00ccde0 con 0x7f33b00d2940 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00b7080 con 0x7f33b00d1100 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.132+0000 7f33b7600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00b7360 con 0x7f33b00d14e0 2024-09-13T18:36:30.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58158/0 (socket says 172.21.15.192:58158) 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 -- 172.21.15.192:0/4173395740 learned_addr learned my addr 172.21.15.192:0/4173395740 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b4c00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 0x7f33b01526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33afe00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 0x7f33b01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 -- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 msgr2=0x7f33b01591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 0x7f33b01591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 -- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 msgr2=0x7f33b01526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 0x7f33b01526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 -- 172.21.15.192:0/4173395740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40094d0 con 0x7f33b00d2940 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b4c00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 0x7f33b01526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33afe00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 0x7f33b01591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.133+0000 7f33b5600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cd50 tx=0x7f33a800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.134+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800f680 con 0x7f33b00d2940 2024-09-13T18:36:30.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.134+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a800f800 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.134+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b00b7640 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.134+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a800fbb0 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.134+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01596e0 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.135+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b00cda00 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.136+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f33a800b040 con 0x7f33b00d2940 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.136+0000 7f33acc00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 0x7f339006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.137+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f33a8089d50 con 0x7f33b00d2940 2024-09-13T18:36:30.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.137+0000 7f33b4c00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 0x7f339006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.137+0000 7f33b4c00640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 0x7f339006d0f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f33a4034000 tx=0x7f33a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.141+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33a808d030 con 0x7f33b00d2940 2024-09-13T18:36:30.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.306+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33b00b4680 con 0x7f33b00d2940 2024-09-13T18:36:30.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.307+0000 7f33acc00640 1 -- 172.21.15.192:0/4173395740 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33a801d0a0 con 0x7f33b00d2940 2024-09-13T18:36:30.311 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:30.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 msgr2=0x7f339006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 0x7f339006d0f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f33a4034000 tx=0x7f33a402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 msgr2=0x7f33b00ca9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f33a800cd50 tx=0x7f33a800a650 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 shutdown_connections 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.309+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f339006ac30 0x7f339006d0f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33b00d2940 0x7f33b00ca9f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33b00d14e0 0x7f33b01591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 --2- 172.21.15.192:0/4173395740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33b00d1100 0x7f33b01526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 >> 172.21.15.192:0/4173395740 conn(0x7f33b00b4a20 msgr2=0x7f33b00704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 shutdown_connections 2024-09-13T18:36:30.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.310+0000 7f33b7600640 1 -- 172.21.15.192:0/4173395740 wait complete. 2024-09-13T18:36:30.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:36:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.481+0000 7f19a1a00640 1 Processor -- start 2024-09-13T18:36:30.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.481+0000 7f19a1a00640 1 -- start start 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f19a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 0x7f199c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f19a1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c06cc40 con 0x7f199c0b3bd0 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f19a1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c06b480 con 0x7f199c1434c0 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f19a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b4060 con 0x7f199c06c800 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f199b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f199c0b3bd0 0x7f199c06e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38766/0 (socket says 172.21.15.192:38766) 2024-09-13T18:36:30.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.482+0000 7f199b400640 1 -- 172.21.15.192:0/3602153350 learned_addr learned my addr 172.21.15.192:0/3602153350 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:30.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f199a000640 1 --2- 172.21.15.192:0/3602153350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 0x7f199c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2287175316 0 0) 0x7f199c06cc40 con 0x7f199c0b3bd0 2024-09-13T18:36:30.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1980003520 con 0x7f199c0b3bd0 2024-09-13T18:36:30.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662580033 0 0) 0x7f199c06b480 con 0x7f199c1434c0 2024-09-13T18:36:30.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c06cc40 con 0x7f199c1434c0 2024-09-13T18:36:30.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f199a000640 1 -- 172.21.15.192:0/3602153350 >> v1:172.21.15.194:6789/0 conn(0x7f199c1434c0 legacy=0x7f199c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f199a000640 1 -- 172.21.15.192:0/3602153350 >> v1:172.21.15.192:6789/0 conn(0x7f199c0b3bd0 legacy=0x7f199c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.483+0000 7f199a000640 1 -- 172.21.15.192:0/3602153350 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c06b760 con 0x7f199c06c800 2024-09-13T18:36:30.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.484+0000 7f199a000640 1 --2- 172.21.15.192:0/3602153350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 0x7f199c0b3690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1988009800 tx=0x7f198802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e74aac3611cbe16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.484+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988032440 con 0x7f199c06c800 2024-09-13T18:36:30.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19880325a0 con 0x7f199c06c800 2024-09-13T18:36:30.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f1999600640 1 -- 172.21.15.192:0/3602153350 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988032930 con 0x7f199c06c800 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 -- 172.21.15.192:0/3602153350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 msgr2=0x7f199c0b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 --2- 172.21.15.192:0/3602153350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 0x7f199c0b3690 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1988009800 tx=0x7f198802a250 comp rx=0 tx=0).stop 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 -- 172.21.15.192:0/3602153350 shutdown_connections 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 --2- 172.21.15.192:0/3602153350 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c06c800 0x7f199c0b3690 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 -- 172.21.15.192:0/3602153350 >> 172.21.15.192:0/3602153350 conn(0x7f199c0b08f0 msgr2=0x7f199c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 -- 172.21.15.192:0/3602153350 shutdown_connections 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.485+0000 7f19a1a00640 1 -- 172.21.15.192:0/3602153350 wait complete. 2024-09-13T18:36:30.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.487+0000 7f19a1a00640 1 Processor -- start 2024-09-13T18:36:30.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.487+0000 7f19a1a00640 1 -- start start 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 0x7f199c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 0x7f199c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c071750 con 0x7f199c06c800 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c154fa0 con 0x7f199c0b3bd0 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f19a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c155280 con 0x7f199c1434c0 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f199aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f199aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51976/0 (socket says 172.21.15.192:51976) 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f199aa00640 1 -- 172.21.15.192:0/2863521358 learned_addr learned my addr 172.21.15.192:0/2863521358 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f199b400640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 0x7f199c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.488+0000 7f199a000640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 0x7f199c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 -- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 msgr2=0x7f199c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 0x7f199c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 -- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 msgr2=0x7f199c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 0x7f199c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 -- 172.21.15.192:0/2863521358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988009400 con 0x7f199c06c800 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199b400640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 0x7f199c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:30.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199a000640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 0x7f199c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f199aa00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c430 tx=0x7f198c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c0052d0 con 0x7f199c06c800 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198c005450 con 0x7f199c06c800 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c155560 con 0x7f199c06c800 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198c003830 con 0x7f199c06c800 2024-09-13T18:36:30.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.489+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c155b20 con 0x7f199c06c800 2024-09-13T18:36:30.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.490+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c155d10 con 0x7f199c06c800 2024-09-13T18:36:30.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.491+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f198c003990 con 0x7f199c06c800 2024-09-13T18:36:30.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.492+0000 7f1992a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 0x7f197c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.492+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f198c0889e0 con 0x7f199c06c800 2024-09-13T18:36:30.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.492+0000 7f199a000640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 0x7f197c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.493+0000 7f199a000640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 0x7f197c06d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1988034000 tx=0x7f198802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.496+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f198c053b90 con 0x7f199c06c800 2024-09-13T18:36:30.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.669+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f199c0cc7d0 con 0x7f199c06c800 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.669+0000 7f1992a00640 1 -- 172.21.15.192:0/2863521358 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f198c017020 con 0x7f199c06c800 2024-09-13T18:36:30.672 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 msgr2=0x7f197c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 0x7f197c06d0c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1988034000 tx=0x7f198802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 msgr2=0x7f199c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f198c00c430 tx=0x7f198c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 shutdown_connections 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197c06ac00 0x7f197c06d0c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199c1434c0 0x7f199c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199c0b3bd0 0x7f199c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 --2- 172.21.15.192:0/2863521358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f199c06c800 0x7f199c071210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 >> 172.21.15.192:0/2863521358 conn(0x7f199c0b08f0 msgr2=0x7f199c0cbfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 shutdown_connections 2024-09-13T18:36:30.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.672+0000 7f19a1a00640 1 -- 172.21.15.192:0/2863521358 wait complete. 2024-09-13T18:36:30.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:36:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.842+0000 7f0e8a800640 1 Processor -- start 2024-09-13T18:36:30.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.843+0000 7f0e8a800640 1 -- start start 2024-09-13T18:36:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0e841402c0 0x7f0e8415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 0x7f0e8415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 0x7f0e840b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e840b05b0 con 0x7f0e841402c0 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8415b070 con 0x7f0e840afbe0 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e8a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8415eba0 con 0x7f0e8415b810 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0e841402c0 0x7f0e8415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0e841402c0 0x7f0e8415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51988/0 (socket says 172.21.15.192:51988) 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 -- 172.21.15.192:0/745090054 learned_addr learned my addr 172.21.15.192:0/745090054 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89e00640 1 --2- 172.21.15.192:0/745090054 >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 0x7f0e840b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e88a00640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 0x7f0e8415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 -- 172.21.15.192:0/745090054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 msgr2=0x7f0e8415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 0x7f0e8415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 -- 172.21.15.192:0/745090054 >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 msgr2=0x7f0e840b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 --2- 172.21.15.192:0/745090054 >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 0x7f0e840b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89400640 1 -- 172.21.15.192:0/745090054 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8415ee20 con 0x7f0e841402c0 2024-09-13T18:36:30.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e89e00640 1 --2- 172.21.15.192:0/745090054 >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 0x7f0e840b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:30.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.844+0000 7f0e88a00640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 0x7f0e8415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.845+0000 7f0e89400640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e841402c0 0x7f0e8415e660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e8406c950 tx=0x7f0e7802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa29d1b39668341f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e83e00640 1 -- 172.21.15.192:0/745090054 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78032440 con 0x7f0e841402c0 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e83e00640 1 -- 172.21.15.192:0/745090054 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e780325a0 con 0x7f0e841402c0 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e83e00640 1 -- 172.21.15.192:0/745090054 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e78032930 con 0x7f0e841402c0 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 -- 172.21.15.192:0/745090054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e841402c0 msgr2=0x7f0e8415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e841402c0 0x7f0e8415e660 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0e8406c950 tx=0x7f0e7802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 -- 172.21.15.192:0/745090054 shutdown_connections 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 --2- 172.21.15.192:0/745090054 >> v2:172.21.15.194:3300/0 conn(0x7f0e840afbe0 0x7f0e840b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e8415b810 0x7f0e8415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 --2- 172.21.15.192:0/745090054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e841402c0 0x7f0e8415e660 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 -- 172.21.15.192:0/745090054 >> 172.21.15.192:0/745090054 conn(0x7f0e840ae7f0 msgr2=0x7f0e8406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:30.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.846+0000 7f0e8a800640 1 -- 172.21.15.192:0/745090054 shutdown_connections 2024-09-13T18:36:30.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.847+0000 7f0e8a800640 1 -- 172.21.15.192:0/745090054 wait complete. 2024-09-13T18:36:30.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.848+0000 7f0e8a800640 1 Processor -- start 2024-09-13T18:36:30.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.848+0000 7f0e8a800640 1 -- start start 2024-09-13T18:36:30.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e840afbe0 0x7f0e84154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e841402c0 0x7f0e840b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b4820 con 0x7f0e8415b810 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b3240 con 0x7f0e841402c0 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e8a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e840b4540 con 0x7f0e840afbe0 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e89e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e89e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52004/0 (socket says 172.21.15.192:52004) 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.849+0000 7f0e89e00640 1 -- 172.21.15.192:0/11437846 learned_addr learned my addr 172.21.15.192:0/11437846 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 -- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e840afbe0 msgr2=0x7f0e84154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e840afbe0 0x7f0e84154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 -- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e841402c0 msgr2=0x7f0e840b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e88a00640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e841402c0 0x7f0e840b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e841402c0 0x7f0e840b3e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 -- 172.21.15.192:0/11437846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e780094d0 con 0x7f0e8415b810 2024-09-13T18:36:30.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e89e00640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c007e70 tx=0x7f0e7c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c003b90 con 0x7f0e8415b810 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e7c00f040 con 0x7f0e8415b810 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c00de80 con 0x7f0e8415b810 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8415cd70 con 0x7f0e8415b810 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.850+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8415d330 con 0x7f0e8415b810 2024-09-13T18:36:30.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.851+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8415d550 con 0x7f0e8415b810 2024-09-13T18:36:30.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.852+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0e7c004030 con 0x7f0e8415b810 2024-09-13T18:36:30.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.853+0000 7f0e81600640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 0x7f0e6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:30.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.853+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0e7c0896c0 con 0x7f0e8415b810 2024-09-13T18:36:30.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.853+0000 7f0e89400640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 0x7f0e6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:30.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.854+0000 7f0e89400640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 0x7f0e6406d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e78034000 tx=0x7f0e7802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:30.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:30.857+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0e7c054870 con 0x7f0e8415b810 2024-09-13T18:36:31.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.027+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e8404e2a0 con 0x7f0e8415b810 2024-09-13T18:36:31.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.027+0000 7f0e81600640 1 -- 172.21.15.192:0/11437846 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e7c057e90 con 0x7f0e8415b810 2024-09-13T18:36:31.030 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:36:31.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 msgr2=0x7f0e6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 0x7f0e6406d0c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0e78034000 tx=0x7f0e7802c000 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 msgr2=0x7f0e840a9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c007e70 tx=0x7f0e7c00d4a0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 shutdown_connections 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0e6406ac00 0x7f0e6406d0c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e8415b810 0x7f0e840a9dc0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0e841402c0 0x7f0e840b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 --2- 172.21.15.192:0/11437846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0e840afbe0 0x7f0e84154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 >> 172.21.15.192:0/11437846 conn(0x7f0e840ae7f0 msgr2=0x7f0e8406b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 shutdown_connections 2024-09-13T18:36:31.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.030+0000 7f0e8a800640 1 -- 172.21.15.192:0/11437846 wait complete. 2024-09-13T18:36:31.049 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:31.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.197+0000 7efef0400640 1 Processor -- start 2024-09-13T18:36:31.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.197+0000 7efef0400640 1 -- start start 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efef0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efee815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efef0400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80b2f00 con 0x7efee80b3f10 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efef0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee80b3150 con 0x7efee815dee0 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efef0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee80b3430 con 0x7efee80b0490 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efeed000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efee80b3f10 0x7efee815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38768/0 (socket says 172.21.15.192:38768) 2024-09-13T18:36:31.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.198+0000 7efeed000640 1 -- 172.21.15.192:0/2439479965 learned_addr learned my addr 172.21.15.192:0/2439479965 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:31.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efeee400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efee815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020797913 0 0) 0x7efee80b2f00 con 0x7efee80b3f10 2024-09-13T18:36:31.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed0003520 con 0x7efee80b3f10 2024-09-13T18:36:31.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1584478351 0 0) 0x7efed0003520 con 0x7efee80b3f10 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 msgr2=0x7efee815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efee815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 >> v1:172.21.15.194:6789/0 conn(0x7efee815dee0 legacy=0x7efee80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee80b3710 con 0x7efee80b3f10 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7efed4001670 con 0x7efee80b3f10 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 >> v1:172.21.15.192:6789/0 conn(0x7efee80b3f10 legacy=0x7efee815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00039a0 0x7efed0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efed00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed0004d00 0x7efed0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee80b3430 con 0x7efed0004d00 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed000ba30 con 0x7efed00039a0 2024-09-13T18:36:31.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed000de00 con 0x7efee80b0490 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.199+0000 7efeee400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed0004d00 0x7efed0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeeda00640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00039a0 0x7efed0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeed000640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efed00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeee400640 1 -- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 msgr2=0x7efed00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeee400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee80b0490 0x7efed00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeee400640 1 -- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00039a0 msgr2=0x7efed0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeee400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed00039a0 0x7efed0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.200+0000 7efeee400640 1 -- 172.21.15.192:0/2439479965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed0003520 con 0x7efed0004d00 2024-09-13T18:36:31.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.201+0000 7efeee400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed0004d00 0x7efed0005180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efee0009fc0 tx=0x7efed00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b72feaa078ecbcfd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.201+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee0031640 con 0x7efed0004d00 2024-09-13T18:36:31.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.201+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efee002d070 con 0x7efed0004d00 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.201+0000 7efee7e00640 1 -- 172.21.15.192:0/2439479965 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efee00319e0 con 0x7efed0004d00 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 -- 172.21.15.192:0/2439479965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed0004d00 msgr2=0x7efed0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 --2- 172.21.15.192:0/2439479965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efed0004d00 0x7efed0005180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7efee0009fc0 tx=0x7efed00057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efeee400640 1 -- 172.21.15.192:0/2439479965 reap_dead start 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 -- 172.21.15.192:0/2439479965 shutdown_connections 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 -- 172.21.15.192:0/2439479965 >> 172.21.15.192:0/2439479965 conn(0x7efee80ae960 msgr2=0x7efee806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 -- 172.21.15.192:0/2439479965 shutdown_connections 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.202+0000 7efef0400640 1 -- 172.21.15.192:0/2439479965 wait complete. 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.203+0000 7efef0400640 1 Processor -- start 2024-09-13T18:36:31.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 -- start start 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed0004d00 0x7efee8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee813fca0 0x7efee80add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee8150520 con 0x7efee813f840 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee813e7a0 con 0x7efed0004d00 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.204+0000 7efef0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee813ea80 con 0x7efee813fca0 2024-09-13T18:36:31.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52022/0 (socket says 172.21.15.192:52022) 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 -- 172.21.15.192:0/465239326 learned_addr learned my addr 172.21.15.192:0/465239326 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeeda00640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed0004d00 0x7efee8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeee400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee813fca0 0x7efee80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 -- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee813fca0 msgr2=0x7efee80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee813fca0 0x7efee80add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 -- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed0004d00 msgr2=0x7efee8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed0004d00 0x7efee8159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 -- 172.21.15.192:0/465239326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee813ed60 con 0x7efee813f840 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.205+0000 7efeed000640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efed4007310 tx=0x7efed40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.206+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400f9c0 con 0x7efee813f840 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.206+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efed400fb20 con 0x7efee813f840 2024-09-13T18:36:31.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.206+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efed400fe90 con 0x7efee813f840 2024-09-13T18:36:31.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.206+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee813f040 con 0x7efee813f840 2024-09-13T18:36:31.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.206+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee8159a90 con 0x7efee813f840 2024-09-13T18:36:31.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.207+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee813f560 con 0x7efee813f840 2024-09-13T18:36:31.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.208+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efed401d460 con 0x7efee813f840 2024-09-13T18:36:31.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.208+0000 7efee5600640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 0x7efec806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.209+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7efed4089600 con 0x7efee813f840 2024-09-13T18:36:31.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.209+0000 7efeeda00640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 0x7efec806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.209+0000 7efeeda00640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 0x7efec806d0f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efedc003640 tx=0x7efedc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.213+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efee813f560 con 0x7efee813f840 2024-09-13T18:36:31.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.413+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efee8159c20 con 0x7efee813f840 2024-09-13T18:36:31.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.414+0000 7efee5600640 1 -- 172.21.15.192:0/465239326 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7efed4054730 con 0x7efee813f840 2024-09-13T18:36:31.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:31.417 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:36:31.417 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 msgr2=0x7efec806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 0x7efec806d0f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efedc003640 tx=0x7efedc009040 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 msgr2=0x7efee80ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7efed4007310 tx=0x7efed40077d0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 shutdown_connections 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efec806ac30 0x7efec806d0f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efee813fca0 0x7efee80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efee813f840 0x7efee80ad840 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 --2- 172.21.15.192:0/465239326 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efed0004d00 0x7efee8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 >> 172.21.15.192:0/465239326 conn(0x7efee80ae960 msgr2=0x7efee815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 shutdown_connections 2024-09-13T18:36:31.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.416+0000 7efef0400640 1 -- 172.21.15.192:0/465239326 wait complete. 2024-09-13T18:36:31.434 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:31.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.584+0000 7fe8c6800640 1 Processor -- start 2024-09-13T18:36:31.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.584+0000 7fe8c6800640 1 -- start start 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8c6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe8c00cc530 0x7fe8c00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8c6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c00ccec0 con 0x7fe8c0071810 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8c6800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c0071dd0 con 0x7fe8c0150480 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8c6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c00cb770 con 0x7fe8c00cc530 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8bea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe8c0071810 0x7fe8c00b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38770/0 (socket says 172.21.15.192:38770) 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.585+0000 7fe8bea00640 1 -- 172.21.15.192:0/3692978152 learned_addr learned my addr 172.21.15.192:0/3692978152 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8bfe00640 1 --2- 172.21.15.192:0/3692978152 >> v2:172.21.15.194:3300/0 conn(0x7fe8c00cc530 0x7fe8c00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437534684 0 0) 0x7fe8c00ccec0 con 0x7fe8c0071810 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8a4003520 con 0x7fe8c0071810 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8bfe00640 1 -- 172.21.15.192:0/3692978152 >> v1:172.21.15.194:6789/0 conn(0x7fe8c0150480 legacy=0x7fe8c015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 857472958 0 0) 0x7fe8c0071dd0 con 0x7fe8c0150480 2024-09-13T18:36:31.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8bfe00640 1 -- 172.21.15.192:0/3692978152 >> v1:172.21.15.192:6789/0 conn(0x7fe8c0071810 legacy=0x7fe8c00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.586+0000 7fe8bfe00640 1 -- 172.21.15.192:0/3692978152 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00cba50 con 0x7fe8c00cc530 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.587+0000 7fe8bfe00640 1 --2- 172.21.15.192:0/3692978152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c00cc530 0x7fe8c00cc980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009d90 tx=0x7fe8b802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9651a2d33a152f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.587+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8007740 con 0x7fe8c00cc530 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.587+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b802d050 con 0x7fe8c00cc530 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.587+0000 7fe8be000640 1 -- 172.21.15.192:0/3692978152 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8007ac0 con 0x7fe8c00cc530 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 -- 172.21.15.192:0/3692978152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c00cc530 msgr2=0x7fe8c00cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 --2- 172.21.15.192:0/3692978152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c00cc530 0x7fe8c00cc980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009d90 tx=0x7fe8b802a660 comp rx=0 tx=0).stop 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 -- 172.21.15.192:0/3692978152 shutdown_connections 2024-09-13T18:36:31.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 --2- 172.21.15.192:0/3692978152 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c00cc530 0x7fe8c00cc980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 -- 172.21.15.192:0/3692978152 >> 172.21.15.192:0/3692978152 conn(0x7fe8c00ae960 msgr2=0x7fe8c006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 -- 172.21.15.192:0/3692978152 shutdown_connections 2024-09-13T18:36:31.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.588+0000 7fe8c6800640 1 -- 172.21.15.192:0/3692978152 wait complete. 2024-09-13T18:36:31.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.590+0000 7fe8c6800640 1 Processor -- start 2024-09-13T18:36:31.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.590+0000 7fe8c6800640 1 -- start start 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8c00cc530 0x7fe8c0154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c0150480 0x7fe8c014a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01512f0 con 0x7fe8c0071810 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c01515d0 con 0x7fe8c0150480 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8c6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c015ac10 con 0x7fe8c00cc530 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8bf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8bf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52038/0 (socket says 172.21.15.192:52038) 2024-09-13T18:36:31.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.591+0000 7fe8bf400640 1 -- 172.21.15.192:0/192242408 learned_addr learned my addr 172.21.15.192:0/192242408 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:31.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 -- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8c00cc530 msgr2=0x7fe8c0154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8c00cc530 0x7fe8c0154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 -- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c0150480 msgr2=0x7fe8c014a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c0150480 0x7fe8c014a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 -- 172.21.15.192:0/192242408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b8009a70 con 0x7fe8c0071810 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8bf400640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c410 tx=0x7fe8b000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b00035f0 con 0x7fe8c0071810 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b0003770 con 0x7fe8c0071810 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c015aef0 con 0x7fe8c0071810 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0003b20 con 0x7fe8c0071810 2024-09-13T18:36:31.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.592+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c01518b0 con 0x7fe8c0071810 2024-09-13T18:36:31.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.593+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c015b0e0 con 0x7fe8c0071810 2024-09-13T18:36:31.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.594+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8b0003c80 con 0x7fe8c0071810 2024-09-13T18:36:31.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.595+0000 7fe8b7400640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.595+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe8b00889b0 con 0x7fe8c0071810 2024-09-13T18:36:31.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.595+0000 7fe8bea00640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.596+0000 7fe8bea00640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 0x7fe8a006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac000f60 tx=0x7fe8ac0078f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.599+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8b0053b70 con 0x7fe8c0071810 2024-09-13T18:36:31.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.767+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe8c00cc980 con 0x7fe8c0071810 2024-09-13T18:36:31.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.768+0000 7fe8b7400640 1 -- 172.21.15.192:0/192242408 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16618 (secure 0 0 0) 0x7fe8b0017020 con 0x7fe8c0071810 2024-09-13T18:36:31.771 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:31.771 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":23,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:27.925064+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.770+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 msgr2=0x7fe8a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.770+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 0x7fe8a006d0c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac000f60 tx=0x7fe8ac0078f0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.770+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 msgr2=0x7fe8c0150aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.770+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000c410 tx=0x7fe8b000c8d0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 shutdown_connections 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8a006ac00 0x7fe8a006d0c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8c0150480 0x7fe8c014a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8c00cc530 0x7fe8c0154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 --2- 172.21.15.192:0/192242408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8c0071810 0x7fe8c0150aa0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 >> 172.21.15.192:0/192242408 conn(0x7fe8c00ae960 msgr2=0x7fe8c01582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 shutdown_connections 2024-09-13T18:36:31.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.771+0000 7fe8c6800640 1 -- 172.21.15.192:0/192242408 wait complete. 2024-09-13T18:36:31.790 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:36:31.791 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:31.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.939+0000 7f81c9c00640 1 Processor -- start 2024-09-13T18:36:31.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.939+0000 7f81c9c00640 1 -- start start 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f81c40b3480 0x7f81c4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81c406bc30 0x7f81c415a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81c415af60 con 0x7f81c4159b00 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c406b7a0 con 0x7f81c406bc30 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81c415ac80 con 0x7f81c40b3480 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81c406bc30 0x7f81c415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81c406bc30 0x7f81c415a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52046/0 (socket says 172.21.15.192:52046) 2024-09-13T18:36:31.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81c9200640 1 -- 172.21.15.192:0/4058906365 learned_addr learned my addr 172.21.15.192:0/4058906365 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:31.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.940+0000 7f81bb400640 1 --2- 172.21.15.192:0/4058906365 >> v2:172.21.15.194:3300/0 conn(0x7f81c40b3480 0x7f81c4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.941+0000 7f81c9200640 1 -- 172.21.15.192:0/4058906365 >> v2:172.21.15.194:3300/0 conn(0x7f81c40b3480 msgr2=0x7f81c4159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:31.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.941+0000 7f81c9200640 1 --2- 172.21.15.192:0/4058906365 >> v2:172.21.15.194:3300/0 conn(0x7f81c40b3480 0x7f81c4159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.941+0000 7f81c9200640 1 -- 172.21.15.192:0/4058906365 >> v1:172.21.15.194:6789/0 conn(0x7f81c4159b00 legacy=0x7f81c40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.941+0000 7f81c9200640 1 -- 172.21.15.192:0/4058906365 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c406b150 con 0x7f81c406bc30 2024-09-13T18:36:31.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.942+0000 7f81c9200640 1 --2- 172.21.15.192:0/4058906365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c406bc30 0x7f81c415a420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81c406c830 tx=0x7f81bc02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a79c24df5a0715b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.942+0000 7f81c3400640 1 -- 172.21.15.192:0/4058906365 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc032440 con 0x7f81c406bc30 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.942+0000 7f81c3400640 1 -- 172.21.15.192:0/4058906365 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81bc0325a0 con 0x7f81c406bc30 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.942+0000 7f81c3400640 1 -- 172.21.15.192:0/4058906365 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81bc032930 con 0x7f81c406bc30 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 -- 172.21.15.192:0/4058906365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c406bc30 msgr2=0x7f81c415a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 --2- 172.21.15.192:0/4058906365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c406bc30 0x7f81c415a420 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f81c406c830 tx=0x7f81bc02a200 comp rx=0 tx=0).stop 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 -- 172.21.15.192:0/4058906365 shutdown_connections 2024-09-13T18:36:31.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 --2- 172.21.15.192:0/4058906365 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c406bc30 0x7f81c415a420 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 --2- 172.21.15.192:0/4058906365 >> v2:172.21.15.194:3300/0 conn(0x7f81c40b3480 0x7f81c4159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 -- 172.21.15.192:0/4058906365 >> 172.21.15.192:0/4058906365 conn(0x7f81c40736d0 msgr2=0x7f81c40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:31.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 -- 172.21.15.192:0/4058906365 shutdown_connections 2024-09-13T18:36:31.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.943+0000 7f81c9c00640 1 -- 172.21.15.192:0/4058906365 wait complete. 2024-09-13T18:36:31.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.944+0000 7f81c9c00640 1 Processor -- start 2024-09-13T18:36:31.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.945+0000 7f81c9c00640 1 -- start start 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.945+0000 7f81c9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c406bc30 0x7f81c4146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.945+0000 7f81c9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81c4159b00 0x7f81c4152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c9c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40ae690 con 0x7f81c40b3480 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c9c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81c4146ac0 con 0x7f81c406bc30 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81c40ae8a0 con 0x7f81c4159b00 2024-09-13T18:36:31.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52062/0 (socket says 172.21.15.192:52062) 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 -- 172.21.15.192:0/3474697852 learned_addr learned my addr 172.21.15.192:0/3474697852 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c3e00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c406bc30 0x7f81c4146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81c9200640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81c4159b00 0x7f81c4152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 -- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81c4159b00 msgr2=0x7f81c4152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81c4159b00 0x7f81c4152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 -- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c406bc30 msgr2=0x7f81c4146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c406bc30 0x7f81c4146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:31.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.946+0000 7f81bb400640 1 -- 172.21.15.192:0/3474697852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0094d0 con 0x7f81c40b3480 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81bb400640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9b0 tx=0x7f81ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac009670 con 0x7f81c40b3480 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00c9a0 con 0x7f81c40b3480 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81c40aeb80 con 0x7f81c40b3480 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00cd50 con 0x7f81c40b3480 2024-09-13T18:36:31.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.947+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81c40af140 con 0x7f81c40b3480 2024-09-13T18:36:31.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.948+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81c40b2d70 con 0x7f81c40b3480 2024-09-13T18:36:31.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.949+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f81ac013470 con 0x7f81c40b3480 2024-09-13T18:36:31.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.950+0000 7f81c0c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 0x7f81a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:31.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.950+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f81ac0896f0 con 0x7f81c40b3480 2024-09-13T18:36:31.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.950+0000 7f81c3e00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 0x7f81a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:31.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.951+0000 7f81c3e00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 0x7f81a006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b40012e0 tx=0x7f81b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:31.956+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81ac054830 con 0x7f81c40b3480 2024-09-13T18:36:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.156+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81c40b3c70 con 0x7f81c40b3480 2024-09-13T18:36:32.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.156+0000 7f81c0c00640 1 -- 172.21.15.192:0/3474697852 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7f81ac057e50 con 0x7f81c40b3480 2024-09-13T18:36:32.159 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:32.159 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:36:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:36:32.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 msgr2=0x7f81a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 0x7f81a006d0c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f81b40012e0 tx=0x7f81b4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:32.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 msgr2=0x7f81c406f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f81ac00e9b0 tx=0x7f81ac00ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 shutdown_connections 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f81a006ac00 0x7f81a006d0c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81c4159b00 0x7f81c4152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81c40b3480 0x7f81c406f580 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 --2- 172.21.15.192:0/3474697852 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81c406bc30 0x7f81c4146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 >> 172.21.15.192:0/3474697852 conn(0x7f81c40736d0 msgr2=0x7f81c4156050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.158+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 shutdown_connections 2024-09-13T18:36:32.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.159+0000 7f81c9c00640 1 -- 172.21.15.192:0/3474697852 wait complete. 2024-09-13T18:36:32.178 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:32.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.326+0000 7fe615e00640 1 Processor -- start 2024-09-13T18:36:32.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.326+0000 7fe615e00640 1 -- start start 2024-09-13T18:36:32.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.327+0000 7fe615e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe610071810 0x7fe6100b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe615e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe6100cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe615e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe610071dd0 con 0x7fe610150480 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe615e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6100cb770 con 0x7fe610071810 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe615e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100cba50 con 0x7fe6100b2230 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe610150480 0x7fe61015a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38776/0 (socket says 172.21.15.192:38776) 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60ea00640 1 -- 172.21.15.192:0/1325868526 learned_addr learned my addr 172.21.15.192:0/1325868526 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140135918 0 0) 0x7fe610071dd0 con 0x7fe610150480 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f4003520 con 0x7fe610150480 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60e000640 1 --2- 172.21.15.192:0/1325868526 >> v2:172.21.15.194:3300/0 conn(0x7fe610071810 0x7fe6100b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.328+0000 7fe60f400640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe6100cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3337934667 0 0) 0x7fe5f4003520 con 0x7fe610150480 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 msgr2=0x7fe6100cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe6100cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 >> v2:172.21.15.194:3300/0 conn(0x7fe610071810 msgr2=0x7fe6100b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 --2- 172.21.15.192:0/1325868526 >> v2:172.21.15.194:3300/0 conn(0x7fe610071810 0x7fe6100b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cbd30 con 0x7fe610150480 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe6000019f0 con 0x7fe610150480 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60f400640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe6100cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 >> v1:172.21.15.192:6789/0 conn(0x7fe610150480 legacy=0x7fe61015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe5f4003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe5f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5f4004d00 0x7fe5f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100cb770 con 0x7fe5f4003f00 2024-09-13T18:36:32.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100cba50 con 0x7fe5f4004d00 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f400dc90 con 0x7fe6100b2230 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe5f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60ea00640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe5f4003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60f400640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5f4004d00 0x7fe5f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 -- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 msgr2=0x7fe5f4003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6100b2230 0x7fe5f4003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 -- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5f4004d00 msgr2=0x7fe5f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5f4004d00 0x7fe5f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.329+0000 7fe60e000640 1 -- 172.21.15.192:0/1325868526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4003520 con 0x7fe5f4003f00 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.330+0000 7fe60e000640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe5f40047c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ac0 tx=0x7fe5f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38453dd1b2e20ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc031400 con 0x7fe5f4003f00 2024-09-13T18:36:32.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc02d050 con 0x7fe5f4003f00 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe60d600640 1 -- 172.21.15.192:0/1325868526 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc031780 con 0x7fe5f4003f00 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 -- 172.21.15.192:0/1325868526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 msgr2=0x7fe5f40047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 --2- 172.21.15.192:0/1325868526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe5f40047c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc009ac0 tx=0x7fe5f40057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe60f400640 1 -- 172.21.15.192:0/1325868526 reap_dead start 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 -- 172.21.15.192:0/1325868526 shutdown_connections 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 -- 172.21.15.192:0/1325868526 >> 172.21.15.192:0/1325868526 conn(0x7fe6100ae960 msgr2=0x7fe61006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 -- 172.21.15.192:0/1325868526 shutdown_connections 2024-09-13T18:36:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.331+0000 7fe615e00640 1 -- 172.21.15.192:0/1325868526 wait complete. 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.333+0000 7fe615e00640 1 Processor -- start 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.333+0000 7fe615e00640 1 -- start start 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe610070030 0x7fe6100704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe61014bcd0 0x7fe61014c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100709f0 con 0x7fe5f4003f00 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe610143a30 con 0x7fe61014bcd0 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe615e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61006a7d0 con 0x7fe610070030 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe60ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe60ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52076/0 (socket says 172.21.15.192:52076) 2024-09-13T18:36:32.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe60ea00640 1 -- 172.21.15.192:0/425221698 learned_addr learned my addr 172.21.15.192:0/425221698 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe60e000640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe610070030 0x7fe6100704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.334+0000 7fe60f400640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe61014bcd0 0x7fe61014c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 -- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe610070030 msgr2=0x7fe6100704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe610070030 0x7fe6100704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 -- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe61014bcd0 msgr2=0x7fe61014c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe61014bcd0 0x7fe61014c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 -- 172.21.15.192:0/425221698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe61014c690 con 0x7fe5f4003f00 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe60ea00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe600007970 tx=0x7fe60000a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000018e0 con 0x7fe5f4003f00 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6000133f0 con 0x7fe5f4003f00 2024-09-13T18:36:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6101434b0 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6000137a0 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.335+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe610069ea0 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.336+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe610071dd0 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.337+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe600013900 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.338+0000 7fe607400640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 0x7fe5f006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.338+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe600089c90 con 0x7fe5f4003f00 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.338+0000 7fe60e000640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 0x7fe5f006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.339+0000 7fe60e000640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 0x7fe5f006d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc033000 tx=0x7fe5fc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.342+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe600054ef0 con 0x7fe5f4003f00 2024-09-13T18:36:32.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.543+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe610159a90 con 0x7fe5f4003f00 2024-09-13T18:36:32.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.544+0000 7fe607400640 1 -- 172.21.15.192:0/425221698 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4734 (secure 0 0 0) 0x7fe600058510 con 0x7fe5f4003f00 2024-09-13T18:36:32.547 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:32.547 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1100296627","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1100296627},{"type":"v1","addr":"172.21.15.194:6834","nonce":1100296627}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/156877194","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":156877194},{"type":"v1","addr":"172.21.15.192:6835","nonce":156877194}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1897445705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1897445705},{"type":"v1","addr":"172.21.15.194:6835","nonce":1897445705}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:35:40.213331+0000","modified":"2024-09-13T18:35:43.236945+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4285},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4285":{"gid":4285,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/978606429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":978606429},{"type":"v1","addr":"172.21.15.192:6837","nonce":978606429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-09-13T18:36:32.547 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 8 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 msgr2=0x7fe5f006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 0x7fe5f006d0f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc033000 tx=0x7fe5fc008030 comp rx=0 tx=0).stop 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 msgr2=0x7fe610142f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe600007970 tx=0x7fe60000a640 comp rx=0 tx=0).stop 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 shutdown_connections 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe5f006ac30 0x7fe5f006d0f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe61014bcd0 0x7fe61014c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe610070030 0x7fe6100704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 --2- 172.21.15.192:0/425221698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5f4003f00 0x7fe610142f70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 >> 172.21.15.192:0/425221698 conn(0x7fe6100ae960 msgr2=0x7fe6100cc380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 shutdown_connections 2024-09-13T18:36:32.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.546+0000 7fe615e00640 1 -- 172.21.15.192:0/425221698 wait complete. 2024-09-13T18:36:32.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:32.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.714+0000 7f157d000640 1 Processor -- start 2024-09-13T18:36:32.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.714+0000 7f157d000640 1 -- start start 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f15781592d0 0x7f1578070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 0x7f15780b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 0x7f157806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15780b3fb0 con 0x7f15781592d0 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f157806f830 con 0x7f15780b3600 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f157d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157806fa80 con 0x7f157806bca0 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f1577400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f15781592d0 0x7f1578070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f1577400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f15781592d0 0x7f1578070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52078/0 (socket says 172.21.15.192:52078) 2024-09-13T18:36:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.715+0000 7f1577400640 1 -- 172.21.15.192:0/521945759 learned_addr learned my addr 172.21.15.192:0/521945759 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577e00640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 0x7f157806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577400640 1 -- 172.21.15.192:0/521945759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 msgr2=0x7f157806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f156fe00640 1 --2- 172.21.15.192:0/521945759 >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 0x7f15780b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577400640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 0x7f157806c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577400640 1 -- 172.21.15.192:0/521945759 >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 msgr2=0x7f15780b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577400640 1 --2- 172.21.15.192:0/521945759 >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 0x7f15780b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577400640 1 -- 172.21.15.192:0/521945759 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f157806fd60 con 0x7f15781592d0 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f1577e00640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 0x7f157806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.716+0000 7f156fe00640 1 --2- 172.21.15.192:0/521945759 >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 0x7f15780b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.717+0000 7f1577400640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15781592d0 0x7f1578070b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f157806cc90 tx=0x7f156802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1378f5be86eebb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.717+0000 7f1576a00640 1 -- 172.21.15.192:0/521945759 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568032440 con 0x7f15781592d0 2024-09-13T18:36:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.717+0000 7f1576a00640 1 -- 172.21.15.192:0/521945759 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15680325a0 con 0x7f15781592d0 2024-09-13T18:36:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.717+0000 7f1576a00640 1 -- 172.21.15.192:0/521945759 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1568032930 con 0x7f15781592d0 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 -- 172.21.15.192:0/521945759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15781592d0 msgr2=0x7f1578070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15781592d0 0x7f1578070b20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f157806cc90 tx=0x7f156802a200 comp rx=0 tx=0).stop 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 -- 172.21.15.192:0/521945759 shutdown_connections 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f157806bca0 0x7f157806c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 --2- 172.21.15.192:0/521945759 >> v2:172.21.15.194:3300/0 conn(0x7f15780b3600 0x7f15780b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 --2- 172.21.15.192:0/521945759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15781592d0 0x7f1578070b20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 -- 172.21.15.192:0/521945759 >> 172.21.15.192:0/521945759 conn(0x7f15780736d0 msgr2=0x7f15780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 -- 172.21.15.192:0/521945759 shutdown_connections 2024-09-13T18:36:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.718+0000 7f157d000640 1 -- 172.21.15.192:0/521945759 wait complete. 2024-09-13T18:36:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.720+0000 7f157d000640 1 Processor -- start 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.720+0000 7f157d000640 1 -- start start 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 0x7f15781412b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 0x7f1578145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157814dbe0 con 0x7f15780b3600 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f157814de80 con 0x7f157806bca0 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f157d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f157814e160 con 0x7f15781592d0 2024-09-13T18:36:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52080/0 (socket says 172.21.15.192:52080) 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 -- 172.21.15.192:0/3477848821 learned_addr learned my addr 172.21.15.192:0/3477848821 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f1577e00640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 0x7f1578145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f1577400640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 0x7f15781412b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 -- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 msgr2=0x7f1578145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 0x7f1578145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 -- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 msgr2=0x7f15781412b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 0x7f15781412b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f156fe00640 1 -- 172.21.15.192:0/3477848821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15680094d0 con 0x7f15780b3600 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f1577e00640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 0x7f1578145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.721+0000 7f1577400640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 0x7f15781412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f156fe00640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f156000c7f0 tx=0x7f156000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1560007a30 con 0x7f15780b3600 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1560007b90 con 0x7f15780b3600 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f156000ce40 con 0x7f15780b3600 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1578148aa0 con 0x7f15780b3600 2024-09-13T18:36:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.722+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1578149060 con 0x7f15780b3600 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.723+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1578149280 con 0x7f15780b3600 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.724+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f15600113f0 con 0x7f15780b3600 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.725+0000 7f156f400640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 0x7f155406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.725+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f1560089530 con 0x7f15780b3600 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.725+0000 7f1577400640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 0x7f155406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.726+0000 7f1577400640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 0x7f155406d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1568034000 tx=0x7f156802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.729+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f15600546f0 con 0x7f15780b3600 2024-09-13T18:36:32.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.898+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f157806c0d0 con 0x7f15780b3600 2024-09-13T18:36:32.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.899+0000 7f156f400640 1 -- 172.21.15.192:0/3477848821 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16618 (secure 0 0 0) 0x7f1560087e60 con 0x7f15780b3600 2024-09-13T18:36:32.902 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:32.902 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":23,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:27.925064+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:35:38.305854+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-13T18:35:39.200936+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2f","mappings":[{"from":0,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 msgr2=0x7f155406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 0x7f155406d0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1568034000 tx=0x7f156802e000 comp rx=0 tx=0).stop 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 msgr2=0x7f157814a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f156000c7f0 tx=0x7f156000cbf0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 shutdown_connections 2024-09-13T18:36:32.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f155406ac00 0x7f155406d0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f15781592d0 0x7f1578145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f15780b3600 0x7f157814a960 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 --2- 172.21.15.192:0/3477848821 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f157806bca0 0x7f15781412b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 >> 172.21.15.192:0/3477848821 conn(0x7f15780736d0 msgr2=0x7f157814e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 shutdown_connections 2024-09-13T18:36:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:32.901+0000 7f157d000640 1 -- 172.21.15.192:0/3477848821 wait complete. 2024-09-13T18:36:32.920 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:36:33.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.072+0000 7f3b37e00640 1 Processor -- start 2024-09-13T18:36:33.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.072+0000 7f3b37e00640 1 -- start start 2024-09-13T18:36:33.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 0x7f3b3015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b37e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b300cb0b0 0x7f3b3015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b37e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b30140480 con 0x7f3b30140980 2024-09-13T18:36:33.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b37e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3015c160 con 0x7f3b300cb0b0 2024-09-13T18:36:33.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b37e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3015ee90 con 0x7f3b300cacd0 2024-09-13T18:36:33.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b34a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b300cb0b0 0x7f3b3015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b34a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b300cb0b0 0x7f3b3015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:56434/0 (socket says 172.21.15.192:56434) 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b34a00640 1 -- 172.21.15.192:0/27062232 learned_addr learned my addr 172.21.15.192:0/27062232 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b35e00640 1 --1- 172.21.15.192:0/27062232 >> v1:172.21.15.194:6789/0 conn(0x7f3b30140980 0x7f3b300afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:57202/0 (socket says 172.21.15.192:57202) 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.074+0000 7f3b35400640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 0x7f3b3015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.075+0000 7f3b34a00640 1 -- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 msgr2=0x7f3b3015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.075+0000 7f3b34a00640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 0x7f3b3015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.075+0000 7f3b34a00640 1 -- 172.21.15.192:0/27062232 >> v1:172.21.15.194:6789/0 conn(0x7f3b30140980 legacy=0x7f3b300afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.075+0000 7f3b34a00640 1 -- 172.21.15.192:0/27062232 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3015f170 con 0x7f3b300cb0b0 2024-09-13T18:36:33.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.075+0000 7f3b35400640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 0x7f3b3015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:33.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.076+0000 7f3b34a00640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3015bc20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a21d94780137d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.076+0000 7f3b2fe00640 1 -- 172.21.15.192:0/27062232 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c032440 con 0x7f3b300cb0b0 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.076+0000 7f3b2fe00640 1 -- 172.21.15.192:0/27062232 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c0325a0 con 0x7f3b300cb0b0 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.076+0000 7f3b2fe00640 1 -- 172.21.15.192:0/27062232 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c032930 con 0x7f3b300cb0b0 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 -- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 msgr2=0x7f3b3015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3015bc20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c009870 tx=0x7f3b1c02a250 comp rx=0 tx=0).stop 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 -- 172.21.15.192:0/27062232 shutdown_connections 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3015bc20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 --2- 172.21.15.192:0/27062232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b300cacd0 0x7f3b3015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 -- 172.21.15.192:0/27062232 >> 172.21.15.192:0/27062232 conn(0x7f3b300ae960 msgr2=0x7f3b3006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 -- 172.21.15.192:0/27062232 shutdown_connections 2024-09-13T18:36:33.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.077+0000 7f3b37e00640 1 -- 172.21.15.192:0/27062232 wait complete. 2024-09-13T18:36:33.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.078+0000 7f3b37e00640 1 Processor -- start 2024-09-13T18:36:33.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 -- start start 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3013cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b30140980 0x7f3b3013d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b30069ea0 con 0x7f3b300cacd0 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3006a180 con 0x7f3b300cb0b0 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.079+0000 7f3b37e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3013d680 con 0x7f3b30140980 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b30140980 0x7f3b3013d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52084/0 (socket says 172.21.15.192:52084) 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 -- 172.21.15.192:0/3809789358 learned_addr learned my addr 172.21.15.192:0/3809789358 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b34a00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 -- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b30140980 msgr2=0x7f3b3013d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b30140980 0x7f3b3013d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 -- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 msgr2=0x7f3b3013cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3013cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.080+0000 7f3b35400640 1 -- 172.21.15.192:0/3809789358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b24009a70 con 0x7f3b300cacd0 2024-09-13T18:36:33.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b35400640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400efc0 tx=0x7f3b2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24014680 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2400f040 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24014a00 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b1c0094d0 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.081+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b30158310 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.082+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3015bc20 con 0x7f3b300cacd0 2024-09-13T18:36:33.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.083+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b24014b60 con 0x7f3b300cacd0 2024-09-13T18:36:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.084+0000 7f3b2d600640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 0x7f3b1006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.084+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3b2408a1d0 con 0x7f3b300cacd0 2024-09-13T18:36:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.084+0000 7f3b34a00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 0x7f3b1006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.084+0000 7f3b34a00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 0x7f3b1006d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c034000 tx=0x7f3b1c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.088+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b24055430 con 0x7f3b300cacd0 2024-09-13T18:36:33.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.287+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3b30140f70 con 0x7f3b300cacd0 2024-09-13T18:36:33.290 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:36:33.288+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:36:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.299+0000 7f3b2d600640 1 -- 172.21.15.192:0/3809789358 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3b24058a50 con 0x7f3b300cacd0 2024-09-13T18:36:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 msgr2=0x7f3b1006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 0x7f3b1006d0c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c034000 tx=0x7f3b1c02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 msgr2=0x7f3b3013f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400efc0 tx=0x7f3b2400c490 comp rx=0 tx=0).stop 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 shutdown_connections 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b1006ac00 0x7f3b1006d0c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b30140980 0x7f3b3013d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b300cb0b0 0x7f3b3013cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 --2- 172.21.15.192:0/3809789358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b300cacd0 0x7f3b3013f3e0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 >> 172.21.15.192:0/3809789358 conn(0x7f3b300ae960 msgr2=0x7f3b30070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 shutdown_connections 2024-09-13T18:36:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.301+0000 7f3b37e00640 1 -- 172.21.15.192:0/3809789358 wait complete. 2024-09-13T18:36:33.315 INFO:tasks.ceph.mds.c.smithi192.stderr: -7170> 2024-09-13T18:35:44.476+0000 7f7c3e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:36:33.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:36:33.368 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:36:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.478+0000 7f1bc2200640 1 Processor -- start 2024-09-13T18:36:33.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.478+0000 7f1bc2200640 1 -- start start 2024-09-13T18:36:33.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bc2200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1434c0 0x7f1bbc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bc2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bc2200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc06b480 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bc2200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc0ce770 con 0x7f1bbc1434c0 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bc2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc06b760 con 0x7f1bbc0b3da0 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bb2a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1bbc06a8b0 0x7f1bbc0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:57222/0 (socket says 172.21.15.192:57222) 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bb2a00640 1 -- 172.21.15.192:0/1019438405 learned_addr learned my addr 172.21.15.192:0/1019438405 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bbb400640 1 --2- 172.21.15.192:0/1019438405 >> v2:172.21.15.194:3300/0 conn(0x7f1bbc1434c0 0x7f1bbc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bbbe00640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.480+0000 7f1bbaa00640 1 -- 172.21.15.192:0/1019438405 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328883701 0 0) 0x7f1bbc06b480 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbaa00640 1 -- 172.21.15.192:0/1019438405 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba0003520 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbb400640 1 -- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 msgr2=0x7f1bbc06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbb400640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbb400640 1 -- 172.21.15.192:0/1019438405 >> v1:172.21.15.194:6789/0 conn(0x7f1bbc06a8b0 legacy=0x7f1bbc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbb400640 1 -- 172.21.15.192:0/1019438405 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc06ba40 con 0x7f1bbc1434c0 2024-09-13T18:36:33.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.481+0000 7f1bbbe00640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.482+0000 7f1bbb400640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc06c800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097a0 tx=0x7f1bac02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=444c9828700201dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.482+0000 7f1bbaa00640 1 -- 172.21.15.192:0/1019438405 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac02ae50 con 0x7f1bbc1434c0 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.482+0000 7f1bbaa00640 1 -- 172.21.15.192:0/1019438405 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac032440 con 0x7f1bbc1434c0 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.482+0000 7f1bbaa00640 1 -- 172.21.15.192:0/1019438405 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0327d0 con 0x7f1bbc1434c0 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 -- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 msgr2=0x7f1bbc06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc06c800 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097a0 tx=0x7f1bac02a100 comp rx=0 tx=0).stop 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 -- 172.21.15.192:0/1019438405 shutdown_connections 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 --2- 172.21.15.192:0/1019438405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc06c800 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 -- 172.21.15.192:0/1019438405 >> 172.21.15.192:0/1019438405 conn(0x7f1bbc0b08f0 msgr2=0x7f1bbc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:33.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 -- 172.21.15.192:0/1019438405 shutdown_connections 2024-09-13T18:36:33.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.483+0000 7f1bc2200640 1 -- 172.21.15.192:0/1019438405 wait complete. 2024-09-13T18:36:33.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.484+0000 7f1bc2200640 1 Processor -- start 2024-09-13T18:36:33.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.484+0000 7f1bc2200640 1 -- start start 2024-09-13T18:36:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc13abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc1418b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0ae2c0 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc15bc60 con 0x7f1bbc1434c0 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.485+0000 7f1bc2200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0ad640 con 0x7f1bbc0b3da0 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52114/0 (socket says 172.21.15.192:52114) 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 -- 172.21.15.192:0/3040935089 learned_addr learned my addr 172.21.15.192:0/3040935089 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bb2a00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc13abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbbe00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc1418b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 -- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 msgr2=0x7f1bbc13abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc13abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 -- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 msgr2=0x7f1bbc1418b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc1418b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 -- 172.21.15.192:0/3040935089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb4009a70 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbbe00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.486+0000 7f1bbb400640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bac035040 tx=0x7f1bac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.487+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac03d710 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.487+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac03d890 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.487+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac03dc40 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.487+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac009400 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.487+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc0adc00 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.488+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bbc0cc7d0 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.489+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1bac039040 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.490+0000 7f1bb3e00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 0x7f1b9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.490+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1bac0a9c20 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.490+0000 7f1bb2a00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 0x7f1b9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:33.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.490+0000 7f1bb2a00640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 0x7f1b9806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40011e0 tx=0x7f1ba4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:33.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.494+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1bac074e30 con 0x7f1bbc06a8b0 2024-09-13T18:36:33.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:33.695+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1bbc13c890 con 0x7f1bbc06a8b0 2024-09-13T18:36:34.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.301+0000 7f1bb3e00640 1 -- 172.21.15.192:0/3040935089 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1bac078450 con 0x7f1bbc06a8b0 2024-09-13T18:36:34.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 msgr2=0x7f1b9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 0x7f1b9806d0c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1ba40011e0 tx=0x7f1ba4009040 comp rx=0 tx=0).stop 2024-09-13T18:36:34.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 msgr2=0x7f1bbc15b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bac035040 tx=0x7f1bac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 shutdown_connections 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b9806ac00 0x7f1b9806d0c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bbc1434c0 0x7f1bbc1418b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bbc0b3da0 0x7f1bbc13abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 --2- 172.21.15.192:0/3040935089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bbc06a8b0 0x7f1bbc15b720 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 >> 172.21.15.192:0/3040935089 conn(0x7f1bbc0b08f0 msgr2=0x7f1bbc0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.303+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 shutdown_connections 2024-09-13T18:36:34.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.304+0000 7f1bc2200640 1 -- 172.21.15.192:0/3040935089 wait complete. 2024-09-13T18:36:34.323 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:36:34.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.476+0000 7f6edf000640 1 Processor -- start 2024-09-13T18:36:34.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.476+0000 7f6edf000640 1 -- start start 2024-09-13T18:36:34.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.477+0000 7f6edf000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ed80cb730 0x7f6ed815d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6edf000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80ccc30 0x7f6ed806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6edf000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed815e110 con 0x7f6ed80b3d90 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6edf000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed815e3f0 con 0x7f6ed80cb730 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6edf000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed815e6d0 con 0x7f6ed80ccc30 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ed80cb730 0x7f6ed815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6ed80cb730 0x7f6ed815d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52128/0 (socket says 172.21.15.192:52128) 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 -- 172.21.15.192:0/1801987803 learned_addr learned my addr 172.21.15.192:0/1801987803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:34.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6edd000640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80ccc30 0x7f6ed806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 -- 172.21.15.192:0/1801987803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80ccc30 msgr2=0x7f6ed806fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:34.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80ccc30 0x7f6ed806fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 -- 172.21.15.192:0/1801987803 >> v1:172.21.15.194:6789/0 conn(0x7f6ed80b3d90 legacy=0x7f6ed80cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7e00640 1 -- 172.21.15.192:0/1801987803 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80cbd20 con 0x7f6ed80cb730 2024-09-13T18:36:34.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.478+0000 7f6ed7400640 1 -- 172.21.15.192:0/1801987803 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1050447576 0 0) 0x7f6ed815e110 con 0x7f6ed80b3d90 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.479+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80cb730 0x7f6ed815d810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800bb10 tx=0x7f6ec802c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0d73e13c3306e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6ed7400640 1 -- 172.21.15.192:0/1801987803 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8032820 con 0x7f6ed80cb730 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6ed7400640 1 -- 172.21.15.192:0/1801987803 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec802e040 con 0x7f6ed80cb730 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6ed7400640 1 -- 172.21.15.192:0/1801987803 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8032ba0 con 0x7f6ed80cb730 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 -- 172.21.15.192:0/1801987803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80cb730 msgr2=0x7f6ed815d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80cb730 0x7f6ed815d810 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6ec800bb10 tx=0x7f6ec802c920 comp rx=0 tx=0).stop 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 -- 172.21.15.192:0/1801987803 shutdown_connections 2024-09-13T18:36:34.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80ccc30 0x7f6ed806fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 --2- 172.21.15.192:0/1801987803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80cb730 0x7f6ed815d810 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 -- 172.21.15.192:0/1801987803 >> 172.21.15.192:0/1801987803 conn(0x7f6ed80b0c40 msgr2=0x7f6ed80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:34.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 -- 172.21.15.192:0/1801987803 shutdown_connections 2024-09-13T18:36:34.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.480+0000 7f6edf000640 1 -- 172.21.15.192:0/1801987803 wait complete. 2024-09-13T18:36:34.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.482+0000 7f6edf000640 1 Processor -- start 2024-09-13T18:36:34.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.482+0000 7f6edf000640 1 -- start start 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80b3d90 0x7f6ed80b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 0x7f6ed81322f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80cae90 con 0x7f6ed80c80e0 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed81332a0 con 0x7f6ed80cb730 2024-09-13T18:36:34.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edf000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8132d70 con 0x7f6ed80b3d90 2024-09-13T18:36:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52136/0 (socket says 172.21.15.192:52136) 2024-09-13T18:36:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.483+0000 7f6edd000640 1 -- 172.21.15.192:0/355787616 learned_addr learned my addr 172.21.15.192:0/355787616 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80b3d90 0x7f6ed80b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ecf400640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 0x7f6ed81322f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 -- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80b3d90 msgr2=0x7f6ed80b0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80b3d90 0x7f6ed80b0300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 -- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 msgr2=0x7f6ed81322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 0x7f6ed81322f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 -- 172.21.15.192:0/355787616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec800b770 con 0x7f6ed80c80e0 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ecf400640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 0x7f6ed81322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:34.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edd000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000efc0 tx=0x7f6ed000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0009ba0 con 0x7f6ed80c80e0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000f040 con 0x7f6ed80c80e0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed00146c0 con 0x7f6ed80c80e0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.484+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed8133000 con 0x7f6ed80c80e0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.485+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed80ca7d0 con 0x7f6ed80c80e0 2024-09-13T18:36:34.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.486+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed815d810 con 0x7f6ed80c80e0 2024-09-13T18:36:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.486+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6ed0014820 con 0x7f6ed80c80e0 2024-09-13T18:36:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.487+0000 7f6ed4c00640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.487+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6ed008a1b0 con 0x7f6ed80c80e0 2024-09-13T18:36:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.487+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:34.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.488+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8037000 tx=0x7f6ec8032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:34.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.491+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6ed00552a0 con 0x7f6ed80c80e0 2024-09-13T18:36:34.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:34.660+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6ed806c3d0 con 0x7f6ed80c80e0 2024-09-13T18:36:35.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.306+0000 7f6ed4c00640 1 -- 172.21.15.192:0/355787616 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6ed00588c0 con 0x7f6ed80c80e0 2024-09-13T18:36:35.309 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:36:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 msgr2=0x7f6eb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8037000 tx=0x7f6ec8032000 comp rx=0 tx=0).stop 2024-09-13T18:36:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 msgr2=0x7f6ed8132830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000efc0 tx=0x7f6ed000c490 comp rx=0 tx=0).stop 2024-09-13T18:36:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 shutdown_connections 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80c80e0 0x7f6ed8132830 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80cb730 0x7f6ed81322f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 --2- 172.21.15.192:0/355787616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80b3d90 0x7f6ed80b0300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 >> 172.21.15.192:0/355787616 conn(0x7f6ed80b0c40 msgr2=0x7f6ed80b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 shutdown_connections 2024-09-13T18:36:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.309+0000 7f6edf000640 1 -- 172.21.15.192:0/355787616 wait complete. 2024-09-13T18:36:35.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:36:35.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.485+0000 7f103bc00640 1 Processor -- start 2024-09-13T18:36:35.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.485+0000 7f103bc00640 1 -- start start 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.486+0000 7f103bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10340cb730 0x7f103415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.486+0000 7f103bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340ccc30 0x7f103406fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.486+0000 7f103bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103415e110 con 0x7f10340b3d90 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.486+0000 7f103bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103415e3f0 con 0x7f10340cb730 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.486+0000 7f103bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103415e6d0 con 0x7f10340ccc30 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10340cb730 0x7f103415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f10340cb730 0x7f103415d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52150/0 (socket says 172.21.15.192:52150) 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 -- 172.21.15.192:0/882893299 learned_addr learned my addr 172.21.15.192:0/882893299 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039c00640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340ccc30 0x7f103406fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 -- 172.21.15.192:0/882893299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340ccc30 msgr2=0x7f103406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340ccc30 0x7f103406fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 -- 172.21.15.192:0/882893299 >> v1:172.21.15.194:6789/0 conn(0x7f10340b3d90 legacy=0x7f10340cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.487+0000 7f1039200640 1 -- 172.21.15.192:0/882893299 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10340cbd20 con 0x7f10340cb730 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.488+0000 7f1039200640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103415d810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1024009870 tx=0x7f102402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af7189e9d078ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.488+0000 7f1033400640 1 -- 172.21.15.192:0/882893299 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024032440 con 0x7f10340cb730 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.488+0000 7f1033400640 1 -- 172.21.15.192:0/882893299 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10240325a0 con 0x7f10340cb730 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.488+0000 7f1033400640 1 -- 172.21.15.192:0/882893299 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1024032930 con 0x7f10340cb730 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 -- 172.21.15.192:0/882893299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 msgr2=0x7f103415d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103415d810 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1024009870 tx=0x7f102402a270 comp rx=0 tx=0).stop 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 -- 172.21.15.192:0/882893299 shutdown_connections 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340ccc30 0x7f103406fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 --2- 172.21.15.192:0/882893299 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103415d810 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 -- 172.21.15.192:0/882893299 >> 172.21.15.192:0/882893299 conn(0x7f10340b0c40 msgr2=0x7f10340b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 -- 172.21.15.192:0/882893299 shutdown_connections 2024-09-13T18:36:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.489+0000 7f103bc00640 1 -- 172.21.15.192:0/882893299 wait complete. 2024-09-13T18:36:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.491+0000 7f103bc00640 1 Processor -- start 2024-09-13T18:36:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.491+0000 7f103bc00640 1 -- start start 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 0x7f1034159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 0x7f1034140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103413e330 con 0x7f10340cb730 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103413e610 con 0x7f1034140050 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f103bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103413e8f0 con 0x7f10340b3d90 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52154/0 (socket says 172.21.15.192:52154) 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 -- 172.21.15.192:0/2980524427 learned_addr learned my addr 172.21.15.192:0/2980524427 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1039200640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 0x7f1034159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1039c00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 0x7f1034140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 -- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 msgr2=0x7f1034159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 0x7f1034159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 -- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 msgr2=0x7f1034140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 0x7f1034140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1033e00640 1 -- 172.21.15.192:0/2980524427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10240094d0 con 0x7f10340cb730 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1039200640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 0x7f1034159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.492+0000 7f1039c00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 0x7f1034140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f1033e00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f102000c400 tx=0x7f102000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10200052d0 con 0x7f10340cb730 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1020005450 con 0x7f10340cb730 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1020007260 con 0x7f10340cb730 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103413ebd0 con 0x7f10340cb730 2024-09-13T18:36:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.493+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f103413df70 con 0x7f10340cb730 2024-09-13T18:36:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.494+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f103413e100 con 0x7f10340cb730 2024-09-13T18:36:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.495+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f10200073c0 con 0x7f10340cb730 2024-09-13T18:36:35.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.496+0000 7f1030c00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 0x7f101406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:35.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.496+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5386+0+0 (secure 0 0 0) 0x7f10200886f0 con 0x7f10340cb730 2024-09-13T18:36:35.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.496+0000 7f1039200640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 0x7f101406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:35.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.497+0000 7f1039200640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 0x7f101406d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1024034000 tx=0x7f102402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.500+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1020053970 con 0x7f10340cb730 2024-09-13T18:36:35.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:35.667+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f10340c3cd0 con 0x7f10340cb730 2024-09-13T18:36:36.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.308+0000 7f1030c00640 1 -- 172.21.15.192:0/2980524427 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f10340c3cd0 con 0x7f10340cb730 2024-09-13T18:36:36.311 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:36:36.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.310+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 msgr2=0x7f101406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.310+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 0x7f101406d0c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1024034000 tx=0x7f102402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:36.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.310+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 msgr2=0x7f103413fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.310+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f102000c400 tx=0x7f102000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 shutdown_connections 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f101406ac00 0x7f101406d0c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1034140050 0x7f1034140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10340cb730 0x7f103413fb10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 --2- 172.21.15.192:0/2980524427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10340b3d90 0x7f1034159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 >> 172.21.15.192:0/2980524427 conn(0x7f10340b0c40 msgr2=0x7f10340b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 shutdown_connections 2024-09-13T18:36:36.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.311+0000 7f103bc00640 1 -- 172.21.15.192:0/2980524427 wait complete. 2024-09-13T18:36:36.335 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:36:36.335 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:36:36.335 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:36:36.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:36.336 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:36:36.336 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:36:36.336 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:36:36.336 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:36.336 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:36:36.336 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:36:36.337 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:36:36.337 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:36.337 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:36:36.337 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:36:36.337 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:36:36.337 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:36:36.350 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:36:36.350 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:36:36.351 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:36:36.352 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:36:36.353 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:36:36.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:36:36.354 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:36:36.354 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:36:36.395 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:36:36.396 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:36.398 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:36:36.398 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:36.398 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:36:36.399 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:36.400 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:36:36.400 DEBUG:teuthology.parallel:result is None 2024-09-13T18:36:36.400 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:36:36.460 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:36.464 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:36:36.527 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:36:36.528 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:36:36.531 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:36:36.531 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:36:36.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.559+0000 7f5339200640 1 Processor -- start 2024-09-13T18:36:36.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.559+0000 7f5339200640 1 -- start start 2024-09-13T18:36:36.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.560+0000 7f5339200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 0x7f53340b3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.560+0000 7f5339200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 0x7f533406c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5339200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53340aeb50 con 0x7f53340ae320 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5339200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53340aee30 con 0x7f53340737b0 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5339200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53340af110 con 0x7f53341467c0 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5332a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f53340ae320 0x7f53340730a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38782/0 (socket says 172.21.15.192:38782) 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5332a00640 1 -- 172.21.15.192:0/3665700491 learned_addr learned my addr 172.21.15.192:0/3665700491 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333400640 1 --2- 172.21.15.192:0/3665700491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 0x7f53340b3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333e00640 1 --2- 172.21.15.192:0/3665700491 >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 0x7f533406c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5332000640 1 -- 172.21.15.192:0/3665700491 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218194847 0 0) 0x7f53340aeb50 con 0x7f53340ae320 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5332000640 1 -- 172.21.15.192:0/3665700491 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5318003520 con 0x7f53340ae320 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333400640 1 -- 172.21.15.192:0/3665700491 >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 msgr2=0x7f533406c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333400640 1 --2- 172.21.15.192:0/3665700491 >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 0x7f533406c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333400640 1 -- 172.21.15.192:0/3665700491 >> v1:172.21.15.192:6789/0 conn(0x7f53340ae320 legacy=0x7f53340730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333400640 1 -- 172.21.15.192:0/3665700491 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53340af3f0 con 0x7f53341467c0 2024-09-13T18:36:36.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.561+0000 7f5333e00640 1 --2- 172.21.15.192:0/3665700491 >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 0x7f533406c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:36.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.562+0000 7f5333400640 1 --2- 172.21.15.192:0/3665700491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 0x7f53340b3dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53240097a0 tx=0x7f532402a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5886dfe49bbce77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5332000640 1 -- 172.21.15.192:0/3665700491 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532402adb0 con 0x7f53341467c0 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5332000640 1 -- 172.21.15.192:0/3665700491 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5324032440 con 0x7f53341467c0 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5332000640 1 -- 172.21.15.192:0/3665700491 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240327d0 con 0x7f53341467c0 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 -- 172.21.15.192:0/3665700491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 msgr2=0x7f53340b3dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 --2- 172.21.15.192:0/3665700491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 0x7f53340b3dc0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f53240097a0 tx=0x7f532402a060 comp rx=0 tx=0).stop 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 -- 172.21.15.192:0/3665700491 shutdown_connections 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 --2- 172.21.15.192:0/3665700491 >> v2:172.21.15.192:3300/0 conn(0x7f53340737b0 0x7f533406c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 --2- 172.21.15.192:0/3665700491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53341467c0 0x7f53340b3dc0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 -- 172.21.15.192:0/3665700491 >> 172.21.15.192:0/3665700491 conn(0x7f533406a080 msgr2=0x7f533406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 -- 172.21.15.192:0/3665700491 shutdown_connections 2024-09-13T18:36:36.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.563+0000 7f5339200640 1 -- 172.21.15.192:0/3665700491 wait complete. 2024-09-13T18:36:36.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.565+0000 7f5339200640 1 Processor -- start 2024-09-13T18:36:36.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.565+0000 7f5339200640 1 -- start start 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 0x7f533414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53340ae320 0x7f53340ce680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533414c830 con 0x7f53341467c0 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533414c490 con 0x7f53340ae320 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5339200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533414ed70 con 0x7f53340737b0 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5333e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5333400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 0x7f533414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5333e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52212/0 (socket says 172.21.15.192:52212) 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5333e00640 1 -- 172.21.15.192:0/512103270 learned_addr learned my addr 172.21.15.192:0/512103270 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:36.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.566+0000 7f5332a00640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53340ae320 0x7f53340ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 -- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53340ae320 msgr2=0x7f53340ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53340ae320 0x7f53340ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 -- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 msgr2=0x7f533406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 -- 172.21.15.192:0/512103270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009a70 con 0x7f53340737b0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333e00640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5333400640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 0x7f533414e4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53340af250 tx=0x7f53240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532403c8d0 con 0x7f53340737b0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532403ca70 con 0x7f53340737b0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5324009400 con 0x7f53340737b0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532403ce20 con 0x7f53340737b0 2024-09-13T18:36:36.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.567+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533414f330 con 0x7f53340737b0 2024-09-13T18:36:36.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.569+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533414f4c0 con 0x7f53340737b0 2024-09-13T18:36:36.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.569+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f532403b3a0 con 0x7f53340737b0 2024-09-13T18:36:36.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.570+0000 7f532b400640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:36.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.570+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f53240a9bd0 con 0x7f53340737b0 2024-09-13T18:36:36.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.570+0000 7f5332a00640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:36.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.571+0000 7f5332a00640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 0x7f531406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53341f5de0 tx=0x7f5320007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:36.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.574+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53240750c0 con 0x7f53340737b0 2024-09-13T18:36:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:36.757+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f53340b3180 con 0x7f53340737b0 2024-09-13T18:36:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.562+0000 7f532b400640 1 -- 172.21.15.192:0/512103270 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v31) v1 ==== 97+0+0 (secure 0 0 0) 0x7f532404a080 con 0x7f53340737b0 2024-09-13T18:36:37.565 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.564+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 msgr2=0x7f531406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.564+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 0x7f531406d0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f53341f5de0 tx=0x7f5320007d30 comp rx=0 tx=0).stop 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.564+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 msgr2=0x7f533414e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.564+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 0x7f533414e4c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f53340af250 tx=0x7f53240046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 shutdown_connections 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f531406ac00 0x7f531406d0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53341467c0 0x7f533406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53340ae320 0x7f53340ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 --2- 172.21.15.192:0/512103270 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53340737b0 0x7f533414e4c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 >> 172.21.15.192:0/512103270 conn(0x7f533406a080 msgr2=0x7f53340730a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 shutdown_connections 2024-09-13T18:36:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.565+0000 7f5339200640 1 -- 172.21.15.192:0/512103270 wait complete. 2024-09-13T18:36:37.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:36:37.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.734+0000 7fd6dce00640 1 Processor -- start 2024-09-13T18:36:37.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.734+0000 7fd6dce00640 1 -- start start 2024-09-13T18:36:37.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 0x7fd6d815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d80cb0b0 0x7fd6d815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6d8140980 0x7fd6d8140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d815c160 con 0x7fd6d8140980 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6d8140480 con 0x7fd6d80cacd0 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.735+0000 7fd6dce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d815ee90 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6d8140980 0x7fd6d8140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6d8140980 0x7fd6d8140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52224/0 (socket says 172.21.15.192:52224) 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 -- 172.21.15.192:0/1547856215 learned_addr learned my addr 172.21.15.192:0/1547856215 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d5e00640 1 --2- 172.21.15.192:0/1547856215 >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 0x7fd6d815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6cfe00640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d80cb0b0 0x7fd6d815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 -- 172.21.15.192:0/1547856215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d80cb0b0 msgr2=0x7fd6d815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d80cb0b0 0x7fd6d815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 -- 172.21.15.192:0/1547856215 >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 msgr2=0x7fd6d815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 --2- 172.21.15.192:0/1547856215 >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 0x7fd6d815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d6800640 1 -- 172.21.15.192:0/1547856215 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d815f170 con 0x7fd6d8140980 2024-09-13T18:36:37.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.736+0000 7fd6d5e00640 1 --2- 172.21.15.192:0/1547856215 >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 0x7fd6d815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:37.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.737+0000 7fd6d6800640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d8140980 0x7fd6d8140df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80b2350 tx=0x7fd6d002a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3860a8d7c2581391 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.737+0000 7fd6d5400640 1 -- 172.21.15.192:0/1547856215 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0031600 con 0x7fd6d8140980 2024-09-13T18:36:37.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6d5400640 1 -- 172.21.15.192:0/1547856215 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d002d050 con 0x7fd6d8140980 2024-09-13T18:36:37.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6d5400640 1 -- 172.21.15.192:0/1547856215 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0031980 con 0x7fd6d8140980 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 -- 172.21.15.192:0/1547856215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d8140980 msgr2=0x7fd6d8140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d8140980 0x7fd6d8140df0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd6d80b2350 tx=0x7fd6d002a610 comp rx=0 tx=0).stop 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 -- 172.21.15.192:0/1547856215 shutdown_connections 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d8140980 0x7fd6d8140df0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 --2- 172.21.15.192:0/1547856215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d80cb0b0 0x7fd6d815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 --2- 172.21.15.192:0/1547856215 >> v2:172.21.15.194:3300/0 conn(0x7fd6d80cacd0 0x7fd6d815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 -- 172.21.15.192:0/1547856215 >> 172.21.15.192:0/1547856215 conn(0x7fd6d80ae960 msgr2=0x7fd6d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 -- 172.21.15.192:0/1547856215 shutdown_connections 2024-09-13T18:36:37.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.738+0000 7fd6dce00640 1 -- 172.21.15.192:0/1547856215 wait complete. 2024-09-13T18:36:37.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.740+0000 7fd6dce00640 1 Processor -- start 2024-09-13T18:36:37.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.740+0000 7fd6dce00640 1 -- start start 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d80cacd0 0x7fd6d813cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d8140980 0x7fd6d806bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d8159c60 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d806b070 con 0x7fd6d80cacd0 2024-09-13T18:36:37.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6dce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d806b350 con 0x7fd6d8140980 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6cfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6cfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52236/0 (socket says 172.21.15.192:52236) 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6cfe00640 1 -- 172.21.15.192:0/2963963849 learned_addr learned my addr 172.21.15.192:0/2963963849 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6d6800640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d8140980 0x7fd6d806bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.741+0000 7fd6d5e00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d80cacd0 0x7fd6d813cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 -- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d8140980 msgr2=0x7fd6d806bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d8140980 0x7fd6d806bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 -- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d80cacd0 msgr2=0x7fd6d813cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d80cacd0 0x7fd6d813cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:37.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 -- 172.21.15.192:0/2963963849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c8009400 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6cfe00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000e9b0 tx=0x7fd6c000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c0009670 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6c000c9a0 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d0009b30 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6c000cd50 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.742+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d813d4e0 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.743+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d815bc20 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.744+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd6c0013470 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.745+0000 7fd6ce000640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 0x7fd6b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:37.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.745+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6c00893a0 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.746+0000 7fd6d5e00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 0x7fd6b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:37.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.746+0000 7fd6d5e00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 0x7fd6b406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd6d813dc70 tx=0x7fd6c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:37.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.750+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd6c0054830 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.979+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd6d806c6c0 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.980+0000 7fd6ce000640 1 -- 172.21.15.192:0/2963963849 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fd6c0057e50 con 0x7fd6d80cb0b0 2024-09-13T18:36:37.982 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:36:37.983 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.984 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.985 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.986 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.987 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.988 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:36:37.989 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.990 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.991 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.992 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.993 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:36:37.995 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-mds", 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRmnTp+OhAA+oGtyMsshOhnIwsaSEEqIw==", 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-mds" 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-mgr", 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRm0UN+OhAAORd+zmQ6sVKLMbM4OEU5Tg==", 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-osd", 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRmyUx+OhAAx2GefaANU6FT9voXeynBAg==", 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-osd" 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.997 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-rbd", 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRmwlR+OhAAKwiD0jOWfu0cmPQroR3upw==", 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRmBl1+OhAAiOfiW+88atVqPqwUfEiSLQ==", 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.998 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.bootstrap-rgw", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDpheRmpGV+OhAA0RTQEYAtTW5/o4On+hMW3w==", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:36:37.999 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:36:38.000 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 msgr2=0x7fd6b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 0x7fd6b406d0c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd6d813dc70 tx=0x7fd6c8008040 comp rx=0 tx=0).stop 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 msgr2=0x7fd6d81591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd6c000e9b0 tx=0x7fd6c000ee70 comp rx=0 tx=0).stop 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 shutdown_connections 2024-09-13T18:36:38.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd6b406ac00 0x7fd6b406d0c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6d8140980 0x7fd6d806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6d80cb0b0 0x7fd6d81591a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 --2- 172.21.15.192:0/2963963849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6d80cacd0 0x7fd6d813cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 >> 172.21.15.192:0/2963963849 conn(0x7fd6d80ae960 msgr2=0x7fd6d8071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 shutdown_connections 2024-09-13T18:36:38.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:37.982+0000 7fd6dce00640 1 -- 172.21.15.192:0/2963963849 wait complete. 2024-09-13T18:36:38.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-13T18:36:38.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.153+0000 7f848d000640 1 Processor -- start 2024-09-13T18:36:38.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.154+0000 7f848d000640 1 -- start start 2024-09-13T18:36:38.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f848d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84880b0460 0x7f848815b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f848d000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848813e080 con 0x7f8488155460 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f848d000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848815b8a0 con 0x7f848813e310 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f848d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848815b6c0 con 0x7f84880b0460 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f847d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84880b0460 0x7f848815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f8485e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8488155460 0x7f84880afd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38786/0 (socket says 172.21.15.192:38786) 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f847d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84880b0460 0x7f848815b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52246/0 (socket says 172.21.15.192:52246) 2024-09-13T18:36:38.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f8485e00640 1 -- 172.21.15.192:0/3088762660 learned_addr learned my addr 172.21.15.192:0/3088762660 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:38.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f847d400640 1 -- 172.21.15.192:0/3088762660 >> v1:172.21.15.194:6789/0 conn(0x7f848813e310 legacy=0x7f84880cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:38.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f847d400640 1 -- 172.21.15.192:0/3088762660 >> v1:172.21.15.192:6789/0 conn(0x7f8488155460 legacy=0x7f84880afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.155+0000 7f847d400640 1 -- 172.21.15.192:0/3088762660 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848815bb80 con 0x7f84880b0460 2024-09-13T18:36:38.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.156+0000 7f847d400640 1 --2- 172.21.15.192:0/3088762660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f848815b180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84700097a0 tx=0x7f847002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16f61ca094009b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f8485400640 1 -- 172.21.15.192:0/3088762660 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470032440 con 0x7f84880b0460 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f8485400640 1 -- 172.21.15.192:0/3088762660 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84700325a0 con 0x7f84880b0460 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f8485400640 1 -- 172.21.15.192:0/3088762660 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8470032930 con 0x7f84880b0460 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 -- 172.21.15.192:0/3088762660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 msgr2=0x7f848815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 --2- 172.21.15.192:0/3088762660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f848815b180 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f84700097a0 tx=0x7f847002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 -- 172.21.15.192:0/3088762660 shutdown_connections 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 --2- 172.21.15.192:0/3088762660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f848815b180 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 -- 172.21.15.192:0/3088762660 >> 172.21.15.192:0/3088762660 conn(0x7f84880ae960 msgr2=0x7f848806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 -- 172.21.15.192:0/3088762660 shutdown_connections 2024-09-13T18:36:38.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.157+0000 7f848d000640 1 -- 172.21.15.192:0/3088762660 wait complete. 2024-09-13T18:36:38.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.159+0000 7f848d000640 1 Processor -- start 2024-09-13T18:36:38.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.159+0000 7f848d000640 1 -- start start 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 0x7f84880ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8488155460 0x7f84880add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881f0210 con 0x7f84880b0460 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84881f3830 con 0x7f848813e310 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f848d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84881f3b10 con 0x7f8488155460 2024-09-13T18:36:38.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f8485e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f8485e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52256/0 (socket says 172.21.15.192:52256) 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.160+0000 7f8485e00640 1 -- 172.21.15.192:0/2967988255 learned_addr learned my addr 172.21.15.192:0/2967988255 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 -- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8488155460 msgr2=0x7f84880add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8488155460 0x7f84880add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 -- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 msgr2=0x7f84880ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f847d400640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 0x7f84880ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 0x7f84880ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 -- 172.21.15.192:0/2967988255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8470009400 con 0x7f84880b0460 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f847d400640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 0x7f84880ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f8485e00640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f847800c480 tx=0x7f847800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478005ce0 con 0x7f84880b0460 2024-09-13T18:36:38.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8478005e40 con 0x7f84880b0460 2024-09-13T18:36:38.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84780072f0 con 0x7f84880b0460 2024-09-13T18:36:38.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84881f3df0 con 0x7f84880b0460 2024-09-13T18:36:38.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.161+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84881f43b0 con 0x7f84880b0460 2024-09-13T18:36:38.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.163+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8488141170 con 0x7f84880b0460 2024-09-13T18:36:38.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.163+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8478007510 con 0x7f84880b0460 2024-09-13T18:36:38.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.164+0000 7f847ea00640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 0x7f846406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.164+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8478088510 con 0x7f84880b0460 2024-09-13T18:36:38.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.164+0000 7f847d400640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 0x7f846406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.165+0000 7f847d400640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 0x7f846406d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8470034000 tx=0x7f847002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.168+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8478053ae0 con 0x7f84880b0460 2024-09-13T18:36:38.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.400+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f84881e92f0 con 0x7f84880b0460 2024-09-13T18:36:38.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.404+0000 7f847ea00640 1 -- 172.21.15.192:0/2967988255 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f84780170a0 con 0x7f84880b0460 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 msgr2=0x7f846406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 0x7f846406d0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8470034000 tx=0x7f847002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 msgr2=0x7f84881f2e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f847800c480 tx=0x7f847800c940 comp rx=0 tx=0).stop 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 shutdown_connections 2024-09-13T18:36:38.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f846406ac00 0x7f846406d0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8488155460 0x7f84880add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f848813e310 0x7f84880ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 --2- 172.21.15.192:0/2967988255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84880b0460 0x7f84881f2e50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 >> 172.21.15.192:0/2967988255 conn(0x7f84880ae960 msgr2=0x7f84880cd1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 shutdown_connections 2024-09-13T18:36:38.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.406+0000 7f848d000640 1 -- 172.21.15.192:0/2967988255 wait complete. 2024-09-13T18:36:38.424 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-13T18:36:38.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.575+0000 7fdbba400640 1 Processor -- start 2024-09-13T18:36:38.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.575+0000 7fdbba400640 1 -- start start 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbba400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbb40cd2d0 0x7fdbb4159670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbba400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb4159c80 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbba400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb4159f60 con 0x7fdbb406bd60 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbba400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb415a240 con 0x7fdbb40cd2d0 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbb3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdbb40cd6b0 0x7fdbb415a830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38788/0 (socket says 172.21.15.192:38788) 2024-09-13T18:36:38.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.576+0000 7fdbb3e00640 1 -- 172.21.15.192:0/2129166125 learned_addr learned my addr 172.21.15.192:0/2129166125 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:38.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb9000640 1 --2- 172.21.15.192:0/2129166125 >> v2:172.21.15.194:3300/0 conn(0x7fdbb40cd2d0 0x7fdbb4159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791655244 0 0) 0x7fdbb4159c80 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb9c003440 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 287309365 0 0) 0x7fdb9c003440 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 >> v2:172.21.15.194:3300/0 conn(0x7fdbb40cd2d0 msgr2=0x7fdbb4159670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 --2- 172.21.15.192:0/2129166125 >> v2:172.21.15.194:3300/0 conn(0x7fdbb40cd2d0 0x7fdbb4159670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 >> v1:172.21.15.194:6789/0 conn(0x7fdbb406bd60 legacy=0x7fdbb40b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb415a520 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fdba0001670 con 0x7fdbb40cd6b0 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 >> v1:172.21.15.192:6789/0 conn(0x7fdbb40cd6b0 legacy=0x7fdbb415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 0x7fdb9c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c008850 0x7fdb9c00ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb9c00b440 0x7fdb9c00d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb415a240 con 0x7fdb9c003a60 2024-09-13T18:36:38.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c00e1e0 con 0x7fdb9c00b440 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.577+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9c00e3a0 con 0x7fdb9c008850 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 0x7fdb9c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb3e00640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c008850 0x7fdb9c00ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9a00640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb9c00b440 0x7fdb9c00d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 -- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c008850 msgr2=0x7fdb9c00ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c008850 0x7fdb9c00ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 -- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb9c00b440 msgr2=0x7fdb9c00d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb9c00b440 0x7fdb9c00d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9000640 1 -- 172.21.15.192:0/2129166125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c003440 con 0x7fdb9c003a60 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9a00640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdb9c00b440 0x7fdb9c00d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:38.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.578+0000 7fdbb9a00640 1 -- 172.21.15.192:0/2129166125 reap_dead start 2024-09-13T18:36:38.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.579+0000 7fdbb9000640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 0x7fdb9c003e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009ac0 tx=0x7fdb9c0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a8bcdfbd6e9423 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.579+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8031400 con 0x7fdb9c003a60 2024-09-13T18:36:38.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.579+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba802d050 con 0x7fdb9c003a60 2024-09-13T18:36:38.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.579+0000 7fdbb3400640 1 -- 172.21.15.192:0/2129166125 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba8031780 con 0x7fdb9c003a60 2024-09-13T18:36:38.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 -- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 msgr2=0x7fdb9c003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 0x7fdb9c003e40 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009ac0 tx=0x7fdb9c0036f0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 -- 172.21.15.192:0/2129166125 shutdown_connections 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 --2- 172.21.15.192:0/2129166125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb9c003a60 0x7fdb9c003e40 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 -- 172.21.15.192:0/2129166125 >> 172.21.15.192:0/2129166125 conn(0x7fdbb40734f0 msgr2=0x7fdbb40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 -- 172.21.15.192:0/2129166125 shutdown_connections 2024-09-13T18:36:38.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.580+0000 7fdbba400640 1 -- 172.21.15.192:0/2129166125 wait complete. 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.581+0000 7fdbba400640 1 Processor -- start 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 -- start start 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c003a60 0x7fdbb4144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb40704d0 0x7fdbb4070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb41449b0 con 0x7fdbb40ae190 2024-09-13T18:36:38.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb4070e90 con 0x7fdbb40704d0 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.582+0000 7fdbba400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ad130 con 0x7fdb9c003a60 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52280/0 (socket says 172.21.15.192:52280) 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 -- 172.21.15.192:0/3480124870 learned_addr learned my addr 172.21.15.192:0/3480124870 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb9a00640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb40704d0 0x7fdbb4070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb9000640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c003a60 0x7fdbb4144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 -- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c003a60 msgr2=0x7fdbb4144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c003a60 0x7fdbb4144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 -- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb40704d0 msgr2=0x7fdbb4070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb40704d0 0x7fdbb4070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 -- 172.21.15.192:0/3480124870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40ad3d0 con 0x7fdbb40ae190 2024-09-13T18:36:38.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.583+0000 7fdbb3e00640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007310 tx=0x7fdba0007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.584+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000f960 con 0x7fdbb40ae190 2024-09-13T18:36:38.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.584+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba000fac0 con 0x7fdbb40ae190 2024-09-13T18:36:38.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.584+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba000fe30 con 0x7fdbb40ae190 2024-09-13T18:36:38.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.584+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb40ad6b0 con 0x7fdbb40ae190 2024-09-13T18:36:38.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.584+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb40adc70 con 0x7fdbb40ae190 2024-09-13T18:36:38.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.585+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb40ae610 con 0x7fdbb40ae190 2024-09-13T18:36:38.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.586+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdba001d460 con 0x7fdbb40ae190 2024-09-13T18:36:38.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.587+0000 7fdbb0c00640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 0x7fdb9406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:38.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.587+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdba0089080 con 0x7fdbb40ae190 2024-09-13T18:36:38.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.587+0000 7fdbb9000640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 0x7fdb9406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:38.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.588+0000 7fdbb9000640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 0x7fdb9406d0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdba8033000 tx=0x7fdba8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:38.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.591+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdba00545b0 con 0x7fdbb40ae190 2024-09-13T18:36:38.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.819+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fdbb415a830 con 0x7fdbb40ae190 2024-09-13T18:36:38.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.825+0000 7fdbb0c00640 1 -- 172.21.15.192:0/3480124870 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdba0057bd0 con 0x7fdbb40ae190 2024-09-13T18:36:38.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 msgr2=0x7fdb9406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 0x7fdb9406d0f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdba8033000 tx=0x7fdba8008030 comp rx=0 tx=0).stop 2024-09-13T18:36:38.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 msgr2=0x7fdbb4154740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:38.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdba0007310 tx=0x7fdba0007710 comp rx=0 tx=0).stop 2024-09-13T18:36:38.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 shutdown_connections 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdb9406ac30 0x7fdb9406d0f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbb40704d0 0x7fdbb4070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbb40ae190 0x7fdbb4154740 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 --2- 172.21.15.192:0/3480124870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdb9c003a60 0x7fdbb4144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 >> 172.21.15.192:0/3480124870 conn(0x7fdbb40734f0 msgr2=0x7fdbb4152570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 shutdown_connections 2024-09-13T18:36:38.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.827+0000 7fdbba400640 1 -- 172.21.15.192:0/3480124870 wait complete. 2024-09-13T18:36:38.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-13T18:36:38.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.996+0000 7ff2eb400640 1 Processor -- start 2024-09-13T18:36:38.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.996+0000 7ff2eb400640 1 -- start start 2024-09-13T18:36:39.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.997+0000 7ff2eb400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 0x7ff2e415b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2eb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2e40b0460 0x7ff2e4140db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2eb400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e413e080 con 0x7ff2e413e310 2024-09-13T18:36:39.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2eb400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e415b6c0 con 0x7ff2e40b0460 2024-09-13T18:36:39.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2eb400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e41412f0 con 0x7ff2e4155460 2024-09-13T18:36:39.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2e40b0460 0x7ff2e4140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2e40b0460 0x7ff2e4140db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52282/0 (socket says 172.21.15.192:52282) 2024-09-13T18:36:39.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 -- 172.21.15.192:0/3109637858 learned_addr learned my addr 172.21.15.192:0/3109637858 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e8a00640 1 --2- 172.21.15.192:0/3109637858 >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 0x7ff2e415b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 -- 172.21.15.192:0/3109637858 >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 msgr2=0x7ff2e415b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 --2- 172.21.15.192:0/3109637858 >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 0x7ff2e415b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 -- 172.21.15.192:0/3109637858 >> v1:172.21.15.192:6789/0 conn(0x7ff2e413e310 legacy=0x7ff2e40afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e9400640 1 -- 172.21.15.192:0/3109637858 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e415b8a0 con 0x7ff2e40b0460 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e3400640 1 -- 172.21.15.192:0/3109637858 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1116106631 0 0) 0x7ff2e413e080 con 0x7ff2e413e310 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.998+0000 7ff2e8a00640 1 --2- 172.21.15.192:0/3109637858 >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 0x7ff2e415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:39.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:38.999+0000 7ff2e9400640 1 --2- 172.21.15.192:0/3109637858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e40b0460 0x7ff2e4140db0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40b1a90 tx=0x7ff2dc02a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f9dfd765c764dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2e3400640 1 -- 172.21.15.192:0/3109637858 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031600 con 0x7ff2e40b0460 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2e3400640 1 -- 172.21.15.192:0/3109637858 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc02d050 con 0x7ff2e40b0460 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2e3400640 1 -- 172.21.15.192:0/3109637858 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc031980 con 0x7ff2e40b0460 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 -- 172.21.15.192:0/3109637858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e40b0460 msgr2=0x7ff2e4140db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 --2- 172.21.15.192:0/3109637858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e40b0460 0x7ff2e4140db0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7ff2e40b1a90 tx=0x7ff2dc02a730 comp rx=0 tx=0).stop 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 -- 172.21.15.192:0/3109637858 shutdown_connections 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 --2- 172.21.15.192:0/3109637858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e40b0460 0x7ff2e4140db0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 --2- 172.21.15.192:0/3109637858 >> v2:172.21.15.194:3300/0 conn(0x7ff2e4155460 0x7ff2e415b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 -- 172.21.15.192:0/3109637858 >> 172.21.15.192:0/3109637858 conn(0x7ff2e40ae960 msgr2=0x7ff2e406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 -- 172.21.15.192:0/3109637858 shutdown_connections 2024-09-13T18:36:39.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.000+0000 7ff2eb400640 1 -- 172.21.15.192:0/3109637858 wait complete. 2024-09-13T18:36:39.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.002+0000 7ff2eb400640 1 Processor -- start 2024-09-13T18:36:39.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.002+0000 7ff2eb400640 1 -- start start 2024-09-13T18:36:39.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2e40b0460 0x7ff2e413d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 0x7ff2e4156910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e4155940 con 0x7ff2e4155460 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e413db30 con 0x7ff2e413e310 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2eb400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40ae580 con 0x7ff2e40b0460 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2e9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2e9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52294/0 (socket says 172.21.15.192:52294) 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2e9400640 1 -- 172.21.15.192:0/2775202652 learned_addr learned my addr 172.21.15.192:0/2775202652 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2e8a00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2e40b0460 0x7ff2e413d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.003+0000 7ff2e3e00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 0x7ff2e4156910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 -- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2e40b0460 msgr2=0x7ff2e413d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2e40b0460 0x7ff2e413d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 -- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 msgr2=0x7ff2e4156910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 0x7ff2e4156910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 -- 172.21.15.192:0/2775202652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009b30 con 0x7ff2e4155460 2024-09-13T18:36:39.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e3e00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 0x7ff2e4156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:39.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e9400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009f40 tx=0x7ff2dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc03b820 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc03b980 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e4155b50 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc03bd30 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.004+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e4156110 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.005+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e4140db0 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.006+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff2dc038050 con 0x7ff2e4155460 2024-09-13T18:36:39.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.007+0000 7ff2e0c00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 0x7ff2c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.007+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff2dc0a9670 con 0x7ff2e4155460 2024-09-13T18:36:39.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.007+0000 7ff2e8a00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 0x7ff2c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.008+0000 7ff2e8a00640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 0x7ff2c406d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006e80 tx=0x7ff2d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.011+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2dc074c50 con 0x7ff2e4155460 2024-09-13T18:36:39.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.247+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff2e40b3d50 con 0x7ff2e4155460 2024-09-13T18:36:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.252+0000 7ff2e0c00640 1 -- 172.21.15.192:0/2775202652 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff2dc009510 con 0x7ff2e4155460 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 msgr2=0x7ff2c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 0x7ff2c406d0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006e80 tx=0x7ff2d4008040 comp rx=0 tx=0).stop 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 msgr2=0x7ff2e4157b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009f40 tx=0x7ff2dc004a40 comp rx=0 tx=0).stop 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 shutdown_connections 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff2c406ac00 0x7ff2c406d0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4155460 0x7ff2e4157b30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2e413e310 0x7ff2e4156910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 --2- 172.21.15.192:0/2775202652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2e40b0460 0x7ff2e413d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 >> 172.21.15.192:0/2775202652 conn(0x7ff2e40ae960 msgr2=0x7ff2e406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 shutdown_connections 2024-09-13T18:36:39.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.255+0000 7ff2eb400640 1 -- 172.21.15.192:0/2775202652 wait complete. 2024-09-13T18:36:39.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-13T18:36:39.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.423+0000 7f7951000640 1 Processor -- start 2024-09-13T18:36:39.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.423+0000 7f7951000640 1 -- start start 2024-09-13T18:36:39.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7951000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7951000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f794c0b0460 0x7f794c1637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7951000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794c0cd570 con 0x7f794c0b3c60 2024-09-13T18:36:39.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7951000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f794c0cd7a0 con 0x7f794c0b0460 2024-09-13T18:36:39.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7951000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c0cda80 con 0x7f794c0cb490 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7949e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7949e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:34316/0 (socket says 172.21.15.192:34316) 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f7949e00640 1 -- 172.21.15.192:0/3667639990 learned_addr learned my addr 172.21.15.192:0/3667639990 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.425+0000 7f794a800640 1 --2- 172.21.15.192:0/3667639990 >> v2:172.21.15.194:3300/0 conn(0x7f794c0b0460 0x7f794c1637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f7948a00640 1 -- 172.21.15.192:0/3667639990 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2151060179 0 0) 0x7f794c0cd570 con 0x7f794c0b3c60 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f794a800640 1 -- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 msgr2=0x7f794c15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f794a800640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f794a800640 1 -- 172.21.15.192:0/3667639990 >> v1:172.21.15.194:6789/0 conn(0x7f794c0b3c60 legacy=0x7f794c0afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f794a800640 1 -- 172.21.15.192:0/3667639990 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c0cdd60 con 0x7f794c0b0460 2024-09-13T18:36:39.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.426+0000 7f7949e00640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:39.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.427+0000 7f794a800640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c1637c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7944009d90 tx=0x7f794402a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a65f69396a6f8ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7948a00640 1 -- 172.21.15.192:0/3667639990 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944031600 con 0x7f794c0b0460 2024-09-13T18:36:39.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7948a00640 1 -- 172.21.15.192:0/3667639990 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794402d050 con 0x7f794c0b0460 2024-09-13T18:36:39.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7948a00640 1 -- 172.21.15.192:0/3667639990 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7944031980 con 0x7f794c0b0460 2024-09-13T18:36:39.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 -- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 msgr2=0x7f794c1637c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c1637c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7944009d90 tx=0x7f794402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 -- 172.21.15.192:0/3667639990 shutdown_connections 2024-09-13T18:36:39.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c1637c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 --2- 172.21.15.192:0/3667639990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c0cb490 0x7f794c15a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 -- 172.21.15.192:0/3667639990 >> 172.21.15.192:0/3667639990 conn(0x7f794c0ae960 msgr2=0x7f794c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 -- 172.21.15.192:0/3667639990 shutdown_connections 2024-09-13T18:36:39.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.428+0000 7f7951000640 1 -- 172.21.15.192:0/3667639990 wait complete. 2024-09-13T18:36:39.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.430+0000 7f7951000640 1 Processor -- start 2024-09-13T18:36:39.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.430+0000 7f7951000640 1 -- start start 2024-09-13T18:36:39.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c153eb0 0x7f794c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c1f32a0 con 0x7f794c0cb490 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794c153130 con 0x7f794c0b0460 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7951000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794c1f2fc0 con 0x7f794c153eb0 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7949400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7949400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52306/0 (socket says 172.21.15.192:52306) 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.431+0000 7f7949400640 1 -- 172.21.15.192:0/680574421 learned_addr learned my addr 172.21.15.192:0/680574421 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f794a800640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c153eb0 0x7f794c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949e00640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 -- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c153eb0 msgr2=0x7f794c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c153eb0 0x7f794c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 -- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 msgr2=0x7f794c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 -- 172.21.15.192:0/680574421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f793c0094d0 con 0x7f794c0cb490 2024-09-13T18:36:39.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7949400640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f793800c520 tx=0x7f793800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79380035f0 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7938003770 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7944009a70 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.432+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7938003b20 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.433+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f794c1536b0 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.434+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794c0afd50 con 0x7f794c0cb490 2024-09-13T18:36:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.435+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7938003c80 con 0x7f794c0cb490 2024-09-13T18:36:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.435+0000 7f7942000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 0x7f792c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.435+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f79380886f0 con 0x7f794c0cb490 2024-09-13T18:36:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.436+0000 7f7949e00640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 0x7f792c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.436+0000 7f7949e00640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 0x7f792c06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f794c155280 tx=0x7f793c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.439+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7938053c10 con 0x7f794c0cb490 2024-09-13T18:36:39.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.668+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f794c150940 con 0x7f794c0cb490 2024-09-13T18:36:39.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.674+0000 7f7942000640 1 -- 172.21.15.192:0/680574421 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7938017020 con 0x7f794c0cb490 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 msgr2=0x7f792c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 0x7f792c06d0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f794c155280 tx=0x7f793c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 msgr2=0x7f794c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f793800c520 tx=0x7f793800c9e0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 shutdown_connections 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f792c06ac00 0x7f792c06d0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f794c153eb0 0x7f794c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f794c0cb490 0x7f794c0ad840 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 --2- 172.21.15.192:0/680574421 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f794c0b0460 0x7f794c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 >> 172.21.15.192:0/680574421 conn(0x7f794c0ae960 msgr2=0x7f794c15a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 shutdown_connections 2024-09-13T18:36:39.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.676+0000 7f7951000640 1 -- 172.21.15.192:0/680574421 wait complete. 2024-09-13T18:36:39.694 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.844+0000 7fe03b200640 1 Processor -- start 2024-09-13T18:36:39.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.845+0000 7fe03b200640 1 -- start start 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe03c157480 0x7fe03c0b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0b2d00 con 0x7fe03c0cd6f0 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe03c0cdc80 con 0x7fe03c06afb0 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe03c0b3380 con 0x7fe03c157480 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe03c0cd6f0 0x7fe03c0cb4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38806/0 (socket says 172.21.15.192:38806) 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe03a800640 1 -- 172.21.15.192:0/1272817652 learned_addr learned my addr 172.21.15.192:0/1272817652 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.846+0000 7fe039e00640 1 --2- 172.21.15.192:0/1272817652 >> v2:172.21.15.194:3300/0 conn(0x7fe03c157480 0x7fe03c0b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.847+0000 7fe039400640 1 -- 172.21.15.192:0/1272817652 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3362204059 0 0) 0x7fe03c0b2d00 con 0x7fe03c0cd6f0 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.847+0000 7fe039400640 1 -- 172.21.15.192:0/1272817652 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe020003520 con 0x7fe03c0cd6f0 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.847+0000 7fe039e00640 1 -- 172.21.15.192:0/1272817652 >> v1:172.21.15.194:6789/0 conn(0x7fe03c06afb0 legacy=0x7fe03c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.847+0000 7fe039e00640 1 -- 172.21.15.192:0/1272817652 >> v1:172.21.15.192:6789/0 conn(0x7fe03c0cd6f0 legacy=0x7fe03c0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.847+0000 7fe039e00640 1 -- 172.21.15.192:0/1272817652 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c0b2fa0 con 0x7fe03c157480 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.848+0000 7fe039e00640 1 --2- 172.21.15.192:0/1272817652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c0b37a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ae11d89b731ee2e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.848+0000 7fe039400640 1 -- 172.21.15.192:0/1272817652 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c032440 con 0x7fe03c157480 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.848+0000 7fe039400640 1 -- 172.21.15.192:0/1272817652 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c0325a0 con 0x7fe03c157480 2024-09-13T18:36:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.848+0000 7fe039400640 1 -- 172.21.15.192:0/1272817652 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c032930 con 0x7fe03c157480 2024-09-13T18:36:39.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 -- 172.21.15.192:0/1272817652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 msgr2=0x7fe03c0b37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 --2- 172.21.15.192:0/1272817652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c0b37a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0097a0 tx=0x7fe02c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 -- 172.21.15.192:0/1272817652 shutdown_connections 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 --2- 172.21.15.192:0/1272817652 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c0b37a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 -- 172.21.15.192:0/1272817652 >> 172.21.15.192:0/1272817652 conn(0x7fe03c0734f0 msgr2=0x7fe03c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 -- 172.21.15.192:0/1272817652 shutdown_connections 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.849+0000 7fe03b200640 1 -- 172.21.15.192:0/1272817652 wait complete. 2024-09-13T18:36:39.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.851+0000 7fe03b200640 1 Processor -- start 2024-09-13T18:36:39.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.851+0000 7fe03b200640 1 -- start start 2024-09-13T18:36:39.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe03c0cd6f0 0x7fe03c1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15c460 con 0x7fe03c06afb0 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15c740 con 0x7fe03c157480 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03c15ca20 con 0x7fe03c0cd6f0 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe039e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe039e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52322/0 (socket says 172.21.15.192:52322) 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe039e00640 1 -- 172.21.15.192:0/3272281978 learned_addr learned my addr 172.21.15.192:0/3272281978 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe031400640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe03c0cd6f0 0x7fe03c1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe03a800640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe039e00640 1 -- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe03c0cd6f0 msgr2=0x7fe03c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.852+0000 7fe039e00640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe03c0cd6f0 0x7fe03c1451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe039e00640 1 -- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 msgr2=0x7fe03c070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe039e00640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe039e00640 1 -- 172.21.15.192:0/3272281978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02c009400 con 0x7fe03c06afb0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe039e00640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe02c035040 tx=0x7fe02c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c006e10 con 0x7fe03c06afb0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe02c032e90 con 0x7fe03c06afb0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe02c030be0 con 0x7fe03c06afb0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03c0b3e60 con 0x7fe03c06afb0 2024-09-13T18:36:39.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.853+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe03c15b200 con 0x7fe03c06afb0 2024-09-13T18:36:39.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.854+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe03c0b37a0 con 0x7fe03c06afb0 2024-09-13T18:36:39.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.855+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe02c039040 con 0x7fe03c06afb0 2024-09-13T18:36:39.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.856+0000 7fe032a00640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 0x7fe01806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:39.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.856+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe02c0a9a70 con 0x7fe03c06afb0 2024-09-13T18:36:39.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.856+0000 7fe031400640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 0x7fe01806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:39.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.857+0000 7fe031400640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 0x7fe01806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe03c15bf90 tx=0x7fe024009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:39.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:39.860+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe02c0750b0 con 0x7fe03c06afb0 2024-09-13T18:36:40.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.088+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fe03c0b0a40 con 0x7fe03c06afb0 2024-09-13T18:36:40.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.094+0000 7fe032a00640 1 -- 172.21.15.192:0/3272281978 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe02c030d40 con 0x7fe03c06afb0 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.096+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 msgr2=0x7fe01806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.096+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 0x7fe01806d0c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe03c15bf90 tx=0x7fe024009040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 msgr2=0x7fe03c15b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe02c035040 tx=0x7fe02c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 shutdown_connections 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe01806ac00 0x7fe01806d0c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe03c157480 0x7fe03c070ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe03c0cd6f0 0x7fe03c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 --2- 172.21.15.192:0/3272281978 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe03c06afb0 0x7fe03c15b720 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 >> 172.21.15.192:0/3272281978 conn(0x7fe03c0734f0 msgr2=0x7fe03c0cb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 shutdown_connections 2024-09-13T18:36:40.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.097+0000 7fe03b200640 1 -- 172.21.15.192:0/3272281978 wait complete. 2024-09-13T18:36:40.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-13T18:36:40.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.263+0000 7f519e400640 1 Processor -- start 2024-09-13T18:36:40.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.264+0000 7f519e400640 1 -- start start 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5198144600 0x7f519815b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f519806c1b0 0x7f519806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f51980cd7b0 0x7f51980cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980707f0 con 0x7f5198144600 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51980ce160 con 0x7f51980cd7b0 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519806ad50 con 0x7f519806c1b0 2024-09-13T18:36:40.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5198144600 0x7f519815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5198144600 0x7f519815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52334/0 (socket says 172.21.15.192:52334) 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519d000640 1 -- 172.21.15.192:0/3416476183 learned_addr learned my addr 172.21.15.192:0/3416476183 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f5197e00640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f519806c1b0 0x7f519806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.265+0000 7f519da00640 1 --2- 172.21.15.192:0/3416476183 >> v2:172.21.15.194:3300/0 conn(0x7f51980cd7b0 0x7f51980cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 -- 172.21.15.192:0/3416476183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f519806c1b0 msgr2=0x7f519806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f519806c1b0 0x7f519806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 -- 172.21.15.192:0/3416476183 >> v2:172.21.15.194:3300/0 conn(0x7f51980cd7b0 msgr2=0x7f51980cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 --2- 172.21.15.192:0/3416476183 >> v2:172.21.15.194:3300/0 conn(0x7f51980cd7b0 0x7f51980cdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 -- 172.21.15.192:0/3416476183 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519806afd0 con 0x7f5198144600 2024-09-13T18:36:40.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.266+0000 7f519d000640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5198144600 0x7f519815b070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f51980b1c00 tx=0x7f518802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c817b276772f977d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f5197400640 1 -- 172.21.15.192:0/3416476183 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518802ae90 con 0x7f5198144600 2024-09-13T18:36:40.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f5197400640 1 -- 172.21.15.192:0/3416476183 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5188032440 con 0x7f5198144600 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f5197400640 1 -- 172.21.15.192:0/3416476183 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51880327d0 con 0x7f5198144600 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 -- 172.21.15.192:0/3416476183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5198144600 msgr2=0x7f519815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5198144600 0x7f519815b070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f51980b1c00 tx=0x7f518802a180 comp rx=0 tx=0).stop 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 -- 172.21.15.192:0/3416476183 shutdown_connections 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 --2- 172.21.15.192:0/3416476183 >> v2:172.21.15.194:3300/0 conn(0x7f51980cd7b0 0x7f51980cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f519806c1b0 0x7f519806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 --2- 172.21.15.192:0/3416476183 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5198144600 0x7f519815b070 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 -- 172.21.15.192:0/3416476183 >> 172.21.15.192:0/3416476183 conn(0x7f51980734f0 msgr2=0x7f51980b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 -- 172.21.15.192:0/3416476183 shutdown_connections 2024-09-13T18:36:40.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.267+0000 7f519e400640 1 -- 172.21.15.192:0/3416476183 wait complete. 2024-09-13T18:36:40.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.269+0000 7f519e400640 1 Processor -- start 2024-09-13T18:36:40.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.269+0000 7f519e400640 1 -- start start 2024-09-13T18:36:40.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51980cd7b0 0x7f51980cab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 0x7f51981311f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980c4670 con 0x7f519806c1b0 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51980c3ac0 con 0x7f5198144600 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51980c3cd0 con 0x7f51980cd7b0 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52338/0 (socket says 172.21.15.192:52338) 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.270+0000 7f519d000640 1 -- 172.21.15.192:0/3953395177 learned_addr learned my addr 172.21.15.192:0/3953395177 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f5197e00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51980cd7b0 0x7f51980cab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519da00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 0x7f51981311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 -- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51980cd7b0 msgr2=0x7f51980cab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51980cd7b0 0x7f51980cab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 -- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 msgr2=0x7f51981311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 0x7f51981311f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 -- 172.21.15.192:0/3953395177 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51880094d0 con 0x7f519806c1b0 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519da00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 0x7f51981311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:40.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519d000640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5188000c00 tx=0x7f51880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188030850 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51880309b0 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51980c3fb0 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5188030d60 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.271+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51980cb0c0 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.272+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51980ae810 con 0x7f519806c1b0 2024-09-13T18:36:40.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.273+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5188039040 con 0x7f519806c1b0 2024-09-13T18:36:40.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.274+0000 7f5194c00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 0x7f517806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.274+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51880a9c20 con 0x7f519806c1b0 2024-09-13T18:36:40.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.274+0000 7f5197e00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 0x7f517806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.275+0000 7f5197e00640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 0x7f517806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5198143bc0 tx=0x7f5184008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.279+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51880750b0 con 0x7f519806c1b0 2024-09-13T18:36:40.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.511+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f519806be20 con 0x7f519806c1b0 2024-09-13T18:36:40.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.517+0000 7f5194c00640 1 -- 172.21.15.192:0/3953395177 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f51880786d0 con 0x7f519806c1b0 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 msgr2=0x7f517806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 0x7f517806d0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5198143bc0 tx=0x7f5184008040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 msgr2=0x7f519815e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5188000c00 tx=0x7f51880046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 shutdown_connections 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f517806ac00 0x7f517806d0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5198144600 0x7f51981311f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51980cd7b0 0x7f51980cab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 --2- 172.21.15.192:0/3953395177 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f519806c1b0 0x7f519815e010 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 >> 172.21.15.192:0/3953395177 conn(0x7f51980734f0 msgr2=0x7f5198071070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.519+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 shutdown_connections 2024-09-13T18:36:40.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.520+0000 7f519e400640 1 -- 172.21.15.192:0/3953395177 wait complete. 2024-09-13T18:36:40.538 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:40.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.687+0000 7fe0ab400640 1 Processor -- start 2024-09-13T18:36:40.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.687+0000 7fe0ab400640 1 -- start start 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a40b3f10 0x7fe0a415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0ab400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe0a40b0490 0x7fe0a415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0ab400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a40b2f00 con 0x7fe0a415dee0 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0ab400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a415aec0 con 0x7fe0a40b0490 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0ab400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a40b3150 con 0x7fe0a40b3f10 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0a8a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe0a415dee0 0x7fe0a40afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58598/0 (socket says 172.21.15.192:58598) 2024-09-13T18:36:40.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.688+0000 7fe0a8a00640 1 -- 172.21.15.192:0/538102532 learned_addr learned my addr 172.21.15.192:0/538102532 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:40.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a9400640 1 --2- 172.21.15.192:0/538102532 >> v2:172.21.15.194:3300/0 conn(0x7fe0a40b0490 0x7fe0a415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a3e00640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a40b3f10 0x7fe0a415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a3400640 1 -- 172.21.15.192:0/538102532 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1307566904 0 0) 0x7fe0a40b2f00 con 0x7fe0a415dee0 2024-09-13T18:36:40.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a3400640 1 -- 172.21.15.192:0/538102532 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe08c003520 con 0x7fe0a415dee0 2024-09-13T18:36:40.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a9400640 1 -- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a40b3f10 msgr2=0x7fe0a415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:40.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a9400640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a40b3f10 0x7fe0a415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a9400640 1 -- 172.21.15.192:0/538102532 >> v1:172.21.15.192:6789/0 conn(0x7fe0a415dee0 legacy=0x7fe0a40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.689+0000 7fe0a9400640 1 -- 172.21.15.192:0/538102532 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40b3430 con 0x7fe0a40b0490 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.690+0000 7fe0a9400640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a40b0490 0x7fe0a415a980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009d90 tx=0x7fe09c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab3e79b4785e27e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.690+0000 7fe0a3400640 1 -- 172.21.15.192:0/538102532 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c007740 con 0x7fe0a40b0490 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.690+0000 7fe0a3400640 1 -- 172.21.15.192:0/538102532 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c02d050 con 0x7fe0a40b0490 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.690+0000 7fe0a3400640 1 -- 172.21.15.192:0/538102532 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c007aa0 con 0x7fe0a40b0490 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 -- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a40b0490 msgr2=0x7fe0a415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a40b0490 0x7fe0a415a980 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009d90 tx=0x7fe09c02a660 comp rx=0 tx=0).stop 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 -- 172.21.15.192:0/538102532 shutdown_connections 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a40b0490 0x7fe0a415a980 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 --2- 172.21.15.192:0/538102532 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a40b3f10 0x7fe0a415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 -- 172.21.15.192:0/538102532 >> 172.21.15.192:0/538102532 conn(0x7fe0a40ae960 msgr2=0x7fe0a406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 -- 172.21.15.192:0/538102532 shutdown_connections 2024-09-13T18:36:40.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.691+0000 7fe0ab400640 1 -- 172.21.15.192:0/538102532 wait complete. 2024-09-13T18:36:40.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.693+0000 7fe0ab400640 1 Processor -- start 2024-09-13T18:36:40.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.693+0000 7fe0ab400640 1 -- start start 2024-09-13T18:36:40.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a415dee0 0x7fe0a413b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a413b7e0 0x7fe0a4142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a413bce0 con 0x7fe0a40b0490 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41f1ac0 con 0x7fe0a413b7e0 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0ab400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a41f1da0 con 0x7fe0a415dee0 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36844/0 (socket says 172.21.15.192:36844) 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 -- 172.21.15.192:0/475731973 learned_addr learned my addr 172.21.15.192:0/475731973 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a3e00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a415dee0 0x7fe0a413b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 -- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a415dee0 msgr2=0x7fe0a413b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a415dee0 0x7fe0a413b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a8a00640 1 -- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a413b7e0 msgr2=0x7fe0a4142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.694+0000 7fe0a9400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a413b7e0 0x7fe0a4142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a8a00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a413b7e0 0x7fe0a4142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a8a00640 1 -- 172.21.15.192:0/475731973 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c009a70 con 0x7fe0a40b0490 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a8a00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c390 tx=0x7fe09800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe098005ce0 con 0x7fe0a40b0490 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe098005e40 con 0x7fe0a40b0490 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0980072f0 con 0x7fe0a40b0490 2024-09-13T18:36:40.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a41f2080 con 0x7fe0a40b0490 2024-09-13T18:36:40.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.695+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a413a570 con 0x7fe0a40b0490 2024-09-13T18:36:40.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.696+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a41f25a0 con 0x7fe0a40b0490 2024-09-13T18:36:40.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.697+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe098007450 con 0x7fe0a40b0490 2024-09-13T18:36:40.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.698+0000 7fe0a0c00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 0x7fe08406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:40.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.698+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe098088620 con 0x7fe0a40b0490 2024-09-13T18:36:40.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.698+0000 7fe0a3e00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 0x7fe08406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:40.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.699+0000 7fe0a3e00640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 0x7fe08406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0a41599f0 tx=0x7fe090008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.702+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe0a41f25a0 con 0x7fe0a40b0490 2024-09-13T18:36:40.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.873+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0a41f25a0 con 0x7fe0a40b0490 2024-09-13T18:36:40.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.874+0000 7fe0a0c00640 1 -- 172.21.15.192:0/475731973 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+12917 (secure 0 0 0) 0x7fe0a41f25a0 con 0x7fe0a40b0490 2024-09-13T18:36:40.877 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:40.877 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":31,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:37.555776+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:40.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 msgr2=0x7fe08406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 0x7fe08406d0c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe0a41599f0 tx=0x7fe090008040 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 msgr2=0x7fe0a4135350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe09800c390 tx=0x7fe09800c850 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 shutdown_connections 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe08406ac00 0x7fe08406d0c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe0a413b7e0 0x7fe0a4142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0a415dee0 0x7fe0a413b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 --2- 172.21.15.192:0/475731973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0a40b0490 0x7fe0a4135350 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.876+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 >> 172.21.15.192:0/475731973 conn(0x7fe0a40ae960 msgr2=0x7fe0a40b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.877+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 shutdown_connections 2024-09-13T18:36:40.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:40.877+0000 7fe0ab400640 1 -- 172.21.15.192:0/475731973 wait complete. 2024-09-13T18:36:40.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:36:40.895 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:36:41.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.047+0000 7fc52d800640 1 Processor -- start 2024-09-13T18:36:41.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.047+0000 7fc52d800640 1 -- start start 2024-09-13T18:36:41.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.048+0000 7fc52d800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc5280b3af0 0x7fc52815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.048+0000 7fc52d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc52806c0b0 0x7fc52806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.048+0000 7fc52d800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5280b2000 con 0x7fc5281589f0 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.048+0000 7fc52d800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5280b2ba0 con 0x7fc5280b3af0 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.048+0000 7fc52d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52806ca30 con 0x7fc52806c0b0 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc5280b3af0 0x7fc52815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc5280b3af0 0x7fc52815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36848/0 (socket says 172.21.15.192:36848) 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 -- 172.21.15.192:0/3134443278 learned_addr learned my addr 172.21.15.192:0/3134443278 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc527400640 1 --2- 172.21.15.192:0/3134443278 >> v2:172.21.15.194:3300/0 conn(0x7fc52806c0b0 0x7fc52806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 -- 172.21.15.192:0/3134443278 >> v2:172.21.15.194:3300/0 conn(0x7fc52806c0b0 msgr2=0x7fc52806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 --2- 172.21.15.192:0/3134443278 >> v2:172.21.15.194:3300/0 conn(0x7fc52806c0b0 0x7fc52806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 -- 172.21.15.192:0/3134443278 >> v1:172.21.15.192:6789/0 conn(0x7fc5281589f0 legacy=0x7fc5280b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.049+0000 7fc526000640 1 -- 172.21.15.192:0/3134443278 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52815bbd0 con 0x7fc5280b3af0 2024-09-13T18:36:41.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.050+0000 7fc526000640 1 --2- 172.21.15.192:0/3134443278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5280b3af0 0x7fc52815b260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc5280cb890 tx=0x7fc51402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f461d7a6b5ca3d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.050+0000 7fc525600640 1 -- 172.21.15.192:0/3134443278 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514032440 con 0x7fc5280b3af0 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.050+0000 7fc525600640 1 -- 172.21.15.192:0/3134443278 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5140325a0 con 0x7fc5280b3af0 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.050+0000 7fc525600640 1 -- 172.21.15.192:0/3134443278 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc514032930 con 0x7fc5280b3af0 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 -- 172.21.15.192:0/3134443278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5280b3af0 msgr2=0x7fc52815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 --2- 172.21.15.192:0/3134443278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5280b3af0 0x7fc52815b260 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc5280cb890 tx=0x7fc51402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 -- 172.21.15.192:0/3134443278 shutdown_connections 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 --2- 172.21.15.192:0/3134443278 >> v2:172.21.15.194:3300/0 conn(0x7fc52806c0b0 0x7fc52806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 --2- 172.21.15.192:0/3134443278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5280b3af0 0x7fc52815b260 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 -- 172.21.15.192:0/3134443278 >> 172.21.15.192:0/3134443278 conn(0x7fc5280b08f0 msgr2=0x7fc5280b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 -- 172.21.15.192:0/3134443278 shutdown_connections 2024-09-13T18:36:41.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.051+0000 7fc52d800640 1 -- 172.21.15.192:0/3134443278 wait complete. 2024-09-13T18:36:41.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.053+0000 7fc52d800640 1 Processor -- start 2024-09-13T18:36:41.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.053+0000 7fc52d800640 1 -- start start 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc52806c0b0 0x7fc528070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5280b3af0 0x7fc5280714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52806f7c0 con 0x7fc5281589f0 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc52806faa0 con 0x7fc5280b3af0 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc52d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52806fd80 con 0x7fc52806c0b0 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36854/0 (socket says 172.21.15.192:36854) 2024-09-13T18:36:41.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 -- 172.21.15.192:0/3668825793 learned_addr learned my addr 172.21.15.192:0/3668825793 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc526a00640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc52806c0b0 0x7fc528070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc526000640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5280b3af0 0x7fc5280714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 -- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc52806c0b0 msgr2=0x7fc528070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc52806c0b0 0x7fc528070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 -- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5280b3af0 msgr2=0x7fc5280714f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5280b3af0 0x7fc5280714f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.054+0000 7fc527400640 1 -- 172.21.15.192:0/3668825793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5140094d0 con 0x7fc5281589f0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc527400640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc520007e40 tx=0x7fc52000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc520014620 con 0x7fc5281589f0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52000ee90 con 0x7fc5281589f0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc528070060 con 0x7fc5281589f0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5200149e0 con 0x7fc5281589f0 2024-09-13T18:36:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.055+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc52815a7a0 con 0x7fc5281589f0 2024-09-13T18:36:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.056+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5280702a0 con 0x7fc5281589f0 2024-09-13T18:36:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.057+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc520014b40 con 0x7fc5281589f0 2024-09-13T18:36:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.058+0000 7fc51ea00640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 0x7fc50806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.058+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc520089840 con 0x7fc5281589f0 2024-09-13T18:36:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.058+0000 7fc526a00640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 0x7fc50806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.059+0000 7fc526a00640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 0x7fc50806d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc518000f60 tx=0x7fc518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.062+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc5280702a0 con 0x7fc5281589f0 2024-09-13T18:36:41.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.227+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5280702a0 con 0x7fc5281589f0 2024-09-13T18:36:41.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.228+0000 7fc51ea00640 1 -- 172.21.15.192:0/3668825793 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5280702a0 con 0x7fc5281589f0 2024-09-13T18:36:41.231 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 msgr2=0x7fc50806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 0x7fc50806d0f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc518000f60 tx=0x7fc518009040 comp rx=0 tx=0).stop 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 msgr2=0x7fc528156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc520007e40 tx=0x7fc52000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 shutdown_connections 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc50806ac30 0x7fc50806d0f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5281589f0 0x7fc528156fc0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc5280b3af0 0x7fc5280714f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 --2- 172.21.15.192:0/3668825793 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc52806c0b0 0x7fc528070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 >> 172.21.15.192:0/3668825793 conn(0x7fc5280b08f0 msgr2=0x7fc5280ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 shutdown_connections 2024-09-13T18:36:41.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.230+0000 7fc52d800640 1 -- 172.21.15.192:0/3668825793 wait complete. 2024-09-13T18:36:41.249 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:36:41.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.400+0000 7f2cbbe00640 1 Processor -- start 2024-09-13T18:36:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.400+0000 7f2cbbe00640 1 -- start start 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cbbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2cb40b3600 0x7f2cb40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cbbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2cb406ee50 0x7f2cb406f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cbbe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40b3f80 con 0x7f2cb4159360 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cbbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb406fbf0 con 0x7f2cb40b3600 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cbbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb406fed0 con 0x7f2cb406ee50 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cb8a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2cb40b3600 0x7f2cb40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cb9400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2cb4159360 0x7f2cb4070c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58612/0 (socket says 172.21.15.192:58612) 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.401+0000 7f2cb9400640 1 -- 172.21.15.192:0/3797824670 learned_addr learned my addr 172.21.15.192:0/3797824670 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb9e00640 1 --2- 172.21.15.192:0/3797824670 >> v2:172.21.15.194:3300/0 conn(0x7f2cb406ee50 0x7f2cb406f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb8a00640 1 -- 172.21.15.192:0/3797824670 >> v2:172.21.15.194:3300/0 conn(0x7f2cb406ee50 msgr2=0x7f2cb406f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb8a00640 1 --2- 172.21.15.192:0/3797824670 >> v2:172.21.15.194:3300/0 conn(0x7f2cb406ee50 0x7f2cb406f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb8a00640 1 -- 172.21.15.192:0/3797824670 >> v1:172.21.15.192:6789/0 conn(0x7f2cb4159360 legacy=0x7f2cb4070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb8a00640 1 -- 172.21.15.192:0/3797824670 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40701b0 con 0x7f2cb40b3600 2024-09-13T18:36:41.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.402+0000 7f2cb3e00640 1 -- 172.21.15.192:0/3797824670 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1242861946 0 0) 0x7f2cb40b3f80 con 0x7f2cb4159360 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.403+0000 7f2cb8a00640 1 --2- 172.21.15.192:0/3797824670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb40b3600 0x7f2cb40b3a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406ba80 tx=0x7f2ca002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d28d4e702bff64d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.403+0000 7f2cb3e00640 1 -- 172.21.15.192:0/3797824670 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca002ae60 con 0x7f2cb40b3600 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.403+0000 7f2cb3e00640 1 -- 172.21.15.192:0/3797824670 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca0032440 con 0x7f2cb40b3600 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.403+0000 7f2cb3e00640 1 -- 172.21.15.192:0/3797824670 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00327d0 con 0x7f2cb40b3600 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 -- 172.21.15.192:0/3797824670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb40b3600 msgr2=0x7f2cb40b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/3797824670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb40b3600 0x7f2cb40b3a40 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2cb406ba80 tx=0x7f2ca002a110 comp rx=0 tx=0).stop 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 -- 172.21.15.192:0/3797824670 shutdown_connections 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/3797824670 >> v2:172.21.15.194:3300/0 conn(0x7f2cb406ee50 0x7f2cb406f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/3797824670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb40b3600 0x7f2cb40b3a40 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 -- 172.21.15.192:0/3797824670 >> 172.21.15.192:0/3797824670 conn(0x7f2cb4073730 msgr2=0x7f2cb40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 -- 172.21.15.192:0/3797824670 shutdown_connections 2024-09-13T18:36:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.404+0000 7f2cbbe00640 1 -- 172.21.15.192:0/3797824670 wait complete. 2024-09-13T18:36:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.405+0000 7f2cbbe00640 1 Processor -- start 2024-09-13T18:36:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 -- start start 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3600 0x7f2cb4147240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 0x7f2cb4147780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4145b00 con 0x7f2cb406ee50 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4144ef0 con 0x7f2cb4159360 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.406+0000 7f2cbbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb41451d0 con 0x7f2cb40b3600 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36876/0 (socket says 172.21.15.192:36876) 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 -- 172.21.15.192:0/2370687094 learned_addr learned my addr 172.21.15.192:0/2370687094 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb8a00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3600 0x7f2cb4147240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9e00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 0x7f2cb4147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 -- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3600 msgr2=0x7f2cb4147240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3600 0x7f2cb4147240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 -- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 msgr2=0x7f2cb4147780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 0x7f2cb4147780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 -- 172.21.15.192:0/2370687094 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009400 con 0x7f2cb406ee50 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9e00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 0x7f2cb4147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:41.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.407+0000 7f2cb9400640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c430 tx=0x7f2ca800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.408+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca80074e0 con 0x7f2cb406ee50 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.408+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca8007660 con 0x7f2cb406ee50 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.408+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004a20 con 0x7f2cb406ee50 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.408+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb41454b0 con 0x7f2cb406ee50 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.408+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4144bd0 con 0x7f2cb406ee50 2024-09-13T18:36:41.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.409+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb406f2e0 con 0x7f2cb406ee50 2024-09-13T18:36:41.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.410+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ca8004b80 con 0x7f2cb406ee50 2024-09-13T18:36:41.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.411+0000 7f2cb1600640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 0x7f2c9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.411+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ca8088e10 con 0x7f2cb406ee50 2024-09-13T18:36:41.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.411+0000 7f2cb8a00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 0x7f2c9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.411+0000 7f2cb8a00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 0x7f2c9406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0034000 tx=0x7f2ca002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.415+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2ca808c030 con 0x7f2cb406ee50 2024-09-13T18:36:41.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.586+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f2cb40aeb20 con 0x7f2cb406ee50 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.587+0000 7f2cb1600640 1 -- 172.21.15.192:0/2370687094 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+65 (secure 0 0 0) 0x7f2ca80542a0 con 0x7f2cb406ee50 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:41.590 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:36:41.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 msgr2=0x7f2c9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 0x7f2c9406d0c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0034000 tx=0x7f2ca002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:41.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 msgr2=0x7f2cb40abaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800c430 tx=0x7f2ca800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 shutdown_connections 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac00 0x7f2c9406d0c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb4159360 0x7f2cb4147780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3600 0x7f2cb4147240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 --2- 172.21.15.192:0/2370687094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406ee50 0x7f2cb40abaa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 >> 172.21.15.192:0/2370687094 conn(0x7f2cb4073730 msgr2=0x7f2cb414aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 shutdown_connections 2024-09-13T18:36:41.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.589+0000 7f2cbbe00640 1 -- 172.21.15.192:0/2370687094 wait complete. 2024-09-13T18:36:41.607 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:36:41.608 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:36:41.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.763+0000 7f92a9000640 1 Processor -- start 2024-09-13T18:36:41.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.763+0000 7f92a9000640 1 -- start start 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92a40cbfe0 0x7f92a40ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a406a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a9000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92a413cfa0 con 0x7f92a415d7f0 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a9000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92a406aa30 con 0x7f92a40cbfe0 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a40cc3c0 con 0x7f92a406a0b0 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92a40cbfe0 0x7f92a40ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.764+0000 7f92a3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92a40cbfe0 0x7f92a40ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36886/0 (socket says 172.21.15.192:36886) 2024-09-13T18:36:41.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a3400640 1 -- 172.21.15.192:0/2209087860 learned_addr learned my addr 172.21.15.192:0/2209087860 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:41.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a2a00640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a406a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a3400640 1 -- 172.21.15.192:0/2209087860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 msgr2=0x7f92a406a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:41.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a3400640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a406a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a3400640 1 -- 172.21.15.192:0/2209087860 >> v1:172.21.15.194:6789/0 conn(0x7f92a415d7f0 legacy=0x7f92a415dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.765+0000 7f92a3400640 1 -- 172.21.15.192:0/2209087860 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40ce720 con 0x7f92a40cbfe0 2024-09-13T18:36:41.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.766+0000 7f92a3400640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a40cbfe0 0x7f92a40ce1e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9294009870 tx=0x7f929402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d954bf7edc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.766+0000 7f92a2000640 1 -- 172.21.15.192:0/2209087860 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294032440 con 0x7f92a40cbfe0 2024-09-13T18:36:41.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.766+0000 7f92a2000640 1 -- 172.21.15.192:0/2209087860 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92940325a0 con 0x7f92a40cbfe0 2024-09-13T18:36:41.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.766+0000 7f92a2000640 1 -- 172.21.15.192:0/2209087860 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9294032930 con 0x7f92a40cbfe0 2024-09-13T18:36:41.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 -- 172.21.15.192:0/2209087860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a40cbfe0 msgr2=0x7f92a40ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a40cbfe0 0x7f92a40ce1e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9294009870 tx=0x7f929402a250 comp rx=0 tx=0).stop 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 -- 172.21.15.192:0/2209087860 shutdown_connections 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a406a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 --2- 172.21.15.192:0/2209087860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a40cbfe0 0x7f92a40ce1e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 -- 172.21.15.192:0/2209087860 >> 172.21.15.192:0/2209087860 conn(0x7f92a4073490 msgr2=0x7f92a40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 -- 172.21.15.192:0/2209087860 shutdown_connections 2024-09-13T18:36:41.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.767+0000 7f92a9000640 1 -- 172.21.15.192:0/2209087860 wait complete. 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.768+0000 7f92a9000640 1 Processor -- start 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 -- start start 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a4137230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40cbfe0 0x7f92a4136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4137770 con 0x7f92a415d7f0 2024-09-13T18:36:41.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92a4132ed0 con 0x7f92a40cbfe0 2024-09-13T18:36:41.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.769+0000 7f92a9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a41355a0 con 0x7f92a406a0b0 2024-09-13T18:36:41.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36894/0 (socket says 172.21.15.192:36894) 2024-09-13T18:36:41.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 -- 172.21.15.192:0/4081889483 learned_addr learned my addr 172.21.15.192:0/4081889483 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a4137230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a2a00640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40cbfe0 0x7f92a4136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 -- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 msgr2=0x7f92a4137230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a4137230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 -- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40cbfe0 msgr2=0x7f92a4136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40cbfe0 0x7f92a4136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 -- 172.21.15.192:0/4081889483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940094d0 con 0x7f92a415d7f0 2024-09-13T18:36:41.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.770+0000 7f92a3e00640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c6b0 tx=0x7f929c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.771+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c003b70 con 0x7f92a415d7f0 2024-09-13T18:36:41.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.771+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f929c003cf0 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.771+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f929c003ea0 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.771+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92a4135880 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.771+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a4135e40 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.772+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a4067b10 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.773+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f929c005310 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.774+0000 7f929b400640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 0x7f928406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.774+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f929c088d10 con 0x7f92a415d7f0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.774+0000 7f92a3400640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 0x7f928406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:41.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.774+0000 7f92a3400640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 0x7f928406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9294034000 tx=0x7f929402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:41.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.778+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f929c08e020 con 0x7f92a415d7f0 2024-09-13T18:36:41.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:41.945+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f92a4140140 con 0x7f92a415d7f0 2024-09-13T18:36:42.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.523+0000 7f929b400640 1 -- 172.21.15.192:0/4081889483 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f929c054250 con 0x7f92a415d7f0 2024-09-13T18:36:42.526 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 msgr2=0x7f928406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 0x7f928406d0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9294034000 tx=0x7f929402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:42.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 msgr2=0x7f92a40adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f929c00c6b0 tx=0x7f929c00cb70 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 shutdown_connections 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f928406ac00 0x7f928406d0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92a415d7f0 0x7f92a40adab0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92a40cbfe0 0x7f92a4136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 --2- 172.21.15.192:0/4081889483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f92a406a0b0 0x7f92a4137230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.527+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 >> 172.21.15.192:0/4081889483 conn(0x7f92a4073490 msgr2=0x7f92a413ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.528+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 shutdown_connections 2024-09-13T18:36:42.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.528+0000 7f92a9000640 1 -- 172.21.15.192:0/4081889483 wait complete. 2024-09-13T18:36:42.548 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:36:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.704+0000 7f94eae00640 1 Processor -- start 2024-09-13T18:36:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.704+0000 7f94eae00640 1 -- start start 2024-09-13T18:36:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94eae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f94e40b3af0 0x7f94e415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94eae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40b2000 con 0x7f94e406c0b0 2024-09-13T18:36:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94eae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e40b2ba0 con 0x7f94e41589f0 2024-09-13T18:36:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94eae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e415bbd0 con 0x7f94e40b3af0 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94e8e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f94e406c0b0 0x7f94e40cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58626/0 (socket says 172.21.15.192:58626) 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94e8e00640 1 -- 172.21.15.192:0/3241025919 learned_addr learned my addr 172.21.15.192:0/3241025919 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.705+0000 7f94dbe00640 1 --2- 172.21.15.192:0/3241025919 >> v2:172.21.15.194:3300/0 conn(0x7f94e40b3af0 0x7f94e415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.706+0000 7f94e3400640 1 -- 172.21.15.192:0/3241025919 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1486220656 0 0) 0x7f94e40b2000 con 0x7f94e406c0b0 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.706+0000 7f94e3400640 1 -- 172.21.15.192:0/3241025919 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c8003520 con 0x7f94e406c0b0 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.706+0000 7f94dbe00640 1 -- 172.21.15.192:0/3241025919 >> v1:172.21.15.194:6789/0 conn(0x7f94e41589f0 legacy=0x7f94e40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.706+0000 7f94dbe00640 1 -- 172.21.15.192:0/3241025919 >> v1:172.21.15.192:6789/0 conn(0x7f94e406c0b0 legacy=0x7f94e40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.706+0000 7f94dbe00640 1 -- 172.21.15.192:0/3241025919 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e415beb0 con 0x7f94e40b3af0 2024-09-13T18:36:42.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.707+0000 7f94dbe00640 1 --2- 172.21.15.192:0/3241025919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e40b3af0 0x7f94e415b260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0097a0 tx=0x7f94cc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29ff024aa1e37769 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.707+0000 7f94e3400640 1 -- 172.21.15.192:0/3241025919 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc032440 con 0x7f94e40b3af0 2024-09-13T18:36:42.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.707+0000 7f94e3400640 1 -- 172.21.15.192:0/3241025919 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94cc0325a0 con 0x7f94e40b3af0 2024-09-13T18:36:42.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.707+0000 7f94e3400640 1 -- 172.21.15.192:0/3241025919 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94cc032910 con 0x7f94e40b3af0 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 -- 172.21.15.192:0/3241025919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e40b3af0 msgr2=0x7f94e415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 --2- 172.21.15.192:0/3241025919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e40b3af0 0x7f94e415b260 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f94cc0097a0 tx=0x7f94cc02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 -- 172.21.15.192:0/3241025919 shutdown_connections 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 --2- 172.21.15.192:0/3241025919 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e40b3af0 0x7f94e415b260 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 -- 172.21.15.192:0/3241025919 >> 172.21.15.192:0/3241025919 conn(0x7f94e40b08f0 msgr2=0x7f94e40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 -- 172.21.15.192:0/3241025919 shutdown_connections 2024-09-13T18:36:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.708+0000 7f94eae00640 1 -- 172.21.15.192:0/3241025919 wait complete. 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.710+0000 7f94eae00640 1 Processor -- start 2024-09-13T18:36:42.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.710+0000 7f94eae00640 1 -- start start 2024-09-13T18:36:42.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94e40b3af0 0x7f94e4155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 0x7f94e4153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4157b20 con 0x7f94e406c0b0 2024-09-13T18:36:42.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4150550 con 0x7f94e41589f0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94eae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e4157d50 con 0x7f94e40b3af0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36896/0 (socket says 172.21.15.192:36896) 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 -- 172.21.15.192:0/456115737 learned_addr learned my addr 172.21.15.192:0/456115737 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94dbe00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94e40b3af0 0x7f94e4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e8e00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 0x7f94e4153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 -- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94e40b3af0 msgr2=0x7f94e4155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94e40b3af0 0x7f94e4155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 -- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 msgr2=0x7f94e4153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 0x7f94e4153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e3e00640 1 -- 172.21.15.192:0/456115737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc009400 con 0x7f94e406c0b0 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.711+0000 7f94e8e00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 0x7f94e4153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:42.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94e3e00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c3c0 tx=0x7f94d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d40052d0 con 0x7f94e406c0b0 2024-09-13T18:36:42.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d4005450 con 0x7f94e406c0b0 2024-09-13T18:36:42.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d4007260 con 0x7f94e406c0b0 2024-09-13T18:36:42.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e4158030 con 0x7f94e406c0b0 2024-09-13T18:36:42.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.712+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e414eb30 con 0x7f94e406c0b0 2024-09-13T18:36:42.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.713+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e4158220 con 0x7f94e406c0b0 2024-09-13T18:36:42.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.714+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94d40073c0 con 0x7f94e406c0b0 2024-09-13T18:36:42.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.715+0000 7f94e0c00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 0x7f94c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:42.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.715+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f94d40889f0 con 0x7f94e406c0b0 2024-09-13T18:36:42.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.715+0000 7f94dbe00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 0x7f94c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:42.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.716+0000 7f94dbe00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 0x7f94c006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:42.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.719+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94d4053e40 con 0x7f94e406c0b0 2024-09-13T18:36:42.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:42.888+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f94e415b260 con 0x7f94e406c0b0 2024-09-13T18:36:43.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.528+0000 7f94e0c00640 1 -- 172.21.15.192:0/456115737 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7f94d40200d0 con 0x7f94e406c0b0 2024-09-13T18:36:43.531 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:36:43.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 msgr2=0x7f94c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 0x7f94c006d0c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f94cc034000 tx=0x7f94cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:43.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 msgr2=0x7f94e414de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c3c0 tx=0x7f94d400c880 comp rx=0 tx=0).stop 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 shutdown_connections 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94c006ac00 0x7f94c006d0c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94e41589f0 0x7f94e4153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94e40b3af0 0x7f94e4155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 --2- 172.21.15.192:0/456115737 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94e406c0b0 0x7f94e414de20 secure :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f94d400c3c0 tx=0x7f94d400c880 comp rx=0 tx=0).stop 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.535+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 >> 172.21.15.192:0/456115737 conn(0x7f94e40b08f0 msgr2=0x7f94e415db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:43.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.537+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 shutdown_connections 2024-09-13T18:36:43.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.538+0000 7f94eae00640 1 -- 172.21.15.192:0/456115737 wait complete. 2024-09-13T18:36:43.560 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:36:43.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.717+0000 7f3dccc00640 1 Processor -- start 2024-09-13T18:36:43.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.717+0000 7f3dccc00640 1 -- start start 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 0x7f3dc80712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dccc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3dc80d0710 0x7f3dc80717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dccc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc80d0280 con 0x7f3dc81608d0 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dccc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc8161830 con 0x7f3dc80d0710 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dccc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc80cf9b0 con 0x7f3dc81465a0 2024-09-13T18:36:43.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dc7e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3dc81608d0 0x7f3dc8160d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58642/0 (socket says 172.21.15.192:58642) 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.718+0000 7f3dc7e00640 1 -- 172.21.15.192:0/3496840795 learned_addr learned my addr 172.21.15.192:0/3496840795 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dc7400640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 0x7f3dc80712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/3496840795 >> v2:172.21.15.194:3300/0 conn(0x7f3dc80d0710 0x7f3dc80717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dc6a00640 1 -- 172.21.15.192:0/3496840795 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290707314 0 0) 0x7f3dc80d0280 con 0x7f3dc81608d0 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dc6a00640 1 -- 172.21.15.192:0/3496840795 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3dac003520 con 0x7f3dc81608d0 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dbfe00640 1 -- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 msgr2=0x7f3dc80712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 0x7f3dc80712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dbfe00640 1 -- 172.21.15.192:0/3496840795 >> v1:172.21.15.192:6789/0 conn(0x7f3dc81608d0 legacy=0x7f3dc8160d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dbfe00640 1 -- 172.21.15.192:0/3496840795 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8161550 con 0x7f3dc80d0710 2024-09-13T18:36:43.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.719+0000 7f3dc7400640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 0x7f3dc80712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:43.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.720+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc80d0710 0x7f3dc80717f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=157fe1f3a7974297 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:43.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.720+0000 7f3dc6a00640 1 -- 172.21.15.192:0/3496840795 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0032440 con 0x7f3dc80d0710 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.720+0000 7f3dc6a00640 1 -- 172.21.15.192:0/3496840795 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db00325a0 con 0x7f3dc80d0710 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.720+0000 7f3dc6a00640 1 -- 172.21.15.192:0/3496840795 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db0032930 con 0x7f3dc80d0710 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 -- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc80d0710 msgr2=0x7f3dc80717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc80d0710 0x7f3dc80717f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3db00097a0 tx=0x7f3db002a180 comp rx=0 tx=0).stop 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 -- 172.21.15.192:0/3496840795 shutdown_connections 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc80d0710 0x7f3dc80717f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 --2- 172.21.15.192:0/3496840795 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81465a0 0x7f3dc80712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 -- 172.21.15.192:0/3496840795 >> 172.21.15.192:0/3496840795 conn(0x7f3dc80b30b0 msgr2=0x7f3dc8070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:43.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 -- 172.21.15.192:0/3496840795 shutdown_connections 2024-09-13T18:36:43.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.721+0000 7f3dccc00640 1 -- 172.21.15.192:0/3496840795 wait complete. 2024-09-13T18:36:43.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.723+0000 7f3dccc00640 1 Processor -- start 2024-09-13T18:36:43.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.723+0000 7f3dccc00640 1 -- start start 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc81465a0 0x7f3dc81f35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81608d0 0x7f3dc81434a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8158b30 con 0x7f3dc80d0710 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc8140500 con 0x7f3dc81465a0 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dccc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc81407e0 con 0x7f3dc81608d0 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36904/0 (socket says 172.21.15.192:36904) 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 -- 172.21.15.192:0/2751944208 learned_addr learned my addr 172.21.15.192:0/2751944208 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7e00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81608d0 0x7f3dc81434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc81465a0 0x7f3dc81f35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 -- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81608d0 msgr2=0x7f3dc81434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81608d0 0x7f3dc81434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 -- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc81465a0 msgr2=0x7f3dc81f35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc81465a0 0x7f3dc81f35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.724+0000 7f3dc7400640 1 -- 172.21.15.192:0/2751944208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db8009400 con 0x7f3dc80d0710 2024-09-13T18:36:43.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dc7400640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3db800ebe0 tx=0x7f3db800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db8009760 con 0x7f3dc80d0710 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db800cc30 con 0x7f3dc80d0710 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db800eee0 con 0x7f3dc80d0710 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db0009400 con 0x7f3dc80d0710 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.725+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc81f3b30 con 0x7f3dc80d0710 2024-09-13T18:36:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.726+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc8140360 con 0x7f3dc80d0710 2024-09-13T18:36:43.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.727+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3db8013470 con 0x7f3dc80d0710 2024-09-13T18:36:43.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.728+0000 7f3dbf400640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:43.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.728+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3db8089600 con 0x7f3dc80d0710 2024-09-13T18:36:43.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.728+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:43.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.729+0000 7f3dbfe00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 0x7f3da406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3db0034000 tx=0x7f3db002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:43.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.733+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3dc8140360 con 0x7f3dc80d0710 2024-09-13T18:36:43.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.936+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3dc8140360 con 0x7f3dc80d0710 2024-09-13T18:36:43.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.942+0000 7f3dbf400640 1 -- 172.21.15.192:0/2751944208 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f3dc8140360 con 0x7f3dc80d0710 2024-09-13T18:36:43.946 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 4 and data pool 5 2024-09-13T18:36:43.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.950+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 msgr2=0x7f3da406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.951+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 0x7f3da406d0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3db0034000 tx=0x7f3db002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:43.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.951+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 msgr2=0x7f3dc813e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:43.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.951+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f3db800ebe0 tx=0x7f3db800c520 comp rx=0 tx=0).stop 2024-09-13T18:36:43.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 shutdown_connections 2024-09-13T18:36:43.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3da406ac00 0x7f3da406d0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3dc81608d0 0x7f3dc81434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3dc81465a0 0x7f3dc81f35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 --2- 172.21.15.192:0/2751944208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3dc80d0710 0x7f3dc813e590 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:43.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.954+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 >> 172.21.15.192:0/2751944208 conn(0x7f3dc80b30b0 msgr2=0x7f3dc81570d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:43.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.956+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 shutdown_connections 2024-09-13T18:36:43.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:43.957+0000 7f3dccc00640 1 -- 172.21.15.192:0/2751944208 wait complete. 2024-09-13T18:36:43.979 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:44.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.129+0000 7fddfcc00640 1 Processor -- start 2024-09-13T18:36:44.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.130+0000 7fddfcc00640 1 -- start start 2024-09-13T18:36:44.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 0x7fddf806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf806b3d0 0x7fddf80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddf806e990 0x7fddf80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf80b3730 con 0x7fddf806e990 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddf806c5d0 con 0x7fddf815a9e0 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddfcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf80b3920 con 0x7fddf806b3d0 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddf7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddf806e990 0x7fddf80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddf7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fddf806e990 0x7fddf80cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36914/0 (socket says 172.21.15.192:36914) 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddf7e00640 1 -- 172.21.15.192:0/1455937190 learned_addr learned my addr 172.21.15.192:0/1455937190 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddf7400640 1 --2- 172.21.15.192:0/1455937190 >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 0x7fddf806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.131+0000 7fddf6a00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf806b3d0 0x7fddf80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7e00640 1 -- 172.21.15.192:0/1455937190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf806b3d0 msgr2=0x7fddf80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7e00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf806b3d0 0x7fddf80cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7e00640 1 -- 172.21.15.192:0/1455937190 >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 msgr2=0x7fddf806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7e00640 1 --2- 172.21.15.192:0/1455937190 >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 0x7fddf806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7e00640 1 -- 172.21.15.192:0/1455937190 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf80b3c00 con 0x7fddf806e990 2024-09-13T18:36:44.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.132+0000 7fddf7400640 1 --2- 172.21.15.192:0/1455937190 >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 0x7fddf806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddf7e00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806e990 0x7fddf80cde00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fddf806cc90 tx=0x7fddf002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6e7dfd966c35f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddf6000640 1 -- 172.21.15.192:0/1455937190 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0031600 con 0x7fddf806e990 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddf6000640 1 -- 172.21.15.192:0/1455937190 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddf002d050 con 0x7fddf806e990 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddf6000640 1 -- 172.21.15.192:0/1455937190 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddf0031980 con 0x7fddf806e990 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddfcc00640 1 -- 172.21.15.192:0/1455937190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806e990 msgr2=0x7fddf80cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.133+0000 7fddfcc00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806e990 0x7fddf80cde00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fddf806cc90 tx=0x7fddf002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 -- 172.21.15.192:0/1455937190 shutdown_connections 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806e990 0x7fddf80cde00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 --2- 172.21.15.192:0/1455937190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf806b3d0 0x7fddf80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 --2- 172.21.15.192:0/1455937190 >> v2:172.21.15.194:3300/0 conn(0x7fddf815a9e0 0x7fddf806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 -- 172.21.15.192:0/1455937190 >> 172.21.15.192:0/1455937190 conn(0x7fddf80736d0 msgr2=0x7fddf80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:44.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 -- 172.21.15.192:0/1455937190 shutdown_connections 2024-09-13T18:36:44.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.134+0000 7fddfcc00640 1 -- 172.21.15.192:0/1455937190 wait complete. 2024-09-13T18:36:44.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.135+0000 7fddfcc00640 1 Processor -- start 2024-09-13T18:36:44.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.135+0000 7fddfcc00640 1 -- start start 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 0x7fddf814b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 0x7fddf814b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81e4480 con 0x7fddf806b3d0 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81e4760 con 0x7fddf806e990 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddfcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81e4a40 con 0x7fddf815a9e0 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.136+0000 7fddf7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36926/0 (socket says 172.21.15.192:36926) 2024-09-13T18:36:44.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 -- 172.21.15.192:0/3653936804 learned_addr learned my addr 172.21.15.192:0/3653936804 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7e00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 0x7fddf814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf6a00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 0x7fddf814b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 -- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 msgr2=0x7fddf814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 0x7fddf814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 -- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 msgr2=0x7fddf814b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 0x7fddf814b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 -- 172.21.15.192:0/3653936804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddf0009b30 con 0x7fddf806b3d0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf6a00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 0x7fddf814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7e00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 0x7fddf814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddf7400640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdde800d7d0 tx=0x7fdde800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004030 con 0x7fddf806b3d0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.137+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde8004190 con 0x7fddf806b3d0 2024-09-13T18:36:44.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.138+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf81e4d20 con 0x7fddf806b3d0 2024-09-13T18:36:44.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.138+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde8004520 con 0x7fddf806b3d0 2024-09-13T18:36:44.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.138+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf814be10 con 0x7fddf806b3d0 2024-09-13T18:36:44.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.139+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf80ce6c0 con 0x7fddf806b3d0 2024-09-13T18:36:44.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.140+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdde80096a0 con 0x7fddf806b3d0 2024-09-13T18:36:44.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.140+0000 7fddef400640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 0x7fddd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.141+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdde8089550 con 0x7fddf806b3d0 2024-09-13T18:36:44.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.141+0000 7fddf6a00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 0x7fddd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.141+0000 7fddf6a00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 0x7fddd806d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fddf80b36d0 tx=0x7fdde4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.145+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdde8054730 con 0x7fddf806b3d0 2024-09-13T18:36:44.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.316+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddf80b31d0 con 0x7fddf806b3d0 2024-09-13T18:36:44.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.317+0000 7fddef400640 1 -- 172.21.15.192:0/3653936804 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fdde8057d50 con 0x7fddf806b3d0 2024-09-13T18:36:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:44.320 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":34,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:43.937662+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 msgr2=0x7fddd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 0x7fddd806d0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fddf80b36d0 tx=0x7fdde4008040 comp rx=0 tx=0).stop 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 msgr2=0x7fddf80cc3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fdde800d7d0 tx=0x7fdde800dc90 comp rx=0 tx=0).stop 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 shutdown_connections 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddd806ac00 0x7fddd806d0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fddf815a9e0 0x7fddf814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fddf806e990 0x7fddf814b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 --2- 172.21.15.192:0/3653936804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fddf806b3d0 0x7fddf80cc3d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 >> 172.21.15.192:0/3653936804 conn(0x7fddf80736d0 msgr2=0x7fddf80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 shutdown_connections 2024-09-13T18:36:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.319+0000 7fddfcc00640 1 -- 172.21.15.192:0/3653936804 wait complete. 2024-09-13T18:36:44.339 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:44.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.488+0000 7f473b200640 1 Processor -- start 2024-09-13T18:36:44.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.488+0000 7f473b200640 1 -- start start 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.489+0000 7f473b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f47340b3f10 0x7f473415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.489+0000 7f473b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f47340b0490 0x7f473415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.489+0000 7f473b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340b2f00 con 0x7f473415dee0 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.489+0000 7f473b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473415aec0 con 0x7f47340b0490 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.489+0000 7f473b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47340b3150 con 0x7f47340b3f10 2024-09-13T18:36:44.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4733e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f473415dee0 0x7f47340afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58652/0 (socket says 172.21.15.192:58652) 2024-09-13T18:36:44.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4733e00640 1 -- 172.21.15.192:0/1633826523 learned_addr learned my addr 172.21.15.192:0/1633826523 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:44.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4739200640 1 --2- 172.21.15.192:0/1633826523 >> v2:172.21.15.192:3300/0 conn(0x7f47340b0490 0x7f473415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4733400640 1 --2- 172.21.15.192:0/1633826523 >> v2:172.21.15.194:3300/0 conn(0x7f47340b3f10 0x7f473415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4732a00640 1 -- 172.21.15.192:0/1633826523 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692048642 0 0) 0x7f47340b2f00 con 0x7f473415dee0 2024-09-13T18:36:44.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4739200640 1 -- 172.21.15.192:0/1633826523 >> v2:172.21.15.194:3300/0 conn(0x7f47340b3f10 msgr2=0x7f473415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:44.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4739200640 1 --2- 172.21.15.192:0/1633826523 >> v2:172.21.15.194:3300/0 conn(0x7f47340b3f10 0x7f473415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4739200640 1 -- 172.21.15.192:0/1633826523 >> v1:172.21.15.192:6789/0 conn(0x7f473415dee0 legacy=0x7f47340afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.490+0000 7f4739200640 1 -- 172.21.15.192:0/1633826523 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340b3430 con 0x7f47340b0490 2024-09-13T18:36:44.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.491+0000 7f4739200640 1 --2- 172.21.15.192:0/1633826523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47340b0490 0x7f473415a980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47340b4700 tx=0x7f472c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d910f00c6a118a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.491+0000 7f4732a00640 1 -- 172.21.15.192:0/1633826523 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c02aea0 con 0x7f47340b0490 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.491+0000 7f4732a00640 1 -- 172.21.15.192:0/1633826523 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c02d050 con 0x7f47340b0490 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.491+0000 7f4732a00640 1 -- 172.21.15.192:0/1633826523 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c007960 con 0x7f47340b0490 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 -- 172.21.15.192:0/1633826523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47340b0490 msgr2=0x7f473415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 --2- 172.21.15.192:0/1633826523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47340b0490 0x7f473415a980 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f47340b4700 tx=0x7f472c02a680 comp rx=0 tx=0).stop 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 -- 172.21.15.192:0/1633826523 shutdown_connections 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 --2- 172.21.15.192:0/1633826523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f47340b0490 0x7f473415a980 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 --2- 172.21.15.192:0/1633826523 >> v2:172.21.15.194:3300/0 conn(0x7f47340b3f10 0x7f473415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 -- 172.21.15.192:0/1633826523 >> 172.21.15.192:0/1633826523 conn(0x7f47340ae960 msgr2=0x7f473406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:44.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 -- 172.21.15.192:0/1633826523 shutdown_connections 2024-09-13T18:36:44.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.492+0000 7f473b200640 1 -- 172.21.15.192:0/1633826523 wait complete. 2024-09-13T18:36:44.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.494+0000 7f473b200640 1 Processor -- start 2024-09-13T18:36:44.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.494+0000 7f473b200640 1 -- start start 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47340b0490 0x7f4734159290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47341553c0 0x7f473413fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341f2920 con 0x7f473415dee0 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47341f2c00 con 0x7f47340b0490 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f473b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47341f2ee0 con 0x7f47341553c0 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36948/0 (socket says 172.21.15.192:36948) 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 -- 172.21.15.192:0/70799560 learned_addr learned my addr 172.21.15.192:0/70799560 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733e00640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47340b0490 0x7f4734159290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4739200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47341553c0 0x7f473413fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 -- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47341553c0 msgr2=0x7f473413fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47341553c0 0x7f473413fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 -- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47340b0490 msgr2=0x7f4734159290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47340b0490 0x7f4734159290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.495+0000 7f4733400640 1 -- 172.21.15.192:0/70799560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009a70 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f4733400640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f472000d800 tx=0x7f472000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000b6c0 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472000b820 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472000bbb0 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47341f31c0 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.496+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473413e080 con 0x7f473415dee0 2024-09-13T18:36:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.497+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47340afd80 con 0x7f473415dee0 2024-09-13T18:36:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.498+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f472000bd10 con 0x7f473415dee0 2024-09-13T18:36:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.499+0000 7f472be00640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 0x7f471406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.499+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47200897b0 con 0x7f473415dee0 2024-09-13T18:36:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.499+0000 7f4733e00640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 0x7f471406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.500+0000 7f4733e00640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 0x7f471406d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4724007fd0 tx=0x7f4724007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.503+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4720054a20 con 0x7f473415dee0 2024-09-13T18:36:44.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.675+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47340b2930 con 0x7f473415dee0 2024-09-13T18:36:44.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.676+0000 7f472be00640 1 -- 172.21.15.192:0/70799560 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f4720058040 con 0x7f473415dee0 2024-09-13T18:36:44.679 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:44.679 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":34,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:43.937662+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:44.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 msgr2=0x7f471406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 0x7f471406d0c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4724007fd0 tx=0x7f4724007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 msgr2=0x7f473413f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f472000d800 tx=0x7f472000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 shutdown_connections 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f471406ac00 0x7f471406d0c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47341553c0 0x7f473413fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f473415dee0 0x7f473413f670 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 --2- 172.21.15.192:0/70799560 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f47340b0490 0x7f4734159290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 >> 172.21.15.192:0/70799560 conn(0x7f47340ae960 msgr2=0x7f47341381b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 shutdown_connections 2024-09-13T18:36:44.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.678+0000 7f473b200640 1 -- 172.21.15.192:0/70799560 wait complete. 2024-09-13T18:36:44.697 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:36:44.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.849+0000 7f3f5aa00640 1 Processor -- start 2024-09-13T18:36:44.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.850+0000 7f3f5aa00640 1 -- start start 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f541402c0 0x7f3f5415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 0x7f3f5415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3f540afbe0 0x7f3f540b0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f540b05d0 con 0x7f3f540afbe0 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5415b070 con 0x7f3f5415b810 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5415eba0 con 0x7f3f541402c0 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3f540afbe0 0x7f3f540b0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3f540afbe0 0x7f3f540b0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36958/0 (socket says 172.21.15.192:36958) 2024-09-13T18:36:44.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f5a000640 1 -- 172.21.15.192:0/4125138454 learned_addr learned my addr 172.21.15.192:0/4125138454 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:44.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4125138454 >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 0x7f3f5415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.851+0000 7f3f59600640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f541402c0 0x7f3f5415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f5a000640 1 -- 172.21.15.192:0/4125138454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f541402c0 msgr2=0x7f3f5415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f5a000640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f541402c0 0x7f3f5415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f5a000640 1 -- 172.21.15.192:0/4125138454 >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 msgr2=0x7f3f5415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f5a000640 1 --2- 172.21.15.192:0/4125138454 >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 0x7f3f5415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f5a000640 1 -- 172.21.15.192:0/4125138454 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5415ee20 con 0x7f3f540afbe0 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.852+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4125138454 >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 0x7f3f5415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f5a000640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540b0090 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f5406c610 tx=0x7f3f4c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b2e0702e8e5f3fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f53e00640 1 -- 172.21.15.192:0/4125138454 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031600 con 0x7f3f540afbe0 2024-09-13T18:36:44.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f53e00640 1 -- 172.21.15.192:0/4125138454 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c02d050 con 0x7f3f540afbe0 2024-09-13T18:36:44.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f53e00640 1 -- 172.21.15.192:0/4125138454 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c031980 con 0x7f3f540afbe0 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4125138454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 msgr2=0x7f3f540b0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.853+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540b0090 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f3f5406c610 tx=0x7f3f4c02a6a0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4125138454 shutdown_connections 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540b0090 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4125138454 >> v2:172.21.15.194:3300/0 conn(0x7f3f5415b810 0x7f3f5415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4125138454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f541402c0 0x7f3f5415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4125138454 >> 172.21.15.192:0/4125138454 conn(0x7f3f540ae7f0 msgr2=0x7f3f5406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4125138454 shutdown_connections 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.854+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4125138454 wait complete. 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.855+0000 7f3f5aa00640 1 Processor -- start 2024-09-13T18:36:44.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.855+0000 7f3f5aa00640 1 -- start start 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 0x7f3f540ac820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 0x7f3f5415d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540ab410 con 0x7f3f540afbe0 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540adc10 con 0x7f3f541402c0 2024-09-13T18:36:44.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f5aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540acd60 con 0x7f3f5415b810 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.856+0000 7f3f59600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36966/0 (socket says 172.21.15.192:36966) 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 -- 172.21.15.192:0/4185913250 learned_addr learned my addr 172.21.15.192:0/4185913250 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 0x7f3f540ac820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f5a000640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 0x7f3f5415d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 -- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 msgr2=0x7f3f5415d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 0x7f3f5415d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 -- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 msgr2=0x7f3f540ac820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 0x7f3f540ac820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 -- 172.21.15.192:0/4185913250 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009b30 con 0x7f3f540afbe0 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f5a000640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 0x7f3f5415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 0x7f3f540ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f59600640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d800 tx=0x7f3f4800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800b6c0 con 0x7f3f540afbe0 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4800b820 con 0x7f3f540afbe0 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4800bbb0 con 0x7f3f540afbe0 2024-09-13T18:36:44.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.857+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f541436c0 con 0x7f3f540afbe0 2024-09-13T18:36:44.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.858+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f540ad2e0 con 0x7f3f540afbe0 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.859+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5415e660 con 0x7f3f540afbe0 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.860+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3f4800bd10 con 0x7f3f540afbe0 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.860+0000 7f3f51600640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 0x7f3f3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.860+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f480898e0 con 0x7f3f540afbe0 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.861+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 0x7f3f3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:44.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.861+0000 7f3f58c00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 0x7f3f3406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f5413fa40 tx=0x7f3f40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:44.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:44.864+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3f48054ab0 con 0x7f3f540afbe0 2024-09-13T18:36:45.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.069+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3f540668d0 con 0x7f3f540afbe0 2024-09-13T18:36:45.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.952+0000 7f3f51600640 1 -- 172.21.15.192:0/4185913250 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3f480580d0 con 0x7f3f540afbe0 2024-09-13T18:36:45.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 msgr2=0x7f3f3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 0x7f3f3406d0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3f5413fa40 tx=0x7f3f40008040 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 msgr2=0x7f3f540aaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3f4800d800 tx=0x7f3f4800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 shutdown_connections 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3f3406ac00 0x7f3f3406d0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3f5415b810 0x7f3f5415d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3f541402c0 0x7f3f540ac820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 --2- 172.21.15.192:0/4185913250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3f540afbe0 0x7f3f540aaed0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.954+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 >> 172.21.15.192:0/4185913250 conn(0x7f3f540ae7f0 msgr2=0x7f3f5406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.955+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 shutdown_connections 2024-09-13T18:36:45.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:45.955+0000 7f3f5aa00640 1 -- 172.21.15.192:0/4185913250 wait complete. 2024-09-13T18:36:45.975 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:36:45.975 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:36:46.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.130+0000 7f3373200640 1 Processor -- start 2024-09-13T18:36:46.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.131+0000 7f3373200640 1 -- start start 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3373200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 0x7f336c0b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3373200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06f940 con 0x7f336c0b2d90 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3373200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06f610 con 0x7f336c142e00 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3373200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0b3530 con 0x7f336c0b02f0 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3372800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f336c0b2d90 0x7f336c06fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58666/0 (socket says 172.21.15.192:58666) 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3372800640 1 -- 172.21.15.192:0/1527528404 learned_addr learned my addr 172.21.15.192:0/1527528404 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:46.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.132+0000 7f3371400640 1 --2- 172.21.15.192:0/1527528404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 0x7f336c0b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413165419 0 0) 0x7f336c06f940 con 0x7f336c0b2d90 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3354003520 con 0x7f336c0b2d90 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264201533 0 0) 0x7f336c06f610 con 0x7f336c142e00 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3371400640 1 -- 172.21.15.192:0/1527528404 >> v1:172.21.15.194:6789/0 conn(0x7f336c142e00 legacy=0x7f336c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3371400640 1 -- 172.21.15.192:0/1527528404 >> v1:172.21.15.192:6789/0 conn(0x7f336c0b2d90 legacy=0x7f336c06fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.133+0000 7f3371400640 1 -- 172.21.15.192:0/1527528404 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0b3810 con 0x7f336c0b02f0 2024-09-13T18:36:46.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.134+0000 7f3371400640 1 --2- 172.21.15.192:0/1527528404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 0x7f336c0b4910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f335c0097d0 tx=0x7f335c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68af8e5e989b3671 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.134+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c032440 con 0x7f336c0b02f0 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.134+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0325a0 con 0x7f336c0b02f0 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.134+0000 7f3370a00640 1 -- 172.21.15.192:0/1527528404 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c032930 con 0x7f336c0b02f0 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 -- 172.21.15.192:0/1527528404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 msgr2=0x7f336c0b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 --2- 172.21.15.192:0/1527528404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 0x7f336c0b4910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f335c0097d0 tx=0x7f335c02a210 comp rx=0 tx=0).stop 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 -- 172.21.15.192:0/1527528404 shutdown_connections 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 --2- 172.21.15.192:0/1527528404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b02f0 0x7f336c0b4910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 -- 172.21.15.192:0/1527528404 >> 172.21.15.192:0/1527528404 conn(0x7f336c0ae7f0 msgr2=0x7f336c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 -- 172.21.15.192:0/1527528404 shutdown_connections 2024-09-13T18:36:46.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.135+0000 7f3373200640 1 -- 172.21.15.192:0/1527528404 wait complete. 2024-09-13T18:36:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.136+0000 7f3373200640 1 Processor -- start 2024-09-13T18:36:46.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.137+0000 7f3373200640 1 -- start start 2024-09-13T18:36:46.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.137+0000 7f3373200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.137+0000 7f3373200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b2d90 0x7f336c133890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3373200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 0x7f336c13af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3373200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c1327f0 con 0x7f336c0b02f0 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3373200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c132ad0 con 0x7f336c142e00 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3373200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c132db0 con 0x7f336c0b2d90 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36970/0 (socket says 172.21.15.192:36970) 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 -- 172.21.15.192:0/2444543523 learned_addr learned my addr 172.21.15.192:0/2444543523 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371400640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b2d90 0x7f336c133890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3372800640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 0x7f336c13af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 -- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b2d90 msgr2=0x7f336c133890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b2d90 0x7f336c133890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 -- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 msgr2=0x7f336c13af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 0x7f336c13af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 -- 172.21.15.192:0/2444543523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009400 con 0x7f336c0b02f0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3372800640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 0x7f336c13af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.138+0000 7f3371e00640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f336000c4b0 tx=0x7f336000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.139+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3360005480 con 0x7f336c0b02f0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.139+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600035f0 con 0x7f336c0b02f0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.139+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c143360 con 0x7f336c0b02f0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.139+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600039e0 con 0x7f336c0b02f0 2024-09-13T18:36:46.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.139+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c133370 con 0x7f336c0b02f0 2024-09-13T18:36:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.140+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c133560 con 0x7f336c0b02f0 2024-09-13T18:36:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.141+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3360003b40 con 0x7f336c0b02f0 2024-09-13T18:36:46.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.142+0000 7f3366000640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 0x7f335006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:46.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.142+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33600888a0 con 0x7f336c0b02f0 2024-09-13T18:36:46.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.142+0000 7f3371400640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 0x7f335006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:46.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.143+0000 7f3371400640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 0x7f335006d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:46.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.146+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3360053b20 con 0x7f336c0b02f0 2024-09-13T18:36:46.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.346+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f336c0b4910 con 0x7f336c0b02f0 2024-09-13T18:36:46.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.954+0000 7f3366000640 1 -- 172.21.15.192:0/2444543523 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3360017070 con 0x7f336c0b02f0 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 msgr2=0x7f335006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 0x7f335006d0c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f335c034000 tx=0x7f335c02e000 comp rx=0 tx=0).stop 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 msgr2=0x7f336c15a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f336000c4b0 tx=0x7f336000c970 comp rx=0 tx=0).stop 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 shutdown_connections 2024-09-13T18:36:46.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f335006ac00 0x7f335006d0c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f336c142e00 0x7f336c13af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336c0b2d90 0x7f336c133890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 --2- 172.21.15.192:0/2444543523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336c0b02f0 0x7f336c15a050 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 >> 172.21.15.192:0/2444543523 conn(0x7f336c0ae7f0 msgr2=0x7f336c137890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 shutdown_connections 2024-09-13T18:36:46.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:46.956+0000 7f3373200640 1 -- 172.21.15.192:0/2444543523 wait complete. 2024-09-13T18:36:46.977 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:36:46.977 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:47.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.128+0000 7fe84a000640 1 Processor -- start 2024-09-13T18:36:47.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.128+0000 7fe84a000640 1 -- start start 2024-09-13T18:36:47.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.129+0000 7fe84a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.129+0000 7fe84a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 0x7fe84415a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.129+0000 7fe84a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe84415af60 con 0x7fe844159b00 2024-09-13T18:36:47.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.129+0000 7fe84a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe84406b7a0 con 0x7fe84406bc30 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.129+0000 7fe84a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe84415ac80 con 0x7fe8440b3480 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe849600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 0x7fe84415a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:43570/0 (socket says 172.21.15.192:43570) 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 -- 172.21.15.192:0/4150910540 learned_addr learned my addr 172.21.15.192:0/4150910540 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:47.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe848c00640 1 --1- 172.21.15.192:0/4150910540 >> v1:172.21.15.194:6789/0 conn(0x7fe844159b00 0x7fe8440b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:51090/0 (socket says 172.21.15.192:51090) 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 -- 172.21.15.192:0/4150910540 >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 msgr2=0x7fe84415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 --2- 172.21.15.192:0/4150910540 >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 0x7fe84415a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 -- 172.21.15.192:0/4150910540 >> v1:172.21.15.194:6789/0 conn(0x7fe844159b00 legacy=0x7fe8440b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe83be00640 1 -- 172.21.15.192:0/4150910540 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe84406b150 con 0x7fe8440b3480 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.130+0000 7fe849600640 1 --2- 172.21.15.192:0/4150910540 >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 0x7fe84415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.131+0000 7fe83be00640 1 --2- 172.21.15.192:0/4150910540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00bb10 tx=0x7fe82c02c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e6ca3e46346b501 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.131+0000 7fe843e00640 1 -- 172.21.15.192:0/4150910540 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c032820 con 0x7fe8440b3480 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe843e00640 1 -- 172.21.15.192:0/4150910540 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c02e040 con 0x7fe8440b3480 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe843e00640 1 -- 172.21.15.192:0/4150910540 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c032ba0 con 0x7fe8440b3480 2024-09-13T18:36:47.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 -- 172.21.15.192:0/4150910540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 msgr2=0x7fe844159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 --2- 172.21.15.192:0/4150910540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00bb10 tx=0x7fe82c02c920 comp rx=0 tx=0).stop 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 -- 172.21.15.192:0/4150910540 shutdown_connections 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 --2- 172.21.15.192:0/4150910540 >> v2:172.21.15.194:3300/0 conn(0x7fe84406bc30 0x7fe84415a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 --2- 172.21.15.192:0/4150910540 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe844159ee0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 -- 172.21.15.192:0/4150910540 >> 172.21.15.192:0/4150910540 conn(0x7fe8440736d0 msgr2=0x7fe8440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 -- 172.21.15.192:0/4150910540 shutdown_connections 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.132+0000 7fe84a000640 1 -- 172.21.15.192:0/4150910540 wait complete. 2024-09-13T18:36:47.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.134+0000 7fe84a000640 1 Processor -- start 2024-09-13T18:36:47.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.134+0000 7fe84a000640 1 -- start start 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe84414c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 0x7fe8440c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84414cb40 con 0x7fe84406bc30 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84406ff90 con 0x7fe844159b00 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe84a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe844158c60 con 0x7fe8440b3480 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe848c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe848c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36978/0 (socket says 172.21.15.192:36978) 2024-09-13T18:36:47.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.135+0000 7fe848c00640 1 -- 172.21.15.192:0/1482240689 learned_addr learned my addr 172.21.15.192:0/1482240689 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:47.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe849600640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 0x7fe8440c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe83be00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe84414c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 -- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 msgr2=0x7fe84414c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe84414c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 -- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 msgr2=0x7fe8440c3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 0x7fe8440c3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 -- 172.21.15.192:0/1482240689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c009a70 con 0x7fe84406bc30 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe849600640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 0x7fe8440c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe83be00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe84414c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe848c00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c3e0 tx=0x7fe83400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340074e0 con 0x7fe84406bc30 2024-09-13T18:36:47.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834007640 con 0x7fe84406bc30 2024-09-13T18:36:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8340049e0 con 0x7fe84406bc30 2024-09-13T18:36:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe82c00b770 con 0x7fe84406bc30 2024-09-13T18:36:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.136+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe844159220 con 0x7fe84406bc30 2024-09-13T18:36:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.137+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8441593b0 con 0x7fe84406bc30 2024-09-13T18:36:47.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.138+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe834004b40 con 0x7fe84406bc30 2024-09-13T18:36:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.139+0000 7fe841600640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 0x7fe82006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.139+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe834088e20 con 0x7fe84406bc30 2024-09-13T18:36:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.139+0000 7fe83be00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 0x7fe82006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.140+0000 7fe83be00640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 0x7fe82006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe82c037000 tx=0x7fe82c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.143+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe834053f60 con 0x7fe84406bc30 2024-09-13T18:36:47.321 INFO:tasks.ceph.mds.c.smithi192.stderr:2024-09-13T18:36:47.318+0000 7f7288600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:36:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.345+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8440b2d70 con 0x7fe84406bc30 2024-09-13T18:36:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.346+0000 7fe841600640 1 -- 172.21.15.192:0/1482240689 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fe834057580 con 0x7fe84406bc30 2024-09-13T18:36:47.349 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:47.349 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:36:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:36:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 msgr2=0x7fe82006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 0x7fe82006d0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe82c037000 tx=0x7fe82c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:47.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 msgr2=0x7fe844070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe83400c3e0 tx=0x7fe83400c8a0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 shutdown_connections 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe82006ac00 0x7fe82006d0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe844159b00 0x7fe8440c3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8440b3480 0x7fe84414c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 --2- 172.21.15.192:0/1482240689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe84406bc30 0x7fe844070750 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.348+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 >> 172.21.15.192:0/1482240689 conn(0x7fe8440736d0 msgr2=0x7fe8440ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.349+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 shutdown_connections 2024-09-13T18:36:47.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.349+0000 7fe84a000640 1 -- 172.21.15.192:0/1482240689 wait complete. 2024-09-13T18:36:47.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:36:47.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.515+0000 7fbfc2400640 1 Processor -- start 2024-09-13T18:36:47.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.515+0000 7fbfc2400640 1 -- start start 2024-09-13T18:36:47.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.516+0000 7fbfc2400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbfbc0b0490 0x7fbfbc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.516+0000 7fbfc2400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0b2f00 con 0x7fbfbc0b3f10 2024-09-13T18:36:47.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.516+0000 7fbfc2400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfbc0b3150 con 0x7fbfbc15dee0 2024-09-13T18:36:47.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.516+0000 7fbfc2400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfbc0b3430 con 0x7fbfbc0b0490 2024-09-13T18:36:47.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfb2a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbfbc0b3f10 0x7fbfbc15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58668/0 (socket says 172.21.15.192:58668) 2024-09-13T18:36:47.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfb2a00640 1 -- 172.21.15.192:0/4243874473 learned_addr learned my addr 172.21.15.192:0/4243874473 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:47.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbbe00640 1 --2- 172.21.15.192:0/4243874473 >> v2:172.21.15.194:3300/0 conn(0x7fbfbc0b0490 0x7fbfbc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517178476 0 0) 0x7fbfbc0b2f00 con 0x7fbfbc0b3f10 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfa0003520 con 0x7fbfbc0b3f10 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512945653 0 0) 0x7fbfbc0b3150 con 0x7fbfbc15dee0 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbbe00640 1 -- 172.21.15.192:0/4243874473 >> v1:172.21.15.194:6789/0 conn(0x7fbfbc15dee0 legacy=0x7fbfbc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbbe00640 1 -- 172.21.15.192:0/4243874473 >> v1:172.21.15.192:6789/0 conn(0x7fbfbc0b3f10 legacy=0x7fbfbc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.517+0000 7fbfbbe00640 1 -- 172.21.15.192:0/4243874473 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc0b3710 con 0x7fbfbc0b0490 2024-09-13T18:36:47.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfbbe00640 1 --2- 172.21.15.192:0/4243874473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc0b0490 0x7fbfbc15ab50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009d90 tx=0x7fbfb402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dea3766800ede0f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4007740 con 0x7fbfbc0b0490 2024-09-13T18:36:47.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb402d050 con 0x7fbfbc0b0490 2024-09-13T18:36:47.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfbaa00640 1 -- 172.21.15.192:0/4243874473 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb4007ac0 con 0x7fbfbc0b0490 2024-09-13T18:36:47.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfc2400640 1 -- 172.21.15.192:0/4243874473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc0b0490 msgr2=0x7fbfbc15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.519+0000 7fbfc2400640 1 --2- 172.21.15.192:0/4243874473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc0b0490 0x7fbfbc15ab50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4009d90 tx=0x7fbfb402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.520+0000 7fbfc2400640 1 -- 172.21.15.192:0/4243874473 shutdown_connections 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.520+0000 7fbfc2400640 1 --2- 172.21.15.192:0/4243874473 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc0b0490 0x7fbfbc15ab50 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.520+0000 7fbfc2400640 1 -- 172.21.15.192:0/4243874473 >> 172.21.15.192:0/4243874473 conn(0x7fbfbc0ae960 msgr2=0x7fbfbc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.520+0000 7fbfc2400640 1 -- 172.21.15.192:0/4243874473 shutdown_connections 2024-09-13T18:36:47.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.520+0000 7fbfc2400640 1 -- 172.21.15.192:0/4243874473 wait complete. 2024-09-13T18:36:47.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.521+0000 7fbfc2400640 1 Processor -- start 2024-09-13T18:36:47.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.521+0000 7fbfc2400640 1 -- start start 2024-09-13T18:36:47.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 0x7fbfbc139a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc13fcc0 0x7fbfbc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc156a30 con 0x7fbfbc15dee0 2024-09-13T18:36:47.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc156190 con 0x7fbfbc13fcc0 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfc2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfbc157230 con 0x7fbfbc0b0490 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36988/0 (socket says 172.21.15.192:36988) 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.522+0000 7fbfb2a00640 1 -- 172.21.15.192:0/2705025979 learned_addr learned my addr 172.21.15.192:0/2705025979 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfbbe00640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc13fcc0 0x7fbfbc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfbb400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 0x7fbfbc139a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 -- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 msgr2=0x7fbfbc139a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 0x7fbfbc139a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 -- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc13fcc0 msgr2=0x7fbfbc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc13fcc0 0x7fbfbc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 -- 172.21.15.192:0/2705025979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb4009a70 con 0x7fbfbc15dee0 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfbb400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 0x7fbfbc139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:47.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb2a00640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c430 tx=0x7fbfa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4005ce0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4005e40 con 0x7fbfbc15dee0 2024-09-13T18:36:47.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40072f0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.523+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfbc1563e0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.524+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfbc156ec0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.525+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfbc156be0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.525+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbfa4007450 con 0x7fbfbc15dee0 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.526+0000 7fbfb3e00640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 0x7fbf9806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.526+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfa4088a10 con 0x7fbfbc15dee0 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.526+0000 7fbfbb400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 0x7fbf9806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.527+0000 7fbfbb400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 0x7fbf9806d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.530+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbfbc156be0 con 0x7fbfbc15dee0 2024-09-13T18:36:47.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.699+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfbc0afd80 con 0x7fbfbc15dee0 2024-09-13T18:36:47.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.701+0000 7fbfb3e00640 1 -- 172.21.15.192:0/2705025979 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fbfa4017020 con 0x7fbfbc15dee0 2024-09-13T18:36:47.704 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:47.704 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":35,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:44.940202+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:36:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 msgr2=0x7fbf9806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 0x7fbf9806d0f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbfac000f60 tx=0x7fbfac009040 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 msgr2=0x7fbfbc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c430 tx=0x7fbfa400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 shutdown_connections 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbf9806ac30 0x7fbf9806d0f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbfbc13fcc0 0x7fbfbc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbfbc15dee0 0x7fbfbc0ad840 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 --2- 172.21.15.192:0/2705025979 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbfbc0b0490 0x7fbfbc139a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 >> 172.21.15.192:0/2705025979 conn(0x7fbfbc0ae960 msgr2=0x7fbfbc159480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 shutdown_connections 2024-09-13T18:36:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.703+0000 7fbfc2400640 1 -- 172.21.15.192:0/2705025979 wait complete. 2024-09-13T18:36:47.722 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:36:47.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:47.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.874+0000 7f39c8e00640 1 Processor -- start 2024-09-13T18:36:47.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.874+0000 7f39c8e00640 1 -- start start 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c8e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39c40b3f10 0x7f39c415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c8e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 0x7f39c415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c8e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c40b2f00 con 0x7f39c415dee0 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c8e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c415aec0 con 0x7f39c40b3f10 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c8e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c40b3150 con 0x7f39c40b0490 2024-09-13T18:36:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39c40b3f10 0x7f39c415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f39c40b3f10 0x7f39c415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36998/0 (socket says 172.21.15.192:36998) 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 -- 172.21.15.192:0/536801176 learned_addr learned my addr 172.21.15.192:0/536801176 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c1e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f39c415dee0 0x7f39c40afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58684/0 (socket says 172.21.15.192:58684) 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c2800640 1 --2- 172.21.15.192:0/536801176 >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 0x7f39c415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 -- 172.21.15.192:0/536801176 >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 msgr2=0x7f39c415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 --2- 172.21.15.192:0/536801176 >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 0x7f39c415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 -- 172.21.15.192:0/536801176 >> v1:172.21.15.192:6789/0 conn(0x7f39c415dee0 legacy=0x7f39c40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c1400640 1 -- 172.21.15.192:0/536801176 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1505570323 0 0) 0x7f39c40b2f00 con 0x7f39c415dee0 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39bbe00640 1 -- 172.21.15.192:0/536801176 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c40b3430 con 0x7f39c40b3f10 2024-09-13T18:36:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.876+0000 7f39c2800640 1 --2- 172.21.15.192:0/536801176 >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 0x7f39c415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.877+0000 7f39bbe00640 1 --2- 172.21.15.192:0/536801176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c40b3f10 0x7f39c415a440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f39c40cec10 tx=0x7f39ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e255530d162d630e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c1400640 1 -- 172.21.15.192:0/536801176 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032440 con 0x7f39c40b3f10 2024-09-13T18:36:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c1400640 1 -- 172.21.15.192:0/536801176 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac0325a0 con 0x7f39c40b3f10 2024-09-13T18:36:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c1400640 1 -- 172.21.15.192:0/536801176 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032930 con 0x7f39c40b3f10 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 -- 172.21.15.192:0/536801176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c40b3f10 msgr2=0x7f39c415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 --2- 172.21.15.192:0/536801176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c40b3f10 0x7f39c415a440 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f39c40cec10 tx=0x7f39ac02a270 comp rx=0 tx=0).stop 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 -- 172.21.15.192:0/536801176 shutdown_connections 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 --2- 172.21.15.192:0/536801176 >> v2:172.21.15.194:3300/0 conn(0x7f39c40b0490 0x7f39c415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 --2- 172.21.15.192:0/536801176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c40b3f10 0x7f39c415a440 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 -- 172.21.15.192:0/536801176 >> 172.21.15.192:0/536801176 conn(0x7f39c40ae960 msgr2=0x7f39c406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 -- 172.21.15.192:0/536801176 shutdown_connections 2024-09-13T18:36:47.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.878+0000 7f39c8e00640 1 -- 172.21.15.192:0/536801176 wait complete. 2024-09-13T18:36:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.880+0000 7f39c8e00640 1 Processor -- start 2024-09-13T18:36:47.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.880+0000 7f39c8e00640 1 -- start start 2024-09-13T18:36:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39c40b0490 0x7f39c4141e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39c4142f50 0x7f39c41f5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c41433e0 con 0x7f39c415dee0 2024-09-13T18:36:47.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c4142510 con 0x7f39c4142f50 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c8e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c413d200 con 0x7f39c40b0490 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37006/0 (socket says 172.21.15.192:37006) 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39bbe00640 1 -- 172.21.15.192:0/1601388955 learned_addr learned my addr 172.21.15.192:0/1601388955 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.881+0000 7f39c2800640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39c4142f50 0x7f39c41f5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39c1e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39c40b0490 0x7f39c4141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 -- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39c40b0490 msgr2=0x7f39c4141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39c40b0490 0x7f39c4141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 -- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39c4142f50 msgr2=0x7f39c41f5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39c4142f50 0x7f39c41f5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 -- 172.21.15.192:0/1601388955 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39ac0094d0 con 0x7f39c415dee0 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39bbe00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac032440 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac004030 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac0043c0 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.882+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c413d4e0 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.883+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c41f5fe0 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.883+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c413da00 con 0x7f39c415dee0 2024-09-13T18:36:47.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.884+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f39ac039050 con 0x7f39c415dee0 2024-09-13T18:36:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.885+0000 7f39ba000640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 0x7f39a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.885+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39ac0a99c0 con 0x7f39c415dee0 2024-09-13T18:36:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.886+0000 7f39c1e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 0x7f39a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.886+0000 7f39c1e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 0x7f39a006d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f39b4007fd0 tx=0x7f39b4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:47.889+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f39c413da00 con 0x7f39c415dee0 2024-09-13T18:36:48.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.056+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39c413d370 con 0x7f39a006ac00 2024-09-13T18:36:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.064+0000 7f39ba000640 1 -- 172.21.15.192:0/1601388955 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282097 (secure 0 0 0) 0x7f39c413d370 con 0x7f39a006ac00 2024-09-13T18:36:48.070 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:48.072 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:36:48.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 msgr2=0x7f39a006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 0x7f39a006d0c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f39b4007fd0 tx=0x7f39b4007de0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 msgr2=0x7f39c4154730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f39ac000c00 tx=0x7f39ac0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 shutdown_connections 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f39a006ac00 0x7f39a006d0c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f39c4142f50 0x7f39c41f5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c415dee0 0x7f39c4154730 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 --2- 172.21.15.192:0/1601388955 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f39c40b0490 0x7f39c4141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 >> 172.21.15.192:0/1601388955 conn(0x7f39c40ae960 msgr2=0x7f39c40ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 shutdown_connections 2024-09-13T18:36:48.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.068+0000 7f39c8e00640 1 -- 172.21.15.192:0/1601388955 wait complete. 2024-09-13T18:36:48.087 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:36:46.747293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225893"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.528067+0000","last_change":"2024-09-13T18:36:43.528067+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.528067+0000","last_undegraded":"2024-09-13T18:36:43.528067+0000","last_fullsized":"2024-09-13T18:36:43.528067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952115+0000","last_change":"2024-09-13T18:36:43.951551+0000","last_active":"2024-09-13T18:36:43.952115+0000","last_peered":"2024-09-13T18:36:43.952115+0000","last_clean":"2024-09-13T18:36:43.952115+0000","last_became_active":"2024-09-13T18:36:43.951076+0000","last_became_peered":"2024-09-13T18:36:43.951076+0000","last_unstale":"2024-09-13T18:36:43.952115+0000","last_undegraded":"2024-09-13T18:36:43.952115+0000","last_fullsized":"2024-09-13T18:36:43.952115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529777+0000","last_change":"2024-09-13T18:36:43.529777+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529777+0000","last_undegraded":"2024-09-13T18:36:43.529777+0000","last_fullsized":"2024-09-13T18:36:43.529777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:07.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.540129+0000","last_change":"2024-09-13T18:36:43.540129+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.540129+0000","last_undegraded":"2024-09-13T18:36:43.540129+0000","last_fullsized":"2024-09-13T18:36:43.540129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:46.448234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952129+0000","last_change":"2024-09-13T18:36:43.951863+0000","last_active":"2024-09-13T18:36:43.952129+0000","last_peered":"2024-09-13T18:36:43.952129+0000","last_clean":"2024-09-13T18:36:43.952129+0000","last_became_active":"2024-09-13T18:36:43.951639+0000","last_became_peered":"2024-09-13T18:36:43.951639+0000","last_unstale":"2024-09-13T18:36:43.952129+0000","last_undegraded":"2024-09-13T18:36:43.952129+0000","last_fullsized":"2024-09-13T18:36:43.952129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538403+0000","last_change":"2024-09-13T18:36:43.538403+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538403+0000","last_undegraded":"2024-09-13T18:36:43.538403+0000","last_fullsized":"2024-09-13T18:36:43.538403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527719+0000","last_change":"2024-09-13T18:36:43.527719+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527719+0000","last_undegraded":"2024-09-13T18:36:43.527719+0000","last_fullsized":"2024-09-13T18:36:43.527719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527685+0000","last_change":"2024-09-13T18:36:43.527685+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527685+0000","last_undegraded":"2024-09-13T18:36:43.527685+0000","last_fullsized":"2024-09-13T18:36:43.527685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529413+0000","last_change":"2024-09-13T18:36:43.529413+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529413+0000","last_undegraded":"2024-09-13T18:36:43.529413+0000","last_fullsized":"2024-09-13T18:36:43.529413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:03.105215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537489+0000","last_change":"2024-09-13T18:36:43.537489+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537489+0000","last_undegraded":"2024-09-13T18:36:43.537489+0000","last_fullsized":"2024-09-13T18:36:43.537489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:30.619118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534180+0000","last_change":"2024-09-13T18:36:43.534180+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534180+0000","last_undegraded":"2024-09-13T18:36:43.534180+0000","last_fullsized":"2024-09-13T18:36:43.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:39.254899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529578+0000","last_change":"2024-09-13T18:36:43.529578+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529578+0000","last_undegraded":"2024-09-13T18:36:43.529578+0000","last_fullsized":"2024-09-13T18:36:43.529578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531393+0000","last_change":"2024-09-13T18:36:43.531393+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531393+0000","last_undegraded":"2024-09-13T18:36:43.531393+0000","last_fullsized":"2024-09-13T18:36:43.531393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.539761+0000","last_change":"2024-09-13T18:36:43.539761+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.539761+0000","last_undegraded":"2024-09-13T18:36:43.539761+0000","last_fullsized":"2024-09-13T18:36:43.539761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531685+0000","last_change":"2024-09-13T18:36:43.531685+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531685+0000","last_undegraded":"2024-09-13T18:36:43.531685+0000","last_fullsized":"2024-09-13T18:36:43.531685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531383+0000","last_change":"2024-09-13T18:36:43.531383+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531383+0000","last_undegraded":"2024-09-13T18:36:43.531383+0000","last_fullsized":"2024-09-13T18:36:43.531383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534377+0000","last_change":"2024-09-13T18:36:43.534377+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534377+0000","last_undegraded":"2024-09-13T18:36:43.534377+0000","last_fullsized":"2024-09-13T18:36:43.534377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.345426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533955+0000","last_change":"2024-09-13T18:36:43.533955+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533955+0000","last_undegraded":"2024-09-13T18:36:43.533955+0000","last_fullsized":"2024-09-13T18:36:43.533955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533221+0000","last_change":"2024-09-13T18:36:43.533221+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533221+0000","last_undegraded":"2024-09-13T18:36:43.533221+0000","last_fullsized":"2024-09-13T18:36:43.533221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530485+0000","last_change":"2024-09-13T18:36:43.530485+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530485+0000","last_undegraded":"2024-09-13T18:36:43.530485+0000","last_fullsized":"2024-09-13T18:36:43.530485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:11.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530259+0000","last_change":"2024-09-13T18:36:43.530259+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530259+0000","last_undegraded":"2024-09-13T18:36:43.530259+0000","last_fullsized":"2024-09-13T18:36:43.530259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527130+0000","last_change":"2024-09-13T18:36:43.527130+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527130+0000","last_undegraded":"2024-09-13T18:36:43.527130+0000","last_fullsized":"2024-09-13T18:36:43.527130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529504+0000","last_change":"2024-09-13T18:36:43.529504+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529504+0000","last_undegraded":"2024-09-13T18:36:43.529504+0000","last_fullsized":"2024-09-13T18:36:43.529504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527291+0000","last_change":"2024-09-13T18:36:43.527291+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527291+0000","last_undegraded":"2024-09-13T18:36:43.527291+0000","last_fullsized":"2024-09-13T18:36:43.527291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537172+0000","last_change":"2024-09-13T18:36:43.537172+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537172+0000","last_undegraded":"2024-09-13T18:36:43.537172+0000","last_fullsized":"2024-09-13T18:36:43.537172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538263+0000","last_change":"2024-09-13T18:36:43.538263+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538263+0000","last_undegraded":"2024-09-13T18:36:43.538263+0000","last_fullsized":"2024-09-13T18:36:43.538263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952098+0000","last_change":"2024-09-13T18:36:43.951370+0000","last_active":"2024-09-13T18:36:43.952098+0000","last_peered":"2024-09-13T18:36:43.952098+0000","last_clean":"2024-09-13T18:36:43.952098+0000","last_became_active":"2024-09-13T18:36:43.950676+0000","last_became_peered":"2024-09-13T18:36:43.950676+0000","last_unstale":"2024-09-13T18:36:43.952098+0000","last_undegraded":"2024-09-13T18:36:43.952098+0000","last_fullsized":"2024-09-13T18:36:43.952098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527298+0000","last_change":"2024-09-13T18:36:43.527298+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527298+0000","last_undegraded":"2024-09-13T18:36:43.527298+0000","last_fullsized":"2024-09-13T18:36:43.527298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529780+0000","last_change":"2024-09-13T18:36:43.529780+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529780+0000","last_undegraded":"2024-09-13T18:36:43.529780+0000","last_fullsized":"2024-09-13T18:36:43.529780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531345+0000","last_change":"2024-09-13T18:36:43.531345+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531345+0000","last_undegraded":"2024-09-13T18:36:43.531345+0000","last_fullsized":"2024-09-13T18:36:43.531345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526932+0000","last_change":"2024-09-13T18:36:43.526932+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526932+0000","last_undegraded":"2024-09-13T18:36:43.526932+0000","last_fullsized":"2024-09-13T18:36:43.526932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534040+0000","last_change":"2024-09-13T18:36:43.534040+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534040+0000","last_undegraded":"2024-09-13T18:36:43.534040+0000","last_fullsized":"2024-09-13T18:36:43.534040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:45.408169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532137+0000","last_change":"2024-09-13T18:36:43.532137+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532137+0000","last_undegraded":"2024-09-13T18:36:43.532137+0000","last_fullsized":"2024-09-13T18:36:43.532137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.542076+0000","last_change":"2024-09-13T18:36:43.542006+0000","last_active":"2024-09-13T18:36:43.542076+0000","last_peered":"2024-09-13T18:36:43.542076+0000","last_clean":"2024-09-13T18:36:43.542076+0000","last_became_active":"2024-09-13T18:36:43.541236+0000","last_became_peered":"2024-09-13T18:36:43.541236+0000","last_unstale":"2024-09-13T18:36:43.542076+0000","last_undegraded":"2024-09-13T18:36:43.542076+0000","last_fullsized":"2024-09-13T18:36:43.542076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:53.065027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526964+0000","last_change":"2024-09-13T18:36:43.526964+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526964+0000","last_undegraded":"2024-09-13T18:36:43.526964+0000","last_fullsized":"2024-09-13T18:36:43.526964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538112+0000","last_change":"2024-09-13T18:36:43.538000+0000","last_active":"2024-09-13T18:36:43.538112+0000","last_peered":"2024-09-13T18:36:43.538112+0000","last_clean":"2024-09-13T18:36:43.538112+0000","last_became_active":"2024-09-13T18:36:43.532918+0000","last_became_peered":"2024-09-13T18:36:43.532918+0000","last_unstale":"2024-09-13T18:36:43.538112+0000","last_undegraded":"2024-09-13T18:36:43.538112+0000","last_fullsized":"2024-09-13T18:36:43.538112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:35.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526481+0000","last_change":"2024-09-13T18:36:43.526481+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526481+0000","last_undegraded":"2024-09-13T18:36:43.526481+0000","last_fullsized":"2024-09-13T18:36:43.526481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535763+0000","last_change":"2024-09-13T18:36:43.535124+0000","last_active":"2024-09-13T18:36:43.535763+0000","last_peered":"2024-09-13T18:36:43.535763+0000","last_clean":"2024-09-13T18:36:43.535763+0000","last_became_active":"2024-09-13T18:36:43.534854+0000","last_became_peered":"2024-09-13T18:36:43.534854+0000","last_unstale":"2024-09-13T18:36:43.535763+0000","last_undegraded":"2024-09-13T18:36:43.535763+0000","last_fullsized":"2024-09-13T18:36:43.535763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:51.263603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.536840+0000","last_change":"2024-09-13T18:36:43.536840+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.536840+0000","last_undegraded":"2024-09-13T18:36:43.536840+0000","last_fullsized":"2024-09-13T18:36:43.536840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533794+0000","last_change":"2024-09-13T18:36:43.533688+0000","last_active":"2024-09-13T18:36:43.533794+0000","last_peered":"2024-09-13T18:36:43.533794+0000","last_clean":"2024-09-13T18:36:43.533794+0000","last_became_active":"2024-09-13T18:36:43.533428+0000","last_became_peered":"2024-09-13T18:36:43.533428+0000","last_unstale":"2024-09-13T18:36:43.533794+0000","last_undegraded":"2024-09-13T18:36:43.533794+0000","last_fullsized":"2024-09-13T18:36:43.533794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:17.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529379+0000","last_change":"2024-09-13T18:36:43.529379+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529379+0000","last_undegraded":"2024-09-13T18:36:43.529379+0000","last_fullsized":"2024-09-13T18:36:43.529379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:37.492595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536644+0000","last_change":"2024-09-13T18:36:43.536543+0000","last_active":"2024-09-13T18:36:43.536644+0000","last_peered":"2024-09-13T18:36:43.536644+0000","last_clean":"2024-09-13T18:36:43.536644+0000","last_became_active":"2024-09-13T18:36:43.536207+0000","last_became_peered":"2024-09-13T18:36:43.536207+0000","last_unstale":"2024-09-13T18:36:43.536644+0000","last_undegraded":"2024-09-13T18:36:43.536644+0000","last_fullsized":"2024-09-13T18:36:43.536644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526458+0000","last_change":"2024-09-13T18:36:43.526458+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526458+0000","last_undegraded":"2024-09-13T18:36:43.526458+0000","last_fullsized":"2024-09-13T18:36:43.526458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536905+0000","last_change":"2024-09-13T18:36:43.536837+0000","last_active":"2024-09-13T18:36:43.536905+0000","last_peered":"2024-09-13T18:36:43.536905+0000","last_clean":"2024-09-13T18:36:43.536905+0000","last_became_active":"2024-09-13T18:36:43.536577+0000","last_became_peered":"2024-09-13T18:36:43.536577+0000","last_unstale":"2024-09-13T18:36:43.536905+0000","last_undegraded":"2024-09-13T18:36:43.536905+0000","last_fullsized":"2024-09-13T18:36:43.536905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527660+0000","last_change":"2024-09-13T18:36:43.527660+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527660+0000","last_undegraded":"2024-09-13T18:36:43.527660+0000","last_fullsized":"2024-09-13T18:36:43.527660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.534578+0000","last_change":"2024-09-13T18:36:43.534506+0000","last_active":"2024-09-13T18:36:43.534578+0000","last_peered":"2024-09-13T18:36:43.534578+0000","last_clean":"2024-09-13T18:36:43.534578+0000","last_became_active":"2024-09-13T18:36:43.534228+0000","last_became_peered":"2024-09-13T18:36:43.534228+0000","last_unstale":"2024-09-13T18:36:43.534578+0000","last_undegraded":"2024-09-13T18:36:43.534578+0000","last_fullsized":"2024-09-13T18:36:43.534578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:12.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.539137+0000","last_change":"2024-09-13T18:36:43.539137+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.539137+0000","last_undegraded":"2024-09-13T18:36:43.539137+0000","last_fullsized":"2024-09-13T18:36:43.539137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.528484+0000","last_change":"2024-09-13T18:36:43.528414+0000","last_active":"2024-09-13T18:36:43.528484+0000","last_peered":"2024-09-13T18:36:43.528484+0000","last_clean":"2024-09-13T18:36:43.528484+0000","last_became_active":"2024-09-13T18:36:43.528200+0000","last_became_peered":"2024-09-13T18:36:43.528200+0000","last_unstale":"2024-09-13T18:36:43.528484+0000","last_undegraded":"2024-09-13T18:36:43.528484+0000","last_fullsized":"2024-09-13T18:36:43.528484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532972+0000","last_change":"2024-09-13T18:36:43.532972+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532972+0000","last_undegraded":"2024-09-13T18:36:43.532972+0000","last_fullsized":"2024-09-13T18:36:43.532972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.564846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.943637+0000","last_change":"2024-09-13T18:36:43.537908+0000","last_active":"2024-09-13T18:36:43.943637+0000","last_peered":"2024-09-13T18:36:43.943637+0000","last_clean":"2024-09-13T18:36:43.943637+0000","last_became_active":"2024-09-13T18:36:43.537692+0000","last_became_peered":"2024-09-13T18:36:43.537692+0000","last_unstale":"2024-09-13T18:36:43.943637+0000","last_undegraded":"2024-09-13T18:36:43.943637+0000","last_fullsized":"2024-09-13T18:36:43.943637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:46.060408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537895+0000","last_change":"2024-09-13T18:36:43.537895+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537895+0000","last_undegraded":"2024-09-13T18:36:43.537895+0000","last_fullsized":"2024-09-13T18:36:43.537895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944365+0000","last_change":"2024-09-13T18:36:43.538915+0000","last_active":"2024-09-13T18:36:43.944365+0000","last_peered":"2024-09-13T18:36:43.944365+0000","last_clean":"2024-09-13T18:36:43.944365+0000","last_became_active":"2024-09-13T18:36:43.538537+0000","last_became_peered":"2024-09-13T18:36:43.538537+0000","last_unstale":"2024-09-13T18:36:43.944365+0000","last_undegraded":"2024-09-13T18:36:43.944365+0000","last_fullsized":"2024-09-13T18:36:43.944365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538665+0000","last_change":"2024-09-13T18:36:43.538665+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538665+0000","last_undegraded":"2024-09-13T18:36:43.538665+0000","last_fullsized":"2024-09-13T18:36:43.538665+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:25.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.541775+0000","last_change":"2024-09-13T18:36:43.541708+0000","last_active":"2024-09-13T18:36:43.541775+0000","last_peered":"2024-09-13T18:36:43.541775+0000","last_clean":"2024-09-13T18:36:43.541775+0000","last_became_active":"2024-09-13T18:36:43.538962+0000","last_became_peered":"2024-09-13T18:36:43.538962+0000","last_unstale":"2024-09-13T18:36:43.541775+0000","last_undegraded":"2024-09-13T18:36:43.541775+0000","last_fullsized":"2024-09-13T18:36:43.541775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:51.494051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537605+0000","last_change":"2024-09-13T18:36:43.537605+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537605+0000","last_undegraded":"2024-09-13T18:36:43.537605+0000","last_fullsized":"2024-09-13T18:36:43.537605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:54.543794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536609+0000","last_change":"2024-09-13T18:36:43.535486+0000","last_active":"2024-09-13T18:36:43.536609+0000","last_peered":"2024-09-13T18:36:43.536609+0000","last_clean":"2024-09-13T18:36:43.536609+0000","last_became_active":"2024-09-13T18:36:43.535085+0000","last_became_peered":"2024-09-13T18:36:43.535085+0000","last_unstale":"2024-09-13T18:36:43.536609+0000","last_undegraded":"2024-09-13T18:36:43.536609+0000","last_fullsized":"2024-09-13T18:36:43.536609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530009+0000","last_change":"2024-09-13T18:36:43.530009+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530009+0000","last_undegraded":"2024-09-13T18:36:43.530009+0000","last_fullsized":"2024-09-13T18:36:43.530009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:24.655907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540381+0000","last_change":"2024-09-13T18:36:43.539714+0000","last_active":"2024-09-13T18:36:43.540381+0000","last_peered":"2024-09-13T18:36:43.540381+0000","last_clean":"2024-09-13T18:36:43.540381+0000","last_became_active":"2024-09-13T18:36:43.538401+0000","last_became_peered":"2024-09-13T18:36:43.538401+0000","last_unstale":"2024-09-13T18:36:43.540381+0000","last_undegraded":"2024-09-13T18:36:43.540381+0000","last_fullsized":"2024-09-13T18:36:43.540381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.536510+0000","last_change":"2024-09-13T18:36:43.536510+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.536510+0000","last_undegraded":"2024-09-13T18:36:43.536510+0000","last_fullsized":"2024-09-13T18:36:43.536510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.539363+0000","last_change":"2024-09-13T18:36:43.539220+0000","last_active":"2024-09-13T18:36:43.539363+0000","last_peered":"2024-09-13T18:36:43.539363+0000","last_clean":"2024-09-13T18:36:43.539363+0000","last_became_active":"2024-09-13T18:36:43.538932+0000","last_became_peered":"2024-09-13T18:36:43.538932+0000","last_unstale":"2024-09-13T18:36:43.539363+0000","last_undegraded":"2024-09-13T18:36:43.539363+0000","last_fullsized":"2024-09-13T18:36:43.539363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526488+0000","last_change":"2024-09-13T18:36:43.526488+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526488+0000","last_undegraded":"2024-09-13T18:36:43.526488+0000","last_fullsized":"2024-09-13T18:36:43.526488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.534026+0000","last_change":"2024-09-13T18:36:43.533866+0000","last_active":"2024-09-13T18:36:43.534026+0000","last_peered":"2024-09-13T18:36:43.534026+0000","last_clean":"2024-09-13T18:36:43.534026+0000","last_became_active":"2024-09-13T18:36:43.533584+0000","last_became_peered":"2024-09-13T18:36:43.533584+0000","last_unstale":"2024-09-13T18:36:43.534026+0000","last_undegraded":"2024-09-13T18:36:43.534026+0000","last_fullsized":"2024-09-13T18:36:43.534026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533699+0000","last_change":"2024-09-13T18:36:43.533699+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533699+0000","last_undegraded":"2024-09-13T18:36:43.533699+0000","last_fullsized":"2024-09-13T18:36:43.533699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:28.437957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540479+0000","last_change":"2024-09-13T18:36:43.540398+0000","last_active":"2024-09-13T18:36:43.540479+0000","last_peered":"2024-09-13T18:36:43.540479+0000","last_clean":"2024-09-13T18:36:43.540479+0000","last_became_active":"2024-09-13T18:36:43.539926+0000","last_became_peered":"2024-09-13T18:36:43.539926+0000","last_unstale":"2024-09-13T18:36:43.540479+0000","last_undegraded":"2024-09-13T18:36:43.540479+0000","last_fullsized":"2024-09-13T18:36:43.540479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:04.042479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534692+0000","last_change":"2024-09-13T18:36:43.534692+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534692+0000","last_undegraded":"2024-09-13T18:36:43.534692+0000","last_fullsized":"2024-09-13T18:36:43.534692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.386496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535810+0000","last_change":"2024-09-13T18:36:43.535513+0000","last_active":"2024-09-13T18:36:43.535810+0000","last_peered":"2024-09-13T18:36:43.535810+0000","last_clean":"2024-09-13T18:36:43.535810+0000","last_became_active":"2024-09-13T18:36:43.535276+0000","last_became_peered":"2024-09-13T18:36:43.535276+0000","last_unstale":"2024-09-13T18:36:43.535810+0000","last_undegraded":"2024-09-13T18:36:43.535810+0000","last_fullsized":"2024-09-13T18:36:43.535810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:22.809094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.528052+0000","last_change":"2024-09-13T18:36:43.528052+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.528052+0000","last_undegraded":"2024-09-13T18:36:43.528052+0000","last_fullsized":"2024-09-13T18:36:43.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540347+0000","last_change":"2024-09-13T18:36:43.538605+0000","last_active":"2024-09-13T18:36:43.540347+0000","last_peered":"2024-09-13T18:36:43.540347+0000","last_clean":"2024-09-13T18:36:43.540347+0000","last_became_active":"2024-09-13T18:36:43.538075+0000","last_became_peered":"2024-09-13T18:36:43.538075+0000","last_unstale":"2024-09-13T18:36:43.540347+0000","last_undegraded":"2024-09-13T18:36:43.540347+0000","last_fullsized":"2024-09-13T18:36:43.540347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954276+0000","last_change":"2024-09-13T18:36:43.954197+0000","last_active":"2024-09-13T18:36:43.954276+0000","last_peered":"2024-09-13T18:36:43.954276+0000","last_clean":"2024-09-13T18:36:43.954276+0000","last_became_active":"2024-09-13T18:36:43.953917+0000","last_became_peered":"2024-09-13T18:36:43.953917+0000","last_unstale":"2024-09-13T18:36:43.954276+0000","last_undegraded":"2024-09-13T18:36:43.954276+0000","last_fullsized":"2024-09-13T18:36:43.954276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.539328+0000","last_change":"2024-09-13T18:36:43.539249+0000","last_active":"2024-09-13T18:36:43.539328+0000","last_peered":"2024-09-13T18:36:43.539328+0000","last_clean":"2024-09-13T18:36:43.539328+0000","last_became_active":"2024-09-13T18:36:43.538532+0000","last_became_peered":"2024-09-13T18:36:43.538532+0000","last_unstale":"2024-09-13T18:36:43.539328+0000","last_undegraded":"2024-09-13T18:36:43.539328+0000","last_fullsized":"2024-09-13T18:36:43.539328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538091+0000","last_change":"2024-09-13T18:36:43.538091+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538091+0000","last_undegraded":"2024-09-13T18:36:43.538091+0000","last_fullsized":"2024-09-13T18:36:43.538091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:36.254852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535422+0000","last_change":"2024-09-13T18:36:43.535052+0000","last_active":"2024-09-13T18:36:43.535422+0000","last_peered":"2024-09-13T18:36:43.535422+0000","last_clean":"2024-09-13T18:36:43.535422+0000","last_became_active":"2024-09-13T18:36:43.534607+0000","last_became_peered":"2024-09-13T18:36:43.534607+0000","last_unstale":"2024-09-13T18:36:43.535422+0000","last_undegraded":"2024-09-13T18:36:43.535422+0000","last_fullsized":"2024-09-13T18:36:43.535422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529565+0000","last_change":"2024-09-13T18:36:43.529565+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529565+0000","last_undegraded":"2024-09-13T18:36:43.529565+0000","last_fullsized":"2024-09-13T18:36:43.529565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:22.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961175+0000","last_change":"2024-09-13T18:36:43.532711+0000","last_active":"2024-09-13T18:36:43.961175+0000","last_peered":"2024-09-13T18:36:43.961175+0000","last_clean":"2024-09-13T18:36:43.961175+0000","last_became_active":"2024-09-13T18:36:43.532491+0000","last_became_peered":"2024-09-13T18:36:43.532491+0000","last_unstale":"2024-09-13T18:36:43.961175+0000","last_undegraded":"2024-09-13T18:36:43.961175+0000","last_fullsized":"2024-09-13T18:36:43.961175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:41.467973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947954+0000","last_change":"2024-09-13T18:36:43.947877+0000","last_active":"2024-09-13T18:36:43.947954+0000","last_peered":"2024-09-13T18:36:43.947954+0000","last_clean":"2024-09-13T18:36:43.947954+0000","last_became_active":"2024-09-13T18:36:43.947611+0000","last_became_peered":"2024-09-13T18:36:43.947611+0000","last_unstale":"2024-09-13T18:36:43.947954+0000","last_undegraded":"2024-09-13T18:36:43.947954+0000","last_fullsized":"2024-09-13T18:36:43.947954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540366+0000","last_change":"2024-09-13T18:36:43.539178+0000","last_active":"2024-09-13T18:36:43.540366+0000","last_peered":"2024-09-13T18:36:43.540366+0000","last_clean":"2024-09-13T18:36:43.540366+0000","last_became_active":"2024-09-13T18:36:43.538927+0000","last_became_peered":"2024-09-13T18:36:43.538927+0000","last_unstale":"2024-09-13T18:36:43.540366+0000","last_undegraded":"2024-09-13T18:36:43.540366+0000","last_fullsized":"2024-09-13T18:36:43.540366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529608+0000","last_change":"2024-09-13T18:36:43.529608+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529608+0000","last_undegraded":"2024-09-13T18:36:43.529608+0000","last_fullsized":"2024-09-13T18:36:43.529608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533758+0000","last_change":"2024-09-13T18:36:43.533289+0000","last_active":"2024-09-13T18:36:43.533758+0000","last_peered":"2024-09-13T18:36:43.533758+0000","last_clean":"2024-09-13T18:36:43.533758+0000","last_became_active":"2024-09-13T18:36:43.532827+0000","last_became_peered":"2024-09-13T18:36:43.532827+0000","last_unstale":"2024-09-13T18:36:43.533758+0000","last_undegraded":"2024-09-13T18:36:43.533758+0000","last_fullsized":"2024-09-13T18:36:43.533758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.380715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527293+0000","last_change":"2024-09-13T18:36:43.527293+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527293+0000","last_undegraded":"2024-09-13T18:36:43.527293+0000","last_fullsized":"2024-09-13T18:36:43.527293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538949+0000","last_change":"2024-09-13T18:36:43.538739+0000","last_active":"2024-09-13T18:36:43.538949+0000","last_peered":"2024-09-13T18:36:43.538949+0000","last_clean":"2024-09-13T18:36:43.538949+0000","last_became_active":"2024-09-13T18:36:43.538227+0000","last_became_peered":"2024-09-13T18:36:43.538227+0000","last_unstale":"2024-09-13T18:36:43.538949+0000","last_undegraded":"2024-09-13T18:36:43.538949+0000","last_fullsized":"2024-09-13T18:36:43.538949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.417931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533624+0000","last_change":"2024-09-13T18:36:43.533624+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533624+0000","last_undegraded":"2024-09-13T18:36:43.533624+0000","last_fullsized":"2024-09-13T18:36:43.533624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:11.267928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536626+0000","last_change":"2024-09-13T18:36:43.536535+0000","last_active":"2024-09-13T18:36:43.536626+0000","last_peered":"2024-09-13T18:36:43.536626+0000","last_clean":"2024-09-13T18:36:43.536626+0000","last_became_active":"2024-09-13T18:36:43.536286+0000","last_became_peered":"2024-09-13T18:36:43.536286+0000","last_unstale":"2024-09-13T18:36:43.536626+0000","last_undegraded":"2024-09-13T18:36:43.536626+0000","last_fullsized":"2024-09-13T18:36:43.536626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533362+0000","last_change":"2024-09-13T18:36:43.533362+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533362+0000","last_undegraded":"2024-09-13T18:36:43.533362+0000","last_fullsized":"2024-09-13T18:36:43.533362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:34.120082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944131+0000","last_change":"2024-09-13T18:36:43.537515+0000","last_active":"2024-09-13T18:36:43.944131+0000","last_peered":"2024-09-13T18:36:43.944131+0000","last_clean":"2024-09-13T18:36:43.944131+0000","last_became_active":"2024-09-13T18:36:43.536247+0000","last_became_peered":"2024-09-13T18:36:43.536247+0000","last_unstale":"2024-09-13T18:36:43.944131+0000","last_undegraded":"2024-09-13T18:36:43.944131+0000","last_fullsized":"2024-09-13T18:36:43.944131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.976877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532549+0000","last_change":"2024-09-13T18:36:43.532549+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532549+0000","last_undegraded":"2024-09-13T18:36:43.532549+0000","last_fullsized":"2024-09-13T18:36:43.532549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:18.532726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.537737+0000","last_change":"2024-09-13T18:36:43.537284+0000","last_active":"2024-09-13T18:36:43.537737+0000","last_peered":"2024-09-13T18:36:43.537737+0000","last_clean":"2024-09-13T18:36:43.537737+0000","last_became_active":"2024-09-13T18:36:43.536206+0000","last_became_peered":"2024-09-13T18:36:43.536206+0000","last_unstale":"2024-09-13T18:36:43.537737+0000","last_undegraded":"2024-09-13T18:36:43.537737+0000","last_fullsized":"2024-09-13T18:36:43.537737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530806+0000","last_change":"2024-09-13T18:36:43.530806+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530806+0000","last_undegraded":"2024-09-13T18:36:43.530806+0000","last_fullsized":"2024-09-13T18:36:43.530806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533837+0000","last_change":"2024-09-13T18:36:43.533733+0000","last_active":"2024-09-13T18:36:43.533837+0000","last_peered":"2024-09-13T18:36:43.533837+0000","last_clean":"2024-09-13T18:36:43.533837+0000","last_became_active":"2024-09-13T18:36:43.533324+0000","last_became_peered":"2024-09-13T18:36:43.533324+0000","last_unstale":"2024-09-13T18:36:43.533837+0000","last_undegraded":"2024-09-13T18:36:43.533837+0000","last_fullsized":"2024-09-13T18:36:43.533837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.535320+0000","last_change":"2024-09-13T18:36:43.535320+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.535320+0000","last_undegraded":"2024-09-13T18:36:43.535320+0000","last_fullsized":"2024-09-13T18:36:43.535320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.542371+0000","last_change":"2024-09-13T18:36:43.542171+0000","last_active":"2024-09-13T18:36:43.542371+0000","last_peered":"2024-09-13T18:36:43.542371+0000","last_clean":"2024-09-13T18:36:43.542371+0000","last_became_active":"2024-09-13T18:36:43.541912+0000","last_became_peered":"2024-09-13T18:36:43.541912+0000","last_unstale":"2024-09-13T18:36:43.542371+0000","last_undegraded":"2024-09-13T18:36:43.542371+0000","last_fullsized":"2024-09-13T18:36:43.542371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538343+0000","last_change":"2024-09-13T18:36:43.538343+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538343+0000","last_undegraded":"2024-09-13T18:36:43.538343+0000","last_fullsized":"2024-09-13T18:36:43.538343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540907+0000","last_change":"2024-09-13T18:36:43.540839+0000","last_active":"2024-09-13T18:36:43.540907+0000","last_peered":"2024-09-13T18:36:43.540907+0000","last_clean":"2024-09-13T18:36:43.540907+0000","last_became_active":"2024-09-13T18:36:43.540623+0000","last_became_peered":"2024-09-13T18:36:43.540623+0000","last_unstale":"2024-09-13T18:36:43.540907+0000","last_undegraded":"2024-09-13T18:36:43.540907+0000","last_fullsized":"2024-09-13T18:36:43.540907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533211+0000","last_change":"2024-09-13T18:36:43.533211+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533211+0000","last_undegraded":"2024-09-13T18:36:43.533211+0000","last_fullsized":"2024-09-13T18:36:43.533211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:27.491146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538093+0000","last_change":"2024-09-13T18:36:43.537818+0000","last_active":"2024-09-13T18:36:43.538093+0000","last_peered":"2024-09-13T18:36:43.538093+0000","last_clean":"2024-09-13T18:36:43.538093+0000","last_became_active":"2024-09-13T18:36:43.532556+0000","last_became_peered":"2024-09-13T18:36:43.532556+0000","last_unstale":"2024-09-13T18:36:43.538093+0000","last_undegraded":"2024-09-13T18:36:43.538093+0000","last_fullsized":"2024-09-13T18:36:43.538093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530355+0000","last_change":"2024-09-13T18:36:43.530355+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530355+0000","last_undegraded":"2024-09-13T18:36:43.530355+0000","last_fullsized":"2024-09-13T18:36:43.530355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538190+0000","last_change":"2024-09-13T18:36:43.538090+0000","last_active":"2024-09-13T18:36:43.538190+0000","last_peered":"2024-09-13T18:36:43.538190+0000","last_clean":"2024-09-13T18:36:43.538190+0000","last_became_active":"2024-09-13T18:36:43.537874+0000","last_became_peered":"2024-09-13T18:36:43.537874+0000","last_unstale":"2024-09-13T18:36:43.538190+0000","last_undegraded":"2024-09-13T18:36:43.538190+0000","last_fullsized":"2024-09-13T18:36:43.538190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:18.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:36:42.527980+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:36:42.527980+0000","last_peered":"2024-09-13T18:36:42.527980+0000","last_clean":"2024-09-13T18:36:42.527980+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:36:42.527980+0000","last_undegraded":"2024-09-13T18:36:42.527980+0000","last_fullsized":"2024-09-13T18:36:42.527980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199259316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69599999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.622},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.871},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.80500000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.876}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.90000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.31}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.77500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.316},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194596,"statfs":{"total":200000000,"available":199266673,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.62}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:36:48.094 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:48.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.278+0000 7f5107c00640 1 Processor -- start 2024-09-13T18:36:48.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.278+0000 7f5107c00640 1 -- start start 2024-09-13T18:36:48.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5107c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f51000b3f10 0x7f510015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5107c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000b2f00 con 0x7f51000b0490 2024-09-13T18:36:48.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5107c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51000b3150 con 0x7f510015dee0 2024-09-13T18:36:48.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5107c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51000b3430 con 0x7f51000b3f10 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5105c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f51000b0490 0x7f510015a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58698/0 (socket says 172.21.15.192:58698) 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f5105c00640 1 -- 172.21.15.192:0/2445480067 learned_addr learned my addr 172.21.15.192:0/2445480067 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f50ffe00640 1 --2- 172.21.15.192:0/2445480067 >> v2:172.21.15.194:3300/0 conn(0x7f51000b3f10 0x7f510015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761366086 0 0) 0x7f51000b2f00 con 0x7f51000b0490 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.280+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e4005730 con 0x7f51000b0490 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485317255 0 0) 0x7f51000b3150 con 0x7f510015dee0 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51000b2f00 con 0x7f510015dee0 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ffe00640 1 -- 172.21.15.192:0/2445480067 >> v1:172.21.15.194:6789/0 conn(0x7f510015dee0 legacy=0x7f51000afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3339987677 0 0) 0x7f50e4005730 con 0x7f51000b0490 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ffe00640 1 -- 172.21.15.192:0/2445480067 >> v1:172.21.15.192:6789/0 conn(0x7f51000b0490 legacy=0x7f510015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.281+0000 7f50ffe00640 1 -- 172.21.15.192:0/2445480067 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51000b3710 con 0x7f51000b3f10 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.282+0000 7f50ffe00640 1 --2- 172.21.15.192:0/2445480067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51000b3f10 0x7f510015a440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0097a0 tx=0x7f50ec02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a854e5961a0cf3a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.282+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f80019f0 con 0x7f51000b3f10 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.282+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50ec02ac50 con 0x7f51000b3f10 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.282+0000 7f50ff400640 1 -- 172.21.15.192:0/2445480067 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ec032440 con 0x7f51000b3f10 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.282+0000 7f5107c00640 1 -- 172.21.15.192:0/2445480067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51000b3f10 msgr2=0x7f510015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 --2- 172.21.15.192:0/2445480067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51000b3f10 0x7f510015a440 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0097a0 tx=0x7f50ec02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 -- 172.21.15.192:0/2445480067 shutdown_connections 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 --2- 172.21.15.192:0/2445480067 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f51000b3f10 0x7f510015a440 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 -- 172.21.15.192:0/2445480067 >> 172.21.15.192:0/2445480067 conn(0x7f51000ae960 msgr2=0x7f510006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 -- 172.21.15.192:0/2445480067 shutdown_connections 2024-09-13T18:36:48.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.283+0000 7f5107c00640 1 -- 172.21.15.192:0/2445480067 wait complete. 2024-09-13T18:36:48.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.284+0000 7f5107c00640 1 Processor -- start 2024-09-13T18:36:48.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.284+0000 7f5107c00640 1 -- start start 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51000b0490 0x7f51001376f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510015dee0 0x7f510006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100070780 con 0x7f51001408a0 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5100137480 con 0x7f510015dee0 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.285+0000 7f5107c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510006fee0 con 0x7f51000b0490 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37008/0 (socket says 172.21.15.192:37008) 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 -- 172.21.15.192:0/887843864 learned_addr learned my addr 172.21.15.192:0/887843864 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:48.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105200640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51000b0490 0x7f51001376f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f50ffe00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510015dee0 0x7f510006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 -- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51000b0490 msgr2=0x7f51001376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51000b0490 0x7f51001376f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 -- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510015dee0 msgr2=0x7f510006f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510015dee0 0x7f510006f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 -- 172.21.15.192:0/887843864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009400 con 0x7f51001408a0 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.286+0000 7f5105c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001fc0 tx=0x7f50f800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.287+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8012400 con 0x7f51001408a0 2024-09-13T18:36:48.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.287+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f8012560 con 0x7f51001408a0 2024-09-13T18:36:48.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.287+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51000701c0 con 0x7f51001408a0 2024-09-13T18:36:48.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.287+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8012910 con 0x7f51001408a0 2024-09-13T18:36:48.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.287+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100070ab0 con 0x7f51001408a0 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.288+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100159170 con 0x7f51001408a0 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.289+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50f8007070 con 0x7f51001408a0 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.290+0000 7f50fcc00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 0x7f50e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.290+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50f80894b0 con 0x7f51001408a0 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.290+0000 7f5105200640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 0x7f50e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.291+0000 7f5105200640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 0x7f50e006d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50f00011e0 tx=0x7f50f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.294+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50f8054730 con 0x7f51001408a0 2024-09-13T18:36:48.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.458+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51000afd80 con 0x7f50e006ac00 2024-09-13T18:36:48.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.465+0000 7f50fcc00640 1 -- 172.21.15.192:0/887843864 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+282097 (secure 0 0 0) 0x7f51000afd80 con 0x7f50e006ac00 2024-09-13T18:36:48.471 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:48.472 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.468+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 msgr2=0x7f50e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.468+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 0x7f50e006d0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f50f00011e0 tx=0x7f50f0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 msgr2=0x7f510006b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001fc0 tx=0x7f50f800a430 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 shutdown_connections 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f50e006ac00 0x7f50e006d0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f51001408a0 0x7f510006b670 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f510015dee0 0x7f510006f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 --2- 172.21.15.192:0/887843864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f51000b0490 0x7f51001376f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 >> 172.21.15.192:0/887843864 conn(0x7f51000ae960 msgr2=0x7f51000b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 shutdown_connections 2024-09-13T18:36:48.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.469+0000 7f5107c00640 1 -- 172.21.15.192:0/887843864 wait complete. 2024-09-13T18:36:48.488 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-09-13T18:36:46.747293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":160,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2240,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560259,"statfs":{"total":1600000000,"available":1597705885,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225893"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.528067+0000","last_change":"2024-09-13T18:36:43.528067+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.528067+0000","last_undegraded":"2024-09-13T18:36:43.528067+0000","last_fullsized":"2024-09-13T18:36:43.528067+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952115+0000","last_change":"2024-09-13T18:36:43.951551+0000","last_active":"2024-09-13T18:36:43.952115+0000","last_peered":"2024-09-13T18:36:43.952115+0000","last_clean":"2024-09-13T18:36:43.952115+0000","last_became_active":"2024-09-13T18:36:43.951076+0000","last_became_peered":"2024-09-13T18:36:43.951076+0000","last_unstale":"2024-09-13T18:36:43.952115+0000","last_undegraded":"2024-09-13T18:36:43.952115+0000","last_fullsized":"2024-09-13T18:36:43.952115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529777+0000","last_change":"2024-09-13T18:36:43.529777+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529777+0000","last_undegraded":"2024-09-13T18:36:43.529777+0000","last_fullsized":"2024-09-13T18:36:43.529777+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:07.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.540129+0000","last_change":"2024-09-13T18:36:43.540129+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.540129+0000","last_undegraded":"2024-09-13T18:36:43.540129+0000","last_fullsized":"2024-09-13T18:36:43.540129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:46.448234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952129+0000","last_change":"2024-09-13T18:36:43.951863+0000","last_active":"2024-09-13T18:36:43.952129+0000","last_peered":"2024-09-13T18:36:43.952129+0000","last_clean":"2024-09-13T18:36:43.952129+0000","last_became_active":"2024-09-13T18:36:43.951639+0000","last_became_peered":"2024-09-13T18:36:43.951639+0000","last_unstale":"2024-09-13T18:36:43.952129+0000","last_undegraded":"2024-09-13T18:36:43.952129+0000","last_fullsized":"2024-09-13T18:36:43.952129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538403+0000","last_change":"2024-09-13T18:36:43.538403+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538403+0000","last_undegraded":"2024-09-13T18:36:43.538403+0000","last_fullsized":"2024-09-13T18:36:43.538403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527719+0000","last_change":"2024-09-13T18:36:43.527719+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527719+0000","last_undegraded":"2024-09-13T18:36:43.527719+0000","last_fullsized":"2024-09-13T18:36:43.527719+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527685+0000","last_change":"2024-09-13T18:36:43.527685+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527685+0000","last_undegraded":"2024-09-13T18:36:43.527685+0000","last_fullsized":"2024-09-13T18:36:43.527685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529413+0000","last_change":"2024-09-13T18:36:43.529413+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529413+0000","last_undegraded":"2024-09-13T18:36:43.529413+0000","last_fullsized":"2024-09-13T18:36:43.529413+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:03.105215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537489+0000","last_change":"2024-09-13T18:36:43.537489+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537489+0000","last_undegraded":"2024-09-13T18:36:43.537489+0000","last_fullsized":"2024-09-13T18:36:43.537489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:30.619118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534180+0000","last_change":"2024-09-13T18:36:43.534180+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534180+0000","last_undegraded":"2024-09-13T18:36:43.534180+0000","last_fullsized":"2024-09-13T18:36:43.534180+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:39.254899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529578+0000","last_change":"2024-09-13T18:36:43.529578+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529578+0000","last_undegraded":"2024-09-13T18:36:43.529578+0000","last_fullsized":"2024-09-13T18:36:43.529578+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531393+0000","last_change":"2024-09-13T18:36:43.531393+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531393+0000","last_undegraded":"2024-09-13T18:36:43.531393+0000","last_fullsized":"2024-09-13T18:36:43.531393+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.539761+0000","last_change":"2024-09-13T18:36:43.539761+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.539761+0000","last_undegraded":"2024-09-13T18:36:43.539761+0000","last_fullsized":"2024-09-13T18:36:43.539761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531685+0000","last_change":"2024-09-13T18:36:43.531685+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531685+0000","last_undegraded":"2024-09-13T18:36:43.531685+0000","last_fullsized":"2024-09-13T18:36:43.531685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531383+0000","last_change":"2024-09-13T18:36:43.531383+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531383+0000","last_undegraded":"2024-09-13T18:36:43.531383+0000","last_fullsized":"2024-09-13T18:36:43.531383+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534377+0000","last_change":"2024-09-13T18:36:43.534377+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534377+0000","last_undegraded":"2024-09-13T18:36:43.534377+0000","last_fullsized":"2024-09-13T18:36:43.534377+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.345426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533955+0000","last_change":"2024-09-13T18:36:43.533955+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533955+0000","last_undegraded":"2024-09-13T18:36:43.533955+0000","last_fullsized":"2024-09-13T18:36:43.533955+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533221+0000","last_change":"2024-09-13T18:36:43.533221+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533221+0000","last_undegraded":"2024-09-13T18:36:43.533221+0000","last_fullsized":"2024-09-13T18:36:43.533221+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530485+0000","last_change":"2024-09-13T18:36:43.530485+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530485+0000","last_undegraded":"2024-09-13T18:36:43.530485+0000","last_fullsized":"2024-09-13T18:36:43.530485+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:11.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530259+0000","last_change":"2024-09-13T18:36:43.530259+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530259+0000","last_undegraded":"2024-09-13T18:36:43.530259+0000","last_fullsized":"2024-09-13T18:36:43.530259+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527130+0000","last_change":"2024-09-13T18:36:43.527130+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527130+0000","last_undegraded":"2024-09-13T18:36:43.527130+0000","last_fullsized":"2024-09-13T18:36:43.527130+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529504+0000","last_change":"2024-09-13T18:36:43.529504+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529504+0000","last_undegraded":"2024-09-13T18:36:43.529504+0000","last_fullsized":"2024-09-13T18:36:43.529504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527291+0000","last_change":"2024-09-13T18:36:43.527291+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527291+0000","last_undegraded":"2024-09-13T18:36:43.527291+0000","last_fullsized":"2024-09-13T18:36:43.527291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537172+0000","last_change":"2024-09-13T18:36:43.537172+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537172+0000","last_undegraded":"2024-09-13T18:36:43.537172+0000","last_fullsized":"2024-09-13T18:36:43.537172+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538263+0000","last_change":"2024-09-13T18:36:43.538263+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538263+0000","last_undegraded":"2024-09-13T18:36:43.538263+0000","last_fullsized":"2024-09-13T18:36:43.538263+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952098+0000","last_change":"2024-09-13T18:36:43.951370+0000","last_active":"2024-09-13T18:36:43.952098+0000","last_peered":"2024-09-13T18:36:43.952098+0000","last_clean":"2024-09-13T18:36:43.952098+0000","last_became_active":"2024-09-13T18:36:43.950676+0000","last_became_peered":"2024-09-13T18:36:43.950676+0000","last_unstale":"2024-09-13T18:36:43.952098+0000","last_undegraded":"2024-09-13T18:36:43.952098+0000","last_fullsized":"2024-09-13T18:36:43.952098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527298+0000","last_change":"2024-09-13T18:36:43.527298+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527298+0000","last_undegraded":"2024-09-13T18:36:43.527298+0000","last_fullsized":"2024-09-13T18:36:43.527298+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529780+0000","last_change":"2024-09-13T18:36:43.529780+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529780+0000","last_undegraded":"2024-09-13T18:36:43.529780+0000","last_fullsized":"2024-09-13T18:36:43.529780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.531345+0000","last_change":"2024-09-13T18:36:43.531345+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.531345+0000","last_undegraded":"2024-09-13T18:36:43.531345+0000","last_fullsized":"2024-09-13T18:36:43.531345+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526932+0000","last_change":"2024-09-13T18:36:43.526932+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526932+0000","last_undegraded":"2024-09-13T18:36:43.526932+0000","last_fullsized":"2024-09-13T18:36:43.526932+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534040+0000","last_change":"2024-09-13T18:36:43.534040+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534040+0000","last_undegraded":"2024-09-13T18:36:43.534040+0000","last_fullsized":"2024-09-13T18:36:43.534040+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:45.408169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532137+0000","last_change":"2024-09-13T18:36:43.532137+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532137+0000","last_undegraded":"2024-09-13T18:36:43.532137+0000","last_fullsized":"2024-09-13T18:36:43.532137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.542076+0000","last_change":"2024-09-13T18:36:43.542006+0000","last_active":"2024-09-13T18:36:43.542076+0000","last_peered":"2024-09-13T18:36:43.542076+0000","last_clean":"2024-09-13T18:36:43.542076+0000","last_became_active":"2024-09-13T18:36:43.541236+0000","last_became_peered":"2024-09-13T18:36:43.541236+0000","last_unstale":"2024-09-13T18:36:43.542076+0000","last_undegraded":"2024-09-13T18:36:43.542076+0000","last_fullsized":"2024-09-13T18:36:43.542076+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:53.065027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526964+0000","last_change":"2024-09-13T18:36:43.526964+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526964+0000","last_undegraded":"2024-09-13T18:36:43.526964+0000","last_fullsized":"2024-09-13T18:36:43.526964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538112+0000","last_change":"2024-09-13T18:36:43.538000+0000","last_active":"2024-09-13T18:36:43.538112+0000","last_peered":"2024-09-13T18:36:43.538112+0000","last_clean":"2024-09-13T18:36:43.538112+0000","last_became_active":"2024-09-13T18:36:43.532918+0000","last_became_peered":"2024-09-13T18:36:43.532918+0000","last_unstale":"2024-09-13T18:36:43.538112+0000","last_undegraded":"2024-09-13T18:36:43.538112+0000","last_fullsized":"2024-09-13T18:36:43.538112+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:35.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526481+0000","last_change":"2024-09-13T18:36:43.526481+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526481+0000","last_undegraded":"2024-09-13T18:36:43.526481+0000","last_fullsized":"2024-09-13T18:36:43.526481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535763+0000","last_change":"2024-09-13T18:36:43.535124+0000","last_active":"2024-09-13T18:36:43.535763+0000","last_peered":"2024-09-13T18:36:43.535763+0000","last_clean":"2024-09-13T18:36:43.535763+0000","last_became_active":"2024-09-13T18:36:43.534854+0000","last_became_peered":"2024-09-13T18:36:43.534854+0000","last_unstale":"2024-09-13T18:36:43.535763+0000","last_undegraded":"2024-09-13T18:36:43.535763+0000","last_fullsized":"2024-09-13T18:36:43.535763+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:51.263603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.536840+0000","last_change":"2024-09-13T18:36:43.536840+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.536840+0000","last_undegraded":"2024-09-13T18:36:43.536840+0000","last_fullsized":"2024-09-13T18:36:43.536840+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533794+0000","last_change":"2024-09-13T18:36:43.533688+0000","last_active":"2024-09-13T18:36:43.533794+0000","last_peered":"2024-09-13T18:36:43.533794+0000","last_clean":"2024-09-13T18:36:43.533794+0000","last_became_active":"2024-09-13T18:36:43.533428+0000","last_became_peered":"2024-09-13T18:36:43.533428+0000","last_unstale":"2024-09-13T18:36:43.533794+0000","last_undegraded":"2024-09-13T18:36:43.533794+0000","last_fullsized":"2024-09-13T18:36:43.533794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:17.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529379+0000","last_change":"2024-09-13T18:36:43.529379+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529379+0000","last_undegraded":"2024-09-13T18:36:43.529379+0000","last_fullsized":"2024-09-13T18:36:43.529379+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:37.492595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536644+0000","last_change":"2024-09-13T18:36:43.536543+0000","last_active":"2024-09-13T18:36:43.536644+0000","last_peered":"2024-09-13T18:36:43.536644+0000","last_clean":"2024-09-13T18:36:43.536644+0000","last_became_active":"2024-09-13T18:36:43.536207+0000","last_became_peered":"2024-09-13T18:36:43.536207+0000","last_unstale":"2024-09-13T18:36:43.536644+0000","last_undegraded":"2024-09-13T18:36:43.536644+0000","last_fullsized":"2024-09-13T18:36:43.536644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526458+0000","last_change":"2024-09-13T18:36:43.526458+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526458+0000","last_undegraded":"2024-09-13T18:36:43.526458+0000","last_fullsized":"2024-09-13T18:36:43.526458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536905+0000","last_change":"2024-09-13T18:36:43.536837+0000","last_active":"2024-09-13T18:36:43.536905+0000","last_peered":"2024-09-13T18:36:43.536905+0000","last_clean":"2024-09-13T18:36:43.536905+0000","last_became_active":"2024-09-13T18:36:43.536577+0000","last_became_peered":"2024-09-13T18:36:43.536577+0000","last_unstale":"2024-09-13T18:36:43.536905+0000","last_undegraded":"2024-09-13T18:36:43.536905+0000","last_fullsized":"2024-09-13T18:36:43.536905+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527660+0000","last_change":"2024-09-13T18:36:43.527660+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527660+0000","last_undegraded":"2024-09-13T18:36:43.527660+0000","last_fullsized":"2024-09-13T18:36:43.527660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.534578+0000","last_change":"2024-09-13T18:36:43.534506+0000","last_active":"2024-09-13T18:36:43.534578+0000","last_peered":"2024-09-13T18:36:43.534578+0000","last_clean":"2024-09-13T18:36:43.534578+0000","last_became_active":"2024-09-13T18:36:43.534228+0000","last_became_peered":"2024-09-13T18:36:43.534228+0000","last_unstale":"2024-09-13T18:36:43.534578+0000","last_undegraded":"2024-09-13T18:36:43.534578+0000","last_fullsized":"2024-09-13T18:36:43.534578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:12.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.539137+0000","last_change":"2024-09-13T18:36:43.539137+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.539137+0000","last_undegraded":"2024-09-13T18:36:43.539137+0000","last_fullsized":"2024-09-13T18:36:43.539137+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.528484+0000","last_change":"2024-09-13T18:36:43.528414+0000","last_active":"2024-09-13T18:36:43.528484+0000","last_peered":"2024-09-13T18:36:43.528484+0000","last_clean":"2024-09-13T18:36:43.528484+0000","last_became_active":"2024-09-13T18:36:43.528200+0000","last_became_peered":"2024-09-13T18:36:43.528200+0000","last_unstale":"2024-09-13T18:36:43.528484+0000","last_undegraded":"2024-09-13T18:36:43.528484+0000","last_fullsized":"2024-09-13T18:36:43.528484+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532972+0000","last_change":"2024-09-13T18:36:43.532972+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532972+0000","last_undegraded":"2024-09-13T18:36:43.532972+0000","last_fullsized":"2024-09-13T18:36:43.532972+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.564846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.943637+0000","last_change":"2024-09-13T18:36:43.537908+0000","last_active":"2024-09-13T18:36:43.943637+0000","last_peered":"2024-09-13T18:36:43.943637+0000","last_clean":"2024-09-13T18:36:43.943637+0000","last_became_active":"2024-09-13T18:36:43.537692+0000","last_became_peered":"2024-09-13T18:36:43.537692+0000","last_unstale":"2024-09-13T18:36:43.943637+0000","last_undegraded":"2024-09-13T18:36:43.943637+0000","last_fullsized":"2024-09-13T18:36:43.943637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:46.060408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537895+0000","last_change":"2024-09-13T18:36:43.537895+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537895+0000","last_undegraded":"2024-09-13T18:36:43.537895+0000","last_fullsized":"2024-09-13T18:36:43.537895+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944365+0000","last_change":"2024-09-13T18:36:43.538915+0000","last_active":"2024-09-13T18:36:43.944365+0000","last_peered":"2024-09-13T18:36:43.944365+0000","last_clean":"2024-09-13T18:36:43.944365+0000","last_became_active":"2024-09-13T18:36:43.538537+0000","last_became_peered":"2024-09-13T18:36:43.538537+0000","last_unstale":"2024-09-13T18:36:43.944365+0000","last_undegraded":"2024-09-13T18:36:43.944365+0000","last_fullsized":"2024-09-13T18:36:43.944365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538665+0000","last_change":"2024-09-13T18:36:43.538665+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538665+0000","last_undegraded":"2024-09-13T18:36:43.538665+0000","last_fullsized":"2024-09-13T18:36:43.538665+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:25.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.541775+0000","last_change":"2024-09-13T18:36:43.541708+0000","last_active":"2024-09-13T18:36:43.541775+0000","last_peered":"2024-09-13T18:36:43.541775+0000","last_clean":"2024-09-13T18:36:43.541775+0000","last_became_active":"2024-09-13T18:36:43.538962+0000","last_became_peered":"2024-09-13T18:36:43.538962+0000","last_unstale":"2024-09-13T18:36:43.541775+0000","last_undegraded":"2024-09-13T18:36:43.541775+0000","last_fullsized":"2024-09-13T18:36:43.541775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:51.494051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.537605+0000","last_change":"2024-09-13T18:36:43.537605+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.537605+0000","last_undegraded":"2024-09-13T18:36:43.537605+0000","last_fullsized":"2024-09-13T18:36:43.537605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:54.543794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536609+0000","last_change":"2024-09-13T18:36:43.535486+0000","last_active":"2024-09-13T18:36:43.536609+0000","last_peered":"2024-09-13T18:36:43.536609+0000","last_clean":"2024-09-13T18:36:43.536609+0000","last_became_active":"2024-09-13T18:36:43.535085+0000","last_became_peered":"2024-09-13T18:36:43.535085+0000","last_unstale":"2024-09-13T18:36:43.536609+0000","last_undegraded":"2024-09-13T18:36:43.536609+0000","last_fullsized":"2024-09-13T18:36:43.536609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530009+0000","last_change":"2024-09-13T18:36:43.530009+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530009+0000","last_undegraded":"2024-09-13T18:36:43.530009+0000","last_fullsized":"2024-09-13T18:36:43.530009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:24.655907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540381+0000","last_change":"2024-09-13T18:36:43.539714+0000","last_active":"2024-09-13T18:36:43.540381+0000","last_peered":"2024-09-13T18:36:43.540381+0000","last_clean":"2024-09-13T18:36:43.540381+0000","last_became_active":"2024-09-13T18:36:43.538401+0000","last_became_peered":"2024-09-13T18:36:43.538401+0000","last_unstale":"2024-09-13T18:36:43.540381+0000","last_undegraded":"2024-09-13T18:36:43.540381+0000","last_fullsized":"2024-09-13T18:36:43.540381+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.536510+0000","last_change":"2024-09-13T18:36:43.536510+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.536510+0000","last_undegraded":"2024-09-13T18:36:43.536510+0000","last_fullsized":"2024-09-13T18:36:43.536510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.539363+0000","last_change":"2024-09-13T18:36:43.539220+0000","last_active":"2024-09-13T18:36:43.539363+0000","last_peered":"2024-09-13T18:36:43.539363+0000","last_clean":"2024-09-13T18:36:43.539363+0000","last_became_active":"2024-09-13T18:36:43.538932+0000","last_became_peered":"2024-09-13T18:36:43.538932+0000","last_unstale":"2024-09-13T18:36:43.539363+0000","last_undegraded":"2024-09-13T18:36:43.539363+0000","last_fullsized":"2024-09-13T18:36:43.539363+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.526488+0000","last_change":"2024-09-13T18:36:43.526488+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.526488+0000","last_undegraded":"2024-09-13T18:36:43.526488+0000","last_fullsized":"2024-09-13T18:36:43.526488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.534026+0000","last_change":"2024-09-13T18:36:43.533866+0000","last_active":"2024-09-13T18:36:43.534026+0000","last_peered":"2024-09-13T18:36:43.534026+0000","last_clean":"2024-09-13T18:36:43.534026+0000","last_became_active":"2024-09-13T18:36:43.533584+0000","last_became_peered":"2024-09-13T18:36:43.533584+0000","last_unstale":"2024-09-13T18:36:43.534026+0000","last_undegraded":"2024-09-13T18:36:43.534026+0000","last_fullsized":"2024-09-13T18:36:43.534026+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533699+0000","last_change":"2024-09-13T18:36:43.533699+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533699+0000","last_undegraded":"2024-09-13T18:36:43.533699+0000","last_fullsized":"2024-09-13T18:36:43.533699+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:28.437957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540479+0000","last_change":"2024-09-13T18:36:43.540398+0000","last_active":"2024-09-13T18:36:43.540479+0000","last_peered":"2024-09-13T18:36:43.540479+0000","last_clean":"2024-09-13T18:36:43.540479+0000","last_became_active":"2024-09-13T18:36:43.539926+0000","last_became_peered":"2024-09-13T18:36:43.539926+0000","last_unstale":"2024-09-13T18:36:43.540479+0000","last_undegraded":"2024-09-13T18:36:43.540479+0000","last_fullsized":"2024-09-13T18:36:43.540479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:04.042479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.534692+0000","last_change":"2024-09-13T18:36:43.534692+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.534692+0000","last_undegraded":"2024-09-13T18:36:43.534692+0000","last_fullsized":"2024-09-13T18:36:43.534692+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.386496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535810+0000","last_change":"2024-09-13T18:36:43.535513+0000","last_active":"2024-09-13T18:36:43.535810+0000","last_peered":"2024-09-13T18:36:43.535810+0000","last_clean":"2024-09-13T18:36:43.535810+0000","last_became_active":"2024-09-13T18:36:43.535276+0000","last_became_peered":"2024-09-13T18:36:43.535276+0000","last_unstale":"2024-09-13T18:36:43.535810+0000","last_undegraded":"2024-09-13T18:36:43.535810+0000","last_fullsized":"2024-09-13T18:36:43.535810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:22.809094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.528052+0000","last_change":"2024-09-13T18:36:43.528052+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.528052+0000","last_undegraded":"2024-09-13T18:36:43.528052+0000","last_fullsized":"2024-09-13T18:36:43.528052+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540347+0000","last_change":"2024-09-13T18:36:43.538605+0000","last_active":"2024-09-13T18:36:43.540347+0000","last_peered":"2024-09-13T18:36:43.540347+0000","last_clean":"2024-09-13T18:36:43.540347+0000","last_became_active":"2024-09-13T18:36:43.538075+0000","last_became_peered":"2024-09-13T18:36:43.538075+0000","last_unstale":"2024-09-13T18:36:43.540347+0000","last_undegraded":"2024-09-13T18:36:43.540347+0000","last_fullsized":"2024-09-13T18:36:43.540347+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954276+0000","last_change":"2024-09-13T18:36:43.954197+0000","last_active":"2024-09-13T18:36:43.954276+0000","last_peered":"2024-09-13T18:36:43.954276+0000","last_clean":"2024-09-13T18:36:43.954276+0000","last_became_active":"2024-09-13T18:36:43.953917+0000","last_became_peered":"2024-09-13T18:36:43.953917+0000","last_unstale":"2024-09-13T18:36:43.954276+0000","last_undegraded":"2024-09-13T18:36:43.954276+0000","last_fullsized":"2024-09-13T18:36:43.954276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.539328+0000","last_change":"2024-09-13T18:36:43.539249+0000","last_active":"2024-09-13T18:36:43.539328+0000","last_peered":"2024-09-13T18:36:43.539328+0000","last_clean":"2024-09-13T18:36:43.539328+0000","last_became_active":"2024-09-13T18:36:43.538532+0000","last_became_peered":"2024-09-13T18:36:43.538532+0000","last_unstale":"2024-09-13T18:36:43.539328+0000","last_undegraded":"2024-09-13T18:36:43.539328+0000","last_fullsized":"2024-09-13T18:36:43.539328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538091+0000","last_change":"2024-09-13T18:36:43.538091+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538091+0000","last_undegraded":"2024-09-13T18:36:43.538091+0000","last_fullsized":"2024-09-13T18:36:43.538091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:36.254852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.535422+0000","last_change":"2024-09-13T18:36:43.535052+0000","last_active":"2024-09-13T18:36:43.535422+0000","last_peered":"2024-09-13T18:36:43.535422+0000","last_clean":"2024-09-13T18:36:43.535422+0000","last_became_active":"2024-09-13T18:36:43.534607+0000","last_became_peered":"2024-09-13T18:36:43.534607+0000","last_unstale":"2024-09-13T18:36:43.535422+0000","last_undegraded":"2024-09-13T18:36:43.535422+0000","last_fullsized":"2024-09-13T18:36:43.535422+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529565+0000","last_change":"2024-09-13T18:36:43.529565+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529565+0000","last_undegraded":"2024-09-13T18:36:43.529565+0000","last_fullsized":"2024-09-13T18:36:43.529565+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:22.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961175+0000","last_change":"2024-09-13T18:36:43.532711+0000","last_active":"2024-09-13T18:36:43.961175+0000","last_peered":"2024-09-13T18:36:43.961175+0000","last_clean":"2024-09-13T18:36:43.961175+0000","last_became_active":"2024-09-13T18:36:43.532491+0000","last_became_peered":"2024-09-13T18:36:43.532491+0000","last_unstale":"2024-09-13T18:36:43.961175+0000","last_undegraded":"2024-09-13T18:36:43.961175+0000","last_fullsized":"2024-09-13T18:36:43.961175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:41.467973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947954+0000","last_change":"2024-09-13T18:36:43.947877+0000","last_active":"2024-09-13T18:36:43.947954+0000","last_peered":"2024-09-13T18:36:43.947954+0000","last_clean":"2024-09-13T18:36:43.947954+0000","last_became_active":"2024-09-13T18:36:43.947611+0000","last_became_peered":"2024-09-13T18:36:43.947611+0000","last_unstale":"2024-09-13T18:36:43.947954+0000","last_undegraded":"2024-09-13T18:36:43.947954+0000","last_fullsized":"2024-09-13T18:36:43.947954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540366+0000","last_change":"2024-09-13T18:36:43.539178+0000","last_active":"2024-09-13T18:36:43.540366+0000","last_peered":"2024-09-13T18:36:43.540366+0000","last_clean":"2024-09-13T18:36:43.540366+0000","last_became_active":"2024-09-13T18:36:43.538927+0000","last_became_peered":"2024-09-13T18:36:43.538927+0000","last_unstale":"2024-09-13T18:36:43.540366+0000","last_undegraded":"2024-09-13T18:36:43.540366+0000","last_fullsized":"2024-09-13T18:36:43.540366+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.529608+0000","last_change":"2024-09-13T18:36:43.529608+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.529608+0000","last_undegraded":"2024-09-13T18:36:43.529608+0000","last_fullsized":"2024-09-13T18:36:43.529608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533758+0000","last_change":"2024-09-13T18:36:43.533289+0000","last_active":"2024-09-13T18:36:43.533758+0000","last_peered":"2024-09-13T18:36:43.533758+0000","last_clean":"2024-09-13T18:36:43.533758+0000","last_became_active":"2024-09-13T18:36:43.532827+0000","last_became_peered":"2024-09-13T18:36:43.532827+0000","last_unstale":"2024-09-13T18:36:43.533758+0000","last_undegraded":"2024-09-13T18:36:43.533758+0000","last_fullsized":"2024-09-13T18:36:43.533758+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.380715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.527293+0000","last_change":"2024-09-13T18:36:43.527293+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.527293+0000","last_undegraded":"2024-09-13T18:36:43.527293+0000","last_fullsized":"2024-09-13T18:36:43.527293+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538949+0000","last_change":"2024-09-13T18:36:43.538739+0000","last_active":"2024-09-13T18:36:43.538949+0000","last_peered":"2024-09-13T18:36:43.538949+0000","last_clean":"2024-09-13T18:36:43.538949+0000","last_became_active":"2024-09-13T18:36:43.538227+0000","last_became_peered":"2024-09-13T18:36:43.538227+0000","last_unstale":"2024-09-13T18:36:43.538949+0000","last_undegraded":"2024-09-13T18:36:43.538949+0000","last_fullsized":"2024-09-13T18:36:43.538949+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.417931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533624+0000","last_change":"2024-09-13T18:36:43.533624+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533624+0000","last_undegraded":"2024-09-13T18:36:43.533624+0000","last_fullsized":"2024-09-13T18:36:43.533624+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:11.267928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.536626+0000","last_change":"2024-09-13T18:36:43.536535+0000","last_active":"2024-09-13T18:36:43.536626+0000","last_peered":"2024-09-13T18:36:43.536626+0000","last_clean":"2024-09-13T18:36:43.536626+0000","last_became_active":"2024-09-13T18:36:43.536286+0000","last_became_peered":"2024-09-13T18:36:43.536286+0000","last_unstale":"2024-09-13T18:36:43.536626+0000","last_undegraded":"2024-09-13T18:36:43.536626+0000","last_fullsized":"2024-09-13T18:36:43.536626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533362+0000","last_change":"2024-09-13T18:36:43.533362+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533362+0000","last_undegraded":"2024-09-13T18:36:43.533362+0000","last_fullsized":"2024-09-13T18:36:43.533362+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:34.120082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944131+0000","last_change":"2024-09-13T18:36:43.537515+0000","last_active":"2024-09-13T18:36:43.944131+0000","last_peered":"2024-09-13T18:36:43.944131+0000","last_clean":"2024-09-13T18:36:43.944131+0000","last_became_active":"2024-09-13T18:36:43.536247+0000","last_became_peered":"2024-09-13T18:36:43.536247+0000","last_unstale":"2024-09-13T18:36:43.944131+0000","last_undegraded":"2024-09-13T18:36:43.944131+0000","last_fullsized":"2024-09-13T18:36:43.944131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.976877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.532549+0000","last_change":"2024-09-13T18:36:43.532549+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.532549+0000","last_undegraded":"2024-09-13T18:36:43.532549+0000","last_fullsized":"2024-09-13T18:36:43.532549+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:18.532726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.537737+0000","last_change":"2024-09-13T18:36:43.537284+0000","last_active":"2024-09-13T18:36:43.537737+0000","last_peered":"2024-09-13T18:36:43.537737+0000","last_clean":"2024-09-13T18:36:43.537737+0000","last_became_active":"2024-09-13T18:36:43.536206+0000","last_became_peered":"2024-09-13T18:36:43.536206+0000","last_unstale":"2024-09-13T18:36:43.537737+0000","last_undegraded":"2024-09-13T18:36:43.537737+0000","last_fullsized":"2024-09-13T18:36:43.537737+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530806+0000","last_change":"2024-09-13T18:36:43.530806+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530806+0000","last_undegraded":"2024-09-13T18:36:43.530806+0000","last_fullsized":"2024-09-13T18:36:43.530806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.533837+0000","last_change":"2024-09-13T18:36:43.533733+0000","last_active":"2024-09-13T18:36:43.533837+0000","last_peered":"2024-09-13T18:36:43.533837+0000","last_clean":"2024-09-13T18:36:43.533837+0000","last_became_active":"2024-09-13T18:36:43.533324+0000","last_became_peered":"2024-09-13T18:36:43.533324+0000","last_unstale":"2024-09-13T18:36:43.533837+0000","last_undegraded":"2024-09-13T18:36:43.533837+0000","last_fullsized":"2024-09-13T18:36:43.533837+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.535320+0000","last_change":"2024-09-13T18:36:43.535320+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.535320+0000","last_undegraded":"2024-09-13T18:36:43.535320+0000","last_fullsized":"2024-09-13T18:36:43.535320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.542371+0000","last_change":"2024-09-13T18:36:43.542171+0000","last_active":"2024-09-13T18:36:43.542371+0000","last_peered":"2024-09-13T18:36:43.542371+0000","last_clean":"2024-09-13T18:36:43.542371+0000","last_became_active":"2024-09-13T18:36:43.541912+0000","last_became_peered":"2024-09-13T18:36:43.541912+0000","last_unstale":"2024-09-13T18:36:43.542371+0000","last_undegraded":"2024-09-13T18:36:43.542371+0000","last_fullsized":"2024-09-13T18:36:43.542371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.538343+0000","last_change":"2024-09-13T18:36:43.538343+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.538343+0000","last_undegraded":"2024-09-13T18:36:43.538343+0000","last_fullsized":"2024-09-13T18:36:43.538343+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.540907+0000","last_change":"2024-09-13T18:36:43.540839+0000","last_active":"2024-09-13T18:36:43.540907+0000","last_peered":"2024-09-13T18:36:43.540907+0000","last_clean":"2024-09-13T18:36:43.540907+0000","last_became_active":"2024-09-13T18:36:43.540623+0000","last_became_peered":"2024-09-13T18:36:43.540623+0000","last_unstale":"2024-09-13T18:36:43.540907+0000","last_undegraded":"2024-09-13T18:36:43.540907+0000","last_fullsized":"2024-09-13T18:36:43.540907+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.533211+0000","last_change":"2024-09-13T18:36:43.533211+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.533211+0000","last_undegraded":"2024-09-13T18:36:43.533211+0000","last_fullsized":"2024-09-13T18:36:43.533211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:27.491146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538093+0000","last_change":"2024-09-13T18:36:43.537818+0000","last_active":"2024-09-13T18:36:43.538093+0000","last_peered":"2024-09-13T18:36:43.538093+0000","last_clean":"2024-09-13T18:36:43.538093+0000","last_became_active":"2024-09-13T18:36:43.532556+0000","last_became_peered":"2024-09-13T18:36:43.532556+0000","last_unstale":"2024-09-13T18:36:43.538093+0000","last_undegraded":"2024-09-13T18:36:43.538093+0000","last_fullsized":"2024-09-13T18:36:43.538093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-09-13T18:36:43.530355+0000","last_change":"2024-09-13T18:36:43.530355+0000","last_active":"2024-09-13T18:36:43.520556+0000","last_peered":"2024-09-13T18:36:43.520556+0000","last_clean":"2024-09-13T18:36:43.520556+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:36:43.530355+0000","last_undegraded":"2024-09-13T18:36:43.530355+0000","last_fullsized":"2024-09-13T18:36:43.530355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.538190+0000","last_change":"2024-09-13T18:36:43.538090+0000","last_active":"2024-09-13T18:36:43.538190+0000","last_peered":"2024-09-13T18:36:43.538190+0000","last_clean":"2024-09-13T18:36:43.538190+0000","last_became_active":"2024-09-13T18:36:43.537874+0000","last_became_peered":"2024-09-13T18:36:43.537874+0000","last_unstale":"2024-09-13T18:36:43.538190+0000","last_undegraded":"2024-09-13T18:36:43.538190+0000","last_fullsized":"2024-09-13T18:36:43.538190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:18.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":176,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-09-13T18:36:42.527980+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:36:42.527980+0000","last_peered":"2024-09-13T18:36:42.527980+0000","last_clean":"2024-09-13T18:36:42.527980+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:36:42.527980+0000","last_undegraded":"2024-09-13T18:36:42.527980+0000","last_fullsized":"2024-09-13T18:36:42.527980+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199259316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69599999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.622},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.58499999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66300000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.80700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.85199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.871},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.80500000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.91400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.88900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78500000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.57799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72599999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.83299999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.66200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.628}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.91200000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.876}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.90000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.31}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.44900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.38600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67300000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.623}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.77500000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.316},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":716,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194596,"statfs":{"total":200000000,"available":199266673,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.39200000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.47099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.54800000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70199999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.71299999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":133,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195179,"statfs":{"total":200000000,"available":199863316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.54100000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.39900000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.62}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.65600000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.68600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:36:48.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:48.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.679+0000 7f9570400640 1 Processor -- start 2024-09-13T18:36:48.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.679+0000 7f9570400640 1 -- start start 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f9570400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95680b3f10 0x7f956815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f9570400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680b2f00 con 0x7f956815dee0 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f9570400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680b3150 con 0x7f95680b0490 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f9570400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680b3430 con 0x7f95680b3f10 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f956da00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f956815dee0 0x7f95680afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58702/0 (socket says 172.21.15.192:58702) 2024-09-13T18:36:48.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.680+0000 7f956da00640 1 -- 172.21.15.192:0/2052420170 learned_addr learned my addr 172.21.15.192:0/2052420170 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f956d000640 1 --2- 172.21.15.192:0/2052420170 >> v2:172.21.15.194:3300/0 conn(0x7f95680b3f10 0x7f956815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f9567e00640 1 -- 172.21.15.192:0/2052420170 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008171956 0 0) 0x7f95680b2f00 con 0x7f956815dee0 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f9567e00640 1 -- 172.21.15.192:0/2052420170 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9550005730 con 0x7f956815dee0 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f956d000640 1 -- 172.21.15.192:0/2052420170 >> v1:172.21.15.194:6789/0 conn(0x7f95680b0490 legacy=0x7f956815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f956d000640 1 -- 172.21.15.192:0/2052420170 >> v1:172.21.15.192:6789/0 conn(0x7f956815dee0 legacy=0x7f95680afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.681+0000 7f956d000640 1 -- 172.21.15.192:0/2052420170 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680b3710 con 0x7f95680b3f10 2024-09-13T18:36:48.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.682+0000 7f956d000640 1 --2- 172.21.15.192:0/2052420170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95680b3f10 0x7f956815a440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fa5ad786da93072 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9567e00640 1 -- 172.21.15.192:0/2052420170 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554032440 con 0x7f95680b3f10 2024-09-13T18:36:48.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9567e00640 1 -- 172.21.15.192:0/2052420170 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95540325a0 con 0x7f95680b3f10 2024-09-13T18:36:48.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9567e00640 1 -- 172.21.15.192:0/2052420170 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9554032930 con 0x7f95680b3f10 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 -- 172.21.15.192:0/2052420170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95680b3f10 msgr2=0x7f956815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 --2- 172.21.15.192:0/2052420170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95680b3f10 0x7f956815a440 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95540097a0 tx=0x7f955402a230 comp rx=0 tx=0).stop 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 -- 172.21.15.192:0/2052420170 shutdown_connections 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 --2- 172.21.15.192:0/2052420170 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95680b3f10 0x7f956815a440 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 -- 172.21.15.192:0/2052420170 >> 172.21.15.192:0/2052420170 conn(0x7f95680ae960 msgr2=0x7f956806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 -- 172.21.15.192:0/2052420170 shutdown_connections 2024-09-13T18:36:48.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.683+0000 7f9570400640 1 -- 172.21.15.192:0/2052420170 wait complete. 2024-09-13T18:36:48.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.685+0000 7f9570400640 1 Processor -- start 2024-09-13T18:36:48.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.685+0000 7f9570400640 1 -- start start 2024-09-13T18:36:48.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95680b0490 0x7f956813dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f956815dee0 0x7f9568140f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956813f300 con 0x7f9568140200 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956813f720 con 0x7f956815dee0 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f9570400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956813e3e0 con 0x7f95680b0490 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f956e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f956e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37014/0 (socket says 172.21.15.192:37014) 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.686+0000 7f956e400640 1 -- 172.21.15.192:0/1166508003 learned_addr learned my addr 172.21.15.192:0/1166508003 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956d000640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f956815dee0 0x7f9568140f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956da00640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95680b0490 0x7f956813dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 -- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95680b0490 msgr2=0x7f956813dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95680b0490 0x7f956813dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 -- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f956815dee0 msgr2=0x7f9568140f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f956815dee0 0x7f9568140f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 -- 172.21.15.192:0/1166508003 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9554009400 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f956e400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f956000c7a0 tx=0x7f956000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560003b70 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9560003cf0 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560003ea0 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956813e680 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.687+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f956813ec40 con 0x7f9568140200 2024-09-13T18:36:48.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.689+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956813f440 con 0x7f9568140200 2024-09-13T18:36:48.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.689+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f956000aa90 con 0x7f9568140200 2024-09-13T18:36:48.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.690+0000 7f9565600640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 0x7f954806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:48.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.690+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9560089210 con 0x7f9568140200 2024-09-13T18:36:48.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.691+0000 7f956da00640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 0x7f954806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:48.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.691+0000 7f956da00640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 0x7f954806d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f955c0011e0 tx=0x7f955c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:48.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.694+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f956813f440 con 0x7f9568140200 2024-09-13T18:36:48.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.861+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f956813f440 con 0x7f954806ac00 2024-09-13T18:36:48.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.868+0000 7f9565600640 1 -- 172.21.15.192:0/1166508003 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284764 (secure 0 0 0) 0x7f956813f440 con 0x7f954806ac00 2024-09-13T18:36:48.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:48.877 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:36:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 msgr2=0x7f954806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 0x7f954806d0c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f955c0011e0 tx=0x7f955c009040 comp rx=0 tx=0).stop 2024-09-13T18:36:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 msgr2=0x7f9568142930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f956000c7a0 tx=0x7f956000cc60 comp rx=0 tx=0).stop 2024-09-13T18:36:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 shutdown_connections 2024-09-13T18:36:48.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f954806ac00 0x7f954806d0c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9568140200 0x7f9568142930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f956815dee0 0x7f9568140f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 --2- 172.21.15.192:0/1166508003 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95680b0490 0x7f956813dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 >> 172.21.15.192:0/1166508003 conn(0x7f95680ae960 msgr2=0x7f956806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 shutdown_connections 2024-09-13T18:36:48.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:48.872+0000 7f9570400640 1 -- 172.21.15.192:0/1166508003 wait complete. 2024-09-13T18:36:48.891 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-13T18:36:48.747680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2370,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560129,"statfs":{"total":1600000000,"available":1597572568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001011"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964510+0000","last_change":"2024-09-13T18:36:43.963722+0000","last_active":"2024-09-13T18:36:43.964510+0000","last_peered":"2024-09-13T18:36:43.964510+0000","last_clean":"2024-09-13T18:36:43.964510+0000","last_became_active":"2024-09-13T18:36:43.963342+0000","last_became_peered":"2024-09-13T18:36:43.963342+0000","last_unstale":"2024-09-13T18:36:43.964510+0000","last_undegraded":"2024-09-13T18:36:43.964510+0000","last_fullsized":"2024-09-13T18:36:43.964510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952115+0000","last_change":"2024-09-13T18:36:43.951551+0000","last_active":"2024-09-13T18:36:43.952115+0000","last_peered":"2024-09-13T18:36:43.952115+0000","last_clean":"2024-09-13T18:36:43.952115+0000","last_became_active":"2024-09-13T18:36:43.951076+0000","last_became_peered":"2024-09-13T18:36:43.951076+0000","last_unstale":"2024-09-13T18:36:43.952115+0000","last_undegraded":"2024-09-13T18:36:43.952115+0000","last_fullsized":"2024-09-13T18:36:43.952115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960027+0000","last_change":"2024-09-13T18:36:43.959962+0000","last_active":"2024-09-13T18:36:43.960027+0000","last_peered":"2024-09-13T18:36:43.960027+0000","last_clean":"2024-09-13T18:36:43.960027+0000","last_became_active":"2024-09-13T18:36:43.959731+0000","last_became_peered":"2024-09-13T18:36:43.959731+0000","last_unstale":"2024-09-13T18:36:43.960027+0000","last_undegraded":"2024-09-13T18:36:43.960027+0000","last_fullsized":"2024-09-13T18:36:43.960027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:07.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960528+0000","last_change":"2024-09-13T18:36:43.959182+0000","last_active":"2024-09-13T18:36:43.960528+0000","last_peered":"2024-09-13T18:36:43.960528+0000","last_clean":"2024-09-13T18:36:43.960528+0000","last_became_active":"2024-09-13T18:36:43.958131+0000","last_became_peered":"2024-09-13T18:36:43.958131+0000","last_unstale":"2024-09-13T18:36:43.960528+0000","last_undegraded":"2024-09-13T18:36:43.960528+0000","last_fullsized":"2024-09-13T18:36:43.960528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:46.448234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952129+0000","last_change":"2024-09-13T18:36:43.951863+0000","last_active":"2024-09-13T18:36:43.952129+0000","last_peered":"2024-09-13T18:36:43.952129+0000","last_clean":"2024-09-13T18:36:43.952129+0000","last_became_active":"2024-09-13T18:36:43.951639+0000","last_became_peered":"2024-09-13T18:36:43.951639+0000","last_unstale":"2024-09-13T18:36:43.952129+0000","last_undegraded":"2024-09-13T18:36:43.952129+0000","last_fullsized":"2024-09-13T18:36:43.952129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963366+0000","last_change":"2024-09-13T18:36:43.962483+0000","last_active":"2024-09-13T18:36:43.963366+0000","last_peered":"2024-09-13T18:36:43.963366+0000","last_clean":"2024-09-13T18:36:43.963366+0000","last_became_active":"2024-09-13T18:36:43.962267+0000","last_became_peered":"2024-09-13T18:36:43.962267+0000","last_unstale":"2024-09-13T18:36:43.963366+0000","last_undegraded":"2024-09-13T18:36:43.963366+0000","last_fullsized":"2024-09-13T18:36:43.963366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960634+0000","last_change":"2024-09-13T18:36:43.960564+0000","last_active":"2024-09-13T18:36:43.960634+0000","last_peered":"2024-09-13T18:36:43.960634+0000","last_clean":"2024-09-13T18:36:43.960634+0000","last_became_active":"2024-09-13T18:36:43.960366+0000","last_became_peered":"2024-09-13T18:36:43.960366+0000","last_unstale":"2024-09-13T18:36:43.960634+0000","last_undegraded":"2024-09-13T18:36:43.960634+0000","last_fullsized":"2024-09-13T18:36:43.960634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965761+0000","last_change":"2024-09-13T18:36:43.965465+0000","last_active":"2024-09-13T18:36:43.965761+0000","last_peered":"2024-09-13T18:36:43.965761+0000","last_clean":"2024-09-13T18:36:43.965761+0000","last_became_active":"2024-09-13T18:36:43.965118+0000","last_became_peered":"2024-09-13T18:36:43.965118+0000","last_unstale":"2024-09-13T18:36:43.965761+0000","last_undegraded":"2024-09-13T18:36:43.965761+0000","last_fullsized":"2024-09-13T18:36:43.965761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954611+0000","last_change":"2024-09-13T18:36:43.953603+0000","last_active":"2024-09-13T18:36:43.954611+0000","last_peered":"2024-09-13T18:36:43.954611+0000","last_clean":"2024-09-13T18:36:43.954611+0000","last_became_active":"2024-09-13T18:36:43.953405+0000","last_became_peered":"2024-09-13T18:36:43.953405+0000","last_unstale":"2024-09-13T18:36:43.954611+0000","last_undegraded":"2024-09-13T18:36:43.954611+0000","last_fullsized":"2024-09-13T18:36:43.954611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:03.105215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962823+0000","last_change":"2024-09-13T18:36:43.962746+0000","last_active":"2024-09-13T18:36:43.962823+0000","last_peered":"2024-09-13T18:36:43.962823+0000","last_clean":"2024-09-13T18:36:43.962823+0000","last_became_active":"2024-09-13T18:36:43.961888+0000","last_became_peered":"2024-09-13T18:36:43.961888+0000","last_unstale":"2024-09-13T18:36:43.962823+0000","last_undegraded":"2024-09-13T18:36:43.962823+0000","last_fullsized":"2024-09-13T18:36:43.962823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:30.619118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957464+0000","last_change":"2024-09-13T18:36:43.956228+0000","last_active":"2024-09-13T18:36:43.957464+0000","last_peered":"2024-09-13T18:36:43.957464+0000","last_clean":"2024-09-13T18:36:43.957464+0000","last_became_active":"2024-09-13T18:36:43.956018+0000","last_became_peered":"2024-09-13T18:36:43.956018+0000","last_unstale":"2024-09-13T18:36:43.957464+0000","last_undegraded":"2024-09-13T18:36:43.957464+0000","last_fullsized":"2024-09-13T18:36:43.957464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:39.254899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954581+0000","last_change":"2024-09-13T18:36:43.952626+0000","last_active":"2024-09-13T18:36:43.954581+0000","last_peered":"2024-09-13T18:36:43.954581+0000","last_clean":"2024-09-13T18:36:43.954581+0000","last_became_active":"2024-09-13T18:36:43.952420+0000","last_became_peered":"2024-09-13T18:36:43.952420+0000","last_unstale":"2024-09-13T18:36:43.954581+0000","last_undegraded":"2024-09-13T18:36:43.954581+0000","last_fullsized":"2024-09-13T18:36:43.954581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.956853+0000","last_change":"2024-09-13T18:36:43.955491+0000","last_active":"2024-09-13T18:36:43.956853+0000","last_peered":"2024-09-13T18:36:43.956853+0000","last_clean":"2024-09-13T18:36:43.956853+0000","last_became_active":"2024-09-13T18:36:43.954987+0000","last_became_peered":"2024-09-13T18:36:43.954987+0000","last_unstale":"2024-09-13T18:36:43.956853+0000","last_undegraded":"2024-09-13T18:36:43.956853+0000","last_fullsized":"2024-09-13T18:36:43.956853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960419+0000","last_change":"2024-09-13T18:36:43.957104+0000","last_active":"2024-09-13T18:36:43.960419+0000","last_peered":"2024-09-13T18:36:43.960419+0000","last_clean":"2024-09-13T18:36:43.960419+0000","last_became_active":"2024-09-13T18:36:43.956662+0000","last_became_peered":"2024-09-13T18:36:43.956662+0000","last_unstale":"2024-09-13T18:36:43.960419+0000","last_undegraded":"2024-09-13T18:36:43.960419+0000","last_fullsized":"2024-09-13T18:36:43.960419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955564+0000","last_change":"2024-09-13T18:36:43.953677+0000","last_active":"2024-09-13T18:36:43.955564+0000","last_peered":"2024-09-13T18:36:43.955564+0000","last_clean":"2024-09-13T18:36:43.955564+0000","last_became_active":"2024-09-13T18:36:43.953082+0000","last_became_peered":"2024-09-13T18:36:43.953082+0000","last_unstale":"2024-09-13T18:36:43.955564+0000","last_undegraded":"2024-09-13T18:36:43.955564+0000","last_fullsized":"2024-09-13T18:36:43.955564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958447+0000","last_change":"2024-09-13T18:36:43.956455+0000","last_active":"2024-09-13T18:36:43.958447+0000","last_peered":"2024-09-13T18:36:43.958447+0000","last_clean":"2024-09-13T18:36:43.958447+0000","last_became_active":"2024-09-13T18:36:43.951699+0000","last_became_peered":"2024-09-13T18:36:43.951699+0000","last_unstale":"2024-09-13T18:36:43.958447+0000","last_undegraded":"2024-09-13T18:36:43.958447+0000","last_fullsized":"2024-09-13T18:36:43.958447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963980+0000","last_change":"2024-09-13T18:36:43.963926+0000","last_active":"2024-09-13T18:36:43.963980+0000","last_peered":"2024-09-13T18:36:43.963980+0000","last_clean":"2024-09-13T18:36:43.963980+0000","last_became_active":"2024-09-13T18:36:43.961097+0000","last_became_peered":"2024-09-13T18:36:43.961097+0000","last_unstale":"2024-09-13T18:36:43.963980+0000","last_undegraded":"2024-09-13T18:36:43.963980+0000","last_fullsized":"2024-09-13T18:36:43.963980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.345426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954338+0000","last_change":"2024-09-13T18:36:43.954221+0000","last_active":"2024-09-13T18:36:43.954338+0000","last_peered":"2024-09-13T18:36:43.954338+0000","last_clean":"2024-09-13T18:36:43.954338+0000","last_became_active":"2024-09-13T18:36:43.952820+0000","last_became_peered":"2024-09-13T18:36:43.952820+0000","last_unstale":"2024-09-13T18:36:43.954338+0000","last_undegraded":"2024-09-13T18:36:43.954338+0000","last_fullsized":"2024-09-13T18:36:43.954338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963266+0000","last_change":"2024-09-13T18:36:43.956584+0000","last_active":"2024-09-13T18:36:43.963266+0000","last_peered":"2024-09-13T18:36:43.963266+0000","last_clean":"2024-09-13T18:36:43.963266+0000","last_became_active":"2024-09-13T18:36:43.956350+0000","last_became_peered":"2024-09-13T18:36:43.956350+0000","last_unstale":"2024-09-13T18:36:43.963266+0000","last_undegraded":"2024-09-13T18:36:43.963266+0000","last_fullsized":"2024-09-13T18:36:43.963266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960053+0000","last_change":"2024-09-13T18:36:43.959921+0000","last_active":"2024-09-13T18:36:43.960053+0000","last_peered":"2024-09-13T18:36:43.960053+0000","last_clean":"2024-09-13T18:36:43.960053+0000","last_became_active":"2024-09-13T18:36:43.959555+0000","last_became_peered":"2024-09-13T18:36:43.959555+0000","last_unstale":"2024-09-13T18:36:43.960053+0000","last_undegraded":"2024-09-13T18:36:43.960053+0000","last_fullsized":"2024-09-13T18:36:43.960053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:11.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958468+0000","last_change":"2024-09-13T18:36:43.956592+0000","last_active":"2024-09-13T18:36:43.958468+0000","last_peered":"2024-09-13T18:36:43.958468+0000","last_clean":"2024-09-13T18:36:43.958468+0000","last_became_active":"2024-09-13T18:36:43.952134+0000","last_became_peered":"2024-09-13T18:36:43.952134+0000","last_unstale":"2024-09-13T18:36:43.958468+0000","last_undegraded":"2024-09-13T18:36:43.958468+0000","last_fullsized":"2024-09-13T18:36:43.958468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964526+0000","last_change":"2024-09-13T18:36:43.964445+0000","last_active":"2024-09-13T18:36:43.964526+0000","last_peered":"2024-09-13T18:36:43.964526+0000","last_clean":"2024-09-13T18:36:43.964526+0000","last_became_active":"2024-09-13T18:36:43.962407+0000","last_became_peered":"2024-09-13T18:36:43.962407+0000","last_unstale":"2024-09-13T18:36:43.964526+0000","last_undegraded":"2024-09-13T18:36:43.964526+0000","last_fullsized":"2024-09-13T18:36:43.964526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955535+0000","last_change":"2024-09-13T18:36:43.955333+0000","last_active":"2024-09-13T18:36:43.955535+0000","last_peered":"2024-09-13T18:36:43.955535+0000","last_clean":"2024-09-13T18:36:43.955535+0000","last_became_active":"2024-09-13T18:36:43.954543+0000","last_became_peered":"2024-09-13T18:36:43.954543+0000","last_unstale":"2024-09-13T18:36:43.955535+0000","last_undegraded":"2024-09-13T18:36:43.955535+0000","last_fullsized":"2024-09-13T18:36:43.955535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957619+0000","last_change":"2024-09-13T18:36:43.956239+0000","last_active":"2024-09-13T18:36:43.957619+0000","last_peered":"2024-09-13T18:36:43.957619+0000","last_clean":"2024-09-13T18:36:43.957619+0000","last_became_active":"2024-09-13T18:36:43.955883+0000","last_became_peered":"2024-09-13T18:36:43.955883+0000","last_unstale":"2024-09-13T18:36:43.957619+0000","last_undegraded":"2024-09-13T18:36:43.957619+0000","last_fullsized":"2024-09-13T18:36:43.957619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963097+0000","last_change":"2024-09-13T18:36:43.962890+0000","last_active":"2024-09-13T18:36:43.963097+0000","last_peered":"2024-09-13T18:36:43.963097+0000","last_clean":"2024-09-13T18:36:43.963097+0000","last_became_active":"2024-09-13T18:36:43.962355+0000","last_became_peered":"2024-09-13T18:36:43.962355+0000","last_unstale":"2024-09-13T18:36:43.963097+0000","last_undegraded":"2024-09-13T18:36:43.963097+0000","last_fullsized":"2024-09-13T18:36:43.963097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960477+0000","last_change":"2024-09-13T18:36:43.958116+0000","last_active":"2024-09-13T18:36:43.960477+0000","last_peered":"2024-09-13T18:36:43.960477+0000","last_clean":"2024-09-13T18:36:43.960477+0000","last_became_active":"2024-09-13T18:36:43.957877+0000","last_became_peered":"2024-09-13T18:36:43.957877+0000","last_unstale":"2024-09-13T18:36:43.960477+0000","last_undegraded":"2024-09-13T18:36:43.960477+0000","last_fullsized":"2024-09-13T18:36:43.960477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952098+0000","last_change":"2024-09-13T18:36:43.951370+0000","last_active":"2024-09-13T18:36:43.952098+0000","last_peered":"2024-09-13T18:36:43.952098+0000","last_clean":"2024-09-13T18:36:43.952098+0000","last_became_active":"2024-09-13T18:36:43.950676+0000","last_became_peered":"2024-09-13T18:36:43.950676+0000","last_unstale":"2024-09-13T18:36:43.952098+0000","last_undegraded":"2024-09-13T18:36:43.952098+0000","last_fullsized":"2024-09-13T18:36:43.952098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965396+0000","last_change":"2024-09-13T18:36:43.965333+0000","last_active":"2024-09-13T18:36:43.965396+0000","last_peered":"2024-09-13T18:36:43.965396+0000","last_clean":"2024-09-13T18:36:43.965396+0000","last_became_active":"2024-09-13T18:36:43.964837+0000","last_became_peered":"2024-09-13T18:36:43.964837+0000","last_unstale":"2024-09-13T18:36:43.965396+0000","last_undegraded":"2024-09-13T18:36:43.965396+0000","last_fullsized":"2024-09-13T18:36:43.965396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951717+0000","last_change":"2024-09-13T18:36:43.951655+0000","last_active":"2024-09-13T18:36:43.951717+0000","last_peered":"2024-09-13T18:36:43.951717+0000","last_clean":"2024-09-13T18:36:43.951717+0000","last_became_active":"2024-09-13T18:36:43.951396+0000","last_became_peered":"2024-09-13T18:36:43.951396+0000","last_unstale":"2024-09-13T18:36:43.951717+0000","last_undegraded":"2024-09-13T18:36:43.951717+0000","last_fullsized":"2024-09-13T18:36:43.951717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961660+0000","last_change":"2024-09-13T18:36:43.961399+0000","last_active":"2024-09-13T18:36:43.961660+0000","last_peered":"2024-09-13T18:36:43.961660+0000","last_clean":"2024-09-13T18:36:43.961660+0000","last_became_active":"2024-09-13T18:36:43.961167+0000","last_became_peered":"2024-09-13T18:36:43.961167+0000","last_unstale":"2024-09-13T18:36:43.961660+0000","last_undegraded":"2024-09-13T18:36:43.961660+0000","last_fullsized":"2024-09-13T18:36:43.961660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957590+0000","last_change":"2024-09-13T18:36:43.952745+0000","last_active":"2024-09-13T18:36:43.957590+0000","last_peered":"2024-09-13T18:36:43.957590+0000","last_clean":"2024-09-13T18:36:43.957590+0000","last_became_active":"2024-09-13T18:36:43.952562+0000","last_became_peered":"2024-09-13T18:36:43.952562+0000","last_unstale":"2024-09-13T18:36:43.957590+0000","last_undegraded":"2024-09-13T18:36:43.957590+0000","last_fullsized":"2024-09-13T18:36:43.957590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963827+0000","last_change":"2024-09-13T18:36:43.963772+0000","last_active":"2024-09-13T18:36:43.963827+0000","last_peered":"2024-09-13T18:36:43.963827+0000","last_clean":"2024-09-13T18:36:43.963827+0000","last_became_active":"2024-09-13T18:36:43.960955+0000","last_became_peered":"2024-09-13T18:36:43.960955+0000","last_unstale":"2024-09-13T18:36:43.963827+0000","last_undegraded":"2024-09-13T18:36:43.963827+0000","last_fullsized":"2024-09-13T18:36:43.963827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:45.408169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962743+0000","last_change":"2024-09-13T18:36:43.962666+0000","last_active":"2024-09-13T18:36:43.962743+0000","last_peered":"2024-09-13T18:36:43.962743+0000","last_clean":"2024-09-13T18:36:43.962743+0000","last_became_active":"2024-09-13T18:36:43.961367+0000","last_became_peered":"2024-09-13T18:36:43.961367+0000","last_unstale":"2024-09-13T18:36:43.962743+0000","last_undegraded":"2024-09-13T18:36:43.962743+0000","last_fullsized":"2024-09-13T18:36:43.962743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962769+0000","last_change":"2024-09-13T18:36:43.542006+0000","last_active":"2024-09-13T18:36:43.962769+0000","last_peered":"2024-09-13T18:36:43.962769+0000","last_clean":"2024-09-13T18:36:43.962769+0000","last_became_active":"2024-09-13T18:36:43.541236+0000","last_became_peered":"2024-09-13T18:36:43.541236+0000","last_unstale":"2024-09-13T18:36:43.962769+0000","last_undegraded":"2024-09-13T18:36:43.962769+0000","last_fullsized":"2024-09-13T18:36:43.962769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:53.065027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963168+0000","last_change":"2024-09-13T18:36:43.963098+0000","last_active":"2024-09-13T18:36:43.963168+0000","last_peered":"2024-09-13T18:36:43.963168+0000","last_clean":"2024-09-13T18:36:43.963168+0000","last_became_active":"2024-09-13T18:36:43.962839+0000","last_became_peered":"2024-09-13T18:36:43.962839+0000","last_unstale":"2024-09-13T18:36:43.963168+0000","last_undegraded":"2024-09-13T18:36:43.963168+0000","last_fullsized":"2024-09-13T18:36:43.963168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962673+0000","last_change":"2024-09-13T18:36:43.538000+0000","last_active":"2024-09-13T18:36:43.962673+0000","last_peered":"2024-09-13T18:36:43.962673+0000","last_clean":"2024-09-13T18:36:43.962673+0000","last_became_active":"2024-09-13T18:36:43.532918+0000","last_became_peered":"2024-09-13T18:36:43.532918+0000","last_unstale":"2024-09-13T18:36:43.962673+0000","last_undegraded":"2024-09-13T18:36:43.962673+0000","last_fullsized":"2024-09-13T18:36:43.962673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:35.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958632+0000","last_change":"2024-09-13T18:36:43.958130+0000","last_active":"2024-09-13T18:36:43.958632+0000","last_peered":"2024-09-13T18:36:43.958632+0000","last_clean":"2024-09-13T18:36:43.958632+0000","last_became_active":"2024-09-13T18:36:43.957741+0000","last_became_peered":"2024-09-13T18:36:43.957741+0000","last_unstale":"2024-09-13T18:36:43.958632+0000","last_undegraded":"2024-09-13T18:36:43.958632+0000","last_fullsized":"2024-09-13T18:36:43.958632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960055+0000","last_change":"2024-09-13T18:36:43.535124+0000","last_active":"2024-09-13T18:36:43.960055+0000","last_peered":"2024-09-13T18:36:43.960055+0000","last_clean":"2024-09-13T18:36:43.960055+0000","last_became_active":"2024-09-13T18:36:43.534854+0000","last_became_peered":"2024-09-13T18:36:43.534854+0000","last_unstale":"2024-09-13T18:36:43.960055+0000","last_undegraded":"2024-09-13T18:36:43.960055+0000","last_fullsized":"2024-09-13T18:36:43.960055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:51.263603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962406+0000","last_change":"2024-09-13T18:36:43.962146+0000","last_active":"2024-09-13T18:36:43.962406+0000","last_peered":"2024-09-13T18:36:43.962406+0000","last_clean":"2024-09-13T18:36:43.962406+0000","last_became_active":"2024-09-13T18:36:43.955896+0000","last_became_peered":"2024-09-13T18:36:43.955896+0000","last_unstale":"2024-09-13T18:36:43.962406+0000","last_undegraded":"2024-09-13T18:36:43.962406+0000","last_fullsized":"2024-09-13T18:36:43.962406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964966+0000","last_change":"2024-09-13T18:36:43.533688+0000","last_active":"2024-09-13T18:36:43.964966+0000","last_peered":"2024-09-13T18:36:43.964966+0000","last_clean":"2024-09-13T18:36:43.964966+0000","last_became_active":"2024-09-13T18:36:43.533428+0000","last_became_peered":"2024-09-13T18:36:43.533428+0000","last_unstale":"2024-09-13T18:36:43.964966+0000","last_undegraded":"2024-09-13T18:36:43.964966+0000","last_fullsized":"2024-09-13T18:36:43.964966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:17.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954597+0000","last_change":"2024-09-13T18:36:43.953056+0000","last_active":"2024-09-13T18:36:43.954597+0000","last_peered":"2024-09-13T18:36:43.954597+0000","last_clean":"2024-09-13T18:36:43.954597+0000","last_became_active":"2024-09-13T18:36:43.952866+0000","last_became_peered":"2024-09-13T18:36:43.952866+0000","last_unstale":"2024-09-13T18:36:43.954597+0000","last_undegraded":"2024-09-13T18:36:43.954597+0000","last_fullsized":"2024-09-13T18:36:43.954597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:37.492595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958861+0000","last_change":"2024-09-13T18:36:43.536543+0000","last_active":"2024-09-13T18:36:43.958861+0000","last_peered":"2024-09-13T18:36:43.958861+0000","last_clean":"2024-09-13T18:36:43.958861+0000","last_became_active":"2024-09-13T18:36:43.536207+0000","last_became_peered":"2024-09-13T18:36:43.536207+0000","last_unstale":"2024-09-13T18:36:43.958861+0000","last_undegraded":"2024-09-13T18:36:43.958861+0000","last_fullsized":"2024-09-13T18:36:43.958861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965415+0000","last_change":"2024-09-13T18:36:43.965339+0000","last_active":"2024-09-13T18:36:43.965415+0000","last_peered":"2024-09-13T18:36:43.965415+0000","last_clean":"2024-09-13T18:36:43.965415+0000","last_became_active":"2024-09-13T18:36:43.964173+0000","last_became_peered":"2024-09-13T18:36:43.964173+0000","last_unstale":"2024-09-13T18:36:43.965415+0000","last_undegraded":"2024-09-13T18:36:43.965415+0000","last_fullsized":"2024-09-13T18:36:43.965415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964585+0000","last_change":"2024-09-13T18:36:43.536837+0000","last_active":"2024-09-13T18:36:43.964585+0000","last_peered":"2024-09-13T18:36:43.964585+0000","last_clean":"2024-09-13T18:36:43.964585+0000","last_became_active":"2024-09-13T18:36:43.536577+0000","last_became_peered":"2024-09-13T18:36:43.536577+0000","last_unstale":"2024-09-13T18:36:43.964585+0000","last_undegraded":"2024-09-13T18:36:43.964585+0000","last_fullsized":"2024-09-13T18:36:43.964585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962583+0000","last_change":"2024-09-13T18:36:43.962340+0000","last_active":"2024-09-13T18:36:43.962583+0000","last_peered":"2024-09-13T18:36:43.962583+0000","last_clean":"2024-09-13T18:36:43.962583+0000","last_became_active":"2024-09-13T18:36:43.962135+0000","last_became_peered":"2024-09-13T18:36:43.962135+0000","last_unstale":"2024-09-13T18:36:43.962583+0000","last_undegraded":"2024-09-13T18:36:43.962583+0000","last_fullsized":"2024-09-13T18:36:43.962583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.942295+0000","last_change":"2024-09-13T18:36:43.534506+0000","last_active":"2024-09-13T18:36:43.942295+0000","last_peered":"2024-09-13T18:36:43.942295+0000","last_clean":"2024-09-13T18:36:43.942295+0000","last_became_active":"2024-09-13T18:36:43.534228+0000","last_became_peered":"2024-09-13T18:36:43.534228+0000","last_unstale":"2024-09-13T18:36:43.942295+0000","last_undegraded":"2024-09-13T18:36:43.942295+0000","last_fullsized":"2024-09-13T18:36:43.942295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:12.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960547+0000","last_change":"2024-09-13T18:36:43.959314+0000","last_active":"2024-09-13T18:36:43.960547+0000","last_peered":"2024-09-13T18:36:43.960547+0000","last_clean":"2024-09-13T18:36:43.960547+0000","last_became_active":"2024-09-13T18:36:43.958506+0000","last_became_peered":"2024-09-13T18:36:43.958506+0000","last_unstale":"2024-09-13T18:36:43.960547+0000","last_undegraded":"2024-09-13T18:36:43.960547+0000","last_fullsized":"2024-09-13T18:36:43.960547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949790+0000","last_change":"2024-09-13T18:36:43.528414+0000","last_active":"2024-09-13T18:36:43.949790+0000","last_peered":"2024-09-13T18:36:43.949790+0000","last_clean":"2024-09-13T18:36:43.949790+0000","last_became_active":"2024-09-13T18:36:43.528200+0000","last_became_peered":"2024-09-13T18:36:43.528200+0000","last_unstale":"2024-09-13T18:36:43.949790+0000","last_undegraded":"2024-09-13T18:36:43.949790+0000","last_fullsized":"2024-09-13T18:36:43.949790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954197+0000","last_change":"2024-09-13T18:36:43.952915+0000","last_active":"2024-09-13T18:36:43.954197+0000","last_peered":"2024-09-13T18:36:43.954197+0000","last_clean":"2024-09-13T18:36:43.954197+0000","last_became_active":"2024-09-13T18:36:43.952717+0000","last_became_peered":"2024-09-13T18:36:43.952717+0000","last_unstale":"2024-09-13T18:36:43.954197+0000","last_undegraded":"2024-09-13T18:36:43.954197+0000","last_fullsized":"2024-09-13T18:36:43.954197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.564846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.943637+0000","last_change":"2024-09-13T18:36:43.537908+0000","last_active":"2024-09-13T18:36:43.943637+0000","last_peered":"2024-09-13T18:36:43.943637+0000","last_clean":"2024-09-13T18:36:43.943637+0000","last_became_active":"2024-09-13T18:36:43.537692+0000","last_became_peered":"2024-09-13T18:36:43.537692+0000","last_unstale":"2024-09-13T18:36:43.943637+0000","last_undegraded":"2024-09-13T18:36:43.943637+0000","last_fullsized":"2024-09-13T18:36:43.943637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:46.060408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960436+0000","last_change":"2024-09-13T18:36:43.957586+0000","last_active":"2024-09-13T18:36:43.960436+0000","last_peered":"2024-09-13T18:36:43.960436+0000","last_clean":"2024-09-13T18:36:43.960436+0000","last_became_active":"2024-09-13T18:36:43.956277+0000","last_became_peered":"2024-09-13T18:36:43.956277+0000","last_unstale":"2024-09-13T18:36:43.960436+0000","last_undegraded":"2024-09-13T18:36:43.960436+0000","last_fullsized":"2024-09-13T18:36:43.960436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944365+0000","last_change":"2024-09-13T18:36:43.538915+0000","last_active":"2024-09-13T18:36:43.944365+0000","last_peered":"2024-09-13T18:36:43.944365+0000","last_clean":"2024-09-13T18:36:43.944365+0000","last_became_active":"2024-09-13T18:36:43.538537+0000","last_became_peered":"2024-09-13T18:36:43.538537+0000","last_unstale":"2024-09-13T18:36:43.944365+0000","last_undegraded":"2024-09-13T18:36:43.944365+0000","last_fullsized":"2024-09-13T18:36:43.944365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960491+0000","last_change":"2024-09-13T18:36:43.958828+0000","last_active":"2024-09-13T18:36:43.960491+0000","last_peered":"2024-09-13T18:36:43.960491+0000","last_clean":"2024-09-13T18:36:43.960491+0000","last_became_active":"2024-09-13T18:36:43.957479+0000","last_became_peered":"2024-09-13T18:36:43.957479+0000","last_unstale":"2024-09-13T18:36:43.960491+0000","last_undegraded":"2024-09-13T18:36:43.960491+0000","last_fullsized":"2024-09-13T18:36:43.960491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:25.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960404+0000","last_change":"2024-09-13T18:36:43.541708+0000","last_active":"2024-09-13T18:36:43.960404+0000","last_peered":"2024-09-13T18:36:43.960404+0000","last_clean":"2024-09-13T18:36:43.960404+0000","last_became_active":"2024-09-13T18:36:43.538962+0000","last_became_peered":"2024-09-13T18:36:43.538962+0000","last_unstale":"2024-09-13T18:36:43.960404+0000","last_undegraded":"2024-09-13T18:36:43.960404+0000","last_fullsized":"2024-09-13T18:36:43.960404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:51.494051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954212+0000","last_change":"2024-09-13T18:36:43.953005+0000","last_active":"2024-09-13T18:36:43.954212+0000","last_peered":"2024-09-13T18:36:43.954212+0000","last_clean":"2024-09-13T18:36:43.954212+0000","last_became_active":"2024-09-13T18:36:43.952761+0000","last_became_peered":"2024-09-13T18:36:43.952761+0000","last_unstale":"2024-09-13T18:36:43.954212+0000","last_undegraded":"2024-09-13T18:36:43.954212+0000","last_fullsized":"2024-09-13T18:36:43.954212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:54.543794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966179+0000","last_change":"2024-09-13T18:36:43.535486+0000","last_active":"2024-09-13T18:36:43.966179+0000","last_peered":"2024-09-13T18:36:43.966179+0000","last_clean":"2024-09-13T18:36:43.966179+0000","last_became_active":"2024-09-13T18:36:43.535085+0000","last_became_peered":"2024-09-13T18:36:43.535085+0000","last_unstale":"2024-09-13T18:36:43.966179+0000","last_undegraded":"2024-09-13T18:36:43.966179+0000","last_fullsized":"2024-09-13T18:36:43.966179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957746+0000","last_change":"2024-09-13T18:36:43.957472+0000","last_active":"2024-09-13T18:36:43.957746+0000","last_peered":"2024-09-13T18:36:43.957746+0000","last_clean":"2024-09-13T18:36:43.957746+0000","last_became_active":"2024-09-13T18:36:43.957255+0000","last_became_peered":"2024-09-13T18:36:43.957255+0000","last_unstale":"2024-09-13T18:36:43.957746+0000","last_undegraded":"2024-09-13T18:36:43.957746+0000","last_fullsized":"2024-09-13T18:36:43.957746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:24.655907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959644+0000","last_change":"2024-09-13T18:36:43.539714+0000","last_active":"2024-09-13T18:36:43.959644+0000","last_peered":"2024-09-13T18:36:43.959644+0000","last_clean":"2024-09-13T18:36:43.959644+0000","last_became_active":"2024-09-13T18:36:43.538401+0000","last_became_peered":"2024-09-13T18:36:43.538401+0000","last_unstale":"2024-09-13T18:36:43.959644+0000","last_undegraded":"2024-09-13T18:36:43.959644+0000","last_fullsized":"2024-09-13T18:36:43.959644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960395+0000","last_change":"2024-09-13T18:36:43.956155+0000","last_active":"2024-09-13T18:36:43.960395+0000","last_peered":"2024-09-13T18:36:43.960395+0000","last_clean":"2024-09-13T18:36:43.960395+0000","last_became_active":"2024-09-13T18:36:43.954845+0000","last_became_peered":"2024-09-13T18:36:43.954845+0000","last_unstale":"2024-09-13T18:36:43.960395+0000","last_undegraded":"2024-09-13T18:36:43.960395+0000","last_fullsized":"2024-09-13T18:36:43.960395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947886+0000","last_change":"2024-09-13T18:36:43.539220+0000","last_active":"2024-09-13T18:36:43.947886+0000","last_peered":"2024-09-13T18:36:43.947886+0000","last_clean":"2024-09-13T18:36:43.947886+0000","last_became_active":"2024-09-13T18:36:43.538932+0000","last_became_peered":"2024-09-13T18:36:43.538932+0000","last_unstale":"2024-09-13T18:36:43.947886+0000","last_undegraded":"2024-09-13T18:36:43.947886+0000","last_fullsized":"2024-09-13T18:36:43.947886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962670+0000","last_change":"2024-09-13T18:36:43.961403+0000","last_active":"2024-09-13T18:36:43.962670+0000","last_peered":"2024-09-13T18:36:43.962670+0000","last_clean":"2024-09-13T18:36:43.962670+0000","last_became_active":"2024-09-13T18:36:43.960097+0000","last_became_peered":"2024-09-13T18:36:43.960097+0000","last_unstale":"2024-09-13T18:36:43.962670+0000","last_undegraded":"2024-09-13T18:36:43.962670+0000","last_fullsized":"2024-09-13T18:36:43.962670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.946479+0000","last_change":"2024-09-13T18:36:43.533866+0000","last_active":"2024-09-13T18:36:43.946479+0000","last_peered":"2024-09-13T18:36:43.946479+0000","last_clean":"2024-09-13T18:36:43.946479+0000","last_became_active":"2024-09-13T18:36:43.533584+0000","last_became_peered":"2024-09-13T18:36:43.533584+0000","last_unstale":"2024-09-13T18:36:43.946479+0000","last_undegraded":"2024-09-13T18:36:43.946479+0000","last_fullsized":"2024-09-13T18:36:43.946479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963173+0000","last_change":"2024-09-13T18:36:43.963101+0000","last_active":"2024-09-13T18:36:43.963173+0000","last_peered":"2024-09-13T18:36:43.963173+0000","last_clean":"2024-09-13T18:36:43.963173+0000","last_became_active":"2024-09-13T18:36:43.960714+0000","last_became_peered":"2024-09-13T18:36:43.960714+0000","last_unstale":"2024-09-13T18:36:43.963173+0000","last_undegraded":"2024-09-13T18:36:43.963173+0000","last_fullsized":"2024-09-13T18:36:43.963173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:28.437957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966106+0000","last_change":"2024-09-13T18:36:43.540398+0000","last_active":"2024-09-13T18:36:43.966106+0000","last_peered":"2024-09-13T18:36:43.966106+0000","last_clean":"2024-09-13T18:36:43.966106+0000","last_became_active":"2024-09-13T18:36:43.539926+0000","last_became_peered":"2024-09-13T18:36:43.539926+0000","last_unstale":"2024-09-13T18:36:43.966106+0000","last_undegraded":"2024-09-13T18:36:43.966106+0000","last_fullsized":"2024-09-13T18:36:43.966106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:04.042479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959125+0000","last_change":"2024-09-13T18:36:43.959018+0000","last_active":"2024-09-13T18:36:43.959125+0000","last_peered":"2024-09-13T18:36:43.959125+0000","last_clean":"2024-09-13T18:36:43.959125+0000","last_became_active":"2024-09-13T18:36:43.957630+0000","last_became_peered":"2024-09-13T18:36:43.957630+0000","last_unstale":"2024-09-13T18:36:43.959125+0000","last_undegraded":"2024-09-13T18:36:43.959125+0000","last_fullsized":"2024-09-13T18:36:43.959125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.386496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963322+0000","last_change":"2024-09-13T18:36:43.535513+0000","last_active":"2024-09-13T18:36:43.963322+0000","last_peered":"2024-09-13T18:36:43.963322+0000","last_clean":"2024-09-13T18:36:43.963322+0000","last_became_active":"2024-09-13T18:36:43.535276+0000","last_became_peered":"2024-09-13T18:36:43.535276+0000","last_unstale":"2024-09-13T18:36:43.963322+0000","last_undegraded":"2024-09-13T18:36:43.963322+0000","last_fullsized":"2024-09-13T18:36:43.963322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:22.809094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957232+0000","last_change":"2024-09-13T18:36:43.956988+0000","last_active":"2024-09-13T18:36:43.957232+0000","last_peered":"2024-09-13T18:36:43.957232+0000","last_clean":"2024-09-13T18:36:43.957232+0000","last_became_active":"2024-09-13T18:36:43.956788+0000","last_became_peered":"2024-09-13T18:36:43.956788+0000","last_unstale":"2024-09-13T18:36:43.957232+0000","last_undegraded":"2024-09-13T18:36:43.957232+0000","last_fullsized":"2024-09-13T18:36:43.957232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959371+0000","last_change":"2024-09-13T18:36:43.538605+0000","last_active":"2024-09-13T18:36:43.959371+0000","last_peered":"2024-09-13T18:36:43.959371+0000","last_clean":"2024-09-13T18:36:43.959371+0000","last_became_active":"2024-09-13T18:36:43.538075+0000","last_became_peered":"2024-09-13T18:36:43.538075+0000","last_unstale":"2024-09-13T18:36:43.959371+0000","last_undegraded":"2024-09-13T18:36:43.959371+0000","last_fullsized":"2024-09-13T18:36:43.959371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954276+0000","last_change":"2024-09-13T18:36:43.954197+0000","last_active":"2024-09-13T18:36:43.954276+0000","last_peered":"2024-09-13T18:36:43.954276+0000","last_clean":"2024-09-13T18:36:43.954276+0000","last_became_active":"2024-09-13T18:36:43.953917+0000","last_became_peered":"2024-09-13T18:36:43.953917+0000","last_unstale":"2024-09-13T18:36:43.954276+0000","last_undegraded":"2024-09-13T18:36:43.954276+0000","last_fullsized":"2024-09-13T18:36:43.954276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959937+0000","last_change":"2024-09-13T18:36:43.539249+0000","last_active":"2024-09-13T18:36:43.959937+0000","last_peered":"2024-09-13T18:36:43.959937+0000","last_clean":"2024-09-13T18:36:43.959937+0000","last_became_active":"2024-09-13T18:36:43.538532+0000","last_became_peered":"2024-09-13T18:36:43.538532+0000","last_unstale":"2024-09-13T18:36:43.959937+0000","last_undegraded":"2024-09-13T18:36:43.959937+0000","last_fullsized":"2024-09-13T18:36:43.959937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949284+0000","last_change":"2024-09-13T18:36:43.949209+0000","last_active":"2024-09-13T18:36:43.949284+0000","last_peered":"2024-09-13T18:36:43.949284+0000","last_clean":"2024-09-13T18:36:43.949284+0000","last_became_active":"2024-09-13T18:36:43.948756+0000","last_became_peered":"2024-09-13T18:36:43.948756+0000","last_unstale":"2024-09-13T18:36:43.949284+0000","last_undegraded":"2024-09-13T18:36:43.949284+0000","last_fullsized":"2024-09-13T18:36:43.949284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:36.254852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944650+0000","last_change":"2024-09-13T18:36:43.535052+0000","last_active":"2024-09-13T18:36:43.944650+0000","last_peered":"2024-09-13T18:36:43.944650+0000","last_clean":"2024-09-13T18:36:43.944650+0000","last_became_active":"2024-09-13T18:36:43.534607+0000","last_became_peered":"2024-09-13T18:36:43.534607+0000","last_unstale":"2024-09-13T18:36:43.944650+0000","last_undegraded":"2024-09-13T18:36:43.944650+0000","last_fullsized":"2024-09-13T18:36:43.944650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953817+0000","last_change":"2024-09-13T18:36:43.953736+0000","last_active":"2024-09-13T18:36:43.953817+0000","last_peered":"2024-09-13T18:36:43.953817+0000","last_clean":"2024-09-13T18:36:43.953817+0000","last_became_active":"2024-09-13T18:36:43.953504+0000","last_became_peered":"2024-09-13T18:36:43.953504+0000","last_unstale":"2024-09-13T18:36:43.953817+0000","last_undegraded":"2024-09-13T18:36:43.953817+0000","last_fullsized":"2024-09-13T18:36:43.953817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:22.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961175+0000","last_change":"2024-09-13T18:36:43.532711+0000","last_active":"2024-09-13T18:36:43.961175+0000","last_peered":"2024-09-13T18:36:43.961175+0000","last_clean":"2024-09-13T18:36:43.961175+0000","last_became_active":"2024-09-13T18:36:43.532491+0000","last_became_peered":"2024-09-13T18:36:43.532491+0000","last_unstale":"2024-09-13T18:36:43.961175+0000","last_undegraded":"2024-09-13T18:36:43.961175+0000","last_fullsized":"2024-09-13T18:36:43.961175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:41.467973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947954+0000","last_change":"2024-09-13T18:36:43.947877+0000","last_active":"2024-09-13T18:36:43.947954+0000","last_peered":"2024-09-13T18:36:43.947954+0000","last_clean":"2024-09-13T18:36:43.947954+0000","last_became_active":"2024-09-13T18:36:43.947611+0000","last_became_peered":"2024-09-13T18:36:43.947611+0000","last_unstale":"2024-09-13T18:36:43.947954+0000","last_undegraded":"2024-09-13T18:36:43.947954+0000","last_fullsized":"2024-09-13T18:36:43.947954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949739+0000","last_change":"2024-09-13T18:36:43.539178+0000","last_active":"2024-09-13T18:36:43.949739+0000","last_peered":"2024-09-13T18:36:43.949739+0000","last_clean":"2024-09-13T18:36:43.949739+0000","last_became_active":"2024-09-13T18:36:43.538927+0000","last_became_peered":"2024-09-13T18:36:43.538927+0000","last_unstale":"2024-09-13T18:36:43.949739+0000","last_undegraded":"2024-09-13T18:36:43.949739+0000","last_fullsized":"2024-09-13T18:36:43.949739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962211+0000","last_change":"2024-09-13T18:36:43.961353+0000","last_active":"2024-09-13T18:36:43.962211+0000","last_peered":"2024-09-13T18:36:43.962211+0000","last_clean":"2024-09-13T18:36:43.962211+0000","last_became_active":"2024-09-13T18:36:43.960913+0000","last_became_peered":"2024-09-13T18:36:43.960913+0000","last_unstale":"2024-09-13T18:36:43.962211+0000","last_undegraded":"2024-09-13T18:36:43.962211+0000","last_fullsized":"2024-09-13T18:36:43.962211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951896+0000","last_change":"2024-09-13T18:36:43.533289+0000","last_active":"2024-09-13T18:36:43.951896+0000","last_peered":"2024-09-13T18:36:43.951896+0000","last_clean":"2024-09-13T18:36:43.951896+0000","last_became_active":"2024-09-13T18:36:43.532827+0000","last_became_peered":"2024-09-13T18:36:43.532827+0000","last_unstale":"2024-09-13T18:36:43.951896+0000","last_undegraded":"2024-09-13T18:36:43.951896+0000","last_fullsized":"2024-09-13T18:36:43.951896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.380715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955714+0000","last_change":"2024-09-13T18:36:43.955456+0000","last_active":"2024-09-13T18:36:43.955714+0000","last_peered":"2024-09-13T18:36:43.955714+0000","last_clean":"2024-09-13T18:36:43.955714+0000","last_became_active":"2024-09-13T18:36:43.955236+0000","last_became_peered":"2024-09-13T18:36:43.955236+0000","last_unstale":"2024-09-13T18:36:43.955714+0000","last_undegraded":"2024-09-13T18:36:43.955714+0000","last_fullsized":"2024-09-13T18:36:43.955714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953374+0000","last_change":"2024-09-13T18:36:43.538739+0000","last_active":"2024-09-13T18:36:43.953374+0000","last_peered":"2024-09-13T18:36:43.953374+0000","last_clean":"2024-09-13T18:36:43.953374+0000","last_became_active":"2024-09-13T18:36:43.538227+0000","last_became_peered":"2024-09-13T18:36:43.538227+0000","last_unstale":"2024-09-13T18:36:43.953374+0000","last_undegraded":"2024-09-13T18:36:43.953374+0000","last_fullsized":"2024-09-13T18:36:43.953374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.417931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951189+0000","last_change":"2024-09-13T18:36:43.949380+0000","last_active":"2024-09-13T18:36:43.951189+0000","last_peered":"2024-09-13T18:36:43.951189+0000","last_clean":"2024-09-13T18:36:43.951189+0000","last_became_active":"2024-09-13T18:36:43.949153+0000","last_became_peered":"2024-09-13T18:36:43.949153+0000","last_unstale":"2024-09-13T18:36:43.951189+0000","last_undegraded":"2024-09-13T18:36:43.951189+0000","last_fullsized":"2024-09-13T18:36:43.951189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:11.267928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964247+0000","last_change":"2024-09-13T18:36:43.536535+0000","last_active":"2024-09-13T18:36:43.964247+0000","last_peered":"2024-09-13T18:36:43.964247+0000","last_clean":"2024-09-13T18:36:43.964247+0000","last_became_active":"2024-09-13T18:36:43.536286+0000","last_became_peered":"2024-09-13T18:36:43.536286+0000","last_unstale":"2024-09-13T18:36:43.964247+0000","last_undegraded":"2024-09-13T18:36:43.964247+0000","last_fullsized":"2024-09-13T18:36:43.964247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954230+0000","last_change":"2024-09-13T18:36:43.953747+0000","last_active":"2024-09-13T18:36:43.954230+0000","last_peered":"2024-09-13T18:36:43.954230+0000","last_clean":"2024-09-13T18:36:43.954230+0000","last_became_active":"2024-09-13T18:36:43.953522+0000","last_became_peered":"2024-09-13T18:36:43.953522+0000","last_unstale":"2024-09-13T18:36:43.954230+0000","last_undegraded":"2024-09-13T18:36:43.954230+0000","last_fullsized":"2024-09-13T18:36:43.954230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:34.120082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944131+0000","last_change":"2024-09-13T18:36:43.537515+0000","last_active":"2024-09-13T18:36:43.944131+0000","last_peered":"2024-09-13T18:36:43.944131+0000","last_clean":"2024-09-13T18:36:43.944131+0000","last_became_active":"2024-09-13T18:36:43.536247+0000","last_became_peered":"2024-09-13T18:36:43.536247+0000","last_unstale":"2024-09-13T18:36:43.944131+0000","last_undegraded":"2024-09-13T18:36:43.944131+0000","last_fullsized":"2024-09-13T18:36:43.944131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.976877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953602+0000","last_change":"2024-09-13T18:36:43.952041+0000","last_active":"2024-09-13T18:36:43.953602+0000","last_peered":"2024-09-13T18:36:43.953602+0000","last_clean":"2024-09-13T18:36:43.953602+0000","last_became_active":"2024-09-13T18:36:43.951804+0000","last_became_peered":"2024-09-13T18:36:43.951804+0000","last_unstale":"2024-09-13T18:36:43.953602+0000","last_undegraded":"2024-09-13T18:36:43.953602+0000","last_fullsized":"2024-09-13T18:36:43.953602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:18.532726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949328+0000","last_change":"2024-09-13T18:36:43.537284+0000","last_active":"2024-09-13T18:36:43.949328+0000","last_peered":"2024-09-13T18:36:43.949328+0000","last_clean":"2024-09-13T18:36:43.949328+0000","last_became_active":"2024-09-13T18:36:43.536206+0000","last_became_peered":"2024-09-13T18:36:43.536206+0000","last_unstale":"2024-09-13T18:36:43.949328+0000","last_undegraded":"2024-09-13T18:36:43.949328+0000","last_fullsized":"2024-09-13T18:36:43.949328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951487+0000","last_change":"2024-09-13T18:36:43.951314+0000","last_active":"2024-09-13T18:36:43.951487+0000","last_peered":"2024-09-13T18:36:43.951487+0000","last_clean":"2024-09-13T18:36:43.951487+0000","last_became_active":"2024-09-13T18:36:43.951145+0000","last_became_peered":"2024-09-13T18:36:43.951145+0000","last_unstale":"2024-09-13T18:36:43.951487+0000","last_undegraded":"2024-09-13T18:36:43.951487+0000","last_fullsized":"2024-09-13T18:36:43.951487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947883+0000","last_change":"2024-09-13T18:36:43.533733+0000","last_active":"2024-09-13T18:36:43.947883+0000","last_peered":"2024-09-13T18:36:43.947883+0000","last_clean":"2024-09-13T18:36:43.947883+0000","last_became_active":"2024-09-13T18:36:43.533324+0000","last_became_peered":"2024-09-13T18:36:43.533324+0000","last_unstale":"2024-09-13T18:36:43.947883+0000","last_undegraded":"2024-09-13T18:36:43.947883+0000","last_fullsized":"2024-09-13T18:36:43.947883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955845+0000","last_change":"2024-09-13T18:36:43.955767+0000","last_active":"2024-09-13T18:36:43.955845+0000","last_peered":"2024-09-13T18:36:43.955845+0000","last_clean":"2024-09-13T18:36:43.955845+0000","last_became_active":"2024-09-13T18:36:43.954868+0000","last_became_peered":"2024-09-13T18:36:43.954868+0000","last_unstale":"2024-09-13T18:36:43.955845+0000","last_undegraded":"2024-09-13T18:36:43.955845+0000","last_fullsized":"2024-09-13T18:36:43.955845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948354+0000","last_change":"2024-09-13T18:36:43.542171+0000","last_active":"2024-09-13T18:36:43.948354+0000","last_peered":"2024-09-13T18:36:43.948354+0000","last_clean":"2024-09-13T18:36:43.948354+0000","last_became_active":"2024-09-13T18:36:43.541912+0000","last_became_peered":"2024-09-13T18:36:43.541912+0000","last_unstale":"2024-09-13T18:36:43.948354+0000","last_undegraded":"2024-09-13T18:36:43.948354+0000","last_fullsized":"2024-09-13T18:36:43.948354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960512+0000","last_change":"2024-09-13T18:36:43.959027+0000","last_active":"2024-09-13T18:36:43.960512+0000","last_peered":"2024-09-13T18:36:43.960512+0000","last_clean":"2024-09-13T18:36:43.960512+0000","last_became_active":"2024-09-13T18:36:43.957800+0000","last_became_peered":"2024-09-13T18:36:43.957800+0000","last_unstale":"2024-09-13T18:36:43.960512+0000","last_undegraded":"2024-09-13T18:36:43.960512+0000","last_fullsized":"2024-09-13T18:36:43.960512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.950762+0000","last_change":"2024-09-13T18:36:43.540839+0000","last_active":"2024-09-13T18:36:43.950762+0000","last_peered":"2024-09-13T18:36:43.950762+0000","last_clean":"2024-09-13T18:36:43.950762+0000","last_became_active":"2024-09-13T18:36:43.540623+0000","last_became_peered":"2024-09-13T18:36:43.540623+0000","last_unstale":"2024-09-13T18:36:43.950762+0000","last_undegraded":"2024-09-13T18:36:43.950762+0000","last_fullsized":"2024-09-13T18:36:43.950762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957438+0000","last_change":"2024-09-13T18:36:43.955612+0000","last_active":"2024-09-13T18:36:43.957438+0000","last_peered":"2024-09-13T18:36:43.957438+0000","last_clean":"2024-09-13T18:36:43.957438+0000","last_became_active":"2024-09-13T18:36:43.955410+0000","last_became_peered":"2024-09-13T18:36:43.955410+0000","last_unstale":"2024-09-13T18:36:43.957438+0000","last_undegraded":"2024-09-13T18:36:43.957438+0000","last_fullsized":"2024-09-13T18:36:43.957438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:27.491146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947744+0000","last_change":"2024-09-13T18:36:43.537818+0000","last_active":"2024-09-13T18:36:43.947744+0000","last_peered":"2024-09-13T18:36:43.947744+0000","last_clean":"2024-09-13T18:36:43.947744+0000","last_became_active":"2024-09-13T18:36:43.532556+0000","last_became_peered":"2024-09-13T18:36:43.532556+0000","last_unstale":"2024-09-13T18:36:43.947744+0000","last_undegraded":"2024-09-13T18:36:43.947744+0000","last_fullsized":"2024-09-13T18:36:43.947744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955542+0000","last_change":"2024-09-13T18:36:43.953334+0000","last_active":"2024-09-13T18:36:43.955542+0000","last_peered":"2024-09-13T18:36:43.955542+0000","last_clean":"2024-09-13T18:36:43.955542+0000","last_became_active":"2024-09-13T18:36:43.950983+0000","last_became_peered":"2024-09-13T18:36:43.950983+0000","last_unstale":"2024-09-13T18:36:43.955542+0000","last_undegraded":"2024-09-13T18:36:43.955542+0000","last_fullsized":"2024-09-13T18:36:43.955542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947093+0000","last_change":"2024-09-13T18:36:43.538090+0000","last_active":"2024-09-13T18:36:43.947093+0000","last_peered":"2024-09-13T18:36:43.947093+0000","last_clean":"2024-09-13T18:36:43.947093+0000","last_became_active":"2024-09-13T18:36:43.537874+0000","last_became_peered":"2024-09-13T18:36:43.537874+0000","last_unstale":"2024-09-13T18:36:43.947093+0000","last_undegraded":"2024-09-13T18:36:43.947093+0000","last_fullsized":"2024-09-13T18:36:43.947093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:18.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948387+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:36:43.948387+0000","last_peered":"2024-09-13T18:36:43.948387+0000","last_clean":"2024-09-13T18:36:43.948387+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:36:43.948387+0000","last_undegraded":"2024-09-13T18:36:43.948387+0000","last_fullsized":"2024-09-13T18:36:43.948387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199259316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69599999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843944,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.747}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199843190,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.377},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.316},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.311}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.751}]}]}],"pool_statfs":[]}} 2024-09-13T18:36:48.897 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:36:49.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.081+0000 7fa85e800640 1 Processor -- start 2024-09-13T18:36:49.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.082+0000 7fa85e800640 1 -- start start 2024-09-13T18:36:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa85e800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa8580b0490 0x7fa85815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa85e800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580b2f00 con 0x7fa85815dee0 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa85e800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580b3150 con 0x7fa8580b3f10 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa85e800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8580b3430 con 0x7fa8580b0490 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa85815dee0 0x7fa8580afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58708/0 (socket says 172.21.15.192:58708) 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857400640 1 -- 172.21.15.192:0/2647797421 learned_addr learned my addr 172.21.15.192:0/2647797421 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857e00640 1 --2- 172.21.15.192:0/2647797421 >> v2:172.21.15.192:3300/0 conn(0x7fa8580b0490 0x7fa85815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857e00640 1 -- 172.21.15.192:0/2647797421 >> v1:172.21.15.194:6789/0 conn(0x7fa8580b3f10 legacy=0x7fa85815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857e00640 1 -- 172.21.15.192:0/2647797421 >> v1:172.21.15.192:6789/0 conn(0x7fa85815dee0 legacy=0x7fa8580afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.083+0000 7fa857e00640 1 -- 172.21.15.192:0/2647797421 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8580b3710 con 0x7fa8580b0490 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.084+0000 7fa857e00640 1 --2- 172.21.15.192:0/2647797421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8580b0490 0x7fa85815ab50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa850009d90 tx=0x7fa85002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c59963729c54848 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa856a00640 1 -- 172.21.15.192:0/2647797421 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850007740 con 0x7fa8580b0490 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa856a00640 1 -- 172.21.15.192:0/2647797421 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85002d050 con 0x7fa8580b0490 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa856a00640 1 -- 172.21.15.192:0/2647797421 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850007ac0 con 0x7fa8580b0490 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 -- 172.21.15.192:0/2647797421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8580b0490 msgr2=0x7fa85815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 --2- 172.21.15.192:0/2647797421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8580b0490 0x7fa85815ab50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fa850009d90 tx=0x7fa85002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 -- 172.21.15.192:0/2647797421 shutdown_connections 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 --2- 172.21.15.192:0/2647797421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa8580b0490 0x7fa85815ab50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 -- 172.21.15.192:0/2647797421 >> 172.21.15.192:0/2647797421 conn(0x7fa8580ae960 msgr2=0x7fa85806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 -- 172.21.15.192:0/2647797421 shutdown_connections 2024-09-13T18:36:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.085+0000 7fa85e800640 1 -- 172.21.15.192:0/2647797421 wait complete. 2024-09-13T18:36:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.087+0000 7fa85e800640 1 Processor -- start 2024-09-13T18:36:49.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.087+0000 7fa85e800640 1 -- start start 2024-09-13T18:36:49.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8580b0490 0x7fa8581f3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa858143040 0x7fa858153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858153370 con 0x7fa85815dee0 2024-09-13T18:36:49.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858152760 con 0x7fa858143040 2024-09-13T18:36:49.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa85e800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa858152a40 con 0x7fa8580b0490 2024-09-13T18:36:49.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa84ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37032/0 (socket says 172.21.15.192:37032) 2024-09-13T18:36:49.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.088+0000 7fa84ea00640 1 -- 172.21.15.192:0/241904990 learned_addr learned my addr 172.21.15.192:0/241904990 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:49.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa857400640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8580b0490 0x7fa8581f3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa857e00640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa858143040 0x7fa858153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 -- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8580b0490 msgr2=0x7fa8581f3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8580b0490 0x7fa8581f3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 -- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa858143040 msgr2=0x7fa858153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa858143040 0x7fa858153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 -- 172.21.15.192:0/241904990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850009a70 con 0x7fa85815dee0 2024-09-13T18:36:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84ea00640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa84000c430 tx=0x7fa84000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840011790 con 0x7fa85815dee0 2024-09-13T18:36:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8400118f0 con 0x7fa85815dee0 2024-09-13T18:36:49.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840011ce0 con 0x7fa85815dee0 2024-09-13T18:36:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.089+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa858152d20 con 0x7fa85815dee0 2024-09-13T18:36:49.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.090+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8581f42f0 con 0x7fa85815dee0 2024-09-13T18:36:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.091+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa858067490 con 0x7fa85815dee0 2024-09-13T18:36:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.091+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa84001c460 con 0x7fa85815dee0 2024-09-13T18:36:49.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.092+0000 7fa84fe00640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 0x7fa83406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.092+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8400892b0 con 0x7fa85815dee0 2024-09-13T18:36:49.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.092+0000 7fa857400640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 0x7fa83406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.093+0000 7fa857400640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 0x7fa83406d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa848005880 tx=0x7fa848009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.097+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa840054480 con 0x7fa85815dee0 2024-09-13T18:36:49.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.330+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa8580afd80 con 0x7fa85815dee0 2024-09-13T18:36:49.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.331+0000 7fa84fe00640 1 -- 172.21.15.192:0/241904990 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1166 (secure 0 0 0) 0x7fa840057aa0 con 0x7fa85815dee0 2024-09-13T18:36:49.335 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:49.335 INFO:teuthology.orchestra.run.smithi192.stdout:{"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":87,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252529,"num_in_osds":8,"osd_in_since":1726252524,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":2427432,"bytes_avail":1597572568,"bytes_total":1600000000,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5094}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-13T18:36:34.745607+0000","services":{"mds":{"daemons":{"summary":"","c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-13T18:36:49.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 msgr2=0x7fa83406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 0x7fa83406d0c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa848005880 tx=0x7fa848009040 comp rx=0 tx=0).stop 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 msgr2=0x7fa858142b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa84000c430 tx=0x7fa84000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 shutdown_connections 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa83406ac00 0x7fa83406d0c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa858143040 0x7fa858153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa85815dee0 0x7fa858142b00 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 --2- 172.21.15.192:0/241904990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa8580b0490 0x7fa8581f3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 >> 172.21.15.192:0/241904990 conn(0x7fa8580ae960 msgr2=0x7fa8580b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 shutdown_connections 2024-09-13T18:36:49.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.333+0000 7fa85e800640 1 -- 172.21.15.192:0/241904990 wait complete. 2024-09-13T18:36:49.353 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:36:49.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:49.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.502+0000 7f6f7ac00640 1 Processor -- start 2024-09-13T18:36:49.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.502+0000 7f6f7ac00640 1 -- start start 2024-09-13T18:36:49.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.503+0000 7f6f7ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6f740b3f10 0x7f6f7415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.503+0000 7f6f7ac00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b2f00 con 0x7f6f7415dee0 2024-09-13T18:36:49.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.503+0000 7f6f7ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b3150 con 0x7f6f740b0490 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.503+0000 7f6f7ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740b3430 con 0x7f6f740b3f10 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6f7415dee0 0x7f6f740afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:58716/0 (socket says 172.21.15.192:58716) 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73e00640 1 -- 172.21.15.192:0/2394093138 learned_addr learned my addr 172.21.15.192:0/2394093138 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73400640 1 --2- 172.21.15.192:0/2394093138 >> v2:172.21.15.194:3300/0 conn(0x7f6f740b3f10 0x7f6f7415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191687013 0 0) 0x7f6f740b2f00 con 0x7f6f7415dee0 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f58005730 con 0x7f6f7415dee0 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110376334 0 0) 0x7f6f740b3150 con 0x7f6f740b0490 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f740b2f00 con 0x7f6f740b0490 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2885752944 0 0) 0x7f6f58005730 con 0x7f6f7415dee0 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73400640 1 -- 172.21.15.192:0/2394093138 >> v1:172.21.15.194:6789/0 conn(0x7f6f740b0490 legacy=0x7f6f7415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73400640 1 -- 172.21.15.192:0/2394093138 >> v1:172.21.15.192:6789/0 conn(0x7f6f7415dee0 legacy=0x7f6f740afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.504+0000 7f6f73400640 1 -- 172.21.15.192:0/2394093138 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740b3710 con 0x7f6f740b3f10 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.505+0000 7f6f73400640 1 --2- 172.21.15.192:0/2394093138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f740b3f10 0x7f6f7415a440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097a0 tx=0x7f6f6002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad300a0ea50b1287 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64001670 con 0x7f6f740b3f10 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6002ac50 con 0x7f6f740b3f10 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f72a00640 1 -- 172.21.15.192:0/2394093138 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f60032440 con 0x7f6f740b3f10 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 -- 172.21.15.192:0/2394093138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f740b3f10 msgr2=0x7f6f7415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/2394093138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f740b3f10 0x7f6f7415a440 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6f600097a0 tx=0x7f6f6002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 -- 172.21.15.192:0/2394093138 shutdown_connections 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/2394093138 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f740b3f10 0x7f6f7415a440 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 -- 172.21.15.192:0/2394093138 >> 172.21.15.192:0/2394093138 conn(0x7f6f740ae960 msgr2=0x7f6f7406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 -- 172.21.15.192:0/2394093138 shutdown_connections 2024-09-13T18:36:49.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.506+0000 7f6f7ac00640 1 -- 172.21.15.192:0/2394093138 wait complete. 2024-09-13T18:36:49.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.508+0000 7f6f7ac00640 1 Processor -- start 2024-09-13T18:36:49.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.508+0000 7f6f7ac00640 1 -- start start 2024-09-13T18:36:49.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 0x7f6f74156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 0x7f6f74137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74156b10 con 0x7f6f740b0490 2024-09-13T18:36:49.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74153e10 con 0x7f6f7415dee0 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f7ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f741f30b0 con 0x7f6f74158e70 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37038/0 (socket says 172.21.15.192:37038) 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.509+0000 7f6f73e00640 1 -- 172.21.15.192:0/1222623255 learned_addr learned my addr 172.21.15.192:0/1222623255 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73400640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 0x7f6f74156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f78c00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 0x7f6f74137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 -- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 msgr2=0x7f6f74137400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 0x7f6f74137400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 -- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 msgr2=0x7f6f74156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 0x7f6f74156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 -- 172.21.15.192:0/1222623255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f60009400 con 0x7f6f740b0490 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73400640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 0x7f6f74156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:49.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f78c00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 0x7f6f74137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f73e00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c750 tx=0x7f6f6400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64005ad0 con 0x7f6f740b0490 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f64005c30 con 0x7f6f740b0490 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f64007070 con 0x7f6f740b0490 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f74153850 con 0x7f6f740b0490 2024-09-13T18:36:49.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.510+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f7413ff60 con 0x7f6f740b0490 2024-09-13T18:36:49.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.511+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f74156870 con 0x7f6f740b0490 2024-09-13T18:36:49.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.512+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6f640071d0 con 0x7f6f740b0490 2024-09-13T18:36:49.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.513+0000 7f6f6be00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 0x7f6f5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:49.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.513+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f640890d0 con 0x7f6f740b0490 2024-09-13T18:36:49.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.513+0000 7f6f73400640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 0x7f6f5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:49.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.514+0000 7f6f73400640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 0x7f6f5406d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f60034000 tx=0x7f6f6002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:49.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.518+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6f74156870 con 0x7f6f740b0490 2024-09-13T18:36:49.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.683+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f74156870 con 0x7f6f5406ac00 2024-09-13T18:36:49.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.690+0000 7f6f6be00640 1 -- 172.21.15.192:0/1222623255 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284764 (secure 0 0 0) 0x7f6f74156870 con 0x7f6f5406ac00 2024-09-13T18:36:49.696 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:49.697 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:36:49.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 msgr2=0x7f6f5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 0x7f6f5406d0c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6f60034000 tx=0x7f6f6002e000 comp rx=0 tx=0).stop 2024-09-13T18:36:49.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 msgr2=0x7f6f741f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:49.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6f6400c750 tx=0x7f6f6400cc10 comp rx=0 tx=0).stop 2024-09-13T18:36:49.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 shutdown_connections 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6f5406ac00 0x7f6f5406d0c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6f74158e70 0x7f6f74137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6f7415dee0 0x7f6f74156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 --2- 172.21.15.192:0/1222623255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6f740b0490 0x7f6f741f2b70 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 >> 172.21.15.192:0/1222623255 conn(0x7f6f740ae960 msgr2=0x7f6f741384e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 shutdown_connections 2024-09-13T18:36:49.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:49.694+0000 7f6f7ac00640 1 -- 172.21.15.192:0/1222623255 wait complete. 2024-09-13T18:36:49.713 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-09-13T18:36:48.747680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2370,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560129,"statfs":{"total":1600000000,"available":1597572568,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001011"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964510+0000","last_change":"2024-09-13T18:36:43.963722+0000","last_active":"2024-09-13T18:36:43.964510+0000","last_peered":"2024-09-13T18:36:43.964510+0000","last_clean":"2024-09-13T18:36:43.964510+0000","last_became_active":"2024-09-13T18:36:43.963342+0000","last_became_peered":"2024-09-13T18:36:43.963342+0000","last_unstale":"2024-09-13T18:36:43.964510+0000","last_undegraded":"2024-09-13T18:36:43.964510+0000","last_fullsized":"2024-09-13T18:36:43.964510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952115+0000","last_change":"2024-09-13T18:36:43.951551+0000","last_active":"2024-09-13T18:36:43.952115+0000","last_peered":"2024-09-13T18:36:43.952115+0000","last_clean":"2024-09-13T18:36:43.952115+0000","last_became_active":"2024-09-13T18:36:43.951076+0000","last_became_peered":"2024-09-13T18:36:43.951076+0000","last_unstale":"2024-09-13T18:36:43.952115+0000","last_undegraded":"2024-09-13T18:36:43.952115+0000","last_fullsized":"2024-09-13T18:36:43.952115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960027+0000","last_change":"2024-09-13T18:36:43.959962+0000","last_active":"2024-09-13T18:36:43.960027+0000","last_peered":"2024-09-13T18:36:43.960027+0000","last_clean":"2024-09-13T18:36:43.960027+0000","last_became_active":"2024-09-13T18:36:43.959731+0000","last_became_peered":"2024-09-13T18:36:43.959731+0000","last_unstale":"2024-09-13T18:36:43.960027+0000","last_undegraded":"2024-09-13T18:36:43.960027+0000","last_fullsized":"2024-09-13T18:36:43.960027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:07.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960528+0000","last_change":"2024-09-13T18:36:43.959182+0000","last_active":"2024-09-13T18:36:43.960528+0000","last_peered":"2024-09-13T18:36:43.960528+0000","last_clean":"2024-09-13T18:36:43.960528+0000","last_became_active":"2024-09-13T18:36:43.958131+0000","last_became_peered":"2024-09-13T18:36:43.958131+0000","last_unstale":"2024-09-13T18:36:43.960528+0000","last_undegraded":"2024-09-13T18:36:43.960528+0000","last_fullsized":"2024-09-13T18:36:43.960528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:46.448234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952129+0000","last_change":"2024-09-13T18:36:43.951863+0000","last_active":"2024-09-13T18:36:43.952129+0000","last_peered":"2024-09-13T18:36:43.952129+0000","last_clean":"2024-09-13T18:36:43.952129+0000","last_became_active":"2024-09-13T18:36:43.951639+0000","last_became_peered":"2024-09-13T18:36:43.951639+0000","last_unstale":"2024-09-13T18:36:43.952129+0000","last_undegraded":"2024-09-13T18:36:43.952129+0000","last_fullsized":"2024-09-13T18:36:43.952129+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963366+0000","last_change":"2024-09-13T18:36:43.962483+0000","last_active":"2024-09-13T18:36:43.963366+0000","last_peered":"2024-09-13T18:36:43.963366+0000","last_clean":"2024-09-13T18:36:43.963366+0000","last_became_active":"2024-09-13T18:36:43.962267+0000","last_became_peered":"2024-09-13T18:36:43.962267+0000","last_unstale":"2024-09-13T18:36:43.963366+0000","last_undegraded":"2024-09-13T18:36:43.963366+0000","last_fullsized":"2024-09-13T18:36:43.963366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960634+0000","last_change":"2024-09-13T18:36:43.960564+0000","last_active":"2024-09-13T18:36:43.960634+0000","last_peered":"2024-09-13T18:36:43.960634+0000","last_clean":"2024-09-13T18:36:43.960634+0000","last_became_active":"2024-09-13T18:36:43.960366+0000","last_became_peered":"2024-09-13T18:36:43.960366+0000","last_unstale":"2024-09-13T18:36:43.960634+0000","last_undegraded":"2024-09-13T18:36:43.960634+0000","last_fullsized":"2024-09-13T18:36:43.960634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965761+0000","last_change":"2024-09-13T18:36:43.965465+0000","last_active":"2024-09-13T18:36:43.965761+0000","last_peered":"2024-09-13T18:36:43.965761+0000","last_clean":"2024-09-13T18:36:43.965761+0000","last_became_active":"2024-09-13T18:36:43.965118+0000","last_became_peered":"2024-09-13T18:36:43.965118+0000","last_unstale":"2024-09-13T18:36:43.965761+0000","last_undegraded":"2024-09-13T18:36:43.965761+0000","last_fullsized":"2024-09-13T18:36:43.965761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954611+0000","last_change":"2024-09-13T18:36:43.953603+0000","last_active":"2024-09-13T18:36:43.954611+0000","last_peered":"2024-09-13T18:36:43.954611+0000","last_clean":"2024-09-13T18:36:43.954611+0000","last_became_active":"2024-09-13T18:36:43.953405+0000","last_became_peered":"2024-09-13T18:36:43.953405+0000","last_unstale":"2024-09-13T18:36:43.954611+0000","last_undegraded":"2024-09-13T18:36:43.954611+0000","last_fullsized":"2024-09-13T18:36:43.954611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:03.105215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962823+0000","last_change":"2024-09-13T18:36:43.962746+0000","last_active":"2024-09-13T18:36:43.962823+0000","last_peered":"2024-09-13T18:36:43.962823+0000","last_clean":"2024-09-13T18:36:43.962823+0000","last_became_active":"2024-09-13T18:36:43.961888+0000","last_became_peered":"2024-09-13T18:36:43.961888+0000","last_unstale":"2024-09-13T18:36:43.962823+0000","last_undegraded":"2024-09-13T18:36:43.962823+0000","last_fullsized":"2024-09-13T18:36:43.962823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:30.619118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957464+0000","last_change":"2024-09-13T18:36:43.956228+0000","last_active":"2024-09-13T18:36:43.957464+0000","last_peered":"2024-09-13T18:36:43.957464+0000","last_clean":"2024-09-13T18:36:43.957464+0000","last_became_active":"2024-09-13T18:36:43.956018+0000","last_became_peered":"2024-09-13T18:36:43.956018+0000","last_unstale":"2024-09-13T18:36:43.957464+0000","last_undegraded":"2024-09-13T18:36:43.957464+0000","last_fullsized":"2024-09-13T18:36:43.957464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:39.254899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954581+0000","last_change":"2024-09-13T18:36:43.952626+0000","last_active":"2024-09-13T18:36:43.954581+0000","last_peered":"2024-09-13T18:36:43.954581+0000","last_clean":"2024-09-13T18:36:43.954581+0000","last_became_active":"2024-09-13T18:36:43.952420+0000","last_became_peered":"2024-09-13T18:36:43.952420+0000","last_unstale":"2024-09-13T18:36:43.954581+0000","last_undegraded":"2024-09-13T18:36:43.954581+0000","last_fullsized":"2024-09-13T18:36:43.954581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.956853+0000","last_change":"2024-09-13T18:36:43.955491+0000","last_active":"2024-09-13T18:36:43.956853+0000","last_peered":"2024-09-13T18:36:43.956853+0000","last_clean":"2024-09-13T18:36:43.956853+0000","last_became_active":"2024-09-13T18:36:43.954987+0000","last_became_peered":"2024-09-13T18:36:43.954987+0000","last_unstale":"2024-09-13T18:36:43.956853+0000","last_undegraded":"2024-09-13T18:36:43.956853+0000","last_fullsized":"2024-09-13T18:36:43.956853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960419+0000","last_change":"2024-09-13T18:36:43.957104+0000","last_active":"2024-09-13T18:36:43.960419+0000","last_peered":"2024-09-13T18:36:43.960419+0000","last_clean":"2024-09-13T18:36:43.960419+0000","last_became_active":"2024-09-13T18:36:43.956662+0000","last_became_peered":"2024-09-13T18:36:43.956662+0000","last_unstale":"2024-09-13T18:36:43.960419+0000","last_undegraded":"2024-09-13T18:36:43.960419+0000","last_fullsized":"2024-09-13T18:36:43.960419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955564+0000","last_change":"2024-09-13T18:36:43.953677+0000","last_active":"2024-09-13T18:36:43.955564+0000","last_peered":"2024-09-13T18:36:43.955564+0000","last_clean":"2024-09-13T18:36:43.955564+0000","last_became_active":"2024-09-13T18:36:43.953082+0000","last_became_peered":"2024-09-13T18:36:43.953082+0000","last_unstale":"2024-09-13T18:36:43.955564+0000","last_undegraded":"2024-09-13T18:36:43.955564+0000","last_fullsized":"2024-09-13T18:36:43.955564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958447+0000","last_change":"2024-09-13T18:36:43.956455+0000","last_active":"2024-09-13T18:36:43.958447+0000","last_peered":"2024-09-13T18:36:43.958447+0000","last_clean":"2024-09-13T18:36:43.958447+0000","last_became_active":"2024-09-13T18:36:43.951699+0000","last_became_peered":"2024-09-13T18:36:43.951699+0000","last_unstale":"2024-09-13T18:36:43.958447+0000","last_undegraded":"2024-09-13T18:36:43.958447+0000","last_fullsized":"2024-09-13T18:36:43.958447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963980+0000","last_change":"2024-09-13T18:36:43.963926+0000","last_active":"2024-09-13T18:36:43.963980+0000","last_peered":"2024-09-13T18:36:43.963980+0000","last_clean":"2024-09-13T18:36:43.963980+0000","last_became_active":"2024-09-13T18:36:43.961097+0000","last_became_peered":"2024-09-13T18:36:43.961097+0000","last_unstale":"2024-09-13T18:36:43.963980+0000","last_undegraded":"2024-09-13T18:36:43.963980+0000","last_fullsized":"2024-09-13T18:36:43.963980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.345426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954338+0000","last_change":"2024-09-13T18:36:43.954221+0000","last_active":"2024-09-13T18:36:43.954338+0000","last_peered":"2024-09-13T18:36:43.954338+0000","last_clean":"2024-09-13T18:36:43.954338+0000","last_became_active":"2024-09-13T18:36:43.952820+0000","last_became_peered":"2024-09-13T18:36:43.952820+0000","last_unstale":"2024-09-13T18:36:43.954338+0000","last_undegraded":"2024-09-13T18:36:43.954338+0000","last_fullsized":"2024-09-13T18:36:43.954338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963266+0000","last_change":"2024-09-13T18:36:43.956584+0000","last_active":"2024-09-13T18:36:43.963266+0000","last_peered":"2024-09-13T18:36:43.963266+0000","last_clean":"2024-09-13T18:36:43.963266+0000","last_became_active":"2024-09-13T18:36:43.956350+0000","last_became_peered":"2024-09-13T18:36:43.956350+0000","last_unstale":"2024-09-13T18:36:43.963266+0000","last_undegraded":"2024-09-13T18:36:43.963266+0000","last_fullsized":"2024-09-13T18:36:43.963266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960053+0000","last_change":"2024-09-13T18:36:43.959921+0000","last_active":"2024-09-13T18:36:43.960053+0000","last_peered":"2024-09-13T18:36:43.960053+0000","last_clean":"2024-09-13T18:36:43.960053+0000","last_became_active":"2024-09-13T18:36:43.959555+0000","last_became_peered":"2024-09-13T18:36:43.959555+0000","last_unstale":"2024-09-13T18:36:43.960053+0000","last_undegraded":"2024-09-13T18:36:43.960053+0000","last_fullsized":"2024-09-13T18:36:43.960053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:11.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958468+0000","last_change":"2024-09-13T18:36:43.956592+0000","last_active":"2024-09-13T18:36:43.958468+0000","last_peered":"2024-09-13T18:36:43.958468+0000","last_clean":"2024-09-13T18:36:43.958468+0000","last_became_active":"2024-09-13T18:36:43.952134+0000","last_became_peered":"2024-09-13T18:36:43.952134+0000","last_unstale":"2024-09-13T18:36:43.958468+0000","last_undegraded":"2024-09-13T18:36:43.958468+0000","last_fullsized":"2024-09-13T18:36:43.958468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964526+0000","last_change":"2024-09-13T18:36:43.964445+0000","last_active":"2024-09-13T18:36:43.964526+0000","last_peered":"2024-09-13T18:36:43.964526+0000","last_clean":"2024-09-13T18:36:43.964526+0000","last_became_active":"2024-09-13T18:36:43.962407+0000","last_became_peered":"2024-09-13T18:36:43.962407+0000","last_unstale":"2024-09-13T18:36:43.964526+0000","last_undegraded":"2024-09-13T18:36:43.964526+0000","last_fullsized":"2024-09-13T18:36:43.964526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955535+0000","last_change":"2024-09-13T18:36:43.955333+0000","last_active":"2024-09-13T18:36:43.955535+0000","last_peered":"2024-09-13T18:36:43.955535+0000","last_clean":"2024-09-13T18:36:43.955535+0000","last_became_active":"2024-09-13T18:36:43.954543+0000","last_became_peered":"2024-09-13T18:36:43.954543+0000","last_unstale":"2024-09-13T18:36:43.955535+0000","last_undegraded":"2024-09-13T18:36:43.955535+0000","last_fullsized":"2024-09-13T18:36:43.955535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957619+0000","last_change":"2024-09-13T18:36:43.956239+0000","last_active":"2024-09-13T18:36:43.957619+0000","last_peered":"2024-09-13T18:36:43.957619+0000","last_clean":"2024-09-13T18:36:43.957619+0000","last_became_active":"2024-09-13T18:36:43.955883+0000","last_became_peered":"2024-09-13T18:36:43.955883+0000","last_unstale":"2024-09-13T18:36:43.957619+0000","last_undegraded":"2024-09-13T18:36:43.957619+0000","last_fullsized":"2024-09-13T18:36:43.957619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963097+0000","last_change":"2024-09-13T18:36:43.962890+0000","last_active":"2024-09-13T18:36:43.963097+0000","last_peered":"2024-09-13T18:36:43.963097+0000","last_clean":"2024-09-13T18:36:43.963097+0000","last_became_active":"2024-09-13T18:36:43.962355+0000","last_became_peered":"2024-09-13T18:36:43.962355+0000","last_unstale":"2024-09-13T18:36:43.963097+0000","last_undegraded":"2024-09-13T18:36:43.963097+0000","last_fullsized":"2024-09-13T18:36:43.963097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960477+0000","last_change":"2024-09-13T18:36:43.958116+0000","last_active":"2024-09-13T18:36:43.960477+0000","last_peered":"2024-09-13T18:36:43.960477+0000","last_clean":"2024-09-13T18:36:43.960477+0000","last_became_active":"2024-09-13T18:36:43.957877+0000","last_became_peered":"2024-09-13T18:36:43.957877+0000","last_unstale":"2024-09-13T18:36:43.960477+0000","last_undegraded":"2024-09-13T18:36:43.960477+0000","last_fullsized":"2024-09-13T18:36:43.960477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.952098+0000","last_change":"2024-09-13T18:36:43.951370+0000","last_active":"2024-09-13T18:36:43.952098+0000","last_peered":"2024-09-13T18:36:43.952098+0000","last_clean":"2024-09-13T18:36:43.952098+0000","last_became_active":"2024-09-13T18:36:43.950676+0000","last_became_peered":"2024-09-13T18:36:43.950676+0000","last_unstale":"2024-09-13T18:36:43.952098+0000","last_undegraded":"2024-09-13T18:36:43.952098+0000","last_fullsized":"2024-09-13T18:36:43.952098+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965396+0000","last_change":"2024-09-13T18:36:43.965333+0000","last_active":"2024-09-13T18:36:43.965396+0000","last_peered":"2024-09-13T18:36:43.965396+0000","last_clean":"2024-09-13T18:36:43.965396+0000","last_became_active":"2024-09-13T18:36:43.964837+0000","last_became_peered":"2024-09-13T18:36:43.964837+0000","last_unstale":"2024-09-13T18:36:43.965396+0000","last_undegraded":"2024-09-13T18:36:43.965396+0000","last_fullsized":"2024-09-13T18:36:43.965396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951717+0000","last_change":"2024-09-13T18:36:43.951655+0000","last_active":"2024-09-13T18:36:43.951717+0000","last_peered":"2024-09-13T18:36:43.951717+0000","last_clean":"2024-09-13T18:36:43.951717+0000","last_became_active":"2024-09-13T18:36:43.951396+0000","last_became_peered":"2024-09-13T18:36:43.951396+0000","last_unstale":"2024-09-13T18:36:43.951717+0000","last_undegraded":"2024-09-13T18:36:43.951717+0000","last_fullsized":"2024-09-13T18:36:43.951717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961660+0000","last_change":"2024-09-13T18:36:43.961399+0000","last_active":"2024-09-13T18:36:43.961660+0000","last_peered":"2024-09-13T18:36:43.961660+0000","last_clean":"2024-09-13T18:36:43.961660+0000","last_became_active":"2024-09-13T18:36:43.961167+0000","last_became_peered":"2024-09-13T18:36:43.961167+0000","last_unstale":"2024-09-13T18:36:43.961660+0000","last_undegraded":"2024-09-13T18:36:43.961660+0000","last_fullsized":"2024-09-13T18:36:43.961660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957590+0000","last_change":"2024-09-13T18:36:43.952745+0000","last_active":"2024-09-13T18:36:43.957590+0000","last_peered":"2024-09-13T18:36:43.957590+0000","last_clean":"2024-09-13T18:36:43.957590+0000","last_became_active":"2024-09-13T18:36:43.952562+0000","last_became_peered":"2024-09-13T18:36:43.952562+0000","last_unstale":"2024-09-13T18:36:43.957590+0000","last_undegraded":"2024-09-13T18:36:43.957590+0000","last_fullsized":"2024-09-13T18:36:43.957590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963827+0000","last_change":"2024-09-13T18:36:43.963772+0000","last_active":"2024-09-13T18:36:43.963827+0000","last_peered":"2024-09-13T18:36:43.963827+0000","last_clean":"2024-09-13T18:36:43.963827+0000","last_became_active":"2024-09-13T18:36:43.960955+0000","last_became_peered":"2024-09-13T18:36:43.960955+0000","last_unstale":"2024-09-13T18:36:43.963827+0000","last_undegraded":"2024-09-13T18:36:43.963827+0000","last_fullsized":"2024-09-13T18:36:43.963827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:45.408169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962743+0000","last_change":"2024-09-13T18:36:43.962666+0000","last_active":"2024-09-13T18:36:43.962743+0000","last_peered":"2024-09-13T18:36:43.962743+0000","last_clean":"2024-09-13T18:36:43.962743+0000","last_became_active":"2024-09-13T18:36:43.961367+0000","last_became_peered":"2024-09-13T18:36:43.961367+0000","last_unstale":"2024-09-13T18:36:43.962743+0000","last_undegraded":"2024-09-13T18:36:43.962743+0000","last_fullsized":"2024-09-13T18:36:43.962743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962769+0000","last_change":"2024-09-13T18:36:43.542006+0000","last_active":"2024-09-13T18:36:43.962769+0000","last_peered":"2024-09-13T18:36:43.962769+0000","last_clean":"2024-09-13T18:36:43.962769+0000","last_became_active":"2024-09-13T18:36:43.541236+0000","last_became_peered":"2024-09-13T18:36:43.541236+0000","last_unstale":"2024-09-13T18:36:43.962769+0000","last_undegraded":"2024-09-13T18:36:43.962769+0000","last_fullsized":"2024-09-13T18:36:43.962769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:53.065027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963168+0000","last_change":"2024-09-13T18:36:43.963098+0000","last_active":"2024-09-13T18:36:43.963168+0000","last_peered":"2024-09-13T18:36:43.963168+0000","last_clean":"2024-09-13T18:36:43.963168+0000","last_became_active":"2024-09-13T18:36:43.962839+0000","last_became_peered":"2024-09-13T18:36:43.962839+0000","last_unstale":"2024-09-13T18:36:43.963168+0000","last_undegraded":"2024-09-13T18:36:43.963168+0000","last_fullsized":"2024-09-13T18:36:43.963168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962673+0000","last_change":"2024-09-13T18:36:43.538000+0000","last_active":"2024-09-13T18:36:43.962673+0000","last_peered":"2024-09-13T18:36:43.962673+0000","last_clean":"2024-09-13T18:36:43.962673+0000","last_became_active":"2024-09-13T18:36:43.532918+0000","last_became_peered":"2024-09-13T18:36:43.532918+0000","last_unstale":"2024-09-13T18:36:43.962673+0000","last_undegraded":"2024-09-13T18:36:43.962673+0000","last_fullsized":"2024-09-13T18:36:43.962673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:35.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958632+0000","last_change":"2024-09-13T18:36:43.958130+0000","last_active":"2024-09-13T18:36:43.958632+0000","last_peered":"2024-09-13T18:36:43.958632+0000","last_clean":"2024-09-13T18:36:43.958632+0000","last_became_active":"2024-09-13T18:36:43.957741+0000","last_became_peered":"2024-09-13T18:36:43.957741+0000","last_unstale":"2024-09-13T18:36:43.958632+0000","last_undegraded":"2024-09-13T18:36:43.958632+0000","last_fullsized":"2024-09-13T18:36:43.958632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960055+0000","last_change":"2024-09-13T18:36:43.535124+0000","last_active":"2024-09-13T18:36:43.960055+0000","last_peered":"2024-09-13T18:36:43.960055+0000","last_clean":"2024-09-13T18:36:43.960055+0000","last_became_active":"2024-09-13T18:36:43.534854+0000","last_became_peered":"2024-09-13T18:36:43.534854+0000","last_unstale":"2024-09-13T18:36:43.960055+0000","last_undegraded":"2024-09-13T18:36:43.960055+0000","last_fullsized":"2024-09-13T18:36:43.960055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:51.263603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962406+0000","last_change":"2024-09-13T18:36:43.962146+0000","last_active":"2024-09-13T18:36:43.962406+0000","last_peered":"2024-09-13T18:36:43.962406+0000","last_clean":"2024-09-13T18:36:43.962406+0000","last_became_active":"2024-09-13T18:36:43.955896+0000","last_became_peered":"2024-09-13T18:36:43.955896+0000","last_unstale":"2024-09-13T18:36:43.962406+0000","last_undegraded":"2024-09-13T18:36:43.962406+0000","last_fullsized":"2024-09-13T18:36:43.962406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964966+0000","last_change":"2024-09-13T18:36:43.533688+0000","last_active":"2024-09-13T18:36:43.964966+0000","last_peered":"2024-09-13T18:36:43.964966+0000","last_clean":"2024-09-13T18:36:43.964966+0000","last_became_active":"2024-09-13T18:36:43.533428+0000","last_became_peered":"2024-09-13T18:36:43.533428+0000","last_unstale":"2024-09-13T18:36:43.964966+0000","last_undegraded":"2024-09-13T18:36:43.964966+0000","last_fullsized":"2024-09-13T18:36:43.964966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:17.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954597+0000","last_change":"2024-09-13T18:36:43.953056+0000","last_active":"2024-09-13T18:36:43.954597+0000","last_peered":"2024-09-13T18:36:43.954597+0000","last_clean":"2024-09-13T18:36:43.954597+0000","last_became_active":"2024-09-13T18:36:43.952866+0000","last_became_peered":"2024-09-13T18:36:43.952866+0000","last_unstale":"2024-09-13T18:36:43.954597+0000","last_undegraded":"2024-09-13T18:36:43.954597+0000","last_fullsized":"2024-09-13T18:36:43.954597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:37.492595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958861+0000","last_change":"2024-09-13T18:36:43.536543+0000","last_active":"2024-09-13T18:36:43.958861+0000","last_peered":"2024-09-13T18:36:43.958861+0000","last_clean":"2024-09-13T18:36:43.958861+0000","last_became_active":"2024-09-13T18:36:43.536207+0000","last_became_peered":"2024-09-13T18:36:43.536207+0000","last_unstale":"2024-09-13T18:36:43.958861+0000","last_undegraded":"2024-09-13T18:36:43.958861+0000","last_fullsized":"2024-09-13T18:36:43.958861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965415+0000","last_change":"2024-09-13T18:36:43.965339+0000","last_active":"2024-09-13T18:36:43.965415+0000","last_peered":"2024-09-13T18:36:43.965415+0000","last_clean":"2024-09-13T18:36:43.965415+0000","last_became_active":"2024-09-13T18:36:43.964173+0000","last_became_peered":"2024-09-13T18:36:43.964173+0000","last_unstale":"2024-09-13T18:36:43.965415+0000","last_undegraded":"2024-09-13T18:36:43.965415+0000","last_fullsized":"2024-09-13T18:36:43.965415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964585+0000","last_change":"2024-09-13T18:36:43.536837+0000","last_active":"2024-09-13T18:36:43.964585+0000","last_peered":"2024-09-13T18:36:43.964585+0000","last_clean":"2024-09-13T18:36:43.964585+0000","last_became_active":"2024-09-13T18:36:43.536577+0000","last_became_peered":"2024-09-13T18:36:43.536577+0000","last_unstale":"2024-09-13T18:36:43.964585+0000","last_undegraded":"2024-09-13T18:36:43.964585+0000","last_fullsized":"2024-09-13T18:36:43.964585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962583+0000","last_change":"2024-09-13T18:36:43.962340+0000","last_active":"2024-09-13T18:36:43.962583+0000","last_peered":"2024-09-13T18:36:43.962583+0000","last_clean":"2024-09-13T18:36:43.962583+0000","last_became_active":"2024-09-13T18:36:43.962135+0000","last_became_peered":"2024-09-13T18:36:43.962135+0000","last_unstale":"2024-09-13T18:36:43.962583+0000","last_undegraded":"2024-09-13T18:36:43.962583+0000","last_fullsized":"2024-09-13T18:36:43.962583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.942295+0000","last_change":"2024-09-13T18:36:43.534506+0000","last_active":"2024-09-13T18:36:43.942295+0000","last_peered":"2024-09-13T18:36:43.942295+0000","last_clean":"2024-09-13T18:36:43.942295+0000","last_became_active":"2024-09-13T18:36:43.534228+0000","last_became_peered":"2024-09-13T18:36:43.534228+0000","last_unstale":"2024-09-13T18:36:43.942295+0000","last_undegraded":"2024-09-13T18:36:43.942295+0000","last_fullsized":"2024-09-13T18:36:43.942295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:12.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960547+0000","last_change":"2024-09-13T18:36:43.959314+0000","last_active":"2024-09-13T18:36:43.960547+0000","last_peered":"2024-09-13T18:36:43.960547+0000","last_clean":"2024-09-13T18:36:43.960547+0000","last_became_active":"2024-09-13T18:36:43.958506+0000","last_became_peered":"2024-09-13T18:36:43.958506+0000","last_unstale":"2024-09-13T18:36:43.960547+0000","last_undegraded":"2024-09-13T18:36:43.960547+0000","last_fullsized":"2024-09-13T18:36:43.960547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949790+0000","last_change":"2024-09-13T18:36:43.528414+0000","last_active":"2024-09-13T18:36:43.949790+0000","last_peered":"2024-09-13T18:36:43.949790+0000","last_clean":"2024-09-13T18:36:43.949790+0000","last_became_active":"2024-09-13T18:36:43.528200+0000","last_became_peered":"2024-09-13T18:36:43.528200+0000","last_unstale":"2024-09-13T18:36:43.949790+0000","last_undegraded":"2024-09-13T18:36:43.949790+0000","last_fullsized":"2024-09-13T18:36:43.949790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954197+0000","last_change":"2024-09-13T18:36:43.952915+0000","last_active":"2024-09-13T18:36:43.954197+0000","last_peered":"2024-09-13T18:36:43.954197+0000","last_clean":"2024-09-13T18:36:43.954197+0000","last_became_active":"2024-09-13T18:36:43.952717+0000","last_became_peered":"2024-09-13T18:36:43.952717+0000","last_unstale":"2024-09-13T18:36:43.954197+0000","last_undegraded":"2024-09-13T18:36:43.954197+0000","last_fullsized":"2024-09-13T18:36:43.954197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.564846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.943637+0000","last_change":"2024-09-13T18:36:43.537908+0000","last_active":"2024-09-13T18:36:43.943637+0000","last_peered":"2024-09-13T18:36:43.943637+0000","last_clean":"2024-09-13T18:36:43.943637+0000","last_became_active":"2024-09-13T18:36:43.537692+0000","last_became_peered":"2024-09-13T18:36:43.537692+0000","last_unstale":"2024-09-13T18:36:43.943637+0000","last_undegraded":"2024-09-13T18:36:43.943637+0000","last_fullsized":"2024-09-13T18:36:43.943637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:46.060408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960436+0000","last_change":"2024-09-13T18:36:43.957586+0000","last_active":"2024-09-13T18:36:43.960436+0000","last_peered":"2024-09-13T18:36:43.960436+0000","last_clean":"2024-09-13T18:36:43.960436+0000","last_became_active":"2024-09-13T18:36:43.956277+0000","last_became_peered":"2024-09-13T18:36:43.956277+0000","last_unstale":"2024-09-13T18:36:43.960436+0000","last_undegraded":"2024-09-13T18:36:43.960436+0000","last_fullsized":"2024-09-13T18:36:43.960436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944365+0000","last_change":"2024-09-13T18:36:43.538915+0000","last_active":"2024-09-13T18:36:43.944365+0000","last_peered":"2024-09-13T18:36:43.944365+0000","last_clean":"2024-09-13T18:36:43.944365+0000","last_became_active":"2024-09-13T18:36:43.538537+0000","last_became_peered":"2024-09-13T18:36:43.538537+0000","last_unstale":"2024-09-13T18:36:43.944365+0000","last_undegraded":"2024-09-13T18:36:43.944365+0000","last_fullsized":"2024-09-13T18:36:43.944365+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960491+0000","last_change":"2024-09-13T18:36:43.958828+0000","last_active":"2024-09-13T18:36:43.960491+0000","last_peered":"2024-09-13T18:36:43.960491+0000","last_clean":"2024-09-13T18:36:43.960491+0000","last_became_active":"2024-09-13T18:36:43.957479+0000","last_became_peered":"2024-09-13T18:36:43.957479+0000","last_unstale":"2024-09-13T18:36:43.960491+0000","last_undegraded":"2024-09-13T18:36:43.960491+0000","last_fullsized":"2024-09-13T18:36:43.960491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:25.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960404+0000","last_change":"2024-09-13T18:36:43.541708+0000","last_active":"2024-09-13T18:36:43.960404+0000","last_peered":"2024-09-13T18:36:43.960404+0000","last_clean":"2024-09-13T18:36:43.960404+0000","last_became_active":"2024-09-13T18:36:43.538962+0000","last_became_peered":"2024-09-13T18:36:43.538962+0000","last_unstale":"2024-09-13T18:36:43.960404+0000","last_undegraded":"2024-09-13T18:36:43.960404+0000","last_fullsized":"2024-09-13T18:36:43.960404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:51.494051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954212+0000","last_change":"2024-09-13T18:36:43.953005+0000","last_active":"2024-09-13T18:36:43.954212+0000","last_peered":"2024-09-13T18:36:43.954212+0000","last_clean":"2024-09-13T18:36:43.954212+0000","last_became_active":"2024-09-13T18:36:43.952761+0000","last_became_peered":"2024-09-13T18:36:43.952761+0000","last_unstale":"2024-09-13T18:36:43.954212+0000","last_undegraded":"2024-09-13T18:36:43.954212+0000","last_fullsized":"2024-09-13T18:36:43.954212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:54.543794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966179+0000","last_change":"2024-09-13T18:36:43.535486+0000","last_active":"2024-09-13T18:36:43.966179+0000","last_peered":"2024-09-13T18:36:43.966179+0000","last_clean":"2024-09-13T18:36:43.966179+0000","last_became_active":"2024-09-13T18:36:43.535085+0000","last_became_peered":"2024-09-13T18:36:43.535085+0000","last_unstale":"2024-09-13T18:36:43.966179+0000","last_undegraded":"2024-09-13T18:36:43.966179+0000","last_fullsized":"2024-09-13T18:36:43.966179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957746+0000","last_change":"2024-09-13T18:36:43.957472+0000","last_active":"2024-09-13T18:36:43.957746+0000","last_peered":"2024-09-13T18:36:43.957746+0000","last_clean":"2024-09-13T18:36:43.957746+0000","last_became_active":"2024-09-13T18:36:43.957255+0000","last_became_peered":"2024-09-13T18:36:43.957255+0000","last_unstale":"2024-09-13T18:36:43.957746+0000","last_undegraded":"2024-09-13T18:36:43.957746+0000","last_fullsized":"2024-09-13T18:36:43.957746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:24.655907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959644+0000","last_change":"2024-09-13T18:36:43.539714+0000","last_active":"2024-09-13T18:36:43.959644+0000","last_peered":"2024-09-13T18:36:43.959644+0000","last_clean":"2024-09-13T18:36:43.959644+0000","last_became_active":"2024-09-13T18:36:43.538401+0000","last_became_peered":"2024-09-13T18:36:43.538401+0000","last_unstale":"2024-09-13T18:36:43.959644+0000","last_undegraded":"2024-09-13T18:36:43.959644+0000","last_fullsized":"2024-09-13T18:36:43.959644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960395+0000","last_change":"2024-09-13T18:36:43.956155+0000","last_active":"2024-09-13T18:36:43.960395+0000","last_peered":"2024-09-13T18:36:43.960395+0000","last_clean":"2024-09-13T18:36:43.960395+0000","last_became_active":"2024-09-13T18:36:43.954845+0000","last_became_peered":"2024-09-13T18:36:43.954845+0000","last_unstale":"2024-09-13T18:36:43.960395+0000","last_undegraded":"2024-09-13T18:36:43.960395+0000","last_fullsized":"2024-09-13T18:36:43.960395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947886+0000","last_change":"2024-09-13T18:36:43.539220+0000","last_active":"2024-09-13T18:36:43.947886+0000","last_peered":"2024-09-13T18:36:43.947886+0000","last_clean":"2024-09-13T18:36:43.947886+0000","last_became_active":"2024-09-13T18:36:43.538932+0000","last_became_peered":"2024-09-13T18:36:43.538932+0000","last_unstale":"2024-09-13T18:36:43.947886+0000","last_undegraded":"2024-09-13T18:36:43.947886+0000","last_fullsized":"2024-09-13T18:36:43.947886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962670+0000","last_change":"2024-09-13T18:36:43.961403+0000","last_active":"2024-09-13T18:36:43.962670+0000","last_peered":"2024-09-13T18:36:43.962670+0000","last_clean":"2024-09-13T18:36:43.962670+0000","last_became_active":"2024-09-13T18:36:43.960097+0000","last_became_peered":"2024-09-13T18:36:43.960097+0000","last_unstale":"2024-09-13T18:36:43.962670+0000","last_undegraded":"2024-09-13T18:36:43.962670+0000","last_fullsized":"2024-09-13T18:36:43.962670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.946479+0000","last_change":"2024-09-13T18:36:43.533866+0000","last_active":"2024-09-13T18:36:43.946479+0000","last_peered":"2024-09-13T18:36:43.946479+0000","last_clean":"2024-09-13T18:36:43.946479+0000","last_became_active":"2024-09-13T18:36:43.533584+0000","last_became_peered":"2024-09-13T18:36:43.533584+0000","last_unstale":"2024-09-13T18:36:43.946479+0000","last_undegraded":"2024-09-13T18:36:43.946479+0000","last_fullsized":"2024-09-13T18:36:43.946479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963173+0000","last_change":"2024-09-13T18:36:43.963101+0000","last_active":"2024-09-13T18:36:43.963173+0000","last_peered":"2024-09-13T18:36:43.963173+0000","last_clean":"2024-09-13T18:36:43.963173+0000","last_became_active":"2024-09-13T18:36:43.960714+0000","last_became_peered":"2024-09-13T18:36:43.960714+0000","last_unstale":"2024-09-13T18:36:43.963173+0000","last_undegraded":"2024-09-13T18:36:43.963173+0000","last_fullsized":"2024-09-13T18:36:43.963173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:28.437957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966106+0000","last_change":"2024-09-13T18:36:43.540398+0000","last_active":"2024-09-13T18:36:43.966106+0000","last_peered":"2024-09-13T18:36:43.966106+0000","last_clean":"2024-09-13T18:36:43.966106+0000","last_became_active":"2024-09-13T18:36:43.539926+0000","last_became_peered":"2024-09-13T18:36:43.539926+0000","last_unstale":"2024-09-13T18:36:43.966106+0000","last_undegraded":"2024-09-13T18:36:43.966106+0000","last_fullsized":"2024-09-13T18:36:43.966106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:04.042479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959125+0000","last_change":"2024-09-13T18:36:43.959018+0000","last_active":"2024-09-13T18:36:43.959125+0000","last_peered":"2024-09-13T18:36:43.959125+0000","last_clean":"2024-09-13T18:36:43.959125+0000","last_became_active":"2024-09-13T18:36:43.957630+0000","last_became_peered":"2024-09-13T18:36:43.957630+0000","last_unstale":"2024-09-13T18:36:43.959125+0000","last_undegraded":"2024-09-13T18:36:43.959125+0000","last_fullsized":"2024-09-13T18:36:43.959125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.386496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963322+0000","last_change":"2024-09-13T18:36:43.535513+0000","last_active":"2024-09-13T18:36:43.963322+0000","last_peered":"2024-09-13T18:36:43.963322+0000","last_clean":"2024-09-13T18:36:43.963322+0000","last_became_active":"2024-09-13T18:36:43.535276+0000","last_became_peered":"2024-09-13T18:36:43.535276+0000","last_unstale":"2024-09-13T18:36:43.963322+0000","last_undegraded":"2024-09-13T18:36:43.963322+0000","last_fullsized":"2024-09-13T18:36:43.963322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:22.809094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957232+0000","last_change":"2024-09-13T18:36:43.956988+0000","last_active":"2024-09-13T18:36:43.957232+0000","last_peered":"2024-09-13T18:36:43.957232+0000","last_clean":"2024-09-13T18:36:43.957232+0000","last_became_active":"2024-09-13T18:36:43.956788+0000","last_became_peered":"2024-09-13T18:36:43.956788+0000","last_unstale":"2024-09-13T18:36:43.957232+0000","last_undegraded":"2024-09-13T18:36:43.957232+0000","last_fullsized":"2024-09-13T18:36:43.957232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959371+0000","last_change":"2024-09-13T18:36:43.538605+0000","last_active":"2024-09-13T18:36:43.959371+0000","last_peered":"2024-09-13T18:36:43.959371+0000","last_clean":"2024-09-13T18:36:43.959371+0000","last_became_active":"2024-09-13T18:36:43.538075+0000","last_became_peered":"2024-09-13T18:36:43.538075+0000","last_unstale":"2024-09-13T18:36:43.959371+0000","last_undegraded":"2024-09-13T18:36:43.959371+0000","last_fullsized":"2024-09-13T18:36:43.959371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954276+0000","last_change":"2024-09-13T18:36:43.954197+0000","last_active":"2024-09-13T18:36:43.954276+0000","last_peered":"2024-09-13T18:36:43.954276+0000","last_clean":"2024-09-13T18:36:43.954276+0000","last_became_active":"2024-09-13T18:36:43.953917+0000","last_became_peered":"2024-09-13T18:36:43.953917+0000","last_unstale":"2024-09-13T18:36:43.954276+0000","last_undegraded":"2024-09-13T18:36:43.954276+0000","last_fullsized":"2024-09-13T18:36:43.954276+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959937+0000","last_change":"2024-09-13T18:36:43.539249+0000","last_active":"2024-09-13T18:36:43.959937+0000","last_peered":"2024-09-13T18:36:43.959937+0000","last_clean":"2024-09-13T18:36:43.959937+0000","last_became_active":"2024-09-13T18:36:43.538532+0000","last_became_peered":"2024-09-13T18:36:43.538532+0000","last_unstale":"2024-09-13T18:36:43.959937+0000","last_undegraded":"2024-09-13T18:36:43.959937+0000","last_fullsized":"2024-09-13T18:36:43.959937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949284+0000","last_change":"2024-09-13T18:36:43.949209+0000","last_active":"2024-09-13T18:36:43.949284+0000","last_peered":"2024-09-13T18:36:43.949284+0000","last_clean":"2024-09-13T18:36:43.949284+0000","last_became_active":"2024-09-13T18:36:43.948756+0000","last_became_peered":"2024-09-13T18:36:43.948756+0000","last_unstale":"2024-09-13T18:36:43.949284+0000","last_undegraded":"2024-09-13T18:36:43.949284+0000","last_fullsized":"2024-09-13T18:36:43.949284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:36.254852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944650+0000","last_change":"2024-09-13T18:36:43.535052+0000","last_active":"2024-09-13T18:36:43.944650+0000","last_peered":"2024-09-13T18:36:43.944650+0000","last_clean":"2024-09-13T18:36:43.944650+0000","last_became_active":"2024-09-13T18:36:43.534607+0000","last_became_peered":"2024-09-13T18:36:43.534607+0000","last_unstale":"2024-09-13T18:36:43.944650+0000","last_undegraded":"2024-09-13T18:36:43.944650+0000","last_fullsized":"2024-09-13T18:36:43.944650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953817+0000","last_change":"2024-09-13T18:36:43.953736+0000","last_active":"2024-09-13T18:36:43.953817+0000","last_peered":"2024-09-13T18:36:43.953817+0000","last_clean":"2024-09-13T18:36:43.953817+0000","last_became_active":"2024-09-13T18:36:43.953504+0000","last_became_peered":"2024-09-13T18:36:43.953504+0000","last_unstale":"2024-09-13T18:36:43.953817+0000","last_undegraded":"2024-09-13T18:36:43.953817+0000","last_fullsized":"2024-09-13T18:36:43.953817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:22.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961175+0000","last_change":"2024-09-13T18:36:43.532711+0000","last_active":"2024-09-13T18:36:43.961175+0000","last_peered":"2024-09-13T18:36:43.961175+0000","last_clean":"2024-09-13T18:36:43.961175+0000","last_became_active":"2024-09-13T18:36:43.532491+0000","last_became_peered":"2024-09-13T18:36:43.532491+0000","last_unstale":"2024-09-13T18:36:43.961175+0000","last_undegraded":"2024-09-13T18:36:43.961175+0000","last_fullsized":"2024-09-13T18:36:43.961175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:41.467973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947954+0000","last_change":"2024-09-13T18:36:43.947877+0000","last_active":"2024-09-13T18:36:43.947954+0000","last_peered":"2024-09-13T18:36:43.947954+0000","last_clean":"2024-09-13T18:36:43.947954+0000","last_became_active":"2024-09-13T18:36:43.947611+0000","last_became_peered":"2024-09-13T18:36:43.947611+0000","last_unstale":"2024-09-13T18:36:43.947954+0000","last_undegraded":"2024-09-13T18:36:43.947954+0000","last_fullsized":"2024-09-13T18:36:43.947954+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949739+0000","last_change":"2024-09-13T18:36:43.539178+0000","last_active":"2024-09-13T18:36:43.949739+0000","last_peered":"2024-09-13T18:36:43.949739+0000","last_clean":"2024-09-13T18:36:43.949739+0000","last_became_active":"2024-09-13T18:36:43.538927+0000","last_became_peered":"2024-09-13T18:36:43.538927+0000","last_unstale":"2024-09-13T18:36:43.949739+0000","last_undegraded":"2024-09-13T18:36:43.949739+0000","last_fullsized":"2024-09-13T18:36:43.949739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962211+0000","last_change":"2024-09-13T18:36:43.961353+0000","last_active":"2024-09-13T18:36:43.962211+0000","last_peered":"2024-09-13T18:36:43.962211+0000","last_clean":"2024-09-13T18:36:43.962211+0000","last_became_active":"2024-09-13T18:36:43.960913+0000","last_became_peered":"2024-09-13T18:36:43.960913+0000","last_unstale":"2024-09-13T18:36:43.962211+0000","last_undegraded":"2024-09-13T18:36:43.962211+0000","last_fullsized":"2024-09-13T18:36:43.962211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951896+0000","last_change":"2024-09-13T18:36:43.533289+0000","last_active":"2024-09-13T18:36:43.951896+0000","last_peered":"2024-09-13T18:36:43.951896+0000","last_clean":"2024-09-13T18:36:43.951896+0000","last_became_active":"2024-09-13T18:36:43.532827+0000","last_became_peered":"2024-09-13T18:36:43.532827+0000","last_unstale":"2024-09-13T18:36:43.951896+0000","last_undegraded":"2024-09-13T18:36:43.951896+0000","last_fullsized":"2024-09-13T18:36:43.951896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.380715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955714+0000","last_change":"2024-09-13T18:36:43.955456+0000","last_active":"2024-09-13T18:36:43.955714+0000","last_peered":"2024-09-13T18:36:43.955714+0000","last_clean":"2024-09-13T18:36:43.955714+0000","last_became_active":"2024-09-13T18:36:43.955236+0000","last_became_peered":"2024-09-13T18:36:43.955236+0000","last_unstale":"2024-09-13T18:36:43.955714+0000","last_undegraded":"2024-09-13T18:36:43.955714+0000","last_fullsized":"2024-09-13T18:36:43.955714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953374+0000","last_change":"2024-09-13T18:36:43.538739+0000","last_active":"2024-09-13T18:36:43.953374+0000","last_peered":"2024-09-13T18:36:43.953374+0000","last_clean":"2024-09-13T18:36:43.953374+0000","last_became_active":"2024-09-13T18:36:43.538227+0000","last_became_peered":"2024-09-13T18:36:43.538227+0000","last_unstale":"2024-09-13T18:36:43.953374+0000","last_undegraded":"2024-09-13T18:36:43.953374+0000","last_fullsized":"2024-09-13T18:36:43.953374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.417931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951189+0000","last_change":"2024-09-13T18:36:43.949380+0000","last_active":"2024-09-13T18:36:43.951189+0000","last_peered":"2024-09-13T18:36:43.951189+0000","last_clean":"2024-09-13T18:36:43.951189+0000","last_became_active":"2024-09-13T18:36:43.949153+0000","last_became_peered":"2024-09-13T18:36:43.949153+0000","last_unstale":"2024-09-13T18:36:43.951189+0000","last_undegraded":"2024-09-13T18:36:43.951189+0000","last_fullsized":"2024-09-13T18:36:43.951189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:11.267928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964247+0000","last_change":"2024-09-13T18:36:43.536535+0000","last_active":"2024-09-13T18:36:43.964247+0000","last_peered":"2024-09-13T18:36:43.964247+0000","last_clean":"2024-09-13T18:36:43.964247+0000","last_became_active":"2024-09-13T18:36:43.536286+0000","last_became_peered":"2024-09-13T18:36:43.536286+0000","last_unstale":"2024-09-13T18:36:43.964247+0000","last_undegraded":"2024-09-13T18:36:43.964247+0000","last_fullsized":"2024-09-13T18:36:43.964247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954230+0000","last_change":"2024-09-13T18:36:43.953747+0000","last_active":"2024-09-13T18:36:43.954230+0000","last_peered":"2024-09-13T18:36:43.954230+0000","last_clean":"2024-09-13T18:36:43.954230+0000","last_became_active":"2024-09-13T18:36:43.953522+0000","last_became_peered":"2024-09-13T18:36:43.953522+0000","last_unstale":"2024-09-13T18:36:43.954230+0000","last_undegraded":"2024-09-13T18:36:43.954230+0000","last_fullsized":"2024-09-13T18:36:43.954230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:34.120082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944131+0000","last_change":"2024-09-13T18:36:43.537515+0000","last_active":"2024-09-13T18:36:43.944131+0000","last_peered":"2024-09-13T18:36:43.944131+0000","last_clean":"2024-09-13T18:36:43.944131+0000","last_became_active":"2024-09-13T18:36:43.536247+0000","last_became_peered":"2024-09-13T18:36:43.536247+0000","last_unstale":"2024-09-13T18:36:43.944131+0000","last_undegraded":"2024-09-13T18:36:43.944131+0000","last_fullsized":"2024-09-13T18:36:43.944131+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.976877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953602+0000","last_change":"2024-09-13T18:36:43.952041+0000","last_active":"2024-09-13T18:36:43.953602+0000","last_peered":"2024-09-13T18:36:43.953602+0000","last_clean":"2024-09-13T18:36:43.953602+0000","last_became_active":"2024-09-13T18:36:43.951804+0000","last_became_peered":"2024-09-13T18:36:43.951804+0000","last_unstale":"2024-09-13T18:36:43.953602+0000","last_undegraded":"2024-09-13T18:36:43.953602+0000","last_fullsized":"2024-09-13T18:36:43.953602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:18.532726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949328+0000","last_change":"2024-09-13T18:36:43.537284+0000","last_active":"2024-09-13T18:36:43.949328+0000","last_peered":"2024-09-13T18:36:43.949328+0000","last_clean":"2024-09-13T18:36:43.949328+0000","last_became_active":"2024-09-13T18:36:43.536206+0000","last_became_peered":"2024-09-13T18:36:43.536206+0000","last_unstale":"2024-09-13T18:36:43.949328+0000","last_undegraded":"2024-09-13T18:36:43.949328+0000","last_fullsized":"2024-09-13T18:36:43.949328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951487+0000","last_change":"2024-09-13T18:36:43.951314+0000","last_active":"2024-09-13T18:36:43.951487+0000","last_peered":"2024-09-13T18:36:43.951487+0000","last_clean":"2024-09-13T18:36:43.951487+0000","last_became_active":"2024-09-13T18:36:43.951145+0000","last_became_peered":"2024-09-13T18:36:43.951145+0000","last_unstale":"2024-09-13T18:36:43.951487+0000","last_undegraded":"2024-09-13T18:36:43.951487+0000","last_fullsized":"2024-09-13T18:36:43.951487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947883+0000","last_change":"2024-09-13T18:36:43.533733+0000","last_active":"2024-09-13T18:36:43.947883+0000","last_peered":"2024-09-13T18:36:43.947883+0000","last_clean":"2024-09-13T18:36:43.947883+0000","last_became_active":"2024-09-13T18:36:43.533324+0000","last_became_peered":"2024-09-13T18:36:43.533324+0000","last_unstale":"2024-09-13T18:36:43.947883+0000","last_undegraded":"2024-09-13T18:36:43.947883+0000","last_fullsized":"2024-09-13T18:36:43.947883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955845+0000","last_change":"2024-09-13T18:36:43.955767+0000","last_active":"2024-09-13T18:36:43.955845+0000","last_peered":"2024-09-13T18:36:43.955845+0000","last_clean":"2024-09-13T18:36:43.955845+0000","last_became_active":"2024-09-13T18:36:43.954868+0000","last_became_peered":"2024-09-13T18:36:43.954868+0000","last_unstale":"2024-09-13T18:36:43.955845+0000","last_undegraded":"2024-09-13T18:36:43.955845+0000","last_fullsized":"2024-09-13T18:36:43.955845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948354+0000","last_change":"2024-09-13T18:36:43.542171+0000","last_active":"2024-09-13T18:36:43.948354+0000","last_peered":"2024-09-13T18:36:43.948354+0000","last_clean":"2024-09-13T18:36:43.948354+0000","last_became_active":"2024-09-13T18:36:43.541912+0000","last_became_peered":"2024-09-13T18:36:43.541912+0000","last_unstale":"2024-09-13T18:36:43.948354+0000","last_undegraded":"2024-09-13T18:36:43.948354+0000","last_fullsized":"2024-09-13T18:36:43.948354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960512+0000","last_change":"2024-09-13T18:36:43.959027+0000","last_active":"2024-09-13T18:36:43.960512+0000","last_peered":"2024-09-13T18:36:43.960512+0000","last_clean":"2024-09-13T18:36:43.960512+0000","last_became_active":"2024-09-13T18:36:43.957800+0000","last_became_peered":"2024-09-13T18:36:43.957800+0000","last_unstale":"2024-09-13T18:36:43.960512+0000","last_undegraded":"2024-09-13T18:36:43.960512+0000","last_fullsized":"2024-09-13T18:36:43.960512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.950762+0000","last_change":"2024-09-13T18:36:43.540839+0000","last_active":"2024-09-13T18:36:43.950762+0000","last_peered":"2024-09-13T18:36:43.950762+0000","last_clean":"2024-09-13T18:36:43.950762+0000","last_became_active":"2024-09-13T18:36:43.540623+0000","last_became_peered":"2024-09-13T18:36:43.540623+0000","last_unstale":"2024-09-13T18:36:43.950762+0000","last_undegraded":"2024-09-13T18:36:43.950762+0000","last_fullsized":"2024-09-13T18:36:43.950762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957438+0000","last_change":"2024-09-13T18:36:43.955612+0000","last_active":"2024-09-13T18:36:43.957438+0000","last_peered":"2024-09-13T18:36:43.957438+0000","last_clean":"2024-09-13T18:36:43.957438+0000","last_became_active":"2024-09-13T18:36:43.955410+0000","last_became_peered":"2024-09-13T18:36:43.955410+0000","last_unstale":"2024-09-13T18:36:43.957438+0000","last_undegraded":"2024-09-13T18:36:43.957438+0000","last_fullsized":"2024-09-13T18:36:43.957438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:27.491146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947744+0000","last_change":"2024-09-13T18:36:43.537818+0000","last_active":"2024-09-13T18:36:43.947744+0000","last_peered":"2024-09-13T18:36:43.947744+0000","last_clean":"2024-09-13T18:36:43.947744+0000","last_became_active":"2024-09-13T18:36:43.532556+0000","last_became_peered":"2024-09-13T18:36:43.532556+0000","last_unstale":"2024-09-13T18:36:43.947744+0000","last_undegraded":"2024-09-13T18:36:43.947744+0000","last_fullsized":"2024-09-13T18:36:43.947744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955542+0000","last_change":"2024-09-13T18:36:43.953334+0000","last_active":"2024-09-13T18:36:43.955542+0000","last_peered":"2024-09-13T18:36:43.955542+0000","last_clean":"2024-09-13T18:36:43.955542+0000","last_became_active":"2024-09-13T18:36:43.950983+0000","last_became_peered":"2024-09-13T18:36:43.950983+0000","last_unstale":"2024-09-13T18:36:43.955542+0000","last_undegraded":"2024-09-13T18:36:43.955542+0000","last_fullsized":"2024-09-13T18:36:43.955542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947093+0000","last_change":"2024-09-13T18:36:43.538090+0000","last_active":"2024-09-13T18:36:43.947093+0000","last_peered":"2024-09-13T18:36:43.947093+0000","last_clean":"2024-09-13T18:36:43.947093+0000","last_became_active":"2024-09-13T18:36:43.537874+0000","last_became_peered":"2024-09-13T18:36:43.537874+0000","last_unstale":"2024-09-13T18:36:43.947093+0000","last_undegraded":"2024-09-13T18:36:43.947093+0000","last_fullsized":"2024-09-13T18:36:43.947093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:18.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948387+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:36:43.948387+0000","last_peered":"2024-09-13T18:36:43.948387+0000","last_clean":"2024-09-13T18:36:43.948387+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:36:43.948387+0000","last_undegraded":"2024-09-13T18:36:43.948387+0000","last_fullsized":"2024-09-13T18:36:43.948387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542163,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":723,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194589,"statfs":{"total":200000000,"available":199259316,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.67700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.83899999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.64800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.873}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.80600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.79000000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.749},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69599999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843944,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.747}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199843190,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.377},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.316},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.311}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.751}]}]}],"pool_statfs":[]}} 2024-09-13T18:36:52.719 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:36:52.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.880+0000 7f44d8c00640 1 Processor -- start 2024-09-13T18:36:52.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.880+0000 7f44d8c00640 1 -- start start 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.881+0000 7f44d8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44d415a9e0 0x7f44d406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d40cdfd0 0x7f44d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d8c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d406c5d0 con 0x7f44d406b3d0 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d8c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d40b3730 con 0x7f44d415a9e0 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d40b3920 con 0x7f44d40cdfd0 2024-09-13T18:36:52.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44d415a9e0 0x7f44d406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f44d415a9e0 0x7f44d406ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58734/0 (socket says 172.21.15.192:58734) 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 -- 172.21.15.192:0/3463599411 learned_addr learned my addr 172.21.15.192:0/3463599411 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3e00640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d40cdfd0 0x7f44d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 -- 172.21.15.192:0/3463599411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d40cdfd0 msgr2=0x7f44d4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d40cdfd0 0x7f44d4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 -- 172.21.15.192:0/3463599411 >> v1:172.21.15.194:6789/0 conn(0x7f44d406b3d0 legacy=0x7f44d40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.882+0000 7f44d3400640 1 -- 172.21.15.192:0/3463599411 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d40b3c00 con 0x7f44d415a9e0 2024-09-13T18:36:52.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.883+0000 7f44d3400640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d415a9e0 0x7f44d406ae90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009870 tx=0x7f44c402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a9e3d5f2b25f910 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:52.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d2a00640 1 -- 172.21.15.192:0/3463599411 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4032440 con 0x7f44d415a9e0 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d2a00640 1 -- 172.21.15.192:0/3463599411 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c40325a0 con 0x7f44d415a9e0 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d2a00640 1 -- 172.21.15.192:0/3463599411 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c4032930 con 0x7f44d415a9e0 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 -- 172.21.15.192:0/3463599411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d415a9e0 msgr2=0x7f44d406ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d415a9e0 0x7f44d406ae90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f44c4009870 tx=0x7f44c402a250 comp rx=0 tx=0).stop 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 -- 172.21.15.192:0/3463599411 shutdown_connections 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d40cdfd0 0x7f44d4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3463599411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d415a9e0 0x7f44d406ae90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 -- 172.21.15.192:0/3463599411 >> 172.21.15.192:0/3463599411 conn(0x7f44d40736d0 msgr2=0x7f44d40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 -- 172.21.15.192:0/3463599411 shutdown_connections 2024-09-13T18:36:52.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.884+0000 7f44d8c00640 1 -- 172.21.15.192:0/3463599411 wait complete. 2024-09-13T18:36:52.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.886+0000 7f44d8c00640 1 Processor -- start 2024-09-13T18:36:52.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.886+0000 7f44d8c00640 1 -- start start 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d406b3d0 0x7f44d414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d415a9e0 0x7f44d41f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41f3a50 con 0x7f44d40cdfd0 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41506f0 con 0x7f44d415a9e0 2024-09-13T18:36:52.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d41509d0 con 0x7f44d406b3d0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44caa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44caa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58736/0 (socket says 172.21.15.192:58736) 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44caa00640 1 -- 172.21.15.192:0/3894455498 learned_addr learned my addr 172.21.15.192:0/3894455498 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d3400640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d406b3d0 0x7f44d414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.887+0000 7f44d3e00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d415a9e0 0x7f44d41f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 -- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d406b3d0 msgr2=0x7f44d414fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d406b3d0 0x7f44d414fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 -- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d415a9e0 msgr2=0x7f44d41f41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d415a9e0 0x7f44d41f41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 -- 172.21.15.192:0/3894455498 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40094d0 con 0x7f44d40cdfd0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44caa00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c400 tx=0x7f44bc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:52.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc0052d0 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44bc005430 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44bc003830 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d4150cb0 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.888+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d4141bb0 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.889+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d41f3ee0 con 0x7f44d40cdfd0 2024-09-13T18:36:52.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.890+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f44bc003990 con 0x7f44d40cdfd0 2024-09-13T18:36:52.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.891+0000 7f44cbe00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 0x7f44b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:52.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.892+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f44bc088950 con 0x7f44d40cdfd0 2024-09-13T18:36:52.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.892+0000 7f44d3400640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 0x7f44b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:52.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.892+0000 7f44d3400640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 0x7f44b006d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:52.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:52.896+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f44d41f3ee0 con 0x7f44d40cdfd0 2024-09-13T18:36:53.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.062+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44d406a970 con 0x7f44b006ac00 2024-09-13T18:36:53.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.069+0000 7f44cbe00640 1 -- 172.21.15.192:0/3894455498 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284783 (secure 0 0 0) 0x7f44c40329c0 con 0x7f44b006ac00 2024-09-13T18:36:53.075 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:53.077 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.073+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 msgr2=0x7f44b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.073+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 0x7f44b006d0c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f44c4034000 tx=0x7f44c402e000 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.073+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 msgr2=0x7f44d41efd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.073+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f44bc00c400 tx=0x7f44bc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 shutdown_connections 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f44b006ac00 0x7f44b006d0c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44d415a9e0 0x7f44d41f41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44d40cdfd0 0x7f44d41efd20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 --2- 172.21.15.192:0/3894455498 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44d406b3d0 0x7f44d414fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 >> 172.21.15.192:0/3894455498 conn(0x7f44d40736d0 msgr2=0x7f44d4154f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:53.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 shutdown_connections 2024-09-13T18:36:53.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.074+0000 7f44d8c00640 1 -- 172.21.15.192:0/3894455498 wait complete. 2024-09-13T18:36:53.092 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-13T18:36:52.748549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":165,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2376,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560123,"statfs":{"total":1600000000,"available":1597566268,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.807632"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964510+0000","last_change":"2024-09-13T18:36:43.963722+0000","last_active":"2024-09-13T18:36:43.964510+0000","last_peered":"2024-09-13T18:36:43.964510+0000","last_clean":"2024-09-13T18:36:43.964510+0000","last_became_active":"2024-09-13T18:36:43.963342+0000","last_became_peered":"2024-09-13T18:36:43.963342+0000","last_unstale":"2024-09-13T18:36:43.964510+0000","last_undegraded":"2024-09-13T18:36:43.964510+0000","last_fullsized":"2024-09-13T18:36:43.964510+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748232+0000","last_change":"2024-09-13T18:36:43.951551+0000","last_active":"2024-09-13T18:36:44.748232+0000","last_peered":"2024-09-13T18:36:44.748232+0000","last_clean":"2024-09-13T18:36:44.748232+0000","last_became_active":"2024-09-13T18:36:43.951076+0000","last_became_peered":"2024-09-13T18:36:43.951076+0000","last_unstale":"2024-09-13T18:36:44.748232+0000","last_undegraded":"2024-09-13T18:36:44.748232+0000","last_fullsized":"2024-09-13T18:36:44.748232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960027+0000","last_change":"2024-09-13T18:36:43.959962+0000","last_active":"2024-09-13T18:36:43.960027+0000","last_peered":"2024-09-13T18:36:43.960027+0000","last_clean":"2024-09-13T18:36:43.960027+0000","last_became_active":"2024-09-13T18:36:43.959731+0000","last_became_peered":"2024-09-13T18:36:43.959731+0000","last_unstale":"2024-09-13T18:36:43.960027+0000","last_undegraded":"2024-09-13T18:36:43.960027+0000","last_fullsized":"2024-09-13T18:36:43.960027+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:07.064724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960528+0000","last_change":"2024-09-13T18:36:43.959182+0000","last_active":"2024-09-13T18:36:43.960528+0000","last_peered":"2024-09-13T18:36:43.960528+0000","last_clean":"2024-09-13T18:36:43.960528+0000","last_became_active":"2024-09-13T18:36:43.958131+0000","last_became_peered":"2024-09-13T18:36:43.958131+0000","last_unstale":"2024-09-13T18:36:43.960528+0000","last_undegraded":"2024-09-13T18:36:43.960528+0000","last_fullsized":"2024-09-13T18:36:43.960528+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:46.448234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748290+0000","last_change":"2024-09-13T18:36:43.951863+0000","last_active":"2024-09-13T18:36:44.748290+0000","last_peered":"2024-09-13T18:36:44.748290+0000","last_clean":"2024-09-13T18:36:44.748290+0000","last_became_active":"2024-09-13T18:36:43.951639+0000","last_became_peered":"2024-09-13T18:36:43.951639+0000","last_unstale":"2024-09-13T18:36:44.748290+0000","last_undegraded":"2024-09-13T18:36:44.748290+0000","last_fullsized":"2024-09-13T18:36:44.748290+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963366+0000","last_change":"2024-09-13T18:36:43.962483+0000","last_active":"2024-09-13T18:36:43.963366+0000","last_peered":"2024-09-13T18:36:43.963366+0000","last_clean":"2024-09-13T18:36:43.963366+0000","last_became_active":"2024-09-13T18:36:43.962267+0000","last_became_peered":"2024-09-13T18:36:43.962267+0000","last_unstale":"2024-09-13T18:36:43.963366+0000","last_undegraded":"2024-09-13T18:36:43.963366+0000","last_fullsized":"2024-09-13T18:36:43.963366+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960634+0000","last_change":"2024-09-13T18:36:43.960564+0000","last_active":"2024-09-13T18:36:43.960634+0000","last_peered":"2024-09-13T18:36:43.960634+0000","last_clean":"2024-09-13T18:36:43.960634+0000","last_became_active":"2024-09-13T18:36:43.960366+0000","last_became_peered":"2024-09-13T18:36:43.960366+0000","last_unstale":"2024-09-13T18:36:43.960634+0000","last_undegraded":"2024-09-13T18:36:43.960634+0000","last_fullsized":"2024-09-13T18:36:43.960634+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965761+0000","last_change":"2024-09-13T18:36:43.965465+0000","last_active":"2024-09-13T18:36:43.965761+0000","last_peered":"2024-09-13T18:36:43.965761+0000","last_clean":"2024-09-13T18:36:43.965761+0000","last_became_active":"2024-09-13T18:36:43.965118+0000","last_became_peered":"2024-09-13T18:36:43.965118+0000","last_unstale":"2024-09-13T18:36:43.965761+0000","last_undegraded":"2024-09-13T18:36:43.965761+0000","last_fullsized":"2024-09-13T18:36:43.965761+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954611+0000","last_change":"2024-09-13T18:36:43.953603+0000","last_active":"2024-09-13T18:36:43.954611+0000","last_peered":"2024-09-13T18:36:43.954611+0000","last_clean":"2024-09-13T18:36:43.954611+0000","last_became_active":"2024-09-13T18:36:43.953405+0000","last_became_peered":"2024-09-13T18:36:43.953405+0000","last_unstale":"2024-09-13T18:36:43.954611+0000","last_undegraded":"2024-09-13T18:36:43.954611+0000","last_fullsized":"2024-09-13T18:36:43.954611+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:03.105215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962823+0000","last_change":"2024-09-13T18:36:43.962746+0000","last_active":"2024-09-13T18:36:43.962823+0000","last_peered":"2024-09-13T18:36:43.962823+0000","last_clean":"2024-09-13T18:36:43.962823+0000","last_became_active":"2024-09-13T18:36:43.961888+0000","last_became_peered":"2024-09-13T18:36:43.961888+0000","last_unstale":"2024-09-13T18:36:43.962823+0000","last_undegraded":"2024-09-13T18:36:43.962823+0000","last_fullsized":"2024-09-13T18:36:43.962823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:30.619118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957464+0000","last_change":"2024-09-13T18:36:43.956228+0000","last_active":"2024-09-13T18:36:43.957464+0000","last_peered":"2024-09-13T18:36:43.957464+0000","last_clean":"2024-09-13T18:36:43.957464+0000","last_became_active":"2024-09-13T18:36:43.956018+0000","last_became_peered":"2024-09-13T18:36:43.956018+0000","last_unstale":"2024-09-13T18:36:43.957464+0000","last_undegraded":"2024-09-13T18:36:43.957464+0000","last_fullsized":"2024-09-13T18:36:43.957464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:38:39.254899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954581+0000","last_change":"2024-09-13T18:36:43.952626+0000","last_active":"2024-09-13T18:36:43.954581+0000","last_peered":"2024-09-13T18:36:43.954581+0000","last_clean":"2024-09-13T18:36:43.954581+0000","last_became_active":"2024-09-13T18:36:43.952420+0000","last_became_peered":"2024-09-13T18:36:43.952420+0000","last_unstale":"2024-09-13T18:36:43.954581+0000","last_undegraded":"2024-09-13T18:36:43.954581+0000","last_fullsized":"2024-09-13T18:36:43.954581+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.956853+0000","last_change":"2024-09-13T18:36:43.955491+0000","last_active":"2024-09-13T18:36:43.956853+0000","last_peered":"2024-09-13T18:36:43.956853+0000","last_clean":"2024-09-13T18:36:43.956853+0000","last_became_active":"2024-09-13T18:36:43.954987+0000","last_became_peered":"2024-09-13T18:36:43.954987+0000","last_unstale":"2024-09-13T18:36:43.956853+0000","last_undegraded":"2024-09-13T18:36:43.956853+0000","last_fullsized":"2024-09-13T18:36:43.956853+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960419+0000","last_change":"2024-09-13T18:36:43.957104+0000","last_active":"2024-09-13T18:36:43.960419+0000","last_peered":"2024-09-13T18:36:43.960419+0000","last_clean":"2024-09-13T18:36:43.960419+0000","last_became_active":"2024-09-13T18:36:43.956662+0000","last_became_peered":"2024-09-13T18:36:43.956662+0000","last_unstale":"2024-09-13T18:36:43.960419+0000","last_undegraded":"2024-09-13T18:36:43.960419+0000","last_fullsized":"2024-09-13T18:36:43.960419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955564+0000","last_change":"2024-09-13T18:36:43.953677+0000","last_active":"2024-09-13T18:36:43.955564+0000","last_peered":"2024-09-13T18:36:43.955564+0000","last_clean":"2024-09-13T18:36:43.955564+0000","last_became_active":"2024-09-13T18:36:43.953082+0000","last_became_peered":"2024-09-13T18:36:43.953082+0000","last_unstale":"2024-09-13T18:36:43.955564+0000","last_undegraded":"2024-09-13T18:36:43.955564+0000","last_fullsized":"2024-09-13T18:36:43.955564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:58.415886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958447+0000","last_change":"2024-09-13T18:36:43.956455+0000","last_active":"2024-09-13T18:36:43.958447+0000","last_peered":"2024-09-13T18:36:43.958447+0000","last_clean":"2024-09-13T18:36:43.958447+0000","last_became_active":"2024-09-13T18:36:43.951699+0000","last_became_peered":"2024-09-13T18:36:43.951699+0000","last_unstale":"2024-09-13T18:36:43.958447+0000","last_undegraded":"2024-09-13T18:36:43.958447+0000","last_fullsized":"2024-09-13T18:36:43.958447+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.937131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963980+0000","last_change":"2024-09-13T18:36:43.963926+0000","last_active":"2024-09-13T18:36:43.963980+0000","last_peered":"2024-09-13T18:36:43.963980+0000","last_clean":"2024-09-13T18:36:43.963980+0000","last_became_active":"2024-09-13T18:36:43.961097+0000","last_became_peered":"2024-09-13T18:36:43.961097+0000","last_unstale":"2024-09-13T18:36:43.963980+0000","last_undegraded":"2024-09-13T18:36:43.963980+0000","last_fullsized":"2024-09-13T18:36:43.963980+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.345426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954338+0000","last_change":"2024-09-13T18:36:43.954221+0000","last_active":"2024-09-13T18:36:43.954338+0000","last_peered":"2024-09-13T18:36:43.954338+0000","last_clean":"2024-09-13T18:36:43.954338+0000","last_became_active":"2024-09-13T18:36:43.952820+0000","last_became_peered":"2024-09-13T18:36:43.952820+0000","last_unstale":"2024-09-13T18:36:43.954338+0000","last_undegraded":"2024-09-13T18:36:43.954338+0000","last_fullsized":"2024-09-13T18:36:43.954338+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963266+0000","last_change":"2024-09-13T18:36:43.956584+0000","last_active":"2024-09-13T18:36:43.963266+0000","last_peered":"2024-09-13T18:36:43.963266+0000","last_clean":"2024-09-13T18:36:43.963266+0000","last_became_active":"2024-09-13T18:36:43.956350+0000","last_became_peered":"2024-09-13T18:36:43.956350+0000","last_unstale":"2024-09-13T18:36:43.963266+0000","last_undegraded":"2024-09-13T18:36:43.963266+0000","last_fullsized":"2024-09-13T18:36:43.963266+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:10.401967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960053+0000","last_change":"2024-09-13T18:36:43.959921+0000","last_active":"2024-09-13T18:36:43.960053+0000","last_peered":"2024-09-13T18:36:43.960053+0000","last_clean":"2024-09-13T18:36:43.960053+0000","last_became_active":"2024-09-13T18:36:43.959555+0000","last_became_peered":"2024-09-13T18:36:43.959555+0000","last_unstale":"2024-09-13T18:36:43.960053+0000","last_undegraded":"2024-09-13T18:36:43.960053+0000","last_fullsized":"2024-09-13T18:36:43.960053+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:11.018521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958468+0000","last_change":"2024-09-13T18:36:43.956592+0000","last_active":"2024-09-13T18:36:43.958468+0000","last_peered":"2024-09-13T18:36:43.958468+0000","last_clean":"2024-09-13T18:36:43.958468+0000","last_became_active":"2024-09-13T18:36:43.952134+0000","last_became_peered":"2024-09-13T18:36:43.952134+0000","last_unstale":"2024-09-13T18:36:43.958468+0000","last_undegraded":"2024-09-13T18:36:43.958468+0000","last_fullsized":"2024-09-13T18:36:43.958468+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964526+0000","last_change":"2024-09-13T18:36:43.964445+0000","last_active":"2024-09-13T18:36:43.964526+0000","last_peered":"2024-09-13T18:36:43.964526+0000","last_clean":"2024-09-13T18:36:43.964526+0000","last_became_active":"2024-09-13T18:36:43.962407+0000","last_became_peered":"2024-09-13T18:36:43.962407+0000","last_unstale":"2024-09-13T18:36:43.964526+0000","last_undegraded":"2024-09-13T18:36:43.964526+0000","last_fullsized":"2024-09-13T18:36:43.964526+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955535+0000","last_change":"2024-09-13T18:36:43.955333+0000","last_active":"2024-09-13T18:36:43.955535+0000","last_peered":"2024-09-13T18:36:43.955535+0000","last_clean":"2024-09-13T18:36:43.955535+0000","last_became_active":"2024-09-13T18:36:43.954543+0000","last_became_peered":"2024-09-13T18:36:43.954543+0000","last_unstale":"2024-09-13T18:36:43.955535+0000","last_undegraded":"2024-09-13T18:36:43.955535+0000","last_fullsized":"2024-09-13T18:36:43.955535+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:07.979218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957619+0000","last_change":"2024-09-13T18:36:43.956239+0000","last_active":"2024-09-13T18:36:43.957619+0000","last_peered":"2024-09-13T18:36:43.957619+0000","last_clean":"2024-09-13T18:36:43.957619+0000","last_became_active":"2024-09-13T18:36:43.955883+0000","last_became_peered":"2024-09-13T18:36:43.955883+0000","last_unstale":"2024-09-13T18:36:43.957619+0000","last_undegraded":"2024-09-13T18:36:43.957619+0000","last_fullsized":"2024-09-13T18:36:43.957619+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963097+0000","last_change":"2024-09-13T18:36:43.962890+0000","last_active":"2024-09-13T18:36:43.963097+0000","last_peered":"2024-09-13T18:36:43.963097+0000","last_clean":"2024-09-13T18:36:43.963097+0000","last_became_active":"2024-09-13T18:36:43.962355+0000","last_became_peered":"2024-09-13T18:36:43.962355+0000","last_unstale":"2024-09-13T18:36:43.963097+0000","last_undegraded":"2024-09-13T18:36:43.963097+0000","last_fullsized":"2024-09-13T18:36:43.963097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:47.013019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960477+0000","last_change":"2024-09-13T18:36:43.958116+0000","last_active":"2024-09-13T18:36:43.960477+0000","last_peered":"2024-09-13T18:36:43.960477+0000","last_clean":"2024-09-13T18:36:43.960477+0000","last_became_active":"2024-09-13T18:36:43.957877+0000","last_became_peered":"2024-09-13T18:36:43.957877+0000","last_unstale":"2024-09-13T18:36:43.960477+0000","last_undegraded":"2024-09-13T18:36:43.960477+0000","last_fullsized":"2024-09-13T18:36:43.960477+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748244+0000","last_change":"2024-09-13T18:36:43.951370+0000","last_active":"2024-09-13T18:36:44.748244+0000","last_peered":"2024-09-13T18:36:44.748244+0000","last_clean":"2024-09-13T18:36:44.748244+0000","last_became_active":"2024-09-13T18:36:43.950676+0000","last_became_peered":"2024-09-13T18:36:43.950676+0000","last_unstale":"2024-09-13T18:36:44.748244+0000","last_undegraded":"2024-09-13T18:36:44.748244+0000","last_fullsized":"2024-09-13T18:36:44.748244+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965396+0000","last_change":"2024-09-13T18:36:43.965333+0000","last_active":"2024-09-13T18:36:43.965396+0000","last_peered":"2024-09-13T18:36:43.965396+0000","last_clean":"2024-09-13T18:36:43.965396+0000","last_became_active":"2024-09-13T18:36:43.964837+0000","last_became_peered":"2024-09-13T18:36:43.964837+0000","last_unstale":"2024-09-13T18:36:43.965396+0000","last_undegraded":"2024-09-13T18:36:43.965396+0000","last_fullsized":"2024-09-13T18:36:43.965396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951717+0000","last_change":"2024-09-13T18:36:43.951655+0000","last_active":"2024-09-13T18:36:43.951717+0000","last_peered":"2024-09-13T18:36:43.951717+0000","last_clean":"2024-09-13T18:36:43.951717+0000","last_became_active":"2024-09-13T18:36:43.951396+0000","last_became_peered":"2024-09-13T18:36:43.951396+0000","last_unstale":"2024-09-13T18:36:43.951717+0000","last_undegraded":"2024-09-13T18:36:43.951717+0000","last_fullsized":"2024-09-13T18:36:43.951717+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.961660+0000","last_change":"2024-09-13T18:36:43.961399+0000","last_active":"2024-09-13T18:36:43.961660+0000","last_peered":"2024-09-13T18:36:43.961660+0000","last_clean":"2024-09-13T18:36:43.961660+0000","last_became_active":"2024-09-13T18:36:43.961167+0000","last_became_peered":"2024-09-13T18:36:43.961167+0000","last_unstale":"2024-09-13T18:36:43.961660+0000","last_undegraded":"2024-09-13T18:36:43.961660+0000","last_fullsized":"2024-09-13T18:36:43.961660+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957590+0000","last_change":"2024-09-13T18:36:43.952745+0000","last_active":"2024-09-13T18:36:43.957590+0000","last_peered":"2024-09-13T18:36:43.957590+0000","last_clean":"2024-09-13T18:36:43.957590+0000","last_became_active":"2024-09-13T18:36:43.952562+0000","last_became_peered":"2024-09-13T18:36:43.952562+0000","last_unstale":"2024-09-13T18:36:43.957590+0000","last_undegraded":"2024-09-13T18:36:43.957590+0000","last_fullsized":"2024-09-13T18:36:43.957590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963827+0000","last_change":"2024-09-13T18:36:43.963772+0000","last_active":"2024-09-13T18:36:43.963827+0000","last_peered":"2024-09-13T18:36:43.963827+0000","last_clean":"2024-09-13T18:36:43.963827+0000","last_became_active":"2024-09-13T18:36:43.960955+0000","last_became_peered":"2024-09-13T18:36:43.960955+0000","last_unstale":"2024-09-13T18:36:43.963827+0000","last_undegraded":"2024-09-13T18:36:43.963827+0000","last_fullsized":"2024-09-13T18:36:43.963827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:33:45.408169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962743+0000","last_change":"2024-09-13T18:36:43.962666+0000","last_active":"2024-09-13T18:36:43.962743+0000","last_peered":"2024-09-13T18:36:43.962743+0000","last_clean":"2024-09-13T18:36:43.962743+0000","last_became_active":"2024-09-13T18:36:43.961367+0000","last_became_peered":"2024-09-13T18:36:43.961367+0000","last_unstale":"2024-09-13T18:36:43.962743+0000","last_undegraded":"2024-09-13T18:36:43.962743+0000","last_fullsized":"2024-09-13T18:36:43.962743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:57:09.565544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962769+0000","last_change":"2024-09-13T18:36:43.542006+0000","last_active":"2024-09-13T18:36:43.962769+0000","last_peered":"2024-09-13T18:36:43.962769+0000","last_clean":"2024-09-13T18:36:43.962769+0000","last_became_active":"2024-09-13T18:36:43.541236+0000","last_became_peered":"2024-09-13T18:36:43.541236+0000","last_unstale":"2024-09-13T18:36:43.962769+0000","last_undegraded":"2024-09-13T18:36:43.962769+0000","last_fullsized":"2024-09-13T18:36:43.962769+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:53.065027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963168+0000","last_change":"2024-09-13T18:36:43.963098+0000","last_active":"2024-09-13T18:36:43.963168+0000","last_peered":"2024-09-13T18:36:43.963168+0000","last_clean":"2024-09-13T18:36:43.963168+0000","last_became_active":"2024-09-13T18:36:43.962839+0000","last_became_peered":"2024-09-13T18:36:43.962839+0000","last_unstale":"2024-09-13T18:36:43.963168+0000","last_undegraded":"2024-09-13T18:36:43.963168+0000","last_fullsized":"2024-09-13T18:36:43.963168+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962673+0000","last_change":"2024-09-13T18:36:43.538000+0000","last_active":"2024-09-13T18:36:43.962673+0000","last_peered":"2024-09-13T18:36:43.962673+0000","last_clean":"2024-09-13T18:36:43.962673+0000","last_became_active":"2024-09-13T18:36:43.532918+0000","last_became_peered":"2024-09-13T18:36:43.532918+0000","last_unstale":"2024-09-13T18:36:43.962673+0000","last_undegraded":"2024-09-13T18:36:43.962673+0000","last_fullsized":"2024-09-13T18:36:43.962673+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:35.252511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958632+0000","last_change":"2024-09-13T18:36:43.958130+0000","last_active":"2024-09-13T18:36:43.958632+0000","last_peered":"2024-09-13T18:36:43.958632+0000","last_clean":"2024-09-13T18:36:43.958632+0000","last_became_active":"2024-09-13T18:36:43.957741+0000","last_became_peered":"2024-09-13T18:36:43.957741+0000","last_unstale":"2024-09-13T18:36:43.958632+0000","last_undegraded":"2024-09-13T18:36:43.958632+0000","last_fullsized":"2024-09-13T18:36:43.958632+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:06.428045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960055+0000","last_change":"2024-09-13T18:36:43.535124+0000","last_active":"2024-09-13T18:36:43.960055+0000","last_peered":"2024-09-13T18:36:43.960055+0000","last_clean":"2024-09-13T18:36:43.960055+0000","last_became_active":"2024-09-13T18:36:43.534854+0000","last_became_peered":"2024-09-13T18:36:43.534854+0000","last_unstale":"2024-09-13T18:36:43.960055+0000","last_undegraded":"2024-09-13T18:36:43.960055+0000","last_fullsized":"2024-09-13T18:36:43.960055+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:49:51.263603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962406+0000","last_change":"2024-09-13T18:36:43.962146+0000","last_active":"2024-09-13T18:36:43.962406+0000","last_peered":"2024-09-13T18:36:43.962406+0000","last_clean":"2024-09-13T18:36:43.962406+0000","last_became_active":"2024-09-13T18:36:43.955896+0000","last_became_peered":"2024-09-13T18:36:43.955896+0000","last_unstale":"2024-09-13T18:36:43.962406+0000","last_undegraded":"2024-09-13T18:36:43.962406+0000","last_fullsized":"2024-09-13T18:36:43.962406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964966+0000","last_change":"2024-09-13T18:36:43.533688+0000","last_active":"2024-09-13T18:36:43.964966+0000","last_peered":"2024-09-13T18:36:43.964966+0000","last_clean":"2024-09-13T18:36:43.964966+0000","last_became_active":"2024-09-13T18:36:43.533428+0000","last_became_peered":"2024-09-13T18:36:43.533428+0000","last_unstale":"2024-09-13T18:36:43.964966+0000","last_undegraded":"2024-09-13T18:36:43.964966+0000","last_fullsized":"2024-09-13T18:36:43.964966+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:17.065479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954597+0000","last_change":"2024-09-13T18:36:43.953056+0000","last_active":"2024-09-13T18:36:43.954597+0000","last_peered":"2024-09-13T18:36:43.954597+0000","last_clean":"2024-09-13T18:36:43.954597+0000","last_became_active":"2024-09-13T18:36:43.952866+0000","last_became_peered":"2024-09-13T18:36:43.952866+0000","last_unstale":"2024-09-13T18:36:43.954597+0000","last_undegraded":"2024-09-13T18:36:43.954597+0000","last_fullsized":"2024-09-13T18:36:43.954597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:37.492595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.958861+0000","last_change":"2024-09-13T18:36:43.536543+0000","last_active":"2024-09-13T18:36:43.958861+0000","last_peered":"2024-09-13T18:36:43.958861+0000","last_clean":"2024-09-13T18:36:43.958861+0000","last_became_active":"2024-09-13T18:36:43.536207+0000","last_became_peered":"2024-09-13T18:36:43.536207+0000","last_unstale":"2024-09-13T18:36:43.958861+0000","last_undegraded":"2024-09-13T18:36:43.958861+0000","last_fullsized":"2024-09-13T18:36:43.958861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.965415+0000","last_change":"2024-09-13T18:36:43.965339+0000","last_active":"2024-09-13T18:36:43.965415+0000","last_peered":"2024-09-13T18:36:43.965415+0000","last_clean":"2024-09-13T18:36:43.965415+0000","last_became_active":"2024-09-13T18:36:43.964173+0000","last_became_peered":"2024-09-13T18:36:43.964173+0000","last_unstale":"2024-09-13T18:36:43.965415+0000","last_undegraded":"2024-09-13T18:36:43.965415+0000","last_fullsized":"2024-09-13T18:36:43.965415+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964585+0000","last_change":"2024-09-13T18:36:43.536837+0000","last_active":"2024-09-13T18:36:43.964585+0000","last_peered":"2024-09-13T18:36:43.964585+0000","last_clean":"2024-09-13T18:36:43.964585+0000","last_became_active":"2024-09-13T18:36:43.536577+0000","last_became_peered":"2024-09-13T18:36:43.536577+0000","last_unstale":"2024-09-13T18:36:43.964585+0000","last_undegraded":"2024-09-13T18:36:43.964585+0000","last_fullsized":"2024-09-13T18:36:43.964585+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962583+0000","last_change":"2024-09-13T18:36:43.962340+0000","last_active":"2024-09-13T18:36:43.962583+0000","last_peered":"2024-09-13T18:36:43.962583+0000","last_clean":"2024-09-13T18:36:43.962583+0000","last_became_active":"2024-09-13T18:36:43.962135+0000","last_became_peered":"2024-09-13T18:36:43.962135+0000","last_unstale":"2024-09-13T18:36:43.962583+0000","last_undegraded":"2024-09-13T18:36:43.962583+0000","last_fullsized":"2024-09-13T18:36:43.962583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:18.067821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.942295+0000","last_change":"2024-09-13T18:36:43.534506+0000","last_active":"2024-09-13T18:36:43.942295+0000","last_peered":"2024-09-13T18:36:43.942295+0000","last_clean":"2024-09-13T18:36:43.942295+0000","last_became_active":"2024-09-13T18:36:43.534228+0000","last_became_peered":"2024-09-13T18:36:43.534228+0000","last_unstale":"2024-09-13T18:36:43.942295+0000","last_undegraded":"2024-09-13T18:36:43.942295+0000","last_fullsized":"2024-09-13T18:36:43.942295+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:12.039479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960547+0000","last_change":"2024-09-13T18:36:43.959314+0000","last_active":"2024-09-13T18:36:43.960547+0000","last_peered":"2024-09-13T18:36:43.960547+0000","last_clean":"2024-09-13T18:36:43.960547+0000","last_became_active":"2024-09-13T18:36:43.958506+0000","last_became_peered":"2024-09-13T18:36:43.958506+0000","last_unstale":"2024-09-13T18:36:43.960547+0000","last_undegraded":"2024-09-13T18:36:43.960547+0000","last_fullsized":"2024-09-13T18:36:43.960547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949790+0000","last_change":"2024-09-13T18:36:43.528414+0000","last_active":"2024-09-13T18:36:43.949790+0000","last_peered":"2024-09-13T18:36:43.949790+0000","last_clean":"2024-09-13T18:36:43.949790+0000","last_became_active":"2024-09-13T18:36:43.528200+0000","last_became_peered":"2024-09-13T18:36:43.528200+0000","last_unstale":"2024-09-13T18:36:43.949790+0000","last_undegraded":"2024-09-13T18:36:43.949790+0000","last_fullsized":"2024-09-13T18:36:43.949790+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954197+0000","last_change":"2024-09-13T18:36:43.952915+0000","last_active":"2024-09-13T18:36:43.954197+0000","last_peered":"2024-09-13T18:36:43.954197+0000","last_clean":"2024-09-13T18:36:43.954197+0000","last_became_active":"2024-09-13T18:36:43.952717+0000","last_became_peered":"2024-09-13T18:36:43.952717+0000","last_unstale":"2024-09-13T18:36:43.954197+0000","last_undegraded":"2024-09-13T18:36:43.954197+0000","last_fullsized":"2024-09-13T18:36:43.954197+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.564846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748274+0000","last_change":"2024-09-13T18:36:43.537908+0000","last_active":"2024-09-13T18:36:44.748274+0000","last_peered":"2024-09-13T18:36:44.748274+0000","last_clean":"2024-09-13T18:36:44.748274+0000","last_became_active":"2024-09-13T18:36:43.537692+0000","last_became_peered":"2024-09-13T18:36:43.537692+0000","last_unstale":"2024-09-13T18:36:44.748274+0000","last_undegraded":"2024-09-13T18:36:44.748274+0000","last_fullsized":"2024-09-13T18:36:44.748274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:46.060408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960436+0000","last_change":"2024-09-13T18:36:43.957586+0000","last_active":"2024-09-13T18:36:43.960436+0000","last_peered":"2024-09-13T18:36:43.960436+0000","last_clean":"2024-09-13T18:36:43.960436+0000","last_became_active":"2024-09-13T18:36:43.956277+0000","last_became_peered":"2024-09-13T18:36:43.956277+0000","last_unstale":"2024-09-13T18:36:43.960436+0000","last_undegraded":"2024-09-13T18:36:43.960436+0000","last_fullsized":"2024-09-13T18:36:43.960436+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748263+0000","last_change":"2024-09-13T18:36:43.538915+0000","last_active":"2024-09-13T18:36:44.748263+0000","last_peered":"2024-09-13T18:36:44.748263+0000","last_clean":"2024-09-13T18:36:44.748263+0000","last_became_active":"2024-09-13T18:36:43.538537+0000","last_became_peered":"2024-09-13T18:36:43.538537+0000","last_unstale":"2024-09-13T18:36:44.748263+0000","last_undegraded":"2024-09-13T18:36:44.748263+0000","last_fullsized":"2024-09-13T18:36:44.748263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960491+0000","last_change":"2024-09-13T18:36:43.958828+0000","last_active":"2024-09-13T18:36:43.960491+0000","last_peered":"2024-09-13T18:36:43.960491+0000","last_clean":"2024-09-13T18:36:43.960491+0000","last_became_active":"2024-09-13T18:36:43.957479+0000","last_became_peered":"2024-09-13T18:36:43.957479+0000","last_unstale":"2024-09-13T18:36:43.960491+0000","last_undegraded":"2024-09-13T18:36:43.960491+0000","last_fullsized":"2024-09-13T18:36:43.960491+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:25.615001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960404+0000","last_change":"2024-09-13T18:36:43.541708+0000","last_active":"2024-09-13T18:36:43.960404+0000","last_peered":"2024-09-13T18:36:43.960404+0000","last_clean":"2024-09-13T18:36:43.960404+0000","last_became_active":"2024-09-13T18:36:43.538962+0000","last_became_peered":"2024-09-13T18:36:43.538962+0000","last_unstale":"2024-09-13T18:36:43.960404+0000","last_undegraded":"2024-09-13T18:36:43.960404+0000","last_fullsized":"2024-09-13T18:36:43.960404+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:53:51.494051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954212+0000","last_change":"2024-09-13T18:36:43.953005+0000","last_active":"2024-09-13T18:36:43.954212+0000","last_peered":"2024-09-13T18:36:43.954212+0000","last_clean":"2024-09-13T18:36:43.954212+0000","last_became_active":"2024-09-13T18:36:43.952761+0000","last_became_peered":"2024-09-13T18:36:43.952761+0000","last_unstale":"2024-09-13T18:36:43.954212+0000","last_undegraded":"2024-09-13T18:36:43.954212+0000","last_fullsized":"2024-09-13T18:36:43.954212+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:21:54.543794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966179+0000","last_change":"2024-09-13T18:36:43.535486+0000","last_active":"2024-09-13T18:36:43.966179+0000","last_peered":"2024-09-13T18:36:43.966179+0000","last_clean":"2024-09-13T18:36:43.966179+0000","last_became_active":"2024-09-13T18:36:43.535085+0000","last_became_peered":"2024-09-13T18:36:43.535085+0000","last_unstale":"2024-09-13T18:36:43.966179+0000","last_undegraded":"2024-09-13T18:36:43.966179+0000","last_fullsized":"2024-09-13T18:36:43.966179+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957746+0000","last_change":"2024-09-13T18:36:43.957472+0000","last_active":"2024-09-13T18:36:43.957746+0000","last_peered":"2024-09-13T18:36:43.957746+0000","last_clean":"2024-09-13T18:36:43.957746+0000","last_became_active":"2024-09-13T18:36:43.957255+0000","last_became_peered":"2024-09-13T18:36:43.957255+0000","last_unstale":"2024-09-13T18:36:43.957746+0000","last_undegraded":"2024-09-13T18:36:43.957746+0000","last_fullsized":"2024-09-13T18:36:43.957746+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:24.655907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959644+0000","last_change":"2024-09-13T18:36:43.539714+0000","last_active":"2024-09-13T18:36:43.959644+0000","last_peered":"2024-09-13T18:36:43.959644+0000","last_clean":"2024-09-13T18:36:43.959644+0000","last_became_active":"2024-09-13T18:36:43.538401+0000","last_became_peered":"2024-09-13T18:36:43.538401+0000","last_unstale":"2024-09-13T18:36:43.959644+0000","last_undegraded":"2024-09-13T18:36:43.959644+0000","last_fullsized":"2024-09-13T18:36:43.959644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:09.399626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960395+0000","last_change":"2024-09-13T18:36:43.956155+0000","last_active":"2024-09-13T18:36:43.960395+0000","last_peered":"2024-09-13T18:36:43.960395+0000","last_clean":"2024-09-13T18:36:43.960395+0000","last_became_active":"2024-09-13T18:36:43.954845+0000","last_became_peered":"2024-09-13T18:36:43.954845+0000","last_unstale":"2024-09-13T18:36:43.960395+0000","last_undegraded":"2024-09-13T18:36:43.960395+0000","last_fullsized":"2024-09-13T18:36:43.960395+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:38:17.363879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947886+0000","last_change":"2024-09-13T18:36:43.539220+0000","last_active":"2024-09-13T18:36:43.947886+0000","last_peered":"2024-09-13T18:36:43.947886+0000","last_clean":"2024-09-13T18:36:43.947886+0000","last_became_active":"2024-09-13T18:36:43.538932+0000","last_became_peered":"2024-09-13T18:36:43.538932+0000","last_unstale":"2024-09-13T18:36:43.947886+0000","last_undegraded":"2024-09-13T18:36:43.947886+0000","last_fullsized":"2024-09-13T18:36:43.947886+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962670+0000","last_change":"2024-09-13T18:36:43.961403+0000","last_active":"2024-09-13T18:36:43.962670+0000","last_peered":"2024-09-13T18:36:43.962670+0000","last_clean":"2024-09-13T18:36:43.962670+0000","last_became_active":"2024-09-13T18:36:43.960097+0000","last_became_peered":"2024-09-13T18:36:43.960097+0000","last_unstale":"2024-09-13T18:36:43.962670+0000","last_undegraded":"2024-09-13T18:36:43.962670+0000","last_fullsized":"2024-09-13T18:36:43.962670+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:00:46.718924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.946479+0000","last_change":"2024-09-13T18:36:43.533866+0000","last_active":"2024-09-13T18:36:43.946479+0000","last_peered":"2024-09-13T18:36:43.946479+0000","last_clean":"2024-09-13T18:36:43.946479+0000","last_became_active":"2024-09-13T18:36:43.533584+0000","last_became_peered":"2024-09-13T18:36:43.533584+0000","last_unstale":"2024-09-13T18:36:43.946479+0000","last_undegraded":"2024-09-13T18:36:43.946479+0000","last_fullsized":"2024-09-13T18:36:43.946479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:17:36.490253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963173+0000","last_change":"2024-09-13T18:36:43.963101+0000","last_active":"2024-09-13T18:36:43.963173+0000","last_peered":"2024-09-13T18:36:43.963173+0000","last_clean":"2024-09-13T18:36:43.963173+0000","last_became_active":"2024-09-13T18:36:43.960714+0000","last_became_peered":"2024-09-13T18:36:43.960714+0000","last_unstale":"2024-09-13T18:36:43.963173+0000","last_undegraded":"2024-09-13T18:36:43.963173+0000","last_fullsized":"2024-09-13T18:36:43.963173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:18:28.437957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":19,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.966106+0000","last_change":"2024-09-13T18:36:43.540398+0000","last_active":"2024-09-13T18:36:43.966106+0000","last_peered":"2024-09-13T18:36:43.966106+0000","last_clean":"2024-09-13T18:36:43.966106+0000","last_became_active":"2024-09-13T18:36:43.539926+0000","last_became_peered":"2024-09-13T18:36:43.539926+0000","last_unstale":"2024-09-13T18:36:43.966106+0000","last_undegraded":"2024-09-13T18:36:43.966106+0000","last_fullsized":"2024-09-13T18:36:43.966106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:04.042479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959125+0000","last_change":"2024-09-13T18:36:43.959018+0000","last_active":"2024-09-13T18:36:43.959125+0000","last_peered":"2024-09-13T18:36:43.959125+0000","last_clean":"2024-09-13T18:36:43.959125+0000","last_became_active":"2024-09-13T18:36:43.957630+0000","last_became_peered":"2024-09-13T18:36:43.957630+0000","last_unstale":"2024-09-13T18:36:43.959125+0000","last_undegraded":"2024-09-13T18:36:43.959125+0000","last_fullsized":"2024-09-13T18:36:43.959125+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:36:42.386496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.963322+0000","last_change":"2024-09-13T18:36:43.535513+0000","last_active":"2024-09-13T18:36:43.963322+0000","last_peered":"2024-09-13T18:36:43.963322+0000","last_clean":"2024-09-13T18:36:43.963322+0000","last_became_active":"2024-09-13T18:36:43.535276+0000","last_became_peered":"2024-09-13T18:36:43.535276+0000","last_unstale":"2024-09-13T18:36:43.963322+0000","last_undegraded":"2024-09-13T18:36:43.963322+0000","last_fullsized":"2024-09-13T18:36:43.963322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:22.809094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957232+0000","last_change":"2024-09-13T18:36:43.956988+0000","last_active":"2024-09-13T18:36:43.957232+0000","last_peered":"2024-09-13T18:36:43.957232+0000","last_clean":"2024-09-13T18:36:43.957232+0000","last_became_active":"2024-09-13T18:36:43.956788+0000","last_became_peered":"2024-09-13T18:36:43.956788+0000","last_unstale":"2024-09-13T18:36:43.957232+0000","last_undegraded":"2024-09-13T18:36:43.957232+0000","last_fullsized":"2024-09-13T18:36:43.957232+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:42.955791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959371+0000","last_change":"2024-09-13T18:36:43.538605+0000","last_active":"2024-09-13T18:36:43.959371+0000","last_peered":"2024-09-13T18:36:43.959371+0000","last_clean":"2024-09-13T18:36:43.959371+0000","last_became_active":"2024-09-13T18:36:43.538075+0000","last_became_peered":"2024-09-13T18:36:43.538075+0000","last_unstale":"2024-09-13T18:36:43.959371+0000","last_undegraded":"2024-09-13T18:36:43.959371+0000","last_fullsized":"2024-09-13T18:36:43.959371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748253+0000","last_change":"2024-09-13T18:36:43.954197+0000","last_active":"2024-09-13T18:36:44.748253+0000","last_peered":"2024-09-13T18:36:44.748253+0000","last_clean":"2024-09-13T18:36:44.748253+0000","last_became_active":"2024-09-13T18:36:43.953917+0000","last_became_peered":"2024-09-13T18:36:43.953917+0000","last_unstale":"2024-09-13T18:36:44.748253+0000","last_undegraded":"2024-09-13T18:36:44.748253+0000","last_fullsized":"2024-09-13T18:36:44.748253+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:52:36.891621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.959937+0000","last_change":"2024-09-13T18:36:43.539249+0000","last_active":"2024-09-13T18:36:43.959937+0000","last_peered":"2024-09-13T18:36:43.959937+0000","last_clean":"2024-09-13T18:36:43.959937+0000","last_became_active":"2024-09-13T18:36:43.538532+0000","last_became_peered":"2024-09-13T18:36:43.538532+0000","last_unstale":"2024-09-13T18:36:43.959937+0000","last_undegraded":"2024-09-13T18:36:43.959937+0000","last_fullsized":"2024-09-13T18:36:43.959937+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:11.078690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949284+0000","last_change":"2024-09-13T18:36:43.949209+0000","last_active":"2024-09-13T18:36:43.949284+0000","last_peered":"2024-09-13T18:36:43.949284+0000","last_clean":"2024-09-13T18:36:43.949284+0000","last_became_active":"2024-09-13T18:36:43.948756+0000","last_became_peered":"2024-09-13T18:36:43.948756+0000","last_unstale":"2024-09-13T18:36:43.949284+0000","last_undegraded":"2024-09-13T18:36:43.949284+0000","last_fullsized":"2024-09-13T18:36:43.949284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:27:36.254852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.944650+0000","last_change":"2024-09-13T18:36:43.535052+0000","last_active":"2024-09-13T18:36:43.944650+0000","last_peered":"2024-09-13T18:36:43.944650+0000","last_clean":"2024-09-13T18:36:43.944650+0000","last_became_active":"2024-09-13T18:36:43.534607+0000","last_became_peered":"2024-09-13T18:36:43.534607+0000","last_unstale":"2024-09-13T18:36:43.944650+0000","last_undegraded":"2024-09-13T18:36:43.944650+0000","last_fullsized":"2024-09-13T18:36:43.944650+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:37:23.653566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953817+0000","last_change":"2024-09-13T18:36:43.953736+0000","last_active":"2024-09-13T18:36:43.953817+0000","last_peered":"2024-09-13T18:36:43.953817+0000","last_clean":"2024-09-13T18:36:43.953817+0000","last_became_active":"2024-09-13T18:36:43.953504+0000","last_became_peered":"2024-09-13T18:36:43.953504+0000","last_unstale":"2024-09-13T18:36:43.953817+0000","last_undegraded":"2024-09-13T18:36:43.953817+0000","last_fullsized":"2024-09-13T18:36:43.953817+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:22.113376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748206+0000","last_change":"2024-09-13T18:36:43.532711+0000","last_active":"2024-09-13T18:36:44.748206+0000","last_peered":"2024-09-13T18:36:44.748206+0000","last_clean":"2024-09-13T18:36:44.748206+0000","last_became_active":"2024-09-13T18:36:43.532491+0000","last_became_peered":"2024-09-13T18:36:43.532491+0000","last_unstale":"2024-09-13T18:36:44.748206+0000","last_undegraded":"2024-09-13T18:36:44.748206+0000","last_fullsized":"2024-09-13T18:36:44.748206+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:15:41.467973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:44.748187+0000","last_change":"2024-09-13T18:36:43.947877+0000","last_active":"2024-09-13T18:36:44.748187+0000","last_peered":"2024-09-13T18:36:44.748187+0000","last_clean":"2024-09-13T18:36:44.748187+0000","last_became_active":"2024-09-13T18:36:43.947611+0000","last_became_peered":"2024-09-13T18:36:43.947611+0000","last_unstale":"2024-09-13T18:36:44.748187+0000","last_undegraded":"2024-09-13T18:36:44.748187+0000","last_fullsized":"2024-09-13T18:36:44.748187+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:41:37.367306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949739+0000","last_change":"2024-09-13T18:36:43.539178+0000","last_active":"2024-09-13T18:36:43.949739+0000","last_peered":"2024-09-13T18:36:43.949739+0000","last_clean":"2024-09-13T18:36:43.949739+0000","last_became_active":"2024-09-13T18:36:43.538927+0000","last_became_peered":"2024-09-13T18:36:43.538927+0000","last_unstale":"2024-09-13T18:36:43.949739+0000","last_undegraded":"2024-09-13T18:36:43.949739+0000","last_fullsized":"2024-09-13T18:36:43.949739+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.962211+0000","last_change":"2024-09-13T18:36:43.961353+0000","last_active":"2024-09-13T18:36:43.962211+0000","last_peered":"2024-09-13T18:36:43.962211+0000","last_clean":"2024-09-13T18:36:43.962211+0000","last_became_active":"2024-09-13T18:36:43.960913+0000","last_became_peered":"2024-09-13T18:36:43.960913+0000","last_unstale":"2024-09-13T18:36:43.962211+0000","last_undegraded":"2024-09-13T18:36:43.962211+0000","last_fullsized":"2024-09-13T18:36:43.962211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:27:10.299588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951896+0000","last_change":"2024-09-13T18:36:43.533289+0000","last_active":"2024-09-13T18:36:43.951896+0000","last_peered":"2024-09-13T18:36:43.951896+0000","last_clean":"2024-09-13T18:36:43.951896+0000","last_became_active":"2024-09-13T18:36:43.532827+0000","last_became_peered":"2024-09-13T18:36:43.532827+0000","last_unstale":"2024-09-13T18:36:43.951896+0000","last_undegraded":"2024-09-13T18:36:43.951896+0000","last_fullsized":"2024-09-13T18:36:43.951896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:55:39.380715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955714+0000","last_change":"2024-09-13T18:36:43.955456+0000","last_active":"2024-09-13T18:36:43.955714+0000","last_peered":"2024-09-13T18:36:43.955714+0000","last_clean":"2024-09-13T18:36:43.955714+0000","last_became_active":"2024-09-13T18:36:43.955236+0000","last_became_peered":"2024-09-13T18:36:43.955236+0000","last_unstale":"2024-09-13T18:36:43.955714+0000","last_undegraded":"2024-09-13T18:36:43.955714+0000","last_fullsized":"2024-09-13T18:36:43.955714+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:32.421541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953374+0000","last_change":"2024-09-13T18:36:43.538739+0000","last_active":"2024-09-13T18:36:43.953374+0000","last_peered":"2024-09-13T18:36:43.953374+0000","last_clean":"2024-09-13T18:36:43.953374+0000","last_became_active":"2024-09-13T18:36:43.538227+0000","last_became_peered":"2024-09-13T18:36:43.538227+0000","last_unstale":"2024-09-13T18:36:43.953374+0000","last_undegraded":"2024-09-13T18:36:43.953374+0000","last_fullsized":"2024-09-13T18:36:43.953374+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:44:39.417931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951189+0000","last_change":"2024-09-13T18:36:43.949380+0000","last_active":"2024-09-13T18:36:43.951189+0000","last_peered":"2024-09-13T18:36:43.951189+0000","last_clean":"2024-09-13T18:36:43.951189+0000","last_became_active":"2024-09-13T18:36:43.949153+0000","last_became_peered":"2024-09-13T18:36:43.949153+0000","last_unstale":"2024-09-13T18:36:43.951189+0000","last_undegraded":"2024-09-13T18:36:43.951189+0000","last_fullsized":"2024-09-13T18:36:43.951189+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:11.267928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.964247+0000","last_change":"2024-09-13T18:36:43.536535+0000","last_active":"2024-09-13T18:36:43.964247+0000","last_peered":"2024-09-13T18:36:43.964247+0000","last_clean":"2024-09-13T18:36:43.964247+0000","last_became_active":"2024-09-13T18:36:43.536286+0000","last_became_peered":"2024-09-13T18:36:43.536286+0000","last_unstale":"2024-09-13T18:36:43.964247+0000","last_undegraded":"2024-09-13T18:36:43.964247+0000","last_fullsized":"2024-09-13T18:36:43.964247+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:45:06.062382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.954230+0000","last_change":"2024-09-13T18:36:43.953747+0000","last_active":"2024-09-13T18:36:43.954230+0000","last_peered":"2024-09-13T18:36:43.954230+0000","last_clean":"2024-09-13T18:36:43.954230+0000","last_became_active":"2024-09-13T18:36:43.953522+0000","last_became_peered":"2024-09-13T18:36:43.953522+0000","last_unstale":"2024-09-13T18:36:43.954230+0000","last_undegraded":"2024-09-13T18:36:43.954230+0000","last_fullsized":"2024-09-13T18:36:43.954230+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:34.120082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-09-13T18:36:45.326052+0000","last_change":"2024-09-13T18:36:43.537515+0000","last_active":"2024-09-13T18:36:45.326052+0000","last_peered":"2024-09-13T18:36:45.326052+0000","last_clean":"2024-09-13T18:36:45.326052+0000","last_became_active":"2024-09-13T18:36:43.536247+0000","last_became_peered":"2024-09-13T18:36:43.536247+0000","last_unstale":"2024-09-13T18:36:45.326052+0000","last_undegraded":"2024-09-13T18:36:45.326052+0000","last_fullsized":"2024-09-13T18:36:45.326052+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:24:06.976877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.953602+0000","last_change":"2024-09-13T18:36:43.952041+0000","last_active":"2024-09-13T18:36:43.953602+0000","last_peered":"2024-09-13T18:36:43.953602+0000","last_clean":"2024-09-13T18:36:43.953602+0000","last_became_active":"2024-09-13T18:36:43.951804+0000","last_became_peered":"2024-09-13T18:36:43.951804+0000","last_unstale":"2024-09-13T18:36:43.953602+0000","last_undegraded":"2024-09-13T18:36:43.953602+0000","last_fullsized":"2024-09-13T18:36:43.953602+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:18.532726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.949328+0000","last_change":"2024-09-13T18:36:43.537284+0000","last_active":"2024-09-13T18:36:43.949328+0000","last_peered":"2024-09-13T18:36:43.949328+0000","last_clean":"2024-09-13T18:36:43.949328+0000","last_became_active":"2024-09-13T18:36:43.536206+0000","last_became_peered":"2024-09-13T18:36:43.536206+0000","last_unstale":"2024-09-13T18:36:43.949328+0000","last_undegraded":"2024-09-13T18:36:43.949328+0000","last_fullsized":"2024-09-13T18:36:43.949328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:31.419199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.951487+0000","last_change":"2024-09-13T18:36:43.951314+0000","last_active":"2024-09-13T18:36:43.951487+0000","last_peered":"2024-09-13T18:36:43.951487+0000","last_clean":"2024-09-13T18:36:43.951487+0000","last_became_active":"2024-09-13T18:36:43.951145+0000","last_became_peered":"2024-09-13T18:36:43.951145+0000","last_unstale":"2024-09-13T18:36:43.951487+0000","last_undegraded":"2024-09-13T18:36:43.951487+0000","last_fullsized":"2024-09-13T18:36:43.951487+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947883+0000","last_change":"2024-09-13T18:36:43.533733+0000","last_active":"2024-09-13T18:36:43.947883+0000","last_peered":"2024-09-13T18:36:43.947883+0000","last_clean":"2024-09-13T18:36:43.947883+0000","last_became_active":"2024-09-13T18:36:43.533324+0000","last_became_peered":"2024-09-13T18:36:43.533324+0000","last_unstale":"2024-09-13T18:36:43.947883+0000","last_undegraded":"2024-09-13T18:36:43.947883+0000","last_fullsized":"2024-09-13T18:36:43.947883+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:21:40.196064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955845+0000","last_change":"2024-09-13T18:36:43.955767+0000","last_active":"2024-09-13T18:36:43.955845+0000","last_peered":"2024-09-13T18:36:43.955845+0000","last_clean":"2024-09-13T18:36:43.955845+0000","last_became_active":"2024-09-13T18:36:43.954868+0000","last_became_peered":"2024-09-13T18:36:43.954868+0000","last_unstale":"2024-09-13T18:36:43.955845+0000","last_undegraded":"2024-09-13T18:36:43.955845+0000","last_fullsized":"2024-09-13T18:36:43.955845+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:47.256121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948354+0000","last_change":"2024-09-13T18:36:43.542171+0000","last_active":"2024-09-13T18:36:43.948354+0000","last_peered":"2024-09-13T18:36:43.948354+0000","last_clean":"2024-09-13T18:36:43.948354+0000","last_became_active":"2024-09-13T18:36:43.541912+0000","last_became_peered":"2024-09-13T18:36:43.541912+0000","last_unstale":"2024-09-13T18:36:43.948354+0000","last_undegraded":"2024-09-13T18:36:43.948354+0000","last_fullsized":"2024-09-13T18:36:43.948354+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.960512+0000","last_change":"2024-09-13T18:36:43.959027+0000","last_active":"2024-09-13T18:36:43.960512+0000","last_peered":"2024-09-13T18:36:43.960512+0000","last_clean":"2024-09-13T18:36:43.960512+0000","last_became_active":"2024-09-13T18:36:43.957800+0000","last_became_peered":"2024-09-13T18:36:43.957800+0000","last_unstale":"2024-09-13T18:36:43.960512+0000","last_undegraded":"2024-09-13T18:36:43.960512+0000","last_fullsized":"2024-09-13T18:36:43.960512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:47:07.074971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.950762+0000","last_change":"2024-09-13T18:36:43.540839+0000","last_active":"2024-09-13T18:36:43.950762+0000","last_peered":"2024-09-13T18:36:43.950762+0000","last_clean":"2024-09-13T18:36:43.950762+0000","last_became_active":"2024-09-13T18:36:43.540623+0000","last_became_peered":"2024-09-13T18:36:43.540623+0000","last_unstale":"2024-09-13T18:36:43.950762+0000","last_undegraded":"2024-09-13T18:36:43.950762+0000","last_fullsized":"2024-09-13T18:36:43.950762+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:24:41.953449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.957438+0000","last_change":"2024-09-13T18:36:43.955612+0000","last_active":"2024-09-13T18:36:43.957438+0000","last_peered":"2024-09-13T18:36:43.957438+0000","last_clean":"2024-09-13T18:36:43.957438+0000","last_became_active":"2024-09-13T18:36:43.955410+0000","last_became_peered":"2024-09-13T18:36:43.955410+0000","last_unstale":"2024-09-13T18:36:43.957438+0000","last_undegraded":"2024-09-13T18:36:43.957438+0000","last_fullsized":"2024-09-13T18:36:43.957438+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:27.491146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947744+0000","last_change":"2024-09-13T18:36:43.537818+0000","last_active":"2024-09-13T18:36:43.947744+0000","last_peered":"2024-09-13T18:36:43.947744+0000","last_clean":"2024-09-13T18:36:43.947744+0000","last_became_active":"2024-09-13T18:36:43.532556+0000","last_became_peered":"2024-09-13T18:36:43.532556+0000","last_unstale":"2024-09-13T18:36:43.947744+0000","last_undegraded":"2024-09-13T18:36:43.947744+0000","last_fullsized":"2024-09-13T18:36:43.947744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:51:02.102874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.955542+0000","last_change":"2024-09-13T18:36:43.953334+0000","last_active":"2024-09-13T18:36:43.955542+0000","last_peered":"2024-09-13T18:36:43.955542+0000","last_clean":"2024-09-13T18:36:43.955542+0000","last_became_active":"2024-09-13T18:36:43.950983+0000","last_became_peered":"2024-09-13T18:36:43.950983+0000","last_unstale":"2024-09-13T18:36:43.955542+0000","last_undegraded":"2024-09-13T18:36:43.955542+0000","last_fullsized":"2024-09-13T18:36:43.955542+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:43.520556+0000","last_clean_scrub_stamp":"2024-09-13T18:36:43.520556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:54:46.112694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.947093+0000","last_change":"2024-09-13T18:36:43.538090+0000","last_active":"2024-09-13T18:36:43.947093+0000","last_peered":"2024-09-13T18:36:43.947093+0000","last_clean":"2024-09-13T18:36:43.947093+0000","last_became_active":"2024-09-13T18:36:43.537874+0000","last_became_peered":"2024-09-13T18:36:43.537874+0000","last_unstale":"2024-09-13T18:36:43.947093+0000","last_undegraded":"2024-09-13T18:36:43.947093+0000","last_fullsized":"2024-09-13T18:36:43.947093+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:36:42.518214+0000","last_clean_scrub_stamp":"2024-09-13T18:36:42.518214+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:14:18.517762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-13T18:36:43.948387+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:36:43.948387+0000","last_peered":"2024-09-13T18:36:43.948387+0000","last_clean":"2024-09-13T18:36:43.948387+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:36:43.948387+0000","last_undegraded":"2024-09-13T18:36:43.948387+0000","last_fullsized":"2024-09-13T18:36:43.948387+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542164,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":729,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253016,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.71399999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.75},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.76000000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843944,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.624}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.47899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.65000000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.72899999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.76800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842402,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.69699999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.66400000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.747}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.628},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195158,"statfs":{"total":200000000,"available":199842380,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.81000000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.73199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.749},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.58799999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.78300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":153,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195159,"statfs":{"total":200000000,"available":199843190,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.40500000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.33400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.377},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.36699999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.70699999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.72099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.73899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.316},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.433}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.36299999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.875},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.89700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":728,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194583,"statfs":{"total":200000000,"available":199253528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.311}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.61199999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.625},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":152,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195160,"statfs":{"total":200000000,"available":199843876,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.41599999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.371},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.63500000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.77600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79900000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.751}]}]}],"pool_statfs":[]}} 2024-09-13T18:36:53.097 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:36:53.098 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:36:53.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.288+0000 7f5039400640 1 Processor -- start 2024-09-13T18:36:53.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.288+0000 7f5039400640 1 -- start start 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5039400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50341589f0 0x7f50340b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5039400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340b2000 con 0x7f503406c0b0 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5039400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f503415b970 con 0x7f50340b3af0 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5039400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f503415bbd0 con 0x7f50341589f0 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5032800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50341589f0 0x7f50340b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5032800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50341589f0 0x7f50340b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58750/0 (socket says 172.21.15.192:58750) 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5032800640 1 -- 172.21.15.192:0/3761101379 learned_addr learned my addr 172.21.15.192:0/3761101379 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:53.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.289+0000 7f5033200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f503406c0b0 0x7f50340cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53736/0 (socket says 172.21.15.192:53736) 2024-09-13T18:36:53.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.290+0000 7f5032800640 1 -- 172.21.15.192:0/3761101379 >> v1:172.21.15.194:6789/0 conn(0x7f50340b3af0 legacy=0x7f503415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.290+0000 7f5032800640 1 -- 172.21.15.192:0/3761101379 >> v1:172.21.15.192:6789/0 conn(0x7f503406c0b0 legacy=0x7f50340cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.290+0000 7f5032800640 1 -- 172.21.15.192:0/3761101379 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f503415beb0 con 0x7f50341589f0 2024-09-13T18:36:53.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.290+0000 7f5031e00640 1 -- 172.21.15.192:0/3761101379 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077112585 0 0) 0x7f50340b2000 con 0x7f503406c0b0 2024-09-13T18:36:53.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.291+0000 7f5032800640 1 --2- 172.21.15.192:0/3761101379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50341589f0 0x7f50340b2490 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5024009870 tx=0x7f502402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2eb8eb0c2475d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.291+0000 7f5031e00640 1 -- 172.21.15.192:0/3761101379 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024032440 con 0x7f50341589f0 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.291+0000 7f5031e00640 1 -- 172.21.15.192:0/3761101379 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50240325a0 con 0x7f50341589f0 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.291+0000 7f5031e00640 1 -- 172.21.15.192:0/3761101379 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024032930 con 0x7f50341589f0 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 -- 172.21.15.192:0/3761101379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50341589f0 msgr2=0x7f50340b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 --2- 172.21.15.192:0/3761101379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50341589f0 0x7f50340b2490 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5024009870 tx=0x7f502402a270 comp rx=0 tx=0).stop 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 -- 172.21.15.192:0/3761101379 shutdown_connections 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 --2- 172.21.15.192:0/3761101379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50341589f0 0x7f50340b2490 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 -- 172.21.15.192:0/3761101379 >> 172.21.15.192:0/3761101379 conn(0x7f50340b08f0 msgr2=0x7f50340b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 -- 172.21.15.192:0/3761101379 shutdown_connections 2024-09-13T18:36:53.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.292+0000 7f5039400640 1 -- 172.21.15.192:0/3761101379 wait complete. 2024-09-13T18:36:53.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.293+0000 7f5039400640 1 Processor -- start 2024-09-13T18:36:53.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 -- start start 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 0x7f50341f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 0x7f50340ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341f31b0 con 0x7f503406c0b0 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50341f3490 con 0x7f50340b3af0 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.294+0000 7f5039400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5034154ec0 con 0x7f50341589f0 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58762/0 (socket says 172.21.15.192:58762) 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 -- 172.21.15.192:0/4291191004 learned_addr learned my addr 172.21.15.192:0/4291191004 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:53.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f502be00640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 0x7f50341f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5033200640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 0x7f50340ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 -- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 msgr2=0x7f50340ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 0x7f50340ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 -- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 msgr2=0x7f50341f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 0x7f50341f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 -- 172.21.15.192:0/4291191004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240094d0 con 0x7f503406c0b0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f502be00640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 0x7f50341f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5033200640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 0x7f50340ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.295+0000 7f5032800640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5024009870 tx=0x7f50240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.296+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024030b00 con 0x7f503406c0b0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.296+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024030c60 con 0x7f503406c0b0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.296+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f502403d420 con 0x7f503406c0b0 2024-09-13T18:36:53.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.296+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50341551a0 con 0x7f503406c0b0 2024-09-13T18:36:53.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.296+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503406b840 con 0x7f503406c0b0 2024-09-13T18:36:53.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.297+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034154d00 con 0x7f503406c0b0 2024-09-13T18:36:53.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.298+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5024039040 con 0x7f503406c0b0 2024-09-13T18:36:53.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.298+0000 7f502aa00640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 0x7f501006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.298+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f50240aa1f0 con 0x7f503406c0b0 2024-09-13T18:36:53.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.299+0000 7f502be00640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 0x7f501006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.299+0000 7f502be00640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 0x7f501006d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f501c007fd0 tx=0x7f501c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.302+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5024075330 con 0x7f503406c0b0 2024-09-13T18:36:53.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.530+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f50340b2490 con 0x7f503406c0b0 2024-09-13T18:36:53.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.535+0000 7f502aa00640 1 -- 172.21.15.192:0/4291191004 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f5024078950 con 0x7f503406c0b0 2024-09-13T18:36:53.538 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:36:53.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 msgr2=0x7f501006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 0x7f501006d0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f501c007fd0 tx=0x7f501c009040 comp rx=0 tx=0).stop 2024-09-13T18:36:53.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 msgr2=0x7f50341f5420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5024009870 tx=0x7f50240046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 shutdown_connections 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f501006ac00 0x7f501006d0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50341589f0 0x7f50340ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50340b3af0 0x7f50341f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 --2- 172.21.15.192:0/4291191004 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f503406c0b0 0x7f50341f5420 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.537+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 >> 172.21.15.192:0/4291191004 conn(0x7f50340b08f0 msgr2=0x7f50341592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.538+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 shutdown_connections 2024-09-13T18:36:53.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.538+0000 7f5039400640 1 -- 172.21.15.192:0/4291191004 wait complete. 2024-09-13T18:36:53.556 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:53.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.704+0000 7f1d73200640 1 Processor -- start 2024-09-13T18:36:53.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.704+0000 7f1d73200640 1 -- start start 2024-09-13T18:36:53.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.705+0000 7f1d73200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 0x7f1d6c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.705+0000 7f1d73200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.705+0000 7f1d73200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d6c0b2f00 con 0x7f1d6c15e2c0 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.705+0000 7f1d73200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b3150 con 0x7f1d6c0b3f10 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.705+0000 7f1d73200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6c0b3430 con 0x7f1d6c15dee0 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d71200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1d6c15e2c0 0x7f1d6c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53740/0 (socket says 172.21.15.192:53740) 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d71200640 1 -- 172.21.15.192:0/2061542827 learned_addr learned my addr 172.21.15.192:0/2061542827 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58776/0 (socket says 172.21.15.192:58776) 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6be00640 1 --2- 172.21.15.192:0/2061542827 >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 0x7f1d6c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 -- 172.21.15.192:0/2061542827 >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 msgr2=0x7f1d6c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 --2- 172.21.15.192:0/2061542827 >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 0x7f1d6c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 -- 172.21.15.192:0/2061542827 >> v1:172.21.15.192:6789/0 conn(0x7f1d6c15e2c0 legacy=0x7f1d6c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6b400640 1 -- 172.21.15.192:0/2061542827 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c0b3710 con 0x7f1d6c0b3f10 2024-09-13T18:36:53.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.706+0000 7f1d6be00640 1 --2- 172.21.15.192:0/2061542827 >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 0x7f1d6c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.707+0000 7f1d6b400640 1 --2- 172.21.15.192:0/2061542827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c06cd20 tx=0x7f1d5802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ad5d1dbcc6bdad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.707+0000 7f1d6aa00640 1 -- 172.21.15.192:0/2061542827 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032440 con 0x7f1d6c0b3f10 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.707+0000 7f1d6aa00640 1 -- 172.21.15.192:0/2061542827 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d580325a0 con 0x7f1d6c0b3f10 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.707+0000 7f1d6aa00640 1 -- 172.21.15.192:0/2061542827 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d58032930 con 0x7f1d6c0b3f10 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 -- 172.21.15.192:0/2061542827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c0b3f10 msgr2=0x7f1d6c0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 --2- 172.21.15.192:0/2061542827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c06cd20 tx=0x7f1d5802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 -- 172.21.15.192:0/2061542827 shutdown_connections 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 --2- 172.21.15.192:0/2061542827 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c0b3f10 0x7f1d6c0b02c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 --2- 172.21.15.192:0/2061542827 >> v2:172.21.15.194:3300/0 conn(0x7f1d6c15dee0 0x7f1d6c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 -- 172.21.15.192:0/2061542827 >> 172.21.15.192:0/2061542827 conn(0x7f1d6c0ae960 msgr2=0x7f1d6c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 -- 172.21.15.192:0/2061542827 shutdown_connections 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.708+0000 7f1d73200640 1 -- 172.21.15.192:0/2061542827 wait complete. 2024-09-13T18:36:53.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.709+0000 7f1d73200640 1 Processor -- start 2024-09-13T18:36:53.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 -- start start 2024-09-13T18:36:53.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 0x7f1d6c155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d6c15e2c0 0x7f1d6c1532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c155140 con 0x7f1d6c156fe0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c1559e0 con 0x7f1d6c15dee0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.710+0000 7f1d73200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d6c13c780 con 0x7f1d6c15e2c0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d6be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 0x7f1d6c155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d6b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d6c15e2c0 0x7f1d6c1532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d6be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 0x7f1d6c155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41120/0 (socket says 172.21.15.192:41120) 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d6be00640 1 -- 172.21.15.192:0/3083185523 learned_addr learned my addr 172.21.15.192:0/3083185523 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58784/0 (socket says 172.21.15.192:58784) 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 -- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d6c15e2c0 msgr2=0x7f1d6c1532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d6c15e2c0 0x7f1d6c1532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 -- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 msgr2=0x7f1d6c155e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 0x7f1d6c155e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.711+0000 7f1d71200640 1 -- 172.21.15.192:0/3083185523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58009400 con 0x7f1d6c156fe0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d71200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400caa0 tx=0x7f1d6400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6400ab40 con 0x7f1d6c156fe0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6400aca0 con 0x7f1d6c156fe0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d64012600 con 0x7f1d6c156fe0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d6c157470 con 0x7f1d6c156fe0 2024-09-13T18:36:53.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.712+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d6c155600 con 0x7f1d6c156fe0 2024-09-13T18:36:53.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.713+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d6c155b20 con 0x7f1d6c156fe0 2024-09-13T18:36:53.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.714+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d64012760 con 0x7f1d6c156fe0 2024-09-13T18:36:53.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.715+0000 7f1d63e00640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 0x7f1d4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:53.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.715+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d640890f0 con 0x7f1d6c156fe0 2024-09-13T18:36:53.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.715+0000 7f1d6be00640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 0x7f1d4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:53.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.716+0000 7f1d6be00640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 0x7f1d4c06d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c143760 tx=0x7f1d5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:53.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.719+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d6c155b20 con 0x7f1d6c156fe0 2024-09-13T18:36:53.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.922+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d6c155b20 con 0x7f1d6c156fe0 2024-09-13T18:36:53.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.922+0000 7f1d63e00640 1 -- 172.21.15.192:0/3083185523 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f1d6c155b20 con 0x7f1d6c156fe0 2024-09-13T18:36:53.925 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:53.925 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:36:53.925 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:36:53.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 msgr2=0x7f1d4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 0x7f1d4c06d0c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c143760 tx=0x7f1d5c008040 comp rx=0 tx=0).stop 2024-09-13T18:36:53.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 msgr2=0x7f1d6c141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:53.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1d6400caa0 tx=0x7f1d6400cf60 comp rx=0 tx=0).stop 2024-09-13T18:36:53.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 shutdown_connections 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d4c06ac00 0x7f1d4c06d0c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d6c156fe0 0x7f1d6c141ee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d6c15e2c0 0x7f1d6c1532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 --2- 172.21.15.192:0/3083185523 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d6c15dee0 0x7f1d6c155e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 >> 172.21.15.192:0/3083185523 conn(0x7f1d6c0ae960 msgr2=0x7f1d6c06f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.924+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 shutdown_connections 2024-09-13T18:36:53.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:53.925+0000 7f1d73200640 1 -- 172.21.15.192:0/3083185523 wait complete. 2024-09-13T18:36:54.345 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:36:43.938032+0000', 'modified': '2024-09-13T18:36:46.951352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5094}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5094': {'gid': 5094, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6836/367924662', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 367924662}, {'type': 'v1', 'addr': '172.21.15.192:6836', 'nonce': 367924662}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:36:54.346 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:36:54.346 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:36:54.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.496+0000 7fcdf5e00640 1 Processor -- start 2024-09-13T18:36:54.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.496+0000 7fcdf5e00640 1 -- start start 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.497+0000 7fcdf5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 0x7fcdf00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.497+0000 7fcdf5e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf015ec00 con 0x7fcdf015e790 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.497+0000 7fcdf5e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf0140480 con 0x7fcdf00cacd0 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.497+0000 7fcdf5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00cb5f0 con 0x7fcdf00b0490 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdee000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcdf015e790 0x7fcdf00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53756/0 (socket says 172.21.15.192:53756) 2024-09-13T18:36:54.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdee000640 1 -- 172.21.15.192:0/2620968601 learned_addr learned my addr 172.21.15.192:0/2620968601 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:54.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdef400640 1 --2- 172.21.15.192:0/2620968601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 0x7fcdf00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3716252576 0 0) 0x7fcdf015ec00 con 0x7fcdf015e790 2024-09-13T18:36:54.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd4003520 con 0x7fcdf015e790 2024-09-13T18:36:54.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260948761 0 0) 0x7fcdf0140480 con 0x7fcdf00cacd0 2024-09-13T18:36:54.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf015ec00 con 0x7fcdf00cacd0 2024-09-13T18:36:54.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdef400640 1 -- 172.21.15.192:0/2620968601 >> v1:172.21.15.194:6789/0 conn(0x7fcdf00cacd0 legacy=0x7fcdf0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdef400640 1 -- 172.21.15.192:0/2620968601 >> v1:172.21.15.192:6789/0 conn(0x7fcdf015e790 legacy=0x7fcdf00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.498+0000 7fcdef400640 1 -- 172.21.15.192:0/2620968601 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf015ee90 con 0x7fcdf00b0490 2024-09-13T18:36:54.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.499+0000 7fcdef400640 1 --2- 172.21.15.192:0/2620968601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 0x7fcdf00cb0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009dc0 tx=0x7fcde802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3de2f87508c0b53f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8007740 con 0x7fcdf00b0490 2024-09-13T18:36:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde802d050 con 0x7fcdf00b0490 2024-09-13T18:36:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcded600640 1 -- 172.21.15.192:0/2620968601 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8007aa0 con 0x7fcdf00b0490 2024-09-13T18:36:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 -- 172.21.15.192:0/2620968601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 msgr2=0x7fcdf00cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/2620968601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 0x7fcdf00cb0b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009dc0 tx=0x7fcde802a6d0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 -- 172.21.15.192:0/2620968601 shutdown_connections 2024-09-13T18:36:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/2620968601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf00b0490 0x7fcdf00cb0b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 -- 172.21.15.192:0/2620968601 >> 172.21.15.192:0/2620968601 conn(0x7fcdf00ae960 msgr2=0x7fcdf006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 -- 172.21.15.192:0/2620968601 shutdown_connections 2024-09-13T18:36:54.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.500+0000 7fcdf5e00640 1 -- 172.21.15.192:0/2620968601 wait complete. 2024-09-13T18:36:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.502+0000 7fcdf5e00640 1 Processor -- start 2024-09-13T18:36:54.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.502+0000 7fcdf5e00640 1 -- start start 2024-09-13T18:36:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 0x7fcdf006ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 0x7fcdf015c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf006b500 con 0x7fcdf00cacd0 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf015bd50 con 0x7fcdf00b0490 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdf5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf015b420 con 0x7fcdf015e790 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58800/0 (socket says 172.21.15.192:58800) 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.503+0000 7fcdee000640 1 -- 172.21.15.192:0/1525700900 learned_addr learned my addr 172.21.15.192:0/1525700900 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 0x7fcdf006ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdef400640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 0x7fcdf015c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 -- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 msgr2=0x7fcdf015c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 0x7fcdf015c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 -- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 msgr2=0x7fcdf006ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 0x7fcdf006ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 -- 172.21.15.192:0/1525700900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8009a70 con 0x7fcdf00cacd0 2024-09-13T18:36:54.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 0x7fcdf006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:54.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdef400640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 0x7fcdf015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:54.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdee000640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00c4c0 tx=0x7fcddc00c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcde7400640 1 -- 172.21.15.192:0/1525700900 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc005da0 con 0x7fcdf00cacd0 2024-09-13T18:36:54.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcde7400640 1 -- 172.21.15.192:0/1525700900 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc007070 con 0x7fcdf00cacd0 2024-09-13T18:36:54.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdf015b700 con 0x7fcdf00cacd0 2024-09-13T18:36:54.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcde7400640 1 -- 172.21.15.192:0/1525700900 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc007400 con 0x7fcdf00cacd0 2024-09-13T18:36:54.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.504+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf015d400 con 0x7fcdf00cacd0 2024-09-13T18:36:54.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.506+0000 7fcde7400640 1 -- 172.21.15.192:0/1525700900 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcddc007560 con 0x7fcdf00cacd0 2024-09-13T18:36:54.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.508+0000 7fcde7400640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 0x7fcdd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.508+0000 7fcde7400640 1 -- 172.21.15.192:0/1525700900 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcddc088990 con 0x7fcdf00cacd0 2024-09-13T18:36:54.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.508+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 0x7fcdd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.508+0000 7fcdf8c45740 1 Processor -- start 2024-09-13T18:36:54.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 0x7fcdd006d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcdf015a7e0 tx=0x7fcde0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 -- start start 2024-09-13T18:36:54.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e849aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e8403ab0 con 0x5603e8497e90 2024-09-13T18:36:54.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e8401240 con 0x5603e849a6d0 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.509+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603e83fcb30 con 0x5603e84c1b80 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdef400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58804/0 (socket says 172.21.15.192:58804) 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdeea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e849aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 -- 172.21.15.192:0/1653158148 learned_addr learned my addr 172.21.15.192:0/1653158148 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 -- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 msgr2=0x5603e84e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 -- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 msgr2=0x5603e849aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e849aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 -- 172.21.15.192:0/1653158148 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603e83c7bd0 con 0x5603e8497e90 2024-09-13T18:36:54.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.510+0000 7fcdee000640 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00ce80 tx=0x7fcddc057e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3549422be40a5ead server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcddbe00640 1 -- 172.21.15.192:0/1653158148 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc06f1c0 con 0x5603e8497e90 2024-09-13T18:36:54.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcddbe00640 1 -- 172.21.15.192:0/1653158148 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc05b5c0 con 0x5603e8497e90 2024-09-13T18:36:54.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcddbe00640 1 -- 172.21.15.192:0/1653158148 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc05fb80 con 0x5603e8497e90 2024-09-13T18:36:54.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1653158148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 msgr2=0x5603e84e7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00ce80 tx=0x7fcddc057e90 comp rx=0 tx=0).stop 2024-09-13T18:36:54.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1653158148 shutdown_connections 2024-09-13T18:36:54.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e8497e90 0x5603e84e7ba0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1653158148 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e849aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1653158148 >> 172.21.15.192:0/1653158148 conn(0x5603e8496e00 msgr2=0x5603e84df2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1653158148 shutdown_connections 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.511+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1653158148 wait complete. 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.512+0000 7fcdf8c45740 1 -- start start 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.512+0000 7fcdf8c45740 1 Processor -- start 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e849a6d0 0x5603e84dc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e84bc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e839e260 con 0x5603e84c1b80 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e839df00 con 0x5603e84945b0 2024-09-13T18:36:54.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603e8163f20 con 0x5603e849a6d0 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdf8c45740 10 client.0 _ll_register_callbacks cb 0x5603e83f61a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58806/0 (socket says 172.21.15.192:58806) 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.513+0000 7fcdee000640 1 -- 172.21.15.192:0/3323604149 learned_addr learned my addr 172.21.15.192:0/3323604149 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdeea00640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e849a6d0 0x5603e84dc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdef400640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e84bc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 -- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e849a6d0 msgr2=0x5603e84dc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e849a6d0 0x5603e84dc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 -- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 msgr2=0x5603e84bc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e84bc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 -- 172.21.15.192:0/3323604149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf015d400 con 0x5603e84c1b80 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdef400640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e84bc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:54.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdee000640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00cfd0 tx=0x7fcddc000f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c84ee61ec6937e45 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdd8c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc056e80 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcddc05fb80 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5603e8426cd0 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcddc05f6f0 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdf8c45740 10 client.5307 fetch_fsmap learned FSMap version 16 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.514+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5603e83fb1b0 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5603e8426cd0 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcddc080d20 con 0x5603e84c1b80 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 10 client.5307 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 10 client.5307 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 20 client.5307 populate_metadata read hostname 'smithi192' 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84bd640 0x5603e84bab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 4 client.5307 mds_command: new command op to 5094 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:36:54.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 --> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603e80f03c0 con 0x5603e84bd640 2024-09-13T18:36:54.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.515+0000 7fcdeea00640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84bd640 0x5603e84bab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.516+0000 7fcdd8c00640 10 client.5307 ms_handle_connect on v2:172.21.15.192:6834/367924662 2024-09-13T18:36:54.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.516+0000 7fcdeea00640 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84bd640 0x5603e84bab60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690414cef1d5a4cd server_cookie=9f6d12efe63ab873 in_seq=0 out_seq=0 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.516+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3323604149 <== mds.0 v2:172.21.15.192:6834/367924662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5603e80f03c0 con 0x5603e84bd640 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.516+0000 7fcdd8c00640 10 client.5307 handle_command_reply: tid=0 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.516+0000 7fcdf8c45740 1 client.5307 shutdown 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 msgr2=0x5603e84bc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00cfd0 tx=0x7fcddc000f20 comp rx=0 tx=0).stop 2024-09-13T18:36:54.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 shutdown_connections 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84bd640 0x5603e84bab60 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e84bc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84c1b80 0x5603e84bc2a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3323604149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e849a6d0 0x5603e84dc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdd8c00640 0 client.5307 ms_handle_reset on v2:172.21.15.192:6834/367924662 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 >> 172.21.15.192:0/3323604149 conn(0x5603e8497e90 msgr2=0x5603e84e27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 shutdown_connections 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3323604149 wait complete. 2024-09-13T18:36:54.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.517+0000 7fcdf8c45740 20 client.5307 trim_cache size 0 max 16384 2024-09-13T18:36:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.532+0000 7fcdf8c45740 1 Processor -- start 2024-09-13T18:36:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.532+0000 7fcdf8c45740 1 -- start start 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e84be7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e8494d90 con 0x5603e84945b0 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e84c4060 con 0x5603e849a6d0 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603e85018a0 con 0x5603e84c1b80 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdeea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdeea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58810/0 (socket says 172.21.15.192:58810) 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.533+0000 7fcdeea00640 1 -- 172.21.15.192:0/1116292913 learned_addr learned my addr 172.21.15.192:0/1116292913 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 -- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 msgr2=0x5603e84f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 -- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 msgr2=0x5603e84be7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e84be7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 -- 172.21.15.192:0/1116292913 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603e8430170 con 0x5603e84945b0 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcdeea00640 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcde00054a0 tx=0x7fcde0011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42d22ee7dec3508e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcde4c00640 1 -- 172.21.15.192:0/1116292913 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000e960 con 0x5603e84945b0 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcde4c00640 1 -- 172.21.15.192:0/1116292913 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000eac0 con 0x5603e84945b0 2024-09-13T18:36:54.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.534+0000 7fcde4c00640 1 -- 172.21.15.192:0/1116292913 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000ec30 con 0x5603e84945b0 2024-09-13T18:36:54.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1116292913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 msgr2=0x5603e84be260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcde00054a0 tx=0x7fcde0011000 comp rx=0 tx=0).stop 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1116292913 shutdown_connections 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e849a6d0 0x5603e84be7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/1116292913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e84945b0 0x5603e84be260 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1116292913 >> 172.21.15.192:0/1116292913 conn(0x5603e8497e90 msgr2=0x5603e84bf530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1116292913 shutdown_connections 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- 172.21.15.192:0/1116292913 wait complete. 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.535+0000 7fcdf8c45740 1 -- start start 2024-09-13T18:36:54.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.536+0000 7fcdf8c45740 1 Processor -- start 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.536+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e8543150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.536+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdf8c45740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e8543690 con 0x5603e849a6d0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603e84c0a10 con 0x5603e84945b0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdf8c45740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5603e84f8820 con 0x5603e84c1b80 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdf8c45740 10 client.0 _ll_register_callbacks cb 0x7fcde00013f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58818/0 (socket says 172.21.15.192:58818) 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdeea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e8543150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 -- 172.21.15.192:0/3988558666 learned_addr learned my addr 172.21.15.192:0/3988558666 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdef400640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 -- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 msgr2=0x5603e84a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 -- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 msgr2=0x5603e8543150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e8543150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 -- 172.21.15.192:0/3988558666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde000f040 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdee000640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcddc057720 tx=0x7fcddc086cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204f032545737c22 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.537+0000 7fcdd8c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc05f6f0 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcddc05fb80 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcddc05b5c0 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcddc00e040 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 10 client.5313 fetch_fsmap learned FSMap version 16 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5603e839d470 con 0x5603e849a6d0 2024-09-13T18:36:54.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc05b5c0 con 0x5603e849a6d0 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcddc053580 con 0x5603e849a6d0 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 10 client.5313 fetch_fsmap finished waiting for FSMap version 16 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 10 client.5313 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 20 client.5313 populate_metadata read hostname 'smithi192' 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84a2f20 0x5603e84db500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 4 client.5313 mds_command: new command op to 5094 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 --> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5603e81016c0 con 0x5603e84a2f20 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.538+0000 7fcdeea00640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84a2f20 0x5603e84db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdeea00640 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84a2f20 0x5603e84db500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62420bbcb31a8705 server_cookie=c0b7bdd2bb42ec84 in_seq=0 out_seq=0 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdd8c00640 10 client.5313 ms_handle_connect on v2:172.21.15.192:6834/367924662 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdd8c00640 1 -- 172.21.15.192:0/3988558666 <== mds.0 v2:172.21.15.192:6834/367924662 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x5603e81016c0 con 0x5603e84a2f20 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdd8c00640 10 client.5313 handle_command_reply: tid=0 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 client.5313 shutdown 2024-09-13T18:36:54.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 msgr2=0x5603e852f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcddc057720 tx=0x7fcddc086cf0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 shutdown_connections 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5603e84c1b80 0x5603e84a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5603e849a6d0 0x5603e852f250 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.192:6834/367924662,v1:172.21.15.192:6836/367924662] conn(0x5603e84a2f20 0x5603e84db500 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 --2- 172.21.15.192:0/3988558666 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5603e84945b0 0x5603e8543150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 >> 172.21.15.192:0/3988558666 conn(0x5603e8497e90 msgr2=0x5603e84bf380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.539+0000 7fcdd8c00640 0 client.5313 ms_handle_reset on v2:172.21.15.192:6834/367924662 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 shutdown_connections 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf8c45740 1 -- 172.21.15.192:0/3988558666 wait complete. 2024-09-13T18:36:54.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf8c45740 20 client.5313 trim_cache size 0 max 16384 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 5094, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 10.599796343, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 16, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 35, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 35, 2024-09-13T18:36:54.548 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 18.010450193 2024-09-13T18:36:54.549 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:36:54.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 msgr2=0x7fcdd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 0x7fcdd006d0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcdf015a7e0 tx=0x7fcde0009040 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 msgr2=0x7fcdf006bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcddc00c4c0 tx=0x7fcddc00c980 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 shutdown_connections 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcdd006ac00 0x7fcdd006d0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcdf015e790 0x7fcdf015c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcdf00cacd0 0x7fcdf006bf90 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 --2- 172.21.15.192:0/1525700900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcdf00b0490 0x7fcdf006ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.540+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 >> 172.21.15.192:0/1525700900 conn(0x7fcdf00ae960 msgr2=0x7fcdf00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.541+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 shutdown_connections 2024-09-13T18:36:54.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.541+0000 7fcdf5e00640 1 -- 172.21.15.192:0/1525700900 wait complete. 2024-09-13T18:36:54.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:54.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.710+0000 7f84dae00640 1 Processor -- start 2024-09-13T18:36:54.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.710+0000 7f84dae00640 1 -- start start 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.711+0000 7f84dae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f84d406cf90 0x7f84d40ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.711+0000 7f84dae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40717b0 con 0x7f84d40aefd0 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.711+0000 7f84dae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d406fab0 con 0x7f84d415ce30 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.711+0000 7f84dae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d40ae350 con 0x7f84d406cf90 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d9000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f84d40aefd0 0x7f84d415c720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53764/0 (socket says 172.21.15.192:53764) 2024-09-13T18:36:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d9000640 1 -- 172.21.15.192:0/3746686806 learned_addr learned my addr 172.21.15.192:0/3746686806 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:54.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d9a00640 1 --2- 172.21.15.192:0/3746686806 >> v2:172.21.15.194:3300/0 conn(0x7f84d406cf90 0x7f84d40ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219561613 0 0) 0x7f84d40717b0 con 0x7f84d40aefd0 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84bc003520 con 0x7f84d40aefd0 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2226548113 0 0) 0x7f84d406fab0 con 0x7f84d415ce30 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84d40717b0 con 0x7f84d415ce30 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895066183 0 0) 0x7f84bc003520 con 0x7f84d40aefd0 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 >> v2:172.21.15.194:3300/0 conn(0x7f84d406cf90 msgr2=0x7f84d40ade10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 --2- 172.21.15.192:0/3746686806 >> v2:172.21.15.194:3300/0 conn(0x7f84d406cf90 0x7f84d40ade10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 >> v1:172.21.15.194:6789/0 conn(0x7f84d415ce30 legacy=0x7f84d4160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d4070830 con 0x7f84d40aefd0 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f84c0001670 con 0x7f84d40aefd0 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 >> v1:172.21.15.192:6789/0 conn(0x7f84d40aefd0 legacy=0x7f84d415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc003b00 0x7f84bc003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.712+0000 7f84d3e00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84bc005180 0x7f84bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40ae350 con 0x7f84bc0047c0 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc00c000 con 0x7f84bc003b00 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84bc00c1c0 con 0x7f84bc005180 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9a00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc003b00 0x7f84bc003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84da400640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84bc005180 0x7f84bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 -- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84bc005180 msgr2=0x7f84bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84bc005180 0x7f84bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 -- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc003b00 msgr2=0x7f84bc003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc003b00 0x7f84bc003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9000640 1 -- 172.21.15.192:0/3746686806 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc003520 con 0x7f84bc0047c0 2024-09-13T18:36:54.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84da400640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84bc005180 0x7f84bc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:54.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84d9a00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84bc003b00 0x7f84bc003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:36:54.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.713+0000 7f84da400640 1 -- 172.21.15.192:0/3746686806 reap_dead start 2024-09-13T18:36:54.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.714+0000 7f84d9000640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84bc004c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c190 tx=0x7f84bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f029bdbec84df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.714+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0005ad0 con 0x7f84bc0047c0 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.714+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c002d070 con 0x7f84bc0047c0 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.714+0000 7f84d3e00640 1 -- 172.21.15.192:0/3746686806 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c0007070 con 0x7f84bc0047c0 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 -- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 msgr2=0x7f84bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84bc004c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f84c000c190 tx=0x7f84bc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 -- 172.21.15.192:0/3746686806 shutdown_connections 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 --2- 172.21.15.192:0/3746686806 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84bc004c40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 -- 172.21.15.192:0/3746686806 >> 172.21.15.192:0/3746686806 conn(0x7f84d406ade0 msgr2=0x7f84d406b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 -- 172.21.15.192:0/3746686806 shutdown_connections 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.715+0000 7f84dae00640 1 -- 172.21.15.192:0/3746686806 wait complete. 2024-09-13T18:36:54.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.717+0000 7f84dae00640 1 Processor -- start 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.717+0000 7f84dae00640 1 -- start start 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 0x7f84d41535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 0x7f84d41595f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d414e980 con 0x7f84bc0047c0 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4153e10 con 0x7f84d4151e20 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84dae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d41540f0 con 0x7f84d4154eb0 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58832/0 (socket says 172.21.15.192:58832) 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 -- 172.21.15.192:0/2553548464 learned_addr learned my addr 172.21.15.192:0/2553548464 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9000640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 0x7f84d41535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 -- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 msgr2=0x7f84d41595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84da400640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 0x7f84d41595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 0x7f84d41595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 -- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 msgr2=0x7f84d41535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 0x7f84d41535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9a00640 1 -- 172.21.15.192:0/2553548464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d41543d0 con 0x7f84bc0047c0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84d9000640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 0x7f84d41535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.718+0000 7f84da400640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 0x7f84d41595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84d9a00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f84c8006c00 tx=0x7f84c800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8011c90 con 0x7f84bc0047c0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c8011df0 con 0x7f84bc0047c0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d41546b0 con 0x7f84bc0047c0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8014660 con 0x7f84bc0047c0 2024-09-13T18:36:54.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.719+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d4153b20 con 0x7f84bc0047c0 2024-09-13T18:36:54.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.720+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40ae560 con 0x7f84bc0047c0 2024-09-13T18:36:54.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.721+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f84c80147c0 con 0x7f84bc0047c0 2024-09-13T18:36:54.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.722+0000 7f84d1600640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 0x7f84b406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:54.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.722+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84c8089b30 con 0x7f84bc0047c0 2024-09-13T18:36:54.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.722+0000 7f84d9000640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 0x7f84b406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:54.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.723+0000 7f84d9000640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 0x7f84b406d0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f84c0032000 tx=0x7f84c0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:54.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.726+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f84c8054c70 con 0x7f84bc0047c0 2024-09-13T18:36:54.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.929+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f84d4156150 con 0x7f84bc0047c0 2024-09-13T18:36:54.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.929+0000 7f84d1600640 1 -- 172.21.15.192:0/2553548464 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f84c8058290 con 0x7f84bc0047c0 2024-09-13T18:36:54.932 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:54.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.931+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 msgr2=0x7f84b406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.931+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 0x7f84b406d0f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f84c0032000 tx=0x7f84c0009030 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.931+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 msgr2=0x7f84d414e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.931+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f84c8006c00 tx=0x7f84c800f610 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 shutdown_connections 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f84b406ac30 0x7f84b406d0f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84d4154eb0 0x7f84d41595f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f84d4151e20 0x7f84d41535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 --2- 172.21.15.192:0/2553548464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84bc0047c0 0x7f84d414e440 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 >> 172.21.15.192:0/2553548464 conn(0x7f84d406ade0 msgr2=0x7f84d4070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 shutdown_connections 2024-09-13T18:36:54.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:54.932+0000 7f84dae00640 1 -- 172.21.15.192:0/2553548464 wait complete. 2024-09-13T18:36:54.949 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:54.950 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:54.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:54.951 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:36:54.987 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:54.988 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42694sec preferred_lft 42694sec 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:36:54.989 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:36:54.990 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:36:54.991 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:54.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:54.991 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:55.081 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:36:55.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.084 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:36:55.121 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:36:55.121 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:55.121 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:55.121 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:55.121 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:55.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:55.122 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:36:55.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.267 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:36:55.303 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:36:55.303 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:36:55.303 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:55.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:36:55.400 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:55.400 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:55.435 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:36:55.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:55.436 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:55.510 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:36:55.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.510 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:55.639 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:55.639 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:55.667 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:55.667 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:55.667 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:55.667 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:55.667 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:55.669 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:36:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:55.672 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:55.672 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.672 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:36:55.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:55.728 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:55.772 INFO:teuthology.orchestra.run.smithi192.stdout:client5215 2024-09-13T18:36:55.772 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:36:55.772 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:55.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:36:56.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.039+0000 7ff42fe00640 1 Processor -- start 2024-09-13T18:36:56.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.039+0000 7ff42fe00640 1 -- start start 2024-09-13T18:36:56.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff42fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159b00 0x7ff4300b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff42fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff43006bc30 0x7ff4300b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff42fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43015af60 con 0x7ff430159ee0 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff42fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43015aaa0 con 0x7ff43006bc30 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff42fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43006b7a0 con 0x7ff430159b00 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff426000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff43006bc30 0x7ff4300b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff426000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff43006bc30 0x7ff4300b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58834/0 (socket says 172.21.15.192:58834) 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.040+0000 7ff426000640 1 -- 172.21.15.192:0/2162309724 learned_addr learned my addr 172.21.15.192:0/2162309724 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.041+0000 7ff42ea00640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159b00 0x7ff4300b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.041+0000 7ff426000640 1 -- 172.21.15.192:0/2162309724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159b00 msgr2=0x7ff4300b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.041+0000 7ff426000640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159b00 0x7ff4300b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.041+0000 7ff426000640 1 -- 172.21.15.192:0/2162309724 >> v1:172.21.15.194:6789/0 conn(0x7ff430159ee0 legacy=0x7ff43015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.041+0000 7ff426000640 1 -- 172.21.15.192:0/2162309724 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43015ac80 con 0x7ff43006bc30 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.042+0000 7ff426000640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff43006bc30 0x7ff4300b32b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff418009870 tx=0x7ff41802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac15092e81ca30a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.042+0000 7ff42e000640 1 -- 172.21.15.192:0/2162309724 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418032440 con 0x7ff43006bc30 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.042+0000 7ff42e000640 1 -- 172.21.15.192:0/2162309724 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180325a0 con 0x7ff43006bc30 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.042+0000 7ff42e000640 1 -- 172.21.15.192:0/2162309724 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418032930 con 0x7ff43006bc30 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 -- 172.21.15.192:0/2162309724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff43006bc30 msgr2=0x7ff4300b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff43006bc30 0x7ff4300b32b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7ff418009870 tx=0x7ff41802a250 comp rx=0 tx=0).stop 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 -- 172.21.15.192:0/2162309724 shutdown_connections 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff43006bc30 0x7ff4300b32b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 --2- 172.21.15.192:0/2162309724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159b00 0x7ff4300b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 -- 172.21.15.192:0/2162309724 >> 172.21.15.192:0/2162309724 conn(0x7ff4300736d0 msgr2=0x7ff4300b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:56.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 -- 172.21.15.192:0/2162309724 shutdown_connections 2024-09-13T18:36:56.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.043+0000 7ff42fe00640 1 -- 172.21.15.192:0/2162309724 wait complete. 2024-09-13T18:36:56.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.044+0000 7ff42fe00640 1 Processor -- start 2024-09-13T18:36:56.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 -- start start 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43006bc30 0x7ff430071350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 0x7ff430156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4301527f0 con 0x7ff430159b00 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff430152ad0 con 0x7ff43006bc30 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.045+0000 7ff42fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff430152db0 con 0x7ff430159ee0 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58848/0 (socket says 172.21.15.192:58848) 2024-09-13T18:36:56.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 -- 172.21.15.192:0/905502383 learned_addr learned my addr 172.21.15.192:0/905502383 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff42ea00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43006bc30 0x7ff430071350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff42f400640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 0x7ff430156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 -- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 msgr2=0x7ff430156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 0x7ff430156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 -- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43006bc30 msgr2=0x7ff430071350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43006bc30 0x7ff430071350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 -- 172.21.15.192:0/905502383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180094d0 con 0x7ff430159b00 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff42f400640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 0x7ff430156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:56.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.046+0000 7ff426000640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff4180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.047+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418032440 con 0x7ff430159b00 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.047+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff418030b80 con 0x7ff430159b00 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.047+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41803d440 con 0x7ff430159b00 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.047+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff430153090 con 0x7ff430159b00 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.047+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4301524c0 con 0x7ff430159b00 2024-09-13T18:36:56.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.048+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff430153550 con 0x7ff430159b00 2024-09-13T18:36:56.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.049+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff418039040 con 0x7ff430159b00 2024-09-13T18:36:56.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.050+0000 7ff427400640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:56.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.050+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4180a9e00 con 0x7ff430159b00 2024-09-13T18:36:56.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.050+0000 7ff42ea00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:56.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.050+0000 7ff42ea00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 0x7ff40c06d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff420006fd0 tx=0x7ff420008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:56.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.054+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff418074fd0 con 0x7ff430159b00 2024-09-13T18:36:56.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.258+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff43015a390 con 0x7ff430159b00 2024-09-13T18:36:56.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.258+0000 7ff427400640 1 -- 172.21.15.192:0/905502383 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff4180785f0 con 0x7ff430159b00 2024-09-13T18:36:56.261 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:36:56.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 msgr2=0x7ff40c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 0x7ff40c06d0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff420006fd0 tx=0x7ff420008040 comp rx=0 tx=0).stop 2024-09-13T18:36:56.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 msgr2=0x7ff430151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:56.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff418000c00 tx=0x7ff4180046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 shutdown_connections 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40c06ac00 0x7ff40c06d0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff430159ee0 0x7ff430156680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff430159b00 0x7ff430151f80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 --2- 172.21.15.192:0/905502383 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff43006bc30 0x7ff430071350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 >> 172.21.15.192:0/905502383 conn(0x7ff4300736d0 msgr2=0x7ff4300b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 shutdown_connections 2024-09-13T18:36:56.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:56.260+0000 7ff42fe00640 1 -- 172.21.15.192:0/905502383 wait complete. 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:36:56.279 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:36:56.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.280 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:36:56.321 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42698sec preferred_lft 42698sec 2024-09-13T18:36:56.322 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:36:56.323 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:36:56.324 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:36:56.324 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:36:56.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.324 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:36:56.418 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:36:56.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.421 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:36:56.458 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:36:56.459 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:36:56.459 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:36:56.459 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:36:56.459 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:36:56.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.459 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:36:56.459 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:36:56.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:36:56.459 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:36:56.460 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:36:56.460 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:36:56.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.605 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:36:56.640 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:36:56.640 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:36:56.640 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:36:56.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.640 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:36:56.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:56.737 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:56.773 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:36:56.773 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:36:56.773 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:56.848 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:36:56.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:56.848 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:56.976 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:56.977 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:57.004 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:36:57.005 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:36:57.005 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:36:57.005 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:36:57.005 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:36:57.006 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:36:57.006 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:36:57.006 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:36:57.006 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:36:57.006 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:36:57.009 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:36:57.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:57.009 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:36:57.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:57.064 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:57.102 INFO:teuthology.orchestra.run.smithi194.stdout:client5224 2024-09-13T18:36:57.102 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:36:57.102 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:36:57.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:36:57.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.334+0000 7f90fd000640 1 Processor -- start 2024-09-13T18:36:57.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.334+0000 7f90fd000640 1 -- start start 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90fd000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f90f8070f80 0x7f90f80cda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90fd000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f8070570 con 0x7f90f81604c0 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90fd000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f80707a0 con 0x7f90f80c9ae0 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90fd000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f8070a80 con 0x7f90f8070f80 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90f5e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f90f81604c0 0x7f90f8066510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53770/0 (socket says 172.21.15.192:53770) 2024-09-13T18:36:57.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.335+0000 7f90f5e00640 1 -- 172.21.15.192:0/3481157656 learned_addr learned my addr 172.21.15.192:0/3481157656 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928746909 0 0) 0x7f90f8070570 con 0x7f90f81604c0 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f5400640 1 --2- 172.21.15.192:0/3481157656 >> v2:172.21.15.194:3300/0 conn(0x7f90f8070f80 0x7f90f80cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90dc003520 con 0x7f90f81604c0 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1349438033 0 0) 0x7f90dc003520 con 0x7f90f81604c0 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 >> v2:172.21.15.194:3300/0 conn(0x7f90f8070f80 msgr2=0x7f90f80cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 --2- 172.21.15.192:0/3481157656 >> v2:172.21.15.194:3300/0 conn(0x7f90f8070f80 0x7f90f80cda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 >> v1:172.21.15.194:6789/0 conn(0x7f90f80c9ae0 legacy=0x7f90f80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f80cb830 con 0x7f90f81604c0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f90e8001670 con 0x7f90f81604c0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 >> v1:172.21.15.192:6789/0 conn(0x7f90f81604c0 legacy=0x7f90f8066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90dc0039c0 0x7f90dc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 0x7f90dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc005180 0x7f90dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8070a80 con 0x7f90dc005180 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc00c080 con 0x7f90dc0039c0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.336+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90dc00c240 con 0x7f90dc0047c0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5e00640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90dc0039c0 0x7f90dc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f6800640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc005180 0x7f90dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 0x7f90dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 -- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90dc0039c0 msgr2=0x7f90dc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:57.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90dc0039c0 0x7f90dc003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 -- 172.21.15.192:0/3481157656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc005180 msgr2=0x7f90dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:57.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc005180 0x7f90dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f5400640 1 -- 172.21.15.192:0/3481157656 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90dc003520 con 0x7f90dc0047c0 2024-09-13T18:36:57.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.337+0000 7f90f6800640 1 -- 172.21.15.192:0/3481157656 reap_dead start 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.338+0000 7f90f5400640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 0x7f90dc004c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009a90 tx=0x7f90dc0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8caf2adfcd95609a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.338+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031400 con 0x7f90dc0047c0 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e402d050 con 0x7f90dc0047c0 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90f4a00640 1 -- 172.21.15.192:0/3481157656 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e4031780 con 0x7f90dc0047c0 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 -- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 msgr2=0x7f90dc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 0x7f90dc004c40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f90e4009a90 tx=0x7f90dc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 -- 172.21.15.192:0/3481157656 shutdown_connections 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 --2- 172.21.15.192:0/3481157656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90dc0047c0 0x7f90dc004c40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 -- 172.21.15.192:0/3481157656 >> 172.21.15.192:0/3481157656 conn(0x7f90f80cf490 msgr2=0x7f90f80cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 -- 172.21.15.192:0/3481157656 shutdown_connections 2024-09-13T18:36:57.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.339+0000 7f90fd000640 1 -- 172.21.15.192:0/3481157656 wait complete. 2024-09-13T18:36:57.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.341+0000 7f90fd000640 1 Processor -- start 2024-09-13T18:36:57.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.341+0000 7f90fd000640 1 -- start start 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90f815c630 0x7f90f815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90f80af190 0x7f90f80af610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f8157600 con 0x7f90dc0047c0 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f80afb50 con 0x7f90f80af190 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90fd000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f814abe0 con 0x7f90f815c630 2024-09-13T18:36:57.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90f5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90f5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58866/0 (socket says 172.21.15.192:58866) 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90f5e00640 1 -- 172.21.15.192:0/2407768574 learned_addr learned my addr 172.21.15.192:0/2407768574 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90f5400640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90f815c630 0x7f90f815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.342+0000 7f90f6800640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90f80af190 0x7f90f80af610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 -- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90f815c630 msgr2=0x7f90f815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90f815c630 0x7f90f815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 -- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90f80af190 msgr2=0x7f90f80af610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90f80af190 0x7f90f80af610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 -- 172.21.15.192:0/2407768574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f814a060 con 0x7f90dc0047c0 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90f5e00640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007290 tx=0x7f90e8007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e8007700 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e800f940 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e800fcf0 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f814a340 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.343+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f814a900 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.345+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f80668a0 con 0x7f90dc0047c0 2024-09-13T18:36:57.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.345+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f90e801d460 con 0x7f90dc0047c0 2024-09-13T18:36:57.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.346+0000 7f90ee000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 0x7f90d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.346+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90e8089290 con 0x7f90dc0047c0 2024-09-13T18:36:57.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.346+0000 7f90f5400640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 0x7f90d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.347+0000 7f90f5400640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 0x7f90d806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90e4033000 tx=0x7f90e4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.351+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90e8054500 con 0x7f90dc0047c0 2024-09-13T18:36:57.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.552+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90f815eb60 con 0x7f90dc0047c0 2024-09-13T18:36:57.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.552+0000 7f90ee000640 1 -- 172.21.15.192:0/2407768574 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f90e8057b20 con 0x7f90dc0047c0 2024-09-13T18:36:57.555 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:57.555 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:36:57.556 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:36:57.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 msgr2=0x7f90d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 0x7f90d806d0c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f90e4033000 tx=0x7f90e4008030 comp rx=0 tx=0).stop 2024-09-13T18:36:57.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 msgr2=0x7f90f815abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90e8007290 tx=0x7f90e8007690 comp rx=0 tx=0).stop 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 shutdown_connections 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90d806ac00 0x7f90d806d0c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f90f80af190 0x7f90f80af610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90f815c630 0x7f90f815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 --2- 172.21.15.192:0/2407768574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90dc0047c0 0x7f90f815abe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.554+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 >> 172.21.15.192:0/2407768574 conn(0x7f90f80cf490 msgr2=0x7f90f806f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.555+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 shutdown_connections 2024-09-13T18:36:57.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.555+0000 7f90fd000640 1 -- 172.21.15.192:0/2407768574 wait complete. 2024-09-13T18:36:57.573 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:36:57.742 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":5094,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.787372556999999,"mdsmap_epoch":16,"osdmap_epoch":35,"osdmap_epoch_barrier":35,"uptime":21.19802893} 2024-09-13T18:36:57.743 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 5094, "mdsmap_epoch": 16, "osdmap_epoch": 35, "osdmap_epoch_barrier": 35, "rank_uptime": 13.787372557, "state": "up:active", "uptime": 21.19802893, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:36:57.743 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2024-09-13T18:36:57.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.894+0000 7f125f200640 1 Processor -- start 2024-09-13T18:36:57.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.894+0000 7f125f200640 1 -- start start 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f126015cef0 0x7f126006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12600cde60 0x7f12600b2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12600ce5d0 con 0x7f12600cfc30 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12600cda20 con 0x7f12600cde60 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12600ce2f0 con 0x7f126015cef0 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12600cde60 0x7f12600b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f12600cde60 0x7f12600b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58878/0 (socket says 172.21.15.192:58878) 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125d400640 1 -- 172.21.15.192:0/4009272803 learned_addr learned my addr 172.21.15.192:0/4009272803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:57.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.895+0000 7f125de00640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f126015cef0 0x7f126006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.896+0000 7f125d400640 1 -- 172.21.15.192:0/4009272803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f126015cef0 msgr2=0x7f126006ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:57.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.896+0000 7f125d400640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f126015cef0 0x7f126006ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.896+0000 7f125d400640 1 -- 172.21.15.192:0/4009272803 >> v1:172.21.15.194:6789/0 conn(0x7f12600cfc30 legacy=0x7f12600b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.896+0000 7f125d400640 1 -- 172.21.15.192:0/4009272803 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f126006af50 con 0x7f12600cde60 2024-09-13T18:36:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125d400640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12600cde60 0x7f12600b2110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f124c009870 tx=0x7f124c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6564632db10ebd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125ca00640 1 -- 172.21.15.192:0/4009272803 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c032440 con 0x7f12600cde60 2024-09-13T18:36:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125ca00640 1 -- 172.21.15.192:0/4009272803 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0325a0 con 0x7f12600cde60 2024-09-13T18:36:57.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125ca00640 1 -- 172.21.15.192:0/4009272803 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c032930 con 0x7f12600cde60 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 -- 172.21.15.192:0/4009272803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12600cde60 msgr2=0x7f12600b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12600cde60 0x7f12600b2110 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f124c009870 tx=0x7f124c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 -- 172.21.15.192:0/4009272803 shutdown_connections 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12600cde60 0x7f12600b2110 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 --2- 172.21.15.192:0/4009272803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f126015cef0 0x7f126006ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.897+0000 7f125f200640 1 -- 172.21.15.192:0/4009272803 >> 172.21.15.192:0/4009272803 conn(0x7f12600b4b70 msgr2=0x7f12600b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.898+0000 7f125f200640 1 -- 172.21.15.192:0/4009272803 shutdown_connections 2024-09-13T18:36:57.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.898+0000 7f125f200640 1 -- 172.21.15.192:0/4009272803 wait complete. 2024-09-13T18:36:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.899+0000 7f125f200640 1 Processor -- start 2024-09-13T18:36:57.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.899+0000 7f125f200640 1 -- start start 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 0x7f12601f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12600b16b0 0x7f12601f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12601f3cb0 con 0x7f126015cef0 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12600cc860 con 0x7f12600cfc30 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12601f3410 con 0x7f12600b16b0 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58894/0 (socket says 172.21.15.192:58894) 2024-09-13T18:36:57.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.900+0000 7f125d400640 1 -- 172.21.15.192:0/3924124444 learned_addr learned my addr 172.21.15.192:0/3924124444 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:57.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125e800640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12600b16b0 0x7f12601f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125de00640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 0x7f12601f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 -- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12600b16b0 msgr2=0x7f12601f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12600b16b0 0x7f12601f69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 -- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 msgr2=0x7f12601f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 0x7f12601f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 -- 172.21.15.192:0/3924124444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c0094d0 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125de00640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 0x7f12601f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f125d400640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f124c000c00 tx=0x7f124c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.901+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c032440 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.902+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c030980 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.902+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c030d10 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.902+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12601f36f0 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.902+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12601f64a0 con 0x7f126015cef0 2024-09-13T18:36:57.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.903+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12601f6300 con 0x7f126015cef0 2024-09-13T18:36:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.903+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f124c039040 con 0x7f126015cef0 2024-09-13T18:36:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.904+0000 7f1256000640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 0x7f124006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.904+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f124c0a9d70 con 0x7f126015cef0 2024-09-13T18:36:57.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.905+0000 7f125de00640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 0x7f124006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:57.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.905+0000 7f125de00640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 0x7f124006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1250009a20 tx=0x7f1250008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:57.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:57.909+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f12601f6300 con 0x7f126015cef0 2024-09-13T18:36:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.146+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f12601f6300 con 0x7f126015cef0 2024-09-13T18:36:58.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.146+0000 7f1256000640 1 -- 172.21.15.192:0/3924124444 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1619 (secure 0 0 0) 0x7f124c041670 con 0x7f126015cef0 2024-09-13T18:36:58.149 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "stats": { 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "total_bytes": 1600000000, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "total_avail_bytes": 1597566268, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_bytes": 2433732, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_raw_bytes": 2433732, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_raw_ratio": 0.0015210824785754085, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "num_osds": 8, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "num_per_pool_osds": 0, 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: "num_per_pool_omap_osds": 0 2024-09-13T18:36:58.150 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "stats_by_class": { 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "hdd": { 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "total_bytes": 1600000000, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "total_avail_bytes": 1597566268, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_bytes": 2433732, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_raw_bytes": 2433732, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "total_used_raw_ratio": 0.0015210824785754085 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:36:58.151 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "name": ".mgr", 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 1, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "stats": { 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "stored": 590368, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "objects": 2, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "kb_used": 577, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "bytes_used": 590368, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "percent_used": 0.0005296607268974185, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "max_avail": 557012544 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:58.152 INFO:teuthology.orchestra.run.smithi192.stdout: "name": "cephfs_metadata", 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 4, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "stats": { 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "stored": 2362, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "objects": 22, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "kb_used": 3, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "bytes_used": 2362, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "percent_used": 2.1202351945248665e-06, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "max_avail": 557012544 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "name": "cephfs_data", 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 5, 2024-09-13T18:36:58.153 INFO:teuthology.orchestra.run.smithi192.stdout: "stats": { 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "stored": 0, 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "objects": 0, 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "kb_used": 0, 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "bytes_used": 0, 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "percent_used": 0, 2024-09-13T18:36:58.154 INFO:teuthology.orchestra.run.smithi192.stdout: "max_avail": 557012544 2024-09-13T18:36:58.155 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:58.155 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:36:58.155 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:36:58.156 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.148+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 msgr2=0x7f124006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.148+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 0x7f124006d0f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1250009a20 tx=0x7f1250008040 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.148+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 msgr2=0x7f12600cc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.148+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f124c000c00 tx=0x7f124c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 shutdown_connections 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f124006ac30 0x7f124006d0f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f12600b16b0 0x7f12601f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f126015cef0 0x7f12600cc320 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 --2- 172.21.15.192:0/3924124444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f12600cfc30 0x7f12601f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 >> 172.21.15.192:0/3924124444 conn(0x7f12600b4b70 msgr2=0x7f12600b7c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 shutdown_connections 2024-09-13T18:36:58.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.149+0000 7f125f200640 1 -- 172.21.15.192:0/3924124444 wait complete. 2024-09-13T18:36:58.167 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:36:58.167 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:36:58.168 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:36:58.168 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:36:58.168 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:36:58.168 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:36:58.168 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:36:58.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:58.452 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:36:58.531 INFO:teuthology.orchestra.run.smithi192.stdout:client5215 2024-09-13T18:36:58.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:36:58.532 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client5215/osdmap') 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 35 barrier 35 flags 0x588000 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:36:58.627 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:36:58.628 INFO:teuthology.orchestra.run.smithi192.stderr:799 bytes copied, 0.000109259 s, 7.3 MB/s 2024-09-13T18:36:58.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-13T18:36:58.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.782+0000 7f1fa7e00640 1 Processor -- start 2024-09-13T18:36:58.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.782+0000 7f1fa7e00640 1 -- start start 2024-09-13T18:36:58.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1fa806b8d0 0x7f1fa806bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fa80b2590 0x7f1fa80b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fa80b2100 con 0x7f1fa815ad10 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa806c250 con 0x7f1fa80b2590 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fa8150f10 con 0x7f1fa806b8d0 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fa80b2590 0x7f1fa80b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1fa80b2590 0x7f1fa80b2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58910/0 (socket says 172.21.15.192:58910) 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa7400640 1 -- 172.21.15.192:0/3535114951 learned_addr learned my addr 172.21.15.192:0/3535114951 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.783+0000 7f1fa6a00640 1 --1- 172.21.15.192:0/3535114951 >> v1:172.21.15.192:6789/0 conn(0x7f1fa815ad10 0x7f1fa8069ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53772/0 (socket says 172.21.15.192:53772) 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1f9e000640 1 --2- 172.21.15.192:0/3535114951 >> v2:172.21.15.194:3300/0 conn(0x7f1fa806b8d0 0x7f1fa806bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1fa7400640 1 -- 172.21.15.192:0/3535114951 >> v2:172.21.15.194:3300/0 conn(0x7f1fa806b8d0 msgr2=0x7f1fa806bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1fa7400640 1 --2- 172.21.15.192:0/3535114951 >> v2:172.21.15.194:3300/0 conn(0x7f1fa806b8d0 0x7f1fa806bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1fa7400640 1 -- 172.21.15.192:0/3535114951 >> v1:172.21.15.192:6789/0 conn(0x7f1fa815ad10 legacy=0x7f1fa8069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1fa7400640 1 -- 172.21.15.192:0/3535114951 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa815a2c0 con 0x7f1fa80b2590 2024-09-13T18:36:58.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.784+0000 7f1fa6000640 1 -- 172.21.15.192:0/3535114951 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075652962 0 0) 0x7f1fa80b2100 con 0x7f1fa815ad10 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.785+0000 7f1fa7400640 1 --2- 172.21.15.192:0/3535114951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa80b2590 0x7f1fa80b2a00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80cb4c0 tx=0x7f1fa002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c011673b6cde5d8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.785+0000 7f1fa6000640 1 -- 172.21.15.192:0/3535114951 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa000b2e0 con 0x7f1fa80b2590 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.785+0000 7f1fa6000640 1 -- 172.21.15.192:0/3535114951 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa000b440 con 0x7f1fa80b2590 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.785+0000 7f1fa6000640 1 -- 172.21.15.192:0/3535114951 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0009820 con 0x7f1fa80b2590 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3535114951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa80b2590 msgr2=0x7f1fa80b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3535114951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa80b2590 0x7f1fa80b2a00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f1fa80cb4c0 tx=0x7f1fa002c940 comp rx=0 tx=0).stop 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3535114951 shutdown_connections 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3535114951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa80b2590 0x7f1fa80b2a00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3535114951 >> v2:172.21.15.194:3300/0 conn(0x7f1fa806b8d0 0x7f1fa806bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3535114951 >> 172.21.15.192:0/3535114951 conn(0x7f1fa80b09f0 msgr2=0x7f1fa80b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:58.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3535114951 shutdown_connections 2024-09-13T18:36:58.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.786+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3535114951 wait complete. 2024-09-13T18:36:58.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.787+0000 7f1fa7e00640 1 Processor -- start 2024-09-13T18:36:58.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.787+0000 7f1fa7e00640 1 -- start start 2024-09-13T18:36:58.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa80b2590 0x7f1fa814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa815ad10 0x7f1fa814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa8139c30 con 0x7f1fa806b8d0 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa814f520 con 0x7f1fa815ad10 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.788+0000 7f1fa7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fa814f7c0 con 0x7f1fa80b2590 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58916/0 (socket says 172.21.15.192:58916) 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 -- 172.21.15.192:0/3225502234 learned_addr learned my addr 172.21.15.192:0/3225502234 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa7400640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa815ad10 0x7f1fa814d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1f9e000640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa80b2590 0x7f1fa814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 -- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa80b2590 msgr2=0x7f1fa814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa80b2590 0x7f1fa814c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 -- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa815ad10 msgr2=0x7f1fa814d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa815ad10 0x7f1fa814d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 -- 172.21.15.192:0/3225502234 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa000bd40 con 0x7f1fa806b8d0 2024-09-13T18:36:58.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.789+0000 7f1fa6a00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c4d0 tx=0x7f1f9800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.790+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f980074e0 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.790+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f98007660 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.790+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f98004a20 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.790+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fa814fa60 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.790+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa8150020 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.791+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fa806bd10 con 0x7f1fa806b8d0 2024-09-13T18:36:58.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.792+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f98004b80 con 0x7f1fa806b8d0 2024-09-13T18:36:58.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.793+0000 7f1f9f400640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 0x7f1f8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:58.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.793+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f98088530 con 0x7f1fa806b8d0 2024-09-13T18:36:58.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.793+0000 7f1f9e000640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 0x7f1f8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:58.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.793+0000 7f1f9e000640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 0x7f1f8406d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fa814d480 tx=0x7f1f90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:58.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.797+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f98053720 con 0x7f1fa806b8d0 2024-09-13T18:36:58.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.976+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f1fa80ae740 con 0x7f1fa806b8d0 2024-09-13T18:36:58.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.991+0000 7f1f9f400640 1 -- 172.21.15.192:0/3225502234 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v36) v1 ==== 93+0+0 (secure 0 0 0) 0x7f1f98056d40 con 0x7f1fa806b8d0 2024-09-13T18:36:58.994 INFO:teuthology.orchestra.run.smithi192.stderr:pauserd,pausewr is set 2024-09-13T18:36:58.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.993+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 msgr2=0x7f1f8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.993+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 0x7f1f8406d0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f1fa814d480 tx=0x7f1f90008040 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.993+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 msgr2=0x7f1fa81396f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.993+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1f9800c4d0 tx=0x7f1f9800c990 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 shutdown_connections 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f8406ac00 0x7f1f8406d0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fa815ad10 0x7f1fa814d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fa80b2590 0x7f1fa814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 --2- 172.21.15.192:0/3225502234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fa806b8d0 0x7f1fa81396f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 >> 172.21.15.192:0/3225502234 conn(0x7f1fa80b09f0 msgr2=0x7f1fa80b3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 shutdown_connections 2024-09-13T18:36:58.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:58.994+0000 7f1fa7e00640 1 -- 172.21.15.192:0/3225502234 wait complete. 2024-09-13T18:36:59.013 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-13T18:36:59.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.163+0000 7f9854000640 1 Processor -- start 2024-09-13T18:36:59.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.163+0000 7f9854000640 1 -- start start 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9854000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 0x7f984c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9854000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f984c0b0490 0x7f984c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9854000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c0b2f00 con 0x7f984c15dee0 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9854000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c15aec0 con 0x7f984c0b0490 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9854000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c0b3150 con 0x7f984c0b3f10 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9852000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f984c0b0490 0x7f984c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9851600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f984c15dee0 0x7f984c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53786/0 (socket says 172.21.15.192:53786) 2024-09-13T18:36:59.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.164+0000 7f9851600640 1 -- 172.21.15.192:0/1175540198 learned_addr learned my addr 172.21.15.192:0/1175540198 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:36:59.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9850c00640 1 --2- 172.21.15.192:0/1175540198 >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 0x7f984c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9852000640 1 -- 172.21.15.192:0/1175540198 >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 msgr2=0x7f984c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9852000640 1 --2- 172.21.15.192:0/1175540198 >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 0x7f984c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9852000640 1 -- 172.21.15.192:0/1175540198 >> v1:172.21.15.192:6789/0 conn(0x7f984c15dee0 legacy=0x7f984c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9852000640 1 -- 172.21.15.192:0/1175540198 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0b3430 con 0x7f984c0b0490 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f984be00640 1 -- 172.21.15.192:0/1175540198 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4265457658 0 0) 0x7f984c0b2f00 con 0x7f984c15dee0 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.165+0000 7f9850c00640 1 --2- 172.21.15.192:0/1175540198 >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 0x7f984c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.166+0000 7f9852000640 1 --2- 172.21.15.192:0/1175540198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c0b0490 0x7f984c15a980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f984c0b4700 tx=0x7f984402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e769b8fd7e3cf149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.166+0000 7f984be00640 1 -- 172.21.15.192:0/1175540198 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984402aea0 con 0x7f984c0b0490 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.166+0000 7f984be00640 1 -- 172.21.15.192:0/1175540198 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984402d050 con 0x7f984c0b0490 2024-09-13T18:36:59.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.166+0000 7f984be00640 1 -- 172.21.15.192:0/1175540198 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9844007960 con 0x7f984c0b0490 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 -- 172.21.15.192:0/1175540198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c0b0490 msgr2=0x7f984c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 --2- 172.21.15.192:0/1175540198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c0b0490 0x7f984c15a980 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f984c0b4700 tx=0x7f984402a680 comp rx=0 tx=0).stop 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 -- 172.21.15.192:0/1175540198 shutdown_connections 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 --2- 172.21.15.192:0/1175540198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c0b0490 0x7f984c15a980 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 --2- 172.21.15.192:0/1175540198 >> v2:172.21.15.194:3300/0 conn(0x7f984c0b3f10 0x7f984c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 -- 172.21.15.192:0/1175540198 >> 172.21.15.192:0/1175540198 conn(0x7f984c0ae960 msgr2=0x7f984c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:36:59.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 -- 172.21.15.192:0/1175540198 shutdown_connections 2024-09-13T18:36:59.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.167+0000 7f9854000640 1 -- 172.21.15.192:0/1175540198 wait complete. 2024-09-13T18:36:59.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.168+0000 7f9854000640 1 Processor -- start 2024-09-13T18:36:59.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 -- start start 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f984c0b0490 0x7f984c1552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c13a220 0x7f984c15b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c138f30 con 0x7f984c15dee0 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c154b20 con 0x7f984c13a220 2024-09-13T18:36:59.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.169+0000 7f9854000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c1431d0 con 0x7f984c0b0490 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58946/0 (socket says 172.21.15.192:58946) 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 -- 172.21.15.192:0/1088666705 learned_addr learned my addr 172.21.15.192:0/1088666705 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9852000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c13a220 0x7f984c15b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9851600640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f984c0b0490 0x7f984c1552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 -- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f984c0b0490 msgr2=0x7f984c1552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f984c0b0490 0x7f984c1552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 -- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c13a220 msgr2=0x7f984c15b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c13a220 0x7f984c15b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844009a70 con 0x7f984c15dee0 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9850c00640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f983800e730 tx=0x7f983800ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.170+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838004230 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.171+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9838004390 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.171+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c13c7e0 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.171+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983800c8f0 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.171+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c13cac0 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.172+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c0afd80 con 0x7f984c15dee0 2024-09-13T18:36:59.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.173+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f983800ca50 con 0x7f984c15dee0 2024-09-13T18:36:59.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.173+0000 7f9849600640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 0x7f982c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:36:59.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.174+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9838088f20 con 0x7f984c15dee0 2024-09-13T18:36:59.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.174+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=37+}) v3 -- 0x7f982c072730 con 0x7f984c15dee0 2024-09-13T18:36:59.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.174+0000 7f9851600640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 0x7f982c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:36:59.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.174+0000 7f9851600640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 0x7f982c06d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9840000f60 tx=0x7f9840007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:36:59.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.177+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9838054190 con 0x7f984c15dee0 2024-09-13T18:36:59.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.354+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f984c0ce510 con 0x7f984c15dee0 2024-09-13T18:36:59.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.990+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(37..37 src has 1..37) v4 ==== 288+0+0 (secure 0 0 0) 0x7f983800ee40 con 0x7f984c15dee0 2024-09-13T18:36:59.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.990+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=38}) v3 -- 0x7f982c072fe0 con 0x7f984c15dee0 2024-09-13T18:36:59.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.992+0000 7f9849600640 1 -- 172.21.15.192:0/1088666705 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9838020090 con 0x7f984c15dee0 2024-09-13T18:36:59.995 INFO:teuthology.orchestra.run.smithi192.stderr:pauserd,pausewr is unset 2024-09-13T18:37:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.995+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 msgr2=0x7f982c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 0x7f982c06d0c0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9840000f60 tx=0x7f9840007c00 comp rx=0 tx=0).stop 2024-09-13T18:37:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 msgr2=0x7f984c1389f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f983800e730 tx=0x7f983800ebf0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 shutdown_connections 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f982c06ac00 0x7f982c06d0c0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f984c13a220 0x7f984c15b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f984c15dee0 0x7f984c1389f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 --2- 172.21.15.192:0/1088666705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f984c0b0490 0x7f984c1552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 >> 172.21.15.192:0/1088666705 conn(0x7f984c0ae960 msgr2=0x7f984c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 shutdown_connections 2024-09-13T18:37:00.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:36:59.996+0000 7f9854000640 1 -- 172.21.15.192:0/1088666705 wait complete. 2024-09-13T18:37:00.017 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:00.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.166+0000 7f13b6e00640 1 Processor -- start 2024-09-13T18:37:00.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.166+0000 7f13b6e00640 1 -- start start 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.167+0000 7f13b6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13b00b0490 0x7f13b00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.167+0000 7f13b6e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b015ec00 con 0x7f13b00cacd0 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13b6e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b0140480 con 0x7f13b015e790 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13b6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b00cb5f0 con 0x7f13b00b0490 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13afe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f13b00cacd0 0x7f13b0140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53796/0 (socket says 172.21.15.192:53796) 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13afe00640 1 -- 172.21.15.192:0/482683816 learned_addr learned my addr 172.21.15.192:0/482683816 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13b4e00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13b00b0490 0x7f13b00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477030291 0 0) 0x7f13b015ec00 con 0x7f13b00cacd0 2024-09-13T18:37:00.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1394003520 con 0x7f13b00cacd0 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.168+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462068052 0 0) 0x7f13b0140480 con 0x7f13b015e790 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b015ec00 con 0x7f13b015e790 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159539849 0 0) 0x7f1394003520 con 0x7f13b00cacd0 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13b00b0490 msgr2=0x7f13b00cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13b00b0490 0x7f13b00cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 >> v1:172.21.15.194:6789/0 conn(0x7f13b015e790 legacy=0x7f13b00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b015ee90 con 0x7f13b00cacd0 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f13a0001690 con 0x7f13b00cacd0 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 >> v1:172.21.15.192:6789/0 conn(0x7f13b00cacd0 legacy=0x7f13b0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1394003b30 0x7f1394003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139400bf70 con 0x7f1394003b30 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f139400c0e0 con 0x7f13940047c0 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f139400c2a0 con 0x7f1394005180 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13b4e00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13b00b0490 0x7f13b00cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1394003b30 0x7f1394003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13a7400640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13b4e00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 -- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394005180 msgr2=0x7f139400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394005180 0x7f139400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 -- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13940047c0 msgr2=0x7f1394004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13940047c0 0x7f1394004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.169+0000 7f13afe00640 1 -- 172.21.15.192:0/482683816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394003520 con 0x7f1394003b30 2024-09-13T18:37:00.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.170+0000 7f13afe00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1394003b30 0x7f1394003f30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f13a0007f70 tx=0x7f13940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6095ccab130a55bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0005ad0 con 0x7f1394003b30 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a002d070 con 0x7f1394003b30 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13af400640 1 -- 172.21.15.192:0/482683816 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a0005e90 con 0x7f1394003b30 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 -- 172.21.15.192:0/482683816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1394003b30 msgr2=0x7f1394003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 --2- 172.21.15.192:0/482683816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1394003b30 0x7f1394003f30 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f13a0007f70 tx=0x7f13940057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b4e00640 1 -- 172.21.15.192:0/482683816 reap_dead start 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 -- 172.21.15.192:0/482683816 shutdown_connections 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 -- 172.21.15.192:0/482683816 >> 172.21.15.192:0/482683816 conn(0x7f13b00ae960 msgr2=0x7f13b006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 -- 172.21.15.192:0/482683816 shutdown_connections 2024-09-13T18:37:00.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.171+0000 7f13b6e00640 1 -- 172.21.15.192:0/482683816 wait complete. 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.173+0000 7f13b6e00640 1 Processor -- start 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.173+0000 7f13b6e00640 1 -- start start 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394003b30 0x7f13b015d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13b013ef10 0x7f13b012f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b013f3a0 con 0x7f13b006bba0 2024-09-13T18:37:00.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b0130c50 con 0x7f13b013ef10 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b015e030 con 0x7f1394003b30 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58960/0 (socket says 172.21.15.192:58960) 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13a7400640 1 -- 172.21.15.192:0/2233795685 learned_addr learned my addr 172.21.15.192:0/2233795685 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13b4e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13b013ef10 0x7f13b012f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.174+0000 7f13afe00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394003b30 0x7f13b015d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 -- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394003b30 msgr2=0x7f13b015d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394003b30 0x7f13b015d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 -- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13b013ef10 msgr2=0x7f13b012f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13b013ef10 0x7f13b012f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 -- 172.21.15.192:0/2233795685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b0130600 con 0x7f13b006bba0 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13a7400640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f139800f7a0 tx=0x7f139800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:00.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f139800fe50 con 0x7f13b006bba0 2024-09-13T18:37:00.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1398005320 con 0x7f13b006bba0 2024-09-13T18:37:00.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b01308e0 con 0x7f13b006bba0 2024-09-13T18:37:00.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398007290 con 0x7f13b006bba0 2024-09-13T18:37:00.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.175+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b01310e0 con 0x7f13b006bba0 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.176+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b00cb0b0 con 0x7f13b006bba0 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.177+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13980073f0 con 0x7f13b006bba0 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.178+0000 7f13acc00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 0x7f138c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.178+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1398088d80 con 0x7f13b006bba0 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.178+0000 7f13afe00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 0x7f138c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:00.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.179+0000 7f13afe00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 0x7f138c06d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13a0032000 tx=0x7f13a002d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:00.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.182+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1398053f50 con 0x7f13b006bba0 2024-09-13T18:37:00.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.350+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13b0130d90 con 0x7f13b006bba0 2024-09-13T18:37:00.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.351+0000 7f13acc00640 1 -- 172.21.15.192:0/2233795685 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f139801a090 con 0x7f13b006bba0 2024-09-13T18:37:00.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:00.354 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 msgr2=0x7f138c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 0x7f138c06d0f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f13a0032000 tx=0x7f13a002d000 comp rx=0 tx=0).stop 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 msgr2=0x7f13b013e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f139800f7a0 tx=0x7f139800fc60 comp rx=0 tx=0).stop 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 shutdown_connections 2024-09-13T18:37:00.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f138c06ac30 0x7f138c06d0f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13b013ef10 0x7f13b012f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13b006bba0 0x7f13b013e9d0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 --2- 172.21.15.192:0/2233795685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1394003b30 0x7f13b015d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 >> 172.21.15.192:0/2233795685 conn(0x7f13b00ae960 msgr2=0x7f13b00718e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 shutdown_connections 2024-09-13T18:37:00.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:00.353+0000 7f13b6e00640 1 -- 172.21.15.192:0/2233795685 wait complete. 2024-09-13T18:37:00.372 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:00.372 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:37:00.372 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:37:00.373 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:37:00.373 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:37:00.373 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:37:00.373 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:37:00.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:00.702 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:37:00.751 INFO:teuthology.orchestra.run.smithi192.stdout:client5215 2024-09-13T18:37:00.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:00.751 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client5215/osdmap') 2024-09-13T18:37:00.865 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 35 barrier 35 flags 0x588000 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:37:00.866 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:37:00.867 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:37:00.867 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:37:00.867 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:37:00.867 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:37:00.867 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:37:00.869 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:37:00.869 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:37:00.869 INFO:teuthology.orchestra.run.smithi192.stderr:799 bytes copied, 7.3875e-05 s, 10.8 MB/s 2024-09-13T18:37:00.870 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:01.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.032+0000 7f4cdf000640 1 Processor -- start 2024-09-13T18:37:01.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.032+0000 7f4cdf000640 1 -- start start 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cdf000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4cd80cacd0 0x7f4cd815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cdf000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cd80cb0b0 0x7f4cd815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cdf000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cd8140480 con 0x7f4cd8140980 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cdf000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd815c160 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cdf000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cd80cb520 con 0x7f4cd80cacd0 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cd7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cd80cb0b0 0x7f4cd815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cd7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cd80cb0b0 0x7f4cd815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40314/0 (socket says 172.21.15.192:40314) 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.033+0000 7f4cd7400640 1 -- 172.21.15.192:0/3199939543 learned_addr learned my addr 172.21.15.192:0/3199939543 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.034+0000 7f4cd7e00640 1 --2- 172.21.15.192:0/3199939543 >> v2:172.21.15.194:3300/0 conn(0x7f4cd80cacd0 0x7f4cd815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.034+0000 7f4cd7400640 1 -- 172.21.15.192:0/3199939543 >> v2:172.21.15.194:3300/0 conn(0x7f4cd80cacd0 msgr2=0x7f4cd815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.034+0000 7f4cd7400640 1 --2- 172.21.15.192:0/3199939543 >> v2:172.21.15.194:3300/0 conn(0x7f4cd80cacd0 0x7f4cd815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.034+0000 7f4cd7400640 1 -- 172.21.15.192:0/3199939543 >> v1:172.21.15.194:6789/0 conn(0x7f4cd8140980 legacy=0x7f4cd80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:01.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.034+0000 7f4cd7400640 1 -- 172.21.15.192:0/3199939543 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd815ee90 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cd7400640 1 --2- 172.21.15.192:0/3199939543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd815bc20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80b2350 tx=0x7f4cc402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf85bf054d6bd9bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:01.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cd6a00640 1 -- 172.21.15.192:0/3199939543 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4032440 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cd6a00640 1 -- 172.21.15.192:0/3199939543 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc40325a0 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cd6a00640 1 -- 172.21.15.192:0/3199939543 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4032930 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cdf000640 1 -- 172.21.15.192:0/3199939543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cb0b0 msgr2=0x7f4cd815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.035+0000 7f4cdf000640 1 --2- 172.21.15.192:0/3199939543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd815bc20 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4cd80b2350 tx=0x7f4cc402a230 comp rx=0 tx=0).stop 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 -- 172.21.15.192:0/3199939543 shutdown_connections 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 --2- 172.21.15.192:0/3199939543 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd815bc20 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 --2- 172.21.15.192:0/3199939543 >> v2:172.21.15.194:3300/0 conn(0x7f4cd80cacd0 0x7f4cd815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 -- 172.21.15.192:0/3199939543 >> 172.21.15.192:0/3199939543 conn(0x7f4cd80ae960 msgr2=0x7f4cd806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:01.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 -- 172.21.15.192:0/3199939543 shutdown_connections 2024-09-13T18:37:01.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.036+0000 7f4cdf000640 1 -- 172.21.15.192:0/3199939543 wait complete. 2024-09-13T18:37:01.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.037+0000 7f4cdf000640 1 Processor -- start 2024-09-13T18:37:01.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.037+0000 7f4cdf000640 1 -- start start 2024-09-13T18:37:01.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd8156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 0x7f4cd8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80cc060 con 0x7f4cd80cacd0 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd80cc900 con 0x7f4cd80cb0b0 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cdf000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cd806ab60 con 0x7f4cd8140980 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cd7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cd7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40316/0 (socket says 172.21.15.192:40316) 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.038+0000 7f4cd7e00640 1 -- 172.21.15.192:0/2274319507 learned_addr learned my addr 172.21.15.192:0/2274319507 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7400640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd8156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cdd000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 0x7f4cd8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 -- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 msgr2=0x7f4cd8157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 0x7f4cd8157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 -- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cd80cb0b0 msgr2=0x7f4cd8156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd8156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 -- 172.21.15.192:0/2274319507 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc40094d0 con 0x7f4cd80cacd0 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cdd000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 0x7f4cd8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cd7e00640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800d5f0 tx=0x7f4cc800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc80125f0 con 0x7f4cd80cacd0 2024-09-13T18:37:01.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cc8012750 con 0x7f4cd80cacd0 2024-09-13T18:37:01.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.039+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cd80cc2b0 con 0x7f4cd80cacd0 2024-09-13T18:37:01.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.040+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cc8012b00 con 0x7f4cd80cacd0 2024-09-13T18:37:01.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.040+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cd80710c0 con 0x7f4cd80cacd0 2024-09-13T18:37:01.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.041+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cd8071250 con 0x7f4cd80cacd0 2024-09-13T18:37:01.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.041+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4cc8012c60 con 0x7f4cd80cacd0 2024-09-13T18:37:01.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.043+0000 7f4ccfe00640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 0x7f4cb806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:01.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.043+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cc8089740 con 0x7f4cd80cacd0 2024-09-13T18:37:01.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.043+0000 7f4cd7400640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 0x7f4cb806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:01.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.044+0000 7f4cd7400640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 0x7f4cb806d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:01.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.047+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4cc8054910 con 0x7f4cd80cacd0 2024-09-13T18:37:01.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.248+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cd815bc20 con 0x7f4cd80cacd0 2024-09-13T18:37:01.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.249+0000 7f4ccfe00640 1 -- 172.21.15.192:0/2274319507 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f4cc8057f30 con 0x7f4cd80cacd0 2024-09-13T18:37:01.252 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:01.253 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:37:01.253 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:37:01.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 msgr2=0x7f4cb806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:01.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 0x7f4cb806d0f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4034000 tx=0x7f4cc402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:01.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 msgr2=0x7f4cd8070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:01.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4cc800d5f0 tx=0x7f4cc800dab0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 shutdown_connections 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4cb806ac30 0x7f4cb806d0f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cd8140980 0x7f4cd8157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cd80cb0b0 0x7f4cd8156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 --2- 172.21.15.192:0/2274319507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cd80cacd0 0x7f4cd8070b80 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 >> 172.21.15.192:0/2274319507 conn(0x7f4cd80ae960 msgr2=0x7f4cd815b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 shutdown_connections 2024-09-13T18:37:01.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:01.251+0000 7f4cdf000640 1 -- 172.21.15.192:0/2274319507 wait complete. 2024-09-13T18:37:01.270 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 37 2024-09-13T18:37:01.437 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:37:01.438 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:37:01.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:01.723 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:37:01.801 INFO:teuthology.orchestra.run.smithi192.stdout:client5215 2024-09-13T18:37:01.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:01.802 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client5215/osdmap') 2024-09-13T18:37:01.898 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 37 barrier 37 flags 0x588000 2024-09-13T18:37:01.898 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:37:01.899 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:37:01.900 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:37:01.900 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:37:01.900 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:37:01.900 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:37:01.900 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:37:01.901 INFO:teuthology.orchestra.run.smithi192.stderr:799 bytes copied, 6.5977e-05 s, 12.1 MB/s 2024-09-13T18:37:01.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:01.902 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:37:01.940 INFO:teuthology.orchestra.run.smithi192.stdout:client5215 2024-09-13T18:37:01.940 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:01.940 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client5215/osdmap') 2024-09-13T18:37:02.036 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 37 barrier 37 flags 0x588000 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:pool 4 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:pool 5 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:37:02.037 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:37:02.038 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:37:02.038 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:37:02.038 INFO:teuthology.orchestra.run.smithi192.stderr:799 bytes copied, 6.6711e-05 s, 12.0 MB/s 2024-09-13T18:37:02.039 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:37:02.039 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:37:02.039 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:02.131 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:02.217 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:37:02.217 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:02.217 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:02.252 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:02.252 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:02.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:02.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.516+0000 7fe9f7200640 1 Processor -- start 2024-09-13T18:37:02.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.517+0000 7fe9f7200640 1 -- start start 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9f80b3480 0x7fe9f8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9f815a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f7200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9f815af60 con 0x7fe9f8159b00 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9f806b7a0 con 0x7fe9f80b3480 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815ac80 con 0x7fe9f806bc30 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f5e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe9f8159b00 0x7fe9f80b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48786/0 (socket says 172.21.15.192:48786) 2024-09-13T18:37:02.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.518+0000 7fe9f5e00640 1 -- 172.21.15.192:0/454445317 learned_addr learned my addr 172.21.15.192:0/454445317 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:02.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f6800640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9f815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936255473 0 0) 0x7fe9f815af60 con 0x7fe9f8159b00 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9ed400640 1 --2- 172.21.15.192:0/454445317 >> v2:172.21.15.194:3300/0 conn(0x7fe9f80b3480 0x7fe9f8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9dc003520 con 0x7fe9f8159b00 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269851023 0 0) 0x7fe9dc003520 con 0x7fe9f8159b00 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 msgr2=0x7fe9f815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9f815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 >> v2:172.21.15.194:3300/0 conn(0x7fe9f80b3480 msgr2=0x7fe9f8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 --2- 172.21.15.192:0/454445317 >> v2:172.21.15.194:3300/0 conn(0x7fe9f80b3480 0x7fe9f8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f806b150 con 0x7fe9f8159b00 2024-09-13T18:37:02.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe9e8001670 con 0x7fe9f8159b00 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 >> v1:172.21.15.192:6789/0 conn(0x7fe9f8159b00 legacy=0x7fe9f80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9dc003970 0x7fe9dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9dc004d00 0x7fe9dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f806b7a0 con 0x7fe9dc004d00 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f815ac80 con 0x7fe9dc003970 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc00b980 con 0x7fe9f806bc30 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.519+0000 7fe9f6800640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9dc004d00 0x7fe9dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f5e00640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9dc003970 0x7fe9dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9ed400640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f6800640 1 -- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 msgr2=0x7fe9dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f6800640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9f806bc30 0x7fe9dc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f6800640 1 -- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9dc003970 msgr2=0x7fe9dc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f6800640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9dc003970 0x7fe9dc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.520+0000 7fe9f6800640 1 -- 172.21.15.192:0/454445317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc003520 con 0x7fe9dc004d00 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f6800640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9dc004d00 0x7fe9dc005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009fc0 tx=0x7fe9dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df45acef31aefaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0031640 con 0x7fe9dc004d00 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f002d070 con 0x7fe9dc004d00 2024-09-13T18:37:02.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f5400640 1 -- 172.21.15.192:0/454445317 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f00319e0 con 0x7fe9dc004d00 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f7200640 1 -- 172.21.15.192:0/454445317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9dc004d00 msgr2=0x7fe9dc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f7200640 1 --2- 172.21.15.192:0/454445317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9dc004d00 0x7fe9dc005180 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0009fc0 tx=0x7fe9dc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.521+0000 7fe9f6800640 1 -- 172.21.15.192:0/454445317 reap_dead start 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.522+0000 7fe9f7200640 1 -- 172.21.15.192:0/454445317 shutdown_connections 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.522+0000 7fe9f7200640 1 -- 172.21.15.192:0/454445317 >> 172.21.15.192:0/454445317 conn(0x7fe9f80736d0 msgr2=0x7fe9f80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:02.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.522+0000 7fe9f7200640 1 -- 172.21.15.192:0/454445317 shutdown_connections 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.522+0000 7fe9f7200640 1 -- 172.21.15.192:0/454445317 wait complete. 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.523+0000 7fe9f7200640 1 Processor -- start 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.523+0000 7fe9f7200640 1 -- start start 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9dc004d00 0x7fe9f8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f815c180 0x7fe9f8153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8151fb0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f8152ae0 con 0x7fe9f815c180 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.524+0000 7fe9f7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f81546d0 con 0x7fe9dc004d00 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40346/0 (socket says 172.21.15.192:40346) 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 -- 172.21.15.192:0/640127012 learned_addr learned my addr 172.21.15.192:0/640127012 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:02.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9ed400640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f815c180 0x7fe9f8153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f5e00640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9dc004d00 0x7fe9f8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 -- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9dc004d00 msgr2=0x7fe9f8152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9dc004d00 0x7fe9f8152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 -- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f815c180 msgr2=0x7fe9f8153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f815c180 0x7fe9f8153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 -- 172.21.15.192:0/640127012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f81521b0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9f6800640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0033040 tx=0x7fe9f0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.525+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0031d30 con 0x7fe9f815c5e0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.526+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f0040070 con 0x7fe9f815c5e0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.526+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f0003bd0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.526+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9f8152490 con 0x7fe9f815c5e0 2024-09-13T18:37:02.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.526+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9f8145fe0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.527+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9f8152c90 con 0x7fe9f815c5e0 2024-09-13T18:37:02.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.528+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe9f0042030 con 0x7fe9f815c5e0 2024-09-13T18:37:02.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.528+0000 7fe9eea00640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 0x7fe9d4071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.529+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f00a9fe0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.529+0000 7fe9f5e00640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 0x7fe9d4071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.529+0000 7fe9f5e00640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 0x7fe9d4071490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8001dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.533+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe9f8152c90 con 0x7fe9f815c5e0 2024-09-13T18:37:02.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.700+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9f8152c50 con 0x7fe9f815c5e0 2024-09-13T18:37:02.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.701+0000 7fe9eea00640 1 -- 172.21.15.192:0/640127012 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fe9f00751d0 con 0x7fe9f815c5e0 2024-09-13T18:37:02.704 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:02.704 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 msgr2=0x7fe9d4071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 0x7fe9d4071490 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe9e8000c00 tx=0x7fe9e8001dc0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 msgr2=0x7fe9f8154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fe9f0033040 tx=0x7fe9f0009750 comp rx=0 tx=0).stop 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 shutdown_connections 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9d406efd0 0x7fe9d4071490 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9f815c5e0 0x7fe9f8154000 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9f815c180 0x7fe9f8153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 --2- 172.21.15.192:0/640127012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9dc004d00 0x7fe9f8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 >> 172.21.15.192:0/640127012 conn(0x7fe9f80736d0 msgr2=0x7fe9f80cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:02.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 shutdown_connections 2024-09-13T18:37:02.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.703+0000 7fe9f7200640 1 -- 172.21.15.192:0/640127012 wait complete. 2024-09-13T18:37:02.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:36:41.985306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:36:42.928618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:02.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:02.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.875+0000 7f881dc00640 1 Processor -- start 2024-09-13T18:37:02.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.875+0000 7f881dc00640 1 -- start start 2024-09-13T18:37:02.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f88181589f0 0x7f88180b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88180b3af0 0x7f881815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 0x7f881806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f881806ca80 con 0x7f88180b3af0 2024-09-13T18:37:02.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88180b2000 con 0x7f88181589f0 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f881dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881815bbd0 con 0x7f881806c0b0 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f880fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88180b3af0 0x7f881815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f880fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88180b3af0 0x7f881815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40350/0 (socket says 172.21.15.192:40350) 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.876+0000 7f880fe00640 1 -- 172.21.15.192:0/628396900 learned_addr learned my addr 172.21.15.192:0/628396900 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f8816a00640 1 --2- 172.21.15.192:0/628396900 >> v2:172.21.15.194:3300/0 conn(0x7f88181589f0 0x7f88180b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f8817400640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 0x7f881806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f880fe00640 1 -- 172.21.15.192:0/628396900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 msgr2=0x7f881806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f880fe00640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 0x7f881806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f880fe00640 1 -- 172.21.15.192:0/628396900 >> v2:172.21.15.194:3300/0 conn(0x7f88181589f0 msgr2=0x7f88180b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f880fe00640 1 --2- 172.21.15.192:0/628396900 >> v2:172.21.15.194:3300/0 conn(0x7f88181589f0 0x7f88180b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f880fe00640 1 -- 172.21.15.192:0/628396900 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881815beb0 con 0x7f88180b3af0 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.877+0000 7f8817400640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 0x7f881806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.878+0000 7f880fe00640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88180b3af0 0x7f881815b260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f881806e230 tx=0x7f880002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=236667fda2d16f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.878+0000 7f8816000640 1 -- 172.21.15.192:0/628396900 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800032440 con 0x7f88180b3af0 2024-09-13T18:37:02.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.878+0000 7f8816000640 1 -- 172.21.15.192:0/628396900 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88000325a0 con 0x7f88180b3af0 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.878+0000 7f8816000640 1 -- 172.21.15.192:0/628396900 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800032930 con 0x7f88180b3af0 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 -- 172.21.15.192:0/628396900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88180b3af0 msgr2=0x7f881815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88180b3af0 0x7f881815b260 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f881806e230 tx=0x7f880002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 -- 172.21.15.192:0/628396900 shutdown_connections 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f881806c0b0 0x7f881806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 --2- 172.21.15.192:0/628396900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88180b3af0 0x7f881815b260 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 --2- 172.21.15.192:0/628396900 >> v2:172.21.15.194:3300/0 conn(0x7f88181589f0 0x7f88180b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 -- 172.21.15.192:0/628396900 >> 172.21.15.192:0/628396900 conn(0x7f88180b08f0 msgr2=0x7f88180b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:02.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 -- 172.21.15.192:0/628396900 shutdown_connections 2024-09-13T18:37:02.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.879+0000 7f881dc00640 1 -- 172.21.15.192:0/628396900 wait complete. 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.880+0000 7f881dc00640 1 Processor -- start 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.881+0000 7f881dc00640 1 -- start start 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.881+0000 7f881dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f881dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88180b3af0 0x7f881806a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f881dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88181589f0 0x7f88180adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f881dc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881806a6d0 con 0x7f881806c0b0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f881dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881806a930 con 0x7f88180b3af0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f881dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881806ac10 con 0x7f88181589f0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40366/0 (socket says 172.21.15.192:40366) 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 -- 172.21.15.192:0/4034271208 learned_addr learned my addr 172.21.15.192:0/4034271208 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f880fe00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88180b3af0 0x7f881806a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8817400640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88181589f0 0x7f88180adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 -- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88181589f0 msgr2=0x7f88180adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88181589f0 0x7f88180adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 -- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88180b3af0 msgr2=0x7f881806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:02.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88180b3af0 0x7f881806a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.882+0000 7f8816a00640 1 -- 172.21.15.192:0/4034271208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88000094d0 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f8816a00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f880800e9b0 tx=0x7f880800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8808009670 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880800c9a0 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f881806aef0 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880800cd50 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.883+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881806b4b0 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.884+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f881806c540 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.885+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8808013470 con 0x7f881806c0b0 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.886+0000 7f880ea00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 0x7f87f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:02.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.886+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8808089680 con 0x7f881806c0b0 2024-09-13T18:37:02.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.886+0000 7f880fe00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 0x7f87f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:02.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.887+0000 7f880fe00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 0x7f87f406d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8800034000 tx=0x7f880002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:02.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:02.890+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f88080547c0 con 0x7f881806c0b0 2024-09-13T18:37:03.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.059+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88180cb8f0 con 0x7f881806c0b0 2024-09-13T18:37:03.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.059+0000 7f880ea00640 1 -- 172.21.15.192:0/4034271208 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8808057de0 con 0x7f881806c0b0 2024-09-13T18:37:03.062 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 msgr2=0x7f87f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 0x7f87f406d0c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8800034000 tx=0x7f880002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 msgr2=0x7f88181e4620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f880800e9b0 tx=0x7f880800ee70 comp rx=0 tx=0).stop 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 shutdown_connections 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87f406ac00 0x7f87f406d0c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88181589f0 0x7f88180adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88180b3af0 0x7f881806a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 --2- 172.21.15.192:0/4034271208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f881806c0b0 0x7f88181e4620 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 >> 172.21.15.192:0/4034271208 conn(0x7f88180b08f0 msgr2=0x7f88180b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 shutdown_connections 2024-09-13T18:37:03.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.062+0000 7f881dc00640 1 -- 172.21.15.192:0/4034271208 wait complete. 2024-09-13T18:37:03.082 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:03.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.234+0000 7f6bc6800640 1 Processor -- start 2024-09-13T18:37:03.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.234+0000 7f6bc6800640 1 -- start start 2024-09-13T18:37:03.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.235+0000 7f6bc6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6bc006c800 0x7f6bc00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.235+0000 7f6bc6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc006cc70 con 0x7f6bc00b3bd0 2024-09-13T18:37:03.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.235+0000 7f6bc6800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc006b480 con 0x7f6bc01434c0 2024-09-13T18:37:03.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.235+0000 7f6bc6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc00ce770 con 0x7f6bc006c800 2024-09-13T18:37:03.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbfe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6bc00b3bd0 0x7f6bc006e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48790/0 (socket says 172.21.15.192:48790) 2024-09-13T18:37:03.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbfe00640 1 -- 172.21.15.192:0/1801755531 learned_addr learned my addr 172.21.15.192:0/1801755531 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:03.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbea00640 1 --2- 172.21.15.192:0/1801755531 >> v2:172.21.15.194:3300/0 conn(0x7f6bc006c800 0x7f6bc00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1716972860 0 0) 0x7f6bc006cc70 con 0x7f6bc00b3bd0 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ba4003520 con 0x7f6bc00b3bd0 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333734504 0 0) 0x7f6bc006b480 con 0x7f6bc01434c0 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bc006cc70 con 0x7f6bc01434c0 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbea00640 1 -- 172.21.15.192:0/1801755531 >> v1:172.21.15.194:6789/0 conn(0x7f6bc01434c0 legacy=0x7f6bc006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbea00640 1 -- 172.21.15.192:0/1801755531 >> v1:172.21.15.192:6789/0 conn(0x7f6bc00b3bd0 legacy=0x7f6bc006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.236+0000 7f6bbea00640 1 -- 172.21.15.192:0/1801755531 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc006b760 con 0x7f6bc006c800 2024-09-13T18:37:03.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.237+0000 7f6bbea00640 1 --2- 172.21.15.192:0/1801755531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc00b3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097d0 tx=0x7f6bac02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7531cb065d5149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac032440 con 0x7f6bc006c800 2024-09-13T18:37:03.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0325a0 con 0x7f6bc006c800 2024-09-13T18:37:03.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bbe000640 1 -- 172.21.15.192:0/1801755531 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac032930 con 0x7f6bc006c800 2024-09-13T18:37:03.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 -- 172.21.15.192:0/1801755531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 msgr2=0x7f6bc00b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 --2- 172.21.15.192:0/1801755531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc00b3690 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0097d0 tx=0x7f6bac02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 -- 172.21.15.192:0/1801755531 shutdown_connections 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 --2- 172.21.15.192:0/1801755531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc00b3690 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 -- 172.21.15.192:0/1801755531 >> 172.21.15.192:0/1801755531 conn(0x7f6bc00b08f0 msgr2=0x7f6bc00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 -- 172.21.15.192:0/1801755531 shutdown_connections 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.238+0000 7f6bc6800640 1 -- 172.21.15.192:0/1801755531 wait complete. 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.240+0000 7f6bc6800640 1 Processor -- start 2024-09-13T18:37:03.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.240+0000 7f6bc6800640 1 -- start start 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc0139220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6bc00b3bd0 0x7f6bc0154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc013df70 con 0x7f6bc01434c0 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc0139760 con 0x7f6bc006c800 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bc6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc013d5d0 con 0x7f6bc00b3bd0 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bbfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bbfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40380/0 (socket says 172.21.15.192:40380) 2024-09-13T18:37:03.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.241+0000 7f6bbfe00640 1 -- 172.21.15.192:0/14447277 learned_addr learned my addr 172.21.15.192:0/14447277 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbea00640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6bc00b3bd0 0x7f6bc0154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbf400640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc0139220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 -- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6bc00b3bd0 msgr2=0x7f6bc0154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6bc00b3bd0 0x7f6bc0154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 -- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 msgr2=0x7f6bc0139220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc0139220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 -- 172.21.15.192:0/14447277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac009400 con 0x7f6bc01434c0 2024-09-13T18:37:03.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbf400640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc0139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bbfe00640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800cbc0 tx=0x7f6bb800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800ace0 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800ae40 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8012600 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc013d8b0 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.242+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc01553b0 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.243+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc00cc7d0 con 0x7f6bc01434c0 2024-09-13T18:37:03.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.244+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6bb8012820 con 0x7f6bc01434c0 2024-09-13T18:37:03.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.245+0000 7f6bb7400640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 0x7f6ba006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.246+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6bb80892c0 con 0x7f6bc01434c0 2024-09-13T18:37:03.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.246+0000 7f6bbf400640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 0x7f6ba006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.246+0000 7f6bbf400640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 0x7f6ba006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00011e0 tx=0x7f6bb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.250+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6bb8054540 con 0x7f6bc01434c0 2024-09-13T18:37:03.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.416+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6bc015c5d0 con 0x7f6bc01434c0 2024-09-13T18:37:03.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.417+0000 7f6bb7400640 1 -- 172.21.15.192:0/14447277 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6bb8057b60 con 0x7f6bc01434c0 2024-09-13T18:37:03.420 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 msgr2=0x7f6ba006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 0x7f6ba006d0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6bb00011e0 tx=0x7f6bb0009040 comp rx=0 tx=0).stop 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 msgr2=0x7f6bc006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800cbc0 tx=0x7f6bb800a430 comp rx=0 tx=0).stop 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 shutdown_connections 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ba006ac00 0x7f6ba006d0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc01434c0 0x7f6bc006e920 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6bc00b3bd0 0x7f6bc0154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 --2- 172.21.15.192:0/14447277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6bc006c800 0x7f6bc0139220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 >> 172.21.15.192:0/14447277 conn(0x7f6bc00b08f0 msgr2=0x7f6bc00afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 shutdown_connections 2024-09-13T18:37:03.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.419+0000 7f6bc6800640 1 -- 172.21.15.192:0/14447277 wait complete. 2024-09-13T18:37:03.439 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:03.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.594+0000 7f2f0b200640 1 Processor -- start 2024-09-13T18:37:03.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.595+0000 7f2f0b200640 1 -- start start 2024-09-13T18:37:03.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0c15b070 con 0x7f2f0c1402c0 2024-09-13T18:37:03.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0c0b05b0 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c15ee20 con 0x7f2f0c15b810 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f01400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f01400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:46844/0 (socket says 172.21.15.192:46844) 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f01400640 1 -- 172.21.15.192:0/847533373 learned_addr learned my addr 172.21.15.192:0/847533373 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.596+0000 7f2f0a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:42160/0 (socket says 172.21.15.192:42160) 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.597+0000 7f2f01400640 1 -- 172.21.15.192:0/847533373 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 msgr2=0x7f2f0c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.597+0000 7f2f01400640 1 --2- 172.21.15.192:0/847533373 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.597+0000 7f2f01400640 1 -- 172.21.15.192:0/847533373 >> v1:172.21.15.194:6789/0 conn(0x7f2f0c1402c0 legacy=0x7f2f0c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.597+0000 7f2f01400640 1 -- 172.21.15.192:0/847533373 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0c15f100 con 0x7f2f0c15b810 2024-09-13T18:37:03.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.597+0000 7f2f0a800640 1 --2- 172.21.15.192:0/847533373 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:03.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.598+0000 7f2f01400640 1 --2- 172.21.15.192:0/847533373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9211aa18432815f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.598+0000 7f2f09400640 1 -- 172.21.15.192:0/847533373 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4032440 con 0x7f2f0c15b810 2024-09-13T18:37:03.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f09400640 1 -- 172.21.15.192:0/847533373 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef40325a0 con 0x7f2f0c15b810 2024-09-13T18:37:03.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f09400640 1 -- 172.21.15.192:0/847533373 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4032930 con 0x7f2f0c15b810 2024-09-13T18:37:03.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 -- 172.21.15.192:0/847533373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 msgr2=0x7f2f0c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 --2- 172.21.15.192:0/847533373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef402a250 comp rx=0 tx=0).stop 2024-09-13T18:37:03.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 -- 172.21.15.192:0/847533373 shutdown_connections 2024-09-13T18:37:03.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 --2- 172.21.15.192:0/847533373 >> v2:172.21.15.194:3300/0 conn(0x7f2f0c0afbe0 0x7f2f0c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 --2- 172.21.15.192:0/847533373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c15bc50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 -- 172.21.15.192:0/847533373 >> 172.21.15.192:0/847533373 conn(0x7f2f0c0ae7f0 msgr2=0x7f2f0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 -- 172.21.15.192:0/847533373 shutdown_connections 2024-09-13T18:37:03.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.599+0000 7f2f0b200640 1 -- 172.21.15.192:0/847533373 wait complete. 2024-09-13T18:37:03.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.601+0000 7f2f0b200640 1 Processor -- start 2024-09-13T18:37:03.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.601+0000 7f2f0b200640 1 -- start start 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c1402c0 0x7f2f0c0713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c13cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c153d10 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c153ff0 con 0x7f2f0c1402c0 2024-09-13T18:37:03.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f0b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0c1542d0 con 0x7f2f0c15b810 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f09e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f09e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40388/0 (socket says 172.21.15.192:40388) 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f09e00640 1 -- 172.21.15.192:0/3957976320 learned_addr learned my addr 172.21.15.192:0/3957976320 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.602+0000 7f2f01400640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c1402c0 0x7f2f0c0713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f0a800640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c13cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 -- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 msgr2=0x7f2f0c13cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c13cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 -- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c1402c0 msgr2=0x7f2f0c0713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c1402c0 0x7f2f0c0713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 -- 172.21.15.192:0/3957976320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f04009a70 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f09e00640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c450 tx=0x7f2efc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0052d0 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc005430 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef40094d0 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.603+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc003830 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.604+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0c154890 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.605+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0c0b0070 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.606+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2efc003990 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.606+0000 7f2f02a00640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.607+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2efc088850 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.607+0000 7f2f01400640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.607+0000 7f2f01400640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4034000 tx=0x7f2ef402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.610+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2efc053ae0 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.777+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f0c13e4e0 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.777+0000 7f2f02a00640 1 -- 172.21.15.192:0/3957976320 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2efc017020 con 0x7f2f0c0afbe0 2024-09-13T18:37:03.780 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 msgr2=0x7f2ee806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4034000 tx=0x7f2ef402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 msgr2=0x7f2f0c070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2efc00c450 tx=0x7f2efc00c850 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 shutdown_connections 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f0c15b810 0x7f2f0c13cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0c1402c0 0x7f2f0c0713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 --2- 172.21.15.192:0/3957976320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0c0afbe0 0x7f2f0c070e60 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 >> 172.21.15.192:0/3957976320 conn(0x7f2f0c0ae7f0 msgr2=0x7f2f0c15d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 shutdown_connections 2024-09-13T18:37:03.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.780+0000 7f2f0b200640 1 -- 172.21.15.192:0/3957976320 wait complete. 2024-09-13T18:37:03.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:03.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.948+0000 7f9043e00640 1 Processor -- start 2024-09-13T18:37:03.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.949+0000 7f9043e00640 1 -- start start 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90440b2d70 0x7f90440b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 0x7f90440ce4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90440cea10 con 0x7f904413fbf0 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440b3d80 con 0x7f90440b2d70 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90440b37c0 con 0x7f90440ce040 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90440b2d70 0x7f90440b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f90440b2d70 0x7f90440b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40402/0 (socket says 172.21.15.192:40402) 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 -- 172.21.15.192:0/745601769 learned_addr learned my addr 172.21.15.192:0/745601769 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:03.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f9043400640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 0x7f90440ce4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 -- 172.21.15.192:0/745601769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 msgr2=0x7f90440ce4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 0x7f90440ce4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.950+0000 7f903a000640 1 -- 172.21.15.192:0/745601769 >> v1:172.21.15.194:6789/0 conn(0x7f904413fbf0 legacy=0x7f9044140410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.951+0000 7f903a000640 1 -- 172.21.15.192:0/745601769 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440b3aa0 con 0x7f90440b2d70 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.951+0000 7f9043400640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 0x7f90440ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:03.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.951+0000 7f903a000640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b2d70 0x7f90440b31e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f902c009870 tx=0x7f902c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3529ce14c28b0ae7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9042000640 1 -- 172.21.15.192:0/745601769 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c032440 con 0x7f90440b2d70 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9042000640 1 -- 172.21.15.192:0/745601769 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c0325a0 con 0x7f90440b2d70 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9042000640 1 -- 172.21.15.192:0/745601769 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c032930 con 0x7f90440b2d70 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 -- 172.21.15.192:0/745601769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b2d70 msgr2=0x7f90440b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b2d70 0x7f90440b31e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f902c009870 tx=0x7f902c02a270 comp rx=0 tx=0).stop 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 -- 172.21.15.192:0/745601769 shutdown_connections 2024-09-13T18:37:03.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440ce040 0x7f90440ce4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 --2- 172.21.15.192:0/745601769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440b2d70 0x7f90440b31e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.952+0000 7f9043e00640 1 -- 172.21.15.192:0/745601769 >> 172.21.15.192:0/745601769 conn(0x7f90440736d0 msgr2=0x7f90440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:03.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.953+0000 7f9043e00640 1 -- 172.21.15.192:0/745601769 shutdown_connections 2024-09-13T18:37:03.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.953+0000 7f9043e00640 1 -- 172.21.15.192:0/745601769 wait complete. 2024-09-13T18:37:03.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.954+0000 7f9043e00640 1 Processor -- start 2024-09-13T18:37:03.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.954+0000 7f9043e00640 1 -- start start 2024-09-13T18:37:03.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 0x7f904415fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 0x7f90441417e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904415c390 con 0x7f90440ce040 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904406ed10 con 0x7f904413fbf0 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f9043e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904406eff0 con 0x7f90440b2d70 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f903a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f903a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40412/0 (socket says 172.21.15.192:40412) 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.955+0000 7f903a000640 1 -- 172.21.15.192:0/3447128914 learned_addr learned my addr 172.21.15.192:0/3447128914 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f9043400640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 0x7f90441417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f9042a00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 0x7f904415fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 -- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 msgr2=0x7f904415fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 0x7f904415fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 -- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 msgr2=0x7f90441417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:03.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 0x7f90441417e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 -- 172.21.15.192:0/3447128914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c0094d0 con 0x7f90440ce040 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f9042a00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 0x7f904415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f9043400640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 0x7f90441417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903a000640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f902c000c00 tx=0x7f902c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.956+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c032440 con 0x7f90440ce040 2024-09-13T18:37:03.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.957+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902c030b80 con 0x7f90440ce040 2024-09-13T18:37:03.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.957+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902c03d440 con 0x7f90440ce040 2024-09-13T18:37:03.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.957+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904406f2d0 con 0x7f90440ce040 2024-09-13T18:37:03.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.957+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90440aeb20 con 0x7f90440ce040 2024-09-13T18:37:03.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.958+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90440ae980 con 0x7f90440ce040 2024-09-13T18:37:03.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.958+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f902c039040 con 0x7f90440ce040 2024-09-13T18:37:03.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.959+0000 7f903b400640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 0x7f902006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:03.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.959+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f902c0a9ed0 con 0x7f90440ce040 2024-09-13T18:37:03.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.960+0000 7f9042a00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 0x7f902006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:03.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.960+0000 7f9042a00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 0x7f902006d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:03.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:03.963+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90440ae980 con 0x7f90440ce040 2024-09-13T18:37:04.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.146+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f90440ae980 con 0x7f90440ce040 2024-09-13T18:37:04.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.146+0000 7f903b400640 1 -- 172.21.15.192:0/3447128914 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f90440ae980 con 0x7f90440ce040 2024-09-13T18:37:04.149 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:37:04.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.148+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 msgr2=0x7f902006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.148+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 0x7f902006d0c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034009040 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.148+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 msgr2=0x7f904415be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.148+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f902c000c00 tx=0x7f902c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 shutdown_connections 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f902006ac00 0x7f902006d0c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f904413fbf0 0x7f90441417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90440ce040 0x7f904415be50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 --2- 172.21.15.192:0/3447128914 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f90440b2d70 0x7f904415fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 >> 172.21.15.192:0/3447128914 conn(0x7f90440736d0 msgr2=0x7f904413d2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 shutdown_connections 2024-09-13T18:37:04.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.149+0000 7f9043e00640 1 -- 172.21.15.192:0/3447128914 wait complete. 2024-09-13T18:37:04.167 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:37:04.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:04.168 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:04.256 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:37:04.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:04.256 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:37:04.295 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:04.295 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:04.334 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:04.335 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:04.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:04.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.561+0000 7fcea1a00640 1 Processor -- start 2024-09-13T18:37:04.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.561+0000 7fcea1a00640 1 -- start start 2024-09-13T18:37:04.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.562+0000 7fcea1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fce9c15dee0 0x7fce9c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.562+0000 7fcea1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0b2f00 con 0x7fce9c0b3f10 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.562+0000 7fcea1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce9c0b3150 con 0x7fce9c15e2c0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.562+0000 7fcea1a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce9c0b3430 con 0x7fce9c15dee0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fce9c15dee0 0x7fce9c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9a000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fce9c0b3f10 0x7fce9c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48804/0 (socket says 172.21.15.192:48804) 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9a000640 1 -- 172.21.15.192:0/934379195 learned_addr learned my addr 172.21.15.192:0/934379195 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9aa00640 1 -- 172.21.15.192:0/934379195 >> v1:172.21.15.194:6789/0 conn(0x7fce9c15e2c0 legacy=0x7fce9c1637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9aa00640 1 -- 172.21.15.192:0/934379195 >> v1:172.21.15.192:6789/0 conn(0x7fce9c0b3f10 legacy=0x7fce9c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce9aa00640 1 -- 172.21.15.192:0/934379195 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce9c0b3710 con 0x7fce9c15dee0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.563+0000 7fce99600640 1 -- 172.21.15.192:0/934379195 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480541441 0 0) 0x7fce9c0b2f00 con 0x7fce9c0b3f10 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.564+0000 7fce9aa00640 1 --2- 172.21.15.192:0/934379195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c0afd80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0097a0 tx=0x7fce8c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f47786b9d4a8225 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.564+0000 7fce99600640 1 -- 172.21.15.192:0/934379195 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c032440 con 0x7fce9c15dee0 2024-09-13T18:37:04.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.564+0000 7fce99600640 1 -- 172.21.15.192:0/934379195 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c0325a0 con 0x7fce9c15dee0 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.564+0000 7fce99600640 1 -- 172.21.15.192:0/934379195 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c032930 con 0x7fce9c15dee0 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 -- 172.21.15.192:0/934379195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 msgr2=0x7fce9c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 --2- 172.21.15.192:0/934379195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c0afd80 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fce8c0097a0 tx=0x7fce8c02a230 comp rx=0 tx=0).stop 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 -- 172.21.15.192:0/934379195 shutdown_connections 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 --2- 172.21.15.192:0/934379195 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c0afd80 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 -- 172.21.15.192:0/934379195 >> 172.21.15.192:0/934379195 conn(0x7fce9c0ae960 msgr2=0x7fce9c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 -- 172.21.15.192:0/934379195 shutdown_connections 2024-09-13T18:37:04.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.565+0000 7fcea1a00640 1 -- 172.21.15.192:0/934379195 wait complete. 2024-09-13T18:37:04.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.567+0000 7fcea1a00640 1 Processor -- start 2024-09-13T18:37:04.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.567+0000 7fcea1a00640 1 -- start start 2024-09-13T18:37:04.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.567+0000 7fcea1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fcea1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce9c15e2c0 0x7fce9c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fcea1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1401c0 0x7fce9c06b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fcea1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c140760 con 0x7fce9c15dee0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fcea1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c13d1e0 con 0x7fce9c1401c0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fcea1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce9c13d4c0 con 0x7fce9c15e2c0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40426/0 (socket says 172.21.15.192:40426) 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 -- 172.21.15.192:0/1895775648 learned_addr learned my addr 172.21.15.192:0/1895775648 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9b400640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1401c0 0x7fce9c06b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9a000640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce9c15e2c0 0x7fce9c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 -- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce9c15e2c0 msgr2=0x7fce9c06b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce9c15e2c0 0x7fce9c06b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 -- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1401c0 msgr2=0x7fce9c06b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1401c0 0x7fce9c06b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.568+0000 7fce9aa00640 1 -- 172.21.15.192:0/1895775648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce8c009400 con 0x7fce9c15dee0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fce9aa00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c030b80 con 0x7fce9c15dee0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce8c030ce0 con 0x7fce9c15dee0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce8c03d680 con 0x7fce9c15dee0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce9c13d7a0 con 0x7fce9c15dee0 2024-09-13T18:37:04.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.569+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce9c150880 con 0x7fce9c15dee0 2024-09-13T18:37:04.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.570+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce9c067490 con 0x7fce9c15dee0 2024-09-13T18:37:04.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.571+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce8c039040 con 0x7fce9c15dee0 2024-09-13T18:37:04.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.571+0000 7fce92a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 0x7fce7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.572+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce8c0a9f50 con 0x7fce9c15dee0 2024-09-13T18:37:04.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.572+0000 7fce9a000640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 0x7fce7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.572+0000 7fce9a000640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 0x7fce7c06d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce9c06c590 tx=0x7fce88007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.576+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce8c075000 con 0x7fce9c15dee0 2024-09-13T18:37:04.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.743+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce9c13dcc0 con 0x7fce9c15dee0 2024-09-13T18:37:04.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.744+0000 7fce92a00640 1 -- 172.21.15.192:0/1895775648 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fce9c13dcc0 con 0x7fce9c15dee0 2024-09-13T18:37:04.748 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:04.748 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.746+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 msgr2=0x7fce7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.746+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 0x7fce7c06d0c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fce9c06c590 tx=0x7fce88007b90 comp rx=0 tx=0).stop 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.746+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 msgr2=0x7fce9c150340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.746+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fce8c000c00 tx=0x7fce8c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 shutdown_connections 2024-09-13T18:37:04.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce7c06ac00 0x7fce7c06d0c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce9c1401c0 0x7fce9c06b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce9c15e2c0 0x7fce9c06b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 --2- 172.21.15.192:0/1895775648 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce9c15dee0 0x7fce9c150340 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 >> 172.21.15.192:0/1895775648 conn(0x7fce9c0ae960 msgr2=0x7fce9c06f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 shutdown_connections 2024-09-13T18:37:04.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.747+0000 7fcea1a00640 1 -- 172.21.15.192:0/1895775648 wait complete. 2024-09-13T18:37:04.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:36:41.985306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:36:42.928618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:04.768 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:04.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.921+0000 7ffbe1600640 1 Processor -- start 2024-09-13T18:37:04.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.921+0000 7ffbe1600640 1 -- start start 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbe1600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffbdc1589f0 0x7ffbdc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbe1600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc0b2000 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbe1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbdc15b970 con 0x7ffbdc06c0b0 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbe1600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbdc15bbd0 con 0x7ffbdc1589f0 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbdaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffbdc1589f0 0x7ffbdc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbdaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffbdc1589f0 0x7ffbdc0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40430/0 (socket says 172.21.15.192:40430) 2024-09-13T18:37:04.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbd2000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ffbdc0b3af0 0x7ffbdc15b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48810/0 (socket says 172.21.15.192:48810) 2024-09-13T18:37:04.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.922+0000 7ffbdaa00640 1 -- 172.21.15.192:0/3190851729 learned_addr learned my addr 172.21.15.192:0/3190851729 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:04.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.923+0000 7ffbdaa00640 1 -- 172.21.15.192:0/3190851729 >> v1:172.21.15.194:6789/0 conn(0x7ffbdc06c0b0 legacy=0x7ffbdc0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.923+0000 7ffbdaa00640 1 -- 172.21.15.192:0/3190851729 >> v1:172.21.15.192:6789/0 conn(0x7ffbdc0b3af0 legacy=0x7ffbdc15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.923+0000 7ffbdaa00640 1 -- 172.21.15.192:0/3190851729 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbdc15beb0 con 0x7ffbdc1589f0 2024-09-13T18:37:04.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.923+0000 7ffbda000640 1 -- 172.21.15.192:0/3190851729 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718722205 0 0) 0x7ffbdc0b2000 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.924+0000 7ffbdaa00640 1 --2- 172.21.15.192:0/3190851729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc0b2490 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc2dbf15ce0d87f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.924+0000 7ffbda000640 1 -- 172.21.15.192:0/3190851729 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc032440 con 0x7ffbdc1589f0 2024-09-13T18:37:04.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.924+0000 7ffbda000640 1 -- 172.21.15.192:0/3190851729 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0325a0 con 0x7ffbdc1589f0 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.924+0000 7ffbda000640 1 -- 172.21.15.192:0/3190851729 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc032930 con 0x7ffbdc1589f0 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 -- 172.21.15.192:0/3190851729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc1589f0 msgr2=0x7ffbdc0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 --2- 172.21.15.192:0/3190851729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc0b2490 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc009870 tx=0x7ffbcc02a270 comp rx=0 tx=0).stop 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 -- 172.21.15.192:0/3190851729 shutdown_connections 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 --2- 172.21.15.192:0/3190851729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc0b2490 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 -- 172.21.15.192:0/3190851729 >> 172.21.15.192:0/3190851729 conn(0x7ffbdc0b08f0 msgr2=0x7ffbdc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 -- 172.21.15.192:0/3190851729 shutdown_connections 2024-09-13T18:37:04.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.925+0000 7ffbe1600640 1 -- 172.21.15.192:0/3190851729 wait complete. 2024-09-13T18:37:04.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.926+0000 7ffbe1600640 1 Processor -- start 2024-09-13T18:37:04.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.927+0000 7ffbe1600640 1 -- start start 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.927+0000 7ffbe1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffbdc06c0b0 0x7ffbdc150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.927+0000 7ffbe1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbe1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc155a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbe1600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc1544a0 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbe1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc152320 con 0x7ffbdc1589f0 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbe1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbdc150e40 con 0x7ffbdc06c0b0 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40438/0 (socket says 172.21.15.192:40438) 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 -- 172.21.15.192:0/2649977465 learned_addr learned my addr 172.21.15.192:0/2649977465 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbdaa00640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffbdc06c0b0 0x7ffbdc150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbdb400640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc155a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 -- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffbdc06c0b0 msgr2=0x7ffbdc150900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffbdc06c0b0 0x7ffbdc150900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 -- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbdc1589f0 msgr2=0x7ffbdc155a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc155a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.928+0000 7ffbd2000640 1 -- 172.21.15.192:0/2649977465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc0094d0 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbd2000640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c4a0 tx=0x7ffbc400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc40074e0 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbc4007640 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbc4004a00 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbdc151710 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.929+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbdc151cd0 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.930+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbdc0cc0b0 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.931+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffbc4004b60 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.932+0000 7ffbd3400640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 0x7ffbb806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:04.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.932+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbc4088400 con 0x7ffbdc0b3af0 2024-09-13T18:37:04.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.932+0000 7ffbdaa00640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 0x7ffbb806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:04.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.933+0000 7ffbdaa00640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 0x7ffbb806d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc034000 tx=0x7ffbcc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:04.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:04.936+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffbc4053690 con 0x7ffbdc0b3af0 2024-09-13T18:37:05.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.106+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffbdc0b2470 con 0x7ffbdc0b3af0 2024-09-13T18:37:05.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.107+0000 7ffbd3400640 1 -- 172.21.15.192:0/2649977465 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffbc4056cb0 con 0x7ffbdc0b3af0 2024-09-13T18:37:05.110 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 msgr2=0x7ffbb806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 0x7ffbb806d0c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc034000 tx=0x7ffbcc02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 msgr2=0x7ffbdc157bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ffbc400c4a0 tx=0x7ffbc400c960 comp rx=0 tx=0).stop 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 shutdown_connections 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffbb806ac00 0x7ffbb806d0c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffbdc1589f0 0x7ffbdc155a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffbdc0b3af0 0x7ffbdc157bb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 --2- 172.21.15.192:0/2649977465 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffbdc06c0b0 0x7ffbdc150900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 >> 172.21.15.192:0/2649977465 conn(0x7ffbdc0b08f0 msgr2=0x7ffbdc0afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:05.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 shutdown_connections 2024-09-13T18:37:05.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.109+0000 7ffbe1600640 1 -- 172.21.15.192:0/2649977465 wait complete. 2024-09-13T18:37:05.127 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:05.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.280+0000 7fbd87a00640 1 Processor -- start 2024-09-13T18:37:05.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.280+0000 7fbd87a00640 1 -- start start 2024-09-13T18:37:05.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd87a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd800b3af0 0x7fbd8015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd87a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd8006c0b0 0x7fbd8006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd87a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd800b2000 con 0x7fbd801589f0 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd87a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd800b2ba0 con 0x7fbd800b3af0 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd87a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd8006ca30 con 0x7fbd8006c0b0 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd7fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd800b3af0 0x7fbd8015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd7fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd800b3af0 0x7fbd8015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40450/0 (socket says 172.21.15.192:40450) 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.281+0000 7fbd7fe00640 1 -- 172.21.15.192:0/2740115681 learned_addr learned my addr 172.21.15.192:0/2740115681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.282+0000 7fbd85a00640 1 --2- 172.21.15.192:0/2740115681 >> v2:172.21.15.194:3300/0 conn(0x7fbd8006c0b0 0x7fbd8006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.282+0000 7fbd7fe00640 1 -- 172.21.15.192:0/2740115681 >> v2:172.21.15.194:3300/0 conn(0x7fbd8006c0b0 msgr2=0x7fbd8006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.282+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/2740115681 >> v2:172.21.15.194:3300/0 conn(0x7fbd8006c0b0 0x7fbd8006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.282+0000 7fbd7fe00640 1 -- 172.21.15.192:0/2740115681 >> v1:172.21.15.194:6789/0 conn(0x7fbd801589f0 legacy=0x7fbd800b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.282+0000 7fbd7fe00640 1 -- 172.21.15.192:0/2740115681 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd8015bbd0 con 0x7fbd800b3af0 2024-09-13T18:37:05.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.283+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/2740115681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd800b3af0 0x7fbd8015b260 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd800cb890 tx=0x7fbd6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26848095701a5686 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.283+0000 7fbd7f400640 1 -- 172.21.15.192:0/2740115681 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c032440 con 0x7fbd800b3af0 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.283+0000 7fbd7f400640 1 -- 172.21.15.192:0/2740115681 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6c0325a0 con 0x7fbd800b3af0 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.283+0000 7fbd7f400640 1 -- 172.21.15.192:0/2740115681 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd6c032930 con 0x7fbd800b3af0 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 -- 172.21.15.192:0/2740115681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd800b3af0 msgr2=0x7fbd8015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 --2- 172.21.15.192:0/2740115681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd800b3af0 0x7fbd8015b260 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fbd800cb890 tx=0x7fbd6c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 -- 172.21.15.192:0/2740115681 shutdown_connections 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 --2- 172.21.15.192:0/2740115681 >> v2:172.21.15.194:3300/0 conn(0x7fbd8006c0b0 0x7fbd8006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 --2- 172.21.15.192:0/2740115681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd800b3af0 0x7fbd8015b260 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 -- 172.21.15.192:0/2740115681 >> 172.21.15.192:0/2740115681 conn(0x7fbd800b08f0 msgr2=0x7fbd800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 -- 172.21.15.192:0/2740115681 shutdown_connections 2024-09-13T18:37:05.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.284+0000 7fbd87a00640 1 -- 172.21.15.192:0/2740115681 wait complete. 2024-09-13T18:37:05.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.285+0000 7fbd87a00640 1 Processor -- start 2024-09-13T18:37:05.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.286+0000 7fbd87a00640 1 -- start start 2024-09-13T18:37:05.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.286+0000 7fbd87a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.286+0000 7fbd87a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 0x7fbd80150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd87a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd801589f0 0x7fbd800c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd87a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd800c5350 con 0x7fbd8006c0b0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd87a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80150c70 con 0x7fbd801589f0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd87a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd80157c10 con 0x7fbd800b3af0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40452/0 (socket says 172.21.15.192:40452) 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 -- 172.21.15.192:0/1989437490 learned_addr learned my addr 172.21.15.192:0/1989437490 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd801589f0 0x7fbd800c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 0x7fbd80150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 -- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 msgr2=0x7fbd80150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 0x7fbd80150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 -- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd801589f0 msgr2=0x7fbd800c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd801589f0 0x7fbd800c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 -- 172.21.15.192:0/1989437490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6c0094d0 con 0x7fbd8006c0b0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 0x7fbd80150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.287+0000 7fbd85000640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c430 tx=0x7fbd7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.288+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd740052d0 con 0x7fbd8006c0b0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.288+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd74005430 con 0x7fbd8006c0b0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.288+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd800c4740 con 0x7fbd8006c0b0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.288+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd74003830 con 0x7fbd8006c0b0 2024-09-13T18:37:05.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.288+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd800c4d00 con 0x7fbd8006c0b0 2024-09-13T18:37:05.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.289+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd800b2950 con 0x7fbd8006c0b0 2024-09-13T18:37:05.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.290+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd74003990 con 0x7fbd8006c0b0 2024-09-13T18:37:05.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.291+0000 7fbd7cc00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 0x7fbd6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.291+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd740888f0 con 0x7fbd8006c0b0 2024-09-13T18:37:05.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.291+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 0x7fbd6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.291+0000 7fbd7fe00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 0x7fbd6006d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c034000 tx=0x7fbd6c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.295+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd74053ae0 con 0x7fbd8006c0b0 2024-09-13T18:37:05.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.466+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd8006c4f0 con 0x7fbd8006c0b0 2024-09-13T18:37:05.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.467+0000 7fbd7cc00640 1 -- 172.21.15.192:0/1989437490 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd74017020 con 0x7fbd8006c0b0 2024-09-13T18:37:05.469 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:37:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 msgr2=0x7fbd6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 0x7fbd6006d0c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbd6c034000 tx=0x7fbd6c02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 msgr2=0x7fbd800c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fbd7400c430 tx=0x7fbd7400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 shutdown_connections 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd6006ac00 0x7fbd6006d0c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd801589f0 0x7fbd800c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd800b3af0 0x7fbd80150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 --2- 172.21.15.192:0/1989437490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd8006c0b0 0x7fbd800c57e0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 >> 172.21.15.192:0/1989437490 conn(0x7fbd800b08f0 msgr2=0x7fbd800b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 shutdown_connections 2024-09-13T18:37:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.469+0000 7fbd87a00640 1 -- 172.21.15.192:0/1989437490 wait complete. 2024-09-13T18:37:05.487 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:05.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.639+0000 7f2f80000640 1 Processor -- start 2024-09-13T18:37:05.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.639+0000 7f2f80000640 1 -- start start 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f80000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f781589f0 0x7f2f780b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f80000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f7806c0b0 0x7f2f7806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f80000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f780b2000 con 0x7f2f780b3af0 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f80000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7806ca80 con 0x7f2f781589f0 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f80000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7815b970 con 0x7f2f7806c0b0 2024-09-13T18:37:05.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f7cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2f780b3af0 0x7f2f7815b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48826/0 (socket says 172.21.15.192:48826) 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f7cc00640 1 -- 172.21.15.192:0/3563025006 learned_addr learned my addr 172.21.15.192:0/3563025006 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.640+0000 7f2f7d600640 1 --2- 172.21.15.192:0/3563025006 >> v2:172.21.15.192:3300/0 conn(0x7f2f781589f0 0x7f2f780b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.641+0000 7f2f7e000640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f7806c0b0 0x7f2f7806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.641+0000 7f2f7d600640 1 -- 172.21.15.192:0/3563025006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f7806c0b0 msgr2=0x7f2f7806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.641+0000 7f2f7d600640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f7806c0b0 0x7f2f7806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.641+0000 7f2f7d600640 1 -- 172.21.15.192:0/3563025006 >> v1:172.21.15.192:6789/0 conn(0x7f2f780b3af0 legacy=0x7f2f7815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.641+0000 7f2f7d600640 1 -- 172.21.15.192:0/3563025006 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7815bbd0 con 0x7f2f781589f0 2024-09-13T18:37:05.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.642+0000 7f2f7d600640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f781589f0 0x7f2f780b2490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097a0 tx=0x7f2f6c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9686aad16c58fb01 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.642+0000 7f2f77e00640 1 -- 172.21.15.192:0/3563025006 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032440 con 0x7f2f781589f0 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.642+0000 7f2f77e00640 1 -- 172.21.15.192:0/3563025006 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c0325a0 con 0x7f2f781589f0 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.642+0000 7f2f77e00640 1 -- 172.21.15.192:0/3563025006 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c032930 con 0x7f2f781589f0 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 -- 172.21.15.192:0/3563025006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f781589f0 msgr2=0x7f2f780b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f781589f0 0x7f2f780b2490 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c0097a0 tx=0x7f2f6c02a180 comp rx=0 tx=0).stop 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 -- 172.21.15.192:0/3563025006 shutdown_connections 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f7806c0b0 0x7f2f7806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 --2- 172.21.15.192:0/3563025006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f781589f0 0x7f2f780b2490 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 -- 172.21.15.192:0/3563025006 >> 172.21.15.192:0/3563025006 conn(0x7f2f780b08f0 msgr2=0x7f2f780b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 -- 172.21.15.192:0/3563025006 shutdown_connections 2024-09-13T18:37:05.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.643+0000 7f2f80000640 1 -- 172.21.15.192:0/3563025006 wait complete. 2024-09-13T18:37:05.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.645+0000 7f2f80000640 1 Processor -- start 2024-09-13T18:37:05.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.645+0000 7f2f80000640 1 -- start start 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f780b3af0 0x7f2f78151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f781589f0 0x7f2f7806b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f3140 con 0x7f2f7806c0b0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f3420 con 0x7f2f780b3af0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f80000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f781f3700 con 0x7f2f781589f0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40470/0 (socket says 172.21.15.192:40470) 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 -- 172.21.15.192:0/817706435 learned_addr learned my addr 172.21.15.192:0/817706435 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7cc00640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f780b3af0 0x7f2f78151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7e000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f781589f0 0x7f2f7806b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 -- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f781589f0 msgr2=0x7f2f7806b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f781589f0 0x7f2f7806b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 -- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f780b3af0 msgr2=0x7f2f78151440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f780b3af0 0x7f2f78151440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.646+0000 7f2f7d600640 1 -- 172.21.15.192:0/817706435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c009400 con 0x7f2f7806c0b0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f7d600640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c035040 tx=0x7f2f6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c006e10 con 0x7f2f7806c0b0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6c032e90 con 0x7f2f7806c0b0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6c030be0 con 0x7f2f7806c0b0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f781f39e0 con 0x7f2f7806c0b0 2024-09-13T18:37:05.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.647+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f781506a0 con 0x7f2f7806c0b0 2024-09-13T18:37:05.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.648+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f781f3bd0 con 0x7f2f7806c0b0 2024-09-13T18:37:05.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.649+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f6c039040 con 0x7f2f7806c0b0 2024-09-13T18:37:05.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.650+0000 7f2f75600640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 0x7f2f5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.650+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f6c0a9a70 con 0x7f2f7806c0b0 2024-09-13T18:37:05.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.650+0000 7f2f7cc00640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 0x7f2f5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.651+0000 7f2f7cc00640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 0x7f2f5806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f78153970 tx=0x7f2f64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:05.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.654+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f6c074e10 con 0x7f2f7806c0b0 2024-09-13T18:37:05.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.821+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f781f3280 con 0x7f2f7806c0b0 2024-09-13T18:37:05.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.822+0000 7f2f75600640 1 -- 172.21.15.192:0/817706435 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f781f3280 con 0x7f2f7806c0b0 2024-09-13T18:37:05.825 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 msgr2=0x7f2f5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 0x7f2f5806d0c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2f78153970 tx=0x7f2f64009040 comp rx=0 tx=0).stop 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 msgr2=0x7f2f7814f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c035040 tx=0x7f2f6c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 shutdown_connections 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f5806ac00 0x7f2f5806d0c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f781589f0 0x7f2f7806b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f780b3af0 0x7f2f78151440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 --2- 172.21.15.192:0/817706435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f7806c0b0 0x7f2f7814f760 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 >> 172.21.15.192:0/817706435 conn(0x7f2f780b08f0 msgr2=0x7f2f780b0110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:05.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 shutdown_connections 2024-09-13T18:37:05.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.824+0000 7f2f80000640 1 -- 172.21.15.192:0/817706435 wait complete. 2024-09-13T18:37:05.843 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:05.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.993+0000 7f8f13c00640 1 Processor -- start 2024-09-13T18:37:05.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.993+0000 7f8f13c00640 1 -- start start 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.994+0000 7f8f13c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8f0c0cacd0 0x7f8f0c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.994+0000 7f8f13c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.994+0000 7f8f13c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f0c140480 con 0x7f8f0c0cb0b0 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.994+0000 7f8f13c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f0c0cb520 con 0x7f8f0c0cacd0 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.994+0000 7f8f13c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c15ee90 con 0x7f8f0c15bc20 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f0be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8f0c0cb0b0 0x7f8f0c140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48842/0 (socket says 172.21.15.192:48842) 2024-09-13T18:37:05.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f0be00640 1 -- 172.21.15.192:0/3840303182 learned_addr learned my addr 172.21.15.192:0/3840303182 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:05.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11200640 1 --2- 172.21.15.192:0/3840303182 >> v2:172.21.15.194:3300/0 conn(0x7f8f0c0cacd0 0x7f8f0c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11c00640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:05.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f0b400640 1 -- 172.21.15.192:0/3840303182 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3629369389 0 0) 0x7f8f0c140480 con 0x7f8f0c0cb0b0 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f0b400640 1 -- 172.21.15.192:0/3840303182 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003520 con 0x7f8f0c0cb0b0 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11200640 1 -- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 msgr2=0x7f8f0c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11200640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11200640 1 -- 172.21.15.192:0/3840303182 >> v1:172.21.15.192:6789/0 conn(0x7f8f0c0cb0b0 legacy=0x7f8f0c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.995+0000 7f8f11200640 1 -- 172.21.15.192:0/3840303182 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c15f170 con 0x7f8f0c0cacd0 2024-09-13T18:37:05.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f11200640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c15e790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8589d5c4223d6b2d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f0b400640 1 -- 172.21.15.192:0/3840303182 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00032440 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f0b400640 1 -- 172.21.15.192:0/3840303182 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000325a0 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f0b400640 1 -- 172.21.15.192:0/3840303182 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f00032930 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f13c00640 1 -- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cacd0 msgr2=0x7f8f0c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f13c00640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c15e790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8f000097a0 tx=0x7f8f0002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f13c00640 1 -- 172.21.15.192:0/3840303182 shutdown_connections 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f13c00640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.997+0000 7f8f13c00640 1 --2- 172.21.15.192:0/3840303182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c15e790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.998+0000 7f8f13c00640 1 -- 172.21.15.192:0/3840303182 >> 172.21.15.192:0/3840303182 conn(0x7f8f0c0ae960 msgr2=0x7f8f0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.998+0000 7f8f13c00640 1 -- 172.21.15.192:0/3840303182 shutdown_connections 2024-09-13T18:37:06.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.998+0000 7f8f13c00640 1 -- 172.21.15.192:0/3840303182 wait complete. 2024-09-13T18:37:06.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.999+0000 7f8f13c00640 1 Processor -- start 2024-09-13T18:37:06.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:05.999+0000 7f8f13c00640 1 -- start start 2024-09-13T18:37:06.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 0x7f8f0c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c13d9f0 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c0b4260 con 0x7f8f0c0cb0b0 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f13c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0c153030 con 0x7f8f0c15bc20 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f11200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f11200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40476/0 (socket says 172.21.15.192:40476) 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.000+0000 7f8f11200640 1 -- 172.21.15.192:0/512955026 learned_addr learned my addr 172.21.15.192:0/512955026 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f0be00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 0x7f8f0c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 -- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 msgr2=0x7f8f0c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 -- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 msgr2=0x7f8f0c153b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 0x7f8f0c153b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 -- 172.21.15.192:0/512955026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009400 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f0be00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 0x7f8f0c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:06.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f11200640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f00035040 tx=0x7f8f000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0003d8f0 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0003da70 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0c153310 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.001+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0003de20 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.002+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f0c0b4540 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.003+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0c152e90 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.003+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f00039040 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.004+0000 7f8f08c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 0x7f8eec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.004+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f000a99a0 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.004+0000 7f8f0be00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 0x7f8eec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.005+0000 7f8f0be00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 0x7f8eec06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c15e350 tx=0x7f8ef8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.008+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f0c152e90 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.193+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f0c152e90 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.194+0000 7f8f08c00640 1 -- 172.21.15.192:0/512955026 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v37) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f0c152e90 con 0x7f8f0c0cacd0 2024-09-13T18:37:06.197 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 msgr2=0x7f8eec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 0x7f8eec06d0c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c15e350 tx=0x7f8ef8009040 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 msgr2=0x7f8f0c13d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f8f00035040 tx=0x7f8f000046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 shutdown_connections 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8eec06ac00 0x7f8eec06d0c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f0c15bc20 0x7f8f0c069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f0c0cb0b0 0x7f8f0c153b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 --2- 172.21.15.192:0/512955026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f0c0cacd0 0x7f8f0c13d0a0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 >> 172.21.15.192:0/512955026 conn(0x7f8f0c0ae960 msgr2=0x7f8f0c0af3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 shutdown_connections 2024-09-13T18:37:06.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.196+0000 7f8f13c00640 1 -- 172.21.15.192:0/512955026 wait complete. 2024-09-13T18:37:06.215 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:37:06.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:06.215 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:06.285 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:37:06.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:06.285 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:37:06.323 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:06.323 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:06.358 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:37:06.358 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:06.359 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:06.399 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:37:06.399 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:06.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.547+0000 7f5ce5a00640 1 Processor -- start 2024-09-13T18:37:06.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.547+0000 7f5ce5a00640 1 -- start start 2024-09-13T18:37:06.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.548+0000 7f5ce5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 0x7f5ce015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5ce5a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ce00cb0b0 0x7f5ce015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5ce5a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 0x7f5ce0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5ce5a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce015c160 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5ce5a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ce0140480 con 0x7f5ce0140980 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5ce5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce015ee90 con 0x7f5ce00cacd0 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ce00cb0b0 0x7f5ce015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ce00cb0b0 0x7f5ce015bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40490/0 (socket says 172.21.15.192:40490) 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 -- 172.21.15.192:0/19251657 learned_addr learned my addr 172.21.15.192:0/19251657 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 -- 172.21.15.192:0/19251657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 msgr2=0x7f5ce015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cdea00640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 0x7f5ce015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 0x7f5ce015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cdf400640 1 --2- 172.21.15.192:0/19251657 >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 0x7f5ce0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 -- 172.21.15.192:0/19251657 >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 msgr2=0x7f5ce0140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 --2- 172.21.15.192:0/19251657 >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 0x7f5ce0140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cde000640 1 -- 172.21.15.192:0/19251657 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce015f170 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cdea00640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 0x7f5ce015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:06.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.549+0000 7f5cdf400640 1 --2- 172.21.15.192:0/19251657 >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 0x7f5ce0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.550+0000 7f5cde000640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce00cb0b0 0x7f5ce015bc20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5ce006e7b0 tx=0x7f5ccc02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5814f7f9b0f5fd37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5cdd600640 1 -- 172.21.15.192:0/19251657 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc02ae90 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5cdd600640 1 -- 172.21.15.192:0/19251657 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc032440 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5cdd600640 1 -- 172.21.15.192:0/19251657 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0327d0 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 -- 172.21.15.192:0/19251657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce00cb0b0 msgr2=0x7f5ce015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce00cb0b0 0x7f5ce015bc20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5ce006e7b0 tx=0x7f5ccc02a140 comp rx=0 tx=0).stop 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 -- 172.21.15.192:0/19251657 shutdown_connections 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/19251657 >> v2:172.21.15.194:3300/0 conn(0x7f5ce0140980 0x7f5ce0140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce00cb0b0 0x7f5ce015bc20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/19251657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cacd0 0x7f5ce015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 -- 172.21.15.192:0/19251657 >> 172.21.15.192:0/19251657 conn(0x7f5ce00ae960 msgr2=0x7f5ce006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 -- 172.21.15.192:0/19251657 shutdown_connections 2024-09-13T18:37:06.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.551+0000 7f5ce5a00640 1 -- 172.21.15.192:0/19251657 wait complete. 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.553+0000 7f5ce5a00640 1 Processor -- start 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.553+0000 7f5ce5a00640 1 -- start start 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce00cacd0 0x7f5ce006b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cb0b0 0x7f5ce006a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce006ae30 con 0x7f5ce0140980 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce0069ea0 con 0x7f5ce00cacd0 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5ce5a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce006a460 con 0x7f5ce00cb0b0 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5cdf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5cdf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40506/0 (socket says 172.21.15.192:40506) 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5cdf400640 1 -- 172.21.15.192:0/3628872352 learned_addr learned my addr 172.21.15.192:0/3628872352 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5cdea00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce00cacd0 0x7f5ce006b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.554+0000 7f5cde000640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cb0b0 0x7f5ce006a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 -- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cb0b0 msgr2=0x7f5ce006a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cb0b0 0x7f5ce006a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 -- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce00cacd0 msgr2=0x7f5ce006b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce00cacd0 0x7f5ce006b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 -- 172.21.15.192:0/3628872352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ccc0094d0 con 0x7f5ce0140980 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cdf400640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800cef0 tx=0x7f5cd800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800d840 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd800d9c0 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd800dd70 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce006b9c0 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.555+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce006a0f0 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.556+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce006bee0 con 0x7f5ce0140980 2024-09-13T18:37:06.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.557+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5cd801e3b0 con 0x7f5ce0140980 2024-09-13T18:37:06.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.558+0000 7f5cd6a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 0x7f5cc006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.558+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cd8089cf0 con 0x7f5ce0140980 2024-09-13T18:37:06.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.559+0000 7f5cdea00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 0x7f5cc006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.559+0000 7f5cdea00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 0x7f5cc006d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ce01f3ec0 tx=0x7f5cd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.563+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5cd8055030 con 0x7f5ce0140980 2024-09-13T18:37:06.579 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:06.583 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.775+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ce006a5d0 con 0x7f5ce0140980 2024-09-13T18:37:06.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.775+0000 7f5cd6a00640 1 -- 172.21.15.192:0/3628872352 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f5cd801a020 con 0x7f5ce0140980 2024-09-13T18:37:06.779 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:06.779 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:37:06.779 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:37:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 msgr2=0x7f5cc006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 0x7f5cc006d0f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5ce01f3ec0 tx=0x7f5cd0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 msgr2=0x7f5ce013cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5cd800cef0 tx=0x7f5cd800a710 comp rx=0 tx=0).stop 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 shutdown_connections 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cc006ac30 0x7f5cc006d0f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ce0140980 0x7f5ce013cb50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ce00cb0b0 0x7f5ce006a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 --2- 172.21.15.192:0/3628872352 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ce00cacd0 0x7f5ce006b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 >> 172.21.15.192:0/3628872352 conn(0x7f5ce00ae960 msgr2=0x7f5ce015da00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 shutdown_connections 2024-09-13T18:37:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.778+0000 7f5ce5a00640 1 -- 172.21.15.192:0/3628872352 wait complete. 2024-09-13T18:37:06.796 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.946+0000 7fc25f600640 1 Processor -- start 2024-09-13T18:37:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.946+0000 7fc25f600640 1 -- start start 2024-09-13T18:37:06.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25f600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc25815e790 0x7fc2580cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc2580afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25f600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc25815ec00 con 0x7fc2580cacd0 2024-09-13T18:37:06.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25f600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2580cb5f0 con 0x7fc25815e790 2024-09-13T18:37:06.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc258140480 con 0x7fc25815bc20 2024-09-13T18:37:06.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc2580cacd0 0x7fc258140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48848/0 (socket says 172.21.15.192:48848) 2024-09-13T18:37:06.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25cc00640 1 -- 172.21.15.192:0/3360685142 learned_addr learned my addr 172.21.15.192:0/3360685142 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:06.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc24fe00640 1 --2- 172.21.15.192:0/3360685142 >> v2:172.21.15.194:3300/0 conn(0x7fc25815e790 0x7fc2580cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc25d600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc2580afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719074906 0 0) 0x7fc25815ec00 con 0x7fc2580cacd0 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.948+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c003520 con 0x7fc2580cacd0 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 267732327 0 0) 0x7fc23c003520 con 0x7fc2580cacd0 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 msgr2=0x7fc2580afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc2580afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 >> v2:172.21.15.194:3300/0 conn(0x7fc25815e790 msgr2=0x7fc2580cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 --2- 172.21.15.192:0/3360685142 >> v2:172.21.15.194:3300/0 conn(0x7fc25815e790 0x7fc2580cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc25815ee90 con 0x7fc2580cacd0 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fc248001670 con 0x7fc2580cacd0 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc24fe00640 1 --2- 172.21.15.192:0/3360685142 >> v2:172.21.15.194:3300/0 conn(0x7fc25815e790 0x7fc2580cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 >> v1:172.21.15.192:6789/0 conn(0x7fc2580cacd0 legacy=0x7fc258140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c003970 0x7fc23c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc23c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc23c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc258140480 con 0x7fc23c004d00 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c00b980 con 0x7fc23c003970 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23c00bac0 con 0x7fc25815bc20 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc25d600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc23c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc25cc00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c003970 0x7fc23c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.949+0000 7fc24fe00640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc23c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.950+0000 7fc25d600640 1 -- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 msgr2=0x7fc23c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.950+0000 7fc25d600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc25815bc20 0x7fc23c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.950+0000 7fc25d600640 1 -- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c003970 msgr2=0x7fc23c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.950+0000 7fc25d600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc23c003970 0x7fc23c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.950+0000 7fc25d600640 1 -- 172.21.15.192:0/3360685142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23c003520 con 0x7fc23c004d00 2024-09-13T18:37:06.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25d600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc23c005180 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc250009fc0 tx=0x7fc23c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c4f01931cadc44 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc250031640 con 0x7fc23c004d00 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc25002d070 con 0x7fc23c004d00 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc257e00640 1 -- 172.21.15.192:0/3360685142 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2500319e0 con 0x7fc23c004d00 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 -- 172.21.15.192:0/3360685142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 msgr2=0x7fc23c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 --2- 172.21.15.192:0/3360685142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc23c005180 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc250009fc0 tx=0x7fc23c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25d600640 1 -- 172.21.15.192:0/3360685142 reap_dead start 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 -- 172.21.15.192:0/3360685142 shutdown_connections 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 -- 172.21.15.192:0/3360685142 >> 172.21.15.192:0/3360685142 conn(0x7fc2580ae960 msgr2=0x7fc25806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 -- 172.21.15.192:0/3360685142 shutdown_connections 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.951+0000 7fc25f600640 1 -- 172.21.15.192:0/3360685142 wait complete. 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.953+0000 7fc25f600640 1 Processor -- start 2024-09-13T18:37:06.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.953+0000 7fc25f600640 1 -- start start 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25813d4b0 0x7fc2580aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 0x7fc2580b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580ab930 con 0x7fc23c004d00 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580add80 con 0x7fc25813d4b0 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2580ae060 con 0x7fc2580ab4b0 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40528/0 (socket says 172.21.15.192:40528) 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.954+0000 7fc25cc00640 1 -- 172.21.15.192:0/2015405863 learned_addr learned my addr 172.21.15.192:0/2015405863 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc24fe00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25813d4b0 0x7fc2580aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25d600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 0x7fc2580b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 -- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 msgr2=0x7fc2580b30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 0x7fc2580b30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 -- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25813d4b0 msgr2=0x7fc2580aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25813d4b0 0x7fc2580aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 -- 172.21.15.192:0/2015405863 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2580ae340 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25d600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 0x7fc2580b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25cc00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc248007340 tx=0x7fc248007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800f8e0 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24800fa80 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24800fe30 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.955+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2580ae620 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.956+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2580abc60 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.957+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2580abe20 con 0x7fc23c004d00 2024-09-13T18:37:06.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.957+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc24801d460 con 0x7fc23c004d00 2024-09-13T18:37:06.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.959+0000 7fc255600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 0x7fc23406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:06.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.959+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc248089640 con 0x7fc23c004d00 2024-09-13T18:37:06.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.959+0000 7fc24fe00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 0x7fc23406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:06.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.959+0000 7fc24fe00640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 0x7fc23406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2580aabd0 tx=0x7fc240009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:06.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:06.963+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc2480546f0 con 0x7fc23c004d00 2024-09-13T18:37:07.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.134+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2580cb0b0 con 0x7fc23c004d00 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.135+0000 7fc255600640 1 -- 172.21.15.192:0/2015405863 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7fc248057d10 con 0x7fc23c004d00 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:07.138 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:07.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 msgr2=0x7fc23406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 0x7fc23406d0c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc2580aabd0 tx=0x7fc240009190 comp rx=0 tx=0).stop 2024-09-13T18:37:07.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 msgr2=0x7fc258133440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fc248007340 tx=0x7fc248007800 comp rx=0 tx=0).stop 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 shutdown_connections 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc23406ac00 0x7fc23406d0c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2580ab4b0 0x7fc2580b30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc25813d4b0 0x7fc2580aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 --2- 172.21.15.192:0/2015405863 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc23c004d00 0x7fc258133440 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 >> 172.21.15.192:0/2015405863 conn(0x7fc2580ae960 msgr2=0x7fc2580aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 shutdown_connections 2024-09-13T18:37:07.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.137+0000 7fc25f600640 1 -- 172.21.15.192:0/2015405863 wait complete. 2024-09-13T18:37:07.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:36:41.985306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:36:42.928618+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:07.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:07.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.307+0000 7f7163200640 1 Processor -- start 2024-09-13T18:37:07.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.308+0000 7f7163200640 1 -- start start 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7163200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f716406e990 0x7f71640cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7163200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71640ce6c0 0x7f71640cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7163200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716406c5d0 con 0x7f716415a9e0 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7163200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71640b3730 con 0x7f716406e990 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7163200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640b3920 con 0x7f71640ce6c0 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f716406e990 0x7f71640cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f716406e990 0x7f71640cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40538/0 (socket says 172.21.15.192:40538) 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 -- 172.21.15.192:0/1773834246 learned_addr learned my addr 172.21.15.192:0/1773834246 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7162800640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71640ce6c0 0x7f71640cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 -- 172.21.15.192:0/1773834246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71640ce6c0 msgr2=0x7f71640cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71640ce6c0 0x7f71640cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.309+0000 7f7159400640 1 -- 172.21.15.192:0/1773834246 >> v1:172.21.15.194:6789/0 conn(0x7f716415a9e0 legacy=0x7f716406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.310+0000 7f7159400640 1 -- 172.21.15.192:0/1773834246 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640b3c00 con 0x7f716406e990 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.310+0000 7f7159400640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f716406e990 0x7f71640cd8c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f714c009870 tx=0x7f714c02a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded49afe34c87e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7161400640 1 -- 172.21.15.192:0/1773834246 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c032440 con 0x7f716406e990 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7161400640 1 -- 172.21.15.192:0/1773834246 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0325a0 con 0x7f716406e990 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7161400640 1 -- 172.21.15.192:0/1773834246 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c032930 con 0x7f716406e990 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 -- 172.21.15.192:0/1773834246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f716406e990 msgr2=0x7f71640cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f716406e990 0x7f71640cd8c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f714c009870 tx=0x7f714c02a250 comp rx=0 tx=0).stop 2024-09-13T18:37:07.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 -- 172.21.15.192:0/1773834246 shutdown_connections 2024-09-13T18:37:07.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71640ce6c0 0x7f71640cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 --2- 172.21.15.192:0/1773834246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f716406e990 0x7f71640cd8c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 -- 172.21.15.192:0/1773834246 >> 172.21.15.192:0/1773834246 conn(0x7f71640736d0 msgr2=0x7f71640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.311+0000 7f7163200640 1 -- 172.21.15.192:0/1773834246 shutdown_connections 2024-09-13T18:37:07.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.312+0000 7f7163200640 1 -- 172.21.15.192:0/1773834246 wait complete. 2024-09-13T18:37:07.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.313+0000 7f7163200640 1 Processor -- start 2024-09-13T18:37:07.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.313+0000 7f7163200640 1 -- start start 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f716406e990 0x7f7164152af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f716415a9e0 0x7f71640a9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164151070 con 0x7f71640ce6c0 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7164153030 con 0x7f716415a9e0 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7163200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71640aa790 con 0x7f716406e990 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7159400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7159400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40540/0 (socket says 172.21.15.192:40540) 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7159400640 1 -- 172.21.15.192:0/3608151720 learned_addr learned my addr 172.21.15.192:0/3608151720 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.314+0000 7f7161e00640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f716406e990 0x7f7164152af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7162800640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f716415a9e0 0x7f71640a9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 -- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f716406e990 msgr2=0x7f7164152af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f716406e990 0x7f7164152af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 -- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f716415a9e0 msgr2=0x7f71640a9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f716415a9e0 0x7f71640a9dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 -- 172.21.15.192:0/3608151720 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0094d0 con 0x7f71640ce6c0 2024-09-13T18:37:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f7159400640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c032440 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.315+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c030980 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.316+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c030d30 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.316+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7164152030 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.316+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71641525f0 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.317+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71640cb4b0 con 0x7f71640ce6c0 2024-09-13T18:37:07.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.317+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f714c039040 con 0x7f71640ce6c0 2024-09-13T18:37:07.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.318+0000 7f715aa00640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 0x7f714006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.318+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f714c0a9c00 con 0x7f71640ce6c0 2024-09-13T18:37:07.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.318+0000 7f7161e00640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 0x7f714006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.319+0000 7f7161e00640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 0x7f714006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7154000f60 tx=0x7f7154009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.322+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f714c074df0 con 0x7f71640ce6c0 2024-09-13T18:37:07.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.489+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f71640ae450 con 0x7f71640ce6c0 2024-09-13T18:37:07.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.490+0000 7f715aa00640 1 -- 172.21.15.192:0/3608151720 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f71640ae450 con 0x7f71640ce6c0 2024-09-13T18:37:07.493 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 msgr2=0x7f714006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 0x7f714006d0c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7154000f60 tx=0x7f7154009040 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 msgr2=0x7f71640ade50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f714c000c00 tx=0x7f714c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 shutdown_connections 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f714006ac00 0x7f714006d0c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f716415a9e0 0x7f71640a9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71640ce6c0 0x7f71640ade50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 --2- 172.21.15.192:0/3608151720 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f716406e990 0x7f7164152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 >> 172.21.15.192:0/3608151720 conn(0x7f71640736d0 msgr2=0x7f71641598f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 shutdown_connections 2024-09-13T18:37:07.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.492+0000 7f7163200640 1 -- 172.21.15.192:0/3608151720 wait complete. 2024-09-13T18:37:07.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:07.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.666+0000 7fbd55400640 1 Processor -- start 2024-09-13T18:37:07.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.666+0000 7fbd55400640 1 -- start start 2024-09-13T18:37:07.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd55400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd500cb330 0x7fbd5006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd55400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbd500b3470 0x7fbd500b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd55400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd5015a8e0 con 0x7fbd500cdf60 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd55400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500b2fe0 con 0x7fbd500b3470 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd55400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd500b26b0 con 0x7fbd500cb330 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd45e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbd500cdf60 0x7fbd500ce3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48852/0 (socket says 172.21.15.192:48852) 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd45e00640 1 -- 172.21.15.192:0/3216296303 learned_addr learned my addr 172.21.15.192:0/3216296303 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.667+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3216296303 >> v2:172.21.15.192:3300/0 conn(0x7fbd500b3470 0x7fbd500b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4e800640 1 --2- 172.21.15.192:0/3216296303 >> v2:172.21.15.194:3300/0 conn(0x7fbd500cb330 0x7fbd5006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4de00640 1 -- 172.21.15.192:0/3216296303 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007831043 0 0) 0x7fbd5015a8e0 con 0x7fbd500cdf60 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4f200640 1 -- 172.21.15.192:0/3216296303 >> v2:172.21.15.194:3300/0 conn(0x7fbd500cb330 msgr2=0x7fbd5006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3216296303 >> v2:172.21.15.194:3300/0 conn(0x7fbd500cb330 0x7fbd5006ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4f200640 1 -- 172.21.15.192:0/3216296303 >> v1:172.21.15.192:6789/0 conn(0x7fbd500cdf60 legacy=0x7fbd500ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.668+0000 7fbd4f200640 1 -- 172.21.15.192:0/3216296303 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500b2990 con 0x7fbd500b3470 2024-09-13T18:37:07.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.669+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3216296303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500b3470 0x7fbd500b3870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbd500b18c0 tx=0x7fbd4802a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6466724d724d9eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.669+0000 7fbd4de00640 1 -- 172.21.15.192:0/3216296303 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48007740 con 0x7fbd500b3470 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.669+0000 7fbd4de00640 1 -- 172.21.15.192:0/3216296303 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4802d050 con 0x7fbd500b3470 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.669+0000 7fbd4de00640 1 -- 172.21.15.192:0/3216296303 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48007ac0 con 0x7fbd500b3470 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 -- 172.21.15.192:0/3216296303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500b3470 msgr2=0x7fbd500b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 --2- 172.21.15.192:0/3216296303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500b3470 0x7fbd500b3870 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fbd500b18c0 tx=0x7fbd4802a560 comp rx=0 tx=0).stop 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 -- 172.21.15.192:0/3216296303 shutdown_connections 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 --2- 172.21.15.192:0/3216296303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500b3470 0x7fbd500b3870 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 --2- 172.21.15.192:0/3216296303 >> v2:172.21.15.194:3300/0 conn(0x7fbd500cb330 0x7fbd5006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 -- 172.21.15.192:0/3216296303 >> 172.21.15.192:0/3216296303 conn(0x7fbd500b08f0 msgr2=0x7fbd500b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 -- 172.21.15.192:0/3216296303 shutdown_connections 2024-09-13T18:37:07.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.670+0000 7fbd55400640 1 -- 172.21.15.192:0/3216296303 wait complete. 2024-09-13T18:37:07.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.672+0000 7fbd55400640 1 Processor -- start 2024-09-13T18:37:07.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.672+0000 7fbd55400640 1 -- start start 2024-09-13T18:37:07.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd500b3470 0x7fbd50070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd500cb330 0x7fbd5014d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5014dc80 con 0x7fbd500cdf60 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd50156240 con 0x7fbd500cb330 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd55400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd501f3970 con 0x7fbd500b3470 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40562/0 (socket says 172.21.15.192:40562) 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 -- 172.21.15.192:0/3799708787 learned_addr learned my addr 172.21.15.192:0/3799708787 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4e800640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd500b3470 0x7fbd50070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd45e00640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd500cb330 0x7fbd5014d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 -- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd500b3470 msgr2=0x7fbd50070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd500b3470 0x7fbd50070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 -- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd500cb330 msgr2=0x7fbd5014d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd500cb330 0x7fbd5014d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.673+0000 7fbd4f200640 1 -- 172.21.15.192:0/3799708787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd48009a70 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd4f200640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009e80 tx=0x7fbd48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48003b90 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd48003cf0 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd501564c0 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd48003ea0 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.674+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd501f3f10 con 0x7fbd500cdf60 2024-09-13T18:37:07.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.675+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd500b3870 con 0x7fbd500cdf60 2024-09-13T18:37:07.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.676+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd48004230 con 0x7fbd500cdf60 2024-09-13T18:37:07.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.677+0000 7fbd47400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 0x7fbd2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:07.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.677+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd480aa500 con 0x7fbd500cdf60 2024-09-13T18:37:07.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.677+0000 7fbd4e800640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 0x7fbd2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:07.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.678+0000 7fbd4e800640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 0x7fbd2c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009aa0 tx=0x7fbd40009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:07.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.681+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd480756f0 con 0x7fbd500cdf60 2024-09-13T18:37:07.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.850+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd50151e60 con 0x7fbd500cdf60 2024-09-13T18:37:07.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.850+0000 7fbd47400640 1 -- 172.21.15.192:0/3799708787 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v37) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbd48078d10 con 0x7fbd500cdf60 2024-09-13T18:37:07.853 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 msgr2=0x7fbd2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 0x7fbd2c06d0c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009aa0 tx=0x7fbd40009190 comp rx=0 tx=0).stop 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 msgr2=0x7fbd50155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbd48009e80 tx=0x7fbd48004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 shutdown_connections 2024-09-13T18:37:07.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2c06ac00 0x7fbd2c06d0c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd500cdf60 0x7fbd50155d00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd500cb330 0x7fbd5014d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 --2- 172.21.15.192:0/3799708787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd500b3470 0x7fbd50070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 >> 172.21.15.192:0/3799708787 conn(0x7fbd500b08f0 msgr2=0x7fbd500b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 shutdown_connections 2024-09-13T18:37:07.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:07.852+0000 7fbd55400640 1 -- 172.21.15.192:0/3799708787 wait complete. 2024-09-13T18:37:07.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:08.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.027+0000 7f5cad200640 1 Processor -- start 2024-09-13T18:37:08.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.028+0000 7f5cad200640 1 -- start start 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5cad200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ca81589f0 0x7f5ca80b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5cad200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca80b2000 con 0x7f5ca80b3af0 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5cad200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca815b970 con 0x7f5ca806c0b0 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5cad200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca815bbd0 con 0x7f5ca81589f0 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5ca5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ca81589f0 0x7f5ca80b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5ca5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ca81589f0 0x7f5ca80b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40564/0 (socket says 172.21.15.192:40564) 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5ca5e00640 1 -- 172.21.15.192:0/1001787504 learned_addr learned my addr 172.21.15.192:0/1001787504 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:08.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.029+0000 7f5c9fe00640 1 --1- 172.21.15.192:0/1001787504 >> v1:172.21.15.192:6789/0 conn(0x7f5ca80b3af0 0x7f5ca815b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48858/0 (socket says 172.21.15.192:48858) 2024-09-13T18:37:08.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.030+0000 7f5ca5e00640 1 -- 172.21.15.192:0/1001787504 >> v1:172.21.15.194:6789/0 conn(0x7f5ca806c0b0 legacy=0x7f5ca80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.030+0000 7f5ca5e00640 1 -- 172.21.15.192:0/1001787504 >> v1:172.21.15.192:6789/0 conn(0x7f5ca80b3af0 legacy=0x7f5ca815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.030+0000 7f5ca5e00640 1 -- 172.21.15.192:0/1001787504 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca815beb0 con 0x7f5ca81589f0 2024-09-13T18:37:08.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.030+0000 7f5ca5e00640 1 --2- 172.21.15.192:0/1001787504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca81589f0 0x7f5ca80b2490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009870 tx=0x7f5c9802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20401d4121815c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5ca5400640 1 -- 172.21.15.192:0/1001787504 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98032440 con 0x7f5ca81589f0 2024-09-13T18:37:08.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5ca5400640 1 -- 172.21.15.192:0/1001787504 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c980325a0 con 0x7f5ca81589f0 2024-09-13T18:37:08.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5ca5400640 1 -- 172.21.15.192:0/1001787504 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98032930 con 0x7f5ca81589f0 2024-09-13T18:37:08.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5cad200640 1 -- 172.21.15.192:0/1001787504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca81589f0 msgr2=0x7f5ca80b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5cad200640 1 --2- 172.21.15.192:0/1001787504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca81589f0 0x7f5ca80b2490 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009870 tx=0x7f5c9802a270 comp rx=0 tx=0).stop 2024-09-13T18:37:08.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5cad200640 1 -- 172.21.15.192:0/1001787504 shutdown_connections 2024-09-13T18:37:08.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5cad200640 1 --2- 172.21.15.192:0/1001787504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca81589f0 0x7f5ca80b2490 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.031+0000 7f5cad200640 1 -- 172.21.15.192:0/1001787504 >> 172.21.15.192:0/1001787504 conn(0x7f5ca80b08f0 msgr2=0x7f5ca80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.032+0000 7f5cad200640 1 -- 172.21.15.192:0/1001787504 shutdown_connections 2024-09-13T18:37:08.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.032+0000 7f5cad200640 1 -- 172.21.15.192:0/1001787504 wait complete. 2024-09-13T18:37:08.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.033+0000 7f5cad200640 1 Processor -- start 2024-09-13T18:37:08.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.033+0000 7f5cad200640 1 -- start start 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ca80b3af0 0x7f5ca8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 0x7f5ca8154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca814f140 con 0x7f5ca806c0b0 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca814f350 con 0x7f5ca81589f0 2024-09-13T18:37:08.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5cad200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca814f630 con 0x7f5ca80b3af0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5ca5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5ca5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40566/0 (socket says 172.21.15.192:40566) 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.034+0000 7f5ca5e00640 1 -- 172.21.15.192:0/852117881 learned_addr learned my addr 172.21.15.192:0/852117881 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 -- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ca80b3af0 msgr2=0x7f5ca8154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ca80b3af0 0x7f5ca8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 -- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 msgr2=0x7f5ca8154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca6800640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 0x7f5ca8154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 0x7f5ca8154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 -- 172.21.15.192:0/852117881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980094d0 con 0x7f5ca806c0b0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca6800640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 0x7f5ca8154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5ca5e00640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c98000c00 tx=0x7f5c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98030b80 con 0x7f5ca806c0b0 2024-09-13T18:37:08.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98030d00 con 0x7f5ca806c0b0 2024-09-13T18:37:08.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca814f910 con 0x7f5ca806c0b0 2024-09-13T18:37:08.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.035+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9803d680 con 0x7f5ca806c0b0 2024-09-13T18:37:08.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.036+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca814fed0 con 0x7f5ca806c0b0 2024-09-13T18:37:08.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.037+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca80b2490 con 0x7f5ca806c0b0 2024-09-13T18:37:08.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.037+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c98039040 con 0x7f5ca806c0b0 2024-09-13T18:37:08.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.039+0000 7f5c9e000640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 0x7f5c8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.039+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c980aa070 con 0x7f5ca806c0b0 2024-09-13T18:37:08.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.039+0000 7f5c9fe00640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 0x7f5c8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.039+0000 7f5c9fe00640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 0x7f5c8406d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ca81f6660 tx=0x7f5c900079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.043+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5c980dd9c0 con 0x7f5ca806c0b0 2024-09-13T18:37:08.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.209+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5ca80cc0b0 con 0x7f5ca806c0b0 2024-09-13T18:37:08.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.209+0000 7f5c9e000640 1 -- 172.21.15.192:0/852117881 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v37) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5c980752f0 con 0x7f5ca806c0b0 2024-09-13T18:37:08.212 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 msgr2=0x7f5c8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 0x7f5c8406d0c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5ca81f6660 tx=0x7f5c900079c0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 msgr2=0x7f5ca80ada20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c98000c00 tx=0x7f5c980046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 shutdown_connections 2024-09-13T18:37:08.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5c8406ac00 0x7f5c8406d0c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ca81589f0 0x7f5ca8154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ca80b3af0 0x7f5ca8154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 --2- 172.21.15.192:0/852117881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ca806c0b0 0x7f5ca80ada20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 >> 172.21.15.192:0/852117881 conn(0x7f5ca80b08f0 msgr2=0x7f5ca80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 shutdown_connections 2024-09-13T18:37:08.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.211+0000 7f5cad200640 1 -- 172.21.15.192:0/852117881 wait complete. 2024-09-13T18:37:08.231 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 Processor -- start 2024-09-13T18:37:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 -- start start 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 0x7f53e015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e0140980 0x7f53e0140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e015c160 con 0x7f53e0140980 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e0140480 con 0x7f53e00cb0b0 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e015ee90 con 0x7f53e00cacd0 2024-09-13T18:37:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53df200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e0140980 0x7f53e0140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53df200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e0140980 0x7f53e0140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40582/0 (socket says 172.21.15.192:40582) 2024-09-13T18:37:08.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.383+0000 7f53df200640 1 -- 172.21.15.192:0/2161918951 learned_addr learned my addr 172.21.15.192:0/2161918951 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:08.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53de800640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53d7e00640 1 --2- 172.21.15.192:0/2161918951 >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 0x7f53e015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53df200640 1 -- 172.21.15.192:0/2161918951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 msgr2=0x7f53e015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53df200640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53df200640 1 -- 172.21.15.192:0/2161918951 >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 msgr2=0x7f53e015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53df200640 1 --2- 172.21.15.192:0/2161918951 >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 0x7f53e015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53df200640 1 -- 172.21.15.192:0/2161918951 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e015f170 con 0x7f53e0140980 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.384+0000 7f53d7e00640 1 --2- 172.21.15.192:0/2161918951 >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 0x7f53e015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.385+0000 7f53df200640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e0140df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f53e006cd20 tx=0x7f53d802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e4a0c9f85dfa21a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.385+0000 7f53dde00640 1 -- 172.21.15.192:0/2161918951 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8031600 con 0x7f53e0140980 2024-09-13T18:37:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.385+0000 7f53dde00640 1 -- 172.21.15.192:0/2161918951 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d802d050 con 0x7f53e0140980 2024-09-13T18:37:08.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.385+0000 7f53dde00640 1 -- 172.21.15.192:0/2161918951 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d8031980 con 0x7f53e0140980 2024-09-13T18:37:08.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 -- 172.21.15.192:0/2161918951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 msgr2=0x7f53e0140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e0140df0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f53e006cd20 tx=0x7f53d802a610 comp rx=0 tx=0).stop 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 -- 172.21.15.192:0/2161918951 shutdown_connections 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e0140df0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 --2- 172.21.15.192:0/2161918951 >> v2:172.21.15.194:3300/0 conn(0x7f53e00cb0b0 0x7f53e015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 --2- 172.21.15.192:0/2161918951 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 -- 172.21.15.192:0/2161918951 >> 172.21.15.192:0/2161918951 conn(0x7f53e00ae960 msgr2=0x7f53e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 -- 172.21.15.192:0/2161918951 shutdown_connections 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.386+0000 7f53e5400640 1 -- 172.21.15.192:0/2161918951 wait complete. 2024-09-13T18:37:08.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.387+0000 7f53e5400640 1 Processor -- start 2024-09-13T18:37:08.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.388+0000 7f53e5400640 1 -- start start 2024-09-13T18:37:08.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.388+0000 7f53e5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e00cd3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.388+0000 7f53e5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e00cb0b0 0x7f53e006b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53e5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53e5400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cbfa0 con 0x7f53e0140980 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53e5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cc330 con 0x7f53e00cb0b0 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53e5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00cc610 con 0x7f53e00cacd0 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40594/0 (socket says 172.21.15.192:40594) 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 -- 172.21.15.192:0/3381306446 learned_addr learned my addr 172.21.15.192:0/3381306446 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53de800640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e00cd3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53d7e00640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e00cb0b0 0x7f53e006b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 -- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 msgr2=0x7f53e00cd3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e00cd3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 -- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e00cb0b0 msgr2=0x7f53e006b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e00cb0b0 0x7f53e006b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 -- 172.21.15.192:0/3381306446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8009b30 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.389+0000 7f53df200640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009f40 tx=0x7f53d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.390+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d803d860 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.390+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d803d9c0 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.390+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e00cc8f0 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.390+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d803dd70 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.390+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e00cceb0 con 0x7f53e0140980 2024-09-13T18:37:08.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.391+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e01555d0 con 0x7f53e0140980 2024-09-13T18:37:08.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.392+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f53d803b400 con 0x7f53e0140980 2024-09-13T18:37:08.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.392+0000 7f53d6a00640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 0x7f53bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.393+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53d80aa140 con 0x7f53e0140980 2024-09-13T18:37:08.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.393+0000 7f53de800640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 0x7f53bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.393+0000 7f53de800640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 0x7f53bc06d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53e00cb860 tx=0x7f53d0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.398+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53d8075310 con 0x7f53e0140980 2024-09-13T18:37:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.599+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53e015bc20 con 0x7f53e0140980 2024-09-13T18:37:08.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.600+0000 7f53d6a00640 1 -- 172.21.15.192:0/3381306446 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f53d8009510 con 0x7f53e0140980 2024-09-13T18:37:08.603 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:08.603 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:37:08.603 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 msgr2=0x7f53bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 0x7f53bc06d0c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f53e00cb860 tx=0x7f53d0009190 comp rx=0 tx=0).stop 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 msgr2=0x7f53e00cba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f53d8009f40 tx=0x7f53d8004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 shutdown_connections 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53bc06ac00 0x7f53bc06d0c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e0140980 0x7f53e00cba60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e00cb0b0 0x7f53e006b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 --2- 172.21.15.192:0/3381306446 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e00cacd0 0x7f53e00cd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 >> 172.21.15.192:0/3381306446 conn(0x7f53e00ae960 msgr2=0x7f53e015d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 shutdown_connections 2024-09-13T18:37:08.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.603+0000 7f53e5400640 1 -- 172.21.15.192:0/3381306446 wait complete. 2024-09-13T18:37:08.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:08.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.771+0000 7f3c4b400640 1 Processor -- start 2024-09-13T18:37:08.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.771+0000 7f3c4b400640 1 -- start start 2024-09-13T18:37:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.772+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 0x7f3c440afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.772+0000 7f3c4b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3c440b3f10 0x7f3c440b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.772+0000 7f3c4b400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c440b2f00 con 0x7f3c4415e2c0 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.772+0000 7f3c4b400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440b3150 con 0x7f3c440b3f10 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.772+0000 7f3c4b400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440b3430 con 0x7f3c4415dee0 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c49400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f3c4415e2c0 0x7f3c4415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:55784/0 (socket says 172.21.15.192:55784) 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c49400640 1 -- 172.21.15.192:0/2101975239 learned_addr learned my addr 172.21.15.192:0/2101975239 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c48a00640 1 --2- 172.21.15.192:0/2101975239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 0x7f3c440afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c43e00640 1 --2- 172.21.15.192:0/2101975239 >> v2:172.21.15.194:3300/0 conn(0x7f3c440b3f10 0x7f3c440b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c43400640 1 -- 172.21.15.192:0/2101975239 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1670977400 0 0) 0x7f3c440b2f00 con 0x7f3c4415e2c0 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c43400640 1 -- 172.21.15.192:0/2101975239 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c28005730 con 0x7f3c4415e2c0 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c48a00640 1 -- 172.21.15.192:0/2101975239 >> v2:172.21.15.194:3300/0 conn(0x7f3c440b3f10 msgr2=0x7f3c440b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c48a00640 1 --2- 172.21.15.192:0/2101975239 >> v2:172.21.15.194:3300/0 conn(0x7f3c440b3f10 0x7f3c440b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c48a00640 1 -- 172.21.15.192:0/2101975239 >> v1:172.21.15.194:6789/0 conn(0x7f3c4415e2c0 legacy=0x7f3c4415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.773+0000 7f3c48a00640 1 -- 172.21.15.192:0/2101975239 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440b3710 con 0x7f3c4415dee0 2024-09-13T18:37:08.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.774+0000 7f3c48a00640 1 --2- 172.21.15.192:0/2101975239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 0x7f3c440afd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c340097a0 tx=0x7f3c3402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a1bf7043b7dc5c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c43400640 1 -- 172.21.15.192:0/2101975239 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34032440 con 0x7f3c4415dee0 2024-09-13T18:37:08.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c43400640 1 -- 172.21.15.192:0/2101975239 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c340325a0 con 0x7f3c4415dee0 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c43400640 1 -- 172.21.15.192:0/2101975239 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c34032930 con 0x7f3c4415dee0 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 -- 172.21.15.192:0/2101975239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 msgr2=0x7f3c440afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 --2- 172.21.15.192:0/2101975239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 0x7f3c440afd80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3c340097a0 tx=0x7f3c3402a180 comp rx=0 tx=0).stop 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 -- 172.21.15.192:0/2101975239 shutdown_connections 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 --2- 172.21.15.192:0/2101975239 >> v2:172.21.15.194:3300/0 conn(0x7f3c440b3f10 0x7f3c440b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 --2- 172.21.15.192:0/2101975239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415dee0 0x7f3c440afd80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 -- 172.21.15.192:0/2101975239 >> 172.21.15.192:0/2101975239 conn(0x7f3c440ae960 msgr2=0x7f3c4406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 -- 172.21.15.192:0/2101975239 shutdown_connections 2024-09-13T18:37:08.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.775+0000 7f3c4b400640 1 -- 172.21.15.192:0/2101975239 wait complete. 2024-09-13T18:37:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.777+0000 7f3c4b400640 1 Processor -- start 2024-09-13T18:37:08.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.777+0000 7f3c4b400640 1 -- start start 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 0x7f3c441f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 0x7f3c440ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4413d060 con 0x7f3c4415dee0 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4413d620 con 0x7f3c441f2d00 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c4b400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c441f32f0 con 0x7f3c4415e2c0 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c48a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40598/0 (socket says 172.21.15.192:40598) 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c48a00640 1 -- 172.21.15.192:0/428135931 learned_addr learned my addr 172.21.15.192:0/428135931 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:08.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c49400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 0x7f3c440ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.778+0000 7f3c43e00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 0x7f3c441f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 -- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 msgr2=0x7f3c441f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 0x7f3c441f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 -- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 msgr2=0x7f3c440ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 0x7f3c440ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 -- 172.21.15.192:0/428135931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34009400 con 0x7f3c4415dee0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c49400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 0x7f3c440ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c43e00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 0x7f3c441f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c48a00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3c34035040 tx=0x7f3c340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403d8f0 con 0x7f3c4415dee0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3403da70 con 0x7f3c4415dee0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3403de20 con 0x7f3c4415dee0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c441f35d0 con 0x7f3c4415dee0 2024-09-13T18:37:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.779+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4406bf30 con 0x7f3c4415dee0 2024-09-13T18:37:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.780+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4415a440 con 0x7f3c4415dee0 2024-09-13T18:37:08.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.781+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3c34039040 con 0x7f3c4415dee0 2024-09-13T18:37:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.782+0000 7f3c40c00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 0x7f3c2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.782+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c340a9e70 con 0x7f3c4415dee0 2024-09-13T18:37:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.782+0000 7f3c43e00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 0x7f3c2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:08.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.783+0000 7f3c43e00640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 0x7f3c2406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c440afea0 tx=0x7f3c30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:08.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.786+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3c340750d0 con 0x7f3c4415dee0 2024-09-13T18:37:08.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.957+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c441f3790 con 0x7f3c4415dee0 2024-09-13T18:37:08.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.958+0000 7f3c40c00640 1 -- 172.21.15.192:0/428135931 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f3c340786f0 con 0x7f3c4415dee0 2024-09-13T18:37:08.960 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:08.960 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.960+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 msgr2=0x7f3c2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.960+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 0x7f3c2406d0c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3c440afea0 tx=0x7f3c30008040 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.960+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 msgr2=0x7f3c441377d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.960+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3c34035040 tx=0x7f3c340046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 shutdown_connections 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3c2406ac00 0x7f3c2406d0c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c441f2d00 0x7f3c440ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c4415e2c0 0x7f3c441f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 --2- 172.21.15.192:0/428135931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c4415dee0 0x7f3c441377d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 >> 172.21.15.192:0/428135931 conn(0x7f3c440ae960 msgr2=0x7f3c4413b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 shutdown_connections 2024-09-13T18:37:08.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:08.961+0000 7f3c4b400640 1 -- 172.21.15.192:0/428135931 wait complete. 2024-09-13T18:37:08.978 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:37:08.978 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:09.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.130+0000 7ffb7f600640 1 Processor -- start 2024-09-13T18:37:09.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.130+0000 7ffb7f600640 1 -- start start 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb780b3f10 0x7ffb7815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7f600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780b2f00 con 0x7ffb7815dee0 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7f600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780b3150 con 0x7ffb780b0490 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780b3430 con 0x7ffb780b3f10 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ffb7815dee0 0x7ffb780afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48872/0 (socket says 172.21.15.192:48872) 2024-09-13T18:37:09.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.131+0000 7ffb7cc00640 1 -- 172.21.15.192:0/2735442911 learned_addr learned my addr 172.21.15.192:0/2735442911 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77e00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb780b3f10 0x7ffb7815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753088490 0 0) 0x7ffb780b2f00 con 0x7ffb7815dee0 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb60005730 con 0x7ffb7815dee0 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3811079732 0 0) 0x7ffb780b3150 con 0x7ffb780b0490 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb780b2f00 con 0x7ffb780b0490 2024-09-13T18:37:09.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1310008640 0 0) 0x7ffb60005730 con 0x7ffb7815dee0 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb780b3f10 msgr2=0x7ffb7815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb780b3f10 0x7ffb7815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 >> v1:172.21.15.194:6789/0 conn(0x7ffb780b0490 legacy=0x7ffb7815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780b3710 con 0x7ffb7815dee0 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7ffb6c001670 con 0x7ffb7815dee0 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 >> v1:172.21.15.192:6789/0 conn(0x7ffb7815dee0 legacy=0x7ffb780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb60005d40 0x7ffb60006140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb600069d0 0x7ffb60006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb60007390 0x7ffb6000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780b3430 con 0x7ffb60005d40 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6000e0d0 con 0x7ffb600069d0 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.132+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6000e210 con 0x7ffb60007390 2024-09-13T18:37:09.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb60005d40 0x7ffb60006140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb77e00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb600069d0 0x7ffb60006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7d600640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb60007390 0x7ffb6000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 -- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb60007390 msgr2=0x7ffb6000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb60007390 0x7ffb6000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 -- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb600069d0 msgr2=0x7ffb60006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb600069d0 0x7ffb60006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.133+0000 7ffb7cc00640 1 -- 172.21.15.192:0/2735442911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60005730 con 0x7ffb60005d40 2024-09-13T18:37:09.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.134+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb60005d40 0x7ffb60006140 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007fd0 tx=0x7ffb60007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff172e7a99b1334 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.134+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005ad0 con 0x7ffb60005d40 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.134+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6c02d070 con 0x7ffb60005d40 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.134+0000 7ffb77400640 1 -- 172.21.15.192:0/2735442911 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6c005e90 con 0x7ffb60005d40 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 -- 172.21.15.192:0/2735442911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb60005d40 msgr2=0x7ffb60006140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2735442911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb60005d40 0x7ffb60006140 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c007fd0 tx=0x7ffb60007a00 comp rx=0 tx=0).stop 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7d600640 1 -- 172.21.15.192:0/2735442911 reap_dead start 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 -- 172.21.15.192:0/2735442911 shutdown_connections 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 -- 172.21.15.192:0/2735442911 >> 172.21.15.192:0/2735442911 conn(0x7ffb780ae960 msgr2=0x7ffb7806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 -- 172.21.15.192:0/2735442911 shutdown_connections 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.135+0000 7ffb7f600640 1 -- 172.21.15.192:0/2735442911 wait complete. 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.137+0000 7ffb7f600640 1 Processor -- start 2024-09-13T18:37:09.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.137+0000 7ffb7f600640 1 -- start start 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60005d40 0x7ffb7813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb7813f3a0 0x7ffb78139990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb78159520 con 0x7ffb78158b60 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7813d6f0 con 0x7ffb60005d40 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7813d9d0 con 0x7ffb7813f3a0 2024-09-13T18:37:09.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40626/0 (socket says 172.21.15.192:40626) 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 -- 172.21.15.192:0/2195994126 learned_addr learned my addr 172.21.15.192:0/2195994126 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60005d40 0x7ffb7813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb77e00640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb7813f3a0 0x7ffb78139990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 -- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb7813f3a0 msgr2=0x7ffb78139990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb7813f3a0 0x7ffb78139990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 -- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60005d40 msgr2=0x7ffb7813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60005d40 0x7ffb7813d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.138+0000 7ffb7d600640 1 -- 172.21.15.192:0/2195994126 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb7813dcb0 con 0x7ffb78158b60 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb7d600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb781437d0 tx=0x7ffb7000feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70006e20 con 0x7ffb78158b60 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb70003970 con 0x7ffb78158b60 2024-09-13T18:37:09.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb70003d20 con 0x7ffb78158b60 2024-09-13T18:37:09.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb7813df90 con 0x7ffb78158b60 2024-09-13T18:37:09.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.139+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb78139ed0 con 0x7ffb78158b60 2024-09-13T18:37:09.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.140+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb7813e120 con 0x7ffb78158b60 2024-09-13T18:37:09.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.141+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb70005030 con 0x7ffb78158b60 2024-09-13T18:37:09.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.142+0000 7ffb74c00640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 0x7ffb5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.142+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb70088360 con 0x7ffb78158b60 2024-09-13T18:37:09.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.143+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 0x7ffb5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.143+0000 7ffb7cc00640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 0x7ffb5806d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c032000 tx=0x7ffb6c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.146+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffb700535f0 con 0x7ffb78158b60 2024-09-13T18:37:09.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.347+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb780b3f10 con 0x7ffb78158b60 2024-09-13T18:37:09.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.348+0000 7ffb74c00640 1 -- 172.21.15.192:0/2195994126 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7ffb70056c10 con 0x7ffb78158b60 2024-09-13T18:37:09.350 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:09.350 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:37:09.350 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:37:09.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 msgr2=0x7ffb5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 0x7ffb5806d0f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffb6c032000 tx=0x7ffb6c007000 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 msgr2=0x7ffb78158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7ffb781437d0 tx=0x7ffb7000feb0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 shutdown_connections 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb5806ac30 0x7ffb5806d0f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb78158b60 0x7ffb78158fe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb7813f3a0 0x7ffb78139990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 --2- 172.21.15.192:0/2195994126 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb60005d40 0x7ffb7813d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 >> 172.21.15.192:0/2195994126 conn(0x7ffb780ae960 msgr2=0x7ffb780ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 shutdown_connections 2024-09-13T18:37:09.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.350+0000 7ffb7f600640 1 -- 172.21.15.192:0/2195994126 wait complete. 2024-09-13T18:37:09.368 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:09.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.517+0000 7fbc77e00640 1 Processor -- start 2024-09-13T18:37:09.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.517+0000 7fbc77e00640 1 -- start start 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc781592d0 0x7fbc78070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbc780b3600 0x7fbc780b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7806bca0 0x7fbc7806c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc7806f830 con 0x7fbc7806bca0 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780b3f80 con 0x7fbc780b3600 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.518+0000 7fbc77e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7806fa80 con 0x7fbc781592d0 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7806bca0 0x7fbc7806c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbc7806bca0 0x7fbc7806c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40638/0 (socket says 172.21.15.192:40638) 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 -- 172.21.15.192:0/14935554 learned_addr learned my addr 172.21.15.192:0/14935554 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:09.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc76a00640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc781592d0 0x7fbc78070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc6e000640 1 --2- 172.21.15.192:0/14935554 >> v2:172.21.15.194:3300/0 conn(0x7fbc780b3600 0x7fbc780b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 -- 172.21.15.192:0/14935554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc781592d0 msgr2=0x7fbc78070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc781592d0 0x7fbc78070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 -- 172.21.15.192:0/14935554 >> v2:172.21.15.194:3300/0 conn(0x7fbc780b3600 msgr2=0x7fbc780b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 --2- 172.21.15.192:0/14935554 >> v2:172.21.15.194:3300/0 conn(0x7fbc780b3600 0x7fbc780b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.519+0000 7fbc77400640 1 -- 172.21.15.192:0/14935554 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7806fd60 con 0x7fbc7806bca0 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.520+0000 7fbc77400640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7806bca0 0x7fbc7806c0d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbc7806ce30 tx=0x7fbc7002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b739bf81855c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.520+0000 7fbc76000640 1 -- 172.21.15.192:0/14935554 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70031600 con 0x7fbc7806bca0 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc76000640 1 -- 172.21.15.192:0/14935554 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7002d050 con 0x7fbc7806bca0 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc76000640 1 -- 172.21.15.192:0/14935554 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70031980 con 0x7fbc7806bca0 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 -- 172.21.15.192:0/14935554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7806bca0 msgr2=0x7fbc7806c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7806bca0 0x7fbc7806c0d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fbc7806ce30 tx=0x7fbc7002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 -- 172.21.15.192:0/14935554 shutdown_connections 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc7806bca0 0x7fbc7806c0d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 --2- 172.21.15.192:0/14935554 >> v2:172.21.15.194:3300/0 conn(0x7fbc780b3600 0x7fbc780b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 --2- 172.21.15.192:0/14935554 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc781592d0 0x7fbc78070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 -- 172.21.15.192:0/14935554 >> 172.21.15.192:0/14935554 conn(0x7fbc780736d0 msgr2=0x7fbc780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 -- 172.21.15.192:0/14935554 shutdown_connections 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.521+0000 7fbc77e00640 1 -- 172.21.15.192:0/14935554 wait complete. 2024-09-13T18:37:09.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.523+0000 7fbc77e00640 1 Processor -- start 2024-09-13T18:37:09.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.523+0000 7fbc77e00640 1 -- start start 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc7806bca0 0x7fbc78146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 0x7fbc78157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7814c360 con 0x7fbc780b3600 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc78153600 con 0x7fbc781592d0 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc781478d0 con 0x7fbc7806bca0 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40646/0 (socket says 172.21.15.192:40646) 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 -- 172.21.15.192:0/1389844664 learned_addr learned my addr 172.21.15.192:0/1389844664 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:09.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc76a00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc7806bca0 0x7fbc78146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77400640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 0x7fbc78157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 -- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc7806bca0 msgr2=0x7fbc78146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc7806bca0 0x7fbc78146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 -- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 msgr2=0x7fbc78157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 0x7fbc78157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc6e000640 1 -- 172.21.15.192:0/1389844664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009b30 con 0x7fbc780b3600 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.524+0000 7fbc77400640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 0x7fbc78157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc6e000640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000e890 tx=0x7fbc6000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000c940 con 0x7fbc780b3600 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6000caa0 con 0x7fbc780b3600 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7814f2d0 con 0x7fbc780b3600 2024-09-13T18:37:09.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6000ce30 con 0x7fbc780b3600 2024-09-13T18:37:09.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.525+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc78153af0 con 0x7fbc780b3600 2024-09-13T18:37:09.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.526+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7806c0d0 con 0x7fbc780b3600 2024-09-13T18:37:09.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.527+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbc60013470 con 0x7fbc780b3600 2024-09-13T18:37:09.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.528+0000 7fbc6fe00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 0x7fbc5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.528+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc60089590 con 0x7fbc780b3600 2024-09-13T18:37:09.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.528+0000 7fbc76a00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 0x7fbc5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.529+0000 7fbc76a00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 0x7fbc5406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009a30 tx=0x7fbc68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.532+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbc60054760 con 0x7fbc780b3600 2024-09-13T18:37:09.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.732+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc78154a40 con 0x7fbc780b3600 2024-09-13T18:37:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.733+0000 7fbc6fe00640 1 -- 172.21.15.192:0/1389844664 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fbc6005e030 con 0x7fbc780b3600 2024-09-13T18:37:09.735 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:09.735 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:36:43.938032+0000","modified":"2024-09-13T18:36:46.951352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5094},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5094":{"gid":5094,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/367924662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":367924662},{"type":"v1","addr":"172.21.15.192:6836","nonce":367924662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-09-13T18:37:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 16 2024-09-13T18:37:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 msgr2=0x7fbc5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 0x7fbc5406d0c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbc68009a30 tx=0x7fbc68008040 comp rx=0 tx=0).stop 2024-09-13T18:37:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 msgr2=0x7fbc7814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fbc6000e890 tx=0x7fbc6000ed50 comp rx=0 tx=0).stop 2024-09-13T18:37:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 shutdown_connections 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbc5406ac00 0x7fbc5406d0c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbc781592d0 0x7fbc78157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbc780b3600 0x7fbc7814c780 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 --2- 172.21.15.192:0/1389844664 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbc7806bca0 0x7fbc78146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 >> 172.21.15.192:0/1389844664 conn(0x7fbc780736d0 msgr2=0x7fbc780b08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 shutdown_connections 2024-09-13T18:37:09.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.735+0000 7fbc77e00640 1 -- 172.21.15.192:0/1389844664 wait complete. 2024-09-13T18:37:09.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:09.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.902+0000 7f8676200640 1 Processor -- start 2024-09-13T18:37:09.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.903+0000 7f8676200640 1 -- start start 2024-09-13T18:37:09.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159b00 0x7f86700b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f867006bc30 0x7f86700b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8670159ee0 0x7f867015a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867015af60 con 0x7f867006bc30 2024-09-13T18:37:09.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f867006b7a0 con 0x7f8670159ee0 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8676200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867015ac80 con 0x7f8670159b00 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8667e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f867006bc30 0x7f86700b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8667e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f867006bc30 0x7f86700b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40660/0 (socket says 172.21.15.192:40660) 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8667e00640 1 -- 172.21.15.192:0/3241008149 learned_addr learned my addr 172.21.15.192:0/3241008149 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8675800640 1 --2- 172.21.15.192:0/3241008149 >> v2:172.21.15.194:3300/0 conn(0x7f8670159ee0 0x7f867015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.904+0000 7f8674e00640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159b00 0x7f86700b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.905+0000 7f8667e00640 1 -- 172.21.15.192:0/3241008149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159b00 msgr2=0x7f86700b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.905+0000 7f8667e00640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159b00 0x7f86700b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.905+0000 7f8667e00640 1 -- 172.21.15.192:0/3241008149 >> v2:172.21.15.194:3300/0 conn(0x7f8670159ee0 msgr2=0x7f867015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.905+0000 7f8667e00640 1 --2- 172.21.15.192:0/3241008149 >> v2:172.21.15.194:3300/0 conn(0x7f8670159ee0 0x7f867015a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.905+0000 7f8667e00640 1 -- 172.21.15.192:0/3241008149 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867006b150 con 0x7f867006bc30 2024-09-13T18:37:09.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f8667e00640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f867006bc30 0x7f86700b32b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f867006b710 tx=0x7f865802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9847bca2ba4657dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f866fe00640 1 -- 172.21.15.192:0/3241008149 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658032440 con 0x7f867006bc30 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f866fe00640 1 -- 172.21.15.192:0/3241008149 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86580325a0 con 0x7f867006bc30 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f866fe00640 1 -- 172.21.15.192:0/3241008149 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658032930 con 0x7f867006bc30 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f8676200640 1 -- 172.21.15.192:0/3241008149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f867006bc30 msgr2=0x7f86700b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.906+0000 7f8676200640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f867006bc30 0x7f86700b32b0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f867006b710 tx=0x7f865802a210 comp rx=0 tx=0).stop 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 -- 172.21.15.192:0/3241008149 shutdown_connections 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 --2- 172.21.15.192:0/3241008149 >> v2:172.21.15.194:3300/0 conn(0x7f8670159ee0 0x7f867015a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f867006bc30 0x7f86700b32b0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 --2- 172.21.15.192:0/3241008149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159b00 0x7f86700b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 -- 172.21.15.192:0/3241008149 >> 172.21.15.192:0/3241008149 conn(0x7f86700736d0 msgr2=0x7f86700b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:09.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 -- 172.21.15.192:0/3241008149 shutdown_connections 2024-09-13T18:37:09.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.907+0000 7f8676200640 1 -- 172.21.15.192:0/3241008149 wait complete. 2024-09-13T18:37:09.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.908+0000 7f8676200640 1 Processor -- start 2024-09-13T18:37:09.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.908+0000 7f8676200640 1 -- start start 2024-09-13T18:37:09.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 0x7f867014f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159ee0 0x7f8670158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867014ee60 con 0x7f8670159b00 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867014dfa0 con 0x7f867006bc30 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8676200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867014e1e0 con 0x7f8670159ee0 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.909+0000 7f8667e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40674/0 (socket says 172.21.15.192:40674) 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 -- 172.21.15.192:0/752080378 learned_addr learned my addr 172.21.15.192:0/752080378 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8675800640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159ee0 0x7f8670158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8674e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 0x7f867014f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 -- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159ee0 msgr2=0x7f8670158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159ee0 0x7f8670158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 -- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 msgr2=0x7f867014f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:09.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 0x7f867014f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 -- 172.21.15.192:0/752080378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86580094d0 con 0x7f8670159b00 2024-09-13T18:37:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8674e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 0x7f867014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:09.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.910+0000 7f8667e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8658000c00 tx=0x7f86580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.911+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865803b810 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.911+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865803b970 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.911+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867015aa50 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.911+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865803bd20 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.911+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867014e7a0 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.912+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867014efa0 con 0x7f8670159b00 2024-09-13T18:37:09.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.913+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8658039040 con 0x7f8670159b00 2024-09-13T18:37:09.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.913+0000 7f866d600640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 0x7f864c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:09.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.914+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f86580a98b0 con 0x7f8670159b00 2024-09-13T18:37:09.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.914+0000 7f8674e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 0x7f864c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:09.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.914+0000 7f8674e00640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 0x7f864c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8670158ca0 tx=0x7f8660008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:09.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:09.918+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f867014efa0 con 0x7f8670159b00 2024-09-13T18:37:10.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.090+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f867014efa0 con 0x7f8670159b00 2024-09-13T18:37:10.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.091+0000 7f866d600640 1 -- 172.21.15.192:0/752080378 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+16569 (secure 0 0 0) 0x7f867014efa0 con 0x7f8670159b00 2024-09-13T18:37:10.093 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:10.094 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":37,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:36:59.989403+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:36:41.985306+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-13T18:36:42.928618+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 msgr2=0x7f864c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 0x7f864c06d0c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8670158ca0 tx=0x7f8660008040 comp rx=0 tx=0).stop 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 msgr2=0x7f867014da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8658000c00 tx=0x7f86580046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 shutdown_connections 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f864c06ac00 0x7f864c06d0c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8670159ee0 0x7f8670158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8670159b00 0x7f867014da60 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 --2- 172.21.15.192:0/752080378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f867006bc30 0x7f867014f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 >> 172.21.15.192:0/752080378 conn(0x7f86700736d0 msgr2=0x7f86700cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 shutdown_connections 2024-09-13T18:37:10.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.094+0000 7f8676200640 1 -- 172.21.15.192:0/752080378 wait complete. 2024-09-13T18:37:10.112 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:37:10.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.262+0000 7f8b9a800640 1 Processor -- start 2024-09-13T18:37:10.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.263+0000 7f8b9a800640 1 -- start start 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b9a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8b941598d0 0x7f8b940b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b9a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b940cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b9a800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b9406bf10 con 0x7f8b9406b180 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b9a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9406bd20 con 0x7f8b941598d0 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b9a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940cdf60 con 0x7f8b940cd5b0 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b99e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8b9406b180 0x7f8b9406b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48880/0 (socket says 172.21.15.192:48880) 2024-09-13T18:37:10.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.264+0000 7f8b99e00640 1 -- 172.21.15.192:0/3346154740 learned_addr learned my addr 172.21.15.192:0/3346154740 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b99400640 1 --2- 172.21.15.192:0/3346154740 >> v2:172.21.15.194:3300/0 conn(0x7f8b941598d0 0x7f8b940b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b98a00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b940cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2127642718 0 0) 0x7f8b9406bf10 con 0x7f8b9406b180 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b7c003520 con 0x7f8b9406b180 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2471678710 0 0) 0x7f8b7c003520 con 0x7f8b9406b180 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 msgr2=0x7f8b940cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b940cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 >> v2:172.21.15.194:3300/0 conn(0x7f8b941598d0 msgr2=0x7f8b940b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 --2- 172.21.15.192:0/3346154740 >> v2:172.21.15.194:3300/0 conn(0x7f8b941598d0 0x7f8b940b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b940b2e10 con 0x7f8b9406b180 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f8b8c0019f0 con 0x7f8b9406b180 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 >> v1:172.21.15.192:6789/0 conn(0x7f8b9406b180 legacy=0x7f8b9406b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b7c0039a0 0x7f8b7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b940cdf60 con 0x7f8b7c004d00 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00b980 con 0x7f8b7c0039a0 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7c00bac0 con 0x7f8b940cd5b0 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b99400640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b7c0039a0 0x7f8b7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b99e00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.265+0000 7f8b98a00640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.266+0000 7f8b99400640 1 -- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 msgr2=0x7f8b7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.266+0000 7f8b99400640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b940cd5b0 0x7f8b7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.266+0000 7f8b99400640 1 -- 172.21.15.192:0/3346154740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c004d00 msgr2=0x7f8b7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.266+0000 7f8b99400640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c004d00 0x7f8b7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.266+0000 7f8b99400640 1 -- 172.21.15.192:0/3346154740 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b7c003520 con 0x7f8b7c0039a0 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.267+0000 7f8b99400640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b7c0039a0 0x7f8b7c003dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009ac0 tx=0x7f8b7c0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ca1986ef7b73c1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.267+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88031400 con 0x7f8b7c0039a0 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.267+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8802d050 con 0x7f8b7c0039a0 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.267+0000 7f8b93e00640 1 -- 172.21.15.192:0/3346154740 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88031780 con 0x7f8b7c0039a0 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 -- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b7c0039a0 msgr2=0x7f8b7c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 --2- 172.21.15.192:0/3346154740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b7c0039a0 0x7f8b7c003dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009ac0 tx=0x7f8b7c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b99e00640 1 -- 172.21.15.192:0/3346154740 reap_dead start 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 -- 172.21.15.192:0/3346154740 shutdown_connections 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 -- 172.21.15.192:0/3346154740 >> 172.21.15.192:0/3346154740 conn(0x7f8b940736d0 msgr2=0x7f8b940b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 -- 172.21.15.192:0/3346154740 shutdown_connections 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.268+0000 7f8b9a800640 1 -- 172.21.15.192:0/3346154740 wait complete. 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.270+0000 7f8b9a800640 1 Processor -- start 2024-09-13T18:37:10.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.270+0000 7f8b9a800640 1 -- start start 2024-09-13T18:37:10.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 0x7f8b94155a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b94155f60 0x7f8b940ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b941571a0 con 0x7f8b7c0039a0 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94149b10 con 0x7f8b94157630 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b9a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b94156590 con 0x7f8b94155f60 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40682/0 (socket says 172.21.15.192:40682) 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 -- 172.21.15.192:0/258726885 learned_addr learned my addr 172.21.15.192:0/258726885 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99e00640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b94155f60 0x7f8b940ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b98a00640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 0x7f8b94155a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 -- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b94155f60 msgr2=0x7f8b940ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b94155f60 0x7f8b940ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 -- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 msgr2=0x7f8b94155a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 0x7f8b94155a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b99400640 1 -- 172.21.15.192:0/258726885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b94156870 con 0x7f8b7c0039a0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.271+0000 7f8b98a00640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 0x7f8b94155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b99400640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009ac0 tx=0x7f8b88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88003b90 con 0x7f8b7c0039a0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88003cf0 con 0x7f8b7c0039a0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b94156b50 con 0x7f8b7c0039a0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88044630 con 0x7f8b7c0039a0 2024-09-13T18:37:10.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.272+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b94150740 con 0x7f8b7c0039a0 2024-09-13T18:37:10.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.273+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b94159cb0 con 0x7f8b7c0039a0 2024-09-13T18:37:10.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.274+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b88038070 con 0x7f8b7c0039a0 2024-09-13T18:37:10.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.275+0000 7f8b91600640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 0x7f8b7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.275+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b880a98f0 con 0x7f8b7c0039a0 2024-09-13T18:37:10.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.275+0000 7f8b98a00640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 0x7f8b7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.275+0000 7f8b98a00640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 0x7f8b7406d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b94158b30 tx=0x7f8b8000b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.279+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8b88074c00 con 0x7f8b7c0039a0 2024-09-13T18:37:10.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.481+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8b940cd390 con 0x7f8b7c0039a0 2024-09-13T18:37:10.483 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:37:10.482+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:37:10.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.492+0000 7f8b91600640 1 -- 172.21.15.192:0/258726885 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8b88049090 con 0x7f8b7c0039a0 2024-09-13T18:37:10.493 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 msgr2=0x7f8b7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 0x7f8b7406d0c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8b94158b30 tx=0x7f8b8000b3a0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 msgr2=0x7f8b941495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8b88009ac0 tx=0x7f8b88004730 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 shutdown_connections 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7406ac00 0x7f8b7406d0c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b94155f60 0x7f8b940ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b94157630 0x7f8b94155a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 --2- 172.21.15.192:0/258726885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b7c0039a0 0x7f8b941495d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 >> 172.21.15.192:0/258726885 conn(0x7f8b940736d0 msgr2=0x7f8b9406a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 shutdown_connections 2024-09-13T18:37:10.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.494+0000 7f8b9a800640 1 -- 172.21.15.192:0/258726885 wait complete. 2024-09-13T18:37:10.501 INFO:tasks.ceph.mds.c.smithi192.stderr: -4844> 2024-09-13T18:36:47.318+0000 7f7288600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:37:10.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:37:10.551 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:37:10.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.665+0000 7fbd6a800640 1 Processor -- start 2024-09-13T18:37:10.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.666+0000 7fbd6a800640 1 -- start start 2024-09-13T18:37:10.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd6a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 0x7fbd64164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 0x7fbd640b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd6a800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd640b2000 con 0x7fbd64165420 2024-09-13T18:37:10.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd6a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd64165e40 con 0x7fbd64144150 2024-09-13T18:37:10.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd6a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64165890 con 0x7fbd640cdd40 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd62a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbd64165420 0x7fbd640cd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44180/0 (socket says 172.21.15.192:44180) 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd62a00640 1 -- 172.21.15.192:0/2537291368 learned_addr learned my addr 172.21.15.192:0/2537291368 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd63400640 1 --2- 172.21.15.192:0/2537291368 >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 0x7fbd64164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd63e00640 1 --2- 172.21.15.192:0/2537291368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 0x7fbd640b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd62000640 1 -- 172.21.15.192:0/2537291368 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3823205453 0 0) 0x7fbd640b2000 con 0x7fbd64165420 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.667+0000 7fbd62000640 1 -- 172.21.15.192:0/2537291368 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd48003520 con 0x7fbd64165420 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.668+0000 7fbd63e00640 1 -- 172.21.15.192:0/2537291368 >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 msgr2=0x7fbd64164ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.668+0000 7fbd63e00640 1 --2- 172.21.15.192:0/2537291368 >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 0x7fbd64164ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.668+0000 7fbd63e00640 1 -- 172.21.15.192:0/2537291368 >> v1:172.21.15.192:6789/0 conn(0x7fbd64165420 legacy=0x7fbd640cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.668+0000 7fbd63e00640 1 -- 172.21.15.192:0/2537291368 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd640ce900 con 0x7fbd640cdd40 2024-09-13T18:37:10.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.668+0000 7fbd63400640 1 --2- 172.21.15.192:0/2537291368 >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 0x7fbd64164ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd63e00640 1 --2- 172.21.15.192:0/2537291368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 0x7fbd640b2490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77f2e63e780a4cd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd62000640 1 -- 172.21.15.192:0/2537291368 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c032440 con 0x7fbd640cdd40 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd62000640 1 -- 172.21.15.192:0/2537291368 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0325a0 con 0x7fbd640cdd40 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd62000640 1 -- 172.21.15.192:0/2537291368 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c032910 con 0x7fbd640cdd40 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd6a800640 1 -- 172.21.15.192:0/2537291368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 msgr2=0x7fbd640b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.669+0000 7fbd6a800640 1 --2- 172.21.15.192:0/2537291368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 0x7fbd640b2490 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c0097a0 tx=0x7fbd5c02a180 comp rx=0 tx=0).stop 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 -- 172.21.15.192:0/2537291368 shutdown_connections 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 --2- 172.21.15.192:0/2537291368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd640cdd40 0x7fbd640b2490 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 --2- 172.21.15.192:0/2537291368 >> v2:172.21.15.194:3300/0 conn(0x7fbd64144150 0x7fbd64164ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 -- 172.21.15.192:0/2537291368 >> 172.21.15.192:0/2537291368 conn(0x7fbd640b08f0 msgr2=0x7fbd640b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 -- 172.21.15.192:0/2537291368 shutdown_connections 2024-09-13T18:37:10.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.670+0000 7fbd6a800640 1 -- 172.21.15.192:0/2537291368 wait complete. 2024-09-13T18:37:10.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.671+0000 7fbd6a800640 1 Processor -- start 2024-09-13T18:37:10.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.671+0000 7fbd6a800640 1 -- start start 2024-09-13T18:37:10.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd64144150 0x7fbd64070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd64165420 0x7fbd640af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd641436d0 con 0x7fbd640cdd40 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd6406fb80 con 0x7fbd64165420 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd6a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd64070a50 con 0x7fbd64144150 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd63400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd63400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59734/0 (socket says 172.21.15.192:59734) 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd63400640 1 -- 172.21.15.192:0/614688826 learned_addr learned my addr 172.21.15.192:0/614688826 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.672+0000 7fbd62a00640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd64144150 0x7fbd64070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63e00640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd64165420 0x7fbd640af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 -- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd64144150 msgr2=0x7fbd64070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd64144150 0x7fbd64070510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 -- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd64165420 msgr2=0x7fbd640af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:10.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd64165420 0x7fbd640af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:10.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 -- 172.21.15.192:0/614688826 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd54009a70 con 0x7fbd640cdd40 2024-09-13T18:37:10.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd63400640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400efc0 tx=0x7fbd5400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54014680 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5400f040 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54014a00 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.673+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5c009400 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.674+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd6406ef70 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.674+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd64164ee0 con 0x7fbd640cdd40 2024-09-13T18:37:10.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.675+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd54014b60 con 0x7fbd640cdd40 2024-09-13T18:37:10.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.676+0000 7fbd5b400640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 0x7fbd4406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:10.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.676+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fbd5408a290 con 0x7fbd640cdd40 2024-09-13T18:37:10.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.676+0000 7fbd62a00640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 0x7fbd4406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:10.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.677+0000 7fbd62a00640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 0x7fbd4406d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd64070290 tx=0x7fbd50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:10.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.680+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd540553a0 con 0x7fbd640cdd40 2024-09-13T18:37:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:10.882+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fbd641f66c0 con 0x7fbd640cdd40 2024-09-13T18:37:11.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.500+0000 7fbd5b400640 1 -- 172.21.15.192:0/614688826 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 104+0+0 (secure 0 0 0) 0x7fbd540589c0 con 0x7fbd640cdd40 2024-09-13T18:37:11.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 msgr2=0x7fbd4406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 0x7fbd4406d0f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbd64070290 tx=0x7fbd50009040 comp rx=0 tx=0).stop 2024-09-13T18:37:11.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 msgr2=0x7fbd641f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbd5400efc0 tx=0x7fbd5400c490 comp rx=0 tx=0).stop 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 shutdown_connections 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd4406ac30 0x7fbd4406d0f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd64165420 0x7fbd640af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd64144150 0x7fbd64070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 --2- 172.21.15.192:0/614688826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd640cdd40 0x7fbd641f78c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.503+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 >> 172.21.15.192:0/614688826 conn(0x7fbd640b08f0 msgr2=0x7fbd640b2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.504+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 shutdown_connections 2024-09-13T18:37:11.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.504+0000 7fbd6a800640 1 -- 172.21.15.192:0/614688826 wait complete. 2024-09-13T18:37:11.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:37:11.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.721+0000 7f76ba800640 1 Processor -- start 2024-09-13T18:37:11.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.721+0000 7f76ba800640 1 -- start start 2024-09-13T18:37:11.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76ba800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f76b4145c30 0x7f76b406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76ba800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b40adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76ba800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b4146010 con 0x7f76b40b3b90 2024-09-13T18:37:11.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76ba800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b406ab60 con 0x7f76b4145c30 2024-09-13T18:37:11.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76ba800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b406b6e0 con 0x7f76b40ad840 2024-09-13T18:37:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76b3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f76b4145c30 0x7f76b406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76b2a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f76b40b3b90 0x7f76b406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44184/0 (socket says 172.21.15.192:44184) 2024-09-13T18:37:11.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.722+0000 7f76b2a00640 1 -- 172.21.15.192:0/1648090954 learned_addr learned my addr 172.21.15.192:0/1648090954 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:11.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3e00640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b40adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3400640 1 -- 172.21.15.192:0/1648090954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 msgr2=0x7f76b40adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3400640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b40adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b2000640 1 -- 172.21.15.192:0/1648090954 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677156131 0 0) 0x7f76a0001110 con 0x7f76b40b3b90 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3400640 1 -- 172.21.15.192:0/1648090954 >> v1:172.21.15.192:6789/0 conn(0x7f76b40b3b90 legacy=0x7f76b406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3400640 1 -- 172.21.15.192:0/1648090954 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b406c0b0 con 0x7f76b4145c30 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.723+0000 7f76b3e00640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b40adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.724+0000 7f76b3400640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b406bb70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097a0 tx=0x7f76a402a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a8b1872b9db9a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.724+0000 7f76b2000640 1 -- 172.21.15.192:0/1648090954 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a402ae50 con 0x7f76b4145c30 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.724+0000 7f76b2000640 1 -- 172.21.15.192:0/1648090954 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a4032440 con 0x7f76b4145c30 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.724+0000 7f76b2000640 1 -- 172.21.15.192:0/1648090954 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a40327d0 con 0x7f76b4145c30 2024-09-13T18:37:11.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 -- 172.21.15.192:0/1648090954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 msgr2=0x7f76b406bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b406bb70 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f76a40097a0 tx=0x7f76a402a100 comp rx=0 tx=0).stop 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 -- 172.21.15.192:0/1648090954 shutdown_connections 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b40adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 --2- 172.21.15.192:0/1648090954 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b406bb70 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 -- 172.21.15.192:0/1648090954 >> 172.21.15.192:0/1648090954 conn(0x7f76b40b0c40 msgr2=0x7f76b40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 -- 172.21.15.192:0/1648090954 shutdown_connections 2024-09-13T18:37:11.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.725+0000 7f76ba800640 1 -- 172.21.15.192:0/1648090954 wait complete. 2024-09-13T18:37:11.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.726+0000 7f76ba800640 1 Processor -- start 2024-09-13T18:37:11.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 -- start start 2024-09-13T18:37:11.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b413db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76b40b3b90 0x7f76b413c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b413e0a0 con 0x7f76b4145c30 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41f3020 con 0x7f76b40b3b90 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.727+0000 7f76ba800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b41f26f0 con 0x7f76b40ad840 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59740/0 (socket says 172.21.15.192:59740) 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 -- 172.21.15.192:0/3801599586 learned_addr learned my addr 172.21.15.192:0/3801599586 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3400640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b413db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b2a00640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76b40b3b90 0x7f76b413c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 -- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 msgr2=0x7f76b413db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b413db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 -- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76b40b3b90 msgr2=0x7f76b413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76b40b3b90 0x7f76b413c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 -- 172.21.15.192:0/3801599586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a4009400 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3400640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.728+0000 7f76b3e00640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00cef0 tx=0x7f76ac00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.729+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00d840 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.729+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac00d9c0 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.729+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b41f29d0 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.729+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac00dd70 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.729+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b413ce60 con 0x7f76b4145c30 2024-09-13T18:37:11.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.730+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b40b0350 con 0x7f76b4145c30 2024-09-13T18:37:11.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.731+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f76ac01e3b0 con 0x7f76b4145c30 2024-09-13T18:37:11.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.731+0000 7f76ab400640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 0x7f769406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:11.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.731+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f76ac089f30 con 0x7f76b4145c30 2024-09-13T18:37:11.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.732+0000 7f76b3400640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 0x7f769406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:11.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.732+0000 7f76b3400640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 0x7f769406d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76a4034000 tx=0x7f76a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:11.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.735+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f76b40b0350 con 0x7f76b4145c30 2024-09-13T18:37:11.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:11.905+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f76b40b0350 con 0x7f76b4145c30 2024-09-13T18:37:12.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.502+0000 7f76ab400640 1 -- 172.21.15.192:0/3801599586 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v39) v1 ==== 181+0+0 (secure 0 0 0) 0x7f76b40b0350 con 0x7f76b4145c30 2024-09-13T18:37:12.504 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:37:12.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 msgr2=0x7f769406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 0x7f769406d0c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f76a4034000 tx=0x7f76a402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 msgr2=0x7f76b415f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00cef0 tx=0x7f76ac00a710 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 shutdown_connections 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f769406ac00 0x7f769406d0c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76b4145c30 0x7f76b415f670 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f76b40b3b90 0x7f76b413c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 --2- 172.21.15.192:0/3801599586 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f76b40ad840 0x7f76b413db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 >> 172.21.15.192:0/3801599586 conn(0x7f76b40b0c40 msgr2=0x7f76b4143000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 shutdown_connections 2024-09-13T18:37:12.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.505+0000 7f76ba800640 1 -- 172.21.15.192:0/3801599586 wait complete. 2024-09-13T18:37:12.524 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:37:12.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.680+0000 7f261ac00640 1 Processor -- start 2024-09-13T18:37:12.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.680+0000 7f261ac00640 1 -- start start 2024-09-13T18:37:12.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.681+0000 7f261ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.681+0000 7f261ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 0x7f26140adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.681+0000 7f261ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2614146010 con 0x7f26140b3b90 2024-09-13T18:37:12.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.681+0000 7f261ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261406ab60 con 0x7f26140ad840 2024-09-13T18:37:12.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.681+0000 7f261ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261406b6e0 con 0x7f2614145c30 2024-09-13T18:37:12.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f26140b3b90 0x7f261406a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:42180/0 (socket says 172.21.15.192:42180) 2024-09-13T18:37:12.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613400640 1 -- 172.21.15.192:0/566698499 learned_addr learned my addr 172.21.15.192:0/566698499 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:12.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:55630/0 (socket says 172.21.15.192:55630) 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2618c00640 1 --2- 172.21.15.192:0/566698499 >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 0x7f26140adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 -- 172.21.15.192:0/566698499 >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 msgr2=0x7f26140adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 --2- 172.21.15.192:0/566698499 >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 0x7f26140adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 -- 172.21.15.192:0/566698499 >> v1:172.21.15.194:6789/0 conn(0x7f26140b3b90 legacy=0x7f261406a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2613e00640 1 -- 172.21.15.192:0/566698499 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261406c0b0 con 0x7f2614145c30 2024-09-13T18:37:12.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.682+0000 7f2618c00640 1 --2- 172.21.15.192:0/566698499 >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 0x7f26140adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.683+0000 7f2613e00640 1 --2- 172.21.15.192:0/566698499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26040097a0 tx=0x7f260402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3675d9aa0c73a44d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f2612a00640 1 -- 172.21.15.192:0/566698499 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260402ae50 con 0x7f2614145c30 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f2612a00640 1 -- 172.21.15.192:0/566698499 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2604032440 con 0x7f2614145c30 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f2612a00640 1 -- 172.21.15.192:0/566698499 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26040327d0 con 0x7f2614145c30 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 -- 172.21.15.192:0/566698499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 msgr2=0x7f261406bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 --2- 172.21.15.192:0/566698499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f26040097a0 tx=0x7f260402a100 comp rx=0 tx=0).stop 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 -- 172.21.15.192:0/566698499 shutdown_connections 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 --2- 172.21.15.192:0/566698499 >> v2:172.21.15.194:3300/0 conn(0x7f26140ad840 0x7f26140adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 --2- 172.21.15.192:0/566698499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261406bb70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 -- 172.21.15.192:0/566698499 >> 172.21.15.192:0/566698499 conn(0x7f26140b0c40 msgr2=0x7f26140b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 -- 172.21.15.192:0/566698499 shutdown_connections 2024-09-13T18:37:12.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.684+0000 7f261ac00640 1 -- 172.21.15.192:0/566698499 wait complete. 2024-09-13T18:37:12.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.686+0000 7f261ac00640 1 Processor -- start 2024-09-13T18:37:12.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.686+0000 7f261ac00640 1 -- start start 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 0x7f261413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261415c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261406f030 con 0x7f26140b3b90 2024-09-13T18:37:12.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2614070420 con 0x7f26140ad840 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f261ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261415cdd0 con 0x7f2614145c30 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2613400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2613e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 0x7f261413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2613e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 0x7f261413fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:52996/0 (socket says 172.21.15.192:52996) 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2613400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59742/0 (socket says 172.21.15.192:59742) 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2618c00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261415c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.687+0000 7f2613e00640 1 -- 172.21.15.192:0/359104214 learned_addr learned my addr 172.21.15.192:0/359104214 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 -- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 msgr2=0x7f261415c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261415c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 -- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 msgr2=0x7f261413fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 0x7f261413fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:12.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 -- 172.21.15.192:0/359104214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009a70 con 0x7f26140b3b90 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f2613400640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f260000c440 tx=0x7f2600001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2600005ce0 con 0x7f26140b3b90 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2600005e40 con 0x7f26140b3b90 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26000072d0 con 0x7f26140b3b90 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.688+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2604009400 con 0x7f26140b3b90 2024-09-13T18:37:12.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.689+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261406f540 con 0x7f26140b3b90 2024-09-13T18:37:12.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.689+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26140705d0 con 0x7f26140b3b90 2024-09-13T18:37:12.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.690+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2600007430 con 0x7f26140b3b90 2024-09-13T18:37:12.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.691+0000 7f260be00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 0x7f25f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:12.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.691+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f26000883d0 con 0x7f26140b3b90 2024-09-13T18:37:12.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.691+0000 7f2613e00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 0x7f25f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:12.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.692+0000 7f2613e00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 0x7f25f406d0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f260402a140 tx=0x7f260402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:12.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.696+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26140705d0 con 0x7f26140b3b90 2024-09-13T18:37:12.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:12.867+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2614146010 con 0x7f26140b3b90 2024-09-13T18:37:13.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.514+0000 7f260be00640 1 -- 172.21.15.192:0/359104214 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v40) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2614146010 con 0x7f26140b3b90 2024-09-13T18:37:13.516 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 msgr2=0x7f25f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 0x7f25f406d0c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f260402a140 tx=0x7f260402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 msgr2=0x7f261406eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f260000c440 tx=0x7f2600001e70 comp rx=0 tx=0).stop 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 shutdown_connections 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25f406ac00 0x7f25f406d0c0 secure :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f260402a140 tx=0x7f260402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2614145c30 0x7f261415c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26140b3b90 0x7f261406eaf0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 --2- 172.21.15.192:0/359104214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26140ad840 0x7f261413fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 >> 172.21.15.192:0/359104214 conn(0x7f26140b0c40 msgr2=0x7f2614144950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:13.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 shutdown_connections 2024-09-13T18:37:13.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.518+0000 7f261ac00640 1 -- 172.21.15.192:0/359104214 wait complete. 2024-09-13T18:37:13.537 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:37:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.690+0000 7f686d400640 1 Processor -- start 2024-09-13T18:37:13.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.690+0000 7f686d400640 1 -- start start 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f686d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 0x7f686815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f686d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f686806c0b0 0x7f686806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f686d400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68680b2000 con 0x7f68681589f0 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f686d400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68680b2ba0 con 0x7f686806c0b0 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f686d400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f686806ca30 con 0x7f68680b3af0 2024-09-13T18:37:13.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.691+0000 7f6867200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f686806c0b0 0x7f686806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f686806c0b0 0x7f686806c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59756/0 (socket says 172.21.15.192:59756) 2024-09-13T18:37:13.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 -- 172.21.15.192:0/2187805411 learned_addr learned my addr 172.21.15.192:0/2187805411 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6865e00640 1 --2- 172.21.15.192:0/2187805411 >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 0x7f686815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 -- 172.21.15.192:0/2187805411 >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 msgr2=0x7f686815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 --2- 172.21.15.192:0/2187805411 >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 0x7f686815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 -- 172.21.15.192:0/2187805411 >> v1:172.21.15.192:6789/0 conn(0x7f68681589f0 legacy=0x7f68680b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6867200640 1 -- 172.21.15.192:0/2187805411 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f686815bbd0 con 0x7f686806c0b0 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6865e00640 1 --2- 172.21.15.192:0/2187805411 >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 0x7f686815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.692+0000 7f6865400640 1 -- 172.21.15.192:0/2187805411 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2831330972 0 0) 0x7f68680b2000 con 0x7f68681589f0 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.693+0000 7f6867200640 1 --2- 172.21.15.192:0/2187805411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f686806c4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f686806edf0 tx=0x7f686002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b97fed59957233d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.693+0000 7f6865400640 1 -- 172.21.15.192:0/2187805411 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860031600 con 0x7f686806c0b0 2024-09-13T18:37:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.693+0000 7f6865400640 1 -- 172.21.15.192:0/2187805411 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686002d050 con 0x7f686806c0b0 2024-09-13T18:37:13.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.693+0000 7f6865400640 1 -- 172.21.15.192:0/2187805411 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6860031980 con 0x7f686806c0b0 2024-09-13T18:37:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 -- 172.21.15.192:0/2187805411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 msgr2=0x7f686806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 --2- 172.21.15.192:0/2187805411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f686806c4f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f686806edf0 tx=0x7f686002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 -- 172.21.15.192:0/2187805411 shutdown_connections 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 --2- 172.21.15.192:0/2187805411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f686806c4f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 --2- 172.21.15.192:0/2187805411 >> v2:172.21.15.194:3300/0 conn(0x7f68680b3af0 0x7f686815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 -- 172.21.15.192:0/2187805411 >> 172.21.15.192:0/2187805411 conn(0x7f68680b08f0 msgr2=0x7f68680b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 -- 172.21.15.192:0/2187805411 shutdown_connections 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.694+0000 7f686d400640 1 -- 172.21.15.192:0/2187805411 wait complete. 2024-09-13T18:37:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.695+0000 7f686d400640 1 Processor -- start 2024-09-13T18:37:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 -- start start 2024-09-13T18:37:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68680b3af0 0x7f686815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 0x7f686815d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68681e5b00 con 0x7f686806c0b0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68680708a0 con 0x7f68681589f0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.696+0000 7f686d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68681e6560 con 0x7f68680b3af0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59758/0 (socket says 172.21.15.192:59758) 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 -- 172.21.15.192:0/1981351887 learned_addr learned my addr 172.21.15.192:0/1981351887 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6865e00640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68680b3af0 0x7f686815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6867200640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 0x7f686815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 -- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68680b3af0 msgr2=0x7f686815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68680b3af0 0x7f686815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 -- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 msgr2=0x7f686815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 0x7f686815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 -- 172.21.15.192:0/1981351887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6860009b30 con 0x7f686806c0b0 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6867200640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 0x7f686815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.697+0000 7f6866800640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f685800c440 tx=0x7f685800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.698+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6858005480 con 0x7f686806c0b0 2024-09-13T18:37:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.698+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68580035f0 con 0x7f686806c0b0 2024-09-13T18:37:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.698+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f686815de20 con 0x7f686806c0b0 2024-09-13T18:37:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.698+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68580039a0 con 0x7f686806c0b0 2024-09-13T18:37:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.698+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6868070530 con 0x7f686806c0b0 2024-09-13T18:37:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.699+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6868070090 con 0x7f686806c0b0 2024-09-13T18:37:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.700+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6858003b00 con 0x7f686806c0b0 2024-09-13T18:37:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.701+0000 7f685ea00640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 0x7f684806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.701+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6858088500 con 0x7f686806c0b0 2024-09-13T18:37:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.701+0000 7f6865e00640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 0x7f684806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.702+0000 7f6865e00640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 0x7f684806d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68681f6090 tx=0x7f6854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.705+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6858053a70 con 0x7f686806c0b0 2024-09-13T18:37:13.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.880+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f686806c4f0 con 0x7f686806c0b0 2024-09-13T18:37:13.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.884+0000 7f685ea00640 1 -- 172.21.15.192:0/1981351887 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7f68580170a0 con 0x7f686806c0b0 2024-09-13T18:37:13.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 msgr2=0x7f684806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 0x7f684806d0c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f68681f6090 tx=0x7f6854008040 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 msgr2=0x7f68681e6020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f685800c440 tx=0x7f685800c900 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 shutdown_connections 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f684806ac00 0x7f684806d0c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68681589f0 0x7f686815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68680b3af0 0x7f686815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 --2- 172.21.15.192:0/1981351887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f686806c0b0 0x7f68681e6020 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.886+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 >> 172.21.15.192:0/1981351887 conn(0x7f68680b08f0 msgr2=0x7f686806acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:13.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.887+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 shutdown_connections 2024-09-13T18:37:13.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:13.887+0000 7f686d400640 1 -- 172.21.15.192:0/1981351887 wait complete. 2024-09-13T18:37:13.904 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2024-09-13T18:37:14.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.054+0000 7fb7b4600640 1 Processor -- start 2024-09-13T18:37:14.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.055+0000 7fb7b4600640 1 -- start start 2024-09-13T18:37:14.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b4600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7ac0cacd0 0x7fb7ac15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0cb0b0 0x7fb7ac15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b4600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ac140480 con 0x7fb7ac140980 2024-09-13T18:37:14.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b4600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ac15c160 con 0x7fb7ac0cacd0 2024-09-13T18:37:14.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15ee90 con 0x7fb7ac0cb0b0 2024-09-13T18:37:14.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b2600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb7ac140980 0x7fb7ac0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44212/0 (socket says 172.21.15.192:44212) 2024-09-13T18:37:14.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b2600640 1 -- 172.21.15.192:0/1555949454 learned_addr learned my addr 172.21.15.192:0/1555949454 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0cb0b0 0x7fb7ac15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.056+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> v2:172.21.15.194:3300/0 conn(0x7fb7ac0cacd0 0x7fb7ac15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533097803 0 0) 0x7fb7ac140480 con 0x7fb7ac140980 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb794003520 con 0x7fb7ac140980 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 664766997 0 0) 0x7fb794003520 con 0x7fb7ac140980 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0cb0b0 msgr2=0x7fb7ac15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0cb0b0 0x7fb7ac15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 >> v2:172.21.15.194:3300/0 conn(0x7fb7ac0cacd0 msgr2=0x7fb7ac15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 --2- 172.21.15.192:0/1555949454 >> v2:172.21.15.194:3300/0 conn(0x7fb7ac0cacd0 0x7fb7ac15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac15f170 con 0x7fb7ac140980 2024-09-13T18:37:14.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fb7a40019f0 con 0x7fb7ac140980 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> v2:172.21.15.194:3300/0 conn(0x7fb7ac0cacd0 0x7fb7ac15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 >> v1:172.21.15.192:6789/0 conn(0x7fb7ac140980 legacy=0x7fb7ac0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb794003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7940047c0 0x7fb794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb794005180 0x7fb79400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15c160 con 0x7fb794003970 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac15ee90 con 0x7fb7940047c0 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb79400bec0 con 0x7fb794005180 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0cb0b0 0x7fb7ac15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:14.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb794003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.057+0000 7fb7b2600640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb794005180 0x7fb79400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7940047c0 0x7fb794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb794005180 msgr2=0x7fb79400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb794005180 0x7fb79400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7940047c0 msgr2=0x7fb794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7940047c0 0x7fb794004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.058+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1555949454 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb794003520 con 0x7fb794003970 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb794003d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009cc0 tx=0x7fb7940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce6bc930d5b74a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0031400 con 0x7fb794003970 2024-09-13T18:37:14.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a002d050 con 0x7fb794003970 2024-09-13T18:37:14.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7abe00640 1 -- 172.21.15.192:0/1555949454 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0031760 con 0x7fb794003970 2024-09-13T18:37:14.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 -- 172.21.15.192:0/1555949454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 msgr2=0x7fb794003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1555949454 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb794003d90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0009cc0 tx=0x7fb7940057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b2600640 1 -- 172.21.15.192:0/1555949454 reap_dead start 2024-09-13T18:37:14.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 -- 172.21.15.192:0/1555949454 shutdown_connections 2024-09-13T18:37:14.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 -- 172.21.15.192:0/1555949454 >> 172.21.15.192:0/1555949454 conn(0x7fb7ac0ae960 msgr2=0x7fb7ac06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:14.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 -- 172.21.15.192:0/1555949454 shutdown_connections 2024-09-13T18:37:14.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.059+0000 7fb7b4600640 1 -- 172.21.15.192:0/1555949454 wait complete. 2024-09-13T18:37:14.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.061+0000 7fb7b4600640 1 Processor -- start 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.061+0000 7fb7b4600640 1 -- start start 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ac0cbee0 0x7fb7ac0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0b3bd0 0x7fb7ac0b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0b4590 con 0x7fb794003970 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0cc9a0 con 0x7fb7ac0cbee0 2024-09-13T18:37:14.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ac0ccc80 con 0x7fb7ac0b3bd0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b1c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b1c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59778/0 (socket says 172.21.15.192:59778) 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.062+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1617593585 learned_addr learned my addr 172.21.15.192:0/1617593585 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b2600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0b3bd0 0x7fb7ac0b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0b3bd0 msgr2=0x7fb7ac0b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ac0cbee0 0x7fb7ac0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0b3bd0 0x7fb7ac0b4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ac0cbee0 msgr2=0x7fb7ac0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ac0cbee0 0x7fb7ac0cc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 -- 172.21.15.192:0/1617593585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ac0ccf60 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b1c00640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0034040 tx=0x7fb7a0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a003a600 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7a003a780 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ac0cd240 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7a003ab30 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.063+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ac06a0a0 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.065+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ac1f2d10 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.065+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7a0038040 con 0x7fb794003970 2024-09-13T18:37:14.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.066+0000 7fb7a9600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 0x7fb78c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.066+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb7a00a9010 con 0x7fb794003970 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.066+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 0x7fb78c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.067+0000 7fb7b1200640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 0x7fb78c06d0f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac06eaf0 tx=0x7fb798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.070+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7a00744f0 con 0x7fb794003970 2024-09-13T18:37:14.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.297+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7fb7ac0cd700 con 0x7fb794003970 2024-09-13T18:37:14.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.512+0000 7fb7a9600640 1 -- 172.21.15.192:0/1617593585 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v103) v1 ==== 130+0+0 (secure 0 0 0) 0x7fb7a00360c0 con 0x7fb794003970 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 msgr2=0x7fb78c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 0x7fb78c06d0f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac06eaf0 tx=0x7fb798008040 comp rx=0 tx=0).stop 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 msgr2=0x7fb7ac06b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fb7a0034040 tx=0x7fb7a0004730 comp rx=0 tx=0).stop 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 shutdown_connections 2024-09-13T18:37:14.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb78c06ac30 0x7fb78c06d0f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ac0b3bd0 0x7fb7ac0b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ac0cbee0 0x7fb7ac0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 --2- 172.21.15.192:0/1617593585 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb794003970 0x7fb7ac06b350 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 >> 172.21.15.192:0/1617593585 conn(0x7fb7ac0ae960 msgr2=0x7fb7ac0aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 shutdown_connections 2024-09-13T18:37:14.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.514+0000 7fb7b4600640 1 -- 172.21.15.192:0/1617593585 wait complete. 2024-09-13T18:37:14.533 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-13T18:37:14.533 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-13T18:37:14.533 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:14.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.684+0000 7f5751600640 1 Processor -- start 2024-09-13T18:37:14.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.684+0000 7f5751600640 1 -- start start 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f5751600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f574c0b0490 0x7f574c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f5751600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0b2f00 con 0x7f574c15dee0 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f5751600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f574c0b3150 con 0x7f574c0b3f10 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f5751600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f574c0b3430 con 0x7f574c0b0490 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f574b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f574c0b0490 0x7f574c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f574aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f574c15dee0 0x7f574c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44218/0 (socket says 172.21.15.192:44218) 2024-09-13T18:37:14.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.685+0000 7f574aa00640 1 -- 172.21.15.192:0/1390098748 learned_addr learned my addr 172.21.15.192:0/1390098748 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:14.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.686+0000 7f574b400640 1 -- 172.21.15.192:0/1390098748 >> v1:172.21.15.194:6789/0 conn(0x7f574c0b3f10 legacy=0x7f574c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.686+0000 7f574b400640 1 -- 172.21.15.192:0/1390098748 >> v1:172.21.15.192:6789/0 conn(0x7f574c15dee0 legacy=0x7f574c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.686+0000 7f574a000640 1 -- 172.21.15.192:0/1390098748 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527786813 0 0) 0x7f574c0b2f00 con 0x7f574c15dee0 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.686+0000 7f574b400640 1 -- 172.21.15.192:0/1390098748 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c0b3710 con 0x7f574c0b0490 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.687+0000 7f574b400640 1 --2- 172.21.15.192:0/1390098748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c0b0490 0x7f574c15ab50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d90 tx=0x7f574402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc3d3e8900e4c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.687+0000 7f574a000640 1 -- 172.21.15.192:0/1390098748 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744007740 con 0x7f574c0b0490 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.687+0000 7f574a000640 1 -- 172.21.15.192:0/1390098748 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574402d050 con 0x7f574c0b0490 2024-09-13T18:37:14.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.687+0000 7f574a000640 1 -- 172.21.15.192:0/1390098748 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744007ac0 con 0x7f574c0b0490 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 -- 172.21.15.192:0/1390098748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c0b0490 msgr2=0x7f574c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 --2- 172.21.15.192:0/1390098748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c0b0490 0x7f574c15ab50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d90 tx=0x7f574402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 -- 172.21.15.192:0/1390098748 shutdown_connections 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 --2- 172.21.15.192:0/1390098748 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c0b0490 0x7f574c15ab50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 -- 172.21.15.192:0/1390098748 >> 172.21.15.192:0/1390098748 conn(0x7f574c0ae960 msgr2=0x7f574c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 -- 172.21.15.192:0/1390098748 shutdown_connections 2024-09-13T18:37:14.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.688+0000 7f5751600640 1 -- 172.21.15.192:0/1390098748 wait complete. 2024-09-13T18:37:14.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.689+0000 7f5751600640 1 Processor -- start 2024-09-13T18:37:14.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.690+0000 7f5751600640 1 -- start start 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.690+0000 7f5751600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f574c0b0490 0x7f574c1f3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.690+0000 7f5751600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f574c15dee0 0x7f574c1f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f5751600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f5751600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c13d060 con 0x7f574c1f1bb0 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f5751600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574c13d2b0 con 0x7f574c15dee0 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f5751600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f574c13d590 con 0x7f574c0b0490 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59784/0 (socket says 172.21.15.192:59784) 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 -- 172.21.15.192:0/2670039159 learned_addr learned my addr 172.21.15.192:0/2670039159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574aa00640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f574c0b0490 0x7f574c1f3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f5743e00640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f574c15dee0 0x7f574c1f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 -- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f574c0b0490 msgr2=0x7f574c1f3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f574c0b0490 0x7f574c1f3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 -- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f574c15dee0 msgr2=0x7f574c1f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f574c15dee0 0x7f574c1f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.691+0000 7f574b400640 1 -- 172.21.15.192:0/2670039159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5744009a70 con 0x7f574c1f1bb0 2024-09-13T18:37:14.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f574b400640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d90 tx=0x7f5744004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5744003b90 con 0x7f574c1f1bb0 2024-09-13T18:37:14.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5744003cf0 con 0x7f574c1f1bb0 2024-09-13T18:37:14.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57440319d0 con 0x7f574c1f1bb0 2024-09-13T18:37:14.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f574c13d870 con 0x7f574c1f1bb0 2024-09-13T18:37:14.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.692+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f574c1f3780 con 0x7f574c1f1bb0 2024-09-13T18:37:14.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.693+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f574c13dd90 con 0x7f574c1f1bb0 2024-09-13T18:37:14.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.694+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5744031b30 con 0x7f574c1f1bb0 2024-09-13T18:37:14.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.694+0000 7f5742a00640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 0x7f572806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:14.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.695+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57440aa6f0 con 0x7f574c1f1bb0 2024-09-13T18:37:14.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.695+0000 7f574aa00640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 0x7f572806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:14.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.695+0000 7f574aa00640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 0x7f572806d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f573c000f60 tx=0x7f573c007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:14.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.699+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f574c13dd90 con 0x7f574c1f1bb0 2024-09-13T18:37:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.869+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f574c13dd90 con 0x7f574c1f1bb0 2024-09-13T18:37:14.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.870+0000 7f5742a00640 1 -- 172.21.15.192:0/2670039159 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+13046 (secure 0 0 0) 0x7f574c13dd90 con 0x7f574c1f1bb0 2024-09-13T18:37:14.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:14.874 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:13.501272+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/367924662":"2024-09-14T18:37:10.481598+0000","172.21.15.192:6834/367924662":"2024-09-14T18:37:10.481598+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:14.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 msgr2=0x7f572806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 0x7f572806d0c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f573c000f60 tx=0x7f573c007e40 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 msgr2=0x7f574c1424a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5744009d90 tx=0x7f5744004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 shutdown_connections 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f572806ac00 0x7f572806d0c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f574c1f1bb0 0x7f574c1424a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f574c15dee0 0x7f574c1f1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.872+0000 7f5751600640 1 --2- 172.21.15.192:0/2670039159 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f574c0b0490 0x7f574c1f3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.873+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 >> 172.21.15.192:0/2670039159 conn(0x7f574c0ae960 msgr2=0x7f574c0b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.873+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 shutdown_connections 2024-09-13T18:37:14.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:14.873+0000 7f5751600640 1 -- 172.21.15.192:0/2670039159 wait complete. 2024-09-13T18:37:14.892 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:14.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:15.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.045+0000 7fbe8b600640 1 Processor -- start 2024-09-13T18:37:15.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.045+0000 7fbe8b600640 1 -- start start 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe8b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 0x7fbe840b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe8b600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8406cc40 con 0x7fbe841434c0 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe8b600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe8406b480 con 0x7fbe840b3bd0 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe8b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe840b4060 con 0x7fbe8406c800 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe88c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbe841434c0 0x7fbe8406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44222/0 (socket says 172.21.15.192:44222) 2024-09-13T18:37:15.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.046+0000 7fbe88c00640 1 -- 172.21.15.192:0/2965541901 learned_addr learned my addr 172.21.15.192:0/2965541901 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83e00640 1 --2- 172.21.15.192:0/2965541901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 0x7fbe840b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3403868376 0 0) 0x7fbe8406cc40 con 0x7fbe841434c0 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe6c003520 con 0x7fbe841434c0 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813784450 0 0) 0x7fbe8406b480 con 0x7fbe840b3bd0 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83e00640 1 -- 172.21.15.192:0/2965541901 >> v1:172.21.15.194:6789/0 conn(0x7fbe840b3bd0 legacy=0x7fbe8406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83e00640 1 -- 172.21.15.192:0/2965541901 >> v1:172.21.15.192:6789/0 conn(0x7fbe841434c0 legacy=0x7fbe8406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.047+0000 7fbe83e00640 1 -- 172.21.15.192:0/2965541901 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe8406b760 con 0x7fbe8406c800 2024-09-13T18:37:15.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.048+0000 7fbe83e00640 1 --2- 172.21.15.192:0/2965541901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 0x7fbe840b3690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009800 tx=0x7fbe7002a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a1c2c20f6deacc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.048+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7002ae50 con 0x7fbe8406c800 2024-09-13T18:37:15.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.048+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe70032440 con 0x7fbe8406c800 2024-09-13T18:37:15.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.048+0000 7fbe83400640 1 -- 172.21.15.192:0/2965541901 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700327b0 con 0x7fbe8406c800 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 -- 172.21.15.192:0/2965541901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 msgr2=0x7fbe840b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2965541901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 0x7fbe840b3690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009800 tx=0x7fbe7002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 -- 172.21.15.192:0/2965541901 shutdown_connections 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2965541901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe8406c800 0x7fbe840b3690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 -- 172.21.15.192:0/2965541901 >> 172.21.15.192:0/2965541901 conn(0x7fbe840b08f0 msgr2=0x7fbe840b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:15.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 -- 172.21.15.192:0/2965541901 shutdown_connections 2024-09-13T18:37:15.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.049+0000 7fbe8b600640 1 -- 172.21.15.192:0/2965541901 wait complete. 2024-09-13T18:37:15.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.051+0000 7fbe8b600640 1 Processor -- start 2024-09-13T18:37:15.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.051+0000 7fbe8b600640 1 -- start start 2024-09-13T18:37:15.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe840b3bd0 0x7fbe841400a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe841434c0 0x7fbe8413b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8413c380 con 0x7fbe8406c800 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe84139fb0 con 0x7fbe840b3bd0 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe8b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8413c0a0 con 0x7fbe841434c0 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59788/0 (socket says 172.21.15.192:59788) 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 -- 172.21.15.192:0/2312336707 learned_addr learned my addr 172.21.15.192:0/2312336707 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe83e00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe840b3bd0 0x7fbe841400a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe89600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe841434c0 0x7fbe8413b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 -- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe841434c0 msgr2=0x7fbe8413b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe841434c0 0x7fbe8413b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 -- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe840b3bd0 msgr2=0x7fbe841400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe840b3bd0 0x7fbe841400a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.052+0000 7fbe88c00640 1 -- 172.21.15.192:0/2312336707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70009400 con 0x7fbe8406c800 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe88c00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c780 tx=0x7fbe7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78005a90 con 0x7fbe8406c800 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe78005bf0 con 0x7fbe8406c800 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78007070 con 0x7fbe8406c800 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe8413a1c0 con 0x7fbe8406c800 2024-09-13T18:37:15.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.053+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe8413a780 con 0x7fbe8406c800 2024-09-13T18:37:15.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.054+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8413a970 con 0x7fbe8406c800 2024-09-13T18:37:15.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.055+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe780071d0 con 0x7fbe8406c800 2024-09-13T18:37:15.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.056+0000 7fbe80c00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 0x7fbe6406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.056+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbe78088830 con 0x7fbe8406c800 2024-09-13T18:37:15.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.056+0000 7fbe83e00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 0x7fbe6406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.057+0000 7fbe83e00640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 0x7fbe6406d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe70034000 tx=0x7fbe7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.060+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe78057850 con 0x7fbe8406c800 2024-09-13T18:37:15.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.226+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe840cc7d0 con 0x7fbe8406c800 2024-09-13T18:37:15.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.226+0000 7fbe80c00640 1 -- 172.21.15.192:0/2312336707 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe780170a0 con 0x7fbe8406c800 2024-09-13T18:37:15.232 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.228+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 msgr2=0x7fbe6406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.228+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 0x7fbe6406d0c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fbe70034000 tx=0x7fbe7002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.228+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 msgr2=0x7fbe8413aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.228+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c780 tx=0x7fbe7800cc40 comp rx=0 tx=0).stop 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 shutdown_connections 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe6406ac00 0x7fbe6406d0c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe841434c0 0x7fbe8413b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe840b3bd0 0x7fbe841400a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 --2- 172.21.15.192:0/2312336707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe8406c800 0x7fbe8413aca0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 >> 172.21.15.192:0/2312336707 conn(0x7fbe840b08f0 msgr2=0x7fbe840ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 shutdown_connections 2024-09-13T18:37:15.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.229+0000 7fbe8b600640 1 -- 172.21.15.192:0/2312336707 wait complete. 2024-09-13T18:37:15.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-13T18:37:15.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.397+0000 7f09d3e00640 1 Processor -- start 2024-09-13T18:37:15.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.397+0000 7f09d3e00640 1 -- start start 2024-09-13T18:37:15.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.398+0000 7f09d3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f09cc0afd80 0x7f09cc0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.398+0000 7f09d3e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0adf50 con 0x7f09cc0b2780 2024-09-13T18:37:15.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.398+0000 7f09d3e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09cc0ae770 con 0x7f09cc146610 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.398+0000 7f09d3e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09cc0cd920 con 0x7f09cc0afd80 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f09cc0afd80 0x7f09cc0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f09cc0afd80 0x7f09cc0b01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59800/0 (socket says 172.21.15.192:59800) 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 -- 172.21.15.192:0/694504591 learned_addr learned my addr 172.21.15.192:0/694504591 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 -- 172.21.15.192:0/694504591 >> v1:172.21.15.194:6789/0 conn(0x7f09cc146610 legacy=0x7f09cc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 -- 172.21.15.192:0/694504591 >> v1:172.21.15.192:6789/0 conn(0x7f09cc0b2780 legacy=0x7f09cc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09d1e00640 1 -- 172.21.15.192:0/694504591 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09cc0cdb30 con 0x7f09cc0afd80 2024-09-13T18:37:15.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.399+0000 7f09cbe00640 1 -- 172.21.15.192:0/694504591 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405094478 0 0) 0x7f09cc0adf50 con 0x7f09cc0b2780 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.400+0000 7f09d1e00640 1 --2- 172.21.15.192:0/694504591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc0b01f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0cda60 tx=0x7f09c402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ef3e1731f10e0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.400+0000 7f09cbe00640 1 -- 172.21.15.192:0/694504591 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4031600 con 0x7f09cc0afd80 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.400+0000 7f09cbe00640 1 -- 172.21.15.192:0/694504591 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c402d050 con 0x7f09cc0afd80 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.400+0000 7f09cbe00640 1 -- 172.21.15.192:0/694504591 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c4031980 con 0x7f09cc0afd80 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 -- 172.21.15.192:0/694504591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 msgr2=0x7f09cc0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 --2- 172.21.15.192:0/694504591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc0b01f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0cda60 tx=0x7f09c402a750 comp rx=0 tx=0).stop 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 -- 172.21.15.192:0/694504591 shutdown_connections 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 --2- 172.21.15.192:0/694504591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc0b01f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 -- 172.21.15.192:0/694504591 >> 172.21.15.192:0/694504591 conn(0x7f09cc0ae960 msgr2=0x7f09cc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:15.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 -- 172.21.15.192:0/694504591 shutdown_connections 2024-09-13T18:37:15.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.401+0000 7f09d3e00640 1 -- 172.21.15.192:0/694504591 wait complete. 2024-09-13T18:37:15.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.403+0000 7f09d3e00640 1 Processor -- start 2024-09-13T18:37:15.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.403+0000 7f09d3e00640 1 -- start start 2024-09-13T18:37:15.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.403+0000 7f09d3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc0b2780 0x7f09cc15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09cc146610 0x7f09cc15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc157ab0 con 0x7f09cc0afd80 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc15cec0 con 0x7f09cc0b2780 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09cc06f9a0 con 0x7f09cc146610 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59816/0 (socket says 172.21.15.192:59816) 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 -- 172.21.15.192:0/1843393864 learned_addr learned my addr 172.21.15.192:0/1843393864 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d0a00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc0b2780 0x7f09cc15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09cc146610 0x7f09cc15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 -- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09cc146610 msgr2=0x7f09cc15af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09cc146610 0x7f09cc15af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 -- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc0b2780 msgr2=0x7f09cc15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:15.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc0b2780 0x7f09cc15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 -- 172.21.15.192:0/1843393864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09c4009b30 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.404+0000 7f09d1400640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c450 tx=0x7f09c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.405+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c00052d0 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.405+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c0005430 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.405+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c0012870 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.405+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09cc06fc80 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.405+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09cc070240 con 0x7f09cc0afd80 2024-09-13T18:37:15.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.406+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09cc070400 con 0x7f09cc0afd80 2024-09-13T18:37:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.407+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f09c00129d0 con 0x7f09cc0afd80 2024-09-13T18:37:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.407+0000 7f09c9600640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 0x7f09ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.408+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f09c0088bd0 con 0x7f09cc0afd80 2024-09-13T18:37:15.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.408+0000 7f09d0a00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 0x7f09ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:15.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.408+0000 7f09d0a00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 0x7f09ac06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09cc071b60 tx=0x7f09b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:15.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.412+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f09c00540a0 con 0x7f09cc0afd80 2024-09-13T18:37:15.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:15.641+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f09cc1469f0 con 0x7f09cc0afd80 2024-09-13T18:37:16.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.520+0000 7f09c9600640 1 -- 172.21.15.192:0/1843393864 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v105) v1 ==== 145+0+0 (secure 0 0 0) 0x7f09c00576c0 con 0x7f09cc0afd80 2024-09-13T18:37:16.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 msgr2=0x7f09ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 0x7f09ac06d0c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f09cc071b60 tx=0x7f09b8009040 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 msgr2=0x7f09cc070e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f09c000c450 tx=0x7f09c000c910 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 shutdown_connections 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f09ac06ac00 0x7f09ac06d0c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f09cc146610 0x7f09cc15af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f09cc0b2780 0x7f09cc15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 --2- 172.21.15.192:0/1843393864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09cc0afd80 0x7f09cc070e20 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 >> 172.21.15.192:0/1843393864 conn(0x7f09cc0ae960 msgr2=0x7f09cc0ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 shutdown_connections 2024-09-13T18:37:16.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.523+0000 7f09d3e00640 1 -- 172.21.15.192:0/1843393864 wait complete. 2024-09-13T18:37:16.544 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-13T18:37:16.715 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_objectstore":"memstore"} 2024-09-13T18:37:16.715 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-13T18:37:16.716 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:37:16.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.869+0000 7f5a13600640 1 Processor -- start 2024-09-13T18:37:16.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.869+0000 7f5a13600640 1 -- start start 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.870+0000 7f5a13600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cdf60 0x7f5a0c0ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.870+0000 7f5a13600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.870+0000 7f5a13600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c15a8e0 con 0x7f5a0c0cb330 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.870+0000 7f5a13600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c0b2fe0 con 0x7f5a0c0b3470 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.870+0000 7f5a13600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0b26b0 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59828/0 (socket says 172.21.15.192:59828) 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 -- 172.21.15.192:0/3636616963 learned_addr learned my addr 172.21.15.192:0/3636616963 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:16.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a03e00640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cdf60 0x7f5a0c0ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 -- 172.21.15.192:0/3636616963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cdf60 msgr2=0x7f5a0c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:16.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cdf60 0x7f5a0c0ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 -- 172.21.15.192:0/3636616963 >> v1:172.21.15.194:6789/0 conn(0x7f5a0c0cb330 legacy=0x7f5a0c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.871+0000 7f5a11600640 1 -- 172.21.15.192:0/3636616963 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c0b2990 con 0x7f5a0c0b3470 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.872+0000 7f5a11600640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400d150 tx=0x7f5a0402c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d87a5fbf3275561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a0be00640 1 -- 172.21.15.192:0/3636616963 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04009600 con 0x7f5a0c0b3470 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a0be00640 1 -- 172.21.15.192:0/3636616963 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a04030050 con 0x7f5a0c0b3470 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a0be00640 1 -- 172.21.15.192:0/3636616963 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a040099a0 con 0x7f5a0c0b3470 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 -- 172.21.15.192:0/3636616963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0b3470 msgr2=0x7f5a0c0b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f5a0400d150 tx=0x7f5a0402c810 comp rx=0 tx=0).stop 2024-09-13T18:37:16.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 -- 172.21.15.192:0/3636616963 shutdown_connections 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c0b38a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 --2- 172.21.15.192:0/3636616963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cdf60 0x7f5a0c0ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 -- 172.21.15.192:0/3636616963 >> 172.21.15.192:0/3636616963 conn(0x7f5a0c0b08f0 msgr2=0x7f5a0c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 -- 172.21.15.192:0/3636616963 shutdown_connections 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.873+0000 7f5a13600640 1 -- 172.21.15.192:0/3636616963 wait complete. 2024-09-13T18:37:16.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.875+0000 7f5a13600640 1 Processor -- start 2024-09-13T18:37:16.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.875+0000 7f5a13600640 1 -- start start 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c13df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cb330 0x7f5a0c15aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c13e480 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c15cba0 con 0x7f5a0c0b3470 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a13600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c15ce80 con 0x7f5a0c0cb330 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a11600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a11600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59834/0 (socket says 172.21.15.192:59834) 2024-09-13T18:37:16.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a11600640 1 -- 172.21.15.192:0/1537339917 learned_addr learned my addr 172.21.15.192:0/1537339917 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:16.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a10c00640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c13df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.876+0000 7f5a03e00640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cb330 0x7f5a0c15aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 -- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cb330 msgr2=0x7f5a0c15aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cb330 0x7f5a0c15aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 -- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a0c0b3470 msgr2=0x7f5a0c13df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c13df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 -- 172.21.15.192:0/1537339917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0400bd40 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a11600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a04037040 tx=0x7f5a04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04004800 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0400b720 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a04009840 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c15d160 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.877+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c15d960 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.879+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c15d680 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.879+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a040099a0 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.880+0000 7f5a09600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 0x7f59e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:16.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.880+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a040aa0a0 con 0x7f5a0c0cdf60 2024-09-13T18:37:16.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.880+0000 7f5a10c00640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 0x7f59e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:16.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.881+0000 7f5a10c00640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 0x7f59e806d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59fc000f60 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:16.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:16.885+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a0c15d680 con 0x7f5a0c0cdf60 2024-09-13T18:37:17.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.052+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5a0c15d680 con 0x7f5a0c0cdf60 2024-09-13T18:37:17.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.057+0000 7f5a09600640 1 -- 172.21.15.192:0/1537339917 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5a0c15d680 con 0x7f5a0c0cdf60 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 msgr2=0x7f59e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 0x7f59e806d0c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f59fc000f60 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 msgr2=0x7f5a0c151ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a04037040 tx=0x7f5a04004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 shutdown_connections 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59e806ac00 0x7f59e806d0c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a0c0cdf60 0x7f5a0c151ff0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a0c0cb330 0x7f5a0c15aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 --2- 172.21.15.192:0/1537339917 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a0c0b3470 0x7f5a0c13df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 >> 172.21.15.192:0/1537339917 conn(0x7f5a0c0b08f0 msgr2=0x7f5a0c06b590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 shutdown_connections 2024-09-13T18:37:17.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.059+0000 7f5a13600640 1 -- 172.21.15.192:0/1537339917 wait complete. 2024-09-13T18:37:17.078 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:37:17.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:17.172 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:17.281 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:37:17.281 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:17.281 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:17.316 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:37:17.317 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:17.317 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:17.354 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:37:17.354 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:17.354 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:17.391 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:37:17.391 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:17.391 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:17.430 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:37:17.430 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:37:17.431 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:17.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.582+0000 7f8575000640 1 Processor -- start 2024-09-13T18:37:17.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.583+0000 7f8575000640 1 -- start start 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8575000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8570159b00 0x7f85700b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8575000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857015af60 con 0x7f857006bc30 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8575000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857015aa40 con 0x7f857015a5f0 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8575000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857006b7a0 con 0x7f8570159b00 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8566a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f857006bc30 0x7f8570159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44226/0 (socket says 172.21.15.192:44226) 2024-09-13T18:37:17.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f8566a00640 1 -- 172.21.15.192:0/27878004 learned_addr learned my addr 172.21.15.192:0/27878004 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.584+0000 7f856f400640 1 --2- 172.21.15.192:0/27878004 >> v2:172.21.15.194:3300/0 conn(0x7f8570159b00 0x7f85700b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4227795381 0 0) 0x7f857015af60 con 0x7f857006bc30 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8554003520 con 0x7f857006bc30 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 43673754 0 0) 0x7f8568001490 con 0x7f857015a5f0 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857015af60 con 0x7f857015a5f0 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856f400640 1 -- 172.21.15.192:0/27878004 >> v1:172.21.15.194:6789/0 conn(0x7f857015a5f0 legacy=0x7f85700cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856f400640 1 -- 172.21.15.192:0/27878004 >> v1:172.21.15.192:6789/0 conn(0x7f857006bc30 legacy=0x7f8570159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.585+0000 7f856f400640 1 -- 172.21.15.192:0/27878004 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857015ac80 con 0x7f8570159b00 2024-09-13T18:37:17.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.586+0000 7f856f400640 1 --2- 172.21.15.192:0/27878004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8570159b00 0x7f85700b2d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f85600097a0 tx=0x7f856002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d58dab0b39be1e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.586+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560032440 con 0x7f8570159b00 2024-09-13T18:37:17.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.586+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85600325a0 con 0x7f8570159b00 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.586+0000 7f856ea00640 1 -- 172.21.15.192:0/27878004 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560032930 con 0x7f8570159b00 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 -- 172.21.15.192:0/27878004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8570159b00 msgr2=0x7f85700b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 --2- 172.21.15.192:0/27878004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8570159b00 0x7f85700b2d70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f85600097a0 tx=0x7f856002a230 comp rx=0 tx=0).stop 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 -- 172.21.15.192:0/27878004 shutdown_connections 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 --2- 172.21.15.192:0/27878004 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8570159b00 0x7f85700b2d70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 -- 172.21.15.192:0/27878004 >> 172.21.15.192:0/27878004 conn(0x7f85700736d0 msgr2=0x7f85700b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 -- 172.21.15.192:0/27878004 shutdown_connections 2024-09-13T18:37:17.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.587+0000 7f8575000640 1 -- 172.21.15.192:0/27878004 wait complete. 2024-09-13T18:37:17.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.588+0000 7f8575000640 1 Processor -- start 2024-09-13T18:37:17.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 -- start start 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8570159b00 0x7f8570151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f857015a5f0 0x7f85700afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857006f580 con 0x7f857006bc30 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85701520c0 con 0x7f857015a5f0 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.589+0000 7f8575000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85701523a0 con 0x7f8570159b00 2024-09-13T18:37:17.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59836/0 (socket says 172.21.15.192:59836) 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 -- 172.21.15.192:0/3518697491 learned_addr learned my addr 172.21.15.192:0/3518697491 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f8566a00640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8570159b00 0x7f8570151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856fe00640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f857015a5f0 0x7f85700afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 -- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8570159b00 msgr2=0x7f8570151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8570159b00 0x7f8570151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 -- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f857015a5f0 msgr2=0x7f85700afe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f857015a5f0 0x7f85700afe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.590+0000 7f856f400640 1 -- 172.21.15.192:0/3518697491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560009400 con 0x7f857006bc30 2024-09-13T18:37:17.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f856f400640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8560035040 tx=0x7f85600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856003d8f0 con 0x7f857006bc30 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856003da70 con 0x7f857006bc30 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8570157800 con 0x7f857006bc30 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856003de20 con 0x7f857006bc30 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.591+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8570151d40 con 0x7f857006bc30 2024-09-13T18:37:17.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.592+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8570157660 con 0x7f857006bc30 2024-09-13T18:37:17.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.593+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8560039040 con 0x7f857006bc30 2024-09-13T18:37:17.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.594+0000 7f8567e00640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 0x7f854c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:17.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.594+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85600a96a0 con 0x7f857006bc30 2024-09-13T18:37:17.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.594+0000 7f8566a00640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 0x7f854c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:17.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.595+0000 7f8566a00640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 0x7f854c06d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85701e4af0 tx=0x7f8558007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:17.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.598+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8570157660 con 0x7f857006bc30 2024-09-13T18:37:17.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.798+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8570157660 con 0x7f857006bc30 2024-09-13T18:37:17.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.798+0000 7f8567e00640 1 -- 172.21.15.192:0/3518697491 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f8570157660 con 0x7f857006bc30 2024-09-13T18:37:17.801 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:17.801 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":18,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5017,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3724104737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3724104737},{"type":"v1","addr":"172.21.15.192:6837","nonce":3724104737}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5020,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3012306118","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3012306118},{"type":"v1","addr":"172.21.15.194:6834","nonce":3012306118}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5023,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1808300275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1808300275},{"type":"v1","addr":"172.21.15.194:6835","nonce":1808300275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5511,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/715771634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":715771634},{"type":"v1","addr":"172.21.15.192:6836","nonce":715771634}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[]} 2024-09-13T18:37:17.802 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 18 2024-09-13T18:37:17.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 msgr2=0x7f854c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 0x7f854c06d0c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f85701e4af0 tx=0x7f8558007d70 comp rx=0 tx=0).stop 2024-09-13T18:37:17.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 msgr2=0x7f857014c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:17.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8560035040 tx=0x7f85600046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 shutdown_connections 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f854c06ac00 0x7f854c06d0c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f857015a5f0 0x7f85700afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8570159b00 0x7f8570151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 --2- 172.21.15.192:0/3518697491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f857006bc30 0x7f857014c260 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 >> 172.21.15.192:0/3518697491 conn(0x7f85700736d0 msgr2=0x7f857015d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.800+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 shutdown_connections 2024-09-13T18:37:17.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:17.801+0000 7f8575000640 1 -- 172.21.15.192:0/3518697491 wait complete. 2024-09-13T18:37:17.819 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:37:17.819 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:37:17.819 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:37:17.819 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:17.820 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:37:17.820 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:37:17.820 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:37:17.820 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:17.820 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:37:17.820 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:37:17.821 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:37:17.821 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:17.821 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:37:17.821 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:37:17.821 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:37:17.821 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:37:17.836 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:37:17.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:37:17.838 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:37:17.838 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:37:17.839 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:37:17.840 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:37:17.841 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:37:17.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:37:17.881 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:37:17.882 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:17.884 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:37:17.884 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:37:17.884 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:17.884 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:17.886 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:37:17.886 DEBUG:teuthology.parallel:result is None 2024-09-13T18:37:17.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:37:18.011 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:37:18.012 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:37:18.014 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:37:18.015 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:37:18.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.049+0000 7f87faa00640 1 Processor -- start 2024-09-13T18:37:18.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.049+0000 7f87faa00640 1 -- start start 2024-09-13T18:37:18.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87faa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87f4146610 0x7f87f40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87faa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 0x7f87f40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87faa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f40adf50 con 0x7f87f40b2780 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87faa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40cd920 con 0x7f87f40afd80 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87faa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f40b0730 con 0x7f87f4146610 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87f8a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 0x7f87f40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.050+0000 7f87f3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87f4146610 0x7f87f40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87f4146610 0x7f87f40ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:53136/0 (socket says 172.21.15.192:53136) 2024-09-13T18:37:18.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 -- 172.21.15.192:0/1187718626 learned_addr learned my addr 172.21.15.192:0/1187718626 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 -- 172.21.15.192:0/1187718626 >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 msgr2=0x7f87f40b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 --2- 172.21.15.192:0/1187718626 >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 0x7f87f40b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 -- 172.21.15.192:0/1187718626 >> v1:172.21.15.192:6789/0 conn(0x7f87f40b2780 legacy=0x7f87f40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f3e00640 1 -- 172.21.15.192:0/1187718626 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f40ae770 con 0x7f87f4146610 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.051+0000 7f87f8a00640 1 --2- 172.21.15.192:0/1187718626 >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 0x7f87f40b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:18.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.052+0000 7f87f3e00640 1 --2- 172.21.15.192:0/1187718626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4146610 0x7f87f40ce2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009870 tx=0x7f87e402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65906bd842f064dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.054+0000 7f87f2a00640 1 -- 172.21.15.192:0/1187718626 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4032440 con 0x7f87f4146610 2024-09-13T18:37:18.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.054+0000 7f87f2a00640 1 -- 172.21.15.192:0/1187718626 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e40325a0 con 0x7f87f4146610 2024-09-13T18:37:18.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.054+0000 7f87f2a00640 1 -- 172.21.15.192:0/1187718626 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e4032930 con 0x7f87f4146610 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 -- 172.21.15.192:0/1187718626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4146610 msgr2=0x7f87f40ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 --2- 172.21.15.192:0/1187718626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4146610 0x7f87f40ce2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f87e4009870 tx=0x7f87e402a230 comp rx=0 tx=0).stop 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 -- 172.21.15.192:0/1187718626 shutdown_connections 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 --2- 172.21.15.192:0/1187718626 >> v2:172.21.15.192:3300/0 conn(0x7f87f40afd80 0x7f87f40b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 --2- 172.21.15.192:0/1187718626 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f4146610 0x7f87f40ce2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 -- 172.21.15.192:0/1187718626 >> 172.21.15.192:0/1187718626 conn(0x7f87f40ae960 msgr2=0x7f87f406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 -- 172.21.15.192:0/1187718626 shutdown_connections 2024-09-13T18:37:18.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.055+0000 7f87faa00640 1 -- 172.21.15.192:0/1187718626 wait complete. 2024-09-13T18:37:18.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.057+0000 7f87faa00640 1 Processor -- start 2024-09-13T18:37:18.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.057+0000 7f87faa00640 1 -- start start 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 0x7f87f4070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 0x7f87f4071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4158a30 con 0x7f87f4146610 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4159430 con 0x7f87f40b2780 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87faa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f4159710 con 0x7f87f40afd80 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 0x7f87f4071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 0x7f87f4071000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59882/0 (socket says 172.21.15.192:59882) 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f8a00640 1 -- 172.21.15.192:0/3263571601 learned_addr learned my addr 172.21.15.192:0/3263571601 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3e00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:55780/0 (socket says 172.21.15.192:55780) 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 0x7f87f4070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 -- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 msgr2=0x7f87f413a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 -- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 msgr2=0x7f87f4071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 0x7f87f4071000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3400640 1 -- 172.21.15.192:0/3263571601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009a70 con 0x7f87f40b2780 2024-09-13T18:37:18.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.058+0000 7f87f3e00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:18.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87f3400640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 0x7f87f4070ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c310 tx=0x7f87e000c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e00052d0 con 0x7f87f40b2780 2024-09-13T18:37:18.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0005450 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e40094d0 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0007260 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.059+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f4159cd0 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f41469f0 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.061+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f87e00073c0 con 0x7f87f40b2780 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.062+0000 7f87ebe00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 0x7f87d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:18.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.062+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87e0088370 con 0x7f87f40b2780 2024-09-13T18:37:18.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.062+0000 7f87f3e00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 0x7f87d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:18.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.063+0000 7f87f3e00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 0x7f87d406d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87e4034000 tx=0x7f87e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.067+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87e0053860 con 0x7f87f40b2780 2024-09-13T18:37:18.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:18.244+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f87f4159570 con 0x7f87f40b2780 2024-09-13T18:37:19.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.057+0000 7f87ebe00640 1 -- 172.21.15.192:0/3263571601 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v45) v1 ==== 97+0+0 (secure 0 0 0) 0x7f87f4159570 con 0x7f87f40b2780 2024-09-13T18:37:19.060 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 msgr2=0x7f87d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 0x7f87d406d0c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87e4034000 tx=0x7f87e402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 msgr2=0x7f87f4070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 0x7f87f4070ac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c310 tx=0x7f87e000c7d0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 shutdown_connections 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f87d406ac00 0x7f87d406d0c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87f4146610 0x7f87f4071000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87f40b2780 0x7f87f4070ac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 --2- 172.21.15.192:0/3263571601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87f40afd80 0x7f87f413a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 >> 172.21.15.192:0/3263571601 conn(0x7f87f40ae960 msgr2=0x7f87f415e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 shutdown_connections 2024-09-13T18:37:19.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.060+0000 7f87faa00640 1 -- 172.21.15.192:0/3263571601 wait complete. 2024-09-13T18:37:19.081 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:37:19.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.232+0000 7f6427a00640 1 Processor -- start 2024-09-13T18:37:19.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.232+0000 7f6427a00640 1 -- start start 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.233+0000 7f6427a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.233+0000 7f6427a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.233+0000 7f6427a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6420140480 con 0x7f64200cb0b0 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6427a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64200cb520 con 0x7f64200cacd0 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6427a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642015ee90 con 0x7f642015bc20 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6425a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6425000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6425000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:53146/0 (socket says 172.21.15.192:53146) 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6425a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:55796/0 (socket says 172.21.15.192:55796) 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6425000640 1 -- 172.21.15.192:0/4010213900 learned_addr learned my addr 172.21.15.192:0/4010213900 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:19.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f6417e00640 1 --1- 172.21.15.192:0/4010213900 >> v1:172.21.15.194:6789/0 conn(0x7f64200cb0b0 0x7f6420140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:42238/0 (socket says 172.21.15.192:42238) 2024-09-13T18:37:19.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.234+0000 7f641fe00640 1 -- 172.21.15.192:0/4010213900 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254782838 0 0) 0x7f6420140480 con 0x7f64200cb0b0 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f641fe00640 1 -- 172.21.15.192:0/4010213900 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6404003520 con 0x7f64200cb0b0 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f6425a00640 1 -- 172.21.15.192:0/4010213900 >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 msgr2=0x7f642015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f6425a00640 1 --2- 172.21.15.192:0/4010213900 >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f6425a00640 1 -- 172.21.15.192:0/4010213900 >> v1:172.21.15.194:6789/0 conn(0x7f64200cb0b0 legacy=0x7f6420140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f6425a00640 1 -- 172.21.15.192:0/4010213900 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642015f170 con 0x7f642015bc20 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.235+0000 7f6425000640 1 --2- 172.21.15.192:0/4010213900 >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6425a00640 1 --2- 172.21.15.192:0/4010213900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6418009d90 tx=0x7f641802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a462ad9f036142c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f641fe00640 1 -- 172.21.15.192:0/4010213900 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418007740 con 0x7f642015bc20 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f641fe00640 1 -- 172.21.15.192:0/4010213900 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641802d050 con 0x7f642015bc20 2024-09-13T18:37:19.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f641fe00640 1 -- 172.21.15.192:0/4010213900 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6418007aa0 con 0x7f642015bc20 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 -- 172.21.15.192:0/4010213900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 msgr2=0x7f64200afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 --2- 172.21.15.192:0/4010213900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6418009d90 tx=0x7f641802a660 comp rx=0 tx=0).stop 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 -- 172.21.15.192:0/4010213900 shutdown_connections 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 --2- 172.21.15.192:0/4010213900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f642015bc20 0x7f64200afd80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 --2- 172.21.15.192:0/4010213900 >> v2:172.21.15.194:3300/0 conn(0x7f64200cacd0 0x7f642015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.236+0000 7f6427a00640 1 -- 172.21.15.192:0/4010213900 >> 172.21.15.192:0/4010213900 conn(0x7f64200ae960 msgr2=0x7f642006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.237+0000 7f6427a00640 1 -- 172.21.15.192:0/4010213900 shutdown_connections 2024-09-13T18:37:19.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.237+0000 7f6427a00640 1 -- 172.21.15.192:0/4010213900 wait complete. 2024-09-13T18:37:19.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.238+0000 7f6427a00640 1 Processor -- start 2024-09-13T18:37:19.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.238+0000 7f6427a00640 1 -- start start 2024-09-13T18:37:19.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64200cacd0 0x7f642013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64200cb0b0 0x7f642015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201e5260 con 0x7f642015bc20 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64201e4650 con 0x7f64200cb0b0 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6427a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64201e4930 con 0x7f64200cacd0 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6425a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6425a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59892/0 (socket says 172.21.15.192:59892) 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6425000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64200cacd0 0x7f642013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6425a00640 1 -- 172.21.15.192:0/1444704893 learned_addr learned my addr 172.21.15.192:0/1444704893 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.239+0000 7f6417e00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64200cb0b0 0x7f642015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 -- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64200cacd0 msgr2=0x7f642013cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64200cacd0 0x7f642013cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 -- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64200cb0b0 msgr2=0x7f642015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64200cb0b0 0x7f642015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 -- 172.21.15.192:0/1444704893 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64100094d0 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6425a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6418009eb0 tx=0x7f6418004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641803c830 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641803c9b0 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.240+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6418009a70 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.241+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641803cd60 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.241+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64201e4ef0 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.242+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64201e53d0 con 0x7f642015bc20 2024-09-13T18:37:19.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.242+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6418031400 con 0x7f642015bc20 2024-09-13T18:37:19.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.243+0000 7f641d600640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 0x7f63fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.243+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f64180aa790 con 0x7f642015bc20 2024-09-13T18:37:19.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.243+0000 7f6425000640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 0x7f63fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.244+0000 7f6425000640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 0x7f63fc06d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6410006ca0 tx=0x7f6410012040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.247+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6418075c40 con 0x7f642015bc20 2024-09-13T18:37:19.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.480+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f642015e790 con 0x7f642015bc20 2024-09-13T18:37:19.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.480+0000 7f641d600640 1 -- 172.21.15.192:0/1444704893 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6418079260 con 0x7f642015bc20 2024-09-13T18:37:19.483 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:19.483 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.484 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:37:19.485 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:37:19.486 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.487 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.488 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.489 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.490 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:37:19.491 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:37:19.492 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:37:19.493 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:37:19.494 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.495 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:37:19.496 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:19.497 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 msgr2=0x7f63fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 0x7f63fc06d0c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6410006ca0 tx=0x7f6410012040 comp rx=0 tx=0).stop 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 msgr2=0x7f642015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6418009eb0 tx=0x7f6418004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 shutdown_connections 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f63fc06ac00 0x7f63fc06d0c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f642015bc20 0x7f642015a860 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f64200cb0b0 0x7f642015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 --2- 172.21.15.192:0/1444704893 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f64200cacd0 0x7f642013cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 >> 172.21.15.192:0/1444704893 conn(0x7f64200ae960 msgr2=0x7f642013e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 shutdown_connections 2024-09-13T18:37:19.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.483+0000 7f6427a00640 1 -- 172.21.15.192:0/1444704893 wait complete. 2024-09-13T18:37:19.502 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.652+0000 7f0cfbc00640 1 Processor -- start 2024-09-13T18:37:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.652+0000 7f0cfbc00640 1 -- start start 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.653+0000 7f0cfbc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0cf415dee0 0x7f0cf40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.653+0000 7f0cfbc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40b2f00 con 0x7f0cf415e2c0 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cfbc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40b3150 con 0x7f0cf40b3f10 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cfbc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40b3430 con 0x7f0cf415dee0 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf9c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0cf415e2c0 0x7f0cf41637e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44242/0 (socket says 172.21.15.192:44242) 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf9c00640 1 -- 172.21.15.192:0/3276713400 learned_addr learned my addr 172.21.15.192:0/3276713400 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf9200640 1 --2- 172.21.15.192:0/3276713400 >> v2:172.21.15.194:3300/0 conn(0x7f0cf415dee0 0x7f0cf40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1441740411 0 0) 0x7f0cf40b2f00 con 0x7f0cf415e2c0 2024-09-13T18:37:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd8003520 con 0x7f0cf415e2c0 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3168613020 0 0) 0x7f0cd8003520 con 0x7f0cf415e2c0 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 >> v2:172.21.15.194:3300/0 conn(0x7f0cf415dee0 msgr2=0x7f0cf40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 --2- 172.21.15.192:0/3276713400 >> v2:172.21.15.194:3300/0 conn(0x7f0cf415dee0 0x7f0cf40afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.654+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 >> v1:172.21.15.194:6789/0 conn(0x7f0cf40b3f10 legacy=0x7f0cf415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40b3710 con 0x7f0cf415e2c0 2024-09-13T18:37:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f0cec0019f0 con 0x7f0cf415e2c0 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 >> v1:172.21.15.192:6789/0 conn(0x7f0cf415e2c0 legacy=0x7f0cf41637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cd80047c0 0x7f0cd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd8005180 0x7f0cd800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40b3430 con 0x7f0cd8003970 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd800e230 con 0x7f0cd8005180 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd800e3f0 con 0x7f0cd80047c0 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cebe00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cd80047c0 0x7f0cd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9c00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd8005180 0x7f0cd800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 -- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cd80047c0 msgr2=0x7f0cd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cd80047c0 0x7f0cd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 -- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd8005180 msgr2=0x7f0cd800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd8005180 0x7f0cd800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9200640 1 -- 172.21.15.192:0/3276713400 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd8003520 con 0x7f0cd8003970 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9c00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cd8005180 0x7f0cd800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.655+0000 7f0cf9c00640 1 -- 172.21.15.192:0/3276713400 reap_dead start 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.656+0000 7f0cf9200640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cd8003d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009ac0 tx=0x7f0cd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1b0b3ada909724a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4031400 con 0x7f0cd8003970 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce402d050 con 0x7f0cd8003970 2024-09-13T18:37:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cf3e00640 1 -- 172.21.15.192:0/3276713400 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4031780 con 0x7f0cd8003970 2024-09-13T18:37:19.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 -- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 msgr2=0x7f0cd8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cd8003d90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4009ac0 tx=0x7f0cd80057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 -- 172.21.15.192:0/3276713400 shutdown_connections 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/3276713400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cd8003d90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 -- 172.21.15.192:0/3276713400 >> 172.21.15.192:0/3276713400 conn(0x7f0cf40ae960 msgr2=0x7f0cf406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 -- 172.21.15.192:0/3276713400 shutdown_connections 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.657+0000 7f0cfbc00640 1 -- 172.21.15.192:0/3276713400 wait complete. 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.659+0000 7f0cfbc00640 1 Processor -- start 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.659+0000 7f0cfbc00640 1 -- start start 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cf4136a60 0x7f0cf413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cf4136ee0 0x7f0cf406a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41376e0 con 0x7f0cd8003970 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4143370 con 0x7f0cf4136a60 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cfbc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf413f850 con 0x7f0cf4136ee0 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cf9200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cf9200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59910/0 (socket says 172.21.15.192:59910) 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cf9200640 1 -- 172.21.15.192:0/1700226311 learned_addr learned my addr 172.21.15.192:0/1700226311 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cf9c00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cf4136ee0 0x7f0cf406a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.660+0000 7f0cebe00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cf4136a60 0x7f0cf413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 -- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cf4136ee0 msgr2=0x7f0cf406a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cf4136ee0 0x7f0cf406a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 -- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cf4136a60 msgr2=0x7f0cf413df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cf4136a60 0x7f0cf413df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 -- 172.21.15.192:0/1700226311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf413fb30 con 0x7f0cd8003970 2024-09-13T18:37:19.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf9200640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0ce402aae0 tx=0x7f0ce4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40044e0 con 0x7f0cd8003970 2024-09-13T18:37:19.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce403b400 con 0x7f0cd8003970 2024-09-13T18:37:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf413fe10 con 0x7f0cd8003970 2024-09-13T18:37:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce403b770 con 0x7f0cd8003970 2024-09-13T18:37:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.661+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf413e4d0 con 0x7f0cd8003970 2024-09-13T18:37:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.662+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf413dc00 con 0x7f0cd8003970 2024-09-13T18:37:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.663+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ce403b8d0 con 0x7f0cd8003970 2024-09-13T18:37:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.664+0000 7f0cf1600640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 0x7f0cd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.664+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ce40a9280 con 0x7f0cd8003970 2024-09-13T18:37:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.665+0000 7f0cebe00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 0x7f0cd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.665+0000 7f0cebe00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 0x7f0cd006d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc000c00 tx=0x7f0cdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:19.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.669+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0ce4074860 con 0x7f0cd8003970 2024-09-13T18:37:19.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.839+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cf40b0410 con 0x7f0cd8003970 2024-09-13T18:37:19.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.840+0000 7f0cf1600640 1 -- 172.21.15.192:0/1700226311 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+12917 (secure 0 0 0) 0x7f0ce4077e80 con 0x7f0cd8003970 2024-09-13T18:37:19.843 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:19.843 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":45,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:19.053681+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 msgr2=0x7f0cd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 0x7f0cd006d0c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc000c00 tx=0x7f0cdc009040 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 msgr2=0x7f0cf41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0ce402aae0 tx=0x7f0ce4004730 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 shutdown_connections 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0cd006ac00 0x7f0cd006d0c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cf4136ee0 0x7f0cf406a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cf4136a60 0x7f0cf413df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 --2- 172.21.15.192:0/1700226311 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cd8003970 0x7f0cf41402e0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 >> 172.21.15.192:0/1700226311 conn(0x7f0cf40ae960 msgr2=0x7f0cf40ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:19.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 shutdown_connections 2024-09-13T18:37:19.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:19.843+0000 7f0cfbc00640 1 -- 172.21.15.192:0/1700226311 wait complete. 2024-09-13T18:37:19.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:19.862 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:20.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.014+0000 7fb900c00640 1 Processor -- start 2024-09-13T18:37:20.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.014+0000 7fb900c00640 1 -- start start 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8fc1589f0 0x7fb8fc0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8fc0b3af0 0x7fb8fc15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc06c0b0 0x7fb8fc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc06ca80 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8fc0b2000 con 0x7fb8fc1589f0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb900c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc15bbd0 con 0x7fb8fc06c0b0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb8f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8fc0b3af0 0x7fb8fc15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb8f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8fc0b3af0 0x7fb8fc15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59914/0 (socket says 172.21.15.192:59914) 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.015+0000 7fb8f3e00640 1 -- 172.21.15.192:0/1269051643 learned_addr learned my addr 172.21.15.192:0/1269051643 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f9e00640 1 --2- 172.21.15.192:0/1269051643 >> v2:172.21.15.194:3300/0 conn(0x7fb8fc1589f0 0x7fb8fc0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8fa800640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc06c0b0 0x7fb8fc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f3e00640 1 -- 172.21.15.192:0/1269051643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc06c0b0 msgr2=0x7fb8fc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:20.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f3e00640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc06c0b0 0x7fb8fc06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f3e00640 1 -- 172.21.15.192:0/1269051643 >> v2:172.21.15.194:3300/0 conn(0x7fb8fc1589f0 msgr2=0x7fb8fc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:20.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f3e00640 1 --2- 172.21.15.192:0/1269051643 >> v2:172.21.15.194:3300/0 conn(0x7fb8fc1589f0 0x7fb8fc0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.016+0000 7fb8f3e00640 1 -- 172.21.15.192:0/1269051643 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc15beb0 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.017+0000 7fb8f3e00640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc0b3af0 0x7fb8fc15b260 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06e230 tx=0x7fb8e402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ec7179b66af2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.017+0000 7fb8f9400640 1 -- 172.21.15.192:0/1269051643 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4032440 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.017+0000 7fb8f9400640 1 -- 172.21.15.192:0/1269051643 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e40325a0 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.017+0000 7fb8f9400640 1 -- 172.21.15.192:0/1269051643 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e4032930 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 -- 172.21.15.192:0/1269051643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc0b3af0 msgr2=0x7fb8fc15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc0b3af0 0x7fb8fc15b260 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc06e230 tx=0x7fb8e402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 -- 172.21.15.192:0/1269051643 shutdown_connections 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc06c0b0 0x7fb8fc06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 --2- 172.21.15.192:0/1269051643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc0b3af0 0x7fb8fc15b260 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 --2- 172.21.15.192:0/1269051643 >> v2:172.21.15.194:3300/0 conn(0x7fb8fc1589f0 0x7fb8fc0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 -- 172.21.15.192:0/1269051643 >> 172.21.15.192:0/1269051643 conn(0x7fb8fc0b08f0 msgr2=0x7fb8fc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 -- 172.21.15.192:0/1269051643 shutdown_connections 2024-09-13T18:37:20.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.018+0000 7fb900c00640 1 -- 172.21.15.192:0/1269051643 wait complete. 2024-09-13T18:37:20.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.019+0000 7fb900c00640 1 Processor -- start 2024-09-13T18:37:20.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 -- start start 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8fc06c0b0 0x7fb8fc147200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc0b3af0 0x7fb8fc155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc148b20 con 0x7fb8fc1589f0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc147f10 con 0x7fb8fc06c0b0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.020+0000 7fb900c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8fc1481f0 con 0x7fb8fc0b3af0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59918/0 (socket says 172.21.15.192:59918) 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 -- 172.21.15.192:0/2699540385 learned_addr learned my addr 172.21.15.192:0/2699540385 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8f9e00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8fc06c0b0 0x7fb8fc147200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8f3e00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc0b3af0 0x7fb8fc155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 -- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc0b3af0 msgr2=0x7fb8fc155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc0b3af0 0x7fb8fc155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 -- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8fc06c0b0 msgr2=0x7fb8fc147200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8fc06c0b0 0x7fb8fc147200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 -- 172.21.15.192:0/2699540385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40094d0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.021+0000 7fb8fa800640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4007d20 tx=0x7fb8f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.022+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4014420 con 0x7fb8fc1589f0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.022+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8f40145a0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.022+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8fc1484d0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.022+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8f4014950 con 0x7fb8fc1589f0 2024-09-13T18:37:20.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.022+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8fc147740 con 0x7fb8fc1589f0 2024-09-13T18:37:20.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.023+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8fc148c90 con 0x7fb8fc1589f0 2024-09-13T18:37:20.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.024+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8f4014ab0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.024+0000 7fb8f2000640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 0x7fb8d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.025+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8f40897c0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.025+0000 7fb8f9e00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 0x7fb8d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.025+0000 7fb8f9e00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 0x7fb8d806d0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006fd0 tx=0x7fb8ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.029+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8f4054d00 con 0x7fb8fc1589f0 2024-09-13T18:37:20.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.193+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb8fc0ce0f0 con 0x7fb8fc1589f0 2024-09-13T18:37:20.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.194+0000 7fb8f2000640 1 -- 172.21.15.192:0/2699540385 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v45) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb8f4058320 con 0x7fb8fc1589f0 2024-09-13T18:37:20.197 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:20.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 msgr2=0x7fb8d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 0x7fb8d806d0f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb8ec006fd0 tx=0x7fb8ec008040 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 msgr2=0x7fb8fc0c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb8f4007d20 tx=0x7fb8f400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 shutdown_connections 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8d806ac30 0x7fb8d806d0f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8fc1589f0 0x7fb8fc0c3b60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8fc0b3af0 0x7fb8fc155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 --2- 172.21.15.192:0/2699540385 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8fc06c0b0 0x7fb8fc147200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.196+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 >> 172.21.15.192:0/2699540385 conn(0x7fb8fc0b08f0 msgr2=0x7fb8fc0af9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.197+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 shutdown_connections 2024-09-13T18:37:20.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.197+0000 7fb900c00640 1 -- 172.21.15.192:0/2699540385 wait complete. 2024-09-13T18:37:20.215 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:37:20.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.363+0000 7f07b6600640 1 Processor -- start 2024-09-13T18:37:20.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.364+0000 7f07b6600640 1 -- start start 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 0x7f07b006bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b6600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07b00b2590 0x7f07b00b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b6600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b00b2100 con 0x7f07b015ad10 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b6600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b006c250 con 0x7f07b00b2590 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0150f10 con 0x7f07b006b8d0 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07b00b2590 0x7f07b00b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f07b00b2590 0x7f07b00b2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44600/0 (socket says 172.21.15.192:44600) 2024-09-13T18:37:20.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b5c00640 1 -- 172.21.15.192:0/3258352592 learned_addr learned my addr 172.21.15.192:0/3258352592 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07a7e00640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 0x7f07b006bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.365+0000 7f07b5c00640 1 -- 172.21.15.192:0/3258352592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 msgr2=0x7f07b006bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:20.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.366+0000 7f07b5c00640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 0x7f07b006bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.366+0000 7f07b5c00640 1 -- 172.21.15.192:0/3258352592 >> v1:172.21.15.192:6789/0 conn(0x7f07b015ad10 legacy=0x7f07b0069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.366+0000 7f07b5c00640 1 -- 172.21.15.192:0/3258352592 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b015a2c0 con 0x7f07b00b2590 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.366+0000 7f07a7e00640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 0x7f07b006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b5c00640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00b2590 0x7f07b00b2a40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1468e71594c0457 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07afe00640 1 -- 172.21.15.192:0/3258352592 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8031600 con 0x7f07b00b2590 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07afe00640 1 -- 172.21.15.192:0/3258352592 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a802d050 con 0x7f07b00b2590 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07afe00640 1 -- 172.21.15.192:0/3258352592 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a8031980 con 0x7f07b00b2590 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 -- 172.21.15.192:0/3258352592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00b2590 msgr2=0x7f07b00b2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00b2590 0x7f07b00b2a40 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f07a8009e50 tx=0x7f07a802a710 comp rx=0 tx=0).stop 2024-09-13T18:37:20.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 -- 172.21.15.192:0/3258352592 shutdown_connections 2024-09-13T18:37:20.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b00b2590 0x7f07b00b2a40 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 --2- 172.21.15.192:0/3258352592 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b006b8d0 0x7f07b006bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 -- 172.21.15.192:0/3258352592 >> 172.21.15.192:0/3258352592 conn(0x7f07b00b09f0 msgr2=0x7f07b00b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 -- 172.21.15.192:0/3258352592 shutdown_connections 2024-09-13T18:37:20.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.367+0000 7f07b6600640 1 -- 172.21.15.192:0/3258352592 wait complete. 2024-09-13T18:37:20.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.369+0000 7f07b6600640 1 Processor -- start 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.369+0000 7f07b6600640 1 -- start start 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 0x7f07b00714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07b015ad10 0x7f07b00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c4850 con 0x7f07b006b8d0 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c3c60 con 0x7f07b015ad10 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b014f720 con 0x7f07b00b2590 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44610/0 (socket says 172.21.15.192:44610) 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b5200640 1 -- 172.21.15.192:0/2224616496 learned_addr learned my addr 172.21.15.192:0/2224616496 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07a7e00640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 0x7f07b00714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.370+0000 7f07b5c00640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07b015ad10 0x7f07b00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 -- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 msgr2=0x7f07b00714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 0x7f07b00714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 -- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07b015ad10 msgr2=0x7f07b00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07b015ad10 0x7f07b00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 -- 172.21.15.192:0/2224616496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a8009b30 con 0x7f07b006b8d0 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07a7e00640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 0x7f07b00714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:20.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b5200640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c400 tx=0x7f07a000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00052d0 con 0x7f07b006b8d0 2024-09-13T18:37:20.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a0005430 con 0x7f07b006b8d0 2024-09-13T18:37:20.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00c3f20 con 0x7f07b006b8d0 2024-09-13T18:37:20.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0003830 con 0x7f07b006b8d0 2024-09-13T18:37:20.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.371+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b00c44e0 con 0x7f07b006b8d0 2024-09-13T18:37:20.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.373+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b00c46a0 con 0x7f07b006b8d0 2024-09-13T18:37:20.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.373+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07a0003990 con 0x7f07b006b8d0 2024-09-13T18:37:20.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.374+0000 7f07ad600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 0x7f078c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.374+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f07a00885a0 con 0x7f07b006b8d0 2024-09-13T18:37:20.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.374+0000 7f07a7e00640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 0x7f078c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.375+0000 7f07a7e00640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 0x7f078c06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f07b00703d0 tx=0x7f0798008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.379+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f07a0053ae0 con 0x7f07b006b8d0 2024-09-13T18:37:20.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.551+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f07b006bd10 con 0x7f07b006b8d0 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.552+0000 7f07ad600640 1 -- 172.21.15.192:0/2224616496 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v45) v1 ==== 84+0+65 (secure 0 0 0) 0x7f07a0017060 con 0x7f07b006b8d0 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:20.555 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:37:20.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 msgr2=0x7f078c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 0x7f078c06d0c0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f07b00703d0 tx=0x7f0798008040 comp rx=0 tx=0).stop 2024-09-13T18:37:20.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 msgr2=0x7f07b014f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f07a000c400 tx=0x7f07a000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 shutdown_connections 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f078c06ac00 0x7f078c06d0c0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07b015ad10 0x7f07b00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f07b00b2590 0x7f07b00714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 --2- 172.21.15.192:0/2224616496 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07b006b8d0 0x7f07b014f1e0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 >> 172.21.15.192:0/2224616496 conn(0x7f07b00b09f0 msgr2=0x7f07b0069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 shutdown_connections 2024-09-13T18:37:20.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.554+0000 7f07b6600640 1 -- 172.21.15.192:0/2224616496 wait complete. 2024-09-13T18:37:20.573 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:37:20.573 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:37:20.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.727+0000 7ff410a00640 1 Processor -- start 2024-09-13T18:37:20.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.727+0000 7ff410a00640 1 -- start start 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff40c071b80 0x7ff40c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff40c1403e0 0x7ff40c070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c071100 0x7ff40c0cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c13e0f0 con 0x7ff40c071b80 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff40c06a330 con 0x7ff40c1403e0 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.728+0000 7ff410a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c15f840 con 0x7ff40c071100 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff40c071b80 0x7ff40c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff40c071b80 0x7ff40c15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44622/0 (socket says 172.21.15.192:44622) 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 -- 172.21.15.192:0/447018801 learned_addr learned my addr 172.21.15.192:0/447018801 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff40a800640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c071100 0x7ff40c0cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff401400640 1 --2- 172.21.15.192:0/447018801 >> v2:172.21.15.194:3300/0 conn(0x7ff40c1403e0 0x7ff40c070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 -- 172.21.15.192:0/447018801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c071100 msgr2=0x7ff40c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c071100 0x7ff40c0cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 -- 172.21.15.192:0/447018801 >> v2:172.21.15.194:3300/0 conn(0x7ff40c1403e0 msgr2=0x7ff40c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 --2- 172.21.15.192:0/447018801 >> v2:172.21.15.194:3300/0 conn(0x7ff40c1403e0 0x7ff40c070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.729+0000 7ff409e00640 1 -- 172.21.15.192:0/447018801 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c15b300 con 0x7ff40c071b80 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.730+0000 7ff409e00640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c15f300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0cb750 tx=0x7ff3fc02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06edcedfb1d0d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.730+0000 7ff409400640 1 -- 172.21.15.192:0/447018801 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc032440 con 0x7ff40c071b80 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.730+0000 7ff409400640 1 -- 172.21.15.192:0/447018801 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0325a0 con 0x7ff40c071b80 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.730+0000 7ff409400640 1 -- 172.21.15.192:0/447018801 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc032930 con 0x7ff40c071b80 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 -- 172.21.15.192:0/447018801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 msgr2=0x7ff40c15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c15f300 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff40c0cb750 tx=0x7ff3fc02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 -- 172.21.15.192:0/447018801 shutdown_connections 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c071100 0x7ff40c0cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 --2- 172.21.15.192:0/447018801 >> v2:172.21.15.194:3300/0 conn(0x7ff40c1403e0 0x7ff40c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 --2- 172.21.15.192:0/447018801 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c15f300 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 -- 172.21.15.192:0/447018801 >> 172.21.15.192:0/447018801 conn(0x7ff40c0b0c40 msgr2=0x7ff40c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 -- 172.21.15.192:0/447018801 shutdown_connections 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.731+0000 7ff410a00640 1 -- 172.21.15.192:0/447018801 wait complete. 2024-09-13T18:37:20.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.733+0000 7ff410a00640 1 Processor -- start 2024-09-13T18:37:20.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.733+0000 7ff410a00640 1 -- start start 2024-09-13T18:37:20.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff40c071100 0x7ff40c0c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c1403e0 0x7ff40c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c5850 con 0x7ff40c071b80 2024-09-13T18:37:20.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c4350 con 0x7ff40c071100 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff410a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c0c3d70 con 0x7ff40c1403e0 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44626/0 (socket says 172.21.15.192:44626) 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 -- 172.21.15.192:0/765351457 learned_addr learned my addr 172.21.15.192:0/765351457 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff40a800640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c1403e0 0x7ff40c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff409e00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff40c071100 0x7ff40c0c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 -- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c1403e0 msgr2=0x7ff40c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c1403e0 0x7ff40c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 -- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff40c071100 msgr2=0x7ff40c0c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff40c071100 0x7ff40c0c5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.734+0000 7ff401400640 1 -- 172.21.15.192:0/765351457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc0094d0 con 0x7ff40c071b80 2024-09-13T18:37:20.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff401400640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e8a0 tx=0x7ff3f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f40094f0 con 0x7ff40c071b80 2024-09-13T18:37:20.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f400c940 con 0x7ff40c071b80 2024-09-13T18:37:20.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400ccf0 con 0x7ff40c071b80 2024-09-13T18:37:20.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c0c4d20 con 0x7ff40c071b80 2024-09-13T18:37:20.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.735+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c0c3fe0 con 0x7ff40c071b80 2024-09-13T18:37:20.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.736+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c0c4500 con 0x7ff40c071b80 2024-09-13T18:37:20.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.737+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff3f4013470 con 0x7ff40c071b80 2024-09-13T18:37:20.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.738+0000 7ff402a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 0x7ff3e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:20.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.738+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff3f4088fd0 con 0x7ff40c071b80 2024-09-13T18:37:20.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.738+0000 7ff409e00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 0x7ff3e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:20.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.739+0000 7ff409e00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 0x7ff3e806d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc034000 tx=0x7ff3fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:20.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.742+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff40c0c4500 con 0x7ff40c071b80 2024-09-13T18:37:20.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:20.913+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff40c0c4500 con 0x7ff40c071b80 2024-09-13T18:37:21.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.546+0000 7ff402a00640 1 -- 172.21.15.192:0/765351457 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v46) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff40c0c4500 con 0x7ff40c071b80 2024-09-13T18:37:21.550 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:37:21.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 msgr2=0x7ff3e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 0x7ff3e806d0c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc034000 tx=0x7ff3fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:37:21.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 msgr2=0x7ff40c0c47e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e8a0 tx=0x7ff3f400ed60 comp rx=0 tx=0).stop 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 shutdown_connections 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff3e806ac00 0x7ff3e806d0c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff40c1403e0 0x7ff40c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff40c071b80 0x7ff40c0c47e0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 --2- 172.21.15.192:0/765351457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff40c071100 0x7ff40c0c5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 >> 172.21.15.192:0/765351457 conn(0x7ff40c0b0c40 msgr2=0x7ff40c06a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 shutdown_connections 2024-09-13T18:37:21.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.550+0000 7ff410a00640 1 -- 172.21.15.192:0/765351457 wait complete. 2024-09-13T18:37:21.569 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:37:21.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.729+0000 7f5dd5e00640 1 Processor -- start 2024-09-13T18:37:21.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.729+0000 7f5dd5e00640 1 -- start start 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.730+0000 7f5dd5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.730+0000 7f5dd5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 0x7f5dd00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.730+0000 7f5dd5e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd006b480 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.730+0000 7f5dd5e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd00b4060 con 0x7f5dd006a8b0 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.730+0000 7f5dd5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd00ce770 con 0x7f5dd01434c0 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dc6000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 0x7f5dd00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:42858/0 (socket says 172.21.15.192:42858) 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 -- 172.21.15.192:0/3196385707 learned_addr learned my addr 172.21.15.192:0/3196385707 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 -- 172.21.15.192:0/3196385707 >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 msgr2=0x7f5dd00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 --2- 172.21.15.192:0/3196385707 >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 0x7f5dd00b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 -- 172.21.15.192:0/3196385707 >> v1:172.21.15.194:6789/0 conn(0x7f5dd00b3bd0 legacy=0x7f5dd006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dcea00640 1 -- 172.21.15.192:0/3196385707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd006b760 con 0x7f5dd01434c0 2024-09-13T18:37:21.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.731+0000 7f5dc6000640 1 --2- 172.21.15.192:0/3196385707 >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 0x7f5dd00b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.732+0000 7f5dcea00640 1 --2- 172.21.15.192:0/3196385707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009e80 tx=0x7f5dc002a740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faa3037e5dec914b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dce000640 1 -- 172.21.15.192:0/3196385707 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0031600 con 0x7f5dd01434c0 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dce000640 1 -- 172.21.15.192:0/3196385707 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc002d050 con 0x7f5dd01434c0 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dce000640 1 -- 172.21.15.192:0/3196385707 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0031980 con 0x7f5dd01434c0 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 -- 172.21.15.192:0/3196385707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 msgr2=0x7f5dd006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/3196385707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009e80 tx=0x7f5dc002a740 comp rx=0 tx=0).stop 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 -- 172.21.15.192:0/3196385707 shutdown_connections 2024-09-13T18:37:21.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/3196385707 >> v2:172.21.15.194:3300/0 conn(0x7f5dd006a8b0 0x7f5dd00b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/3196385707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd006c800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 -- 172.21.15.192:0/3196385707 >> 172.21.15.192:0/3196385707 conn(0x7f5dd00b08f0 msgr2=0x7f5dd00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 -- 172.21.15.192:0/3196385707 shutdown_connections 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.733+0000 7f5dd5e00640 1 -- 172.21.15.192:0/3196385707 wait complete. 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.735+0000 7f5dd5e00640 1 Processor -- start 2024-09-13T18:37:21.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.735+0000 7f5dd5e00640 1 -- start start 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dd006a8b0 0x7f5dd00aa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd013ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd015bc40 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd013ad30 con 0x7f5dd006a8b0 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dd5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd013b010 con 0x7f5dd01434c0 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dc6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dc6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44642/0 (socket says 172.21.15.192:44642) 2024-09-13T18:37:21.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.736+0000 7f5dc6000640 1 -- 172.21.15.192:0/1424327638 learned_addr learned my addr 172.21.15.192:0/1424327638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dcea00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dd006a8b0 0x7f5dd00aa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dcf400640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd013ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 -- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 msgr2=0x7f5dd013ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd013ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 -- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dd006a8b0 msgr2=0x7f5dd00aa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dd006a8b0 0x7f5dd00aa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 -- 172.21.15.192:0/1424327638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db8009400 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dcf400640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd013ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc6000640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5db800ebe0 tx=0x7f5db800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db8009760 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800cc30 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc0009b30 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800eee0 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.737+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd013de80 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.738+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd006acf0 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.740+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5db8013470 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.740+0000 7f5dc7e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 0x7f5dac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:21.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.740+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f5db8089c60 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.741+0000 7f5dcea00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 0x7f5dac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:21.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.741+0000 7f5dcea00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 0x7f5dac06d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0033000 tx=0x7f5dc0009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:21.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.744+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5db8055010 con 0x7f5dd00b3bd0 2024-09-13T18:37:21.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:21.913+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5dd00b0f20 con 0x7f5dd00b3bd0 2024-09-13T18:37:22.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.550+0000 7f5dc7e00640 1 -- 172.21.15.192:0/1424327638 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v47) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5db8058630 con 0x7f5dd00b3bd0 2024-09-13T18:37:22.554 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:37:22.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.556+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 msgr2=0x7f5dac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.556+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 0x7f5dac06d0c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0033000 tx=0x7f5dc0009000 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.556+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 msgr2=0x7f5dd00ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.556+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5db800ebe0 tx=0x7f5db800c520 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 shutdown_connections 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5dac06ac00 0x7f5dac06d0c0 secure :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0033000 tx=0x7f5dc0009000 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5dd01434c0 0x7f5dd013ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5dd00b3bd0 0x7f5dd00ad270 secure :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5db800ebe0 tx=0x7f5db800c520 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 --2- 172.21.15.192:0/1424327638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5dd006a8b0 0x7f5dd00aa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.557+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 >> 172.21.15.192:0/1424327638 conn(0x7f5dd00b08f0 msgr2=0x7f5dd015ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.558+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 shutdown_connections 2024-09-13T18:37:22.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.558+0000 7f5dd5e00640 1 -- 172.21.15.192:0/1424327638 wait complete. 2024-09-13T18:37:22.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:37:22.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.738+0000 7fc86c800640 1 Processor -- start 2024-09-13T18:37:22.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.738+0000 7fc86c800640 1 -- start start 2024-09-13T18:37:22.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc86c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 0x7fc86406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc86c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640b2000 con 0x7fc8640b3af0 2024-09-13T18:37:22.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc86c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8640b2ba0 con 0x7fc8641589f0 2024-09-13T18:37:22.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc86c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86406ca80 con 0x7fc86406c0b0 2024-09-13T18:37:22.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc869400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc8640b3af0 0x7fc86415b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59864/0 (socket says 172.21.15.192:59864) 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc869400640 1 -- 172.21.15.192:0/906167671 learned_addr learned my addr 172.21.15.192:0/906167671 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc86a800640 1 --2- 172.21.15.192:0/906167671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 0x7fc86406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1417146484 0 0) 0x7fc8640b2000 con 0x7fc8640b3af0 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.740+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc84c003520 con 0x7fc8640b3af0 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.741+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467681338 0 0) 0x7fc8640b2ba0 con 0x7fc8641589f0 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.741+0000 7fc86a800640 1 -- 172.21.15.192:0/906167671 >> v1:172.21.15.194:6789/0 conn(0x7fc8641589f0 legacy=0x7fc8640b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.741+0000 7fc86a800640 1 -- 172.21.15.192:0/906167671 >> v1:172.21.15.192:6789/0 conn(0x7fc8640b3af0 legacy=0x7fc86415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.741+0000 7fc86a800640 1 -- 172.21.15.192:0/906167671 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86415b970 con 0x7fc86406c0b0 2024-09-13T18:37:22.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.742+0000 7fc86a800640 1 --2- 172.21.15.192:0/906167671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 0x7fc86406c540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc860009dc0 tx=0x7fc86002a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e85ea63f9b9936 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.742+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854001670 con 0x7fc86406c0b0 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.742+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86002d050 con 0x7fc86406c0b0 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.742+0000 7fc868a00640 1 -- 172.21.15.192:0/906167671 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860007760 con 0x7fc86406c0b0 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 -- 172.21.15.192:0/906167671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 msgr2=0x7fc86406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 --2- 172.21.15.192:0/906167671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 0x7fc86406c540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc860009dc0 tx=0x7fc86002a640 comp rx=0 tx=0).stop 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 -- 172.21.15.192:0/906167671 shutdown_connections 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 --2- 172.21.15.192:0/906167671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc86406c0b0 0x7fc86406c540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 -- 172.21.15.192:0/906167671 >> 172.21.15.192:0/906167671 conn(0x7fc8640b08f0 msgr2=0x7fc8640b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 -- 172.21.15.192:0/906167671 shutdown_connections 2024-09-13T18:37:22.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.743+0000 7fc86c800640 1 -- 172.21.15.192:0/906167671 wait complete. 2024-09-13T18:37:22.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.744+0000 7fc86c800640 1 Processor -- start 2024-09-13T18:37:22.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 -- start start 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc86406c0b0 0x7fc86406ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8641589f0 0x7fc8641f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86406b5d0 con 0x7fc8640b3af0 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86406a380 con 0x7fc86406c0b0 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.745+0000 7fc86c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86406a660 con 0x7fc8641589f0 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44648/0 (socket says 172.21.15.192:44648) 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 -- 172.21.15.192:0/3119487685 learned_addr learned my addr 172.21.15.192:0/3119487685 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869e00640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc86406c0b0 0x7fc86406ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc86a800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8641589f0 0x7fc8641f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 -- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8641589f0 msgr2=0x7fc8641f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8641589f0 0x7fc8641f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 -- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc86406c0b0 msgr2=0x7fc86406ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc86406c0b0 0x7fc86406ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 -- 172.21.15.192:0/3119487685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860009a70 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.746+0000 7fc869400640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c750 tx=0x7fc85400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.747+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540074e0 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.747+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc854007640 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.747+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8540049e0 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.747+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc86406a940 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.747+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8641e59d0 con 0x7fc8640b3af0 2024-09-13T18:37:22.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.748+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8641f2bb0 con 0x7fc8640b3af0 2024-09-13T18:37:22.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.749+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc854004b40 con 0x7fc8640b3af0 2024-09-13T18:37:22.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.750+0000 7fc85e000640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 0x7fc84806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:22.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.750+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc854088810 con 0x7fc8640b3af0 2024-09-13T18:37:22.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.750+0000 7fc869e00640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 0x7fc84806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:22.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.751+0000 7fc869e00640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 0x7fc84806d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc858000f60 tx=0x7fc858009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:22.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.754+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc854053be0 con 0x7fc8640b3af0 2024-09-13T18:37:22.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.955+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc8641f2bb0 con 0x7fc8640b3af0 2024-09-13T18:37:22.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.960+0000 7fc85e000640 1 -- 172.21.15.192:0/3119487685 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc8641f2bb0 con 0x7fc8640b3af0 2024-09-13T18:37:22.963 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 6 and data pool 7 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 msgr2=0x7fc84806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 0x7fc84806d0c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc858000f60 tx=0x7fc858009040 comp rx=0 tx=0).stop 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 msgr2=0x7fc8641e5490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c750 tx=0x7fc85400cc10 comp rx=0 tx=0).stop 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 shutdown_connections 2024-09-13T18:37:22.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc84806ac00 0x7fc84806d0c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8641589f0 0x7fc8641f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8640b3af0 0x7fc8641e5490 secure :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc85400c750 tx=0x7fc85400cc10 comp rx=0 tx=0).stop 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 --2- 172.21.15.192:0/3119487685 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc86406c0b0 0x7fc86406ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.963+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 >> 172.21.15.192:0/3119487685 conn(0x7fc8640b08f0 msgr2=0x7fc864158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.964+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 shutdown_connections 2024-09-13T18:37:22.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:22.964+0000 7fc86c800640 1 -- 172.21.15.192:0/3119487685 wait complete. 2024-09-13T18:37:22.995 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:23.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.146+0000 7fe6df400640 1 Processor -- start 2024-09-13T18:37:23.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.146+0000 7fe6df400640 1 -- start start 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6df400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 0x7fe6d80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6df400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6d80b2780 0x7fe6d80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6df400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d80ae770 con 0x7fe6d80afd80 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6df400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6d80cd920 con 0x7fe6d80b2780 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6df400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80cdb30 con 0x7fe6d8146610 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.147+0000 7fe6d7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6d80b2780 0x7fe6d80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe6d80b2780 0x7fe6d80ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44652/0 (socket says 172.21.15.192:44652) 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 -- 172.21.15.192:0/3431553971 learned_addr learned my addr 172.21.15.192:0/3431553971 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6dca00640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 0x7fe6d80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 -- 172.21.15.192:0/3431553971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 msgr2=0x7fe6d80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 0x7fe6d80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 -- 172.21.15.192:0/3431553971 >> v1:172.21.15.192:6789/0 conn(0x7fe6d80afd80 legacy=0x7fe6d80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7e00640 1 -- 172.21.15.192:0/3431553971 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d80ae1b0 con 0x7fe6d80b2780 2024-09-13T18:37:23.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6d7400640 1 -- 172.21.15.192:0/3431553971 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 339131227 0 0) 0x7fe6d80ae770 con 0x7fe6d80afd80 2024-09-13T18:37:23.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.148+0000 7fe6dca00640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 0x7fe6d80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:23.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.149+0000 7fe6d7e00640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d80b2780 0x7fe6d80ad840 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009870 tx=0x7fe6c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aea767cc2699afd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.149+0000 7fe6d7400640 1 -- 172.21.15.192:0/3431553971 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4032440 con 0x7fe6d80b2780 2024-09-13T18:37:23.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.149+0000 7fe6d7400640 1 -- 172.21.15.192:0/3431553971 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c40325a0 con 0x7fe6d80b2780 2024-09-13T18:37:23.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.149+0000 7fe6d7400640 1 -- 172.21.15.192:0/3431553971 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4032930 con 0x7fe6d80b2780 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 -- 172.21.15.192:0/3431553971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d80b2780 msgr2=0x7fe6d80ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d80b2780 0x7fe6d80ad840 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009870 tx=0x7fe6c402a270 comp rx=0 tx=0).stop 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 -- 172.21.15.192:0/3431553971 shutdown_connections 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d80b2780 0x7fe6d80ad840 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 --2- 172.21.15.192:0/3431553971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d8146610 0x7fe6d80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 -- 172.21.15.192:0/3431553971 >> 172.21.15.192:0/3431553971 conn(0x7fe6d80ae960 msgr2=0x7fe6d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 -- 172.21.15.192:0/3431553971 shutdown_connections 2024-09-13T18:37:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.150+0000 7fe6df400640 1 -- 172.21.15.192:0/3431553971 wait complete. 2024-09-13T18:37:23.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.151+0000 7fe6df400640 1 Processor -- start 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 -- start start 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 0x7fe6d815ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 0x7fe6d815f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 0x7fe6d81416b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8140750 con 0x7fe6d8146610 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.152+0000 7fe6df400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8143400 con 0x7fe6d80b2780 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6df400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d8140bd0 con 0x7fe6d80afd80 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 0x7fe6d81416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 0x7fe6d815ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6d7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 0x7fe6d815f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dca00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 0x7fe6d815ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:42892/0 (socket says 172.21.15.192:42892) 2024-09-13T18:37:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dca00640 1 -- 172.21.15.192:0/3908069870 learned_addr learned my addr 172.21.15.192:0/3908069870 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 -- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 msgr2=0x7fe6d815ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 0x7fe6d815ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 -- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 msgr2=0x7fe6d815f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 0x7fe6d815f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6dd400640 1 -- 172.21.15.192:0/3908069870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c40094d0 con 0x7fe6d8146610 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.153+0000 7fe6d7e00640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 0x7fe6d815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6dd400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 0x7fe6d81416b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0001560 tx=0x7fe6d000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0003da0 con 0x7fe6d8146610 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d000ce30 con 0x7fe6d8146610 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0005290 con 0x7fe6d8146610 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d8140eb0 con 0x7fe6d8146610 2024-09-13T18:37:23.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.154+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d81436e0 con 0x7fe6d8146610 2024-09-13T18:37:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.155+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d81413d0 con 0x7fe6d8146610 2024-09-13T18:37:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.156+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6d00053f0 con 0x7fe6d8146610 2024-09-13T18:37:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.157+0000 7fe6d4c00640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.157+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6d0088a80 con 0x7fe6d8146610 2024-09-13T18:37:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.157+0000 7fe6dca00640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.158+0000 7fe6dca00640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc006d40 tx=0x7fe6cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.161+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe6d81413d0 con 0x7fe6d8146610 2024-09-13T18:37:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.331+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6d81413d0 con 0x7fe6d8146610 2024-09-13T18:37:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.332+0000 7fe6d4c00640 1 -- 172.21.15.192:0/3908069870 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16582 (secure 0 0 0) 0x7fe6d81413d0 con 0x7fe6d8146610 2024-09-13T18:37:23.335 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:23.335 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":48,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:22.956776+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 msgr2=0x7fe6b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc006d40 tx=0x7fe6cc008040 comp rx=0 tx=0).stop 2024-09-13T18:37:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 msgr2=0x7fe6d81416b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 0x7fe6d81416b0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe6d0001560 tx=0x7fe6d000cbe0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 shutdown_connections 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d8146610 0x7fe6d81416b0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b2780 0x7fe6d815f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 --2- 172.21.15.192:0/3908069870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d80afd80 0x7fe6d815ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.334+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 >> 172.21.15.192:0/3908069870 conn(0x7fe6d80ae960 msgr2=0x7fe6d80b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.335+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 shutdown_connections 2024-09-13T18:37:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.335+0000 7fe6df400640 1 -- 172.21.15.192:0/3908069870 wait complete. 2024-09-13T18:37:23.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:23.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.504+0000 7f1bfc600640 1 Processor -- start 2024-09-13T18:37:23.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.504+0000 7f1bfc600640 1 -- start start 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfc600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf40cacd0 0x7f1bf415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfc600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bf415bc20 0x7f1bf40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfc600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bf4140480 con 0x7f1bf40cb0b0 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfc600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf415ee90 con 0x7f1bf415bc20 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfc600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf415f170 con 0x7f1bf40cacd0 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bf415bc20 0x7f1bf40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bf415bc20 0x7f1bf40afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44662/0 (socket says 172.21.15.192:44662) 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 -- 172.21.15.192:0/919123276 learned_addr learned my addr 172.21.15.192:0/919123276 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bf9c00640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf40cacd0 0x7f1bf415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 -- 172.21.15.192:0/919123276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf40cacd0 msgr2=0x7f1bf415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf40cacd0 0x7f1bf415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 -- 172.21.15.192:0/919123276 >> v1:172.21.15.194:6789/0 conn(0x7f1bf40cb0b0 legacy=0x7f1bf4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bf3e00640 1 -- 172.21.15.192:0/919123276 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884077077 0 0) 0x7f1bf4140480 con 0x7f1bf40cb0b0 2024-09-13T18:37:23.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.506+0000 7f1bfa600640 1 -- 172.21.15.192:0/919123276 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf415f450 con 0x7f1bf415bc20 2024-09-13T18:37:23.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.507+0000 7f1bfa600640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf415bc20 0x7f1bf40afd80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009e50 tx=0x7f1bec02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82a3f255a8a4208 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bf3e00640 1 -- 172.21.15.192:0/919123276 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec031600 con 0x7f1bf415bc20 2024-09-13T18:37:23.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bf3e00640 1 -- 172.21.15.192:0/919123276 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bec02d050 con 0x7f1bf415bc20 2024-09-13T18:37:23.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bf3e00640 1 -- 172.21.15.192:0/919123276 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bec031980 con 0x7f1bf415bc20 2024-09-13T18:37:23.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 -- 172.21.15.192:0/919123276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf415bc20 msgr2=0x7f1bf40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf415bc20 0x7f1bf40afd80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f1bec009e50 tx=0x7f1bec02a710 comp rx=0 tx=0).stop 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 -- 172.21.15.192:0/919123276 shutdown_connections 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf415bc20 0x7f1bf40afd80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 --2- 172.21.15.192:0/919123276 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf40cacd0 0x7f1bf415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 -- 172.21.15.192:0/919123276 >> 172.21.15.192:0/919123276 conn(0x7f1bf40ae960 msgr2=0x7f1bf406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 -- 172.21.15.192:0/919123276 shutdown_connections 2024-09-13T18:37:23.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.508+0000 7f1bfc600640 1 -- 172.21.15.192:0/919123276 wait complete. 2024-09-13T18:37:23.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.510+0000 7f1bfc600640 1 Processor -- start 2024-09-13T18:37:23.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.510+0000 7f1bfc600640 1 -- start start 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 0x7f1bf4069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 0x7f1bf4159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf406b8b0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf406b420 con 0x7f1bf40cb0b0 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bfc600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf413d3b0 con 0x7f1bf415bc20 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bf9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bf9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44666/0 (socket says 172.21.15.192:44666) 2024-09-13T18:37:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.511+0000 7f1bf9c00640 1 -- 172.21.15.192:0/640994992 learned_addr learned my addr 172.21.15.192:0/640994992 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9200640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 0x7f1bf4069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bfa600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 0x7f1bf4159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 -- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 msgr2=0x7f1bf4159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 0x7f1bf4159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 -- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 msgr2=0x7f1bf4069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 0x7f1bf4069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 -- 172.21.15.192:0/640994992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bec009b30 con 0x7f1bf40cacd0 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9200640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 0x7f1bf4069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bfa600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 0x7f1bf4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf9c00640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1be800e870 tx=0x7f1be800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be80094f0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be800c940 con 0x7f1bf40cacd0 2024-09-13T18:37:23.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bf406a810 con 0x7f1bf40cacd0 2024-09-13T18:37:23.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be800ccf0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.512+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf406add0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.513+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf415e790 con 0x7f1bf40cacd0 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.514+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1be8013470 con 0x7f1bf40cacd0 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.515+0000 7f1bf1600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 0x7f1bd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.515+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1be80897d0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.515+0000 7f1bf9200640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 0x7f1bd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.516+0000 7f1bf9200640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 0x7f1bd406d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bf406c030 tx=0x7f1be0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.519+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1be80549a0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.690+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bf406c6c0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.691+0000 7f1bf1600640 1 -- 172.21.15.192:0/640994992 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f1be8057fc0 con 0x7f1bf40cacd0 2024-09-13T18:37:23.695 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:23.695 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":48,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:22.956776+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:23.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 msgr2=0x7f1bd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 0x7f1bd406d0c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bf406c030 tx=0x7f1be0009040 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 msgr2=0x7f1bf413ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f1be800e870 tx=0x7f1be800ed30 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 shutdown_connections 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bd406ac00 0x7f1bd406d0c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bf415bc20 0x7f1bf4159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bf40cb0b0 0x7f1bf4069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 --2- 172.21.15.192:0/640994992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bf40cacd0 0x7f1bf413ce70 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.693+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 >> 172.21.15.192:0/640994992 conn(0x7f1bf40ae960 msgr2=0x7f1bf40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.694+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 shutdown_connections 2024-09-13T18:37:23.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.694+0000 7f1bfc600640 1 -- 172.21.15.192:0/640994992 wait complete. 2024-09-13T18:37:23.713 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:37:23.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.870+0000 7f7e3e400640 1 Processor -- start 2024-09-13T18:37:23.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.870+0000 7f7e3e400640 1 -- start start 2024-09-13T18:37:23.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.871+0000 7f7e3e400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e381434c0 0x7f7e3806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.871+0000 7f7e3e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e380b3da0 0x7f7e3806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e3e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3806b480 con 0x7f7e3806a8b0 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e3e400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e380ce770 con 0x7f7e381434c0 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e3e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3806b760 con 0x7f7e380b3da0 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e381434c0 0x7f7e3806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e381434c0 0x7f7e3806c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44680/0 (socket says 172.21.15.192:44680) 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 -- 172.21.15.192:0/1906836072 learned_addr learned my addr 172.21.15.192:0/1906836072 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37e00640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e380b3da0 0x7f7e3806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 -- 172.21.15.192:0/1906836072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e380b3da0 msgr2=0x7f7e3806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:23.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e380b3da0 0x7f7e3806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 -- 172.21.15.192:0/1906836072 >> v1:172.21.15.194:6789/0 conn(0x7f7e3806a8b0 legacy=0x7f7e380b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.872+0000 7f7e37400640 1 -- 172.21.15.192:0/1906836072 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3806ba40 con 0x7f7e381434c0 2024-09-13T18:37:23.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.873+0000 7f7e37400640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e381434c0 0x7f7e3806c800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009870 tx=0x7f7e2802c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1187c2d609f2277e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e36000640 1 -- 172.21.15.192:0/1906836072 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28031710 con 0x7f7e381434c0 2024-09-13T18:37:23.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e36000640 1 -- 172.21.15.192:0/1906836072 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2802f050 con 0x7f7e381434c0 2024-09-13T18:37:23.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e36000640 1 -- 172.21.15.192:0/1906836072 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e28031a90 con 0x7f7e381434c0 2024-09-13T18:37:23.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 -- 172.21.15.192:0/1906836072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e381434c0 msgr2=0x7f7e3806c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e381434c0 0x7f7e3806c800 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7e28009870 tx=0x7f7e2802c3d0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 -- 172.21.15.192:0/1906836072 shutdown_connections 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e380b3da0 0x7f7e3806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 --2- 172.21.15.192:0/1906836072 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e381434c0 0x7f7e3806c800 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 -- 172.21.15.192:0/1906836072 >> 172.21.15.192:0/1906836072 conn(0x7f7e380b08f0 msgr2=0x7f7e380b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 -- 172.21.15.192:0/1906836072 shutdown_connections 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.874+0000 7f7e3e400640 1 -- 172.21.15.192:0/1906836072 wait complete. 2024-09-13T18:37:23.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.876+0000 7f7e3e400640 1 Processor -- start 2024-09-13T18:37:23.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.876+0000 7f7e3e400640 1 -- start start 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e3806a8b0 0x7f7e38139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e381434c0 0x7f7e38141a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381ef520 con 0x7f7e380b3da0 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381504a0 con 0x7f7e3806a8b0 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e3e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e381ef240 con 0x7f7e381434c0 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e36a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e36a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44686/0 (socket says 172.21.15.192:44686) 2024-09-13T18:37:23.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e36a00640 1 -- 172.21.15.192:0/613758645 learned_addr learned my addr 172.21.15.192:0/613758645 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e37400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e3806a8b0 0x7f7e38139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.877+0000 7f7e37e00640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e381434c0 0x7f7e38141a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 -- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e381434c0 msgr2=0x7f7e38141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e381434c0 0x7f7e38141a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 -- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e3806a8b0 msgr2=0x7f7e38139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e3806a8b0 0x7f7e38139120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 -- 172.21.15.192:0/613758645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e280094d0 con 0x7f7e380b3da0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e36a00640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c480 tx=0x7f7e2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e240052d0 con 0x7f7e380b3da0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24005430 con 0x7f7e380b3da0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e380a95d0 con 0x7f7e380b3da0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24012870 con 0x7f7e380b3da0 2024-09-13T18:37:23.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.878+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e380a9b90 con 0x7f7e380b3da0 2024-09-13T18:37:23.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.880+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e380a9430 con 0x7f7e380b3da0 2024-09-13T18:37:23.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.880+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e240129d0 con 0x7f7e380b3da0 2024-09-13T18:37:23.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.881+0000 7f7e2f400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 0x7f7e1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:23.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.881+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e24088d00 con 0x7f7e380b3da0 2024-09-13T18:37:23.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.881+0000 7f7e37400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 0x7f7e1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:23.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.882+0000 7f7e37400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 0x7f7e1806d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7e28035000 tx=0x7f7e28008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:23.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:23.885+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e380a9430 con 0x7f7e380b3da0 2024-09-13T18:37:24.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.088+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7e380a9430 con 0x7f7e380b3da0 2024-09-13T18:37:24.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.978+0000 7f7e2f400640 1 -- 172.21.15.192:0/613758645 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7e380a9430 con 0x7f7e380b3da0 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 msgr2=0x7f7e1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 0x7f7e1806d0c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7e28035000 tx=0x7f7e28008030 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 msgr2=0x7f7e381414d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400c480 tx=0x7f7e2400c940 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 shutdown_connections 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1806ac00 0x7f7e1806d0c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e381434c0 0x7f7e38141a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e380b3da0 0x7f7e381414d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 --2- 172.21.15.192:0/613758645 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e3806a8b0 0x7f7e38139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 >> 172.21.15.192:0/613758645 conn(0x7f7e380b08f0 msgr2=0x7f7e38070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 shutdown_connections 2024-09-13T18:37:24.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:24.981+0000 7f7e3e400640 1 -- 172.21.15.192:0/613758645 wait complete. 2024-09-13T18:37:25.002 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:37:25.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:37:25.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.158+0000 7f6042400640 1 Processor -- start 2024-09-13T18:37:25.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.158+0000 7f6042400640 1 -- start start 2024-09-13T18:37:25.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f6042400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f6042400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0b2000 con 0x7f603c1589f0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f6042400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603c0b2ba0 con 0x7f603c0b3af0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f6042400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c06ca80 con 0x7f603c06c0b0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f603b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f603c1589f0 0x7f603c0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59870/0 (socket says 172.21.15.192:59870) 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f603b400640 1 -- 172.21.15.192:0/1330157065 learned_addr learned my addr 172.21.15.192:0/1330157065 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f603be00640 1 --2- 172.21.15.192:0/1330157065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154106514 0 0) 0x7f603c0b2000 con 0x7f603c1589f0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.160+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6020003520 con 0x7f603c1589f0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.161+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3943331124 0 0) 0x7f603c0b2ba0 con 0x7f603c0b3af0 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.161+0000 7f603be00640 1 -- 172.21.15.192:0/1330157065 >> v1:172.21.15.194:6789/0 conn(0x7f603c0b3af0 legacy=0x7f603c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.161+0000 7f603be00640 1 -- 172.21.15.192:0/1330157065 >> v1:172.21.15.192:6789/0 conn(0x7f603c1589f0 legacy=0x7f603c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.161+0000 7f603be00640 1 -- 172.21.15.192:0/1330157065 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c15b970 con 0x7f603c06c0b0 2024-09-13T18:37:25.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f603be00640 1 --2- 172.21.15.192:0/1330157065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c06c540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6034009dc0 tx=0x7f603402a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6688a3d18f7e484 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:25.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c001670 con 0x7f603c06c0b0 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603402d050 con 0x7f603c06c0b0 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f603aa00640 1 -- 172.21.15.192:0/1330157065 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034007760 con 0x7f603c06c0b0 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f6042400640 1 -- 172.21.15.192:0/1330157065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 msgr2=0x7f603c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.162+0000 7f6042400640 1 --2- 172.21.15.192:0/1330157065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c06c540 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6034009dc0 tx=0x7f603402a640 comp rx=0 tx=0).stop 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.163+0000 7f6042400640 1 -- 172.21.15.192:0/1330157065 shutdown_connections 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.163+0000 7f6042400640 1 --2- 172.21.15.192:0/1330157065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c06c540 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.163+0000 7f6042400640 1 -- 172.21.15.192:0/1330157065 >> 172.21.15.192:0/1330157065 conn(0x7f603c0b08f0 msgr2=0x7f603c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.163+0000 7f6042400640 1 -- 172.21.15.192:0/1330157065 shutdown_connections 2024-09-13T18:37:25.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.163+0000 7f6042400640 1 -- 172.21.15.192:0/1330157065 wait complete. 2024-09-13T18:37:25.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.164+0000 7f6042400640 1 Processor -- start 2024-09-13T18:37:25.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.164+0000 7f6042400640 1 -- start start 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603c0b3af0 0x7f603c14fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c14ed00 con 0x7f603c1589f0 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1f2aa0 con 0x7f603c0b3af0 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f6042400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c1f6490 con 0x7f603c06c0b0 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.165+0000 7f603be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44690/0 (socket says 172.21.15.192:44690) 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 -- 172.21.15.192:0/4013382492 learned_addr learned my addr 172.21.15.192:0/4013382492 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603b400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f6032a00640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603c0b3af0 0x7f603c14fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 -- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 msgr2=0x7f603c14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c14e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 -- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603c0b3af0 msgr2=0x7f603c14fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603c0b3af0 0x7f603c14fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 -- 172.21.15.192:0/4013382492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034009a70 con 0x7f603c1589f0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.166+0000 7f603be00640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6034009ee0 tx=0x7f6034004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.167+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6034003b90 con 0x7f603c1589f0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.167+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6034003cf0 con 0x7f603c1589f0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.167+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603c1f6770 con 0x7f603c1589f0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.167+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603403c880 con 0x7f603c1589f0 2024-09-13T18:37:25.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.167+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603c1f6d30 con 0x7f603c1589f0 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.168+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603c1f2c10 con 0x7f603c1589f0 2024-09-13T18:37:25.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.169+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f603403c9e0 con 0x7f603c1589f0 2024-09-13T18:37:25.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.170+0000 7f6033e00640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 0x7f601806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:25.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.170+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60340aa9f0 con 0x7f603c1589f0 2024-09-13T18:37:25.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.170+0000 7f603b400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 0x7f601806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:25.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.171+0000 7f603b400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 0x7f601806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f602c001600 tx=0x7f602c001570 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:25.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.174+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f603c1f2c10 con 0x7f603c1589f0 2024-09-13T18:37:25.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.376+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f603c1f2c10 con 0x7f603c1589f0 2024-09-13T18:37:25.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.979+0000 7f6033e00640 1 -- 172.21.15.192:0/4013382492 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f603c1f2c10 con 0x7f603c1589f0 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 msgr2=0x7f601806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 0x7f601806d0c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f602c001600 tx=0x7f602c001570 comp rx=0 tx=0).stop 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 msgr2=0x7f603c069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f6034009ee0 tx=0x7f6034004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 shutdown_connections 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac00 0x7f601806d0c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f603c1589f0 0x7f603c069ea0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f603c0b3af0 0x7f603c14fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 --2- 172.21.15.192:0/4013382492 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603c06c0b0 0x7f603c14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:25.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 >> 172.21.15.192:0/4013382492 conn(0x7f603c0b08f0 msgr2=0x7f603c159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:25.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 shutdown_connections 2024-09-13T18:37:25.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:25.982+0000 7f6042400640 1 -- 172.21.15.192:0/4013382492 wait complete. 2024-09-13T18:37:26.002 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:37:26.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:26.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.153+0000 7f0086800640 1 Processor -- start 2024-09-13T18:37:26.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.153+0000 7f0086800640 1 -- start start 2024-09-13T18:37:26.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.154+0000 7f0086800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f00800cacd0 0x7f008015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.154+0000 7f0086800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f008015bc20 0x7f00800afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.154+0000 7f0086800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0080140480 con 0x7f00800cb0b0 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.154+0000 7f0086800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00800cb520 con 0x7f008015bc20 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.154+0000 7f0086800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f008015ee90 con 0x7f00800cacd0 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f008015bc20 0x7f00800afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f008015bc20 0x7f00800afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44698/0 (socket says 172.21.15.192:44698) 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 -- 172.21.15.192:0/2978769720 learned_addr learned my addr 172.21.15.192:0/2978769720 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007f400640 1 --2- 172.21.15.192:0/2978769720 >> v2:172.21.15.194:3300/0 conn(0x7f00800cacd0 0x7f008015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 -- 172.21.15.192:0/2978769720 >> v2:172.21.15.194:3300/0 conn(0x7f00800cacd0 msgr2=0x7f008015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 --2- 172.21.15.192:0/2978769720 >> v2:172.21.15.194:3300/0 conn(0x7f00800cacd0 0x7f008015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 -- 172.21.15.192:0/2978769720 >> v1:172.21.15.192:6789/0 conn(0x7f00800cb0b0 legacy=0x7f0080140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007fe00640 1 -- 172.21.15.192:0/2978769720 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008015f170 con 0x7f008015bc20 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.155+0000 7f007ea00640 1 -- 172.21.15.192:0/2978769720 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421678280 0 0) 0x7f0080140480 con 0x7f00800cb0b0 2024-09-13T18:37:26.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.156+0000 7f007fe00640 1 --2- 172.21.15.192:0/2978769720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f008015bc20 0x7f00800afd80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f00800b2350 tx=0x7f007802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eeb3068a9c2cf41 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.156+0000 7f007ea00640 1 -- 172.21.15.192:0/2978769720 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078031600 con 0x7f008015bc20 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f007ea00640 1 -- 172.21.15.192:0/2978769720 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007802d050 con 0x7f008015bc20 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f007ea00640 1 -- 172.21.15.192:0/2978769720 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0078031980 con 0x7f008015bc20 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 -- 172.21.15.192:0/2978769720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f008015bc20 msgr2=0x7f00800afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 --2- 172.21.15.192:0/2978769720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f008015bc20 0x7f00800afd80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f00800b2350 tx=0x7f007802a730 comp rx=0 tx=0).stop 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 -- 172.21.15.192:0/2978769720 shutdown_connections 2024-09-13T18:37:26.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 --2- 172.21.15.192:0/2978769720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f008015bc20 0x7f00800afd80 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 --2- 172.21.15.192:0/2978769720 >> v2:172.21.15.194:3300/0 conn(0x7f00800cacd0 0x7f008015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 -- 172.21.15.192:0/2978769720 >> 172.21.15.192:0/2978769720 conn(0x7f00800ae960 msgr2=0x7f008006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 -- 172.21.15.192:0/2978769720 shutdown_connections 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.157+0000 7f0086800640 1 -- 172.21.15.192:0/2978769720 wait complete. 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.159+0000 7f0086800640 1 Processor -- start 2024-09-13T18:37:26.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.159+0000 7f0086800640 1 -- start start 2024-09-13T18:37:26.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 0x7f008006b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f008015bc20 0x7f008013c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008006b8a0 con 0x7f00800cb0b0 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00801e5580 con 0x7f00800cacd0 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0086800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00801e4970 con 0x7f008015bc20 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44710/0 (socket says 172.21.15.192:44710) 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 -- 172.21.15.192:0/3680250904 learned_addr learned my addr 172.21.15.192:0/3680250904 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f007f400640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 0x7f008006b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 -- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f008015bc20 msgr2=0x7f008013c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f008015bc20 0x7f008013c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 -- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 msgr2=0x7f008006b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 0x7f008006b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f0076a00640 1 -- 172.21.15.192:0/3680250904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078009b30 con 0x7f00800cb0b0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.160+0000 7f007f400640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 0x7f008006b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0076a00640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f006800c4b0 tx=0x7f006800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0068005480 con 0x7f00800cb0b0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00680035f0 con 0x7f00800cb0b0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00680039e0 con 0x7f00800cb0b0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00801e4c50 con 0x7f00800cb0b0 2024-09-13T18:37:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.161+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00801e5210 con 0x7f00800cb0b0 2024-09-13T18:37:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.162+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008015e790 con 0x7f00800cb0b0 2024-09-13T18:37:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.163+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0068003b40 con 0x7f00800cb0b0 2024-09-13T18:37:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.164+0000 7f0077e00640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.164+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00680889e0 con 0x7f00800cb0b0 2024-09-13T18:37:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.164+0000 7f007f400640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.164+0000 7f007f400640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 0x7f005c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f008006b2f0 tx=0x7f0070008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.168+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0068053b20 con 0x7f00800cb0b0 2024-09-13T18:37:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.367+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00801e56c0 con 0x7f00800cb0b0 2024-09-13T18:37:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.368+0000 7f0077e00640 1 -- 172.21.15.192:0/3680250904 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f0068017070 con 0x7f00800cb0b0 2024-09-13T18:37:26.370 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:26.370 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:37:26.371 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:37:26.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 msgr2=0x7f005c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 0x7f005c06d0c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f008006b2f0 tx=0x7f0070008040 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 msgr2=0x7f0080159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f006800c4b0 tx=0x7f006800c970 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 shutdown_connections 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f005c06ac00 0x7f005c06d0c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f008015bc20 0x7f008013c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f00800cb0b0 0x7f0080159ce0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 --2- 172.21.15.192:0/3680250904 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f00800cacd0 0x7f008006b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 >> 172.21.15.192:0/3680250904 conn(0x7f00800ae960 msgr2=0x7f0080071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 shutdown_connections 2024-09-13T18:37:26.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.370+0000 7f0086800640 1 -- 172.21.15.192:0/3680250904 wait complete. 2024-09-13T18:37:26.389 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:26.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.537+0000 7ff42b800640 1 Processor -- start 2024-09-13T18:37:26.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.537+0000 7ff42b800640 1 -- start start 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.538+0000 7ff42b800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff424150480 0x7ff42415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.538+0000 7ff42b800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff424071810 0x7ff4240b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.538+0000 7ff42b800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff424071dd0 con 0x7ff4240b2230 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.538+0000 7ff42b800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240cb770 con 0x7ff424071810 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.538+0000 7ff42b800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4240cba50 con 0x7ff424150480 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff424071810 0x7ff4240b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff424071810 0x7ff4240b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44712/0 (socket says 172.21.15.192:44712) 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff429800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff4240b2230 0x7ff4240cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59890/0 (socket says 172.21.15.192:59890) 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 -- 172.21.15.192:0/1115443485 learned_addr learned my addr 172.21.15.192:0/1115443485 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff428e00640 1 --2- 172.21.15.192:0/1115443485 >> v2:172.21.15.194:3300/0 conn(0x7ff424150480 0x7ff42415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 -- 172.21.15.192:0/1115443485 >> v2:172.21.15.194:3300/0 conn(0x7ff424150480 msgr2=0x7ff42415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 --2- 172.21.15.192:0/1115443485 >> v2:172.21.15.194:3300/0 conn(0x7ff424150480 0x7ff42415a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 -- 172.21.15.192:0/1115443485 >> v1:172.21.15.192:6789/0 conn(0x7ff4240b2230 legacy=0x7ff4240cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423400640 1 -- 172.21.15.192:0/1115443485 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323396992 0 0) 0x7ff424071dd0 con 0x7ff4240b2230 2024-09-13T18:37:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.539+0000 7ff423e00640 1 -- 172.21.15.192:0/1115443485 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4240cbd30 con 0x7ff424071810 2024-09-13T18:37:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.540+0000 7ff423e00640 1 --2- 172.21.15.192:0/1115443485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff424071810 0x7ff4240b1cf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff4240b07c0 tx=0x7ff41002b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20683fc736c5e910 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.540+0000 7ff423400640 1 -- 172.21.15.192:0/1115443485 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410030710 con 0x7ff424071810 2024-09-13T18:37:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.540+0000 7ff423400640 1 -- 172.21.15.192:0/1115443485 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41002e050 con 0x7ff424071810 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.540+0000 7ff423400640 1 -- 172.21.15.192:0/1115443485 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410030a90 con 0x7ff424071810 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 -- 172.21.15.192:0/1115443485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff424071810 msgr2=0x7ff4240b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 --2- 172.21.15.192:0/1115443485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff424071810 0x7ff4240b1cf0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff4240b07c0 tx=0x7ff41002b5e0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 -- 172.21.15.192:0/1115443485 shutdown_connections 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 --2- 172.21.15.192:0/1115443485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff424071810 0x7ff4240b1cf0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 --2- 172.21.15.192:0/1115443485 >> v2:172.21.15.194:3300/0 conn(0x7ff424150480 0x7ff42415a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 -- 172.21.15.192:0/1115443485 >> 172.21.15.192:0/1115443485 conn(0x7ff4240ae960 msgr2=0x7ff42406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 -- 172.21.15.192:0/1115443485 shutdown_connections 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.541+0000 7ff42b800640 1 -- 172.21.15.192:0/1115443485 wait complete. 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.543+0000 7ff42b800640 1 Processor -- start 2024-09-13T18:37:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.543+0000 7ff42b800640 1 -- start start 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff424071810 0x7ff42414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 0x7ff4241530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240adf80 con 0x7ff4240b2230 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240ad5b0 con 0x7ff424150480 2024-09-13T18:37:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff42b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240acc80 con 0x7ff424071810 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44718/0 (socket says 172.21.15.192:44718) 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 -- 172.21.15.192:0/778602565 learned_addr learned my addr 172.21.15.192:0/778602565 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff428e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff424071810 0x7ff42414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff429800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 0x7ff4241530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 -- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff424071810 msgr2=0x7ff42414c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff424071810 0x7ff42414c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 -- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 msgr2=0x7ff4241530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 0x7ff4241530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff423e00640 1 -- 172.21.15.192:0/778602565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41000a670 con 0x7ff4240b2230 2024-09-13T18:37:26.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.544+0000 7ff429800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 0x7ff4241530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff423e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff41002b620 tx=0x7ff4100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410032990 con 0x7ff4240b2230 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410032b10 con 0x7ff4240b2230 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41003b430 con 0x7ff4240b2230 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4240acf60 con 0x7ff4240b2230 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.545+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4240ac930 con 0x7ff4240b2230 2024-09-13T18:37:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.546+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240b1cf0 con 0x7ff4240b2230 2024-09-13T18:37:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.547+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff41003b590 con 0x7ff4240b2230 2024-09-13T18:37:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.548+0000 7ff420c00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 0x7ff40406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.548+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4100a9fe0 con 0x7ff4240b2230 2024-09-13T18:37:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.548+0000 7ff428e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 0x7ff40406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.549+0000 7ff428e00640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 0x7ff40406d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff4180079a0 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.552+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4100753e0 con 0x7ff4240b2230 2024-09-13T18:37:26.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.720+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4241594f0 con 0x7ff4240b2230 2024-09-13T18:37:26.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.722+0000 7ff420c00640 1 -- 172.21.15.192:0/778602565 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v49) v1 ==== 74+0+16569 (secure 0 0 0) 0x7ff410078a00 con 0x7ff4240b2230 2024-09-13T18:37:26.725 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:26.725 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":49,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:23.959307+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"49","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 msgr2=0x7ff40406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 0x7ff40406d0f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff4180079a0 tx=0x7ff418008040 comp rx=0 tx=0).stop 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 msgr2=0x7ff4240ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff41002b620 tx=0x7ff4100046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 shutdown_connections 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff40406ac30 0x7ff40406d0f0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff424150480 0x7ff4241530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4240b2230 0x7ff4240ada40 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 --2- 172.21.15.192:0/778602565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff424071810 0x7ff42414c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 >> 172.21.15.192:0/778602565 conn(0x7ff4240ae960 msgr2=0x7ff424069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:26.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 shutdown_connections 2024-09-13T18:37:26.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.724+0000 7ff42b800640 1 -- 172.21.15.192:0/778602565 wait complete. 2024-09-13T18:37:26.743 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:37:26.743 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:26.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.894+0000 7f7380a00640 1 Processor -- start 2024-09-13T18:37:26.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.895+0000 7f7380a00640 1 -- start start 2024-09-13T18:37:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f737c06b3d0 0x7f737c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c06e990 0x7f737c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c0b3730 con 0x7f737c06e990 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c06c5d0 con 0x7f737c06b3d0 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7380a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0b3920 con 0x7f737c15a9e0 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f737be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c06e990 0x7f737c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f737be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c06e990 0x7f737c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44724/0 (socket says 172.21.15.192:44724) 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f737be00640 1 -- 172.21.15.192:0/1237860874 learned_addr learned my addr 172.21.15.192:0/1237860874 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f7373e00640 1 --2- 172.21.15.192:0/1237860874 >> v2:172.21.15.194:3300/0 conn(0x7f737c06b3d0 0x7f737c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.896+0000 7f737b400640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.897+0000 7f737be00640 1 -- 172.21.15.192:0/1237860874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 msgr2=0x7f737c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.897+0000 7f737be00640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.897+0000 7f737be00640 1 -- 172.21.15.192:0/1237860874 >> v2:172.21.15.194:3300/0 conn(0x7f737c06b3d0 msgr2=0x7f737c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.897+0000 7f737be00640 1 --2- 172.21.15.192:0/1237860874 >> v2:172.21.15.194:3300/0 conn(0x7f737c06b3d0 0x7f737c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.897+0000 7f737be00640 1 -- 172.21.15.192:0/1237860874 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c0b3c00 con 0x7f737c06e990 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f737be00640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0cde00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f737c0b1620 tx=0x7f737402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eaa7949b9585ee9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f737aa00640 1 -- 172.21.15.192:0/1237860874 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374031600 con 0x7f737c06e990 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f737aa00640 1 -- 172.21.15.192:0/1237860874 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737402d050 con 0x7f737c06e990 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f737aa00640 1 -- 172.21.15.192:0/1237860874 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7374031980 con 0x7f737c06e990 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 -- 172.21.15.192:0/1237860874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 msgr2=0x7f737c0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0cde00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f737c0b1620 tx=0x7f737402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 -- 172.21.15.192:0/1237860874 shutdown_connections 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0cde00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 --2- 172.21.15.192:0/1237860874 >> v2:172.21.15.194:3300/0 conn(0x7f737c06b3d0 0x7f737c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.898+0000 7f7380a00640 1 --2- 172.21.15.192:0/1237860874 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.899+0000 7f7380a00640 1 -- 172.21.15.192:0/1237860874 >> 172.21.15.192:0/1237860874 conn(0x7f737c0736d0 msgr2=0x7f737c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.899+0000 7f7380a00640 1 -- 172.21.15.192:0/1237860874 shutdown_connections 2024-09-13T18:37:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.899+0000 7f7380a00640 1 -- 172.21.15.192:0/1237860874 wait complete. 2024-09-13T18:37:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.900+0000 7f7380a00640 1 Processor -- start 2024-09-13T18:37:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.900+0000 7f7380a00640 1 -- start start 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 0x7f737c15b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0cbfe0 con 0x7f737c06e990 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c15bbf0 con 0x7f737c06b3d0 2024-09-13T18:37:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7380a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1f3250 con 0x7f737c15a9e0 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7373e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7373e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44732/0 (socket says 172.21.15.192:44732) 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.901+0000 7f7373e00640 1 -- 172.21.15.192:0/1617847223 learned_addr learned my addr 172.21.15.192:0/1617847223 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f737be00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f737b400640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 0x7f737c15b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 -- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 msgr2=0x7f737c0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 -- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 msgr2=0x7f737c15b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 0x7f737c15b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 -- 172.21.15.192:0/1617847223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374009b30 con 0x7f737c06e990 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f737b400640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 0x7f737c15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f737be00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373e00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f736400e870 tx=0x7f736400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364009590 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f736400c940 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736400ccf0 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0cb6b0 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.902+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0cbc70 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.904+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c0cc150 con 0x7f737c06e990 2024-09-13T18:37:26.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.904+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7364013470 con 0x7f737c06e990 2024-09-13T18:37:26.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.905+0000 7f7373400640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 0x7f735806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:26.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.905+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7364089510 con 0x7f737c06e990 2024-09-13T18:37:26.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.905+0000 7f737b400640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 0x7f735806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:26.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.906+0000 7f737b400640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 0x7f735806d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f736c009a20 tx=0x7f736c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:26.910+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73640546f0 con 0x7f737c06e990 2024-09-13T18:37:27.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.081+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f737c06a970 con 0x7f735806ac30 2024-09-13T18:37:27.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.089+0000 7f7373400640 1 -- 172.21.15.192:0/1617847223 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284804 (secure 0 0 0) 0x7f736c004030 con 0x7f735806ac30 2024-09-13T18:37:27.095 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:27.097 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:37:27.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 msgr2=0x7f735806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 0x7f735806d0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f736c009a20 tx=0x7f736c008040 comp rx=0 tx=0).stop 2024-09-13T18:37:27.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 msgr2=0x7f737c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f736400e870 tx=0x7f736400ed30 comp rx=0 tx=0).stop 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 shutdown_connections 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735806ac30 0x7f735806d0f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c15a9e0 0x7f737c0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c06e990 0x7f737c0ad840 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 --2- 172.21.15.192:0/1617847223 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c06b3d0 0x7f737c15b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 >> 172.21.15.192:0/1617847223 conn(0x7f737c0736d0 msgr2=0x7f737c155700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 shutdown_connections 2024-09-13T18:37:27.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.093+0000 7f7380a00640 1 -- 172.21.15.192:0/1617847223 wait complete. 2024-09-13T18:37:27.113 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-13T18:37:26.990700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2932,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559567,"statfs":{"total":1600000000,"available":1596996655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.443395"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975226+0000","last_change":"2024-09-13T18:37:22.974788+0000","last_active":"2024-09-13T18:37:22.975226+0000","last_peered":"2024-09-13T18:37:22.975226+0000","last_clean":"2024-09-13T18:37:22.975226+0000","last_became_active":"2024-09-13T18:37:22.973222+0000","last_became_peered":"2024-09-13T18:37:22.973222+0000","last_unstale":"2024-09-13T18:37:22.975226+0000","last_undegraded":"2024-09-13T18:37:22.975226+0000","last_fullsized":"2024-09-13T18:37:22.975226+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970671+0000","last_change":"2024-09-13T18:37:22.970254+0000","last_active":"2024-09-13T18:37:22.970671+0000","last_peered":"2024-09-13T18:37:22.970671+0000","last_clean":"2024-09-13T18:37:22.970671+0000","last_became_active":"2024-09-13T18:37:22.969850+0000","last_became_peered":"2024-09-13T18:37:22.969850+0000","last_unstale":"2024-09-13T18:37:22.970671+0000","last_undegraded":"2024-09-13T18:37:22.970671+0000","last_fullsized":"2024-09-13T18:37:22.970671+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:40.383945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966803+0000","last_change":"2024-09-13T18:37:22.966662+0000","last_active":"2024-09-13T18:37:22.966803+0000","last_peered":"2024-09-13T18:37:22.966803+0000","last_clean":"2024-09-13T18:37:22.966803+0000","last_became_active":"2024-09-13T18:37:22.966408+0000","last_became_peered":"2024-09-13T18:37:22.966408+0000","last_unstale":"2024-09-13T18:37:22.966803+0000","last_undegraded":"2024-09-13T18:37:22.966803+0000","last_fullsized":"2024-09-13T18:37:22.966803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:21.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982689+0000","last_change":"2024-09-13T18:37:22.977811+0000","last_active":"2024-09-13T18:37:22.982689+0000","last_peered":"2024-09-13T18:37:22.982689+0000","last_clean":"2024-09-13T18:37:22.982689+0000","last_became_active":"2024-09-13T18:37:22.977250+0000","last_became_peered":"2024-09-13T18:37:22.977250+0000","last_unstale":"2024-09-13T18:37:22.982689+0000","last_undegraded":"2024-09-13T18:37:22.982689+0000","last_fullsized":"2024-09-13T18:37:22.982689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974679+0000","last_change":"2024-09-13T18:37:22.974548+0000","last_active":"2024-09-13T18:37:22.974679+0000","last_peered":"2024-09-13T18:37:22.974679+0000","last_clean":"2024-09-13T18:37:22.974679+0000","last_became_active":"2024-09-13T18:37:22.974355+0000","last_became_peered":"2024-09-13T18:37:22.974355+0000","last_unstale":"2024-09-13T18:37:22.974679+0000","last_undegraded":"2024-09-13T18:37:22.974679+0000","last_fullsized":"2024-09-13T18:37:22.974679+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.128362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987589+0000","last_change":"2024-09-13T18:37:22.987517+0000","last_active":"2024-09-13T18:37:22.987589+0000","last_peered":"2024-09-13T18:37:22.987589+0000","last_clean":"2024-09-13T18:37:22.987589+0000","last_became_active":"2024-09-13T18:37:22.987216+0000","last_became_peered":"2024-09-13T18:37:22.987216+0000","last_unstale":"2024-09-13T18:37:22.987589+0000","last_undegraded":"2024-09-13T18:37:22.987589+0000","last_fullsized":"2024-09-13T18:37:22.987589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:35.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980256+0000","last_change":"2024-09-13T18:37:22.979981+0000","last_active":"2024-09-13T18:37:22.980256+0000","last_peered":"2024-09-13T18:37:22.980256+0000","last_clean":"2024-09-13T18:37:22.980256+0000","last_became_active":"2024-09-13T18:37:22.979778+0000","last_became_peered":"2024-09-13T18:37:22.979778+0000","last_unstale":"2024-09-13T18:37:22.980256+0000","last_undegraded":"2024-09-13T18:37:22.980256+0000","last_fullsized":"2024-09-13T18:37:22.980256+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:15.012707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982762+0000","last_change":"2024-09-13T18:37:22.980468+0000","last_active":"2024-09-13T18:37:22.982762+0000","last_peered":"2024-09-13T18:37:22.982762+0000","last_clean":"2024-09-13T18:37:22.982762+0000","last_became_active":"2024-09-13T18:37:22.980220+0000","last_became_peered":"2024-09-13T18:37:22.980220+0000","last_unstale":"2024-09-13T18:37:22.982762+0000","last_undegraded":"2024-09-13T18:37:22.982762+0000","last_fullsized":"2024-09-13T18:37:22.982762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:42.518277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.985589+0000","last_change":"2024-09-13T18:37:22.985226+0000","last_active":"2024-09-13T18:37:22.985589+0000","last_peered":"2024-09-13T18:37:22.985589+0000","last_clean":"2024-09-13T18:37:22.985589+0000","last_became_active":"2024-09-13T18:37:22.984795+0000","last_became_peered":"2024-09-13T18:37:22.984795+0000","last_unstale":"2024-09-13T18:37:22.985589+0000","last_undegraded":"2024-09-13T18:37:22.985589+0000","last_fullsized":"2024-09-13T18:37:22.985589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:11.735399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967528+0000","last_change":"2024-09-13T18:37:22.967096+0000","last_active":"2024-09-13T18:37:22.967528+0000","last_peered":"2024-09-13T18:37:22.967528+0000","last_clean":"2024-09-13T18:37:22.967528+0000","last_became_active":"2024-09-13T18:37:22.966737+0000","last_became_peered":"2024-09-13T18:37:22.966737+0000","last_unstale":"2024-09-13T18:37:22.967528+0000","last_undegraded":"2024-09-13T18:37:22.967528+0000","last_fullsized":"2024-09-13T18:37:22.967528+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.393425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986127+0000","last_change":"2024-09-13T18:37:22.985981+0000","last_active":"2024-09-13T18:37:22.986127+0000","last_peered":"2024-09-13T18:37:22.986127+0000","last_clean":"2024-09-13T18:37:22.986127+0000","last_became_active":"2024-09-13T18:37:22.985371+0000","last_became_peered":"2024-09-13T18:37:22.985371+0000","last_unstale":"2024-09-13T18:37:22.986127+0000","last_undegraded":"2024-09-13T18:37:22.986127+0000","last_fullsized":"2024-09-13T18:37:22.986127+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:04.969268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968656+0000","last_change":"2024-09-13T18:37:22.968038+0000","last_active":"2024-09-13T18:37:22.968656+0000","last_peered":"2024-09-13T18:37:22.968656+0000","last_clean":"2024-09-13T18:37:22.968656+0000","last_became_active":"2024-09-13T18:37:22.967780+0000","last_became_peered":"2024-09-13T18:37:22.967780+0000","last_unstale":"2024-09-13T18:37:22.968656+0000","last_undegraded":"2024-09-13T18:37:22.968656+0000","last_fullsized":"2024-09-13T18:37:22.968656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987531+0000","last_change":"2024-09-13T18:37:22.987459+0000","last_active":"2024-09-13T18:37:22.987531+0000","last_peered":"2024-09-13T18:37:22.987531+0000","last_clean":"2024-09-13T18:37:22.987531+0000","last_became_active":"2024-09-13T18:37:22.987127+0000","last_became_peered":"2024-09-13T18:37:22.987127+0000","last_unstale":"2024-09-13T18:37:22.987531+0000","last_undegraded":"2024-09-13T18:37:22.987531+0000","last_fullsized":"2024-09-13T18:37:22.987531+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987674+0000","last_change":"2024-09-13T18:37:22.987602+0000","last_active":"2024-09-13T18:37:22.987674+0000","last_peered":"2024-09-13T18:37:22.987674+0000","last_clean":"2024-09-13T18:37:22.987674+0000","last_became_active":"2024-09-13T18:37:22.986603+0000","last_became_peered":"2024-09-13T18:37:22.986603+0000","last_unstale":"2024-09-13T18:37:22.987674+0000","last_undegraded":"2024-09-13T18:37:22.987674+0000","last_fullsized":"2024-09-13T18:37:22.987674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:35.447287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986083+0000","last_change":"2024-09-13T18:37:22.985854+0000","last_active":"2024-09-13T18:37:22.986083+0000","last_peered":"2024-09-13T18:37:22.986083+0000","last_clean":"2024-09-13T18:37:22.986083+0000","last_became_active":"2024-09-13T18:37:22.985335+0000","last_became_peered":"2024-09-13T18:37:22.985335+0000","last_unstale":"2024-09-13T18:37:22.986083+0000","last_undegraded":"2024-09-13T18:37:22.986083+0000","last_fullsized":"2024-09-13T18:37:22.986083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.183032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986656+0000","last_change":"2024-09-13T18:37:22.986589+0000","last_active":"2024-09-13T18:37:22.986656+0000","last_peered":"2024-09-13T18:37:22.986656+0000","last_clean":"2024-09-13T18:37:22.986656+0000","last_became_active":"2024-09-13T18:37:22.986382+0000","last_became_peered":"2024-09-13T18:37:22.986382+0000","last_unstale":"2024-09-13T18:37:22.986656+0000","last_undegraded":"2024-09-13T18:37:22.986656+0000","last_fullsized":"2024-09-13T18:37:22.986656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:40.383945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977339+0000","last_change":"2024-09-13T18:37:22.977143+0000","last_active":"2024-09-13T18:37:22.977339+0000","last_peered":"2024-09-13T18:37:22.977339+0000","last_clean":"2024-09-13T18:37:22.977339+0000","last_became_active":"2024-09-13T18:37:22.976480+0000","last_became_peered":"2024-09-13T18:37:22.976480+0000","last_unstale":"2024-09-13T18:37:22.977339+0000","last_undegraded":"2024-09-13T18:37:22.977339+0000","last_fullsized":"2024-09-13T18:37:22.977339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:35.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984865+0000","last_change":"2024-09-13T18:37:22.984805+0000","last_active":"2024-09-13T18:37:22.984865+0000","last_peered":"2024-09-13T18:37:22.984865+0000","last_clean":"2024-09-13T18:37:22.984865+0000","last_became_active":"2024-09-13T18:37:22.984584+0000","last_became_peered":"2024-09-13T18:37:22.984584+0000","last_unstale":"2024-09-13T18:37:22.984865+0000","last_undegraded":"2024-09-13T18:37:22.984865+0000","last_fullsized":"2024-09-13T18:37:22.984865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973961+0000","last_change":"2024-09-13T18:37:22.973861+0000","last_active":"2024-09-13T18:37:22.973961+0000","last_peered":"2024-09-13T18:37:22.973961+0000","last_clean":"2024-09-13T18:37:22.973961+0000","last_became_active":"2024-09-13T18:37:22.973631+0000","last_became_peered":"2024-09-13T18:37:22.973631+0000","last_unstale":"2024-09-13T18:37:22.973961+0000","last_undegraded":"2024-09-13T18:37:22.973961+0000","last_fullsized":"2024-09-13T18:37:22.973961+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967510+0000","last_change":"2024-09-13T18:37:22.966946+0000","last_active":"2024-09-13T18:37:22.967510+0000","last_peered":"2024-09-13T18:37:22.967510+0000","last_clean":"2024-09-13T18:37:22.967510+0000","last_became_active":"2024-09-13T18:37:22.966436+0000","last_became_peered":"2024-09-13T18:37:22.966436+0000","last_unstale":"2024-09-13T18:37:22.967510+0000","last_undegraded":"2024-09-13T18:37:22.967510+0000","last_fullsized":"2024-09-13T18:37:22.967510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:04.969268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984868+0000","last_change":"2024-09-13T18:37:22.983811+0000","last_active":"2024-09-13T18:37:22.984868+0000","last_peered":"2024-09-13T18:37:22.984868+0000","last_clean":"2024-09-13T18:37:22.984868+0000","last_became_active":"2024-09-13T18:37:22.977439+0000","last_became_peered":"2024-09-13T18:37:22.977439+0000","last_unstale":"2024-09-13T18:37:22.984868+0000","last_undegraded":"2024-09-13T18:37:22.984868+0000","last_fullsized":"2024-09-13T18:37:22.984868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:11.647077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974716+0000","last_change":"2024-09-13T18:37:22.972255+0000","last_active":"2024-09-13T18:37:22.974716+0000","last_peered":"2024-09-13T18:37:22.974716+0000","last_clean":"2024-09-13T18:37:22.974716+0000","last_became_active":"2024-09-13T18:37:22.971341+0000","last_became_peered":"2024-09-13T18:37:22.971341+0000","last_unstale":"2024-09-13T18:37:22.974716+0000","last_undegraded":"2024-09-13T18:37:22.974716+0000","last_fullsized":"2024-09-13T18:37:22.974716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:23.935718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975291+0000","last_change":"2024-09-13T18:37:22.975140+0000","last_active":"2024-09-13T18:37:22.975291+0000","last_peered":"2024-09-13T18:37:22.975291+0000","last_clean":"2024-09-13T18:37:22.975291+0000","last_became_active":"2024-09-13T18:37:22.974927+0000","last_became_peered":"2024-09-13T18:37:22.974927+0000","last_unstale":"2024-09-13T18:37:22.975291+0000","last_undegraded":"2024-09-13T18:37:22.975291+0000","last_fullsized":"2024-09-13T18:37:22.975291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:58.101640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.978816+0000","last_change":"2024-09-13T18:37:22.978751+0000","last_active":"2024-09-13T18:37:22.978816+0000","last_peered":"2024-09-13T18:37:22.978816+0000","last_clean":"2024-09-13T18:37:22.978816+0000","last_became_active":"2024-09-13T18:37:22.978542+0000","last_became_peered":"2024-09-13T18:37:22.978542+0000","last_unstale":"2024-09-13T18:37:22.978816+0000","last_undegraded":"2024-09-13T18:37:22.978816+0000","last_fullsized":"2024-09-13T18:37:22.978816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:14.091193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972980+0000","last_change":"2024-09-13T18:37:22.972890+0000","last_active":"2024-09-13T18:37:22.972980+0000","last_peered":"2024-09-13T18:37:22.972980+0000","last_clean":"2024-09-13T18:37:22.972980+0000","last_became_active":"2024-09-13T18:37:22.972666+0000","last_became_peered":"2024-09-13T18:37:22.972666+0000","last_unstale":"2024-09-13T18:37:22.972980+0000","last_undegraded":"2024-09-13T18:37:22.972980+0000","last_fullsized":"2024-09-13T18:37:22.972980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:41.665728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986066+0000","last_change":"2024-09-13T18:37:22.985784+0000","last_active":"2024-09-13T18:37:22.986066+0000","last_peered":"2024-09-13T18:37:22.986066+0000","last_clean":"2024-09-13T18:37:22.986066+0000","last_became_active":"2024-09-13T18:37:22.985044+0000","last_became_peered":"2024-09-13T18:37:22.985044+0000","last_unstale":"2024-09-13T18:37:22.986066+0000","last_undegraded":"2024-09-13T18:37:22.986066+0000","last_fullsized":"2024-09-13T18:37:22.986066+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:05.978858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969967+0000","last_change":"2024-09-13T18:37:22.969855+0000","last_active":"2024-09-13T18:37:22.969967+0000","last_peered":"2024-09-13T18:37:22.969967+0000","last_clean":"2024-09-13T18:37:22.969967+0000","last_became_active":"2024-09-13T18:37:22.969465+0000","last_became_peered":"2024-09-13T18:37:22.969465+0000","last_unstale":"2024-09-13T18:37:22.969967+0000","last_undegraded":"2024-09-13T18:37:22.969967+0000","last_fullsized":"2024-09-13T18:37:22.969967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:51.702797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971924+0000","last_change":"2024-09-13T18:37:22.971852+0000","last_active":"2024-09-13T18:37:22.971924+0000","last_peered":"2024-09-13T18:37:22.971924+0000","last_clean":"2024-09-13T18:37:22.971924+0000","last_became_active":"2024-09-13T18:37:22.971438+0000","last_became_peered":"2024-09-13T18:37:22.971438+0000","last_unstale":"2024-09-13T18:37:22.971924+0000","last_undegraded":"2024-09-13T18:37:22.971924+0000","last_fullsized":"2024-09-13T18:37:22.971924+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:24.240978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984137+0000","last_change":"2024-09-13T18:37:22.984067+0000","last_active":"2024-09-13T18:37:22.984137+0000","last_peered":"2024-09-13T18:37:22.984137+0000","last_clean":"2024-09-13T18:37:22.984137+0000","last_became_active":"2024-09-13T18:37:22.983847+0000","last_became_peered":"2024-09-13T18:37:22.983847+0000","last_unstale":"2024-09-13T18:37:22.984137+0000","last_undegraded":"2024-09-13T18:37:22.984137+0000","last_fullsized":"2024-09-13T18:37:22.984137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971086+0000","last_change":"2024-09-13T18:37:22.971005+0000","last_active":"2024-09-13T18:37:22.971086+0000","last_peered":"2024-09-13T18:37:22.971086+0000","last_clean":"2024-09-13T18:37:22.971086+0000","last_became_active":"2024-09-13T18:37:22.970715+0000","last_became_peered":"2024-09-13T18:37:22.970715+0000","last_unstale":"2024-09-13T18:37:22.971086+0000","last_undegraded":"2024-09-13T18:37:22.971086+0000","last_fullsized":"2024-09-13T18:37:22.971086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980664+0000","last_change":"2024-09-13T18:37:22.980304+0000","last_active":"2024-09-13T18:37:22.980664+0000","last_peered":"2024-09-13T18:37:22.980664+0000","last_clean":"2024-09-13T18:37:22.980664+0000","last_became_active":"2024-09-13T18:37:22.977472+0000","last_became_peered":"2024-09-13T18:37:22.977472+0000","last_unstale":"2024-09-13T18:37:22.980664+0000","last_undegraded":"2024-09-13T18:37:22.980664+0000","last_fullsized":"2024-09-13T18:37:22.980664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:14.091193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982743+0000","last_change":"2024-09-13T18:37:22.978671+0000","last_active":"2024-09-13T18:37:22.982743+0000","last_peered":"2024-09-13T18:37:22.982743+0000","last_clean":"2024-09-13T18:37:22.982743+0000","last_became_active":"2024-09-13T18:37:22.978411+0000","last_became_peered":"2024-09-13T18:37:22.978411+0000","last_unstale":"2024-09-13T18:37:22.982743+0000","last_undegraded":"2024-09-13T18:37:22.982743+0000","last_fullsized":"2024-09-13T18:37:22.982743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.128362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969720+0000","last_change":"2024-09-13T18:37:22.969643+0000","last_active":"2024-09-13T18:37:22.969720+0000","last_peered":"2024-09-13T18:37:22.969720+0000","last_clean":"2024-09-13T18:37:22.969720+0000","last_became_active":"2024-09-13T18:37:22.969397+0000","last_became_peered":"2024-09-13T18:37:22.969397+0000","last_unstale":"2024-09-13T18:37:22.969720+0000","last_undegraded":"2024-09-13T18:37:22.969720+0000","last_fullsized":"2024-09-13T18:37:22.969720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:16.875659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987293+0000","last_change":"2024-09-13T18:37:22.564111+0000","last_active":"2024-09-13T18:37:22.987293+0000","last_peered":"2024-09-13T18:37:22.987293+0000","last_clean":"2024-09-13T18:37:22.987293+0000","last_became_active":"2024-09-13T18:37:22.563537+0000","last_became_peered":"2024-09-13T18:37:22.563537+0000","last_unstale":"2024-09-13T18:37:22.987293+0000","last_undegraded":"2024-09-13T18:37:22.987293+0000","last_fullsized":"2024-09-13T18:37:22.987293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:13.529401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973946+0000","last_change":"2024-09-13T18:37:22.973866+0000","last_active":"2024-09-13T18:37:22.973946+0000","last_peered":"2024-09-13T18:37:22.973946+0000","last_clean":"2024-09-13T18:37:22.973946+0000","last_became_active":"2024-09-13T18:37:22.973644+0000","last_became_peered":"2024-09-13T18:37:22.973644+0000","last_unstale":"2024-09-13T18:37:22.973946+0000","last_undegraded":"2024-09-13T18:37:22.973946+0000","last_fullsized":"2024-09-13T18:37:22.973946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:43.297197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982366+0000","last_change":"2024-09-13T18:37:22.564195+0000","last_active":"2024-09-13T18:37:22.982366+0000","last_peered":"2024-09-13T18:37:22.982366+0000","last_clean":"2024-09-13T18:37:22.982366+0000","last_became_active":"2024-09-13T18:37:22.563962+0000","last_became_peered":"2024-09-13T18:37:22.563962+0000","last_unstale":"2024-09-13T18:37:22.982366+0000","last_undegraded":"2024-09-13T18:37:22.982366+0000","last_fullsized":"2024-09-13T18:37:22.982366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.076868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968639+0000","last_change":"2024-09-13T18:37:22.967021+0000","last_active":"2024-09-13T18:37:22.968639+0000","last_peered":"2024-09-13T18:37:22.968639+0000","last_clean":"2024-09-13T18:37:22.968639+0000","last_became_active":"2024-09-13T18:37:22.966823+0000","last_became_peered":"2024-09-13T18:37:22.966823+0000","last_unstale":"2024-09-13T18:37:22.968639+0000","last_undegraded":"2024-09-13T18:37:22.968639+0000","last_fullsized":"2024-09-13T18:37:22.968639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:28.490321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984968+0000","last_change":"2024-09-13T18:37:22.561947+0000","last_active":"2024-09-13T18:37:22.984968+0000","last_peered":"2024-09-13T18:37:22.984968+0000","last_clean":"2024-09-13T18:37:22.984968+0000","last_became_active":"2024-09-13T18:37:22.561716+0000","last_became_peered":"2024-09-13T18:37:22.561716+0000","last_unstale":"2024-09-13T18:37:22.984968+0000","last_undegraded":"2024-09-13T18:37:22.984968+0000","last_fullsized":"2024-09-13T18:37:22.984968+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.962171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984847+0000","last_change":"2024-09-13T18:37:22.983413+0000","last_active":"2024-09-13T18:37:22.984847+0000","last_peered":"2024-09-13T18:37:22.984847+0000","last_clean":"2024-09-13T18:37:22.984847+0000","last_became_active":"2024-09-13T18:37:22.983168+0000","last_became_peered":"2024-09-13T18:37:22.983168+0000","last_unstale":"2024-09-13T18:37:22.984847+0000","last_undegraded":"2024-09-13T18:37:22.984847+0000","last_fullsized":"2024-09-13T18:37:22.984847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:41.665728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981945+0000","last_change":"2024-09-13T18:37:22.565279+0000","last_active":"2024-09-13T18:37:22.981945+0000","last_peered":"2024-09-13T18:37:22.981945+0000","last_clean":"2024-09-13T18:37:22.981945+0000","last_became_active":"2024-09-13T18:37:22.564800+0000","last_became_peered":"2024-09-13T18:37:22.564800+0000","last_unstale":"2024-09-13T18:37:22.981945+0000","last_undegraded":"2024-09-13T18:37:22.981945+0000","last_fullsized":"2024-09-13T18:37:22.981945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:48.699313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970665+0000","last_change":"2024-09-13T18:37:22.970608+0000","last_active":"2024-09-13T18:37:22.970665+0000","last_peered":"2024-09-13T18:37:22.970665+0000","last_clean":"2024-09-13T18:37:22.970665+0000","last_became_active":"2024-09-13T18:37:22.970475+0000","last_became_peered":"2024-09-13T18:37:22.970475+0000","last_unstale":"2024-09-13T18:37:22.970665+0000","last_undegraded":"2024-09-13T18:37:22.970665+0000","last_fullsized":"2024-09-13T18:37:22.970665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:27.916117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983990+0000","last_change":"2024-09-13T18:37:22.566143+0000","last_active":"2024-09-13T18:37:22.983990+0000","last_peered":"2024-09-13T18:37:22.983990+0000","last_clean":"2024-09-13T18:37:22.983990+0000","last_became_active":"2024-09-13T18:37:22.565908+0000","last_became_peered":"2024-09-13T18:37:22.565908+0000","last_unstale":"2024-09-13T18:37:22.983990+0000","last_undegraded":"2024-09-13T18:37:22.983990+0000","last_fullsized":"2024-09-13T18:37:22.983990+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:57.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982091+0000","last_change":"2024-09-13T18:37:22.981175+0000","last_active":"2024-09-13T18:37:22.982091+0000","last_peered":"2024-09-13T18:37:22.982091+0000","last_clean":"2024-09-13T18:37:22.982091+0000","last_became_active":"2024-09-13T18:37:22.980817+0000","last_became_peered":"2024-09-13T18:37:22.980817+0000","last_unstale":"2024-09-13T18:37:22.982091+0000","last_undegraded":"2024-09-13T18:37:22.982091+0000","last_fullsized":"2024-09-13T18:37:22.982091+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.183032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981695+0000","last_change":"2024-09-13T18:37:22.555547+0000","last_active":"2024-09-13T18:37:22.981695+0000","last_peered":"2024-09-13T18:37:22.981695+0000","last_clean":"2024-09-13T18:37:22.981695+0000","last_became_active":"2024-09-13T18:37:22.554960+0000","last_became_peered":"2024-09-13T18:37:22.554960+0000","last_unstale":"2024-09-13T18:37:22.981695+0000","last_undegraded":"2024-09-13T18:37:22.981695+0000","last_fullsized":"2024-09-13T18:37:22.981695+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:16.904745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982137+0000","last_change":"2024-09-13T18:37:22.981597+0000","last_active":"2024-09-13T18:37:22.982137+0000","last_peered":"2024-09-13T18:37:22.982137+0000","last_clean":"2024-09-13T18:37:22.982137+0000","last_became_active":"2024-09-13T18:37:22.979429+0000","last_became_peered":"2024-09-13T18:37:22.979429+0000","last_unstale":"2024-09-13T18:37:22.982137+0000","last_undegraded":"2024-09-13T18:37:22.982137+0000","last_fullsized":"2024-09-13T18:37:22.982137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:41.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971448+0000","last_change":"2024-09-13T18:37:22.566498+0000","last_active":"2024-09-13T18:37:22.971448+0000","last_peered":"2024-09-13T18:37:22.971448+0000","last_clean":"2024-09-13T18:37:22.971448+0000","last_became_active":"2024-09-13T18:37:22.566228+0000","last_became_peered":"2024-09-13T18:37:22.566228+0000","last_unstale":"2024-09-13T18:37:22.971448+0000","last_undegraded":"2024-09-13T18:37:22.971448+0000","last_fullsized":"2024-09-13T18:37:22.971448+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:10.584149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973555+0000","last_change":"2024-09-13T18:37:22.973479+0000","last_active":"2024-09-13T18:37:22.973555+0000","last_peered":"2024-09-13T18:37:22.973555+0000","last_clean":"2024-09-13T18:37:22.973555+0000","last_became_active":"2024-09-13T18:37:22.973266+0000","last_became_peered":"2024-09-13T18:37:22.973266+0000","last_unstale":"2024-09-13T18:37:22.973555+0000","last_undegraded":"2024-09-13T18:37:22.973555+0000","last_fullsized":"2024-09-13T18:37:22.973555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:37.121583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.961942+0000","last_change":"2024-09-13T18:37:22.566709+0000","last_active":"2024-09-13T18:37:22.961942+0000","last_peered":"2024-09-13T18:37:22.961942+0000","last_clean":"2024-09-13T18:37:22.961942+0000","last_became_active":"2024-09-13T18:37:22.566504+0000","last_became_peered":"2024-09-13T18:37:22.566504+0000","last_unstale":"2024-09-13T18:37:22.961942+0000","last_undegraded":"2024-09-13T18:37:22.961942+0000","last_fullsized":"2024-09-13T18:37:22.961942+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.378102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968306+0000","last_change":"2024-09-13T18:37:22.967345+0000","last_active":"2024-09-13T18:37:22.968306+0000","last_peered":"2024-09-13T18:37:22.968306+0000","last_clean":"2024-09-13T18:37:22.968306+0000","last_became_active":"2024-09-13T18:37:22.967084+0000","last_became_peered":"2024-09-13T18:37:22.967084+0000","last_unstale":"2024-09-13T18:37:22.968306+0000","last_undegraded":"2024-09-13T18:37:22.968306+0000","last_fullsized":"2024-09-13T18:37:22.968306+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.766433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963684+0000","last_change":"2024-09-13T18:37:22.560345+0000","last_active":"2024-09-13T18:37:22.963684+0000","last_peered":"2024-09-13T18:37:22.963684+0000","last_clean":"2024-09-13T18:37:22.963684+0000","last_became_active":"2024-09-13T18:37:22.559030+0000","last_became_peered":"2024-09-13T18:37:22.559030+0000","last_unstale":"2024-09-13T18:37:22.963684+0000","last_undegraded":"2024-09-13T18:37:22.963684+0000","last_fullsized":"2024-09-13T18:37:22.963684+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:56.115687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975607+0000","last_change":"2024-09-13T18:37:22.975052+0000","last_active":"2024-09-13T18:37:22.975607+0000","last_peered":"2024-09-13T18:37:22.975607+0000","last_clean":"2024-09-13T18:37:22.975607+0000","last_became_active":"2024-09-13T18:37:22.974823+0000","last_became_peered":"2024-09-13T18:37:22.974823+0000","last_unstale":"2024-09-13T18:37:22.975607+0000","last_undegraded":"2024-09-13T18:37:22.975607+0000","last_fullsized":"2024-09-13T18:37:22.975607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:13.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.961530+0000","last_change":"2024-09-13T18:37:22.562062+0000","last_active":"2024-09-13T18:37:22.961530+0000","last_peered":"2024-09-13T18:37:22.961530+0000","last_clean":"2024-09-13T18:37:22.961530+0000","last_became_active":"2024-09-13T18:37:22.559584+0000","last_became_peered":"2024-09-13T18:37:22.559584+0000","last_unstale":"2024-09-13T18:37:22.961530+0000","last_undegraded":"2024-09-13T18:37:22.961530+0000","last_fullsized":"2024-09-13T18:37:22.961530+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:05.025346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.988085+0000","last_change":"2024-09-13T18:37:22.987746+0000","last_active":"2024-09-13T18:37:22.988085+0000","last_peered":"2024-09-13T18:37:22.988085+0000","last_clean":"2024-09-13T18:37:22.988085+0000","last_became_active":"2024-09-13T18:37:22.987260+0000","last_became_peered":"2024-09-13T18:37:22.987260+0000","last_unstale":"2024-09-13T18:37:22.988085+0000","last_undegraded":"2024-09-13T18:37:22.988085+0000","last_fullsized":"2024-09-13T18:37:22.988085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.393425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980414+0000","last_change":"2024-09-13T18:37:22.562184+0000","last_active":"2024-09-13T18:37:22.980414+0000","last_peered":"2024-09-13T18:37:22.980414+0000","last_clean":"2024-09-13T18:37:22.980414+0000","last_became_active":"2024-09-13T18:37:22.561905+0000","last_became_peered":"2024-09-13T18:37:22.561905+0000","last_unstale":"2024-09-13T18:37:22.980414+0000","last_undegraded":"2024-09-13T18:37:22.980414+0000","last_fullsized":"2024-09-13T18:37:22.980414+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:22.929875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983670+0000","last_change":"2024-09-13T18:37:22.983595+0000","last_active":"2024-09-13T18:37:22.983670+0000","last_peered":"2024-09-13T18:37:22.983670+0000","last_clean":"2024-09-13T18:37:22.983670+0000","last_became_active":"2024-09-13T18:37:22.983351+0000","last_became_peered":"2024-09-13T18:37:22.983351+0000","last_unstale":"2024-09-13T18:37:22.983670+0000","last_undegraded":"2024-09-13T18:37:22.983670+0000","last_fullsized":"2024-09-13T18:37:22.983670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:18.076060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.988660+0000","last_change":"2024-09-13T18:37:22.556903+0000","last_active":"2024-09-13T18:37:22.988660+0000","last_peered":"2024-09-13T18:37:22.988660+0000","last_clean":"2024-09-13T18:37:22.988660+0000","last_became_active":"2024-09-13T18:37:22.556075+0000","last_became_peered":"2024-09-13T18:37:22.556075+0000","last_unstale":"2024-09-13T18:37:22.988660+0000","last_undegraded":"2024-09-13T18:37:22.988660+0000","last_fullsized":"2024-09-13T18:37:22.988660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:13.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987309+0000","last_change":"2024-09-13T18:37:22.987250+0000","last_active":"2024-09-13T18:37:22.987309+0000","last_peered":"2024-09-13T18:37:22.987309+0000","last_clean":"2024-09-13T18:37:22.987309+0000","last_became_active":"2024-09-13T18:37:22.987009+0000","last_became_peered":"2024-09-13T18:37:22.987009+0000","last_unstale":"2024-09-13T18:37:22.987309+0000","last_undegraded":"2024-09-13T18:37:22.987309+0000","last_fullsized":"2024-09-13T18:37:22.987309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.615020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981315+0000","last_change":"2024-09-13T18:37:22.562246+0000","last_active":"2024-09-13T18:37:22.981315+0000","last_peered":"2024-09-13T18:37:22.981315+0000","last_clean":"2024-09-13T18:37:22.981315+0000","last_became_active":"2024-09-13T18:37:22.562005+0000","last_became_peered":"2024-09-13T18:37:22.562005+0000","last_unstale":"2024-09-13T18:37:22.981315+0000","last_undegraded":"2024-09-13T18:37:22.981315+0000","last_fullsized":"2024-09-13T18:37:22.981315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:19.213798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969044+0000","last_change":"2024-09-13T18:37:22.968220+0000","last_active":"2024-09-13T18:37:22.969044+0000","last_peered":"2024-09-13T18:37:22.969044+0000","last_clean":"2024-09-13T18:37:22.969044+0000","last_became_active":"2024-09-13T18:37:22.967956+0000","last_became_peered":"2024-09-13T18:37:22.967956+0000","last_unstale":"2024-09-13T18:37:22.969044+0000","last_undegraded":"2024-09-13T18:37:22.969044+0000","last_fullsized":"2024-09-13T18:37:22.969044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:45.923745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972087+0000","last_change":"2024-09-13T18:37:22.555862+0000","last_active":"2024-09-13T18:37:22.972087+0000","last_peered":"2024-09-13T18:37:22.972087+0000","last_clean":"2024-09-13T18:37:22.972087+0000","last_became_active":"2024-09-13T18:37:22.555599+0000","last_became_peered":"2024-09-13T18:37:22.555599+0000","last_unstale":"2024-09-13T18:37:22.972087+0000","last_undegraded":"2024-09-13T18:37:22.972087+0000","last_fullsized":"2024-09-13T18:37:22.972087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974657+0000","last_change":"2024-09-13T18:37:22.969828+0000","last_active":"2024-09-13T18:37:22.974657+0000","last_peered":"2024-09-13T18:37:22.974657+0000","last_clean":"2024-09-13T18:37:22.974657+0000","last_became_active":"2024-09-13T18:37:22.969524+0000","last_became_peered":"2024-09-13T18:37:22.969524+0000","last_unstale":"2024-09-13T18:37:22.974657+0000","last_undegraded":"2024-09-13T18:37:22.974657+0000","last_fullsized":"2024-09-13T18:37:22.974657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:35.748071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970486+0000","last_change":"2024-09-13T18:37:22.564684+0000","last_active":"2024-09-13T18:37:22.970486+0000","last_peered":"2024-09-13T18:37:22.970486+0000","last_clean":"2024-09-13T18:37:22.970486+0000","last_became_active":"2024-09-13T18:37:22.564282+0000","last_became_peered":"2024-09-13T18:37:22.564282+0000","last_unstale":"2024-09-13T18:37:22.970486+0000","last_undegraded":"2024-09-13T18:37:22.970486+0000","last_fullsized":"2024-09-13T18:37:22.970486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:14.849785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977047+0000","last_change":"2024-09-13T18:37:22.976989+0000","last_active":"2024-09-13T18:37:22.977047+0000","last_peered":"2024-09-13T18:37:22.977047+0000","last_clean":"2024-09-13T18:37:22.977047+0000","last_became_active":"2024-09-13T18:37:22.976219+0000","last_became_peered":"2024-09-13T18:37:22.976219+0000","last_unstale":"2024-09-13T18:37:22.977047+0000","last_undegraded":"2024-09-13T18:37:22.977047+0000","last_fullsized":"2024-09-13T18:37:22.977047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:06.031189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983764+0000","last_change":"2024-09-13T18:37:22.565560+0000","last_active":"2024-09-13T18:37:22.983764+0000","last_peered":"2024-09-13T18:37:22.983764+0000","last_clean":"2024-09-13T18:37:22.983764+0000","last_became_active":"2024-09-13T18:37:22.565302+0000","last_became_peered":"2024-09-13T18:37:22.565302+0000","last_unstale":"2024-09-13T18:37:22.983764+0000","last_undegraded":"2024-09-13T18:37:22.983764+0000","last_fullsized":"2024-09-13T18:37:22.983764+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:15.476179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967580+0000","last_change":"2024-09-13T18:37:22.967368+0000","last_active":"2024-09-13T18:37:22.967580+0000","last_peered":"2024-09-13T18:37:22.967580+0000","last_clean":"2024-09-13T18:37:22.967580+0000","last_became_active":"2024-09-13T18:37:22.966678+0000","last_became_peered":"2024-09-13T18:37:22.966678+0000","last_unstale":"2024-09-13T18:37:22.967580+0000","last_undegraded":"2024-09-13T18:37:22.967580+0000","last_fullsized":"2024-09-13T18:37:22.967580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.615020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987457+0000","last_change":"2024-09-13T18:37:22.566177+0000","last_active":"2024-09-13T18:37:22.987457+0000","last_peered":"2024-09-13T18:37:22.987457+0000","last_clean":"2024-09-13T18:37:22.987457+0000","last_became_active":"2024-09-13T18:37:22.565719+0000","last_became_peered":"2024-09-13T18:37:22.565719+0000","last_unstale":"2024-09-13T18:37:22.987457+0000","last_undegraded":"2024-09-13T18:37:22.987457+0000","last_fullsized":"2024-09-13T18:37:22.987457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:13.529401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974700+0000","last_change":"2024-09-13T18:37:22.972081+0000","last_active":"2024-09-13T18:37:22.974700+0000","last_peered":"2024-09-13T18:37:22.974700+0000","last_clean":"2024-09-13T18:37:22.974700+0000","last_became_active":"2024-09-13T18:37:22.971842+0000","last_became_peered":"2024-09-13T18:37:22.971842+0000","last_unstale":"2024-09-13T18:37:22.974700+0000","last_undegraded":"2024-09-13T18:37:22.974700+0000","last_fullsized":"2024-09-13T18:37:22.974700+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:00.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984837+0000","last_change":"2024-09-13T18:37:22.564375+0000","last_active":"2024-09-13T18:37:22.984837+0000","last_peered":"2024-09-13T18:37:22.984837+0000","last_clean":"2024-09-13T18:37:22.984837+0000","last_became_active":"2024-09-13T18:37:22.564168+0000","last_became_peered":"2024-09-13T18:37:22.564168+0000","last_unstale":"2024-09-13T18:37:22.984837+0000","last_undegraded":"2024-09-13T18:37:22.984837+0000","last_fullsized":"2024-09-13T18:37:22.984837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:23.356979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977356+0000","last_change":"2024-09-13T18:37:22.977279+0000","last_active":"2024-09-13T18:37:22.977356+0000","last_peered":"2024-09-13T18:37:22.977356+0000","last_clean":"2024-09-13T18:37:22.977356+0000","last_became_active":"2024-09-13T18:37:22.976785+0000","last_became_peered":"2024-09-13T18:37:22.976785+0000","last_unstale":"2024-09-13T18:37:22.977356+0000","last_undegraded":"2024-09-13T18:37:22.977356+0000","last_fullsized":"2024-09-13T18:37:22.977356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:11.735399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982989+0000","last_change":"2024-09-13T18:37:22.564129+0000","last_active":"2024-09-13T18:37:22.982989+0000","last_peered":"2024-09-13T18:37:22.982989+0000","last_clean":"2024-09-13T18:37:22.982989+0000","last_became_active":"2024-09-13T18:37:22.563859+0000","last_became_peered":"2024-09-13T18:37:22.563859+0000","last_unstale":"2024-09-13T18:37:22.982989+0000","last_undegraded":"2024-09-13T18:37:22.982989+0000","last_fullsized":"2024-09-13T18:37:22.982989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:04.820529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966850+0000","last_change":"2024-09-13T18:37:22.966758+0000","last_active":"2024-09-13T18:37:22.966850+0000","last_peered":"2024-09-13T18:37:22.966850+0000","last_clean":"2024-09-13T18:37:22.966850+0000","last_became_active":"2024-09-13T18:37:22.966528+0000","last_became_peered":"2024-09-13T18:37:22.966528+0000","last_unstale":"2024-09-13T18:37:22.966850+0000","last_undegraded":"2024-09-13T18:37:22.966850+0000","last_fullsized":"2024-09-13T18:37:22.966850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:16.325436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970574+0000","last_change":"2024-09-13T18:37:22.564503+0000","last_active":"2024-09-13T18:37:22.970574+0000","last_peered":"2024-09-13T18:37:22.970574+0000","last_clean":"2024-09-13T18:37:22.970574+0000","last_became_active":"2024-09-13T18:37:22.563933+0000","last_became_peered":"2024-09-13T18:37:22.563933+0000","last_unstale":"2024-09-13T18:37:22.970574+0000","last_undegraded":"2024-09-13T18:37:22.970574+0000","last_fullsized":"2024-09-13T18:37:22.970574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982718+0000","last_change":"2024-09-13T18:37:22.982342+0000","last_active":"2024-09-13T18:37:22.982718+0000","last_peered":"2024-09-13T18:37:22.982718+0000","last_clean":"2024-09-13T18:37:22.982718+0000","last_became_active":"2024-09-13T18:37:22.978435+0000","last_became_peered":"2024-09-13T18:37:22.978435+0000","last_unstale":"2024-09-13T18:37:22.982718+0000","last_undegraded":"2024-09-13T18:37:22.982718+0000","last_fullsized":"2024-09-13T18:37:22.982718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.129408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983935+0000","last_change":"2024-09-13T18:37:22.562921+0000","last_active":"2024-09-13T18:37:22.983935+0000","last_peered":"2024-09-13T18:37:22.983935+0000","last_clean":"2024-09-13T18:37:22.983935+0000","last_became_active":"2024-09-13T18:37:22.562656+0000","last_became_peered":"2024-09-13T18:37:22.562656+0000","last_unstale":"2024-09-13T18:37:22.983935+0000","last_undegraded":"2024-09-13T18:37:22.983935+0000","last_fullsized":"2024-09-13T18:37:22.983935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:34.761566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973873+0000","last_change":"2024-09-13T18:37:22.973717+0000","last_active":"2024-09-13T18:37:22.973873+0000","last_peered":"2024-09-13T18:37:22.973873+0000","last_clean":"2024-09-13T18:37:22.973873+0000","last_became_active":"2024-09-13T18:37:22.973485+0000","last_became_peered":"2024-09-13T18:37:22.973485+0000","last_unstale":"2024-09-13T18:37:22.973873+0000","last_undegraded":"2024-09-13T18:37:22.973873+0000","last_fullsized":"2024-09-13T18:37:22.973873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:06.031189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971534+0000","last_change":"2024-09-13T18:37:22.562902+0000","last_active":"2024-09-13T18:37:22.971534+0000","last_peered":"2024-09-13T18:37:22.971534+0000","last_clean":"2024-09-13T18:37:22.971534+0000","last_became_active":"2024-09-13T18:37:22.560205+0000","last_became_peered":"2024-09-13T18:37:22.560205+0000","last_unstale":"2024-09-13T18:37:22.971534+0000","last_undegraded":"2024-09-13T18:37:22.971534+0000","last_fullsized":"2024-09-13T18:37:22.971534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:57.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984910+0000","last_change":"2024-09-13T18:37:22.984585+0000","last_active":"2024-09-13T18:37:22.984910+0000","last_peered":"2024-09-13T18:37:22.984910+0000","last_clean":"2024-09-13T18:37:22.984910+0000","last_became_active":"2024-09-13T18:37:22.980785+0000","last_became_peered":"2024-09-13T18:37:22.980785+0000","last_unstale":"2024-09-13T18:37:22.984910+0000","last_undegraded":"2024-09-13T18:37:22.984910+0000","last_fullsized":"2024-09-13T18:37:22.984910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:13.737567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.962050+0000","last_change":"2024-09-13T18:37:22.563706+0000","last_active":"2024-09-13T18:37:22.962050+0000","last_peered":"2024-09-13T18:37:22.962050+0000","last_clean":"2024-09-13T18:37:22.962050+0000","last_became_active":"2024-09-13T18:37:22.563503+0000","last_became_peered":"2024-09-13T18:37:22.563503+0000","last_unstale":"2024-09-13T18:37:22.962050+0000","last_undegraded":"2024-09-13T18:37:22.962050+0000","last_fullsized":"2024-09-13T18:37:22.962050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:10.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986143+0000","last_change":"2024-09-13T18:37:22.985993+0000","last_active":"2024-09-13T18:37:22.986143+0000","last_peered":"2024-09-13T18:37:22.986143+0000","last_clean":"2024-09-13T18:37:22.986143+0000","last_became_active":"2024-09-13T18:37:22.985635+0000","last_became_peered":"2024-09-13T18:37:22.985635+0000","last_unstale":"2024-09-13T18:37:22.986143+0000","last_undegraded":"2024-09-13T18:37:22.986143+0000","last_fullsized":"2024-09-13T18:37:22.986143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.129408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967200+0000","last_change":"2024-09-13T18:37:22.562079+0000","last_active":"2024-09-13T18:37:22.967200+0000","last_peered":"2024-09-13T18:37:22.967200+0000","last_clean":"2024-09-13T18:37:22.967200+0000","last_became_active":"2024-09-13T18:37:22.561837+0000","last_became_peered":"2024-09-13T18:37:22.561837+0000","last_unstale":"2024-09-13T18:37:22.967200+0000","last_undegraded":"2024-09-13T18:37:22.967200+0000","last_fullsized":"2024-09-13T18:37:22.967200+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:37.745408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972694+0000","last_change":"2024-09-13T18:37:22.972612+0000","last_active":"2024-09-13T18:37:22.972694+0000","last_peered":"2024-09-13T18:37:22.972694+0000","last_clean":"2024-09-13T18:37:22.972694+0000","last_became_active":"2024-09-13T18:37:22.972413+0000","last_became_peered":"2024-09-13T18:37:22.972413+0000","last_unstale":"2024-09-13T18:37:22.972694+0000","last_undegraded":"2024-09-13T18:37:22.972694+0000","last_fullsized":"2024-09-13T18:37:22.972694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:19.109807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977532+0000","last_change":"2024-09-13T18:37:22.560496+0000","last_active":"2024-09-13T18:37:22.977532+0000","last_peered":"2024-09-13T18:37:22.977532+0000","last_clean":"2024-09-13T18:37:22.977532+0000","last_became_active":"2024-09-13T18:37:22.560198+0000","last_became_peered":"2024-09-13T18:37:22.560198+0000","last_unstale":"2024-09-13T18:37:22.977532+0000","last_undegraded":"2024-09-13T18:37:22.977532+0000","last_fullsized":"2024-09-13T18:37:22.977532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982122+0000","last_change":"2024-09-13T18:37:22.981427+0000","last_active":"2024-09-13T18:37:22.982122+0000","last_peered":"2024-09-13T18:37:22.982122+0000","last_clean":"2024-09-13T18:37:22.982122+0000","last_became_active":"2024-09-13T18:37:22.979116+0000","last_became_peered":"2024-09-13T18:37:22.979116+0000","last_unstale":"2024-09-13T18:37:22.982122+0000","last_undegraded":"2024-09-13T18:37:22.982122+0000","last_fullsized":"2024-09-13T18:37:22.982122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:11.647077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971625+0000","last_change":"2024-09-13T18:37:22.563063+0000","last_active":"2024-09-13T18:37:22.971625+0000","last_peered":"2024-09-13T18:37:22.971625+0000","last_clean":"2024-09-13T18:37:22.971625+0000","last_became_active":"2024-09-13T18:37:22.560555+0000","last_became_peered":"2024-09-13T18:37:22.560555+0000","last_unstale":"2024-09-13T18:37:22.971625+0000","last_undegraded":"2024-09-13T18:37:22.971625+0000","last_fullsized":"2024-09-13T18:37:22.971625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:14.849785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980239+0000","last_change":"2024-09-13T18:37:22.979575+0000","last_active":"2024-09-13T18:37:22.980239+0000","last_peered":"2024-09-13T18:37:22.980239+0000","last_clean":"2024-09-13T18:37:22.980239+0000","last_became_active":"2024-09-13T18:37:22.978789+0000","last_became_peered":"2024-09-13T18:37:22.978789+0000","last_unstale":"2024-09-13T18:37:22.980239+0000","last_undegraded":"2024-09-13T18:37:22.980239+0000","last_fullsized":"2024-09-13T18:37:22.980239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:40.805997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963934+0000","last_change":"2024-09-13T18:37:22.561696+0000","last_active":"2024-09-13T18:37:22.963934+0000","last_peered":"2024-09-13T18:37:22.963934+0000","last_clean":"2024-09-13T18:37:22.963934+0000","last_became_active":"2024-09-13T18:37:22.560237+0000","last_became_peered":"2024-09-13T18:37:22.560237+0000","last_unstale":"2024-09-13T18:37:22.963934+0000","last_undegraded":"2024-09-13T18:37:22.963934+0000","last_fullsized":"2024-09-13T18:37:22.963934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:55.890790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982073+0000","last_change":"2024-09-13T18:37:22.981013+0000","last_active":"2024-09-13T18:37:22.982073+0000","last_peered":"2024-09-13T18:37:22.982073+0000","last_clean":"2024-09-13T18:37:22.982073+0000","last_became_active":"2024-09-13T18:37:22.980495+0000","last_became_peered":"2024-09-13T18:37:22.980495+0000","last_unstale":"2024-09-13T18:37:22.982073+0000","last_undegraded":"2024-09-13T18:37:22.982073+0000","last_fullsized":"2024-09-13T18:37:22.982073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:05.978858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972223+0000","last_change":"2024-09-13T18:37:22.559865+0000","last_active":"2024-09-13T18:37:22.972223+0000","last_peered":"2024-09-13T18:37:22.972223+0000","last_clean":"2024-09-13T18:37:22.972223+0000","last_became_active":"2024-09-13T18:37:22.559625+0000","last_became_peered":"2024-09-13T18:37:22.559625+0000","last_unstale":"2024-09-13T18:37:22.972223+0000","last_undegraded":"2024-09-13T18:37:22.972223+0000","last_fullsized":"2024-09-13T18:37:22.972223+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984884+0000","last_change":"2024-09-13T18:37:22.984380+0000","last_active":"2024-09-13T18:37:22.984884+0000","last_peered":"2024-09-13T18:37:22.984884+0000","last_clean":"2024-09-13T18:37:22.984884+0000","last_became_active":"2024-09-13T18:37:22.980212+0000","last_became_peered":"2024-09-13T18:37:22.980212+0000","last_unstale":"2024-09-13T18:37:22.984884+0000","last_undegraded":"2024-09-13T18:37:22.984884+0000","last_fullsized":"2024-09-13T18:37:22.984884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:41.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968542+0000","last_change":"2024-09-13T18:37:22.556852+0000","last_active":"2024-09-13T18:37:22.968542+0000","last_peered":"2024-09-13T18:37:22.968542+0000","last_clean":"2024-09-13T18:37:22.968542+0000","last_became_active":"2024-09-13T18:37:22.556621+0000","last_became_peered":"2024-09-13T18:37:22.556621+0000","last_unstale":"2024-09-13T18:37:22.968542+0000","last_undegraded":"2024-09-13T18:37:22.968542+0000","last_fullsized":"2024-09-13T18:37:22.968542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:22.245188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.979193+0000","last_change":"2024-09-13T18:37:22.979007+0000","last_active":"2024-09-13T18:37:22.979193+0000","last_peered":"2024-09-13T18:37:22.979193+0000","last_clean":"2024-09-13T18:37:22.979193+0000","last_became_active":"2024-09-13T18:37:22.978790+0000","last_became_peered":"2024-09-13T18:37:22.978790+0000","last_unstale":"2024-09-13T18:37:22.979193+0000","last_undegraded":"2024-09-13T18:37:22.979193+0000","last_fullsized":"2024-09-13T18:37:22.979193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:00.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968417+0000","last_change":"2024-09-13T18:37:22.564269+0000","last_active":"2024-09-13T18:37:22.968417+0000","last_peered":"2024-09-13T18:37:22.968417+0000","last_clean":"2024-09-13T18:37:22.968417+0000","last_became_active":"2024-09-13T18:37:22.563874+0000","last_became_peered":"2024-09-13T18:37:22.563874+0000","last_unstale":"2024-09-13T18:37:22.968417+0000","last_undegraded":"2024-09-13T18:37:22.968417+0000","last_fullsized":"2024-09-13T18:37:22.968417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:34.742228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966908+0000","last_change":"2024-09-13T18:37:22.966406+0000","last_active":"2024-09-13T18:37:22.966908+0000","last_peered":"2024-09-13T18:37:22.966908+0000","last_clean":"2024-09-13T18:37:22.966908+0000","last_became_active":"2024-09-13T18:37:22.966130+0000","last_became_peered":"2024-09-13T18:37:22.966130+0000","last_unstale":"2024-09-13T18:37:22.966908+0000","last_undegraded":"2024-09-13T18:37:22.966908+0000","last_fullsized":"2024-09-13T18:37:22.966908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:39.513560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963692+0000","last_change":"2024-09-13T18:37:22.554671+0000","last_active":"2024-09-13T18:37:22.963692+0000","last_peered":"2024-09-13T18:37:22.963692+0000","last_clean":"2024-09-13T18:37:22.963692+0000","last_became_active":"2024-09-13T18:37:22.553103+0000","last_became_peered":"2024-09-13T18:37:22.553103+0000","last_unstale":"2024-09-13T18:37:22.963692+0000","last_undegraded":"2024-09-13T18:37:22.963692+0000","last_fullsized":"2024-09-13T18:37:22.963692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:26.284657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982725+0000","last_change":"2024-09-13T18:37:22.978892+0000","last_active":"2024-09-13T18:37:22.982725+0000","last_peered":"2024-09-13T18:37:22.982725+0000","last_clean":"2024-09-13T18:37:22.982725+0000","last_became_active":"2024-09-13T18:37:22.978678+0000","last_became_peered":"2024-09-13T18:37:22.978678+0000","last_unstale":"2024-09-13T18:37:22.982725+0000","last_undegraded":"2024-09-13T18:37:22.982725+0000","last_fullsized":"2024-09-13T18:37:22.982725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983457+0000","last_change":"2024-09-13T18:37:22.559788+0000","last_active":"2024-09-13T18:37:22.983457+0000","last_peered":"2024-09-13T18:37:22.983457+0000","last_clean":"2024-09-13T18:37:22.983457+0000","last_became_active":"2024-09-13T18:37:22.559540+0000","last_became_peered":"2024-09-13T18:37:22.559540+0000","last_unstale":"2024-09-13T18:37:22.983457+0000","last_undegraded":"2024-09-13T18:37:22.983457+0000","last_fullsized":"2024-09-13T18:37:22.983457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:39.214871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.557645+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:37:22.557645+0000","last_peered":"2024-09-13T18:37:22.557645+0000","last_clean":"2024-09-13T18:37:22.557645+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:37:22.557645+0000","last_undegraded":"2024-09-13T18:37:22.557645+0000","last_fullsized":"2024-09-13T18:37:22.557645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":224,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195087,"statfs":{"total":200000000,"available":199769899,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195087,"statfs":{"total":200000000,"available":199769317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.754}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.748},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.436},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.496},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.62}]}]}],"pool_statfs":[]}} 2024-09-13T18:37:27.119 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:37:27.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.302+0000 7fcc37200640 1 Processor -- start 2024-09-13T18:37:27.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.302+0000 7fcc37200640 1 -- start start 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc37200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 0x7fcc380b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc37200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcc3815a5f0 0x7fcc380b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc37200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3815af60 con 0x7fcc3806bc30 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc37200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3815aa40 con 0x7fcc3815a5f0 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc37200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc3806b7a0 con 0x7fcc38159b00 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc36800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcc3815a5f0 0x7fcc380b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc36800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcc3815a5f0 0x7fcc380b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44746/0 (socket says 172.21.15.192:44746) 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc36800640 1 -- 172.21.15.192:0/3076846078 learned_addr learned my addr 172.21.15.192:0/3076846078 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:27.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.303+0000 7fcc35400640 1 --1- 172.21.15.192:0/3076846078 >> v1:172.21.15.192:6789/0 conn(0x7fcc3806bc30 0x7fcc38159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59892/0 (socket says 172.21.15.192:59892) 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc35e00640 1 --2- 172.21.15.192:0/3076846078 >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 0x7fcc380b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc36800640 1 -- 172.21.15.192:0/3076846078 >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 msgr2=0x7fcc380b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc36800640 1 --2- 172.21.15.192:0/3076846078 >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 0x7fcc380b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc36800640 1 -- 172.21.15.192:0/3076846078 >> v1:172.21.15.192:6789/0 conn(0x7fcc3806bc30 legacy=0x7fcc38159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc36800640 1 -- 172.21.15.192:0/3076846078 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc3815ac80 con 0x7fcc3815a5f0 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.304+0000 7fcc35e00640 1 --2- 172.21.15.192:0/3076846078 >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 0x7fcc380b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc36800640 1 --2- 172.21.15.192:0/3076846078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc3815a5f0 0x7fcc380b32b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcc3806cc90 tx=0x7fcc3002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8422427ab9ee39fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc34a00640 1 -- 172.21.15.192:0/3076846078 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30031600 con 0x7fcc3815a5f0 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc34a00640 1 -- 172.21.15.192:0/3076846078 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc3002d050 con 0x7fcc3815a5f0 2024-09-13T18:37:27.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc34a00640 1 -- 172.21.15.192:0/3076846078 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc30031980 con 0x7fcc3815a5f0 2024-09-13T18:37:27.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc37200640 1 -- 172.21.15.192:0/3076846078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc3815a5f0 msgr2=0x7fcc380b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.305+0000 7fcc37200640 1 --2- 172.21.15.192:0/3076846078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc3815a5f0 0x7fcc380b32b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fcc3806cc90 tx=0x7fcc3002a730 comp rx=0 tx=0).stop 2024-09-13T18:37:27.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 -- 172.21.15.192:0/3076846078 shutdown_connections 2024-09-13T18:37:27.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 --2- 172.21.15.192:0/3076846078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc3815a5f0 0x7fcc380b32b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 --2- 172.21.15.192:0/3076846078 >> v2:172.21.15.194:3300/0 conn(0x7fcc38159b00 0x7fcc380b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 -- 172.21.15.192:0/3076846078 >> 172.21.15.192:0/3076846078 conn(0x7fcc380736d0 msgr2=0x7fcc380b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:27.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 -- 172.21.15.192:0/3076846078 shutdown_connections 2024-09-13T18:37:27.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.306+0000 7fcc37200640 1 -- 172.21.15.192:0/3076846078 wait complete. 2024-09-13T18:37:27.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.307+0000 7fcc37200640 1 Processor -- start 2024-09-13T18:37:27.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.307+0000 7fcc37200640 1 -- start start 2024-09-13T18:37:27.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc3806bc30 0x7fcc38154610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc3815a5f0 0x7fcc381e4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38154b50 con 0x7fcc38159b00 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc381e57d0 con 0x7fcc3815a5f0 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc37200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc38153b30 con 0x7fcc3806bc30 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44756/0 (socket says 172.21.15.192:44756) 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.308+0000 7fcc35400640 1 -- 172.21.15.192:0/1241422518 learned_addr learned my addr 172.21.15.192:0/1241422518 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc36800640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc3815a5f0 0x7fcc381e4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35e00640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc3806bc30 0x7fcc38154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 -- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc3806bc30 msgr2=0x7fcc38154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc3806bc30 0x7fcc38154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 -- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc3815a5f0 msgr2=0x7fcc381e4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc3815a5f0 0x7fcc381e4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 -- 172.21.15.192:0/1241422518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc30009b30 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc35400640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c4d0 tx=0x7fcc2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc24007480 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc240075e0 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc38153e10 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.309+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc240049e0 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.310+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc3814c850 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.311+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc38154330 con 0x7fcc38159b00 2024-09-13T18:37:27.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.312+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcc24004b40 con 0x7fcc38159b00 2024-09-13T18:37:27.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.312+0000 7fcc2e000640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 0x7fcc1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.312+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fcc240889e0 con 0x7fcc38159b00 2024-09-13T18:37:27.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.313+0000 7fcc35e00640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 0x7fcc1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.313+0000 7fcc35e00640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 0x7fcc1806d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a990 tx=0x7fcc28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.317+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcc38154330 con 0x7fcc38159b00 2024-09-13T18:37:27.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.482+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcc381539b0 con 0x7fcc1806ac00 2024-09-13T18:37:27.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.490+0000 7fcc2e000640 1 -- 172.21.15.192:0/1241422518 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284804 (secure 0 0 0) 0x7fcc2800a710 con 0x7fcc1806ac00 2024-09-13T18:37:27.496 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:27.497 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 msgr2=0x7fcc1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 0x7fcc1806d0c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcc2800a990 tx=0x7fcc28008040 comp rx=0 tx=0).stop 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 msgr2=0x7fcc3814b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fcc2400c4d0 tx=0x7fcc2400c990 comp rx=0 tx=0).stop 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 shutdown_connections 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcc1806ac00 0x7fcc1806d0c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcc3815a5f0 0x7fcc381e4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcc38159b00 0x7fcc3814b880 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 --2- 172.21.15.192:0/1241422518 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcc3806bc30 0x7fcc38154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 >> 172.21.15.192:0/1241422518 conn(0x7fcc380736d0 msgr2=0x7fcc380b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:27.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 shutdown_connections 2024-09-13T18:37:27.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.494+0000 7fcc37200640 1 -- 172.21.15.192:0/1241422518 wait complete. 2024-09-13T18:37:27.513 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2024-09-13T18:37:26.990700+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":159,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2932,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559567,"statfs":{"total":1600000000,"available":1596996655,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.443395"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975226+0000","last_change":"2024-09-13T18:37:22.974788+0000","last_active":"2024-09-13T18:37:22.975226+0000","last_peered":"2024-09-13T18:37:22.975226+0000","last_clean":"2024-09-13T18:37:22.975226+0000","last_became_active":"2024-09-13T18:37:22.973222+0000","last_became_peered":"2024-09-13T18:37:22.973222+0000","last_unstale":"2024-09-13T18:37:22.975226+0000","last_undegraded":"2024-09-13T18:37:22.975226+0000","last_fullsized":"2024-09-13T18:37:22.975226+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970671+0000","last_change":"2024-09-13T18:37:22.970254+0000","last_active":"2024-09-13T18:37:22.970671+0000","last_peered":"2024-09-13T18:37:22.970671+0000","last_clean":"2024-09-13T18:37:22.970671+0000","last_became_active":"2024-09-13T18:37:22.969850+0000","last_became_peered":"2024-09-13T18:37:22.969850+0000","last_unstale":"2024-09-13T18:37:22.970671+0000","last_undegraded":"2024-09-13T18:37:22.970671+0000","last_fullsized":"2024-09-13T18:37:22.970671+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:40.383945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966803+0000","last_change":"2024-09-13T18:37:22.966662+0000","last_active":"2024-09-13T18:37:22.966803+0000","last_peered":"2024-09-13T18:37:22.966803+0000","last_clean":"2024-09-13T18:37:22.966803+0000","last_became_active":"2024-09-13T18:37:22.966408+0000","last_became_peered":"2024-09-13T18:37:22.966408+0000","last_unstale":"2024-09-13T18:37:22.966803+0000","last_undegraded":"2024-09-13T18:37:22.966803+0000","last_fullsized":"2024-09-13T18:37:22.966803+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:52:21.764977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982689+0000","last_change":"2024-09-13T18:37:22.977811+0000","last_active":"2024-09-13T18:37:22.982689+0000","last_peered":"2024-09-13T18:37:22.982689+0000","last_clean":"2024-09-13T18:37:22.982689+0000","last_became_active":"2024-09-13T18:37:22.977250+0000","last_became_peered":"2024-09-13T18:37:22.977250+0000","last_unstale":"2024-09-13T18:37:22.982689+0000","last_undegraded":"2024-09-13T18:37:22.982689+0000","last_fullsized":"2024-09-13T18:37:22.982689+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974679+0000","last_change":"2024-09-13T18:37:22.974548+0000","last_active":"2024-09-13T18:37:22.974679+0000","last_peered":"2024-09-13T18:37:22.974679+0000","last_clean":"2024-09-13T18:37:22.974679+0000","last_became_active":"2024-09-13T18:37:22.974355+0000","last_became_peered":"2024-09-13T18:37:22.974355+0000","last_unstale":"2024-09-13T18:37:22.974679+0000","last_undegraded":"2024-09-13T18:37:22.974679+0000","last_fullsized":"2024-09-13T18:37:22.974679+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.128362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987589+0000","last_change":"2024-09-13T18:37:22.987517+0000","last_active":"2024-09-13T18:37:22.987589+0000","last_peered":"2024-09-13T18:37:22.987589+0000","last_clean":"2024-09-13T18:37:22.987589+0000","last_became_active":"2024-09-13T18:37:22.987216+0000","last_became_peered":"2024-09-13T18:37:22.987216+0000","last_unstale":"2024-09-13T18:37:22.987589+0000","last_undegraded":"2024-09-13T18:37:22.987589+0000","last_fullsized":"2024-09-13T18:37:22.987589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:35.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980256+0000","last_change":"2024-09-13T18:37:22.979981+0000","last_active":"2024-09-13T18:37:22.980256+0000","last_peered":"2024-09-13T18:37:22.980256+0000","last_clean":"2024-09-13T18:37:22.980256+0000","last_became_active":"2024-09-13T18:37:22.979778+0000","last_became_peered":"2024-09-13T18:37:22.979778+0000","last_unstale":"2024-09-13T18:37:22.980256+0000","last_undegraded":"2024-09-13T18:37:22.980256+0000","last_fullsized":"2024-09-13T18:37:22.980256+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:15.012707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982762+0000","last_change":"2024-09-13T18:37:22.980468+0000","last_active":"2024-09-13T18:37:22.982762+0000","last_peered":"2024-09-13T18:37:22.982762+0000","last_clean":"2024-09-13T18:37:22.982762+0000","last_became_active":"2024-09-13T18:37:22.980220+0000","last_became_peered":"2024-09-13T18:37:22.980220+0000","last_unstale":"2024-09-13T18:37:22.982762+0000","last_undegraded":"2024-09-13T18:37:22.982762+0000","last_fullsized":"2024-09-13T18:37:22.982762+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:46:42.518277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.985589+0000","last_change":"2024-09-13T18:37:22.985226+0000","last_active":"2024-09-13T18:37:22.985589+0000","last_peered":"2024-09-13T18:37:22.985589+0000","last_clean":"2024-09-13T18:37:22.985589+0000","last_became_active":"2024-09-13T18:37:22.984795+0000","last_became_peered":"2024-09-13T18:37:22.984795+0000","last_unstale":"2024-09-13T18:37:22.985589+0000","last_undegraded":"2024-09-13T18:37:22.985589+0000","last_fullsized":"2024-09-13T18:37:22.985589+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:11.735399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967528+0000","last_change":"2024-09-13T18:37:22.967096+0000","last_active":"2024-09-13T18:37:22.967528+0000","last_peered":"2024-09-13T18:37:22.967528+0000","last_clean":"2024-09-13T18:37:22.967528+0000","last_became_active":"2024-09-13T18:37:22.966737+0000","last_became_peered":"2024-09-13T18:37:22.966737+0000","last_unstale":"2024-09-13T18:37:22.967528+0000","last_undegraded":"2024-09-13T18:37:22.967528+0000","last_fullsized":"2024-09-13T18:37:22.967528+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.393425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986127+0000","last_change":"2024-09-13T18:37:22.985981+0000","last_active":"2024-09-13T18:37:22.986127+0000","last_peered":"2024-09-13T18:37:22.986127+0000","last_clean":"2024-09-13T18:37:22.986127+0000","last_became_active":"2024-09-13T18:37:22.985371+0000","last_became_peered":"2024-09-13T18:37:22.985371+0000","last_unstale":"2024-09-13T18:37:22.986127+0000","last_undegraded":"2024-09-13T18:37:22.986127+0000","last_fullsized":"2024-09-13T18:37:22.986127+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:04.969268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968656+0000","last_change":"2024-09-13T18:37:22.968038+0000","last_active":"2024-09-13T18:37:22.968656+0000","last_peered":"2024-09-13T18:37:22.968656+0000","last_clean":"2024-09-13T18:37:22.968656+0000","last_became_active":"2024-09-13T18:37:22.967780+0000","last_became_peered":"2024-09-13T18:37:22.967780+0000","last_unstale":"2024-09-13T18:37:22.968656+0000","last_undegraded":"2024-09-13T18:37:22.968656+0000","last_fullsized":"2024-09-13T18:37:22.968656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987531+0000","last_change":"2024-09-13T18:37:22.987459+0000","last_active":"2024-09-13T18:37:22.987531+0000","last_peered":"2024-09-13T18:37:22.987531+0000","last_clean":"2024-09-13T18:37:22.987531+0000","last_became_active":"2024-09-13T18:37:22.987127+0000","last_became_peered":"2024-09-13T18:37:22.987127+0000","last_unstale":"2024-09-13T18:37:22.987531+0000","last_undegraded":"2024-09-13T18:37:22.987531+0000","last_fullsized":"2024-09-13T18:37:22.987531+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987674+0000","last_change":"2024-09-13T18:37:22.987602+0000","last_active":"2024-09-13T18:37:22.987674+0000","last_peered":"2024-09-13T18:37:22.987674+0000","last_clean":"2024-09-13T18:37:22.987674+0000","last_became_active":"2024-09-13T18:37:22.986603+0000","last_became_peered":"2024-09-13T18:37:22.986603+0000","last_unstale":"2024-09-13T18:37:22.987674+0000","last_undegraded":"2024-09-13T18:37:22.987674+0000","last_fullsized":"2024-09-13T18:37:22.987674+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:35.447287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986083+0000","last_change":"2024-09-13T18:37:22.985854+0000","last_active":"2024-09-13T18:37:22.986083+0000","last_peered":"2024-09-13T18:37:22.986083+0000","last_clean":"2024-09-13T18:37:22.986083+0000","last_became_active":"2024-09-13T18:37:22.985335+0000","last_became_peered":"2024-09-13T18:37:22.985335+0000","last_unstale":"2024-09-13T18:37:22.986083+0000","last_undegraded":"2024-09-13T18:37:22.986083+0000","last_fullsized":"2024-09-13T18:37:22.986083+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.183032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986656+0000","last_change":"2024-09-13T18:37:22.986589+0000","last_active":"2024-09-13T18:37:22.986656+0000","last_peered":"2024-09-13T18:37:22.986656+0000","last_clean":"2024-09-13T18:37:22.986656+0000","last_became_active":"2024-09-13T18:37:22.986382+0000","last_became_peered":"2024-09-13T18:37:22.986382+0000","last_unstale":"2024-09-13T18:37:22.986656+0000","last_undegraded":"2024-09-13T18:37:22.986656+0000","last_fullsized":"2024-09-13T18:37:22.986656+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:40.383945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977339+0000","last_change":"2024-09-13T18:37:22.977143+0000","last_active":"2024-09-13T18:37:22.977339+0000","last_peered":"2024-09-13T18:37:22.977339+0000","last_clean":"2024-09-13T18:37:22.977339+0000","last_became_active":"2024-09-13T18:37:22.976480+0000","last_became_peered":"2024-09-13T18:37:22.976480+0000","last_unstale":"2024-09-13T18:37:22.977339+0000","last_undegraded":"2024-09-13T18:37:22.977339+0000","last_fullsized":"2024-09-13T18:37:22.977339+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:35.767409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984865+0000","last_change":"2024-09-13T18:37:22.984805+0000","last_active":"2024-09-13T18:37:22.984865+0000","last_peered":"2024-09-13T18:37:22.984865+0000","last_clean":"2024-09-13T18:37:22.984865+0000","last_became_active":"2024-09-13T18:37:22.984584+0000","last_became_peered":"2024-09-13T18:37:22.984584+0000","last_unstale":"2024-09-13T18:37:22.984865+0000","last_undegraded":"2024-09-13T18:37:22.984865+0000","last_fullsized":"2024-09-13T18:37:22.984865+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:40:24.782259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973961+0000","last_change":"2024-09-13T18:37:22.973861+0000","last_active":"2024-09-13T18:37:22.973961+0000","last_peered":"2024-09-13T18:37:22.973961+0000","last_clean":"2024-09-13T18:37:22.973961+0000","last_became_active":"2024-09-13T18:37:22.973631+0000","last_became_peered":"2024-09-13T18:37:22.973631+0000","last_unstale":"2024-09-13T18:37:22.973961+0000","last_undegraded":"2024-09-13T18:37:22.973961+0000","last_fullsized":"2024-09-13T18:37:22.973961+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:56:09.408715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967510+0000","last_change":"2024-09-13T18:37:22.966946+0000","last_active":"2024-09-13T18:37:22.967510+0000","last_peered":"2024-09-13T18:37:22.967510+0000","last_clean":"2024-09-13T18:37:22.967510+0000","last_became_active":"2024-09-13T18:37:22.966436+0000","last_became_peered":"2024-09-13T18:37:22.966436+0000","last_unstale":"2024-09-13T18:37:22.967510+0000","last_undegraded":"2024-09-13T18:37:22.967510+0000","last_fullsized":"2024-09-13T18:37:22.967510+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:04.969268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984868+0000","last_change":"2024-09-13T18:37:22.983811+0000","last_active":"2024-09-13T18:37:22.984868+0000","last_peered":"2024-09-13T18:37:22.984868+0000","last_clean":"2024-09-13T18:37:22.984868+0000","last_became_active":"2024-09-13T18:37:22.977439+0000","last_became_peered":"2024-09-13T18:37:22.977439+0000","last_unstale":"2024-09-13T18:37:22.984868+0000","last_undegraded":"2024-09-13T18:37:22.984868+0000","last_fullsized":"2024-09-13T18:37:22.984868+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:11.647077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974716+0000","last_change":"2024-09-13T18:37:22.972255+0000","last_active":"2024-09-13T18:37:22.974716+0000","last_peered":"2024-09-13T18:37:22.974716+0000","last_clean":"2024-09-13T18:37:22.974716+0000","last_became_active":"2024-09-13T18:37:22.971341+0000","last_became_peered":"2024-09-13T18:37:22.971341+0000","last_unstale":"2024-09-13T18:37:22.974716+0000","last_undegraded":"2024-09-13T18:37:22.974716+0000","last_fullsized":"2024-09-13T18:37:22.974716+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:23.935718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975291+0000","last_change":"2024-09-13T18:37:22.975140+0000","last_active":"2024-09-13T18:37:22.975291+0000","last_peered":"2024-09-13T18:37:22.975291+0000","last_clean":"2024-09-13T18:37:22.975291+0000","last_became_active":"2024-09-13T18:37:22.974927+0000","last_became_peered":"2024-09-13T18:37:22.974927+0000","last_unstale":"2024-09-13T18:37:22.975291+0000","last_undegraded":"2024-09-13T18:37:22.975291+0000","last_fullsized":"2024-09-13T18:37:22.975291+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:58.101640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.978816+0000","last_change":"2024-09-13T18:37:22.978751+0000","last_active":"2024-09-13T18:37:22.978816+0000","last_peered":"2024-09-13T18:37:22.978816+0000","last_clean":"2024-09-13T18:37:22.978816+0000","last_became_active":"2024-09-13T18:37:22.978542+0000","last_became_peered":"2024-09-13T18:37:22.978542+0000","last_unstale":"2024-09-13T18:37:22.978816+0000","last_undegraded":"2024-09-13T18:37:22.978816+0000","last_fullsized":"2024-09-13T18:37:22.978816+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:14.091193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972980+0000","last_change":"2024-09-13T18:37:22.972890+0000","last_active":"2024-09-13T18:37:22.972980+0000","last_peered":"2024-09-13T18:37:22.972980+0000","last_clean":"2024-09-13T18:37:22.972980+0000","last_became_active":"2024-09-13T18:37:22.972666+0000","last_became_peered":"2024-09-13T18:37:22.972666+0000","last_unstale":"2024-09-13T18:37:22.972980+0000","last_undegraded":"2024-09-13T18:37:22.972980+0000","last_fullsized":"2024-09-13T18:37:22.972980+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:41.665728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986066+0000","last_change":"2024-09-13T18:37:22.985784+0000","last_active":"2024-09-13T18:37:22.986066+0000","last_peered":"2024-09-13T18:37:22.986066+0000","last_clean":"2024-09-13T18:37:22.986066+0000","last_became_active":"2024-09-13T18:37:22.985044+0000","last_became_peered":"2024-09-13T18:37:22.985044+0000","last_unstale":"2024-09-13T18:37:22.986066+0000","last_undegraded":"2024-09-13T18:37:22.986066+0000","last_fullsized":"2024-09-13T18:37:22.986066+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:05.978858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969967+0000","last_change":"2024-09-13T18:37:22.969855+0000","last_active":"2024-09-13T18:37:22.969967+0000","last_peered":"2024-09-13T18:37:22.969967+0000","last_clean":"2024-09-13T18:37:22.969967+0000","last_became_active":"2024-09-13T18:37:22.969465+0000","last_became_peered":"2024-09-13T18:37:22.969465+0000","last_unstale":"2024-09-13T18:37:22.969967+0000","last_undegraded":"2024-09-13T18:37:22.969967+0000","last_fullsized":"2024-09-13T18:37:22.969967+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:51.702797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971924+0000","last_change":"2024-09-13T18:37:22.971852+0000","last_active":"2024-09-13T18:37:22.971924+0000","last_peered":"2024-09-13T18:37:22.971924+0000","last_clean":"2024-09-13T18:37:22.971924+0000","last_became_active":"2024-09-13T18:37:22.971438+0000","last_became_peered":"2024-09-13T18:37:22.971438+0000","last_unstale":"2024-09-13T18:37:22.971924+0000","last_undegraded":"2024-09-13T18:37:22.971924+0000","last_fullsized":"2024-09-13T18:37:22.971924+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:45:24.240978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984137+0000","last_change":"2024-09-13T18:37:22.984067+0000","last_active":"2024-09-13T18:37:22.984137+0000","last_peered":"2024-09-13T18:37:22.984137+0000","last_clean":"2024-09-13T18:37:22.984137+0000","last_became_active":"2024-09-13T18:37:22.983847+0000","last_became_peered":"2024-09-13T18:37:22.983847+0000","last_unstale":"2024-09-13T18:37:22.984137+0000","last_undegraded":"2024-09-13T18:37:22.984137+0000","last_fullsized":"2024-09-13T18:37:22.984137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:16.482022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971086+0000","last_change":"2024-09-13T18:37:22.971005+0000","last_active":"2024-09-13T18:37:22.971086+0000","last_peered":"2024-09-13T18:37:22.971086+0000","last_clean":"2024-09-13T18:37:22.971086+0000","last_became_active":"2024-09-13T18:37:22.970715+0000","last_became_peered":"2024-09-13T18:37:22.970715+0000","last_unstale":"2024-09-13T18:37:22.971086+0000","last_undegraded":"2024-09-13T18:37:22.971086+0000","last_fullsized":"2024-09-13T18:37:22.971086+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980664+0000","last_change":"2024-09-13T18:37:22.980304+0000","last_active":"2024-09-13T18:37:22.980664+0000","last_peered":"2024-09-13T18:37:22.980664+0000","last_clean":"2024-09-13T18:37:22.980664+0000","last_became_active":"2024-09-13T18:37:22.977472+0000","last_became_peered":"2024-09-13T18:37:22.977472+0000","last_unstale":"2024-09-13T18:37:22.980664+0000","last_undegraded":"2024-09-13T18:37:22.980664+0000","last_fullsized":"2024-09-13T18:37:22.980664+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:14.091193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982743+0000","last_change":"2024-09-13T18:37:22.978671+0000","last_active":"2024-09-13T18:37:22.982743+0000","last_peered":"2024-09-13T18:37:22.982743+0000","last_clean":"2024-09-13T18:37:22.982743+0000","last_became_active":"2024-09-13T18:37:22.978411+0000","last_became_peered":"2024-09-13T18:37:22.978411+0000","last_unstale":"2024-09-13T18:37:22.982743+0000","last_undegraded":"2024-09-13T18:37:22.982743+0000","last_fullsized":"2024-09-13T18:37:22.982743+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:23:18.128362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969720+0000","last_change":"2024-09-13T18:37:22.969643+0000","last_active":"2024-09-13T18:37:22.969720+0000","last_peered":"2024-09-13T18:37:22.969720+0000","last_clean":"2024-09-13T18:37:22.969720+0000","last_became_active":"2024-09-13T18:37:22.969397+0000","last_became_peered":"2024-09-13T18:37:22.969397+0000","last_unstale":"2024-09-13T18:37:22.969720+0000","last_undegraded":"2024-09-13T18:37:22.969720+0000","last_fullsized":"2024-09-13T18:37:22.969720+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:11:16.875659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"48'4","reported_seq":14,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987293+0000","last_change":"2024-09-13T18:37:22.564111+0000","last_active":"2024-09-13T18:37:22.987293+0000","last_peered":"2024-09-13T18:37:22.987293+0000","last_clean":"2024-09-13T18:37:22.987293+0000","last_became_active":"2024-09-13T18:37:22.563537+0000","last_became_peered":"2024-09-13T18:37:22.563537+0000","last_unstale":"2024-09-13T18:37:22.987293+0000","last_undegraded":"2024-09-13T18:37:22.987293+0000","last_fullsized":"2024-09-13T18:37:22.987293+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:13.529401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973946+0000","last_change":"2024-09-13T18:37:22.973866+0000","last_active":"2024-09-13T18:37:22.973946+0000","last_peered":"2024-09-13T18:37:22.973946+0000","last_clean":"2024-09-13T18:37:22.973946+0000","last_became_active":"2024-09-13T18:37:22.973644+0000","last_became_peered":"2024-09-13T18:37:22.973644+0000","last_unstale":"2024-09-13T18:37:22.973946+0000","last_undegraded":"2024-09-13T18:37:22.973946+0000","last_fullsized":"2024-09-13T18:37:22.973946+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:43.297197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982366+0000","last_change":"2024-09-13T18:37:22.564195+0000","last_active":"2024-09-13T18:37:22.982366+0000","last_peered":"2024-09-13T18:37:22.982366+0000","last_clean":"2024-09-13T18:37:22.982366+0000","last_became_active":"2024-09-13T18:37:22.563962+0000","last_became_peered":"2024-09-13T18:37:22.563962+0000","last_unstale":"2024-09-13T18:37:22.982366+0000","last_undegraded":"2024-09-13T18:37:22.982366+0000","last_fullsized":"2024-09-13T18:37:22.982366+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:42.076868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968639+0000","last_change":"2024-09-13T18:37:22.967021+0000","last_active":"2024-09-13T18:37:22.968639+0000","last_peered":"2024-09-13T18:37:22.968639+0000","last_clean":"2024-09-13T18:37:22.968639+0000","last_became_active":"2024-09-13T18:37:22.966823+0000","last_became_peered":"2024-09-13T18:37:22.966823+0000","last_unstale":"2024-09-13T18:37:22.968639+0000","last_undegraded":"2024-09-13T18:37:22.968639+0000","last_fullsized":"2024-09-13T18:37:22.968639+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:28.490321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984968+0000","last_change":"2024-09-13T18:37:22.561947+0000","last_active":"2024-09-13T18:37:22.984968+0000","last_peered":"2024-09-13T18:37:22.984968+0000","last_clean":"2024-09-13T18:37:22.984968+0000","last_became_active":"2024-09-13T18:37:22.561716+0000","last_became_peered":"2024-09-13T18:37:22.561716+0000","last_unstale":"2024-09-13T18:37:22.984968+0000","last_undegraded":"2024-09-13T18:37:22.984968+0000","last_fullsized":"2024-09-13T18:37:22.984968+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:05:12.962171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984847+0000","last_change":"2024-09-13T18:37:22.983413+0000","last_active":"2024-09-13T18:37:22.984847+0000","last_peered":"2024-09-13T18:37:22.984847+0000","last_clean":"2024-09-13T18:37:22.984847+0000","last_became_active":"2024-09-13T18:37:22.983168+0000","last_became_peered":"2024-09-13T18:37:22.983168+0000","last_unstale":"2024-09-13T18:37:22.984847+0000","last_undegraded":"2024-09-13T18:37:22.984847+0000","last_fullsized":"2024-09-13T18:37:22.984847+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:33:41.665728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981945+0000","last_change":"2024-09-13T18:37:22.565279+0000","last_active":"2024-09-13T18:37:22.981945+0000","last_peered":"2024-09-13T18:37:22.981945+0000","last_clean":"2024-09-13T18:37:22.981945+0000","last_became_active":"2024-09-13T18:37:22.564800+0000","last_became_peered":"2024-09-13T18:37:22.564800+0000","last_unstale":"2024-09-13T18:37:22.981945+0000","last_undegraded":"2024-09-13T18:37:22.981945+0000","last_fullsized":"2024-09-13T18:37:22.981945+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:11:48.699313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970665+0000","last_change":"2024-09-13T18:37:22.970608+0000","last_active":"2024-09-13T18:37:22.970665+0000","last_peered":"2024-09-13T18:37:22.970665+0000","last_clean":"2024-09-13T18:37:22.970665+0000","last_became_active":"2024-09-13T18:37:22.970475+0000","last_became_peered":"2024-09-13T18:37:22.970475+0000","last_unstale":"2024-09-13T18:37:22.970665+0000","last_undegraded":"2024-09-13T18:37:22.970665+0000","last_fullsized":"2024-09-13T18:37:22.970665+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:27.916117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983990+0000","last_change":"2024-09-13T18:37:22.566143+0000","last_active":"2024-09-13T18:37:22.983990+0000","last_peered":"2024-09-13T18:37:22.983990+0000","last_clean":"2024-09-13T18:37:22.983990+0000","last_became_active":"2024-09-13T18:37:22.565908+0000","last_became_peered":"2024-09-13T18:37:22.565908+0000","last_unstale":"2024-09-13T18:37:22.983990+0000","last_undegraded":"2024-09-13T18:37:22.983990+0000","last_fullsized":"2024-09-13T18:37:22.983990+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:57.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982091+0000","last_change":"2024-09-13T18:37:22.981175+0000","last_active":"2024-09-13T18:37:22.982091+0000","last_peered":"2024-09-13T18:37:22.982091+0000","last_clean":"2024-09-13T18:37:22.982091+0000","last_became_active":"2024-09-13T18:37:22.980817+0000","last_became_peered":"2024-09-13T18:37:22.980817+0000","last_unstale":"2024-09-13T18:37:22.982091+0000","last_undegraded":"2024-09-13T18:37:22.982091+0000","last_fullsized":"2024-09-13T18:37:22.982091+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:28:19.183032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981695+0000","last_change":"2024-09-13T18:37:22.555547+0000","last_active":"2024-09-13T18:37:22.981695+0000","last_peered":"2024-09-13T18:37:22.981695+0000","last_clean":"2024-09-13T18:37:22.981695+0000","last_became_active":"2024-09-13T18:37:22.554960+0000","last_became_peered":"2024-09-13T18:37:22.554960+0000","last_unstale":"2024-09-13T18:37:22.981695+0000","last_undegraded":"2024-09-13T18:37:22.981695+0000","last_fullsized":"2024-09-13T18:37:22.981695+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:16.904745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982137+0000","last_change":"2024-09-13T18:37:22.981597+0000","last_active":"2024-09-13T18:37:22.982137+0000","last_peered":"2024-09-13T18:37:22.982137+0000","last_clean":"2024-09-13T18:37:22.982137+0000","last_became_active":"2024-09-13T18:37:22.979429+0000","last_became_peered":"2024-09-13T18:37:22.979429+0000","last_unstale":"2024-09-13T18:37:22.982137+0000","last_undegraded":"2024-09-13T18:37:22.982137+0000","last_fullsized":"2024-09-13T18:37:22.982137+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:41.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971448+0000","last_change":"2024-09-13T18:37:22.566498+0000","last_active":"2024-09-13T18:37:22.971448+0000","last_peered":"2024-09-13T18:37:22.971448+0000","last_clean":"2024-09-13T18:37:22.971448+0000","last_became_active":"2024-09-13T18:37:22.566228+0000","last_became_peered":"2024-09-13T18:37:22.566228+0000","last_unstale":"2024-09-13T18:37:22.971448+0000","last_undegraded":"2024-09-13T18:37:22.971448+0000","last_fullsized":"2024-09-13T18:37:22.971448+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:10.584149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973555+0000","last_change":"2024-09-13T18:37:22.973479+0000","last_active":"2024-09-13T18:37:22.973555+0000","last_peered":"2024-09-13T18:37:22.973555+0000","last_clean":"2024-09-13T18:37:22.973555+0000","last_became_active":"2024-09-13T18:37:22.973266+0000","last_became_peered":"2024-09-13T18:37:22.973266+0000","last_unstale":"2024-09-13T18:37:22.973555+0000","last_undegraded":"2024-09-13T18:37:22.973555+0000","last_fullsized":"2024-09-13T18:37:22.973555+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:58:37.121583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.961942+0000","last_change":"2024-09-13T18:37:22.566709+0000","last_active":"2024-09-13T18:37:22.961942+0000","last_peered":"2024-09-13T18:37:22.961942+0000","last_clean":"2024-09-13T18:37:22.961942+0000","last_became_active":"2024-09-13T18:37:22.566504+0000","last_became_peered":"2024-09-13T18:37:22.566504+0000","last_unstale":"2024-09-13T18:37:22.961942+0000","last_undegraded":"2024-09-13T18:37:22.961942+0000","last_fullsized":"2024-09-13T18:37:22.961942+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:39.378102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968306+0000","last_change":"2024-09-13T18:37:22.967345+0000","last_active":"2024-09-13T18:37:22.968306+0000","last_peered":"2024-09-13T18:37:22.968306+0000","last_clean":"2024-09-13T18:37:22.968306+0000","last_became_active":"2024-09-13T18:37:22.967084+0000","last_became_peered":"2024-09-13T18:37:22.967084+0000","last_unstale":"2024-09-13T18:37:22.968306+0000","last_undegraded":"2024-09-13T18:37:22.968306+0000","last_fullsized":"2024-09-13T18:37:22.968306+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:48:30.766433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963684+0000","last_change":"2024-09-13T18:37:22.560345+0000","last_active":"2024-09-13T18:37:22.963684+0000","last_peered":"2024-09-13T18:37:22.963684+0000","last_clean":"2024-09-13T18:37:22.963684+0000","last_became_active":"2024-09-13T18:37:22.559030+0000","last_became_peered":"2024-09-13T18:37:22.559030+0000","last_unstale":"2024-09-13T18:37:22.963684+0000","last_undegraded":"2024-09-13T18:37:22.963684+0000","last_fullsized":"2024-09-13T18:37:22.963684+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:56.115687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.975607+0000","last_change":"2024-09-13T18:37:22.975052+0000","last_active":"2024-09-13T18:37:22.975607+0000","last_peered":"2024-09-13T18:37:22.975607+0000","last_clean":"2024-09-13T18:37:22.975607+0000","last_became_active":"2024-09-13T18:37:22.974823+0000","last_became_peered":"2024-09-13T18:37:22.974823+0000","last_unstale":"2024-09-13T18:37:22.975607+0000","last_undegraded":"2024-09-13T18:37:22.975607+0000","last_fullsized":"2024-09-13T18:37:22.975607+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:13.824230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.961530+0000","last_change":"2024-09-13T18:37:22.562062+0000","last_active":"2024-09-13T18:37:22.961530+0000","last_peered":"2024-09-13T18:37:22.961530+0000","last_clean":"2024-09-13T18:37:22.961530+0000","last_became_active":"2024-09-13T18:37:22.559584+0000","last_became_peered":"2024-09-13T18:37:22.559584+0000","last_unstale":"2024-09-13T18:37:22.961530+0000","last_undegraded":"2024-09-13T18:37:22.961530+0000","last_fullsized":"2024-09-13T18:37:22.961530+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:05.025346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.988085+0000","last_change":"2024-09-13T18:37:22.987746+0000","last_active":"2024-09-13T18:37:22.988085+0000","last_peered":"2024-09-13T18:37:22.988085+0000","last_clean":"2024-09-13T18:37:22.988085+0000","last_became_active":"2024-09-13T18:37:22.987260+0000","last_became_peered":"2024-09-13T18:37:22.987260+0000","last_unstale":"2024-09-13T18:37:22.988085+0000","last_undegraded":"2024-09-13T18:37:22.988085+0000","last_fullsized":"2024-09-13T18:37:22.988085+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:56.393425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"48'3","reported_seq":13,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980414+0000","last_change":"2024-09-13T18:37:22.562184+0000","last_active":"2024-09-13T18:37:22.980414+0000","last_peered":"2024-09-13T18:37:22.980414+0000","last_clean":"2024-09-13T18:37:22.980414+0000","last_became_active":"2024-09-13T18:37:22.561905+0000","last_became_peered":"2024-09-13T18:37:22.561905+0000","last_unstale":"2024-09-13T18:37:22.980414+0000","last_undegraded":"2024-09-13T18:37:22.980414+0000","last_fullsized":"2024-09-13T18:37:22.980414+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:22.929875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983670+0000","last_change":"2024-09-13T18:37:22.983595+0000","last_active":"2024-09-13T18:37:22.983670+0000","last_peered":"2024-09-13T18:37:22.983670+0000","last_clean":"2024-09-13T18:37:22.983670+0000","last_became_active":"2024-09-13T18:37:22.983351+0000","last_became_peered":"2024-09-13T18:37:22.983351+0000","last_unstale":"2024-09-13T18:37:22.983670+0000","last_undegraded":"2024-09-13T18:37:22.983670+0000","last_fullsized":"2024-09-13T18:37:22.983670+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:49:18.076060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"48'6","reported_seq":16,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.988660+0000","last_change":"2024-09-13T18:37:22.556903+0000","last_active":"2024-09-13T18:37:22.988660+0000","last_peered":"2024-09-13T18:37:22.988660+0000","last_clean":"2024-09-13T18:37:22.988660+0000","last_became_active":"2024-09-13T18:37:22.556075+0000","last_became_peered":"2024-09-13T18:37:22.556075+0000","last_unstale":"2024-09-13T18:37:22.988660+0000","last_undegraded":"2024-09-13T18:37:22.988660+0000","last_fullsized":"2024-09-13T18:37:22.988660+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:13.085350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987309+0000","last_change":"2024-09-13T18:37:22.987250+0000","last_active":"2024-09-13T18:37:22.987309+0000","last_peered":"2024-09-13T18:37:22.987309+0000","last_clean":"2024-09-13T18:37:22.987309+0000","last_became_active":"2024-09-13T18:37:22.987009+0000","last_became_peered":"2024-09-13T18:37:22.987009+0000","last_unstale":"2024-09-13T18:37:22.987309+0000","last_undegraded":"2024-09-13T18:37:22.987309+0000","last_fullsized":"2024-09-13T18:37:22.987309+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.615020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.981315+0000","last_change":"2024-09-13T18:37:22.562246+0000","last_active":"2024-09-13T18:37:22.981315+0000","last_peered":"2024-09-13T18:37:22.981315+0000","last_clean":"2024-09-13T18:37:22.981315+0000","last_became_active":"2024-09-13T18:37:22.562005+0000","last_became_peered":"2024-09-13T18:37:22.562005+0000","last_unstale":"2024-09-13T18:37:22.981315+0000","last_undegraded":"2024-09-13T18:37:22.981315+0000","last_fullsized":"2024-09-13T18:37:22.981315+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:19.213798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.969044+0000","last_change":"2024-09-13T18:37:22.968220+0000","last_active":"2024-09-13T18:37:22.969044+0000","last_peered":"2024-09-13T18:37:22.969044+0000","last_clean":"2024-09-13T18:37:22.969044+0000","last_became_active":"2024-09-13T18:37:22.967956+0000","last_became_peered":"2024-09-13T18:37:22.967956+0000","last_unstale":"2024-09-13T18:37:22.969044+0000","last_undegraded":"2024-09-13T18:37:22.969044+0000","last_fullsized":"2024-09-13T18:37:22.969044+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:45.923745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972087+0000","last_change":"2024-09-13T18:37:22.555862+0000","last_active":"2024-09-13T18:37:22.972087+0000","last_peered":"2024-09-13T18:37:22.972087+0000","last_clean":"2024-09-13T18:37:22.972087+0000","last_became_active":"2024-09-13T18:37:22.555599+0000","last_became_peered":"2024-09-13T18:37:22.555599+0000","last_unstale":"2024-09-13T18:37:22.972087+0000","last_undegraded":"2024-09-13T18:37:22.972087+0000","last_fullsized":"2024-09-13T18:37:22.972087+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:27.484478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974657+0000","last_change":"2024-09-13T18:37:22.969828+0000","last_active":"2024-09-13T18:37:22.974657+0000","last_peered":"2024-09-13T18:37:22.974657+0000","last_clean":"2024-09-13T18:37:22.974657+0000","last_became_active":"2024-09-13T18:37:22.969524+0000","last_became_peered":"2024-09-13T18:37:22.969524+0000","last_unstale":"2024-09-13T18:37:22.974657+0000","last_undegraded":"2024-09-13T18:37:22.974657+0000","last_fullsized":"2024-09-13T18:37:22.974657+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:35.748071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970486+0000","last_change":"2024-09-13T18:37:22.564684+0000","last_active":"2024-09-13T18:37:22.970486+0000","last_peered":"2024-09-13T18:37:22.970486+0000","last_clean":"2024-09-13T18:37:22.970486+0000","last_became_active":"2024-09-13T18:37:22.564282+0000","last_became_peered":"2024-09-13T18:37:22.564282+0000","last_unstale":"2024-09-13T18:37:22.970486+0000","last_undegraded":"2024-09-13T18:37:22.970486+0000","last_fullsized":"2024-09-13T18:37:22.970486+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:14.849785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977047+0000","last_change":"2024-09-13T18:37:22.976989+0000","last_active":"2024-09-13T18:37:22.977047+0000","last_peered":"2024-09-13T18:37:22.977047+0000","last_clean":"2024-09-13T18:37:22.977047+0000","last_became_active":"2024-09-13T18:37:22.976219+0000","last_became_peered":"2024-09-13T18:37:22.976219+0000","last_unstale":"2024-09-13T18:37:22.977047+0000","last_undegraded":"2024-09-13T18:37:22.977047+0000","last_fullsized":"2024-09-13T18:37:22.977047+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:06.031189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"48'8","reported_seq":18,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983764+0000","last_change":"2024-09-13T18:37:22.565560+0000","last_active":"2024-09-13T18:37:22.983764+0000","last_peered":"2024-09-13T18:37:22.983764+0000","last_clean":"2024-09-13T18:37:22.983764+0000","last_became_active":"2024-09-13T18:37:22.565302+0000","last_became_peered":"2024-09-13T18:37:22.565302+0000","last_unstale":"2024-09-13T18:37:22.983764+0000","last_undegraded":"2024-09-13T18:37:22.983764+0000","last_fullsized":"2024-09-13T18:37:22.983764+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:15.476179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967580+0000","last_change":"2024-09-13T18:37:22.967368+0000","last_active":"2024-09-13T18:37:22.967580+0000","last_peered":"2024-09-13T18:37:22.967580+0000","last_clean":"2024-09-13T18:37:22.967580+0000","last_became_active":"2024-09-13T18:37:22.966678+0000","last_became_peered":"2024-09-13T18:37:22.966678+0000","last_unstale":"2024-09-13T18:37:22.967580+0000","last_undegraded":"2024-09-13T18:37:22.967580+0000","last_fullsized":"2024-09-13T18:37:22.967580+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:21.615020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.987457+0000","last_change":"2024-09-13T18:37:22.566177+0000","last_active":"2024-09-13T18:37:22.987457+0000","last_peered":"2024-09-13T18:37:22.987457+0000","last_clean":"2024-09-13T18:37:22.987457+0000","last_became_active":"2024-09-13T18:37:22.565719+0000","last_became_peered":"2024-09-13T18:37:22.565719+0000","last_unstale":"2024-09-13T18:37:22.987457+0000","last_undegraded":"2024-09-13T18:37:22.987457+0000","last_fullsized":"2024-09-13T18:37:22.987457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:11:13.529401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.974700+0000","last_change":"2024-09-13T18:37:22.972081+0000","last_active":"2024-09-13T18:37:22.974700+0000","last_peered":"2024-09-13T18:37:22.974700+0000","last_clean":"2024-09-13T18:37:22.974700+0000","last_became_active":"2024-09-13T18:37:22.971842+0000","last_became_peered":"2024-09-13T18:37:22.971842+0000","last_unstale":"2024-09-13T18:37:22.974700+0000","last_undegraded":"2024-09-13T18:37:22.974700+0000","last_fullsized":"2024-09-13T18:37:22.974700+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:00.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984837+0000","last_change":"2024-09-13T18:37:22.564375+0000","last_active":"2024-09-13T18:37:22.984837+0000","last_peered":"2024-09-13T18:37:22.984837+0000","last_clean":"2024-09-13T18:37:22.984837+0000","last_became_active":"2024-09-13T18:37:22.564168+0000","last_became_peered":"2024-09-13T18:37:22.564168+0000","last_unstale":"2024-09-13T18:37:22.984837+0000","last_undegraded":"2024-09-13T18:37:22.984837+0000","last_fullsized":"2024-09-13T18:37:22.984837+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:23.356979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977356+0000","last_change":"2024-09-13T18:37:22.977279+0000","last_active":"2024-09-13T18:37:22.977356+0000","last_peered":"2024-09-13T18:37:22.977356+0000","last_clean":"2024-09-13T18:37:22.977356+0000","last_became_active":"2024-09-13T18:37:22.976785+0000","last_became_peered":"2024-09-13T18:37:22.976785+0000","last_unstale":"2024-09-13T18:37:22.977356+0000","last_undegraded":"2024-09-13T18:37:22.977356+0000","last_fullsized":"2024-09-13T18:37:22.977356+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:11.735399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"48'1","reported_seq":11,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982989+0000","last_change":"2024-09-13T18:37:22.564129+0000","last_active":"2024-09-13T18:37:22.982989+0000","last_peered":"2024-09-13T18:37:22.982989+0000","last_clean":"2024-09-13T18:37:22.982989+0000","last_became_active":"2024-09-13T18:37:22.563859+0000","last_became_peered":"2024-09-13T18:37:22.563859+0000","last_unstale":"2024-09-13T18:37:22.982989+0000","last_undegraded":"2024-09-13T18:37:22.982989+0000","last_fullsized":"2024-09-13T18:37:22.982989+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:48:04.820529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966850+0000","last_change":"2024-09-13T18:37:22.966758+0000","last_active":"2024-09-13T18:37:22.966850+0000","last_peered":"2024-09-13T18:37:22.966850+0000","last_clean":"2024-09-13T18:37:22.966850+0000","last_became_active":"2024-09-13T18:37:22.966528+0000","last_became_peered":"2024-09-13T18:37:22.966528+0000","last_unstale":"2024-09-13T18:37:22.966850+0000","last_undegraded":"2024-09-13T18:37:22.966850+0000","last_fullsized":"2024-09-13T18:37:22.966850+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:16.325436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.970574+0000","last_change":"2024-09-13T18:37:22.564503+0000","last_active":"2024-09-13T18:37:22.970574+0000","last_peered":"2024-09-13T18:37:22.970574+0000","last_clean":"2024-09-13T18:37:22.970574+0000","last_became_active":"2024-09-13T18:37:22.563933+0000","last_became_peered":"2024-09-13T18:37:22.563933+0000","last_unstale":"2024-09-13T18:37:22.970574+0000","last_undegraded":"2024-09-13T18:37:22.970574+0000","last_fullsized":"2024-09-13T18:37:22.970574+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982718+0000","last_change":"2024-09-13T18:37:22.982342+0000","last_active":"2024-09-13T18:37:22.982718+0000","last_peered":"2024-09-13T18:37:22.982718+0000","last_clean":"2024-09-13T18:37:22.982718+0000","last_became_active":"2024-09-13T18:37:22.978435+0000","last_became_peered":"2024-09-13T18:37:22.978435+0000","last_unstale":"2024-09-13T18:37:22.982718+0000","last_undegraded":"2024-09-13T18:37:22.982718+0000","last_fullsized":"2024-09-13T18:37:22.982718+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.129408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983935+0000","last_change":"2024-09-13T18:37:22.562921+0000","last_active":"2024-09-13T18:37:22.983935+0000","last_peered":"2024-09-13T18:37:22.983935+0000","last_clean":"2024-09-13T18:37:22.983935+0000","last_became_active":"2024-09-13T18:37:22.562656+0000","last_became_peered":"2024-09-13T18:37:22.562656+0000","last_unstale":"2024-09-13T18:37:22.983935+0000","last_undegraded":"2024-09-13T18:37:22.983935+0000","last_fullsized":"2024-09-13T18:37:22.983935+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:30:34.761566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.973873+0000","last_change":"2024-09-13T18:37:22.973717+0000","last_active":"2024-09-13T18:37:22.973873+0000","last_peered":"2024-09-13T18:37:22.973873+0000","last_clean":"2024-09-13T18:37:22.973873+0000","last_became_active":"2024-09-13T18:37:22.973485+0000","last_became_peered":"2024-09-13T18:37:22.973485+0000","last_unstale":"2024-09-13T18:37:22.973873+0000","last_undegraded":"2024-09-13T18:37:22.973873+0000","last_fullsized":"2024-09-13T18:37:22.973873+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:06.031189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971534+0000","last_change":"2024-09-13T18:37:22.562902+0000","last_active":"2024-09-13T18:37:22.971534+0000","last_peered":"2024-09-13T18:37:22.971534+0000","last_clean":"2024-09-13T18:37:22.971534+0000","last_became_active":"2024-09-13T18:37:22.560205+0000","last_became_peered":"2024-09-13T18:37:22.560205+0000","last_unstale":"2024-09-13T18:37:22.971534+0000","last_undegraded":"2024-09-13T18:37:22.971534+0000","last_fullsized":"2024-09-13T18:37:22.971534+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:55:57.499991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984910+0000","last_change":"2024-09-13T18:37:22.984585+0000","last_active":"2024-09-13T18:37:22.984910+0000","last_peered":"2024-09-13T18:37:22.984910+0000","last_clean":"2024-09-13T18:37:22.984910+0000","last_became_active":"2024-09-13T18:37:22.980785+0000","last_became_peered":"2024-09-13T18:37:22.980785+0000","last_unstale":"2024-09-13T18:37:22.984910+0000","last_undegraded":"2024-09-13T18:37:22.984910+0000","last_fullsized":"2024-09-13T18:37:22.984910+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:13.737567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.962050+0000","last_change":"2024-09-13T18:37:22.563706+0000","last_active":"2024-09-13T18:37:22.962050+0000","last_peered":"2024-09-13T18:37:22.962050+0000","last_clean":"2024-09-13T18:37:22.962050+0000","last_became_active":"2024-09-13T18:37:22.563503+0000","last_became_peered":"2024-09-13T18:37:22.563503+0000","last_unstale":"2024-09-13T18:37:22.962050+0000","last_undegraded":"2024-09-13T18:37:22.962050+0000","last_fullsized":"2024-09-13T18:37:22.962050+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:23:10.729556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.986143+0000","last_change":"2024-09-13T18:37:22.985993+0000","last_active":"2024-09-13T18:37:22.986143+0000","last_peered":"2024-09-13T18:37:22.986143+0000","last_clean":"2024-09-13T18:37:22.986143+0000","last_became_active":"2024-09-13T18:37:22.985635+0000","last_became_peered":"2024-09-13T18:37:22.985635+0000","last_unstale":"2024-09-13T18:37:22.986143+0000","last_undegraded":"2024-09-13T18:37:22.986143+0000","last_fullsized":"2024-09-13T18:37:22.986143+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:15.129408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.967200+0000","last_change":"2024-09-13T18:37:22.562079+0000","last_active":"2024-09-13T18:37:22.967200+0000","last_peered":"2024-09-13T18:37:22.967200+0000","last_clean":"2024-09-13T18:37:22.967200+0000","last_became_active":"2024-09-13T18:37:22.561837+0000","last_became_peered":"2024-09-13T18:37:22.561837+0000","last_unstale":"2024-09-13T18:37:22.967200+0000","last_undegraded":"2024-09-13T18:37:22.967200+0000","last_fullsized":"2024-09-13T18:37:22.967200+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:38:37.745408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972694+0000","last_change":"2024-09-13T18:37:22.972612+0000","last_active":"2024-09-13T18:37:22.972694+0000","last_peered":"2024-09-13T18:37:22.972694+0000","last_clean":"2024-09-13T18:37:22.972694+0000","last_became_active":"2024-09-13T18:37:22.972413+0000","last_became_peered":"2024-09-13T18:37:22.972413+0000","last_unstale":"2024-09-13T18:37:22.972694+0000","last_undegraded":"2024-09-13T18:37:22.972694+0000","last_fullsized":"2024-09-13T18:37:22.972694+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:32:19.109807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.977532+0000","last_change":"2024-09-13T18:37:22.560496+0000","last_active":"2024-09-13T18:37:22.977532+0000","last_peered":"2024-09-13T18:37:22.977532+0000","last_clean":"2024-09-13T18:37:22.977532+0000","last_became_active":"2024-09-13T18:37:22.560198+0000","last_became_peered":"2024-09-13T18:37:22.560198+0000","last_unstale":"2024-09-13T18:37:22.977532+0000","last_undegraded":"2024-09-13T18:37:22.977532+0000","last_fullsized":"2024-09-13T18:37:22.977532+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982122+0000","last_change":"2024-09-13T18:37:22.981427+0000","last_active":"2024-09-13T18:37:22.982122+0000","last_peered":"2024-09-13T18:37:22.982122+0000","last_clean":"2024-09-13T18:37:22.982122+0000","last_became_active":"2024-09-13T18:37:22.979116+0000","last_became_peered":"2024-09-13T18:37:22.979116+0000","last_unstale":"2024-09-13T18:37:22.982122+0000","last_undegraded":"2024-09-13T18:37:22.982122+0000","last_fullsized":"2024-09-13T18:37:22.982122+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:59:11.647077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.971625+0000","last_change":"2024-09-13T18:37:22.563063+0000","last_active":"2024-09-13T18:37:22.971625+0000","last_peered":"2024-09-13T18:37:22.971625+0000","last_clean":"2024-09-13T18:37:22.971625+0000","last_became_active":"2024-09-13T18:37:22.560555+0000","last_became_peered":"2024-09-13T18:37:22.560555+0000","last_unstale":"2024-09-13T18:37:22.971625+0000","last_undegraded":"2024-09-13T18:37:22.971625+0000","last_fullsized":"2024-09-13T18:37:22.971625+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:02:14.849785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.980239+0000","last_change":"2024-09-13T18:37:22.979575+0000","last_active":"2024-09-13T18:37:22.980239+0000","last_peered":"2024-09-13T18:37:22.980239+0000","last_clean":"2024-09-13T18:37:22.980239+0000","last_became_active":"2024-09-13T18:37:22.978789+0000","last_became_peered":"2024-09-13T18:37:22.978789+0000","last_unstale":"2024-09-13T18:37:22.980239+0000","last_undegraded":"2024-09-13T18:37:22.980239+0000","last_fullsized":"2024-09-13T18:37:22.980239+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:40.805997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963934+0000","last_change":"2024-09-13T18:37:22.561696+0000","last_active":"2024-09-13T18:37:22.963934+0000","last_peered":"2024-09-13T18:37:22.963934+0000","last_clean":"2024-09-13T18:37:22.963934+0000","last_became_active":"2024-09-13T18:37:22.560237+0000","last_became_peered":"2024-09-13T18:37:22.560237+0000","last_unstale":"2024-09-13T18:37:22.963934+0000","last_undegraded":"2024-09-13T18:37:22.963934+0000","last_fullsized":"2024-09-13T18:37:22.963934+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:00:55.890790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982073+0000","last_change":"2024-09-13T18:37:22.981013+0000","last_active":"2024-09-13T18:37:22.982073+0000","last_peered":"2024-09-13T18:37:22.982073+0000","last_clean":"2024-09-13T18:37:22.982073+0000","last_became_active":"2024-09-13T18:37:22.980495+0000","last_became_peered":"2024-09-13T18:37:22.980495+0000","last_unstale":"2024-09-13T18:37:22.982073+0000","last_undegraded":"2024-09-13T18:37:22.982073+0000","last_fullsized":"2024-09-13T18:37:22.982073+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:33:05.978858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.972223+0000","last_change":"2024-09-13T18:37:22.559865+0000","last_active":"2024-09-13T18:37:22.972223+0000","last_peered":"2024-09-13T18:37:22.972223+0000","last_clean":"2024-09-13T18:37:22.972223+0000","last_became_active":"2024-09-13T18:37:22.559625+0000","last_became_peered":"2024-09-13T18:37:22.559625+0000","last_unstale":"2024-09-13T18:37:22.972223+0000","last_undegraded":"2024-09-13T18:37:22.972223+0000","last_fullsized":"2024-09-13T18:37:22.972223+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:19.659609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.984884+0000","last_change":"2024-09-13T18:37:22.984380+0000","last_active":"2024-09-13T18:37:22.984884+0000","last_peered":"2024-09-13T18:37:22.984884+0000","last_clean":"2024-09-13T18:37:22.984884+0000","last_became_active":"2024-09-13T18:37:22.980212+0000","last_became_peered":"2024-09-13T18:37:22.980212+0000","last_unstale":"2024-09-13T18:37:22.984884+0000","last_undegraded":"2024-09-13T18:37:22.984884+0000","last_fullsized":"2024-09-13T18:37:22.984884+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:46:41.589420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968542+0000","last_change":"2024-09-13T18:37:22.556852+0000","last_active":"2024-09-13T18:37:22.968542+0000","last_peered":"2024-09-13T18:37:22.968542+0000","last_clean":"2024-09-13T18:37:22.968542+0000","last_became_active":"2024-09-13T18:37:22.556621+0000","last_became_peered":"2024-09-13T18:37:22.556621+0000","last_unstale":"2024-09-13T18:37:22.968542+0000","last_undegraded":"2024-09-13T18:37:22.968542+0000","last_fullsized":"2024-09-13T18:37:22.968542+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:22.245188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.979193+0000","last_change":"2024-09-13T18:37:22.979007+0000","last_active":"2024-09-13T18:37:22.979193+0000","last_peered":"2024-09-13T18:37:22.979193+0000","last_clean":"2024-09-13T18:37:22.979193+0000","last_became_active":"2024-09-13T18:37:22.978790+0000","last_became_peered":"2024-09-13T18:37:22.978790+0000","last_unstale":"2024-09-13T18:37:22.979193+0000","last_undegraded":"2024-09-13T18:37:22.979193+0000","last_fullsized":"2024-09-13T18:37:22.979193+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:00.834157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.968417+0000","last_change":"2024-09-13T18:37:22.564269+0000","last_active":"2024-09-13T18:37:22.968417+0000","last_peered":"2024-09-13T18:37:22.968417+0000","last_clean":"2024-09-13T18:37:22.968417+0000","last_became_active":"2024-09-13T18:37:22.563874+0000","last_became_peered":"2024-09-13T18:37:22.563874+0000","last_unstale":"2024-09-13T18:37:22.968417+0000","last_undegraded":"2024-09-13T18:37:22.968417+0000","last_fullsized":"2024-09-13T18:37:22.968417+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:32:34.742228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.966908+0000","last_change":"2024-09-13T18:37:22.966406+0000","last_active":"2024-09-13T18:37:22.966908+0000","last_peered":"2024-09-13T18:37:22.966908+0000","last_clean":"2024-09-13T18:37:22.966908+0000","last_became_active":"2024-09-13T18:37:22.966130+0000","last_became_peered":"2024-09-13T18:37:22.966130+0000","last_unstale":"2024-09-13T18:37:22.966908+0000","last_undegraded":"2024-09-13T18:37:22.966908+0000","last_fullsized":"2024-09-13T18:37:22.966908+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:39.513560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.963692+0000","last_change":"2024-09-13T18:37:22.554671+0000","last_active":"2024-09-13T18:37:22.963692+0000","last_peered":"2024-09-13T18:37:22.963692+0000","last_clean":"2024-09-13T18:37:22.963692+0000","last_became_active":"2024-09-13T18:37:22.553103+0000","last_became_peered":"2024-09-13T18:37:22.553103+0000","last_unstale":"2024-09-13T18:37:22.963692+0000","last_undegraded":"2024-09-13T18:37:22.963692+0000","last_fullsized":"2024-09-13T18:37:22.963692+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:26.284657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.982725+0000","last_change":"2024-09-13T18:37:22.978892+0000","last_active":"2024-09-13T18:37:22.982725+0000","last_peered":"2024-09-13T18:37:22.982725+0000","last_clean":"2024-09-13T18:37:22.982725+0000","last_became_active":"2024-09-13T18:37:22.978678+0000","last_became_peered":"2024-09-13T18:37:22.978678+0000","last_unstale":"2024-09-13T18:37:22.982725+0000","last_undegraded":"2024-09-13T18:37:22.982725+0000","last_fullsized":"2024-09-13T18:37:22.982725+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":47,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:22.543877+0000","last_clean_scrub_stamp":"2024-09-13T18:37:22.543877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:22:33.443172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"48'2","reported_seq":12,"reported_epoch":48,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.983457+0000","last_change":"2024-09-13T18:37:22.559788+0000","last_active":"2024-09-13T18:37:22.983457+0000","last_peered":"2024-09-13T18:37:22.983457+0000","last_clean":"2024-09-13T18:37:22.983457+0000","last_became_active":"2024-09-13T18:37:22.559540+0000","last_became_peered":"2024-09-13T18:37:22.559540+0000","last_unstale":"2024-09-13T18:37:22.983457+0000","last_undegraded":"2024-09-13T18:37:22.983457+0000","last_fullsized":"2024-09-13T18:37:22.983457+0000","mapping_epoch":46,"log_start":"0'0","ondisk_log_start":"0'0","created":46,"last_epoch_clean":47,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:37:21.538034+0000","last_clean_scrub_stamp":"2024-09-13T18:37:21.538034+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:39.214871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":188,"reported_epoch":47,"state":"active+clean","last_fresh":"2024-09-13T18:37:22.557645+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:37:22.557645+0000","last_peered":"2024-09-13T18:37:22.557645+0000","last_clean":"2024-09-13T18:37:22.557645+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:37:22.557645+0000","last_undegraded":"2024-09-13T18:37:22.557645+0000","last_fullsized":"2024-09-13T18:37:22.557645+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542171,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179543,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.77600000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.75800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":6.1040000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":6.0890000000000004,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.60499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.55400000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.84599999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69799999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574873,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":224,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195087,"statfs":{"total":200000000,"available":199769899,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.44}]},{"osd":1,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.46400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.69999999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.75600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.85999999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195087,"statfs":{"total":200000000,"available":199769317,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":6.4539999999999997,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68999999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":6.3890000000000002,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":6.5019999999999998,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.55600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":6.3310000000000004,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.57399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":6.2039999999999997,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.76000000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.754}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":226,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195086,"statfs":{"total":200000000,"available":199768277,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.58699999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.436}]},{"osd":2,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.51000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.4870000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:36:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.51700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":8.1059999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":4.8310000000000004,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.42199999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":7.798,"5min":7.798,"15min":7.798},"last":0.57799999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.093,"5min":3.093,"15min":3.093},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.4039999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.66000000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":3.0299999999999998,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":7.9199999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.748},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.0519999999999996,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:36:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":2.9900000000000002,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.71099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.69499999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.67100000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.55800000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:36:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":801,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194511,"statfs":{"total":200000000,"available":199179495,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.32000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.436},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.46999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.79300000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:36:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.752},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.86899999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":218,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195094,"statfs":{"total":200000000,"available":199776708,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.669,"5min":1.669,"15min":1.669},"last":0.496},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.27800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.591,"5min":1.591,"15min":1.591},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.45000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.637,"5min":1.637,"15min":1.637},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.698,"5min":1.698,"15min":1.698},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:36:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.3010000000000002,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.70799999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:36:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.62}]}]}],"pool_statfs":[]}} 2024-09-13T18:37:27.573 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:37:27.573 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:37:27.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.731+0000 7f9504a00640 1 Processor -- start 2024-09-13T18:37:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.731+0000 7f9504a00640 1 -- start start 2024-09-13T18:37:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f9504a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95001589f0 0x7f95000b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f9504a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000b3af0 0x7f950015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f9504a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000b2000 con 0x7f950006c0b0 2024-09-13T18:37:27.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f9504a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950015bbd0 con 0x7f95001589f0 2024-09-13T18:37:27.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f9504a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950015beb0 con 0x7f95000b3af0 2024-09-13T18:37:27.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94fe800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f950006c0b0 0x7f95000cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59896/0 (socket says 172.21.15.192:59896) 2024-09-13T18:37:27.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94fe800640 1 -- 172.21.15.192:0/1798096105 learned_addr learned my addr 172.21.15.192:0/1798096105 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94fde00640 1 --2- 172.21.15.192:0/1798096105 >> v2:172.21.15.194:3300/0 conn(0x7f95001589f0 0x7f95000b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94f5400640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000b3af0 0x7f950015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1382334346 0 0) 0x7f95000b2000 con 0x7f950006c0b0 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.733+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e4003520 con 0x7f950006c0b0 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.734+0000 7f94fde00640 1 -- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000b3af0 msgr2=0x7f950015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.734+0000 7f94fde00640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000b3af0 0x7f950015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.734+0000 7f94fde00640 1 -- 172.21.15.192:0/1798096105 >> v1:172.21.15.192:6789/0 conn(0x7f950006c0b0 legacy=0x7f95000cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.734+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2153275423 0 0) 0x7f94e4003520 con 0x7f950006c0b0 2024-09-13T18:37:27.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.734+0000 7f94fde00640 1 -- 172.21.15.192:0/1798096105 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950015c190 con 0x7f95001589f0 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f94fde00640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95001589f0 0x7f95000b2490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94f00097a0 tx=0x7f94f002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62a4fd67715ea233 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0032440 con 0x7f95001589f0 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f00325a0 con 0x7f95001589f0 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f94fd400640 1 -- 172.21.15.192:0/1798096105 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0032930 con 0x7f95001589f0 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f9504a00640 1 -- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95001589f0 msgr2=0x7f95000b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.735+0000 7f9504a00640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95001589f0 0x7f95000b2490 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f94f00097a0 tx=0x7f94f002a180 comp rx=0 tx=0).stop 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 -- 172.21.15.192:0/1798096105 shutdown_connections 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95000b3af0 0x7f950015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 --2- 172.21.15.192:0/1798096105 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95001589f0 0x7f95000b2490 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 -- 172.21.15.192:0/1798096105 >> 172.21.15.192:0/1798096105 conn(0x7f95000b08f0 msgr2=0x7f95000b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 -- 172.21.15.192:0/1798096105 shutdown_connections 2024-09-13T18:37:27.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.736+0000 7f9504a00640 1 -- 172.21.15.192:0/1798096105 wait complete. 2024-09-13T18:37:27.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.737+0000 7f9504a00640 1 Processor -- start 2024-09-13T18:37:27.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.737+0000 7f9504a00640 1 -- start start 2024-09-13T18:37:27.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000b3af0 0x7f9500151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95001589f0 0x7f95000ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9500147c00 con 0x7f950006c0b0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95001521a0 con 0x7f95000b3af0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.738+0000 7f9504a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9500151be0 con 0x7f95001589f0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44762/0 (socket says 172.21.15.192:44762) 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 -- 172.21.15.192:0/2999814080 learned_addr learned my addr 172.21.15.192:0/2999814080 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94f5400640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000b3af0 0x7f9500151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fe800640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95001589f0 0x7f95000ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 -- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95001589f0 msgr2=0x7f95000ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95001589f0 0x7f95000ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 -- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000b3af0 msgr2=0x7f9500151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000b3af0 0x7f9500151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 -- 172.21.15.192:0/2999814080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f0009400 con 0x7f950006c0b0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.739+0000 7f94fde00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94f00098c0 tx=0x7f94f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.740+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f003d8f0 con 0x7f950006c0b0 2024-09-13T18:37:27.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.740+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f003da70 con 0x7f950006c0b0 2024-09-13T18:37:27.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.740+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f003de20 con 0x7f950006c0b0 2024-09-13T18:37:27.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.740+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9500151ec0 con 0x7f950006c0b0 2024-09-13T18:37:27.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.740+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950006a320 con 0x7f950006c0b0 2024-09-13T18:37:27.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.741+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9500069ea0 con 0x7f950006c0b0 2024-09-13T18:37:27.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.742+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94f0039040 con 0x7f950006c0b0 2024-09-13T18:37:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.743+0000 7f94f6a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 0x7f94dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.743+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f94f00a9dd0 con 0x7f950006c0b0 2024-09-13T18:37:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.743+0000 7f94f5400640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 0x7f94dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.744+0000 7f94f5400640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 0x7f94dc06d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95000ae430 tx=0x7f94e8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:27.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.748+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9500069ea0 con 0x7f950006c0b0 2024-09-13T18:37:27.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.977+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9500069ea0 con 0x7f950006c0b0 2024-09-13T18:37:27.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.981+0000 7f94f6a00640 1 -- 172.21.15.192:0/2999814080 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9500069ea0 con 0x7f950006c0b0 2024-09-13T18:37:27.984 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:37:27.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.983+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 msgr2=0x7f94dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.983+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 0x7f94dc06d0c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f95000ae430 tx=0x7f94e8009190 comp rx=0 tx=0).stop 2024-09-13T18:37:27.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.983+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 msgr2=0x7f95001476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.983+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f94f00098c0 tx=0x7f94f00046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 shutdown_connections 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f94dc06ac00 0x7f94dc06d0c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95001589f0 0x7f95000ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95000b3af0 0x7f9500151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 --2- 172.21.15.192:0/2999814080 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f950006c0b0 0x7f95001476c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 >> 172.21.15.192:0/2999814080 conn(0x7f95000b08f0 msgr2=0x7f95000cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 shutdown_connections 2024-09-13T18:37:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:27.984+0000 7f9504a00640 1 -- 172.21.15.192:0/2999814080 wait complete. 2024-09-13T18:37:28.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:28.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.156+0000 7f049ec00640 1 Processor -- start 2024-09-13T18:37:28.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.156+0000 7f049ec00640 1 -- start start 2024-09-13T18:37:28.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f049ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0498071810 0x7f04980b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f049ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 0x7f04980cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f049ec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0498071dd0 con 0x7f0498150480 2024-09-13T18:37:28.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f049ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04980cb770 con 0x7f0498071810 2024-09-13T18:37:28.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f049ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04980cba50 con 0x7f04980b2230 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f0497e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0498150480 0x7f049815a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59900/0 (socket says 172.21.15.192:59900) 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.157+0000 7f0497e00640 1 -- 172.21.15.192:0/2091915802 learned_addr learned my addr 172.21.15.192:0/2091915802 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f049cc00640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 0x7f04980cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0497400640 1 --2- 172.21.15.192:0/2091915802 >> v2:172.21.15.194:3300/0 conn(0x7f0498071810 0x7f04980b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0496a00640 1 -- 172.21.15.192:0/2091915802 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302592135 0 0) 0x7f0498071dd0 con 0x7f0498150480 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0496a00640 1 -- 172.21.15.192:0/2091915802 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f047c003520 con 0x7f0498150480 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0497400640 1 -- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 msgr2=0x7f04980cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0497400640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 0x7f04980cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0497400640 1 -- 172.21.15.192:0/2091915802 >> v1:172.21.15.192:6789/0 conn(0x7f0498150480 legacy=0x7f049815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f0497400640 1 -- 172.21.15.192:0/2091915802 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04980cbd30 con 0x7f0498071810 2024-09-13T18:37:28.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.158+0000 7f049cc00640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 0x7f04980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:28.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.159+0000 7f0497400640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498071810 0x7f04980b1cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04840097a0 tx=0x7f048402a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00f5349fc10574c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.159+0000 7f0496a00640 1 -- 172.21.15.192:0/2091915802 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048402ae50 con 0x7f0498071810 2024-09-13T18:37:28.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f0496a00640 1 -- 172.21.15.192:0/2091915802 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0484032440 con 0x7f0498071810 2024-09-13T18:37:28.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f0496a00640 1 -- 172.21.15.192:0/2091915802 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04840327b0 con 0x7f0498071810 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 -- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498071810 msgr2=0x7f04980b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498071810 0x7f04980b1cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f04840097a0 tx=0x7f048402a100 comp rx=0 tx=0).stop 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 -- 172.21.15.192:0/2091915802 shutdown_connections 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04980b2230 0x7f04980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 --2- 172.21.15.192:0/2091915802 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498071810 0x7f04980b1cf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 -- 172.21.15.192:0/2091915802 >> 172.21.15.192:0/2091915802 conn(0x7f04980ae960 msgr2=0x7f049806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 -- 172.21.15.192:0/2091915802 shutdown_connections 2024-09-13T18:37:28.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.160+0000 7f049ec00640 1 -- 172.21.15.192:0/2091915802 wait complete. 2024-09-13T18:37:28.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.162+0000 7f049ec00640 1 Processor -- start 2024-09-13T18:37:28.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.162+0000 7f049ec00640 1 -- start start 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 0x7f049815c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498150480 0x7f04981f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0498155870 con 0x7f04980b2230 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0498155a60 con 0x7f0498150480 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f049ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0498155d40 con 0x7f0498071810 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f0497400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f0497400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44766/0 (socket says 172.21.15.192:44766) 2024-09-13T18:37:28.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.163+0000 7f0497400640 1 -- 172.21.15.192:0/2284666393 learned_addr learned my addr 172.21.15.192:0/2284666393 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f049cc00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498150480 0x7f04981f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497e00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 0x7f049815c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 -- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 msgr2=0x7f049815c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 0x7f049815c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 -- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498150480 msgr2=0x7f04981f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498150480 0x7f04981f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 -- 172.21.15.192:0/2284666393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490009a70 con 0x7f04980b2230 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497e00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 0x7f049815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f0497400640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f04840098c0 tx=0x7f04840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.164+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048403c810 con 0x7f04980b2230 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.165+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048403c970 con 0x7f04980b2230 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.165+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048403cd20 con 0x7f04980b2230 2024-09-13T18:37:28.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.165+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0484009400 con 0x7f04980b2230 2024-09-13T18:37:28.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.165+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0498156300 con 0x7f04980b2230 2024-09-13T18:37:28.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.166+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0498071dd0 con 0x7f04980b2230 2024-09-13T18:37:28.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.167+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f048403b3a0 con 0x7f04980b2230 2024-09-13T18:37:28.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.167+0000 7f048fe00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 0x7f047806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.167+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f04840aa130 con 0x7f04980b2230 2024-09-13T18:37:28.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.168+0000 7f0497e00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 0x7f047806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.168+0000 7f0497e00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 0x7f047806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0488007fd0 tx=0x7f0488009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.171+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0484075150 con 0x7f04980b2230 2024-09-13T18:37:28.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.370+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0498157640 con 0x7f04980b2230 2024-09-13T18:37:28.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.371+0000 7f048fe00640 1 -- 172.21.15.192:0/2284666393 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f0484078770 con 0x7f04980b2230 2024-09-13T18:37:28.374 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:28.374 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:37:28.374 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 msgr2=0x7f047806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 0x7f047806d0c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0488007fd0 tx=0x7f0488009040 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 msgr2=0x7f049815d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f04840098c0 tx=0x7f04840046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 shutdown_connections 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f047806ac00 0x7f047806d0c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0498150480 0x7f04981f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04980b2230 0x7f049815d540 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 --2- 172.21.15.192:0/2284666393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0498071810 0x7f049815c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 >> 172.21.15.192:0/2284666393 conn(0x7f04980ae960 msgr2=0x7f049806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 shutdown_connections 2024-09-13T18:37:28.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.373+0000 7f049ec00640 1 -- 172.21.15.192:0/2284666393 wait complete. 2024-09-13T18:37:28.539 INFO:tasks.ceph.mds.b.smithi194.stderr:2024-09-13T18:37:28.536+0000 7f2520000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:37:28.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:37:22.957094+0000', 'modified': '2024-09-13T18:37:25.977539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5461}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5461': {'gid': 5461, 'name': 'b', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6834/530866381', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6832', 'nonce': 530866381}, {'type': 'v1', 'addr': '172.21.15.194:6834', 'nonce': 530866381}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:37:28.795 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:37:28.795 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:37:28.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.947+0000 7f9bbf200640 1 Processor -- start 2024-09-13T18:37:28.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.947+0000 7f9bbf200640 1 -- start start 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbf200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9bc01598d0 0x7f9bc00b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbf200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9bc006b890 0x7f9bc00cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbf200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc006bf10 con 0x7f9bc00cd5b0 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbf200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc006bd20 con 0x7f9bc01598d0 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbf200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc00cdf60 con 0x7f9bc006b890 2024-09-13T18:37:28.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9bc01598d0 0x7f9bc00b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9bc01598d0 0x7f9bc00b3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44778/0 (socket says 172.21.15.192:44778) 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 -- 172.21.15.192:0/2548220439 learned_addr learned my addr 172.21.15.192:0/2548220439 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbe800640 1 --2- 172.21.15.192:0/2548220439 >> v2:172.21.15.194:3300/0 conn(0x7f9bc006b890 0x7f9bc00cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 -- 172.21.15.192:0/2548220439 >> v2:172.21.15.194:3300/0 conn(0x7f9bc006b890 msgr2=0x7f9bc00cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 --2- 172.21.15.192:0/2548220439 >> v2:172.21.15.194:3300/0 conn(0x7f9bc006b890 0x7f9bc00cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 -- 172.21.15.192:0/2548220439 >> v1:172.21.15.194:6789/0 conn(0x7f9bc00cd5b0 legacy=0x7f9bc006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.949+0000 7f9bbde00640 1 -- 172.21.15.192:0/2548220439 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc00b2e10 con 0x7f9bc01598d0 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.950+0000 7f9bbde00640 1 --2- 172.21.15.192:0/2548220439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00b3bd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ce3c0 tx=0x7f9bb002a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175b00d6d1bc9cc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbd400640 1 -- 172.21.15.192:0/2548220439 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0032440 con 0x7f9bc01598d0 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbd400640 1 -- 172.21.15.192:0/2548220439 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb00325a0 con 0x7f9bc01598d0 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbd400640 1 -- 172.21.15.192:0/2548220439 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0032930 con 0x7f9bc01598d0 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 -- 172.21.15.192:0/2548220439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 msgr2=0x7f9bc00b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 --2- 172.21.15.192:0/2548220439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00b3bd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9bc00ce3c0 tx=0x7f9bb002a2a0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 -- 172.21.15.192:0/2548220439 shutdown_connections 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 --2- 172.21.15.192:0/2548220439 >> v2:172.21.15.194:3300/0 conn(0x7f9bc006b890 0x7f9bc00cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 --2- 172.21.15.192:0/2548220439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00b3bd0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 -- 172.21.15.192:0/2548220439 >> 172.21.15.192:0/2548220439 conn(0x7f9bc00736d0 msgr2=0x7f9bc00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 -- 172.21.15.192:0/2548220439 shutdown_connections 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.951+0000 7f9bbf200640 1 -- 172.21.15.192:0/2548220439 wait complete. 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.953+0000 7f9bbf200640 1 Processor -- start 2024-09-13T18:37:28.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.953+0000 7f9bbf200640 1 -- start start 2024-09-13T18:37:28.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bc006b890 0x7f9bc0145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bc00cd5b0 0x7f9bc014c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc01f2d00 con 0x7f9bc01598d0 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0145a40 con 0x7f9bc00cd5b0 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbf200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc01569e0 con 0x7f9bc006b890 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44780/0 (socket says 172.21.15.192:44780) 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbe800640 1 -- 172.21.15.192:0/694396084 learned_addr learned my addr 172.21.15.192:0/694396084 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bb5400640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bc00cd5b0 0x7f9bc014c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.954+0000 7f9bbde00640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bc006b890 0x7f9bc0145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 -- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bc006b890 msgr2=0x7f9bc0145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bc006b890 0x7f9bc0145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 -- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bc00cd5b0 msgr2=0x7f9bc014c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bc00cd5b0 0x7f9bc014c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 -- 172.21.15.192:0/694396084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb00094d0 con 0x7f9bc01598d0 2024-09-13T18:37:28.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbe800640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8007e40 tx=0x7f9bb800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bb6a00640 1 -- 172.21.15.192:0/694396084 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8014620 con 0x7f9bc01598d0 2024-09-13T18:37:28.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bb6a00640 1 -- 172.21.15.192:0/694396084 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800ee90 con 0x7f9bc01598d0 2024-09-13T18:37:28.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bb6a00640 1 -- 172.21.15.192:0/694396084 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb80149e0 con 0x7f9bc01598d0 2024-09-13T18:37:28.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc014f5a0 con 0x7f9bc01598d0 2024-09-13T18:37:28.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.955+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc014fb60 con 0x7f9bc01598d0 2024-09-13T18:37:28.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.957+0000 7f9bb6a00640 1 -- 172.21.15.192:0/694396084 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9bb8014b40 con 0x7f9bc01598d0 2024-09-13T18:37:28.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.959+0000 7f9bb6a00640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 0x7f9b9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.959+0000 7f9bb6a00640 1 -- 172.21.15.192:0/694396084 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9bb8089d10 con 0x7f9bc01598d0 2024-09-13T18:37:28.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.959+0000 7f9bbde00640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 0x7f9b9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.959+0000 7f9bc7cc8740 1 Processor -- start 2024-09-13T18:37:28.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 -- start start 2024-09-13T18:37:28.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bbde00640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 0x7f9b9c06d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0034000 tx=0x7f9bb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b4ead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b4eb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b406ab0 con 0x55703b49d840 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b404240 con 0x55703b4c4cf0 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.960+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55703b3ffb30 con 0x55703b49b000 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44794/0 (socket says 172.21.15.192:44794) 2024-09-13T18:37:28.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 -- 172.21.15.192:0/613795096 learned_addr learned my addr 172.21.15.192:0/613795096 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bb5400640 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b4ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbe800640 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b4eb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 -- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 msgr2=0x55703b4ead10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b4ead10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 -- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 msgr2=0x55703b4eb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b4eb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 -- 172.21.15.192:0/613795096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703b3cabd0 con 0x55703b49d840 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.961+0000 7f9bbde00640 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb002c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5364ccd82ff71a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9baea00640 1 -- 172.21.15.192:0/613795096 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb003c700 con 0x55703b49d840 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9baea00640 1 -- 172.21.15.192:0/613795096 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb003c860 con 0x55703b49d840 2024-09-13T18:37:28.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9baea00640 1 -- 172.21.15.192:0/613795096 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb003cbd0 con 0x55703b49d840 2024-09-13T18:37:28.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/613795096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 msgr2=0x55703b49dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0000c00 tx=0x7f9bb002c000 comp rx=0 tx=0).stop 2024-09-13T18:37:28.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/613795096 shutdown_connections 2024-09-13T18:37:28.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b4eb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b4ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/613795096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b49dc20 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.962+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/613795096 >> 172.21.15.192:0/613795096 conn(0x55703b499f70 msgr2=0x55703b4e2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.963+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/613795096 shutdown_connections 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.963+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/613795096 wait complete. 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.963+0000 7f9bc7cc8740 1 -- start start 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.963+0000 7f9bc7cc8740 1 Processor -- start 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b4c4cf0 0x55703b4df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4dfe50 0x55703b4c7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b3a1260 con 0x55703b49d840 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b3a0f00 con 0x55703b4dfe50 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55703b166f20 con 0x55703b4c4cf0 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bc7cc8740 10 client.0 _ll_register_callbacks cb 0x55703b3f91a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:28.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.964+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44800/0 (socket says 172.21.15.192:44800) 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 -- 172.21.15.192:0/3366229422 learned_addr learned my addr 172.21.15.192:0/3366229422 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b4c4cf0 0x55703b4df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbe800640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4dfe50 0x55703b4c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 -- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b4c4cf0 msgr2=0x55703b4df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b4c4cf0 0x55703b4df910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 -- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4dfe50 msgr2=0x55703b4c7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4dfe50 0x55703b4c7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 -- 172.21.15.192:0/3366229422 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc00b2e10 con 0x55703b49d840 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0032570 tx=0x7f9bb0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f490325bfb776f97 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9ba3400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.965+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0051820 con 0x55703b49d840 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9bb0051980 con 0x55703b49d840 2024-09-13T18:37:28.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55703b429cd0 con 0x55703b49d840 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9bb0051b40 con 0x55703b49d840 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 10 client.5727 fetch_fsmap learned FSMap version 24 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55703b3fe1b0 con 0x55703b49d840 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55703b429cd0 con 0x55703b49d840 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9bb0044040 con 0x55703b49d840 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 10 client.5727 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 10 client.5727 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 20 client.5727 populate_metadata read hostname 'smithi192' 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4c3970 0x55703b4b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 4 client.5727 mds_command: new command op to 5461 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.966+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 --> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55703b0f33c0 con 0x55703b4c3970 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.967+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4c3970 0x55703b4b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.967+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4c3970 0x55703b4b0d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=accf48de0637689f server_cookie=884d635a00381d5f in_seq=0 out_seq=0 2024-09-13T18:37:28.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.967+0000 7f9ba3400640 10 client.5727 ms_handle_connect on v2:172.21.15.194:6832/530866381 2024-09-13T18:37:28.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9ba3400640 1 -- 172.21.15.192:0/3366229422 <== mds.0 v2:172.21.15.194:6832/530866381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55703b0f33c0 con 0x55703b4c3970 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9ba3400640 10 client.5727 handle_command_reply: tid=0 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 client.5727 shutdown 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 msgr2=0x55703b4aed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0032570 tx=0x7f9bb0004730 comp rx=0 tx=0).stop 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 shutdown_connections 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4c3970 0x55703b4b0d80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4dfe50 0x55703b4c7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b4c4cf0 0x55703b4df910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3366229422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4aed20 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9ba3400640 0 client.5727 ms_handle_reset on v2:172.21.15.194:6832/530866381 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.968+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 >> 172.21.15.192:0/3366229422 conn(0x55703b49b000 msgr2=0x55703b498e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.969+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 shutdown_connections 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.969+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3366229422 wait complete. 2024-09-13T18:37:28.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.969+0000 7f9bc7cc8740 20 client.5727 trim_cache size 0 max 16384 2024-09-13T18:37:28.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.984+0000 7f9bc7cc8740 1 Processor -- start 2024-09-13T18:37:28.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.984+0000 7f9bc7cc8740 1 -- start start 2024-09-13T18:37:28.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49d840 0x55703b4e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b49bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b4c34d0 con 0x55703b49b000 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b4c6200 con 0x55703b4c4cf0 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55703b4c50d0 con 0x55703b49d840 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44814/0 (socket says 172.21.15.192:44814) 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 -- 172.21.15.192:0/3658180889 learned_addr learned my addr 172.21.15.192:0/3658180889 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbe800640 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b49bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49d840 0x55703b4e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 -- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49d840 msgr2=0x55703b4e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49d840 0x55703b4e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 -- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 msgr2=0x55703b49bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b49bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.985+0000 7f9bbde00640 1 -- 172.21.15.192:0/3658180889 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55703b433170 con 0x55703b49b000 2024-09-13T18:37:28.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0006c40 tx=0x7f9bb0053040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11569242500933d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9baf400640 1 -- 172.21.15.192:0/3658180889 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0051820 con 0x55703b49b000 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9baf400640 1 -- 172.21.15.192:0/3658180889 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb0051980 con 0x55703b49b000 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9baf400640 1 -- 172.21.15.192:0/3658180889 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb003cc80 con 0x55703b49b000 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3658180889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 msgr2=0x55703b4e2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0006c40 tx=0x7f9bb0053040 comp rx=0 tx=0).stop 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3658180889 shutdown_connections 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b49bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49d840 0x55703b4e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3658180889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49b000 0x55703b4e2390 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3658180889 >> 172.21.15.192:0/3658180889 conn(0x55703b4c5440 msgr2=0x55703b4e70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3658180889 shutdown_connections 2024-09-13T18:37:28.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.986+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3658180889 wait complete. 2024-09-13T18:37:28.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.987+0000 7f9bc7cc8740 1 -- start start 2024-09-13T18:37:28.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.987+0000 7f9bc7cc8740 1 Processor -- start 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b5441f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b53ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b4e65e0 con 0x55703b49d840 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55703b5415e0 con 0x55703b4c4cf0 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55703b5447f0 con 0x55703b49b000 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bc7cc8740 10 client.0 _ll_register_callbacks cb 0x7f9bb004b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bb5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bb5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44828/0 (socket says 172.21.15.192:44828) 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.988+0000 7f9bb5400640 1 -- 172.21.15.192:0/3655196651 learned_addr learned my addr 172.21.15.192:0/3655196651 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:28.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bbe800640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b53ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b5441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 -- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 msgr2=0x55703b5441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b5441f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 -- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 msgr2=0x55703b53ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b53ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 -- 172.21.15.192:0/3655196651 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55703b3fe1b0 con 0x55703b49d840 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bb5400640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f60 tx=0x7f9ba801ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1923fd972f2c2fbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9ba3400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8007250 con 0x55703b49d840 2024-09-13T18:37:28.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9ba80073b0 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9bb003c860 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba8007570 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bc7cc8740 10 client.5733 fetch_fsmap learned FSMap version 24 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.989+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) v3 -- 0x55703b3a0470 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb003c860 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 24) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9ba8024020 con 0x55703b49d840 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 10 client.5733 fetch_fsmap finished waiting for FSMap version 24 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 10 client.5733 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 20 client.5733 populate_metadata read hostname 'smithi192' 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4dfe50 0x55703b4e0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 4 client.5733 mds_command: new command op to 5461 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:37:28.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 --> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55703b1046c0 con 0x55703b4dfe50 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.990+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4dfe50 0x55703b4e0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9ba3400640 10 client.5733 ms_handle_connect on v2:172.21.15.194:6832/530866381 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bbde00640 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4dfe50 0x55703b4e0410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f332d80d515e499 server_cookie=47302d793b335f98 in_seq=0 out_seq=0 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9ba3400640 1 -- 172.21.15.192:0/3655196651 <== mds.0 v2:172.21.15.194:6832/530866381 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55703b1046c0 con 0x55703b4dfe50 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9ba3400640 10 client.5733 handle_command_reply: tid=0 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 client.5733 shutdown 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 msgr2=0x55703b4e60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8000f60 tx=0x7f9ba801ced0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 shutdown_connections 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:6832/530866381,v1:172.21.15.194:6834/530866381] conn(0x55703b4dfe50 0x55703b4e0410 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55703b4c4cf0 0x55703b53ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55703b49d840 0x55703b4e60a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:28.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9ba3400640 0 client.5733 ms_handle_reset on v2:172.21.15.194:6832/530866381 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 --2- 172.21.15.192:0/3655196651 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55703b49b000 0x55703b5441f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 >> 172.21.15.192:0/3655196651 conn(0x55703b4c5440 msgr2=0x55703b4e9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 shutdown_connections 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.991+0000 7f9bc7cc8740 1 -- 172.21.15.192:0/3655196651 wait complete. 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bc7cc8740 20 client.5733 trim_cache size 0 max 16384 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:37:29.000 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 5461, 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0316110140000001, 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 24, 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 51, 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 49, 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 10.978752140999999 2024-09-13T18:37:29.001 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 msgr2=0x7f9b9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 0x7f9b9c06d0c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9bb0034000 tx=0x7f9bb002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 msgr2=0x7f9bc00ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8007e40 tx=0x7f9bb800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 shutdown_connections 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9b9c06ac00 0x7f9b9c06d0c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bc01598d0 0x7f9bc00ad840 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bc00cd5b0 0x7f9bc014c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 --2- 172.21.15.192:0/694396084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bc006b890 0x7f9bc0145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 >> 172.21.15.192:0/694396084 conn(0x7f9bc00736d0 msgr2=0x7f9bc00afcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:29.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 shutdown_connections 2024-09-13T18:37:29.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:28.992+0000 7f9bbf200640 1 -- 172.21.15.192:0/694396084 wait complete. 2024-09-13T18:37:29.010 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:29.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.161+0000 7f2fc2c00640 1 Processor -- start 2024-09-13T18:37:29.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.161+0000 7f2fc2c00640 1 -- start start 2024-09-13T18:37:29.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fc2c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 0x7f2fbc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fc2c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b2f00 con 0x7f2fbc0b3f10 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fc2c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fbc0b3150 con 0x7f2fbc15dee0 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fc2c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc0b3430 con 0x7f2fbc0b0490 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fb3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2fbc0b3f10 0x7f2fbc15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59912/0 (socket says 172.21.15.192:59912) 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fb3400640 1 -- 172.21.15.192:0/1443617821 learned_addr learned my addr 172.21.15.192:0/1443617821 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:29.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fc0c00640 1 --2- 172.21.15.192:0/1443617821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 0x7f2fbc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897910904 0 0) 0x7f2fbc0b2f00 con 0x7f2fbc0b3f10 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.163+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa0003520 con 0x7f2fbc0b3f10 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.164+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167840177 0 0) 0x7f2fbc0b3150 con 0x7f2fbc15dee0 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.164+0000 7f2fc0c00640 1 -- 172.21.15.192:0/1443617821 >> v1:172.21.15.194:6789/0 conn(0x7f2fbc15dee0 legacy=0x7f2fbc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.164+0000 7f2fc0c00640 1 -- 172.21.15.192:0/1443617821 >> v1:172.21.15.192:6789/0 conn(0x7f2fbc0b3f10 legacy=0x7f2fbc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.164+0000 7f2fc0c00640 1 -- 172.21.15.192:0/1443617821 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc0b3710 con 0x7f2fbc0b0490 2024-09-13T18:37:29.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc0c00640 1 --2- 172.21.15.192:0/1443617821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 0x7f2fbc15ab50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009dc0 tx=0x7f2fb402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8817cb1283cd81fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:29.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4007740 con 0x7f2fbc0b0490 2024-09-13T18:37:29.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb402d050 con 0x7f2fbc0b0490 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fbb400640 1 -- 172.21.15.192:0/1443617821 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4007aa0 con 0x7f2fbc0b0490 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc2c00640 1 -- 172.21.15.192:0/1443617821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 msgr2=0x7f2fbc15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/1443617821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 0x7f2fbc15ab50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fb4009dc0 tx=0x7f2fb402a6d0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc2c00640 1 -- 172.21.15.192:0/1443617821 shutdown_connections 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/1443617821 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc0b0490 0x7f2fbc15ab50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.165+0000 7f2fc2c00640 1 -- 172.21.15.192:0/1443617821 >> 172.21.15.192:0/1443617821 conn(0x7f2fbc0ae960 msgr2=0x7f2fbc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.166+0000 7f2fc2c00640 1 -- 172.21.15.192:0/1443617821 shutdown_connections 2024-09-13T18:37:29.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.166+0000 7f2fc2c00640 1 -- 172.21.15.192:0/1443617821 wait complete. 2024-09-13T18:37:29.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.167+0000 7f2fc2c00640 1 Processor -- start 2024-09-13T18:37:29.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.167+0000 7f2fc2c00640 1 -- start start 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fbc15dee0 0x7f2fbc141cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc1421f0 0x7f2fbc13bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc1426a0 con 0x7f2fbc0b0490 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc142890 con 0x7f2fbc15dee0 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fc2c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fbc155780 con 0x7f2fbc1421f0 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:29.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:44836/0 (socket says 172.21.15.192:44836) 2024-09-13T18:37:29.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.168+0000 7f2fbbe00640 1 -- 172.21.15.192:0/541136171 learned_addr learned my addr 172.21.15.192:0/541136171 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:29.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fb3400640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fbc15dee0 0x7f2fbc141cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:29.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fc0c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc1421f0 0x7f2fbc13bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:29.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 -- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc1421f0 msgr2=0x7f2fbc13bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc1421f0 0x7f2fbc13bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 -- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fbc15dee0 msgr2=0x7f2fbc141cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fbc15dee0 0x7f2fbc141cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 -- 172.21.15.192:0/541136171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4009a70 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fbbe00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c440 tx=0x7f2fac00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac005480 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fac0035f0 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fac0039a0 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.169+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fbc157580 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.170+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fbc155f90 con 0x7f2fbc0b0490 2024-09-13T18:37:29.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.170+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fbc0afd80 con 0x7f2fbc0b0490 2024-09-13T18:37:29.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.171+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2fac003b00 con 0x7f2fbc0b0490 2024-09-13T18:37:29.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.172+0000 7f2fb8c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 0x7f2f9806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:29.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.172+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f2fac0888d0 con 0x7f2fbc0b0490 2024-09-13T18:37:29.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.172+0000 7f2fb3400640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 0x7f2f9806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:29.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.173+0000 7f2fb3400640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 0x7f2f9806d0f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc140150 tx=0x7f2fa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:29.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.177+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2fac053a10 con 0x7f2fbc0b0490 2024-09-13T18:37:29.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.379+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2fbc06fd40 con 0x7f2fbc0b0490 2024-09-13T18:37:29.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.380+0000 7f2fb8c00640 1 -- 172.21.15.192:0/541136171 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2fac017070 con 0x7f2fbc0b0490 2024-09-13T18:37:29.383 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 msgr2=0x7f2f9806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 0x7f2f9806d0f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc140150 tx=0x7f2fa4009040 comp rx=0 tx=0).stop 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 msgr2=0x7f2fbc159260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2fac00c440 tx=0x7f2fac00c900 comp rx=0 tx=0).stop 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 shutdown_connections 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f9806ac30 0x7f2f9806d0f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2fbc1421f0 0x7f2fbc13bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2fbc15dee0 0x7f2fbc141cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 --2- 172.21.15.192:0/541136171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fbc0b0490 0x7f2fbc159260 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 >> 172.21.15.192:0/541136171 conn(0x7f2fbc0ae960 msgr2=0x7f2fbc15d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 shutdown_connections 2024-09-13T18:37:29.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:29.382+0000 7f2fc2c00640 1 -- 172.21.15.192:0/541136171 wait complete. 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:29.401 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:37:29.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.401 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:37:29.437 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:29.437 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:29.437 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:29.437 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:29.438 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42660sec preferred_lft 42660sec 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:37:29.439 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.440 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:29.440 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:37:29.440 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:37:29.440 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:29.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.440 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:29.531 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:37:29.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.534 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:37:29.570 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:37:29.570 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:29.570 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:29.571 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:29.571 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:29.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:29.571 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:37:29.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.715 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:37:29.750 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:37:29.751 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:37:29.751 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:37:29.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.751 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:37:29.846 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:29.846 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:29.881 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:37:29.881 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:29.881 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:29.956 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:37:29.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:29.956 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:30.083 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:30.083 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:37:30.110 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:30.110 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:37:30.110 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:37:30.110 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:37:30.111 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:37:30.112 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:37:30.112 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:37:30.112 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:37:30.112 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:37:30.112 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:37:30.115 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:37:30.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:30.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.171 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:37:30.218 INFO:teuthology.orchestra.run.smithi192.stdout:client5216 2024-09-13T18:37:30.218 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:30.218 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:30.254 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:37:30.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.443+0000 7f2169000640 1 Processor -- start 2024-09-13T18:37:30.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.444+0000 7f2169000640 1 -- start start 2024-09-13T18:37:30.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2169000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2164159b00 0x7f21640b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2169000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f216406bc30 0x7f21640b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2169000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216415af60 con 0x7f2164159ee0 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2169000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216415aa40 con 0x7f2164159b00 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2169000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216406b7a0 con 0x7f216406bc30 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2163400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2164159b00 0x7f21640b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2163400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2164159b00 0x7f21640b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42138/0 (socket says 172.21.15.192:42138) 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f2163400640 1 -- 172.21.15.192:0/2598672643 learned_addr learned my addr 172.21.15.192:0/2598672643 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.445+0000 7f215aa00640 1 --2- 172.21.15.192:0/2598672643 >> v2:172.21.15.194:3300/0 conn(0x7f216406bc30 0x7f21640b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.446+0000 7f2163400640 1 -- 172.21.15.192:0/2598672643 >> v2:172.21.15.194:3300/0 conn(0x7f216406bc30 msgr2=0x7f21640b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.446+0000 7f2163400640 1 --2- 172.21.15.192:0/2598672643 >> v2:172.21.15.194:3300/0 conn(0x7f216406bc30 0x7f21640b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.446+0000 7f2163400640 1 -- 172.21.15.192:0/2598672643 >> v1:172.21.15.194:6789/0 conn(0x7f2164159ee0 legacy=0x7f216415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:30.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.446+0000 7f2163400640 1 -- 172.21.15.192:0/2598672643 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216415ac80 con 0x7f2164159b00 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2163400640 1 --2- 172.21.15.192:0/2598672643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640b2d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f216406c830 tx=0x7f215402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daeb27381d0eb0e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2162a00640 1 -- 172.21.15.192:0/2598672643 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154032440 con 0x7f2164159b00 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2162a00640 1 -- 172.21.15.192:0/2598672643 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21540325a0 con 0x7f2164159b00 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2162a00640 1 -- 172.21.15.192:0/2598672643 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154032930 con 0x7f2164159b00 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2169000640 1 -- 172.21.15.192:0/2598672643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 msgr2=0x7f21640b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.447+0000 7f2169000640 1 --2- 172.21.15.192:0/2598672643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640b2d70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f216406c830 tx=0x7f215402a230 comp rx=0 tx=0).stop 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 -- 172.21.15.192:0/2598672643 shutdown_connections 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 --2- 172.21.15.192:0/2598672643 >> v2:172.21.15.194:3300/0 conn(0x7f216406bc30 0x7f21640b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 --2- 172.21.15.192:0/2598672643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640b2d70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 -- 172.21.15.192:0/2598672643 >> 172.21.15.192:0/2598672643 conn(0x7f21640736d0 msgr2=0x7f21640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 -- 172.21.15.192:0/2598672643 shutdown_connections 2024-09-13T18:37:30.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.448+0000 7f2169000640 1 -- 172.21.15.192:0/2598672643 wait complete. 2024-09-13T18:37:30.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.449+0000 7f2169000640 1 Processor -- start 2024-09-13T18:37:30.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.449+0000 7f2169000640 1 -- start start 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216406bc30 0x7f216414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2164159ee0 0x7f21640add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640afa00 con 0x7f2164159b00 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21640afce0 con 0x7f216406bc30 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f2169000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21640affc0 con 0x7f2164159ee0 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.450+0000 7f215aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42144/0 (socket says 172.21.15.192:42144) 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 -- 172.21.15.192:0/2538804389 learned_addr learned my addr 172.21.15.192:0/2538804389 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:30.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f2163400640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216406bc30 0x7f216414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f2163e00640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2164159ee0 0x7f21640add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 -- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2164159ee0 msgr2=0x7f21640add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2164159ee0 0x7f21640add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 -- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216406bc30 msgr2=0x7f216414b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216406bc30 0x7f216414b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 -- 172.21.15.192:0/2538804389 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21540094d0 con 0x7f2164159b00 2024-09-13T18:37:30.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215aa00640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d800 tx=0x7f214c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.451+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00b6c0 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.452+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c00b820 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.452+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21640b02a0 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.452+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c00bbb0 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.452+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21640aed60 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.453+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216415a330 con 0x7f2164159b00 2024-09-13T18:37:30.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.454+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f214c00bd10 con 0x7f2164159b00 2024-09-13T18:37:30.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.455+0000 7f215be00640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 0x7f214006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:30.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.455+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f214c0898c0 con 0x7f2164159b00 2024-09-13T18:37:30.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.455+0000 7f2163400640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 0x7f214006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:30.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.456+0000 7f2163400640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 0x7f214006d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2154034000 tx=0x7f215402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:30.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.459+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f214c054a20 con 0x7f2164159b00 2024-09-13T18:37:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.666+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21640ccac0 con 0x7f2164159b00 2024-09-13T18:37:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.666+0000 7f215be00640 1 -- 172.21.15.192:0/2538804389 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) v1 ==== 53+0+73 (secure 0 0 0) 0x7f214c058040 con 0x7f2164159b00 2024-09-13T18:37:30.669 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.668+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 msgr2=0x7f214006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.668+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 0x7f214006d0c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2154034000 tx=0x7f215402e000 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.668+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 msgr2=0x7f21640ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.668+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f214c00d800 tx=0x7f214c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 shutdown_connections 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214006ac00 0x7f214006d0c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2164159ee0 0x7f21640add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2164159b00 0x7f21640ad840 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 --2- 172.21.15.192:0/2538804389 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216406bc30 0x7f216414b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 >> 172.21.15.192:0/2538804389 conn(0x7f21640736d0 msgr2=0x7f21640cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 shutdown_connections 2024-09-13T18:37:30.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:30.669+0000 7f2169000640 1 -- 172.21.15.192:0/2538804389 wait complete. 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:37:30.687 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:37:30.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.688 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:37:30.728 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:37:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:37:30.728 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:30.729 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42664sec preferred_lft 42664sec 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.730 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:37:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:37:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:37:30.731 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:37:30.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.731 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:37:30.825 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:37:30.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.829 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:37:30.866 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:37:30.866 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:37:30.866 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:37:30.866 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:37:30.866 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:37:30.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:37:30.867 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:37:31.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.015 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:37:31.050 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:37:31.050 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:37:31.051 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:37:31.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.051 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:37:31.145 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:31.145 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:31.180 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:37:31.181 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:37:31.181 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:31.255 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:37:31.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.255 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:31.383 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:31.383 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:37:31.409 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:37:31.410 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:37:31.410 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:37:31.410 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:37:31.410 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:37:31.412 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:37:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:37:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:37:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:37:31.412 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:37:31.415 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:37:31.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.415 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:37:31.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:31.471 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:37:31.509 INFO:teuthology.orchestra.run.smithi194.stdout:client5602 2024-09-13T18:37:31.509 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:31.509 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:31.584 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:31.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.735+0000 7fd0b3c00640 1 Processor -- start 2024-09-13T18:37:31.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.735+0000 7fd0b3c00640 1 -- start start 2024-09-13T18:37:31.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0ac0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b3c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0adf50 con 0x7fd0ac146610 2024-09-13T18:37:31.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b3c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0ac0ae770 con 0x7fd0ac0b2780 2024-09-13T18:37:31.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0cd920 con 0x7fd0ac0afd80 2024-09-13T18:37:31.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b1200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd0ac146610 0x7fd0ac0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59476/0 (socket says 172.21.15.192:59476) 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b1200640 1 -- 172.21.15.192:0/1893031403 learned_addr learned my addr 172.21.15.192:0/1893031403 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0ac0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932973802 0 0) 0x7fd0ac0adf50 con 0x7fd0ac146610 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.737+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd090003520 con 0x7fd0ac146610 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1255124782 0 0) 0x7fd090003520 con 0x7fd0ac146610 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 msgr2=0x7fd0ac0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0ac0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 >> v1:172.21.15.194:6789/0 conn(0x7fd0ac0b2780 legacy=0x7fd0ac0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac0cdb30 con 0x7fd0ac146610 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fd09c001670 con 0x7fd0ac146610 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 >> v1:172.21.15.192:6789/0 conn(0x7fd0ac146610 legacy=0x7fd0ac0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0900039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd090003ee0 0x7fd0900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd090005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac0cd920 con 0x7fd090004d00 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09000b9e0 con 0x7fd090003ee0 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09000bba0 con 0x7fd0ac0afd80 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd090005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0a3e00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd090003ee0 0x7fd0900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1200640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0900039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 -- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 msgr2=0x7fd0900039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac0afd80 0x7fd0900039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 -- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd090003ee0 msgr2=0x7fd0900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd090003ee0 0x7fd0900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.738+0000 7fd0b1c00640 1 -- 172.21.15.192:0/1893031403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd090003520 con 0x7fd090004d00 2024-09-13T18:37:31.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.739+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd090005180 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009fc0 tx=0x7fd0900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8edd3d7a853df5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a4031640 con 0x7fd090004d00 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0a402d070 con 0x7fd090004d00 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0abe00640 1 -- 172.21.15.192:0/1893031403 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a40319e0 con 0x7fd090004d00 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 -- 172.21.15.192:0/1893031403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 msgr2=0x7fd090005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/1893031403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd090005180 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fd0a4009fc0 tx=0x7fd0900057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b1c00640 1 -- 172.21.15.192:0/1893031403 reap_dead start 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 -- 172.21.15.192:0/1893031403 shutdown_connections 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 -- 172.21.15.192:0/1893031403 >> 172.21.15.192:0/1893031403 conn(0x7fd0ac0ae960 msgr2=0x7fd0ac06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 -- 172.21.15.192:0/1893031403 shutdown_connections 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.740+0000 7fd0b3c00640 1 -- 172.21.15.192:0/1893031403 wait complete. 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.742+0000 7fd0b3c00640 1 Processor -- start 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.742+0000 7fd0b3c00640 1 -- start start 2024-09-13T18:37:31.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac141ee0 0x7fd0ac13da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 0x7fd0ac06b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac070370 con 0x7fd090004d00 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac06b8b0 con 0x7fd0ac06aef0 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b3c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac13fd30 con 0x7fd0ac141ee0 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42164/0 (socket says 172.21.15.192:42164) 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 -- 172.21.15.192:0/4079990307 learned_addr learned my addr 172.21.15.192:0/4079990307 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0a3e00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac141ee0 0x7fd0ac13da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 0x7fd0ac06b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 -- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac141ee0 msgr2=0x7fd0ac13da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac141ee0 0x7fd0ac13da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.743+0000 7fd0b1200640 1 -- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 msgr2=0x7fd0ac06b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b1200640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 0x7fd0ac06b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b1200640 1 -- 172.21.15.192:0/4079990307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ac13dfa0 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b1c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 0x7fd0ac06b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b1200640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0072c0 tx=0x7fd09c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00f8e0 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c00fa60 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00fe10 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac13ff80 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.744+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac140540 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.745+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac0b01f0 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.746+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd09c01d460 con 0x7fd090004d00 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.747+0000 7fd0a9600640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:31.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.747+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd09c0895a0 con 0x7fd090004d00 2024-09-13T18:37:31.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.747+0000 7fd0a3e00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:31.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.748+0000 7fd0a3e00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac157670 tx=0x7fd094009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:31.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.751+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd09c0545c0 con 0x7fd090004d00 2024-09-13T18:37:31.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.951+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0ac066a20 con 0x7fd090004d00 2024-09-13T18:37:31.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.953+0000 7fd0a9600640 1 -- 172.21.15.192:0/4079990307 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fd09c057be0 con 0x7fd090004d00 2024-09-13T18:37:31.956 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:31.956 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:37:31.956 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 msgr2=0x7fd08806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 0x7fd08806d0c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac157670 tx=0x7fd094009040 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 msgr2=0x7fd0ac13e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0072c0 tx=0x7fd09c007780 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 shutdown_connections 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd08806ac00 0x7fd08806d0c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd0ac06aef0 0x7fd0ac06b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd0ac141ee0 0x7fd0ac13da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 --2- 172.21.15.192:0/4079990307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd090004d00 0x7fd0ac13e6d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:31.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 >> 172.21.15.192:0/4079990307 conn(0x7fd0ac0ae960 msgr2=0x7fd0ac161100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:31.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 shutdown_connections 2024-09-13T18:37:31.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:31.955+0000 7fd0b3c00640 1 -- 172.21.15.192:0/4079990307 wait complete. 2024-09-13T18:37:31.974 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:37:32.144 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":5461,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.1693300660000006,"mdsmap_epoch":24,"osdmap_epoch":51,"osdmap_epoch_barrier":49,"uptime":14.116471276} 2024-09-13T18:37:32.144 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 5461, "mdsmap_epoch": 24, "osdmap_epoch": 51, "osdmap_epoch_barrier": 49, "rank_uptime": 9.169330066, "state": "up:active", "uptime": 14.116471276, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:37:32.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:37:32.311 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:37:32.311 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:37:32.311 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-13T18:37:32.312 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:32.312 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:32.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:32.347 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-13T18:37:34.190 INFO:teuthology.orchestra.run.smithi192.stderr:265+0 records in 2024-09-13T18:37:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:265+0 records out 2024-09-13T18:37:34.191 INFO:teuthology.orchestra.run.smithi192.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.76452 s, 157 MB/s 2024-09-13T18:37:34.193 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:34.193 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:34.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:34.229 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi192.stderr:292+0 records in 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi192.stderr:292+0 records out 2024-09-13T18:37:36.312 INFO:teuthology.orchestra.run.smithi192.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.00597 s, 153 MB/s 2024-09-13T18:37:36.313 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-13T18:37:36.313 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:36.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.462+0000 7ff914000640 1 Processor -- start 2024-09-13T18:37:36.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.462+0000 7ff914000640 1 -- start start 2024-09-13T18:37:36.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.463+0000 7ff914000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff90c0cacd0 0x7ff90c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.463+0000 7ff914000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff90c0cb0b0 0x7ff90c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff914000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff90c140480 con 0x7ff90c140980 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff914000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c15c160 con 0x7ff90c0cacd0 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff914000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff90c0cb520 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff90c0cacd0 0x7ff90c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff90c0cacd0 0x7ff90c15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42170/0 (socket says 172.21.15.192:42170) 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 -- 172.21.15.192:0/3207584828 learned_addr learned my addr 172.21.15.192:0/3207584828 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:36.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff910c00640 1 --2- 172.21.15.192:0/3207584828 >> v2:172.21.15.194:3300/0 conn(0x7ff90c0cb0b0 0x7ff90c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 -- 172.21.15.192:0/3207584828 >> v2:172.21.15.194:3300/0 conn(0x7ff90c0cb0b0 msgr2=0x7ff90c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:36.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 --2- 172.21.15.192:0/3207584828 >> v2:172.21.15.194:3300/0 conn(0x7ff90c0cb0b0 0x7ff90c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 -- 172.21.15.192:0/3207584828 >> v1:172.21.15.194:6789/0 conn(0x7ff90c140980 legacy=0x7ff90c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.464+0000 7ff911600640 1 -- 172.21.15.192:0/3207584828 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff90c15ee90 con 0x7ff90c0cacd0 2024-09-13T18:37:36.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.465+0000 7ff911600640 1 --2- 172.21.15.192:0/3207584828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cacd0 0x7ff90c15e790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0ce9e0 tx=0x7ff90002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0bbf215e33850e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff90be00640 1 -- 172.21.15.192:0/3207584828 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900032440 con 0x7ff90c0cacd0 2024-09-13T18:37:36.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff90be00640 1 -- 172.21.15.192:0/3207584828 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9000325a0 con 0x7ff90c0cacd0 2024-09-13T18:37:36.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff90be00640 1 -- 172.21.15.192:0/3207584828 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff900032930 con 0x7ff90c0cacd0 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff914000640 1 -- 172.21.15.192:0/3207584828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cacd0 msgr2=0x7ff90c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff914000640 1 --2- 172.21.15.192:0/3207584828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cacd0 0x7ff90c15e790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff90c0ce9e0 tx=0x7ff90002a270 comp rx=0 tx=0).stop 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff914000640 1 -- 172.21.15.192:0/3207584828 shutdown_connections 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.466+0000 7ff914000640 1 --2- 172.21.15.192:0/3207584828 >> v2:172.21.15.194:3300/0 conn(0x7ff90c0cb0b0 0x7ff90c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.467+0000 7ff914000640 1 --2- 172.21.15.192:0/3207584828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cacd0 0x7ff90c15e790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.467+0000 7ff914000640 1 -- 172.21.15.192:0/3207584828 >> 172.21.15.192:0/3207584828 conn(0x7ff90c0ae960 msgr2=0x7ff90c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.467+0000 7ff914000640 1 -- 172.21.15.192:0/3207584828 shutdown_connections 2024-09-13T18:37:36.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.467+0000 7ff914000640 1 -- 172.21.15.192:0/3207584828 wait complete. 2024-09-13T18:37:36.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.468+0000 7ff914000640 1 Processor -- start 2024-09-13T18:37:36.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.468+0000 7ff914000640 1 -- start start 2024-09-13T18:37:36.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90c0cacd0 0x7ff90c157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90c140980 0x7ff90c15a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c06ab90 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c06ae70 con 0x7ff90c140980 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff914000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff90c06b150 con 0x7ff90c0cacd0 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff910c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff910c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:42174/0 (socket says 172.21.15.192:42174) 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.469+0000 7ff910c00640 1 -- 172.21.15.192:0/539180759 learned_addr learned my addr 172.21.15.192:0/539180759 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff912000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90c140980 0x7ff90c15a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff911600640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90c0cacd0 0x7ff90c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 -- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90c0cacd0 msgr2=0x7ff90c157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90c0cacd0 0x7ff90c157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 -- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90c140980 msgr2=0x7ff90c15a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90c140980 0x7ff90c15a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 -- 172.21.15.192:0/539180759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9000094d0 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff910c00640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e9b0 tx=0x7ff8f800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8009670 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f800c9a0 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f800cd50 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.470+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c06b430 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.471+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff90c06bc30 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.472+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90c15bc20 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.472+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff8f8013470 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.473+0000 7ff909600640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 0x7ff8ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:36.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.473+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5854+0+0 (secure 0 0 0) 0x7ff8f8089660 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.473+0000 7ff911600640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 0x7ff8ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:36.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.474+0000 7ff911600640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 0x7ff8ec06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff900034000 tx=0x7ff90002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:36.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.478+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff8f80547c0 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.646+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff90c06c6c0 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.647+0000 7ff909600640 1 -- 172.21.15.192:0/539180759 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v51) v1 ==== 81+0+34926 (secure 0 0 0) 0x7ff8f8057de0 con 0x7ff90c0cb0b0 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 51, 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:27.990305+0000", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:36.651 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:36.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:36.653 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:36.654 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.655 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "17", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:36.656 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:36.657 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:36.658 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:36.659 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:36.660 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:36.661 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:36.662 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "48", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:36.663 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:36.664 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:36.665 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.666 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:36.667 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:36.668 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.669 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "49", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:36.670 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:36.671 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:36.672 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:36.673 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.674 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.680 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.681 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.682 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.683 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.684 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.686 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.687 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.688 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.689 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.690 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.691 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.692 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.693 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.694 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.695 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.696 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.697 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:36.698 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:36.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.700 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.701 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.702 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:36.703 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.704 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.705 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.706 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:36.707 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.708 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:36.709 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.710 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:36.711 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.712 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.713 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.714 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:36.715 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.716 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:36.717 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.718 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.719 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.720 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.721 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:36.722 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.723 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.724 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.725 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.725 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:36.725 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.726 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.727 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.727 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.728 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:36.729 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.730 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.732 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:36.733 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:36.734 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.735 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.736 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.737 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:36.738 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:36.739 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:36.740 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:36.741 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:36.742 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:36.743 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:36.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:36.745 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:36.746 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:36.747 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 msgr2=0x7ff8ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 0x7ff8ec06d0c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff900034000 tx=0x7ff90002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 msgr2=0x7ff90c159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800e9b0 tx=0x7ff8f800ee70 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 shutdown_connections 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff8ec06ac00 0x7ff8ec06d0c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff90c140980 0x7ff90c15a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff90c0cb0b0 0x7ff90c159d80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 --2- 172.21.15.192:0/539180759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff90c0cacd0 0x7ff90c157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 >> 172.21.15.192:0/539180759 conn(0x7ff90c0ae960 msgr2=0x7ff90c15cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:36.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 shutdown_connections 2024-09-13T18:37:36.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:36.650+0000 7ff914000640 1 -- 172.21.15.192:0/539180759 wait complete. 2024-09-13T18:37:36.750 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:37:36.795 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:37:38.026 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:37:38.023+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-13T18:37:41.751 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:41.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.911+0000 7f0114400640 1 Processor -- start 2024-09-13T18:37:41.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.911+0000 7f0114400640 1 -- start start 2024-09-13T18:37:41.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.912+0000 7f0114400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c071810 0x7f010c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.912+0000 7f0114400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f010c0b2230 0x7f010c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.912+0000 7f0114400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010c071dd0 con 0x7f010c150480 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.912+0000 7f0114400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010c0cb770 con 0x7f010c0b2230 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.912+0000 7f0114400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c0cba50 con 0x7f010c071810 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f010c0b2230 0x7f010c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f010c0b2230 0x7f010c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58418/0 (socket says 172.21.15.192:58418) 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 -- 172.21.15.192:0/3579500049 learned_addr learned my addr 172.21.15.192:0/3579500049 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:41.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0111000640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c071810 0x7f010c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 -- 172.21.15.192:0/3579500049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c071810 msgr2=0x7f010c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c071810 0x7f010c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 -- 172.21.15.192:0/3579500049 >> v1:172.21.15.194:6789/0 conn(0x7f010c150480 legacy=0x7f010c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.913+0000 7f0112400640 1 -- 172.21.15.192:0/3579500049 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c0cbd30 con 0x7f010c0b2230 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.914+0000 7f0112400640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c0b2230 0x7f010c0cc530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f010400d150 tx=0x7f010402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f9191367d63f3e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.914+0000 7f010be00640 1 -- 172.21.15.192:0/3579500049 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104009600 con 0x7f010c0b2230 2024-09-13T18:37:41.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f010be00640 1 -- 172.21.15.192:0/3579500049 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0104009760 con 0x7f010c0b2230 2024-09-13T18:37:41.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f010be00640 1 -- 172.21.15.192:0/3579500049 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104009af0 con 0x7f010c0b2230 2024-09-13T18:37:41.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 -- 172.21.15.192:0/3579500049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c0b2230 msgr2=0x7f010c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c0b2230 0x7f010c0cc530 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f010400d150 tx=0x7f010402c890 comp rx=0 tx=0).stop 2024-09-13T18:37:41.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 -- 172.21.15.192:0/3579500049 shutdown_connections 2024-09-13T18:37:41.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c0b2230 0x7f010c0cc530 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 --2- 172.21.15.192:0/3579500049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c071810 0x7f010c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 -- 172.21.15.192:0/3579500049 >> 172.21.15.192:0/3579500049 conn(0x7f010c0ae960 msgr2=0x7f010c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 -- 172.21.15.192:0/3579500049 shutdown_connections 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.915+0000 7f0114400640 1 -- 172.21.15.192:0/3579500049 wait complete. 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.917+0000 7f0114400640 1 Processor -- start 2024-09-13T18:37:41.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.917+0000 7f0114400640 1 -- start start 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 0x7f010c070140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 0x7f010c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c151940 con 0x7f010c071810 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f010c151c20 con 0x7f010c150480 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0114400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010c151f00 con 0x7f010c0b2230 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58424/0 (socket says 172.21.15.192:58424) 2024-09-13T18:37:41.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 -- 172.21.15.192:0/1191780965 learned_addr learned my addr 172.21.15.192:0/1191780965 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111000640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 0x7f010c070140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0112400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 0x7f010c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 -- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 msgr2=0x7f010c070140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 0x7f010c070140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 -- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 msgr2=0x7f010c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 0x7f010c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111a00640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010400bd40 con 0x7f010c071810 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0112400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 0x7f010c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.918+0000 7f0111000640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 0x7f010c070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:41.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0111a00640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f010000c400 tx=0x7f010000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01000052d0 con 0x7f010c071810 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0100005430 con 0x7f010c071810 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010c1521e0 con 0x7f010c071810 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0100003830 con 0x7f010c071810 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.919+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f010c151460 con 0x7f010c071810 2024-09-13T18:37:41.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.920+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010c0b1cf0 con 0x7f010c071810 2024-09-13T18:37:41.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.921+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0100003990 con 0x7f010c071810 2024-09-13T18:37:41.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.922+0000 7f0109600640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 0x7f00ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:41.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.922+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f0100088a10 con 0x7f010c071810 2024-09-13T18:37:41.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.922+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f00ec072910 con 0x7f010c071810 2024-09-13T18:37:41.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.922+0000 7f0111000640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 0x7f00ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:41.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.923+0000 7f0111000640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 0x7f00ec06d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f010c15c330 tx=0x7f00f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:41.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:41.926+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0100017060 con 0x7f010c071810 2024-09-13T18:37:42.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.098+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f010c151680 con 0x7f010c071810 2024-09-13T18:37:42.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.100+0000 7f0109600640 1 -- 172.21.15.192:0/1191780965 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+35133 (secure 0 0 0) 0x7f0100053ac0 con 0x7f010c071810 2024-09-13T18:37:42.103 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 54, 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:41.030230+0000", 2024-09-13T18:37:42.104 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:42.105 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:42.106 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.107 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:42.108 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.110 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.111 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.112 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.113 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.114 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.115 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.117 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.118 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.119 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:42.120 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.121 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:42.122 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.123 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.124 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.125 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.126 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.127 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.128 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.129 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.129 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.129 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.129 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.129 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.130 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:42.131 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.132 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.133 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.134 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.134 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.134 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.134 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.135 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.136 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.137 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.137 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.137 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.137 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.137 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.140 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.141 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.142 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:42.143 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.144 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.145 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.146 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.147 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.148 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.149 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.150 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.151 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.152 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.153 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.154 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.155 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.156 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:42.157 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.158 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.159 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.160 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.161 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.162 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.163 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.164 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.164 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.164 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.164 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.165 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.166 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:42.167 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.168 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.169 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:42.170 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.171 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.172 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:42.173 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.174 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.175 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.176 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.177 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:42.178 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.179 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.180 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.181 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.182 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.182 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:42.182 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.182 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.183 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.184 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.186 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:42.187 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.188 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:42.189 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:42.189 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.189 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.189 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.190 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.191 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.192 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:42.194 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.197 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.198 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.200 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.202 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.203 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:42.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.205 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.209 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.210 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:42.211 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.212 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:42.213 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:42.214 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.215 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:42.217 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.218 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.220 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:42.221 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:42.222 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:42.223 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:42.223 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:42.223 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:42.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.223 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 msgr2=0x7f00ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 0x7f00ec06d0c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f010c15c330 tx=0x7f00f8008040 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 msgr2=0x7f010c156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f010000c400 tx=0x7f010000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 shutdown_connections 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f00ec06ac00 0x7f00ec06d0c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f010c150480 0x7f010c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f010c0b2230 0x7f010c070140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 --2- 172.21.15.192:0/1191780965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f010c071810 0x7f010c156b60 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 >> 172.21.15.192:0/1191780965 conn(0x7f010c0ae960 msgr2=0x7f010c0aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 shutdown_connections 2024-09-13T18:37:42.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.102+0000 7f0114400640 1 -- 172.21.15.192:0/1191780965 wait complete. 2024-09-13T18:37:42.226 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-13T18:37:42.226 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:42.226 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:42.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:42.262 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-13T18:37:42.622 INFO:teuthology.orchestra.run.smithi192.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-13T18:37:42.622 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:37:42.622 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:37:42.622 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.272543 s, 192 MB/s 2024-09-13T18:37:42.623 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:37:42.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:42.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.773+0000 7fec12e00640 1 Processor -- start 2024-09-13T18:37:42.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.773+0000 7fec12e00640 1 -- start start 2024-09-13T18:37:42.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec12e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec12e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fec0c0b3f10 0x7fec0c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec12e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0c0b2f00 con 0x7fec0c15e2c0 2024-09-13T18:37:42.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec12e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0c0b3150 con 0x7fec0c0b3f10 2024-09-13T18:37:42.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec12e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c0b3430 con 0x7fec0c15dee0 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec10e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fec0c15e2c0 0x7fec0c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42792/0 (socket says 172.21.15.192:42792) 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec10e00640 1 -- 172.21.15.192:0/675665046 learned_addr learned my addr 172.21.15.192:0/675665046 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec03400640 1 --2- 172.21.15.192:0/675665046 >> v2:172.21.15.194:3300/0 conn(0x7fec0c0b3f10 0x7fec0c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec0be00640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.775+0000 7fec0b400640 1 -- 172.21.15.192:0/675665046 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260344330 0 0) 0x7fec0c0b2f00 con 0x7fec0c15e2c0 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.776+0000 7fec0b400640 1 -- 172.21.15.192:0/675665046 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febf0003520 con 0x7fec0c15e2c0 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.776+0000 7fec03400640 1 -- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 msgr2=0x7fec0c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.776+0000 7fec03400640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.776+0000 7fec03400640 1 -- 172.21.15.192:0/675665046 >> v1:172.21.15.192:6789/0 conn(0x7fec0c15e2c0 legacy=0x7fec0c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.776+0000 7fec03400640 1 -- 172.21.15.192:0/675665046 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c0b3710 con 0x7fec0c0b3f10 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.777+0000 7fec03400640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c0b3f10 0x7fec0c0b02c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7febf40097d0 tx=0x7febf402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0dedb870add9f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.777+0000 7fec0b400640 1 -- 172.21.15.192:0/675665046 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4032440 con 0x7fec0c0b3f10 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.777+0000 7fec0b400640 1 -- 172.21.15.192:0/675665046 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40325a0 con 0x7fec0c0b3f10 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.777+0000 7fec0b400640 1 -- 172.21.15.192:0/675665046 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf4032910 con 0x7fec0c0b3f10 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 -- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c0b3f10 msgr2=0x7fec0c0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c0b3f10 0x7fec0c0b02c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7febf40097d0 tx=0x7febf402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 -- 172.21.15.192:0/675665046 shutdown_connections 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c0b3f10 0x7fec0c0b02c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 --2- 172.21.15.192:0/675665046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 -- 172.21.15.192:0/675665046 >> 172.21.15.192:0/675665046 conn(0x7fec0c0ae960 msgr2=0x7fec0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:42.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 -- 172.21.15.192:0/675665046 shutdown_connections 2024-09-13T18:37:42.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.778+0000 7fec12e00640 1 -- 172.21.15.192:0/675665046 wait complete. 2024-09-13T18:37:42.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.779+0000 7fec12e00640 1 Processor -- start 2024-09-13T18:37:42.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.779+0000 7fec12e00640 1 -- start start 2024-09-13T18:37:42.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c15e2c0 0x7fec0c15bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13d100 con 0x7fec0c134a60 2024-09-13T18:37:42.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13d3e0 con 0x7fec0c15e2c0 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.780+0000 7fec12e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0c13edc0 con 0x7fec0c15dee0 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58432/0 (socket says 172.21.15.192:58432) 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 -- 172.21.15.192:0/478241878 learned_addr learned my addr 172.21.15.192:0/478241878 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec03400640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c15e2c0 0x7fec0c15bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec0be00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 -- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 msgr2=0x7fec0c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 -- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c15e2c0 msgr2=0x7fec0c15bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c15e2c0 0x7fec0c15bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf4009400 con 0x7fec0c134a60 2024-09-13T18:37:42.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec10e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fec0400caa0 tx=0x7fec0400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.781+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400ac00 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.782+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400ad60 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.782+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0c13f0a0 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.782+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec04012620 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.782+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0c13d6c0 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.783+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0c067490 con 0x7fec0c134a60 2024-09-13T18:37:42.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.784+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fec04007070 con 0x7fec0c134a60 2024-09-13T18:37:42.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.784+0000 7fec08c00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 0x7febe806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:42.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.785+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fec04089400 con 0x7fec0c134a60 2024-09-13T18:37:42.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.785+0000 7fec0be00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 0x7febe806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:42.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.785+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7febe8072940 con 0x7fec0c134a60 2024-09-13T18:37:42.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.786+0000 7fec0be00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 0x7febe806d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7febfc009ad0 tx=0x7febfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:42.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.789+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fec040544b0 con 0x7fec0c134a60 2024-09-13T18:37:42.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.958+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fec0c13ec20 con 0x7fec0c134a60 2024-09-13T18:37:42.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.959+0000 7fec08c00640 1 -- 172.21.15.192:0/478241878 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v54) v1 ==== 81+0+35133 (secure 0 0 0) 0x7fec0c13ec20 con 0x7fec0c134a60 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 54, 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:41.030230+0000", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:42.963 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:42.964 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.965 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.966 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.967 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.968 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.969 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.970 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:42.971 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.972 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:42.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.974 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.975 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.976 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.977 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.978 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:42.979 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:42.980 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:42.981 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:42.982 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:42.983 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:42.984 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:42.985 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.986 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.987 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.988 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.990 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.991 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:42.992 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.993 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.994 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:42.996 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.997 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:42.998 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:42.999 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.000 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.001 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:43.002 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.003 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.004 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:43.005 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.006 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:43.007 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:43.008 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.009 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.010 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:43.011 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.012 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.013 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:43.014 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.015 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:43.016 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.017 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:43.018 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.019 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.020 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.021 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.022 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:43.023 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.024 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.025 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.027 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:43.028 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:43.029 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.030 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:43.034 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.035 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.036 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.037 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.038 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.039 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:43.040 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:43.041 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:43.042 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.043 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:43.044 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:43.045 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:43.046 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:43.047 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.961+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 msgr2=0x7febe806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.961+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 0x7febe806d0f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7febfc009ad0 tx=0x7febfc008040 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.961+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 msgr2=0x7fec0c132030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.961+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fec0400caa0 tx=0x7fec0400cf60 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 shutdown_connections 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7febe806ac30 0x7febe806d0f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec0c134a60 0x7fec0c132030 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fec0c15e2c0 0x7fec0c15bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 --2- 172.21.15.192:0/478241878 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fec0c15dee0 0x7fec0c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 >> 172.21.15.192:0/478241878 conn(0x7fec0c0ae960 msgr2=0x7fec0c06bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:43.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 shutdown_connections 2024-09-13T18:37:43.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:42.962+0000 7fec12e00640 1 -- 172.21.15.192:0/478241878 wait complete. 2024-09-13T18:37:43.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.199+0000 7f4dc4800640 1 Processor -- start 2024-09-13T18:37:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.199+0000 7f4dc4800640 1 -- start start 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc4800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc0cacd0 0x7f4dbc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc4800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dbc15bc20 0x7f4dbc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc4800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dbc140480 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc4800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dbc15ee90 con 0x7f4dbc15bc20 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc4800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc15f170 con 0x7f4dbc0cacd0 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dbc15bc20 0x7f4dbc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4dbc15bc20 0x7f4dbc0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58434/0 (socket says 172.21.15.192:58434) 2024-09-13T18:37:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 -- 172.21.15.192:0/3192829140 learned_addr learned my addr 172.21.15.192:0/3192829140 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc1e00640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc0cacd0 0x7f4dbc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 -- 172.21.15.192:0/3192829140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc0cacd0 msgr2=0x7f4dbc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc0cacd0 0x7f4dbc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 -- 172.21.15.192:0/3192829140 >> v1:172.21.15.194:6789/0 conn(0x7f4dbc0cb0b0 legacy=0x7f4dbc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.201+0000 7f4dc2800640 1 -- 172.21.15.192:0/3192829140 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc15f450 con 0x7f4dbc15bc20 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.202+0000 7f4dc2800640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc15bc20 0x7f4dbc0afd80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e50 tx=0x7f4db802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1ccd7cdb7e248a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc0a00640 1 -- 172.21.15.192:0/3192829140 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8031600 con 0x7f4dbc15bc20 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc0a00640 1 -- 172.21.15.192:0/3192829140 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db802d050 con 0x7f4dbc15bc20 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc0a00640 1 -- 172.21.15.192:0/3192829140 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db8031980 con 0x7f4dbc15bc20 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 -- 172.21.15.192:0/3192829140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc15bc20 msgr2=0x7f4dbc0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc15bc20 0x7f4dbc0afd80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4db8009e50 tx=0x7f4db802a710 comp rx=0 tx=0).stop 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 -- 172.21.15.192:0/3192829140 shutdown_connections 2024-09-13T18:37:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc15bc20 0x7f4dbc0afd80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3192829140 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc0cacd0 0x7f4dbc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 -- 172.21.15.192:0/3192829140 >> 172.21.15.192:0/3192829140 conn(0x7f4dbc0ae960 msgr2=0x7f4dbc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 -- 172.21.15.192:0/3192829140 shutdown_connections 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.203+0000 7f4dc4800640 1 -- 172.21.15.192:0/3192829140 wait complete. 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.205+0000 7f4dc4800640 1 Processor -- start 2024-09-13T18:37:43.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.205+0000 7f4dc4800640 1 -- start start 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dbc0cacd0 0x7f4dbc06a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc15bc20 0x7f4dbc06bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc06aa40 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc0ae730 con 0x7f4dbc0cacd0 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc4800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dbc06ace0 con 0x7f4dbc15bc20 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58450/0 (socket says 172.21.15.192:58450) 2024-09-13T18:37:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.206+0000 7f4dc1400640 1 -- 172.21.15.192:0/3718866814 learned_addr learned my addr 172.21.15.192:0/3718866814 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:43.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 -- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc15bc20 msgr2=0x7f4dbc06bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc15bc20 0x7f4dbc06bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 -- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dbc0cacd0 msgr2=0x7f4dbc06a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dbc0cacd0 0x7f4dbc06a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8009b30 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc1400640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c400 tx=0x7f4dac00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac0052d0 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac005430 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac003830 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dbc06afc0 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.207+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dbc06b580 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.208+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dbc15e790 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.209+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4dac003990 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.210+0000 7f4db6000640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 0x7f4da006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:43.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.210+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4dac088a80 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.210+0000 7f4dc1e00640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 0x7f4da006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:43.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.210+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=55}) v3 -- 0x7f4da0072910 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.211+0000 7f4dc1e00640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 0x7f4da006d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4db0006fd0 tx=0x7f4db0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:43.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.214+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4dac017020 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.420+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4dbc140d00 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.421+0000 7f4db6000640 1 -- 172.21.15.192:0/3718866814 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f4dac053aa0 con 0x7f4dbc0cb0b0 2024-09-13T18:37:43.423 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:37:43.424 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 msgr2=0x7f4da006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 0x7f4da006d0c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4db0006fd0 tx=0x7f4db0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 msgr2=0x7f4dbc0ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4dac00c400 tx=0x7f4dac00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 shutdown_connections 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4da006ac00 0x7f4da006d0c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4dbc15bc20 0x7f4dbc06bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4dbc0cb0b0 0x7f4dbc0ae1f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 --2- 172.21.15.192:0/3718866814 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4dbc0cacd0 0x7f4dbc06a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 >> 172.21.15.192:0/3718866814 conn(0x7f4dbc0ae960 msgr2=0x7f4dbc15d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:43.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 shutdown_connections 2024-09-13T18:37:43.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:43.423+0000 7f4dc4800640 1 -- 172.21.15.192:0/3718866814 wait complete. 2024-09-13T18:37:43.441 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:37:43.620 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":5461,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.645986123,"mdsmap_epoch":24,"osdmap_epoch":54,"osdmap_epoch_barrier":54,"uptime":25.593128748000002} 2024-09-13T18:37:43.620 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 5461, "mdsmap_epoch": 24, "osdmap_epoch": 54, "osdmap_epoch_barrier": 54, "rank_uptime": 20.645986123, "state": "up:active", "uptime": 25.593128748, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:37:43.620 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:37:43.621 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:43.621 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:43.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.657 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-13T18:37:43.732 INFO:teuthology.orchestra.run.smithi192.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-13T18:37:43.733 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:37:43.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.733 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-13T18:37:43.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:43.815 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-13T18:37:43.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:44.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.100+0000 7f7df8a00640 1 Processor -- start 2024-09-13T18:37:44.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.101+0000 7f7df8a00640 1 -- start start 2024-09-13T18:37:44.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df8a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df40b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df8a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7df406bca0 0x7f7df406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df8a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df406f830 con 0x7f7df41592d0 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df8a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df4071230 con 0x7f7df406bca0 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df8a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40b3fb0 con 0x7f7df40b3600 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7df41592d0 0x7f7df4070b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42798/0 (socket says 172.21.15.192:42798) 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df3400640 1 -- 172.21.15.192:0/424206749 learned_addr learned my addr 172.21.15.192:0/424206749 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.102+0000 7f7df3e00640 1 --2- 172.21.15.192:0/424206749 >> v2:172.21.15.192:3300/0 conn(0x7f7df406bca0 0x7f7df406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df2a00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df40b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df3e00640 1 -- 172.21.15.192:0/424206749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 msgr2=0x7f7df40b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df3e00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df40b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df3e00640 1 -- 172.21.15.192:0/424206749 >> v1:172.21.15.192:6789/0 conn(0x7f7df41592d0 legacy=0x7f7df4070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df3e00640 1 -- 172.21.15.192:0/424206749 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df406c630 con 0x7f7df406bca0 2024-09-13T18:37:44.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.103+0000 7f7df2a00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df3e00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df406c0f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009dc0 tx=0x7f7dec02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbc6ab2831195d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df2000640 1 -- 172.21.15.192:0/424206749 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec007740 con 0x7f7df406bca0 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df2000640 1 -- 172.21.15.192:0/424206749 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec02d050 con 0x7f7df406bca0 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df2000640 1 -- 172.21.15.192:0/424206749 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec007ac0 con 0x7f7df406bca0 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df8a00640 1 -- 172.21.15.192:0/424206749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 msgr2=0x7f7df406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.104+0000 7f7df8a00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df406c0f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009dc0 tx=0x7f7dec02a680 comp rx=0 tx=0).stop 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 -- 172.21.15.192:0/424206749 shutdown_connections 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df406c0f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 --2- 172.21.15.192:0/424206749 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df40b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 -- 172.21.15.192:0/424206749 >> 172.21.15.192:0/424206749 conn(0x7f7df40736d0 msgr2=0x7f7df40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 -- 172.21.15.192:0/424206749 shutdown_connections 2024-09-13T18:37:44.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.105+0000 7f7df8a00640 1 -- 172.21.15.192:0/424206749 wait complete. 2024-09-13T18:37:44.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.106+0000 7f7df8a00640 1 Processor -- start 2024-09-13T18:37:44.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.106+0000 7f7df8a00640 1 -- start start 2024-09-13T18:37:44.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df413eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 0x7f7df40b2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40cc900 con 0x7f7df406bca0 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40ccbe0 con 0x7f7df41592d0 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df8a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df40ccec0 con 0x7f7df40b3600 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58468/0 (socket says 172.21.15.192:58468) 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.107+0000 7f7df3400640 1 -- 172.21.15.192:0/3068013487 learned_addr learned my addr 172.21.15.192:0/3068013487 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3e00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 0x7f7df40b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df2a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df413eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 -- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 msgr2=0x7f7df413eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df413eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 -- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 msgr2=0x7f7df40b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 0x7f7df40b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009a70 con 0x7f7df406bca0 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3e00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 0x7f7df40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df2a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df3400640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c480 tx=0x7f7de400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de4005ce0 con 0x7f7df406bca0 2024-09-13T18:37:44.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7de4005e40 con 0x7f7df406bca0 2024-09-13T18:37:44.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7de40072f0 con 0x7f7df406bca0 2024-09-13T18:37:44.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df40cd1a0 con 0x7f7df406bca0 2024-09-13T18:37:44.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.108+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df40cb210 con 0x7f7df406bca0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.110+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df40cd390 con 0x7f7df406bca0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.110+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7de4007510 con 0x7f7df406bca0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.111+0000 7f7deb400640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 0x7f7dd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.111+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f7de4088800 con 0x7f7df406bca0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.112+0000 7f7df2a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 0x7f7dd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.112+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=56}) v3 -- 0x7f7dd4072910 con 0x7f7df406bca0 2024-09-13T18:37:44.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.112+0000 7f7df2a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 0x7f7dd406d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7de0006fd0 tx=0x7f7de0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:44.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.115+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7de4017020 con 0x7f7df406bca0 2024-09-13T18:37:44.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.285+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7df40cca40 con 0x7f7df406bca0 2024-09-13T18:37:44.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.287+0000 7f7deb400640 1 -- 172.21.15.192:0/3068013487 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v55) v1 ==== 81+0+35069 (secure 0 0 0) 0x7f7df40cca40 con 0x7f7df406bca0 2024-09-13T18:37:44.290 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:44.290 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:44.290 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 55, 2024-09-13T18:37:44.290 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:44.043285+0000", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:44.291 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:44.292 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:44.293 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:44.294 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:44.295 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:44.296 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:44.297 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:44.298 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:44.299 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:44.300 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:44.301 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:44.302 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:44.303 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:44.304 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:44.305 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:44.306 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:44.307 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:44.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:44.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:44.310 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:44.311 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:44.312 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:44.313 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.314 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:44.315 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:44.316 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.319 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.320 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:44.321 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.322 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.323 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.325 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.326 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.328 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.329 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.330 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.331 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:44.332 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.333 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.336 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.337 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.338 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.339 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.340 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.343 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.344 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.345 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.346 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.347 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.349 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:44.350 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:44.351 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.352 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.352 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.358 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.360 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.361 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.362 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:44.363 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.364 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:44.365 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:44.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.367 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.368 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.369 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:44.370 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.371 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.372 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.373 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.374 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.375 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:44.376 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.377 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:44.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:44.379 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:44.380 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:44.381 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 msgr2=0x7f7dd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 0x7f7dd406d0c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f7de0006fd0 tx=0x7f7de0008040 comp rx=0 tx=0).stop 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 msgr2=0x7f7df4153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7de400c480 tx=0x7f7de400c940 comp rx=0 tx=0).stop 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 shutdown_connections 2024-09-13T18:37:44.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7dd406ac00 0x7f7dd406d0c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7df41592d0 0x7f7df40b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7df40b3600 0x7f7df413eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 --2- 172.21.15.192:0/3068013487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7df406bca0 0x7f7df4153a40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 >> 172.21.15.192:0/3068013487 conn(0x7f7df40736d0 msgr2=0x7f7df4156730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.289+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 shutdown_connections 2024-09-13T18:37:44.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:44.290+0000 7f7df8a00640 1 -- 172.21.15.192:0/3068013487 wait complete. 2024-09-13T18:37:44.385 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:37:46.779 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:37:46.776+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2024-09-13T18:37:49.386 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:49.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.546+0000 7fa28ea00640 1 Processor -- start 2024-09-13T18:37:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.546+0000 7fa28ea00640 1 -- start start 2024-09-13T18:37:49.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 0x7fa28815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28ea00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28815af60 con 0x7fa2880b3480 2024-09-13T18:37:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28ea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28806b7a0 con 0x7fa288159b00 2024-09-13T18:37:49.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28815ac80 con 0x7fa28806bc30 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa2880b3480 0x7fa288159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:42808/0 (socket says 172.21.15.192:42808) 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28cc00640 1 -- 172.21.15.192:0/1067002163 learned_addr learned my addr 172.21.15.192:0/1067002163 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.547+0000 7fa28e000640 1 --2- 172.21.15.192:0/1067002163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 0x7fa28815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 862974219 0 0) 0x7fa28815af60 con 0x7fa2880b3480 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa270003520 con 0x7fa2880b3480 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677265581 0 0) 0x7fa28806b7a0 con 0x7fa288159b00 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28815af60 con 0x7fa288159b00 2024-09-13T18:37:49.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa28e000640 1 -- 172.21.15.192:0/1067002163 >> v1:172.21.15.194:6789/0 conn(0x7fa288159b00 legacy=0x7fa2880b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa28e000640 1 -- 172.21.15.192:0/1067002163 >> v1:172.21.15.192:6789/0 conn(0x7fa2880b3480 legacy=0x7fa288159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.548+0000 7fa28e000640 1 -- 172.21.15.192:0/1067002163 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28806b150 con 0x7fa28806bc30 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.549+0000 7fa28e000640 1 --2- 172.21.15.192:0/1067002163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 0x7fa28815a5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa280009dc0 tx=0x7fa28002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df69c2d0b346b912 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.549+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280007740 con 0x7fa28806bc30 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.549+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28002d050 con 0x7fa28806bc30 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.549+0000 7fa287e00640 1 -- 172.21.15.192:0/1067002163 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280007aa0 con 0x7fa28806bc30 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 -- 172.21.15.192:0/1067002163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 msgr2=0x7fa28815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 --2- 172.21.15.192:0/1067002163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 0x7fa28815a5f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa280009dc0 tx=0x7fa28002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 -- 172.21.15.192:0/1067002163 shutdown_connections 2024-09-13T18:37:49.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 --2- 172.21.15.192:0/1067002163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa28806bc30 0x7fa28815a5f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 -- 172.21.15.192:0/1067002163 >> 172.21.15.192:0/1067002163 conn(0x7fa2880736d0 msgr2=0x7fa2880b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 -- 172.21.15.192:0/1067002163 shutdown_connections 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.550+0000 7fa28ea00640 1 -- 172.21.15.192:0/1067002163 wait complete. 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.552+0000 7fa28ea00640 1 Processor -- start 2024-09-13T18:37:49.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.552+0000 7fa28ea00640 1 -- start start 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2880b3480 0x7fa288154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa288159b00 0x7fa288159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288071760 con 0x7fa28806bc30 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288151650 con 0x7fa288159b00 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa288071480 con 0x7fa2880b3480 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:58472/0 (socket says 172.21.15.192:58472) 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28d600640 1 -- 172.21.15.192:0/3436745096 learned_addr learned my addr 172.21.15.192:0/3436745096 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:49.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28e000640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa288159b00 0x7fa288159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.553+0000 7fa28cc00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2880b3480 0x7fa288154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 -- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2880b3480 msgr2=0x7fa288154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2880b3480 0x7fa288154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 -- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa288159b00 msgr2=0x7fa288159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa288159b00 0x7fa288159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa280009a70 con 0x7fa28806bc30 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28d600640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c430 tx=0x7fa27c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0052d0 con 0x7fa28806bc30 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c005450 con 0x7fa28806bc30 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2881518f0 con 0x7fa28806bc30 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c003830 con 0x7fa28806bc30 2024-09-13T18:37:49.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.554+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28814a610 con 0x7fa28806bc30 2024-09-13T18:37:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.555+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa288151e10 con 0x7fa28806bc30 2024-09-13T18:37:49.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.556+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa27c003990 con 0x7fa28806bc30 2024-09-13T18:37:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.557+0000 7fa285600640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 0x7fa26806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.557+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa27c0888f0 con 0x7fa28806bc30 2024-09-13T18:37:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.557+0000 7fa28cc00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 0x7fa26806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.557+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=59}) v3 -- 0x7fa268072910 con 0x7fa28806bc30 2024-09-13T18:37:49.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.558+0000 7fa28cc00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 0x7fa26806d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2880cb200 tx=0x7fa274007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.561+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa27c017060 con 0x7fa28806bc30 2024-09-13T18:37:49.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.732+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa2880b2d70 con 0x7fa28806bc30 2024-09-13T18:37:49.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.733+0000 7fa285600640 1 -- 172.21.15.192:0/3436745096 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v58) v1 ==== 81+0+34965 (secure 0 0 0) 0x7fa27c017020 con 0x7fa28806bc30 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 58, 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:48.646980+0000", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:49.737 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:49.738 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:49.739 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:49.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:49.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:49.742 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:49.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:49.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:49.745 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:49.746 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:49.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:49.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:49.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:49.750 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:49.751 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:37:49.752 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:49.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "52", 2024-09-13T18:37:49.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:49.755 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:49.756 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:49.757 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:49.758 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.759 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:49.760 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:49.761 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:49.764 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.765 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.766 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.767 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.768 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.769 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.771 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.772 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.773 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.774 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:49.775 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.776 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.777 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:49.778 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.779 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.780 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.783 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.785 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:49.786 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:49.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.788 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.789 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.791 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.792 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.793 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:49.794 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.795 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.797 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:49.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.799 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.800 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:49.801 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.802 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.803 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:49.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:49.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:49.806 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.807 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:49.808 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.809 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.810 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.811 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.812 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:49.813 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:49.814 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.815 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:49.816 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:49.817 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:49.818 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:49.819 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:49.819 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:49.819 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:49.819 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:49.819 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:49.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.735+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 msgr2=0x7fa26806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.735+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 0x7fa26806d0c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa2880cb200 tx=0x7fa274007d30 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.735+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 msgr2=0x7fa28814a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.735+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fa27c00c430 tx=0x7fa27c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 shutdown_connections 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa26806ac00 0x7fa26806d0c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa288159b00 0x7fa288159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2880b3480 0x7fa288154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 --2- 172.21.15.192:0/3436745096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa28806bc30 0x7fa28814a0d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 >> 172.21.15.192:0/3436745096 conn(0x7fa2880736d0 msgr2=0x7fa288153fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 shutdown_connections 2024-09-13T18:37:49.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:49.736+0000 7fa28ea00640 1 -- 172.21.15.192:0/3436745096 wait complete. 2024-09-13T18:37:49.822 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:37:54.824 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:54.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.985+0000 7fa198200640 1 Processor -- start 2024-09-13T18:37:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.986+0000 7fa198200640 1 -- start start 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa198200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1900b0490 0x7fa1900cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa198200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa19015ec00 con 0x7fa1900cacd0 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa198200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa190140480 con 0x7fa19015e790 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa198200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1900cb5f0 con 0x7fa1900b0490 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa195800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa1900cacd0 0x7fa190140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47976/0 (socket says 172.21.15.192:47976) 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa195800640 1 -- 172.21.15.192:0/3156041432 learned_addr learned my addr 172.21.15.192:0/3156041432 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:54.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.987+0000 7fa196200640 1 --2- 172.21.15.192:0/3156041432 >> v2:172.21.15.194:3300/0 conn(0x7fa1900b0490 0x7fa1900cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.988+0000 7fa18fe00640 1 -- 172.21.15.192:0/3156041432 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424170302 0 0) 0x7fa19015ec00 con 0x7fa1900cacd0 2024-09-13T18:37:54.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.988+0000 7fa18fe00640 1 -- 172.21.15.192:0/3156041432 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa178003520 con 0x7fa1900cacd0 2024-09-13T18:37:54.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.988+0000 7fa196200640 1 -- 172.21.15.192:0/3156041432 >> v1:172.21.15.194:6789/0 conn(0x7fa19015e790 legacy=0x7fa1900afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.988+0000 7fa196200640 1 -- 172.21.15.192:0/3156041432 >> v1:172.21.15.192:6789/0 conn(0x7fa1900cacd0 legacy=0x7fa190140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.988+0000 7fa196200640 1 -- 172.21.15.192:0/3156041432 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa19015ee90 con 0x7fa1900b0490 2024-09-13T18:37:54.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.989+0000 7fa196200640 1 --2- 172.21.15.192:0/3156041432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1900cb0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa188009d90 tx=0x7fa18802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5527321fac26499 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.989+0000 7fa18fe00640 1 -- 172.21.15.192:0/3156041432 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188007740 con 0x7fa1900b0490 2024-09-13T18:37:54.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.989+0000 7fa18fe00640 1 -- 172.21.15.192:0/3156041432 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18802d050 con 0x7fa1900b0490 2024-09-13T18:37:54.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.989+0000 7fa18fe00640 1 -- 172.21.15.192:0/3156041432 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188007aa0 con 0x7fa1900b0490 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 -- 172.21.15.192:0/3156041432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 msgr2=0x7fa1900cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 --2- 172.21.15.192:0/3156041432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1900cb0b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa188009d90 tx=0x7fa18802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 -- 172.21.15.192:0/3156041432 shutdown_connections 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 --2- 172.21.15.192:0/3156041432 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1900cb0b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 -- 172.21.15.192:0/3156041432 >> 172.21.15.192:0/3156041432 conn(0x7fa1900ae960 msgr2=0x7fa19006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 -- 172.21.15.192:0/3156041432 shutdown_connections 2024-09-13T18:37:54.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.990+0000 7fa198200640 1 -- 172.21.15.192:0/3156041432 wait complete. 2024-09-13T18:37:54.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.992+0000 7fa198200640 1 Processor -- start 2024-09-13T18:37:54.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.992+0000 7fa198200640 1 -- start start 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1901367c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 0x7fa19015cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19013c830 con 0x7fa19015e790 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19013cb10 con 0x7fa1900b0490 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa198200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa19013cdf0 con 0x7fa1900cacd0 2024-09-13T18:37:54.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa196200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa196200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60676/0 (socket says 172.21.15.192:60676) 2024-09-13T18:37:54.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa196200640 1 -- 172.21.15.192:0/1092552797 learned_addr learned my addr 172.21.15.192:0/1092552797 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa195800640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1901367c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa194e00640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 0x7fa19015cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa196200640 1 -- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 msgr2=0x7fa19015cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.993+0000 7fa196200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 0x7fa19015cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa196200640 1 -- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 msgr2=0x7fa1901367c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa196200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1901367c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:54.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa196200640 1 -- 172.21.15.192:0/1092552797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa188009a70 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa194e00640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 0x7fa19015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa195800640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1901367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa196200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa188009eb0 tx=0x7fa188004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188007740 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1880078a0 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa188007c50 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19013d0d0 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.994+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa190136d00 con 0x7fa19015e790 2024-09-13T18:37:54.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.995+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900cb0b0 con 0x7fa19015e790 2024-09-13T18:37:55.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.996+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa18803b410 con 0x7fa19015e790 2024-09-13T18:37:55.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.997+0000 7fa18d600640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.997+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fa1880aa4a0 con 0x7fa19015e790 2024-09-13T18:37:55.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.997+0000 7fa195800640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:54.998+0000 7fa195800640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 0x7fa17006d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1840011e0 tx=0x7fa184009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.002+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa1880756a0 con 0x7fa19015e790 2024-09-13T18:37:55.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.170+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa19006c6c0 con 0x7fa19015e790 2024-09-13T18:37:55.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.172+0000 7fa18d600640 1 -- 172.21.15.192:0/1092552797 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+34926 (secure 0 0 0) 0x7fa188009450 con 0x7fa19015e790 2024-09-13T18:37:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:55.175 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 59, 2024-09-13T18:37:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:51.664800+0000", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.251 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.252 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.254 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.255 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.256 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.257 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.258 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:55.259 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.260 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.261 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.262 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.263 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:55.264 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.265 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.266 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.267 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:55.268 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:55.269 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.270 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:55.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.272 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:55.273 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:55.274 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:55.275 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.275 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 msgr2=0x7fa17006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 0x7fa17006d0c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa1840011e0 tx=0x7fa184009040 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 msgr2=0x7fa19015d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa188009eb0 tx=0x7fa188004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 shutdown_connections 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa17006ac00 0x7fa17006d0c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa19015e790 0x7fa19015d310 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1900cacd0 0x7fa19015cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 --2- 172.21.15.192:0/1092552797 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1900b0490 0x7fa1901367c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 >> 172.21.15.192:0/1092552797 conn(0x7fa1900ae960 msgr2=0x7fa190070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 shutdown_connections 2024-09-13T18:37:55.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.174+0000 7fa198200640 1 -- 172.21.15.192:0/1092552797 wait complete. 2024-09-13T18:37:55.278 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-13T18:37:55.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:37:55.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.427+0000 7f5f92400640 1 Processor -- start 2024-09-13T18:37:55.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.428+0000 7f5f92400640 1 -- start start 2024-09-13T18:37:55.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f8c15a9e0 0x7f5f8c06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f8c06e990 0x7f5f8c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c0b3730 con 0x7f5f8c06e990 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8c06c5d0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f92400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c0b3920 con 0x7f5f8c06b3d0 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f91a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f8c06e990 0x7f5f8c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f91a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5f8c06e990 0x7f5f8c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60678/0 (socket says 172.21.15.192:60678) 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f91a00640 1 -- 172.21.15.192:0/1966433234 learned_addr learned my addr 172.21.15.192:0/1966433234 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f83e00640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.429+0000 7f5f91000640 1 --2- 172.21.15.192:0/1966433234 >> v2:172.21.15.194:3300/0 conn(0x7f5f8c15a9e0 0x7f5f8c06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.430+0000 7f5f91a00640 1 -- 172.21.15.192:0/1966433234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 msgr2=0x7f5f8c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.430+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.430+0000 7f5f91a00640 1 -- 172.21.15.192:0/1966433234 >> v2:172.21.15.194:3300/0 conn(0x7f5f8c15a9e0 msgr2=0x7f5f8c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.430+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1966433234 >> v2:172.21.15.194:3300/0 conn(0x7f5f8c15a9e0 0x7f5f8c06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.430+0000 7f5f91a00640 1 -- 172.21.15.192:0/1966433234 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c0b3c00 con 0x7f5f8c06e990 2024-09-13T18:37:55.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c06e990 0x7f5f8c0cde00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c06cc90 tx=0x7f5f8402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ce2940ceb53944 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f8be00640 1 -- 172.21.15.192:0/1966433234 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84031600 con 0x7f5f8c06e990 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f8be00640 1 -- 172.21.15.192:0/1966433234 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8402d050 con 0x7f5f8c06e990 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f8be00640 1 -- 172.21.15.192:0/1966433234 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f84031980 con 0x7f5f8c06e990 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f92400640 1 -- 172.21.15.192:0/1966433234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c06e990 msgr2=0x7f5f8c0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.431+0000 7f5f92400640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c06e990 0x7f5f8c0cde00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c06cc90 tx=0x7f5f8402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 -- 172.21.15.192:0/1966433234 shutdown_connections 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c06e990 0x7f5f8c0cde00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 --2- 172.21.15.192:0/1966433234 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 --2- 172.21.15.192:0/1966433234 >> v2:172.21.15.194:3300/0 conn(0x7f5f8c15a9e0 0x7f5f8c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 -- 172.21.15.192:0/1966433234 >> 172.21.15.192:0/1966433234 conn(0x7f5f8c0736d0 msgr2=0x7f5f8c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 -- 172.21.15.192:0/1966433234 shutdown_connections 2024-09-13T18:37:55.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.432+0000 7f5f92400640 1 -- 172.21.15.192:0/1966433234 wait complete. 2024-09-13T18:37:55.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.433+0000 7f5f92400640 1 Processor -- start 2024-09-13T18:37:55.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.433+0000 7f5f92400640 1 -- start start 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f8c06e990 0x7f5f8c1f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c151e70 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c155080 con 0x7f5f8c06e990 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f92400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8c1520c0 con 0x7f5f8c06b3d0 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.434+0000 7f5f91a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60694/0 (socket says 172.21.15.192:60694) 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 -- 172.21.15.192:0/1660255393 learned_addr learned my addr 172.21.15.192:0/1660255393 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:55.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f83e00640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f8c06e990 0x7f5f8c1f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91000640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 -- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 msgr2=0x7f5f8c0ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 -- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f8c06e990 msgr2=0x7f5f8c1f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f8c06e990 0x7f5f8c1f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 -- 172.21.15.192:0/1660255393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f84009b30 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f91a00640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5f84034040 tx=0x7f5f84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.435+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8403d860 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.436+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8403d9c0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.436+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8403dd70 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.436+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8c1523a0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.436+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8c0aa6e0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.437+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8c0ce6c0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.438+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f8403b400 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.438+0000 7f5f89600640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 0x7f5f6806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.438+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f5f840aa160 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.439+0000 7f5f91000640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 0x7f5f6806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.439+0000 7f5f91000640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 0x7f5f6806d0f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009aa0 tx=0x7f5f7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.442+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f84075230 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.611+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5f8c06bff0 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.612+0000 7f5f89600640 1 -- 172.21.15.192:0/1660255393 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v59) v1 ==== 81+0+34926 (secure 0 0 0) 0x7f5f84009510 con 0x7f5f8c15a9e0 2024-09-13T18:37:55.615 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:55.615 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 59, 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:37:51.664800+0000", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:37:55.616 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:37:55.617 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 7, 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "luminous", 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:37:55.618 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:37:55.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.622 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.624 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.625 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:37:55.626 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 6, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:20.953486+0000", 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.628 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:37:55.629 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.631 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.633 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.635 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 7, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:37:21.953576+0000", 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:37:55.636 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:37:55.637 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "59", 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:37:55.638 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:37:55.639 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:37:55.640 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:37:55.641 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:37:55.642 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.643 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.644 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:37:55.645 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.646 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:37:55.649 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:55.650 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.651 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.652 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.654 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.655 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.656 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:37:55.657 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.658 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.659 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.661 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.662 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.663 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.663 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:37:55.663 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.664 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.665 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.666 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.668 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.669 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.670 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:37:55.671 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.672 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.673 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.674 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.676 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.678 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.680 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:37:55.681 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 47, 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:37:55.682 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:37:55.686 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:55.687 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.688 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.689 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.690 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:37:55.692 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.694 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:37:55.695 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 50, 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.696 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.697 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.698 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:37:55.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:37:55.700 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.701 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.702 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.703 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.704 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:37:55.705 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.706 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.707 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:37:55.708 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [ 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.3", 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.15", 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.2e", 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.710 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.31", 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.711 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 0 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "pgid": "7.33", 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "mappings": [ 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "from": 5, 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: "to": 7 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.712 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:37:55.713 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:37:55.714 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:37:55.715 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:37:55.715 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:37:55.715 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:37:55.715 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:37:55.715 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:37:55.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 msgr2=0x7f5f6806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 0x7f5f6806d0f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009aa0 tx=0x7f5f7c009190 comp rx=0 tx=0).stop 2024-09-13T18:37:55.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 msgr2=0x7f5f8c151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5f84034040 tx=0x7f5f84004a40 comp rx=0 tx=0).stop 2024-09-13T18:37:55.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 shutdown_connections 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f6806ac30 0x7f5f6806d0f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f8c15a9e0 0x7f5f8c151470 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f8c06e990 0x7f5f8c1f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 --2- 172.21.15.192:0/1660255393 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f8c06b3d0 0x7f5f8c0ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 >> 172.21.15.192:0/1660255393 conn(0x7f5f8c0736d0 msgr2=0x7f5f8c06b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.614+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 shutdown_connections 2024-09-13T18:37:55.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.615+0000 7f5f92400640 1 -- 172.21.15.192:0/1660255393 wait complete. 2024-09-13T18:37:55.719 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:37:55.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.869+0000 7f61a7200640 1 Processor -- start 2024-09-13T18:37:55.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.869+0000 7f61a7200640 1 -- start start 2024-09-13T18:37:55.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.870+0000 7f61a7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.870+0000 7f61a7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a00b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.870+0000 7f61a7200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a00adf50 con 0x7f61a00b2780 2024-09-13T18:37:55.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.870+0000 7f61a7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a00cd920 con 0x7f61a0146610 2024-09-13T18:37:55.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.870+0000 7f61a7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00b0730 con 0x7f61a00afd80 2024-09-13T18:37:55.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f619fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f61a5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a00b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f619fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:52680/0 (socket says 172.21.15.192:52680) 2024-09-13T18:37:55.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f619fe00640 1 -- 172.21.15.192:0/3655575656 learned_addr learned my addr 172.21.15.192:0/3655575656 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f61a5200640 1 -- 172.21.15.192:0/3655575656 >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 msgr2=0x7f61a00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f61a5200640 1 --2- 172.21.15.192:0/3655575656 >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f61a5200640 1 -- 172.21.15.192:0/3655575656 >> v1:172.21.15.194:6789/0 conn(0x7f61a00b2780 legacy=0x7f61a00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f61a5200640 1 -- 172.21.15.192:0/3655575656 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a00ae770 con 0x7f61a00afd80 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.871+0000 7f619fe00640 1 --2- 172.21.15.192:0/3655575656 >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.872+0000 7f61a5200640 1 --2- 172.21.15.192:0/3655575656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a00b01f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61980097d0 tx=0x7f619802a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36daeba361dd8354 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f619ea00640 1 -- 172.21.15.192:0/3655575656 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198032440 con 0x7f61a00afd80 2024-09-13T18:37:55.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f619ea00640 1 -- 172.21.15.192:0/3655575656 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61980325a0 con 0x7f61a00afd80 2024-09-13T18:37:55.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f619ea00640 1 -- 172.21.15.192:0/3655575656 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198032930 con 0x7f61a00afd80 2024-09-13T18:37:55.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 -- 172.21.15.192:0/3655575656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 msgr2=0x7f61a00b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 --2- 172.21.15.192:0/3655575656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a00b01f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f61980097d0 tx=0x7f619802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 -- 172.21.15.192:0/3655575656 shutdown_connections 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 --2- 172.21.15.192:0/3655575656 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a00b01f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 --2- 172.21.15.192:0/3655575656 >> v2:172.21.15.194:3300/0 conn(0x7f61a0146610 0x7f61a00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 -- 172.21.15.192:0/3655575656 >> 172.21.15.192:0/3655575656 conn(0x7f61a00ae960 msgr2=0x7f61a006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.873+0000 7f61a7200640 1 -- 172.21.15.192:0/3655575656 shutdown_connections 2024-09-13T18:37:55.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.874+0000 7f61a7200640 1 -- 172.21.15.192:0/3655575656 wait complete. 2024-09-13T18:37:55.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.875+0000 7f61a7200640 1 Processor -- start 2024-09-13T18:37:55.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.875+0000 7f61a7200640 1 -- start start 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a0144f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61a00b2780 0x7f61a015c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a015be60 con 0x7f61a0146610 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a00cb840 con 0x7f61a00b2780 2024-09-13T18:37:55.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a0145450 con 0x7f61a00afd80 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60700/0 (socket says 172.21.15.192:60700) 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f61a5200640 1 -- 172.21.15.192:0/1678742611 learned_addr learned my addr 172.21.15.192:0/1678742611 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f619fe00640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a0144f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.876+0000 7f619f400640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61a00b2780 0x7f61a015c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 -- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 msgr2=0x7f61a0144f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a0144f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 -- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61a00b2780 msgr2=0x7f61a015c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61a00b2780 0x7f61a015c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 -- 172.21.15.192:0/1678742611 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6190009b30 con 0x7f61a0146610 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a5200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f619802a7b0 tx=0x7f61980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198030b00 con 0x7f61a0146610 2024-09-13T18:37:55.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6198032e90 con 0x7f61a0146610 2024-09-13T18:37:55.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6198009400 con 0x7f61a0146610 2024-09-13T18:37:55.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.877+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198006e10 con 0x7f61a0146610 2024-09-13T18:37:55.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.878+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a015b7a0 con 0x7f61a0146610 2024-09-13T18:37:55.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.878+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a00ae470 con 0x7f61a0146610 2024-09-13T18:37:55.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.879+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6198039040 con 0x7f61a0146610 2024-09-13T18:37:55.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.880+0000 7f6197e00640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 0x7f618006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:55.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.880+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f61980a9c00 con 0x7f61a0146610 2024-09-13T18:37:55.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.880+0000 7f619fe00640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 0x7f618006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:55.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.881+0000 7f619fe00640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 0x7f618006d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b4c00 tx=0x7f619000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:55.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:55.884+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f61a00ae470 con 0x7f61a0146610 2024-09-13T18:37:56.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.087+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f61a015bfa0 con 0x7f61a0146610 2024-09-13T18:37:56.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.088+0000 7f6197e00640 1 -- 172.21.15.192:0/1678742611 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f61a015bfa0 con 0x7f61a0146610 2024-09-13T18:37:56.091 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:56.091 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:37:56.091 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 msgr2=0x7f618006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 0x7f618006d0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f61a00b4c00 tx=0x7f619000b040 comp rx=0 tx=0).stop 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 msgr2=0x7f61a00706c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f619802a7b0 tx=0x7f61980046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 shutdown_connections 2024-09-13T18:37:56.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f618006ac00 0x7f618006d0c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61a0146610 0x7f61a00706c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61a00b2780 0x7f61a015c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 --2- 172.21.15.192:0/1678742611 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61a00afd80 0x7f61a0144f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 >> 172.21.15.192:0/1678742611 conn(0x7f61a00ae960 msgr2=0x7f61a01607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 shutdown_connections 2024-09-13T18:37:56.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:56.090+0000 7f61a7200640 1 -- 172.21.15.192:0/1678742611 wait complete. 2024-09-13T18:37:56.108 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:37:56.287 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":5461,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":33.312968798999997,"mdsmap_epoch":24,"osdmap_epoch":59,"osdmap_epoch_barrier":54,"uptime":38.260112077999999} 2024-09-13T18:37:56.287 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 5461, "mdsmap_epoch": 24, "osdmap_epoch": 59, "osdmap_epoch_barrier": 54, "rank_uptime": 33.312968799, "state": "up:active", "uptime": 38.260112078, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:37:56.288 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:56.288 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:56.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:56.324 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-13T18:37:56.790 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:37:56.790 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:37:56.790 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.390173 s, 134 MB/s 2024-09-13T18:37:56.791 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:37:56.791 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:56.881 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:37:56.970 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:37:56.971 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:56.971 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:57.006 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:37:57.006 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:57.082 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:57.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.271+0000 7f93aec00640 1 Processor -- start 2024-09-13T18:37:57.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.271+0000 7f93aec00640 1 -- start start 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93aec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93aec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 0x7f93a80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93aec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a806f830 con 0x7f93a80b3600 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93aec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80b3f80 con 0x7f93a806c3b0 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93aec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a806fa80 con 0x7f93a81592d0 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93ace00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f93a80b3600 0x7f93a806bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47978/0 (socket says 172.21.15.192:47978) 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93ace00640 1 -- 172.21.15.192:0/828836548 learned_addr learned my addr 172.21.15.192:0/828836548 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:57.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93ad800640 1 --2- 172.21.15.192:0/828836548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.272+0000 7f93ae200640 1 --2- 172.21.15.192:0/828836548 >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 0x7f93a80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93a7e00640 1 -- 172.21.15.192:0/828836548 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138586834 0 0) 0x7f93a806f830 con 0x7f93a80b3600 2024-09-13T18:37:57.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93a7e00640 1 -- 172.21.15.192:0/828836548 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9390003520 con 0x7f93a80b3600 2024-09-13T18:37:57.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93ad800640 1 -- 172.21.15.192:0/828836548 >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 msgr2=0x7f93a80b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93ad800640 1 --2- 172.21.15.192:0/828836548 >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 0x7f93a80b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93ad800640 1 -- 172.21.15.192:0/828836548 >> v1:172.21.15.192:6789/0 conn(0x7f93a80b3600 legacy=0x7f93a806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93ad800640 1 -- 172.21.15.192:0/828836548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a806fd60 con 0x7f93a81592d0 2024-09-13T18:37:57.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.273+0000 7f93ae200640 1 --2- 172.21.15.192:0/828836548 >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 0x7f93a80b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:37:57.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.274+0000 7f93ad800640 1 --2- 172.21.15.192:0/828836548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a8070b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097a0 tx=0x7f939c02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2d2581513e39dcf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.274+0000 7f93a7e00640 1 -- 172.21.15.192:0/828836548 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c032440 con 0x7f93a81592d0 2024-09-13T18:37:57.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.274+0000 7f93a7e00640 1 -- 172.21.15.192:0/828836548 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c0325a0 con 0x7f93a81592d0 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.274+0000 7f93a7e00640 1 -- 172.21.15.192:0/828836548 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c032930 con 0x7f93a81592d0 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 -- 172.21.15.192:0/828836548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 msgr2=0x7f93a8070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 --2- 172.21.15.192:0/828836548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a8070b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f939c0097a0 tx=0x7f939c02a180 comp rx=0 tx=0).stop 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 -- 172.21.15.192:0/828836548 shutdown_connections 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 --2- 172.21.15.192:0/828836548 >> v2:172.21.15.194:3300/0 conn(0x7f93a806c3b0 0x7f93a80b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 --2- 172.21.15.192:0/828836548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a8070b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 -- 172.21.15.192:0/828836548 >> 172.21.15.192:0/828836548 conn(0x7f93a80736d0 msgr2=0x7f93a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 -- 172.21.15.192:0/828836548 shutdown_connections 2024-09-13T18:37:57.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.275+0000 7f93aec00640 1 -- 172.21.15.192:0/828836548 wait complete. 2024-09-13T18:37:57.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.277+0000 7f93aec00640 1 Processor -- start 2024-09-13T18:37:57.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.277+0000 7f93aec00640 1 -- start start 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 0x7f93a80cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a80cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a81410d0 con 0x7f93a806c3b0 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8154020 con 0x7f93a80b3600 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93aec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8154300 con 0x7f93a81592d0 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60702/0 (socket says 172.21.15.192:60702) 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 -- 172.21.15.192:0/687376479 learned_addr learned my addr 172.21.15.192:0/687376479 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:57.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ace00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 0x7f93a80cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ae200640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a80cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 -- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 msgr2=0x7f93a80cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a80cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 -- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 msgr2=0x7f93a80cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 0x7f93a80cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ad800640 1 -- 172.21.15.192:0/687376479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a000ab80 con 0x7f93a806c3b0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.278+0000 7f93ace00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 0x7f93a80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93ad800640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f939c035040 tx=0x7f939c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c03d8f0 con 0x7f93a806c3b0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c03da70 con 0x7f93a806c3b0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c03de20 con 0x7f93a806c3b0 2024-09-13T18:37:57.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f939c009400 con 0x7f93a806c3b0 2024-09-13T18:37:57.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.279+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a81548c0 con 0x7f93a806c3b0 2024-09-13T18:37:57.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.280+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a80b3a40 con 0x7f93a806c3b0 2024-09-13T18:37:57.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.281+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f939c039040 con 0x7f93a806c3b0 2024-09-13T18:37:57.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.282+0000 7f93a5600640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 0x7f938806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.282+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f939c0a9e10 con 0x7f93a806c3b0 2024-09-13T18:37:57.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.282+0000 7f93ace00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 0x7f938806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.283+0000 7f93ace00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 0x7f938806d0f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93a815cc00 tx=0x7f9394009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.287+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f939c0ad030 con 0x7f93a806c3b0 2024-09-13T18:37:57.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.458+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93a80aeb90 con 0x7f93a806c3b0 2024-09-13T18:37:57.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.460+0000 7f93a5600640 1 -- 172.21.15.192:0/687376479 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f939c075090 con 0x7f93a806c3b0 2024-09-13T18:37:57.463 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:57.463 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":59,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:51.664800+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.15","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":0}]},{"pgid":"7.33","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 msgr2=0x7f938806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 0x7f938806d0f0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93a815cc00 tx=0x7f9394009040 comp rx=0 tx=0).stop 2024-09-13T18:37:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 msgr2=0x7f93a8140b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f939c035040 tx=0x7f939c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 shutdown_connections 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f938806ac30 0x7f938806d0f0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93a81592d0 0x7f93a80cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93a80b3600 0x7f93a80cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 --2- 172.21.15.192:0/687376479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93a806c3b0 0x7f93a8140b90 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 >> 172.21.15.192:0/687376479 conn(0x7f93a80736d0 msgr2=0x7f93a80b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 shutdown_connections 2024-09-13T18:37:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.462+0000 7f93aec00640 1 -- 172.21.15.192:0/687376479 wait complete. 2024-09-13T18:37:57.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:20.953486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:21.953576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:57.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:57.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.633+0000 7fe772a00640 1 Processor -- start 2024-09-13T18:37:57.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.634+0000 7fe772a00640 1 -- start start 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe76c159b00 0x7fe76c0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c15af60 con 0x7fe76c15a5f0 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe76c15aa40 con 0x7fe76c06bc30 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe76c06b7a0 con 0x7fe76c159b00 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe771600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe76c159b00 0x7fe76c0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe76c15a5f0 0x7fe76c0cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47990/0 (socket says 172.21.15.192:47990) 2024-09-13T18:37:57.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.635+0000 7fe772000640 1 -- 172.21.15.192:0/1193314269 learned_addr learned my addr 172.21.15.192:0/1193314269 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:57.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.636+0000 7fe771600640 1 -- 172.21.15.192:0/1193314269 >> v1:172.21.15.194:6789/0 conn(0x7fe76c06bc30 legacy=0x7fe76c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.636+0000 7fe771600640 1 -- 172.21.15.192:0/1193314269 >> v1:172.21.15.192:6789/0 conn(0x7fe76c15a5f0 legacy=0x7fe76c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.636+0000 7fe771600640 1 -- 172.21.15.192:0/1193314269 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c15ac80 con 0x7fe76c159b00 2024-09-13T18:37:57.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.636+0000 7fe76be00640 1 -- 172.21.15.192:0/1193314269 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2169051210 0 0) 0x7fe76c15af60 con 0x7fe76c15a5f0 2024-09-13T18:37:57.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe771600640 1 --2- 172.21.15.192:0/1193314269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c0b2d70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097a0 tx=0x7fe76002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb7dfb604a102af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe76be00640 1 -- 172.21.15.192:0/1193314269 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760032440 con 0x7fe76c159b00 2024-09-13T18:37:57.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe76be00640 1 -- 172.21.15.192:0/1193314269 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600325a0 con 0x7fe76c159b00 2024-09-13T18:37:57.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe76be00640 1 -- 172.21.15.192:0/1193314269 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760032930 con 0x7fe76c159b00 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe772a00640 1 -- 172.21.15.192:0/1193314269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 msgr2=0x7fe76c0b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.637+0000 7fe772a00640 1 --2- 172.21.15.192:0/1193314269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c0b2d70 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe7600097a0 tx=0x7fe76002a230 comp rx=0 tx=0).stop 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.638+0000 7fe772a00640 1 -- 172.21.15.192:0/1193314269 shutdown_connections 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.638+0000 7fe772a00640 1 --2- 172.21.15.192:0/1193314269 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c0b2d70 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.638+0000 7fe772a00640 1 -- 172.21.15.192:0/1193314269 >> 172.21.15.192:0/1193314269 conn(0x7fe76c0736d0 msgr2=0x7fe76c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.638+0000 7fe772a00640 1 -- 172.21.15.192:0/1193314269 shutdown_connections 2024-09-13T18:37:57.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.638+0000 7fe772a00640 1 -- 172.21.15.192:0/1193314269 wait complete. 2024-09-13T18:37:57.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.639+0000 7fe772a00640 1 Processor -- start 2024-09-13T18:37:57.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.639+0000 7fe772a00640 1 -- start start 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 0x7fe76c070880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76c15a5f0 0x7fe76c1465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c071420 con 0x7fe76c159b00 2024-09-13T18:37:57.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c070e60 con 0x7fe76c06bc30 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.640+0000 7fe772a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe76c071140 con 0x7fe76c15a5f0 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60714/0 (socket says 172.21.15.192:60714) 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 -- 172.21.15.192:0/3575017027 learned_addr learned my addr 172.21.15.192:0/3575017027 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe771600640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 0x7fe76c070880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe772000640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76c15a5f0 0x7fe76c1465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 -- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76c15a5f0 msgr2=0x7fe76c1465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76c15a5f0 0x7fe76c1465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 -- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 msgr2=0x7fe76c070880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 0x7fe76c070880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 -- 172.21.15.192:0/3575017027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe760009400 con 0x7fe76c159b00 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe771600640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 0x7fe76c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:57.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe770c00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c450 tx=0x7fe75800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7580052d0 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758005430 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe758012870 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.641+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe76c0ae830 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.642+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe76c153530 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.643+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe76c0ae690 con 0x7fe76c159b00 2024-09-13T18:37:57.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.643+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe7580129d0 con 0x7fe76c159b00 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.644+0000 7fe769600640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 0x7fe74c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.644+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe758088d50 con 0x7fe76c159b00 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.644+0000 7fe771600640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 0x7fe74c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.645+0000 7fe771600640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 0x7fe74c06d0f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.648+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe76c0ae690 con 0x7fe76c159b00 2024-09-13T18:37:57.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.816+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe76c0aed50 con 0x7fe76c159b00 2024-09-13T18:37:57.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.817+0000 7fe769600640 1 -- 172.21.15.192:0/3575017027 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe76c0aed50 con 0x7fe76c159b00 2024-09-13T18:37:57.820 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 msgr2=0x7fe74c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 0x7fe74c06d0f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).stop 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 msgr2=0x7fe76c152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe75800c450 tx=0x7fe75800c910 comp rx=0 tx=0).stop 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 shutdown_connections 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe74c06ac30 0x7fe74c06d0f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe76c15a5f0 0x7fe76c1465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe76c159b00 0x7fe76c152ff0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 --2- 172.21.15.192:0/3575017027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe76c06bc30 0x7fe76c070880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 >> 172.21.15.192:0/3575017027 conn(0x7fe76c0736d0 msgr2=0x7fe76c0cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 shutdown_connections 2024-09-13T18:37:57.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.819+0000 7fe772a00640 1 -- 172.21.15.192:0/3575017027 wait complete. 2024-09-13T18:37:57.838 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:37:57.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.990+0000 7fc863200640 1 Processor -- start 2024-09-13T18:37:57.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.990+0000 7fc863200640 1 -- start start 2024-09-13T18:37:57.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.991+0000 7fc863200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c0b3af0 0x7fc85c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.991+0000 7fc863200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc85c06c0b0 0x7fc85c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.991+0000 7fc863200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c0b2000 con 0x7fc85c1589f0 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.991+0000 7fc863200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c06ca80 con 0x7fc85c06c0b0 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.991+0000 7fc863200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c0b2ba0 con 0x7fc85c0b3af0 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc85c06c0b0 0x7fc85c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc85c06c0b0 0x7fc85c06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60730/0 (socket says 172.21.15.192:60730) 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 -- 172.21.15.192:0/3849462168 learned_addr learned my addr 172.21.15.192:0/3849462168 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc85b400640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c0b3af0 0x7fc85c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 -- 172.21.15.192:0/3849462168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c0b3af0 msgr2=0x7fc85c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c0b3af0 0x7fc85c15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 -- 172.21.15.192:0/3849462168 >> v1:172.21.15.194:6789/0 conn(0x7fc85c1589f0 legacy=0x7fc85c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:57.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.992+0000 7fc861200640 1 -- 172.21.15.192:0/3849462168 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c15bbd0 con 0x7fc85c06c0b0 2024-09-13T18:37:57.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.993+0000 7fc861200640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c06c0b0 0x7fc85c06c540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e50 tx=0x7fc85402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431c633f6cff38a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:57.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.993+0000 7fc85aa00640 1 -- 172.21.15.192:0/3849462168 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854031600 con 0x7fc85c06c0b0 2024-09-13T18:37:57.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.993+0000 7fc85aa00640 1 -- 172.21.15.192:0/3849462168 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85402d050 con 0x7fc85c06c0b0 2024-09-13T18:37:57.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.993+0000 7fc85aa00640 1 -- 172.21.15.192:0/3849462168 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc854031980 con 0x7fc85c06c0b0 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 -- 172.21.15.192:0/3849462168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c06c0b0 msgr2=0x7fc85c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c06c0b0 0x7fc85c06c540 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fc854009e50 tx=0x7fc85402a710 comp rx=0 tx=0).stop 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 -- 172.21.15.192:0/3849462168 shutdown_connections 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c06c0b0 0x7fc85c06c540 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 --2- 172.21.15.192:0/3849462168 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c0b3af0 0x7fc85c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 -- 172.21.15.192:0/3849462168 >> 172.21.15.192:0/3849462168 conn(0x7fc85c0b08f0 msgr2=0x7fc85c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:57.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 -- 172.21.15.192:0/3849462168 shutdown_connections 2024-09-13T18:37:57.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.994+0000 7fc863200640 1 -- 172.21.15.192:0/3849462168 wait complete. 2024-09-13T18:37:57.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.996+0000 7fc863200640 1 Processor -- start 2024-09-13T18:37:57.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.996+0000 7fc863200640 1 -- start start 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc85c06c0b0 0x7fc85c14e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c1589f0 0x7fc85c157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c14fe10 con 0x7fc85c0b3af0 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1500f0 con 0x7fc85c06c0b0 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc863200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c1f31f0 con 0x7fc85c1589f0 2024-09-13T18:37:58.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60740/0 (socket says 172.21.15.192:60740) 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 -- 172.21.15.192:0/3665346217 learned_addr learned my addr 172.21.15.192:0/3665346217 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85be00640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc85c06c0b0 0x7fc85c14e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc861200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c1589f0 0x7fc85c157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 -- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c1589f0 msgr2=0x7fc85c157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c1589f0 0x7fc85c157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 -- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc85c06c0b0 msgr2=0x7fc85c14e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc85c06c0b0 0x7fc85c14e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.997+0000 7fc85b400640 1 -- 172.21.15.192:0/3665346217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854009b30 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc85b400640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d800 tx=0x7fc84800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800b6c0 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84800b820 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c1f34d0 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84800bbd0 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.998+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c14fa30 con 0x7fc85c0b3af0 2024-09-13T18:37:58.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:57.999+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c071b20 con 0x7fc85c0b3af0 2024-09-13T18:37:58.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.000+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc84800bd30 con 0x7fc85c0b3af0 2024-09-13T18:37:58.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.001+0000 7fc853e00640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 0x7fc83c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.001+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc848089790 con 0x7fc85c0b3af0 2024-09-13T18:37:58.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.001+0000 7fc85be00640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 0x7fc83c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.002+0000 7fc85be00640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 0x7fc83c06d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b37d0 tx=0x7fc84c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.005+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc848054990 con 0x7fc85c0b3af0 2024-09-13T18:37:58.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.174+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc85c06c540 con 0x7fc85c0b3af0 2024-09-13T18:37:58.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.175+0000 7fc853e00640 1 -- 172.21.15.192:0/3665346217 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc848057fb0 con 0x7fc85c0b3af0 2024-09-13T18:37:58.178 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:37:58.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.177+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 msgr2=0x7fc83c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.177+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 0x7fc83c06d0c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b37d0 tx=0x7fc84c009040 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.177+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 msgr2=0x7fc85c1f39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.177+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fc84800d800 tx=0x7fc84800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 shutdown_connections 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc83c06ac00 0x7fc83c06d0c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc85c1589f0 0x7fc85c157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc85c0b3af0 0x7fc85c1f39f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 --2- 172.21.15.192:0/3665346217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc85c06c0b0 0x7fc85c14e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 >> 172.21.15.192:0/3665346217 conn(0x7fc85c0b08f0 msgr2=0x7fc85c0ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 shutdown_connections 2024-09-13T18:37:58.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.178+0000 7fc863200640 1 -- 172.21.15.192:0/3665346217 wait complete. 2024-09-13T18:37:58.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:37:58.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.349+0000 7f05ef000640 1 Processor -- start 2024-09-13T18:37:58.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.350+0000 7f05ef000640 1 -- start start 2024-09-13T18:37:58.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ef000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05e815b810 0x7f05e815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ef000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 0x7f05e80b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ef000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05e815b070 con 0x7f05e81402c0 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ef000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e80b0590 con 0x7f05e815b810 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ef000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05e815ee20 con 0x7f05e80afbe0 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ed200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05e815b810 0x7f05e815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ed200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05e815b810 0x7f05e815bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60752/0 (socket says 172.21.15.192:60752) 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ed200640 1 -- 172.21.15.192:0/998831083 learned_addr learned my addr 172.21.15.192:0/998831083 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.351+0000 7f05ee600640 1 --2- 172.21.15.192:0/998831083 >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 0x7f05e80b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.352+0000 7f05ed200640 1 -- 172.21.15.192:0/998831083 >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 msgr2=0x7f05e80b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.352+0000 7f05ed200640 1 --2- 172.21.15.192:0/998831083 >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 0x7f05e80b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.352+0000 7f05ed200640 1 -- 172.21.15.192:0/998831083 >> v1:172.21.15.194:6789/0 conn(0x7f05e81402c0 legacy=0x7f05e815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.352+0000 7f05ed200640 1 -- 172.21.15.192:0/998831083 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e815f100 con 0x7f05e815b810 2024-09-13T18:37:58.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.352+0000 7f05ee600640 1 --2- 172.21.15.192:0/998831083 >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 0x7f05e80b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05ed200640 1 --2- 172.21.15.192:0/998831083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e815b810 0x7f05e815bc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f05e806ce80 tx=0x7f05d402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7507dc60da0d1754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05e7e00640 1 -- 172.21.15.192:0/998831083 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4032440 con 0x7f05e815b810 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05e7e00640 1 -- 172.21.15.192:0/998831083 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d40325a0 con 0x7f05e815b810 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05e7e00640 1 -- 172.21.15.192:0/998831083 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4032930 con 0x7f05e815b810 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05ef000640 1 -- 172.21.15.192:0/998831083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e815b810 msgr2=0x7f05e815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.353+0000 7f05ef000640 1 --2- 172.21.15.192:0/998831083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e815b810 0x7f05e815bc50 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f05e806ce80 tx=0x7f05d402a270 comp rx=0 tx=0).stop 2024-09-13T18:37:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 -- 172.21.15.192:0/998831083 shutdown_connections 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 --2- 172.21.15.192:0/998831083 >> v2:172.21.15.194:3300/0 conn(0x7f05e80afbe0 0x7f05e80b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 --2- 172.21.15.192:0/998831083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e815b810 0x7f05e815bc50 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 -- 172.21.15.192:0/998831083 >> 172.21.15.192:0/998831083 conn(0x7f05e80ae7f0 msgr2=0x7f05e806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 -- 172.21.15.192:0/998831083 shutdown_connections 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.354+0000 7f05ef000640 1 -- 172.21.15.192:0/998831083 wait complete. 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.355+0000 7f05ef000640 1 Processor -- start 2024-09-13T18:37:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.355+0000 7f05ef000640 1 -- start start 2024-09-13T18:37:58.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80afbe0 0x7f05e813d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e815b810 0x7f05e80b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8141bf0 con 0x7f05e81402c0 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8140be0 con 0x7f05e80afbe0 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.356+0000 7f05ef000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05e8140e30 con 0x7f05e815b810 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60756/0 (socket says 172.21.15.192:60756) 2024-09-13T18:37:58.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 -- 172.21.15.192:0/3876940306 learned_addr learned my addr 172.21.15.192:0/3876940306 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05edc00640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80afbe0 0x7f05e813d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ee600640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e815b810 0x7f05e80b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 -- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e815b810 msgr2=0x7f05e80b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e815b810 0x7f05e80b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 -- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80afbe0 msgr2=0x7f05e813d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80afbe0 0x7f05e813d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 -- 172.21.15.192:0/3876940306 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40094d0 con 0x7f05e81402c0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.357+0000 7f05ed200640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a2b0 tx=0x7f05d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.358+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d4032440 con 0x7f05e81402c0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.358+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d4030b00 con 0x7f05e81402c0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.358+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d403d440 con 0x7f05e81402c0 2024-09-13T18:37:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.358+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05e8141110 con 0x7f05e81402c0 2024-09-13T18:37:58.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.358+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05e81416d0 con 0x7f05e81402c0 2024-09-13T18:37:58.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.359+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05e80b0050 con 0x7f05e81402c0 2024-09-13T18:37:58.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.360+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05d4039040 con 0x7f05e81402c0 2024-09-13T18:37:58.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.360+0000 7f05e5600640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.361+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f05d40a9f90 con 0x7f05e81402c0 2024-09-13T18:37:58.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.361+0000 7f05edc00640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.361+0000 7f05edc00640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 0x7f05c806d0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000f60 tx=0x7f05dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.365+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05d4075040 con 0x7f05e81402c0 2024-09-13T18:37:58.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.532+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05e815e220 con 0x7f05e81402c0 2024-09-13T18:37:58.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.533+0000 7f05e5600640 1 -- 172.21.15.192:0/3876940306 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f05d4078660 con 0x7f05e81402c0 2024-09-13T18:37:58.536 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 msgr2=0x7f05c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 0x7f05c806d0c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000f60 tx=0x7f05dc009040 comp rx=0 tx=0).stop 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 msgr2=0x7f05e80b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f05d402a2b0 tx=0x7f05d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 shutdown_connections 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05c806ac00 0x7f05c806d0c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05e815b810 0x7f05e80b2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05e81402c0 0x7f05e80b2850 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 --2- 172.21.15.192:0/3876940306 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05e80afbe0 0x7f05e813d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 >> 172.21.15.192:0/3876940306 conn(0x7f05e80ae7f0 msgr2=0x7f05e8071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 shutdown_connections 2024-09-13T18:37:58.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.536+0000 7f05ef000640 1 -- 172.21.15.192:0/3876940306 wait complete. 2024-09-13T18:37:58.555 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:37:58.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.705+0000 7f5a9c200640 1 Processor -- start 2024-09-13T18:37:58.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.705+0000 7f5a9c200640 1 -- start start 2024-09-13T18:37:58.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a9c200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5a940b0490 0x7f5a9415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a9c200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940b2f00 con 0x7f5a9415dee0 2024-09-13T18:37:58.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a9c200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a940b3150 con 0x7f5a940b3f10 2024-09-13T18:37:58.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a9c200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a940b3430 con 0x7f5a940b0490 2024-09-13T18:37:58.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a99800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5a9415dee0 0x7f5a940afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48000/0 (socket says 172.21.15.192:48000) 2024-09-13T18:37:58.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a99800640 1 -- 172.21.15.192:0/1698514340 learned_addr learned my addr 172.21.15.192:0/1698514340 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a9a200640 1 --2- 172.21.15.192:0/1698514340 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b0490 0x7f5a9415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980529766 0 0) 0x7f5a940b2f00 con 0x7f5a9415dee0 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.707+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a7c003520 con 0x7f5a9415dee0 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2065317366 0 0) 0x7f5a7c003520 con 0x7f5a9415dee0 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b0490 msgr2=0x7f5a9415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 --2- 172.21.15.192:0/1698514340 >> v2:172.21.15.194:3300/0 conn(0x7f5a940b0490 0x7f5a9415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 >> v1:172.21.15.194:6789/0 conn(0x7f5a940b3f10 legacy=0x7f5a9415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a940b3710 con 0x7f5a9415dee0 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f5a88001670 con 0x7f5a9415dee0 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 >> v1:172.21.15.192:6789/0 conn(0x7f5a9415dee0 legacy=0x7f5a940afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a7c003970 0x7f5a7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 0x7f5a7c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c005180 0x7f5a7c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a940b3430 con 0x7f5a7c0047c0 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c00c020 con 0x7f5a7c005180 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7c00e3f0 con 0x7f5a7c003970 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 0x7f5a7c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a99800640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a7c003970 0x7f5a7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a9a200640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c005180 0x7f5a7c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 -- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a7c003970 msgr2=0x7f5a7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a7c003970 0x7f5a7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 -- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c005180 msgr2=0x7f5a7c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c005180 0x7f5a7c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a98e00640 1 -- 172.21.15.192:0/1698514340 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c003520 con 0x7f5a7c0047c0 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a9a200640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c005180 0x7f5a7c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.708+0000 7f5a9a200640 1 -- 172.21.15.192:0/1698514340 reap_dead start 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.709+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 0x7f5a7c004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001750 tx=0x7f5a7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511311ff31ba0a78 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.709+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800052d0 con 0x7f5a7c0047c0 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80005430 con 0x7f5a7c0047c0 2024-09-13T18:37:58.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a93e00640 1 -- 172.21.15.192:0/1698514340 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8002abc0 con 0x7f5a7c0047c0 2024-09-13T18:37:58.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 -- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 msgr2=0x7f5a7c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 0x7f5a7c004c40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5a80001750 tx=0x7f5a7c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 -- 172.21.15.192:0/1698514340 shutdown_connections 2024-09-13T18:37:58.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1698514340 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a7c0047c0 0x7f5a7c004c40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 -- 172.21.15.192:0/1698514340 >> 172.21.15.192:0/1698514340 conn(0x7f5a940ae960 msgr2=0x7f5a9406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 -- 172.21.15.192:0/1698514340 shutdown_connections 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.710+0000 7f5a9c200640 1 -- 172.21.15.192:0/1698514340 wait complete. 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.712+0000 7f5a9c200640 1 Processor -- start 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.712+0000 7f5a9c200640 1 -- start start 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c0047c0 0x7f5a94130e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 0x7f5a9413c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a9406aee0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941313d0 con 0x7f5a7c0047c0 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a9c200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a941510a0 con 0x7f5a9413b630 2024-09-13T18:37:58.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a98e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a98e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60778/0 (socket says 172.21.15.192:60778) 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a98e00640 1 -- 172.21.15.192:0/1229500943 learned_addr learned my addr 172.21.15.192:0/1229500943 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.713+0000 7f5a99800640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c0047c0 0x7f5a94130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a9a200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 0x7f5a9413c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 -- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 msgr2=0x7f5a9413c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 0x7f5a9413c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 -- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c0047c0 msgr2=0x7f5a94130e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c0047c0 0x7f5a94130e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 -- 172.21.15.192:0/1229500943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9406a2d0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a9a200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 0x7f5a9413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a98e00640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000c00 tx=0x7f5a80001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80007300 con 0x7f5a9413b1b0 2024-09-13T18:37:58.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a80007460 con 0x7f5a9413b1b0 2024-09-13T18:37:58.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a800067d0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a9406a5b0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.714+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9406ab70 con 0x7f5a9413b1b0 2024-09-13T18:37:58.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.715+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a940afd80 con 0x7f5a9413b1b0 2024-09-13T18:37:58.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.716+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5a80006930 con 0x7f5a9413b1b0 2024-09-13T18:37:58.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.717+0000 7f5a91600640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 0x7f5a7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:58.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.718+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f5a800a92e0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.718+0000 7f5a99800640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 0x7f5a7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:58.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.718+0000 7f5a99800640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 0x7f5a7406d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a88001050 tx=0x7f5a88000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:58.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.722+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5a80074390 con 0x7f5a9413b1b0 2024-09-13T18:37:58.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.903+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5a940afd80 con 0x7f5a9413b1b0 2024-09-13T18:37:58.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.904+0000 7f5a91600640 1 -- 172.21.15.192:0/1229500943 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5a800779b0 con 0x7f5a9413b1b0 2024-09-13T18:37:58.907 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 msgr2=0x7f5a7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 0x7f5a7406d0c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5a88001050 tx=0x7f5a88000f80 comp rx=0 tx=0).stop 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 msgr2=0x7f5a9413bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5a80000c00 tx=0x7f5a80001120 comp rx=0 tx=0).stop 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 shutdown_connections 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5a7406ac00 0x7f5a7406d0c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5a9413b630 0x7f5a9413c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5a9413b1b0 0x7f5a9413bea0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 --2- 172.21.15.192:0/1229500943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5a7c0047c0 0x7f5a94130e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:58.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 >> 172.21.15.192:0/1229500943 conn(0x7f5a940ae960 msgr2=0x7f5a94070470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:58.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 shutdown_connections 2024-09-13T18:37:58.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:58.906+0000 7f5a9c200640 1 -- 172.21.15.192:0/1229500943 wait complete. 2024-09-13T18:37:58.924 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:37:58.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:58.924 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:37:59.025 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:37:59.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:37:59.025 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:37:59.062 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:59.062 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:59.100 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:37:59.100 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:37:59.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:37:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.326+0000 7f9843400640 1 Processor -- start 2024-09-13T18:37:59.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.326+0000 7f9843400640 1 -- start start 2024-09-13T18:37:59.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.327+0000 7f9843400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.327+0000 7f9843400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f983c15bc20 0x7f983c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.327+0000 7f9843400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c140480 con 0x7f983c0cacd0 2024-09-13T18:37:59.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.327+0000 7f9843400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f983c0cb5f0 con 0x7f983c15bc20 2024-09-13T18:37:59.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.327+0000 7f9843400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15ebd0 con 0x7f983c15e790 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9841400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f983c15bc20 0x7f983c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9833e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9840a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f983c0cacd0 0x7f983c140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:54138/0 (socket says 172.21.15.192:54138) 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9840a00640 1 -- 172.21.15.192:0/1765115 learned_addr learned my addr 172.21.15.192:0/1765115 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f983be00640 1 -- 172.21.15.192:0/1765115 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3044503037 0 0) 0x7f983c140480 con 0x7f983c0cacd0 2024-09-13T18:37:59.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9833e00640 1 -- 172.21.15.192:0/1765115 >> v2:172.21.15.194:3300/0 conn(0x7f983c15bc20 msgr2=0x7f983c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9833e00640 1 --2- 172.21.15.192:0/1765115 >> v2:172.21.15.194:3300/0 conn(0x7f983c15bc20 0x7f983c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9833e00640 1 -- 172.21.15.192:0/1765115 >> v1:172.21.15.194:6789/0 conn(0x7f983c0cacd0 legacy=0x7f983c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.328+0000 7f9833e00640 1 -- 172.21.15.192:0/1765115 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c15ee90 con 0x7f983c15e790 2024-09-13T18:37:59.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.329+0000 7f9833e00640 1 --2- 172.21.15.192:0/1765115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c0cb0b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98240097a0 tx=0x7f982402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=743456c75f8aeb9c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f983be00640 1 -- 172.21.15.192:0/1765115 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824032440 con 0x7f983c15e790 2024-09-13T18:37:59.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f983be00640 1 -- 172.21.15.192:0/1765115 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98240325a0 con 0x7f983c15e790 2024-09-13T18:37:59.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f983be00640 1 -- 172.21.15.192:0/1765115 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9824032930 con 0x7f983c15e790 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 -- 172.21.15.192:0/1765115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 msgr2=0x7f983c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 --2- 172.21.15.192:0/1765115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c0cb0b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f98240097a0 tx=0x7f982402a180 comp rx=0 tx=0).stop 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 -- 172.21.15.192:0/1765115 shutdown_connections 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 --2- 172.21.15.192:0/1765115 >> v2:172.21.15.194:3300/0 conn(0x7f983c15bc20 0x7f983c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 --2- 172.21.15.192:0/1765115 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c0cb0b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 -- 172.21.15.192:0/1765115 >> 172.21.15.192:0/1765115 conn(0x7f983c0ae960 msgr2=0x7f983c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 -- 172.21.15.192:0/1765115 shutdown_connections 2024-09-13T18:37:59.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.331+0000 7f9843400640 1 -- 172.21.15.192:0/1765115 wait complete. 2024-09-13T18:37:59.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.332+0000 7f9843400640 1 Processor -- start 2024-09-13T18:37:59.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 -- start start 2024-09-13T18:37:59.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 0x7f983c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f983c15bc20 0x7f983c13efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c06b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c158e60 con 0x7f983c0cacd0 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c159100 con 0x7f983c15bc20 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.333+0000 7f9843400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c1593e0 con 0x7f983c15e790 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9840a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 0x7f983c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9840a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 0x7f983c156430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60786/0 (socket says 172.21.15.192:60786) 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9840a00640 1 -- 172.21.15.192:0/1620607889 learned_addr learned my addr 172.21.15.192:0/1620607889 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c06b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9833e00640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f983c15bc20 0x7f983c13efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 -- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f983c15bc20 msgr2=0x7f983c13efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f983c15bc20 0x7f983c13efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 -- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 msgr2=0x7f983c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 0x7f983c156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 -- 172.21.15.192:0/1620607889 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9824009400 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.334+0000 7f9841400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c06b110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f983400eba0 tx=0x7f983400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.335+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983400cd20 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.335+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983400f040 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.335+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98340146c0 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.335+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c1596c0 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.335+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c06ad90 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.336+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c0cb0b0 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.337+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9834014820 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.337+0000 7f9839600640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 0x7f981806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.338+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f9834089f30 con 0x7f983c15e790 2024-09-13T18:37:59.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.338+0000 7f9840a00640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 0x7f981806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.338+0000 7f9840a00640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 0x7f981806d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f982c000f60 tx=0x7f982c007ea0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.344+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98340551a0 con 0x7f983c15e790 2024-09-13T18:37:59.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.511+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f983c159520 con 0x7f983c15e790 2024-09-13T18:37:59.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.513+0000 7f9839600640 1 -- 172.21.15.192:0/1620607889 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f983c159520 con 0x7f983c15e790 2024-09-13T18:37:59.515 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:37:59.515 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":59,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:51.664800+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.15","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":0}]},{"pgid":"7.33","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 msgr2=0x7f981806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 0x7f981806d0c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f982c000f60 tx=0x7f982c007ea0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 msgr2=0x7f983c06b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c06b110 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f983400eba0 tx=0x7f983400c490 comp rx=0 tx=0).stop 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 shutdown_connections 2024-09-13T18:37:59.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f981806ac00 0x7f981806d0c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f983c15e790 0x7f983c06b110 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f983c15bc20 0x7f983c13efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 --2- 172.21.15.192:0/1620607889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f983c0cacd0 0x7f983c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 >> 172.21.15.192:0/1620607889 conn(0x7f983c0ae960 msgr2=0x7f983c15c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 shutdown_connections 2024-09-13T18:37:59.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.515+0000 7f9843400640 1 -- 172.21.15.192:0/1620607889 wait complete. 2024-09-13T18:37:59.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:20.953486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:21.953576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:37:59.533 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:37:59.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.686+0000 7f210d000640 1 Processor -- start 2024-09-13T18:37:59.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.686+0000 7f210d000640 1 -- start start 2024-09-13T18:37:59.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2108144150 0x7f2108164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2108165420 0x7f21080cd630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f21080cdb70 0x7f21081618c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2108165e40 con 0x7f2108144150 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21080b2000 con 0x7f21080cdb70 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f210d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108165860 con 0x7f2108165420 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f2105e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2108144150 0x7f2108164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f2105e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2108144150 0x7f2108164ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60792/0 (socket says 172.21.15.192:60792) 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.687+0000 7f2105e00640 1 -- 172.21.15.192:0/3952486046 learned_addr learned my addr 172.21.15.192:0/3952486046 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2106800640 1 --2- 172.21.15.192:0/3952486046 >> v2:172.21.15.194:3300/0 conn(0x7f21080cdb70 0x7f21081618c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105400640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2108165420 0x7f21080cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105e00640 1 -- 172.21.15.192:0/3952486046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2108165420 msgr2=0x7f21080cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105e00640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2108165420 0x7f21080cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105e00640 1 -- 172.21.15.192:0/3952486046 >> v2:172.21.15.194:3300/0 conn(0x7f21080cdb70 msgr2=0x7f21081618c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105e00640 1 --2- 172.21.15.192:0/3952486046 >> v2:172.21.15.194:3300/0 conn(0x7f21080cdb70 0x7f21081618c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.688+0000 7f2105e00640 1 -- 172.21.15.192:0/3952486046 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21080ce900 con 0x7f2108144150 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.689+0000 7f2105e00640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108164ee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f21080ceaf0 tx=0x7f20f802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe92d378b8b1c93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.689+0000 7f2104a00640 1 -- 172.21.15.192:0/3952486046 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8032440 con 0x7f2108144150 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.689+0000 7f2104a00640 1 -- 172.21.15.192:0/3952486046 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f80325a0 con 0x7f2108144150 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.689+0000 7f2104a00640 1 -- 172.21.15.192:0/3952486046 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f8032930 con 0x7f2108144150 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 -- 172.21.15.192:0/3952486046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 msgr2=0x7f2108164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108164ee0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f21080ceaf0 tx=0x7f20f802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 -- 172.21.15.192:0/3952486046 shutdown_connections 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 --2- 172.21.15.192:0/3952486046 >> v2:172.21.15.194:3300/0 conn(0x7f21080cdb70 0x7f21081618c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2108165420 0x7f21080cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 --2- 172.21.15.192:0/3952486046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108164ee0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 -- 172.21.15.192:0/3952486046 >> 172.21.15.192:0/3952486046 conn(0x7f21080b08f0 msgr2=0x7f21080b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:59.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 -- 172.21.15.192:0/3952486046 shutdown_connections 2024-09-13T18:37:59.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.690+0000 7f210d000640 1 -- 172.21.15.192:0/3952486046 wait complete. 2024-09-13T18:37:59.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.691+0000 7f210d000640 1 Processor -- start 2024-09-13T18:37:59.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.691+0000 7f210d000640 1 -- start start 2024-09-13T18:37:59.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21080cdb70 0x7f210814da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2108165420 0x7f21080712e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2108070e50 con 0x7f2108144150 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210814df90 con 0x7f2108165420 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.692+0000 7f210d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2108070240 con 0x7f21080cdb70 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60804/0 (socket says 172.21.15.192:60804) 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 -- 172.21.15.192:0/2559669642 learned_addr learned my addr 172.21.15.192:0/2559669642 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105e00640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21080cdb70 0x7f210814da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2106800640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2108165420 0x7f21080712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 -- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21080cdb70 msgr2=0x7f210814da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21080cdb70 0x7f210814da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 -- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2108165420 msgr2=0x7f21080712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2108165420 0x7f21080712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 -- 172.21.15.192:0/2559669642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80094d0 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.693+0000 7f2105400640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d620 tx=0x7f20f400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.694+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400b620 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.694+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f400b780 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.694+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f400bb30 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.694+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2108070520 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.694+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2108070ae0 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.695+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2108071000 con 0x7f2108144150 2024-09-13T18:37:59.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.696+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f20f400bc90 con 0x7f2108144150 2024-09-13T18:37:59.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.697+0000 7f20fe000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 0x7f20e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:37:59.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.697+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f20f4089650 con 0x7f2108144150 2024-09-13T18:37:59.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.697+0000 7f2105e00640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 0x7f20e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:37:59.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.697+0000 7f2105e00640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 0x7f20e806d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f20f8034000 tx=0x7f20f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:37:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.701+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2108071000 con 0x7f2108144150 2024-09-13T18:37:59.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.870+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2108144530 con 0x7f2108144150 2024-09-13T18:37:59.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.871+0000 7f20fe000640 1 -- 172.21.15.192:0/2559669642 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f20f40548e0 con 0x7f2108144150 2024-09-13T18:37:59.873 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 msgr2=0x7f20e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 0x7f20e806d0c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f20f8034000 tx=0x7f20f802e000 comp rx=0 tx=0).stop 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 msgr2=0x7f2108142f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d620 tx=0x7f20f400dae0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 shutdown_connections 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f20e806ac00 0x7f20e806d0c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2108165420 0x7f21080712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2108144150 0x7f2108142f20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 --2- 172.21.15.192:0/2559669642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21080cdb70 0x7f210814da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:37:59.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 >> 172.21.15.192:0/2559669642 conn(0x7f21080b08f0 msgr2=0x7f2108163e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:37:59.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 shutdown_connections 2024-09-13T18:37:59.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:37:59.873+0000 7f210d000640 1 -- 172.21.15.192:0/2559669642 wait complete. 2024-09-13T18:37:59.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:00.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.044+0000 7f1749000640 1 Processor -- start 2024-09-13T18:38:00.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.044+0000 7f1749000640 1 -- start start 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.045+0000 7f1749000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17441589f0 0x7f17440b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.045+0000 7f1749000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17440b3af0 0x7f174415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.045+0000 7f1749000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17440b2000 con 0x7f174406c0b0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.045+0000 7f1749000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f174415bbd0 con 0x7f17441589f0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.045+0000 7f1749000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174415beb0 con 0x7f17440b3af0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17441589f0 0x7f17440b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1742800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f174406c0b0 0x7f17440cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48012/0 (socket says 172.21.15.192:48012) 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1742800640 1 -- 172.21.15.192:0/572649184 learned_addr learned my addr 172.21.15.192:0/572649184 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741400640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17440b3af0 0x7f174415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1740a00640 1 -- 172.21.15.192:0/572649184 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365358148 0 0) 0x7f17440b2000 con 0x7f174406c0b0 2024-09-13T18:38:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1740a00640 1 -- 172.21.15.192:0/572649184 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1728003520 con 0x7f174406c0b0 2024-09-13T18:38:00.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741e00640 1 -- 172.21.15.192:0/572649184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17440b3af0 msgr2=0x7f174415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:00.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741e00640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17440b3af0 0x7f174415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741e00640 1 -- 172.21.15.192:0/572649184 >> v1:172.21.15.192:6789/0 conn(0x7f174406c0b0 legacy=0x7f17440cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.046+0000 7f1741e00640 1 -- 172.21.15.192:0/572649184 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f174415c190 con 0x7f17441589f0 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.047+0000 7f1741e00640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17441589f0 0x7f17440b2490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f17340097a0 tx=0x7f173402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa55f5183946dcd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.047+0000 7f1740a00640 1 -- 172.21.15.192:0/572649184 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734032440 con 0x7f17441589f0 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1740a00640 1 -- 172.21.15.192:0/572649184 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17340325a0 con 0x7f17441589f0 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1740a00640 1 -- 172.21.15.192:0/572649184 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1734032930 con 0x7f17441589f0 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 -- 172.21.15.192:0/572649184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17441589f0 msgr2=0x7f17440b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17441589f0 0x7f17440b2490 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f17340097a0 tx=0x7f173402a180 comp rx=0 tx=0).stop 2024-09-13T18:38:00.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 -- 172.21.15.192:0/572649184 shutdown_connections 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17440b3af0 0x7f174415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 --2- 172.21.15.192:0/572649184 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17441589f0 0x7f17440b2490 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 -- 172.21.15.192:0/572649184 >> 172.21.15.192:0/572649184 conn(0x7f17440b08f0 msgr2=0x7f17440b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 -- 172.21.15.192:0/572649184 shutdown_connections 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.048+0000 7f1749000640 1 -- 172.21.15.192:0/572649184 wait complete. 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.050+0000 7f1749000640 1 Processor -- start 2024-09-13T18:38:00.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.050+0000 7f1749000640 1 -- start start 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f174406c0b0 0x7f174414b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17441589f0 0x7f17440cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174414c4d0 con 0x7f17440b3af0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f174414c7b0 con 0x7f17441589f0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1749000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174414ca90 con 0x7f174406c0b0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:60828/0 (socket says 172.21.15.192:60828) 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 -- 172.21.15.192:0/3489638700 learned_addr learned my addr 172.21.15.192:0/3489638700 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741e00640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f174406c0b0 0x7f174414b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1742800640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17441589f0 0x7f17440cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 -- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f174406c0b0 msgr2=0x7f174414b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f174406c0b0 0x7f174414b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 -- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17441589f0 msgr2=0x7f17440cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17441589f0 0x7f17440cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.051+0000 7f1741400640 1 -- 172.21.15.192:0/3489638700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1734009400 con 0x7f17440b3af0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f1741400640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f173000e8b0 tx=0x7f173000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1730009610 con 0x7f17440b3af0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f173000c940 con 0x7f17440b3af0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f174414cd70 con 0x7f17440b3af0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f173000ccf0 con 0x7f17440b3af0 2024-09-13T18:38:00.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.052+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f174414c0a0 con 0x7f17440b3af0 2024-09-13T18:38:00.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.053+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f174415b260 con 0x7f17440b3af0 2024-09-13T18:38:00.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.054+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1730013470 con 0x7f17440b3af0 2024-09-13T18:38:00.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.055+0000 7f173a000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 0x7f172406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.055+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f1730089530 con 0x7f17440b3af0 2024-09-13T18:38:00.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.055+0000 7f1741e00640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 0x7f172406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.056+0000 7f1741e00640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 0x7f172406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1734034000 tx=0x7f173402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.059+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1730054730 con 0x7f17440b3af0 2024-09-13T18:38:00.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.226+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17440cb8f0 con 0x7f17440b3af0 2024-09-13T18:38:00.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.227+0000 7f173a000640 1 -- 172.21.15.192:0/3489638700 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1730057d50 con 0x7f17440b3af0 2024-09-13T18:38:00.229 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:38:00.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 msgr2=0x7f172406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 0x7f172406d0c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1734034000 tx=0x7f173402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 msgr2=0x7f174414bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f173000e8b0 tx=0x7f173000ed70 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 shutdown_connections 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f172406ac00 0x7f172406d0c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17441589f0 0x7f17440cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17440b3af0 0x7f174414bb60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 --2- 172.21.15.192:0/3489638700 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f174406c0b0 0x7f174414b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 >> 172.21.15.192:0/3489638700 conn(0x7f17440b08f0 msgr2=0x7f17440b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 shutdown_connections 2024-09-13T18:38:00.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.229+0000 7f1749000640 1 -- 172.21.15.192:0/3489638700 wait complete. 2024-09-13T18:38:00.247 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:00.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.399+0000 7faf51400640 1 Processor -- start 2024-09-13T18:38:00.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.400+0000 7faf51400640 1 -- start start 2024-09-13T18:38:00.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf51400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf4c0ccbd0 0x7faf4c0b2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf51400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c161e70 0x7faf4c0b0020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf51400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0cb850 con 0x7faf4c0afbe0 2024-09-13T18:38:00.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf51400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c0b2370 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf51400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c162690 con 0x7faf4c161e70 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf4c0ccbd0 0x7faf4c0b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf4c0ccbd0 0x7faf4c0b2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54028/0 (socket says 172.21.15.192:54028) 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 -- 172.21.15.192:0/2424188926 learned_addr learned my addr 172.21.15.192:0/2424188926 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf43400640 1 --1- 172.21.15.192:0/2424188926 >> v1:172.21.15.192:6789/0 conn(0x7faf4c0afbe0 0x7faf4c161760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52192/0 (socket says 172.21.15.192:52192) 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf50a00640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c161e70 0x7faf4c0b0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 -- 172.21.15.192:0/2424188926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c161e70 msgr2=0x7faf4c0b0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c161e70 0x7faf4c0b0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 -- 172.21.15.192:0/2424188926 >> v1:172.21.15.192:6789/0 conn(0x7faf4c0afbe0 legacy=0x7faf4c161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.401+0000 7faf4be00640 1 -- 172.21.15.192:0/2424188926 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c0b0560 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.402+0000 7faf4be00640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0ccbd0 0x7faf4c0b2790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f64a50d738ef670 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf4b400640 1 -- 172.21.15.192:0/2424188926 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c02ae90 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf4b400640 1 -- 172.21.15.192:0/2424188926 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c032440 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf4b400640 1 -- 172.21.15.192:0/2424188926 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c0327d0 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 -- 172.21.15.192:0/2424188926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0ccbd0 msgr2=0x7faf4c0b2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0ccbd0 0x7faf4c0b2790 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c02a140 comp rx=0 tx=0).stop 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 -- 172.21.15.192:0/2424188926 shutdown_connections 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c161e70 0x7faf4c0b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 --2- 172.21.15.192:0/2424188926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0ccbd0 0x7faf4c0b2790 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 -- 172.21.15.192:0/2424188926 >> 172.21.15.192:0/2424188926 conn(0x7faf4c0ae7f0 msgr2=0x7faf4c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 -- 172.21.15.192:0/2424188926 shutdown_connections 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.403+0000 7faf51400640 1 -- 172.21.15.192:0/2424188926 wait complete. 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.405+0000 7faf51400640 1 Processor -- start 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.405+0000 7faf51400640 1 -- start start 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c0ccbd0 0x7faf4c154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4c161e70 0x7faf4c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c153470 con 0x7faf4c0afbe0 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c153750 con 0x7faf4c161e70 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf51400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c153a30 con 0x7faf4c0ccbd0 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf4be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf4be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54040/0 (socket says 172.21.15.192:54040) 2024-09-13T18:38:00.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf4be00640 1 -- 172.21.15.192:0/4157116768 learned_addr learned my addr 172.21.15.192:0/4157116768 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf50a00640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4c161e70 0x7faf4c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.406+0000 7faf43400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c0ccbd0 0x7faf4c154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 -- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c0ccbd0 msgr2=0x7faf4c154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c0ccbd0 0x7faf4c154a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 -- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4c161e70 msgr2=0x7faf4c154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4c161e70 0x7faf4c154f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 -- 172.21.15.192:0/4157116768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c0094d0 con 0x7faf4c0afbe0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf4be00640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c030850 con 0x7faf4c0afbe0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c0309b0 con 0x7faf4c0afbe0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c030d60 con 0x7faf4c0afbe0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c153d10 con 0x7faf4c0afbe0 2024-09-13T18:38:00.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.407+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c152460 con 0x7faf4c0afbe0 2024-09-13T18:38:00.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.408+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c153b70 con 0x7faf4c0afbe0 2024-09-13T18:38:00.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.409+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf3c039040 con 0x7faf4c0afbe0 2024-09-13T18:38:00.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.410+0000 7faf48c00640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 0x7faf2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.410+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7faf3c0a9ed0 con 0x7faf4c0afbe0 2024-09-13T18:38:00.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.410+0000 7faf43400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 0x7faf2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.411+0000 7faf43400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 0x7faf2806d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf4c1527e0 tx=0x7faf34007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.414+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf4c153b70 con 0x7faf4c0afbe0 2024-09-13T18:38:00.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.581+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faf4c153b70 con 0x7faf4c0afbe0 2024-09-13T18:38:00.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.582+0000 7faf48c00640 1 -- 172.21.15.192:0/4157116768 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7faf4c153b70 con 0x7faf4c0afbe0 2024-09-13T18:38:00.583 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:38:00.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 msgr2=0x7faf2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 0x7faf2806d0c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7faf4c1527e0 tx=0x7faf34007c80 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 msgr2=0x7faf4c151f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7faf3c000c00 tx=0x7faf3c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 shutdown_connections 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf2806ac00 0x7faf2806d0c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf4c161e70 0x7faf4c154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf4c0ccbd0 0x7faf4c154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 --2- 172.21.15.192:0/4157116768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf4c0afbe0 0x7faf4c151f20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 >> 172.21.15.192:0/4157116768 conn(0x7faf4c0ae7f0 msgr2=0x7faf4c15f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 shutdown_connections 2024-09-13T18:38:00.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.584+0000 7faf51400640 1 -- 172.21.15.192:0/4157116768 wait complete. 2024-09-13T18:38:00.602 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:38:00.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.753+0000 7efd63600640 1 Processor -- start 2024-09-13T18:38:00.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.753+0000 7efd63600640 1 -- start start 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.754+0000 7efd63600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd5c071810 0x7efd5c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.754+0000 7efd63600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efd5c0b2230 0x7efd5c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.754+0000 7efd63600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd5c071dd0 con 0x7efd5c150480 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.754+0000 7efd63600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0cb770 con 0x7efd5c0b2230 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.754+0000 7efd63600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd5c0cba50 con 0x7efd5c071810 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efd5c0b2230 0x7efd5c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efd5c0b2230 0x7efd5c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54044/0 (socket says 172.21.15.192:54044) 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 -- 172.21.15.192:0/2999204412 learned_addr learned my addr 172.21.15.192:0/2999204412 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd5be00640 1 --2- 172.21.15.192:0/2999204412 >> v2:172.21.15.194:3300/0 conn(0x7efd5c071810 0x7efd5c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 -- 172.21.15.192:0/2999204412 >> v2:172.21.15.194:3300/0 conn(0x7efd5c071810 msgr2=0x7efd5c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:00.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 --2- 172.21.15.192:0/2999204412 >> v2:172.21.15.194:3300/0 conn(0x7efd5c071810 0x7efd5c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 -- 172.21.15.192:0/2999204412 >> v1:172.21.15.194:6789/0 conn(0x7efd5c150480 legacy=0x7efd5c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.755+0000 7efd61600640 1 -- 172.21.15.192:0/2999204412 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0cbd30 con 0x7efd5c0b2230 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.756+0000 7efd61600640 1 --2- 172.21.15.192:0/2999204412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c0b2230 0x7efd5c0cc530 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06cb50 tx=0x7efd5402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60fc4b21a36187e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.756+0000 7efd5b400640 1 -- 172.21.15.192:0/2999204412 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54031600 con 0x7efd5c0b2230 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.756+0000 7efd5b400640 1 -- 172.21.15.192:0/2999204412 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd5402d050 con 0x7efd5c0b2230 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.756+0000 7efd5b400640 1 -- 172.21.15.192:0/2999204412 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54031980 con 0x7efd5c0b2230 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 -- 172.21.15.192:0/2999204412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c0b2230 msgr2=0x7efd5c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 --2- 172.21.15.192:0/2999204412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c0b2230 0x7efd5c0cc530 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06cb50 tx=0x7efd5402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 -- 172.21.15.192:0/2999204412 shutdown_connections 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 --2- 172.21.15.192:0/2999204412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c0b2230 0x7efd5c0cc530 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 --2- 172.21.15.192:0/2999204412 >> v2:172.21.15.194:3300/0 conn(0x7efd5c071810 0x7efd5c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 -- 172.21.15.192:0/2999204412 >> 172.21.15.192:0/2999204412 conn(0x7efd5c0ae960 msgr2=0x7efd5c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 -- 172.21.15.192:0/2999204412 shutdown_connections 2024-09-13T18:38:00.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.757+0000 7efd63600640 1 -- 172.21.15.192:0/2999204412 wait complete. 2024-09-13T18:38:00.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.759+0000 7efd63600640 1 Processor -- start 2024-09-13T18:38:00.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.759+0000 7efd63600640 1 -- start start 2024-09-13T18:38:00.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 0x7efd5c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 0x7efd5c06a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c1492e0 con 0x7efd5c071810 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c14dfb0 con 0x7efd5c0b2230 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd63600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5c14e290 con 0x7efd5c150480 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54060/0 (socket says 172.21.15.192:54060) 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 -- 172.21.15.192:0/51799085 learned_addr learned my addr 172.21.15.192:0/51799085 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd5be00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 0x7efd5c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd61600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 0x7efd5c06a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 -- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 msgr2=0x7efd5c06a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 0x7efd5c06a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 -- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 msgr2=0x7efd5c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 0x7efd5c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd60c00640 1 -- 172.21.15.192:0/51799085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd54009b30 con 0x7efd5c071810 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd61600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 0x7efd5c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.760+0000 7efd5be00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 0x7efd5c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd60c00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500052d0 con 0x7efd5c071810 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd50005430 con 0x7efd5c071810 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd50003830 con 0x7efd5c071810 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd5c14e570 con 0x7efd5c071810 2024-09-13T18:38:00.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.761+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5c148a90 con 0x7efd5c071810 2024-09-13T18:38:00.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.762+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd5c06fcd0 con 0x7efd5c071810 2024-09-13T18:38:00.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.763+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd50003990 con 0x7efd5c071810 2024-09-13T18:38:00.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.764+0000 7efd58c00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 0x7efd3c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:00.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.764+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7efd500889f0 con 0x7efd5c071810 2024-09-13T18:38:00.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.764+0000 7efd5be00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 0x7efd3c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:00.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.765+0000 7efd5be00640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 0x7efd3c06d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06f9c0 tx=0x7efd48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:00.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.768+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd5c06fcd0 con 0x7efd5c071810 2024-09-13T18:38:00.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.950+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efd5c06fcd0 con 0x7efd5c071810 2024-09-13T18:38:00.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.951+0000 7efd58c00640 1 -- 172.21.15.192:0/51799085 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v59) v1 ==== 80+0+0 (secure 0 0 0) 0x7efd5c06fcd0 con 0x7efd5c071810 2024-09-13T18:38:00.952 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.952+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 msgr2=0x7efd3c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.952+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 0x7efd3c06d0c0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7efd5c06f9c0 tx=0x7efd48008040 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.952+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 msgr2=0x7efd5c148da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.952+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7efd5000c400 tx=0x7efd5000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 shutdown_connections 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3c06ac00 0x7efd3c06d0c0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd5c150480 0x7efd5c06a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5c0b2230 0x7efd5c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 --2- 172.21.15.192:0/51799085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5c071810 0x7efd5c148da0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 >> 172.21.15.192:0/51799085 conn(0x7efd5c0ae960 msgr2=0x7efd5c0af560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 shutdown_connections 2024-09-13T18:38:00.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:00.953+0000 7efd63600640 1 -- 172.21.15.192:0/51799085 wait complete. 2024-09-13T18:38:00.970 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:38:00.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:00.970 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:01.038 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:38:01.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:01.039 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:38:01.076 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:38:01.076 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:01.111 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:38:01.111 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:38:01.112 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:01.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:38:01.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:01.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.301+0000 7fc6bb200640 1 Processor -- start 2024-09-13T18:38:01.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.301+0000 7fc6bb200640 1 -- start start 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.302+0000 7fc6bb200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6b40b2780 0x7fc6b40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.302+0000 7fc6bb200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc6b40afd80 0x7fc6b40b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.302+0000 7fc6bb200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6b40ae770 con 0x7fc6b4146610 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.302+0000 7fc6bb200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40cd920 con 0x7fc6b40b2780 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.302+0000 7fc6bb200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6b40b0730 con 0x7fc6b40afd80 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6b40b2780 0x7fc6b40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6b40b2780 0x7fc6b40ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54074/0 (socket says 172.21.15.192:54074) 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 -- 172.21.15.192:0/2893375590 learned_addr learned my addr 172.21.15.192:0/2893375590 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:01.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3e00640 1 --1- 172.21.15.192:0/2893375590 >> v1:172.21.15.192:6789/0 conn(0x7fc6b4146610 0x7fc6b40ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52194/0 (socket says 172.21.15.192:52194) 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b9200640 1 --2- 172.21.15.192:0/2893375590 >> v2:172.21.15.194:3300/0 conn(0x7fc6b40afd80 0x7fc6b40b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 -- 172.21.15.192:0/2893375590 >> v2:172.21.15.194:3300/0 conn(0x7fc6b40afd80 msgr2=0x7fc6b40b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 --2- 172.21.15.192:0/2893375590 >> v2:172.21.15.194:3300/0 conn(0x7fc6b40afd80 0x7fc6b40b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 -- 172.21.15.192:0/2893375590 >> v1:172.21.15.192:6789/0 conn(0x7fc6b4146610 legacy=0x7fc6b40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b3400640 1 -- 172.21.15.192:0/2893375590 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b40cdb30 con 0x7fc6b40b2780 2024-09-13T18:38:01.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.303+0000 7fc6b2a00640 1 -- 172.21.15.192:0/2893375590 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 995416151 0 0) 0x7fc6b40ae770 con 0x7fc6b4146610 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.304+0000 7fc6b3400640 1 --2- 172.21.15.192:0/2893375590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b40ad840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009870 tx=0x7fc6a002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=769d9a846fa239b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.304+0000 7fc6b2a00640 1 -- 172.21.15.192:0/2893375590 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0032440 con 0x7fc6b40b2780 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.304+0000 7fc6b2a00640 1 -- 172.21.15.192:0/2893375590 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a00325a0 con 0x7fc6b40b2780 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.304+0000 7fc6b2a00640 1 -- 172.21.15.192:0/2893375590 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0032930 con 0x7fc6b40b2780 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 -- 172.21.15.192:0/2893375590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 msgr2=0x7fc6b40ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 --2- 172.21.15.192:0/2893375590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b40ad840 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0009870 tx=0x7fc6a002a210 comp rx=0 tx=0).stop 2024-09-13T18:38:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 -- 172.21.15.192:0/2893375590 shutdown_connections 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 --2- 172.21.15.192:0/2893375590 >> v2:172.21.15.194:3300/0 conn(0x7fc6b40afd80 0x7fc6b40b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 --2- 172.21.15.192:0/2893375590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b40ad840 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 -- 172.21.15.192:0/2893375590 >> 172.21.15.192:0/2893375590 conn(0x7fc6b40ae960 msgr2=0x7fc6b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 -- 172.21.15.192:0/2893375590 shutdown_connections 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.305+0000 7fc6bb200640 1 -- 172.21.15.192:0/2893375590 wait complete. 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.307+0000 7fc6bb200640 1 Processor -- start 2024-09-13T18:38:01.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.307+0000 7fc6bb200640 1 -- start start 2024-09-13T18:38:01.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 0x7fc6b4156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4146610 0x7fc6b41588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4136fe0 con 0x7fc6b40b2780 2024-09-13T18:38:01.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b4156da0 con 0x7fc6b4146610 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6bb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b406fe90 con 0x7fc6b40afd80 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54090/0 (socket says 172.21.15.192:54090) 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 -- 172.21.15.192:0/3535570689 learned_addr learned my addr 172.21.15.192:0/3535570689 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b9200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4146610 0x7fc6b41588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3e00640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 0x7fc6b4156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 -- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 msgr2=0x7fc6b4156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 0x7fc6b4156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 -- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4146610 msgr2=0x7fc6b41588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4146610 0x7fc6b41588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3400640 1 -- 172.21.15.192:0/3535570689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a00094d0 con 0x7fc6b40b2780 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.308+0000 7fc6b3e00640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 0x7fc6b4156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6b3400640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000c00 tx=0x7fc6a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0032440 con 0x7fc6b40b2780 2024-09-13T18:38:01.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a0004230 con 0x7fc6b40b2780 2024-09-13T18:38:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0030980 con 0x7fc6b40b2780 2024-09-13T18:38:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6b4070170 con 0x7fc6b40b2780 2024-09-13T18:38:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.309+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6b4070730 con 0x7fc6b40b2780 2024-09-13T18:38:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.310+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6b40cc960 con 0x7fc6b40b2780 2024-09-13T18:38:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.311+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6a0030ae0 con 0x7fc6b40b2780 2024-09-13T18:38:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.312+0000 7fc6abe00640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 0x7fc69406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.312+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fc6a00aa760 con 0x7fc6b40b2780 2024-09-13T18:38:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.312+0000 7fc6b3e00640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 0x7fc69406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.312+0000 7fc6b3e00640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 0x7fc69406d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000f60 tx=0x7fc6a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.316+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6a0075930 con 0x7fc6b40b2780 2024-09-13T18:38:01.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.518+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc6b40b01f0 con 0x7fc6b40b2780 2024-09-13T18:38:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.518+0000 7fc6abe00640 1 -- 172.21.15.192:0/3535570689 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fc6a0078f50 con 0x7fc6b40b2780 2024-09-13T18:38:01.520 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:01.520 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:38:01.521 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 msgr2=0x7fc69406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 0x7fc69406d0c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc6a4000f60 tx=0x7fc6a4009040 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 msgr2=0x7fc6b4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0000c00 tx=0x7fc6a00046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 shutdown_connections 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc69406ac00 0x7fc69406d0c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4146610 0x7fc6b41588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40b2780 0x7fc6b4071210 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 --2- 172.21.15.192:0/3535570689 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b40afd80 0x7fc6b4156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 >> 172.21.15.192:0/3535570689 conn(0x7fc6b40ae960 msgr2=0x7fc6b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:01.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 shutdown_connections 2024-09-13T18:38:01.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.521+0000 7fc6bb200640 1 -- 172.21.15.192:0/3535570689 wait complete. 2024-09-13T18:38:01.538 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:01.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.688+0000 7f563da00640 1 Processor -- start 2024-09-13T18:38:01.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.688+0000 7f563da00640 1 -- start start 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.689+0000 7f563da00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.689+0000 7f563da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.689+0000 7f563da00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56380b2f00 con 0x7f56380b3f10 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.689+0000 7f563da00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56380b3150 con 0x7f563815dee0 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.689+0000 7f563da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56380b3430 con 0x7f563815e2c0 2024-09-13T18:38:01.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5636a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:34880/0 (socket says 172.21.15.192:34880) 2024-09-13T18:38:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 -- 172.21.15.192:0/4010855452 learned_addr learned my addr 172.21.15.192:0/4010855452 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5636a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:47314/0 (socket says 172.21.15.192:47314) 2024-09-13T18:38:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 -- 172.21.15.192:0/4010855452 >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 msgr2=0x7f56380afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 --2- 172.21.15.192:0/4010855452 >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 -- 172.21.15.192:0/4010855452 >> v1:172.21.15.194:6789/0 conn(0x7f56380b3f10 legacy=0x7f563815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5637400640 1 -- 172.21.15.192:0/4010855452 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56380b3710 con 0x7f563815e2c0 2024-09-13T18:38:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.690+0000 7f5636a00640 1 --2- 172.21.15.192:0/4010855452 >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.691+0000 7f5637400640 1 --2- 172.21.15.192:0/4010855452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5630009e50 tx=0x7f563002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fbf373e668c4bf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.691+0000 7f5635600640 1 -- 172.21.15.192:0/4010855452 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630031600 con 0x7f563815e2c0 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.691+0000 7f5635600640 1 -- 172.21.15.192:0/4010855452 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563002d050 con 0x7f563815e2c0 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.691+0000 7f5635600640 1 -- 172.21.15.192:0/4010855452 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5630031980 con 0x7f563815e2c0 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 -- 172.21.15.192:0/4010855452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 msgr2=0x7f563815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 --2- 172.21.15.192:0/4010855452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5630009e50 tx=0x7f563002a710 comp rx=0 tx=0).stop 2024-09-13T18:38:01.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 -- 172.21.15.192:0/4010855452 shutdown_connections 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 --2- 172.21.15.192:0/4010855452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f563815e2c0 0x7f563815ab50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 --2- 172.21.15.192:0/4010855452 >> v2:172.21.15.194:3300/0 conn(0x7f563815dee0 0x7f56380afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 -- 172.21.15.192:0/4010855452 >> 172.21.15.192:0/4010855452 conn(0x7f56380ae960 msgr2=0x7f563806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 -- 172.21.15.192:0/4010855452 shutdown_connections 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.692+0000 7f563da00640 1 -- 172.21.15.192:0/4010855452 wait complete. 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.694+0000 7f563da00640 1 Processor -- start 2024-09-13T18:38:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.694+0000 7f563da00640 1 -- start start 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 0x7f5638164460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5638139680 0x7f5638152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5638139510 con 0x7f563815e2c0 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5638152950 con 0x7f563815dee0 2024-09-13T18:38:01.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f563da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5638152060 con 0x7f5638139680 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54104/0 (socket says 172.21.15.192:54104) 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 -- 172.21.15.192:0/1759540006 learned_addr learned my addr 172.21.15.192:0/1759540006 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5637400640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5638139680 0x7f5638152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636a00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 0x7f5638164460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 -- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5638139680 msgr2=0x7f5638152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5638139680 0x7f5638152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 -- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 msgr2=0x7f5638164460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 0x7f5638164460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636000640 1 -- 172.21.15.192:0/1759540006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628009400 con 0x7f563815e2c0 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.695+0000 7f5636a00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 0x7f5638164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f5636000640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f562400c400 tx=0x7f562400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56240052d0 con 0x7f563815e2c0 2024-09-13T18:38:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5624005430 con 0x7f563815e2c0 2024-09-13T18:38:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5624003830 con 0x7f563815e2c0 2024-09-13T18:38:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5630009b30 con 0x7f563815e2c0 2024-09-13T18:38:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.696+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56381525e0 con 0x7f563815e2c0 2024-09-13T18:38:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.697+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56381527a0 con 0x7f563815e2c0 2024-09-13T18:38:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.698+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5624003990 con 0x7f563815e2c0 2024-09-13T18:38:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.699+0000 7f562ea00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 0x7f561806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.699+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f5624088970 con 0x7f563815e2c0 2024-09-13T18:38:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.699+0000 7f5636a00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 0x7f561806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.700+0000 7f5636a00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 0x7f561806d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5628009d20 tx=0x7f5628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:01.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.703+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5624053ae0 con 0x7f563815e2c0 2024-09-13T18:38:01.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.873+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5638152ac0 con 0x7f563815e2c0 2024-09-13T18:38:01.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.875+0000 7f562ea00640 1 -- 172.21.15.192:0/1759540006 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f5624017020 con 0x7f563815e2c0 2024-09-13T18:38:01.877 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:01.877 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":59,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:51.664800+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.15","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":0}]},{"pgid":"7.33","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 msgr2=0x7f561806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 0x7f561806d0f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5628009d20 tx=0x7f5628008040 comp rx=0 tx=0).stop 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 msgr2=0x7f5638138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f562400c400 tx=0x7f562400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 shutdown_connections 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f561806ac30 0x7f561806d0f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5638139680 0x7f5638152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f563815e2c0 0x7f5638138fd0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 --2- 172.21.15.192:0/1759540006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f563815dee0 0x7f5638164460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:01.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 >> 172.21.15.192:0/1759540006 conn(0x7f56380ae960 msgr2=0x7f5638069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:01.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 shutdown_connections 2024-09-13T18:38:01.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:01.877+0000 7f563da00640 1 -- 172.21.15.192:0/1759540006 wait complete. 2024-09-13T18:38:01.896 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:37:20.953486+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:37:21.953576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:38:01.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:02.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.051+0000 7f3892400640 1 Processor -- start 2024-09-13T18:38:02.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.051+0000 7f3892400640 1 -- start start 2024-09-13T18:38:02.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f3892400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f388c0b2600 0x7f388c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f3892400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 0x7f388c0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f3892400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f388c0ae1d0 con 0x7f388c15a910 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f3892400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c0b21e0 con 0x7f388c0b2600 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f3892400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f388c0b1bf0 con 0x7f388c0add80 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f388b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f388c15a910 0x7f388c160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52196/0 (socket says 172.21.15.192:52196) 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f388b400640 1 -- 172.21.15.192:0/3646137438 learned_addr learned my addr 172.21.15.192:0/3646137438 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.052+0000 7f388aa00640 1 --2- 172.21.15.192:0/3646137438 >> v2:172.21.15.192:3300/0 conn(0x7f388c0b2600 0x7f388c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388be00640 1 --2- 172.21.15.192:0/3646137438 >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 0x7f388c0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388aa00640 1 -- 172.21.15.192:0/3646137438 >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 msgr2=0x7f388c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388aa00640 1 --2- 172.21.15.192:0/3646137438 >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 0x7f388c0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388aa00640 1 -- 172.21.15.192:0/3646137438 >> v1:172.21.15.192:6789/0 conn(0x7f388c15a910 legacy=0x7f388c160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388aa00640 1 -- 172.21.15.192:0/3646137438 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f388c161510 con 0x7f388c0b2600 2024-09-13T18:38:02.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388a000640 1 -- 172.21.15.192:0/3646137438 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801173625 0 0) 0x7f387c001110 con 0x7f388c15a910 2024-09-13T18:38:02.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.053+0000 7f388be00640 1 --2- 172.21.15.192:0/3646137438 >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 0x7f388c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.054+0000 7f388aa00640 1 --2- 172.21.15.192:0/3646137438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c0ad840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ce2e0 tx=0x7f387802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8a2ccb34dedd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.054+0000 7f388a000640 1 -- 172.21.15.192:0/3646137438 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387802ae60 con 0x7f388c0b2600 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.054+0000 7f388a000640 1 -- 172.21.15.192:0/3646137438 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3878032440 con 0x7f388c0b2600 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.054+0000 7f388a000640 1 -- 172.21.15.192:0/3646137438 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780327d0 con 0x7f388c0b2600 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 -- 172.21.15.192:0/3646137438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 msgr2=0x7f388c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 --2- 172.21.15.192:0/3646137438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c0ad840 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f388c0ce2e0 tx=0x7f387802a110 comp rx=0 tx=0).stop 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 -- 172.21.15.192:0/3646137438 shutdown_connections 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 --2- 172.21.15.192:0/3646137438 >> v2:172.21.15.194:3300/0 conn(0x7f388c0add80 0x7f388c0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 --2- 172.21.15.192:0/3646137438 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c0ad840 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 -- 172.21.15.192:0/3646137438 >> 172.21.15.192:0/3646137438 conn(0x7f388c0b08f0 msgr2=0x7f388c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 -- 172.21.15.192:0/3646137438 shutdown_connections 2024-09-13T18:38:02.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.055+0000 7f3892400640 1 -- 172.21.15.192:0/3646137438 wait complete. 2024-09-13T18:38:02.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.056+0000 7f3892400640 1 Processor -- start 2024-09-13T18:38:02.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 -- start start 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f388c0add80 0x7f388c1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f388c15a910 0x7f388c15fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c155f00 con 0x7f388c0b2600 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f388c06ea50 con 0x7f388c0add80 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.057+0000 7f3892400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f388c06ed30 con 0x7f388c15a910 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54130/0 (socket says 172.21.15.192:54130) 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 -- 172.21.15.192:0/2305819894 learned_addr learned my addr 172.21.15.192:0/2305819894 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388b400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f388c0add80 0x7f388c1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388be00640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f388c15a910 0x7f388c15fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 -- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f388c15a910 msgr2=0x7f388c15fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f388c15a910 0x7f388c15fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 -- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f388c0add80 msgr2=0x7f388c1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f388c0add80 0x7f388c1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.058+0000 7f388aa00640 1 -- 172.21.15.192:0/2305819894 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3878009400 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f388aa00640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c00 tx=0x7f38780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3878004030 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780041b0 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387803d630 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f388c06f010 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.059+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f388c06a680 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.060+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f388c0b3ab0 con 0x7f388c0b2600 2024-09-13T18:38:02.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.061+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f387803d790 con 0x7f388c0b2600 2024-09-13T18:38:02.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.062+0000 7f3883400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 0x7f386c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.062+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f38780a9ee0 con 0x7f388c0b2600 2024-09-13T18:38:02.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.062+0000 7f388b400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 0x7f386c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.062+0000 7f388b400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 0x7f386c06d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f387c007fd0 tx=0x7f387c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.066+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3878075170 con 0x7f388c0b2600 2024-09-13T18:38:02.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.233+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f388c0cf6b0 con 0x7f388c0b2600 2024-09-13T18:38:02.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.234+0000 7f3883400640 1 -- 172.21.15.192:0/2305819894 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3878037020 con 0x7f388c0b2600 2024-09-13T18:38:02.236 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 msgr2=0x7f386c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 0x7f386c06d0c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f387c007fd0 tx=0x7f387c007de0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 msgr2=0x7f388c15f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3878000c00 tx=0x7f38780046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 shutdown_connections 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f386c06ac00 0x7f386c06d0c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f388c15a910 0x7f388c15fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f388c0b2600 0x7f388c15f6b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 --2- 172.21.15.192:0/2305819894 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f388c0add80 0x7f388c1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 >> 172.21.15.192:0/2305819894 conn(0x7f388c0b08f0 msgr2=0x7f388c1566d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 shutdown_connections 2024-09-13T18:38:02.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.236+0000 7f3892400640 1 -- 172.21.15.192:0/2305819894 wait complete. 2024-09-13T18:38:02.254 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:38:02.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.407+0000 7f59f6800640 1 Processor -- start 2024-09-13T18:38:02.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.407+0000 7f59f6800640 1 -- start start 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59f6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59f01589f0 0x7f59f00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59f6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f59f006c0b0 0x7f59f006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59f6800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00b2000 con 0x7f59f00b3af0 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59f6800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f006ca30 con 0x7f59f01589f0 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59f6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f015b970 con 0x7f59f006c0b0 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.408+0000 7f59ef400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59f01589f0 0x7f59f00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59f01589f0 0x7f59f00b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54136/0 (socket says 172.21.15.192:54136) 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 -- 172.21.15.192:0/556379545 learned_addr learned my addr 172.21.15.192:0/556379545 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59efe00640 1 --2- 172.21.15.192:0/556379545 >> v2:172.21.15.194:3300/0 conn(0x7f59f006c0b0 0x7f59f006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 -- 172.21.15.192:0/556379545 >> v2:172.21.15.194:3300/0 conn(0x7f59f006c0b0 msgr2=0x7f59f006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:02.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 --2- 172.21.15.192:0/556379545 >> v2:172.21.15.194:3300/0 conn(0x7f59f006c0b0 0x7f59f006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 -- 172.21.15.192:0/556379545 >> v1:172.21.15.194:6789/0 conn(0x7f59f00b3af0 legacy=0x7f59f015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:02.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.409+0000 7f59ef400640 1 -- 172.21.15.192:0/556379545 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f015bbd0 con 0x7f59f01589f0 2024-09-13T18:38:02.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.410+0000 7f59ef400640 1 --2- 172.21.15.192:0/556379545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f01589f0 0x7f59f00b2490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59f00cb890 tx=0x7f59e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221700eb201f2b32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.410+0000 7f59ee000640 1 -- 172.21.15.192:0/556379545 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0032440 con 0x7f59f01589f0 2024-09-13T18:38:02.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.410+0000 7f59ee000640 1 -- 172.21.15.192:0/556379545 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e00325a0 con 0x7f59f01589f0 2024-09-13T18:38:02.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.410+0000 7f59ee000640 1 -- 172.21.15.192:0/556379545 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0032930 con 0x7f59f01589f0 2024-09-13T18:38:02.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 -- 172.21.15.192:0/556379545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f01589f0 msgr2=0x7f59f00b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 --2- 172.21.15.192:0/556379545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f01589f0 0x7f59f00b2490 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59f00cb890 tx=0x7f59e002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 -- 172.21.15.192:0/556379545 shutdown_connections 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 --2- 172.21.15.192:0/556379545 >> v2:172.21.15.194:3300/0 conn(0x7f59f006c0b0 0x7f59f006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 --2- 172.21.15.192:0/556379545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f01589f0 0x7f59f00b2490 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 -- 172.21.15.192:0/556379545 >> 172.21.15.192:0/556379545 conn(0x7f59f00b08f0 msgr2=0x7f59f00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 -- 172.21.15.192:0/556379545 shutdown_connections 2024-09-13T18:38:02.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.411+0000 7f59f6800640 1 -- 172.21.15.192:0/556379545 wait complete. 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.412+0000 7f59f6800640 1 Processor -- start 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.413+0000 7f59f6800640 1 -- start start 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.413+0000 7f59f6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.413+0000 7f59f6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59f00b3af0 0x7f59f0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.413+0000 7f59f6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59f01589f0 0x7f59f0159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59f6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f01f1ad0 con 0x7f59f006c0b0 2024-09-13T18:38:02.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59f6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f014ed90 con 0x7f59f00b3af0 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59f6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f01f17f0 con 0x7f59f01589f0 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54146/0 (socket says 172.21.15.192:54146) 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 -- 172.21.15.192:0/1683576671 learned_addr learned my addr 172.21.15.192:0/1683576671 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59efe00640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59f01589f0 0x7f59f0159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59eea00640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59f00b3af0 0x7f59f0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 -- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59f01589f0 msgr2=0x7f59f0159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59f01589f0 0x7f59f0159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 -- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59f00b3af0 msgr2=0x7f59f0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59f00b3af0 0x7f59f0159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.414+0000 7f59ef400640 1 -- 172.21.15.192:0/1683576671 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e00094d0 con 0x7f59f006c0b0 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59ef400640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f59e002a1e0 tx=0x7f59e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0032440 con 0x7f59f006c0b0 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0030ba0 con 0x7f59f006c0b0 2024-09-13T18:38:02.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f00ac5c0 con 0x7f59f006c0b0 2024-09-13T18:38:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e003d440 con 0x7f59f006c0b0 2024-09-13T18:38:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.415+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f00acb80 con 0x7f59f006c0b0 2024-09-13T18:38:02.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.416+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f00ac420 con 0x7f59f006c0b0 2024-09-13T18:38:02.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.417+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f59e0039040 con 0x7f59f006c0b0 2024-09-13T18:38:02.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.417+0000 7f59e7400640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 0x7f59d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.418+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f59e00a9e80 con 0x7f59f006c0b0 2024-09-13T18:38:02.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.418+0000 7f59eea00640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 0x7f59d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.418+0000 7f59eea00640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 0x7f59d006d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59dc004f60 tx=0x7f59dc007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.422+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f59f00ac420 con 0x7f59f006c0b0 2024-09-13T18:38:02.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.591+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f59f00ac420 con 0x7f59f006c0b0 2024-09-13T18:38:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.591+0000 7f59e7400640 1 -- 172.21.15.192:0/1683576671 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v59) v1 ==== 104+0+11 (secure 0 0 0) 0x7f59f00ac420 con 0x7f59f006c0b0 2024-09-13T18:38:02.641 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.593+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 msgr2=0x7f59d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.593+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 0x7f59d006d0c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59dc004f60 tx=0x7f59dc007e30 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.593+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 msgr2=0x7f59f014e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.593+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f59e002a1e0 tx=0x7f59e00046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 shutdown_connections 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f59d006ac00 0x7f59d006d0c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f59f01589f0 0x7f59f0159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59f00b3af0 0x7f59f0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 --2- 172.21.15.192:0/1683576671 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59f006c0b0 0x7f59f014e850 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 >> 172.21.15.192:0/1683576671 conn(0x7f59f00b08f0 msgr2=0x7f59f0071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 shutdown_connections 2024-09-13T18:38:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.594+0000 7f59f6800640 1 -- 172.21.15.192:0/1683576671 wait complete. 2024-09-13T18:38:02.644 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:38:02.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.798+0000 7f55f1400640 1 Processor -- start 2024-09-13T18:38:02.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.798+0000 7f55f1400640 1 -- start start 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55f1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55ec0b2600 0x7f55ec0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55f1400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f55ec0add80 0x7f55ec0cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55f1400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55ec0ae1d0 con 0x7f55ec15a910 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55f1400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0b21e0 con 0x7f55ec0b2600 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55f1400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55ec0b1bf0 con 0x7f55ec0add80 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55ea800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f55ec15a910 0x7f55ec160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52204/0 (socket says 172.21.15.192:52204) 2024-09-13T18:38:02.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55ea800640 1 -- 172.21.15.192:0/3643908421 learned_addr learned my addr 172.21.15.192:0/3643908421 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.799+0000 7f55e9e00640 1 --2- 172.21.15.192:0/3643908421 >> v2:172.21.15.192:3300/0 conn(0x7f55ec0b2600 0x7f55ec0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.800+0000 7f55eb200640 1 --2- 172.21.15.192:0/3643908421 >> v2:172.21.15.194:3300/0 conn(0x7f55ec0add80 0x7f55ec0cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.800+0000 7f55e9e00640 1 -- 172.21.15.192:0/3643908421 >> v2:172.21.15.194:3300/0 conn(0x7f55ec0add80 msgr2=0x7f55ec0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.800+0000 7f55e9e00640 1 --2- 172.21.15.192:0/3643908421 >> v2:172.21.15.194:3300/0 conn(0x7f55ec0add80 0x7f55ec0cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.800+0000 7f55e9e00640 1 -- 172.21.15.192:0/3643908421 >> v1:172.21.15.192:6789/0 conn(0x7f55ec15a910 legacy=0x7f55ec160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.800+0000 7f55e9e00640 1 -- 172.21.15.192:0/3643908421 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec161510 con 0x7f55ec0b2600 2024-09-13T18:38:02.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.801+0000 7f55e9e00640 1 --2- 172.21.15.192:0/3643908421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec0b2600 0x7f55ec0ad840 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ce2e0 tx=0x7f55d802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ee4de320be00a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.801+0000 7f55e9400640 1 -- 172.21.15.192:0/3643908421 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d802ae60 con 0x7f55ec0b2600 2024-09-13T18:38:02.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.801+0000 7f55e9400640 1 -- 172.21.15.192:0/3643908421 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8032440 con 0x7f55ec0b2600 2024-09-13T18:38:02.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.801+0000 7f55e9400640 1 -- 172.21.15.192:0/3643908421 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80327d0 con 0x7f55ec0b2600 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 -- 172.21.15.192:0/3643908421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec0b2600 msgr2=0x7f55ec0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 --2- 172.21.15.192:0/3643908421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec0b2600 0x7f55ec0ad840 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ce2e0 tx=0x7f55d802a110 comp rx=0 tx=0).stop 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 -- 172.21.15.192:0/3643908421 shutdown_connections 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 --2- 172.21.15.192:0/3643908421 >> v2:172.21.15.194:3300/0 conn(0x7f55ec0add80 0x7f55ec0cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 --2- 172.21.15.192:0/3643908421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec0b2600 0x7f55ec0ad840 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 -- 172.21.15.192:0/3643908421 >> 172.21.15.192:0/3643908421 conn(0x7f55ec0b08f0 msgr2=0x7f55ec0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 -- 172.21.15.192:0/3643908421 shutdown_connections 2024-09-13T18:38:02.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.802+0000 7f55f1400640 1 -- 172.21.15.192:0/3643908421 wait complete. 2024-09-13T18:38:02.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.803+0000 7f55f1400640 1 Processor -- start 2024-09-13T18:38:02.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 -- start start 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55ec0add80 0x7f55ec15ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ec0b2600 0x7f55ec1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec15a1e0 con 0x7f55ec15a910 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec1517e0 con 0x7f55ec0b2600 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.804+0000 7f55f1400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55ec158b80 con 0x7f55ec0add80 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54154/0 (socket says 172.21.15.192:54154) 2024-09-13T18:38:02.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 -- 172.21.15.192:0/3170713428 learned_addr learned my addr 172.21.15.192:0/3170713428 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55e9e00640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ec0b2600 0x7f55ec1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55ea800640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55ec0add80 0x7f55ec15ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 -- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55ec0add80 msgr2=0x7f55ec15ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55ec0add80 0x7f55ec15ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 -- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ec0b2600 msgr2=0x7f55ec1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ec0b2600 0x7f55ec1512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.805+0000 7f55eb200640 1 -- 172.21.15.192:0/3170713428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8009400 con 0x7f55ec15a910 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55eb200640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55e400efc0 tx=0x7f55e400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4014480 con 0x7f55ec15a910 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e400f040 con 0x7f55ec15a910 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e4014820 con 0x7f55ec15a910 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55ec15c340 con 0x7f55ec15a910 2024-09-13T18:38:02.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.806+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55ec15c900 con 0x7f55ec15a910 2024-09-13T18:38:02.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.807+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55ec15caf0 con 0x7f55ec15a910 2024-09-13T18:38:02.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.808+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55e4014980 con 0x7f55ec15a910 2024-09-13T18:38:02.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.809+0000 7f55e2a00640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:02.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.809+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f55e4089e40 con 0x7f55ec15a910 2024-09-13T18:38:02.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.809+0000 7f55ea800640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:02.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.810+0000 7f55ea800640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55dc005880 tx=0x7f55dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:02.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.813+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55e4055040 con 0x7f55ec15a910 2024-09-13T18:38:02.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.985+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55ec0b3ab0 con 0x7f55ec15a910 2024-09-13T18:38:02.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.985+0000 7f55e2a00640 1 -- 172.21.15.192:0/3170713428 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v59) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55e4018020 con 0x7f55ec15a910 2024-09-13T18:38:02.988 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:38:02.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.987+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 msgr2=0x7f55cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.987+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f55dc005880 tx=0x7f55dc009040 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.987+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 msgr2=0x7f55ec0afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.987+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f55e400efc0 tx=0x7f55e400c490 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 shutdown_connections 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55ec15a910 0x7f55ec0afcd0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55ec0b2600 0x7f55ec1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 --2- 172.21.15.192:0/3170713428 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55ec0add80 0x7f55ec15ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 >> 172.21.15.192:0/3170713428 conn(0x7f55ec0b08f0 msgr2=0x7f55ec15f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 shutdown_connections 2024-09-13T18:38:02.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:02.988+0000 7f55f1400640 1 -- 172.21.15.192:0/3170713428 wait complete. 2024-09-13T18:38:03.005 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:03.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.156+0000 7f35b3200640 1 Processor -- start 2024-09-13T18:38:03.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.156+0000 7f35b3200640 1 -- start start 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35b3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f35b40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35b3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35b415a5f0 0x7f35b40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35b3200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35b415af60 con 0x7f35b406bc30 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35b3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35b415aaa0 con 0x7f35b415a5f0 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35b3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b406b7a0 con 0x7f35b4159b00 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35abe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f35b406bc30 0x7f35b4159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52206/0 (socket says 172.21.15.192:52206) 2024-09-13T18:38:03.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.157+0000 7f35abe00640 1 -- 172.21.15.192:0/1621995033 learned_addr learned my addr 172.21.15.192:0/1621995033 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:03.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f35b40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b2800640 1 --2- 172.21.15.192:0/1621995033 >> v2:172.21.15.194:3300/0 conn(0x7f35b415a5f0 0x7f35b40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655114779 0 0) 0x7f35b415af60 con 0x7f35b406bc30 2024-09-13T18:38:03.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3598003520 con 0x7f35b406bc30 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4104844969 0 0) 0x7f3598003520 con 0x7f35b406bc30 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 msgr2=0x7f35b40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f35b40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 >> v2:172.21.15.194:3300/0 conn(0x7f35b415a5f0 msgr2=0x7f35b40b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 --2- 172.21.15.192:0/1621995033 >> v2:172.21.15.194:3300/0 conn(0x7f35b415a5f0 0x7f35b40b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b415ac80 con 0x7f35b406bc30 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f359c001670 con 0x7f35b406bc30 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f35b40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 >> v1:172.21.15.192:6789/0 conn(0x7f35b406bc30 legacy=0x7f35b4159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3598003970 0x7f3598003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f3598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415aaa0 con 0x7f3598003970 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b406b7a0 con 0x7f35980047c0 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359800db90 con 0x7f35b4159b00 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.158+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3598003970 0x7f3598003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35abe00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b2800640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f3598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b1e00640 1 -- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 msgr2=0x7f3598005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b4159b00 0x7f3598005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b1e00640 1 -- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35980047c0 msgr2=0x7f3598004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35980047c0 0x7f3598004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.159+0000 7f35b1e00640 1 -- 172.21.15.192:0/1621995033 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009400 con 0x7f3598003970 2024-09-13T18:38:03.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.160+0000 7f35b1e00640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3598003970 0x7f3598003d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009c90 tx=0x7f35980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b5e3f7ec3bdcc71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.160+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4031400 con 0x7f3598003970 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.160+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a402d050 con 0x7f3598003970 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.160+0000 7f35b1400640 1 -- 172.21.15.192:0/1621995033 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a4031760 con 0x7f3598003970 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 -- 172.21.15.192:0/1621995033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3598003970 msgr2=0x7f3598003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 --2- 172.21.15.192:0/1621995033 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3598003970 0x7f3598003d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009c90 tx=0x7f35980057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b2800640 1 -- 172.21.15.192:0/1621995033 reap_dead start 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 -- 172.21.15.192:0/1621995033 shutdown_connections 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 -- 172.21.15.192:0/1621995033 >> 172.21.15.192:0/1621995033 conn(0x7f35b40736d0 msgr2=0x7f35b40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 -- 172.21.15.192:0/1621995033 shutdown_connections 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.161+0000 7f35b3200640 1 -- 172.21.15.192:0/1621995033 wait complete. 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.163+0000 7f35b3200640 1 Processor -- start 2024-09-13T18:38:03.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.163+0000 7f35b3200640 1 -- start start 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 0x7f35b414dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b414cc90 0x7f35b414f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415b420 con 0x7f35b415af60 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415b700 con 0x7f3598003970 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35b415b9e0 con 0x7f35b414cc90 2024-09-13T18:38:03.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54162/0 (socket says 172.21.15.192:54162) 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 -- 172.21.15.192:0/471311022 learned_addr learned my addr 172.21.15.192:0/471311022 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b2800640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b414cc90 0x7f35b414f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b1e00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 0x7f35b414dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 -- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b414cc90 msgr2=0x7f35b414f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b414cc90 0x7f35b414f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 -- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 msgr2=0x7f35b414dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 0x7f35b414dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 -- 172.21.15.192:0/471311022 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b415bcc0 con 0x7f35b415af60 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35b1e00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 0x7f35b414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:03.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.164+0000 7f35abe00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f359c004f70 tx=0x7f359c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.165+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00f750 con 0x7f35b415af60 2024-09-13T18:38:03.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.165+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f359c00f8b0 con 0x7f35b415af60 2024-09-13T18:38:03.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.165+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35b415bfa0 con 0x7f35b415af60 2024-09-13T18:38:03.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.165+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f359c00fc60 con 0x7f35b415af60 2024-09-13T18:38:03.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.165+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35b414d140 con 0x7f35b415af60 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.166+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35b415c1c0 con 0x7f35b415af60 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.167+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f359c01d460 con 0x7f35b415af60 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.168+0000 7f35aa000640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 0x7f359006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.168+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f359c0895c0 con 0x7f35b415af60 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.168+0000 7f35b1e00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 0x7f359006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.169+0000 7f35b1e00640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 0x7f359006d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f35a4033000 tx=0x7f35a4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.172+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f359c054670 con 0x7f35b415af60 2024-09-13T18:38:03.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.377+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35b40b32b0 con 0x7f35b415af60 2024-09-13T18:38:03.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.378+0000 7f35aa000640 1 -- 172.21.15.192:0/471311022 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f359c057c90 con 0x7f35b415af60 2024-09-13T18:38:03.380 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:03.380 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:38:03.380 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 msgr2=0x7f359006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 0x7f359006d0c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f35a4033000 tx=0x7f35a4008030 comp rx=0 tx=0).stop 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 msgr2=0x7f35b415c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f359c004f70 tx=0x7f359c0074f0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 shutdown_connections 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f359006ac00 0x7f359006d0c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35b414cc90 0x7f35b414f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35b415af60 0x7f35b415c4c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 --2- 172.21.15.192:0/471311022 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3598003970 0x7f35b414dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 >> 172.21.15.192:0/471311022 conn(0x7f35b40736d0 msgr2=0x7f35b41567a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 shutdown_connections 2024-09-13T18:38:03.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.380+0000 7f35b3200640 1 -- 172.21.15.192:0/471311022 wait complete. 2024-09-13T18:38:03.397 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:03.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.548+0000 7fd740200640 1 Processor -- start 2024-09-13T18:38:03.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.548+0000 7fd740200640 1 -- start start 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd73815dee0 0x7fd7380afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7380b3f10 0x7fd7380b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd73815e2c0 0x7fd73815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380b2f00 con 0x7fd7380b3f10 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7380b3150 con 0x7fd73815dee0 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd740200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7380b3430 con 0x7fd73815e2c0 2024-09-13T18:38:03.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7380b3f10 0x7fd7380b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7380b3f10 0x7fd7380b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54164/0 (socket says 172.21.15.192:54164) 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 -- 172.21.15.192:0/2598407939 learned_addr learned my addr 172.21.15.192:0/2598407939 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73d800640 1 --2- 172.21.15.192:0/2598407939 >> v2:172.21.15.194:3300/0 conn(0x7fd73815dee0 0x7fd7380afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73e200640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd73815e2c0 0x7fd73815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 -- 172.21.15.192:0/2598407939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd73815e2c0 msgr2=0x7fd73815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd73815e2c0 0x7fd73815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 -- 172.21.15.192:0/2598407939 >> v2:172.21.15.194:3300/0 conn(0x7fd73815dee0 msgr2=0x7fd7380afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2598407939 >> v2:172.21.15.194:3300/0 conn(0x7fd73815dee0 0x7fd7380afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.550+0000 7fd73ce00640 1 -- 172.21.15.192:0/2598407939 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7380b3710 con 0x7fd7380b3f10 2024-09-13T18:38:03.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.551+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7380b3f10 0x7fd7380b02c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd73806cd20 tx=0x7fd72402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade3726127497298 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd737e00640 1 -- 172.21.15.192:0/2598407939 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724032440 con 0x7fd7380b3f10 2024-09-13T18:38:03.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd737e00640 1 -- 172.21.15.192:0/2598407939 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7240325a0 con 0x7fd7380b3f10 2024-09-13T18:38:03.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd737e00640 1 -- 172.21.15.192:0/2598407939 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724032930 con 0x7fd7380b3f10 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 -- 172.21.15.192:0/2598407939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7380b3f10 msgr2=0x7fd7380b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7380b3f10 0x7fd7380b02c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fd73806cd20 tx=0x7fd72402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 -- 172.21.15.192:0/2598407939 shutdown_connections 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd73815e2c0 0x7fd73815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 --2- 172.21.15.192:0/2598407939 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7380b3f10 0x7fd7380b02c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 --2- 172.21.15.192:0/2598407939 >> v2:172.21.15.194:3300/0 conn(0x7fd73815dee0 0x7fd7380afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 -- 172.21.15.192:0/2598407939 >> 172.21.15.192:0/2598407939 conn(0x7fd7380ae960 msgr2=0x7fd73806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.552+0000 7fd740200640 1 -- 172.21.15.192:0/2598407939 shutdown_connections 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.553+0000 7fd740200640 1 -- 172.21.15.192:0/2598407939 wait complete. 2024-09-13T18:38:03.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.554+0000 7fd740200640 1 Processor -- start 2024-09-13T18:38:03.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.554+0000 7fd740200640 1 -- start start 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 0x7fd738154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 0x7fd738135820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd738155120 con 0x7fd73815e2c0 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7381541b0 con 0x7fd73815dee0 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd740200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd738152080 con 0x7fd738154730 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd73ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd73ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54174/0 (socket says 172.21.15.192:54174) 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.555+0000 7fd73ce00640 1 -- 172.21.15.192:0/2876274653 learned_addr learned my addr 172.21.15.192:0/2876274653 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73d800640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 0x7fd738154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73e200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 0x7fd738135820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 -- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 msgr2=0x7fd738135820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 0x7fd738135820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 -- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 msgr2=0x7fd738154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 0x7fd738154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 -- 172.21.15.192:0/2876274653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7240094d0 con 0x7fd73815e2c0 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73d800640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 0x7fd738154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73e200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 0x7fd738135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:03.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.556+0000 7fd73ce00640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd724000c00 tx=0x7fd7240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.557+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724032440 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.557+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd724030ba0 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.557+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd738155310 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.557+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72403d440 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.557+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd738153470 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.558+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd73815a440 con 0x7fd73815e2c0 2024-09-13T18:38:03.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.559+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd724039040 con 0x7fd73815e2c0 2024-09-13T18:38:03.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.559+0000 7fd735600640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 0x7fd71806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.559+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fd7240a9fe0 con 0x7fd73815e2c0 2024-09-13T18:38:03.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.560+0000 7fd73d800640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 0x7fd71806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.560+0000 7fd73d800640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 0x7fd71806d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006fd0 tx=0x7fd72c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.564+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd7240750a0 con 0x7fd73815e2c0 2024-09-13T18:38:03.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.732+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd73813ce40 con 0x7fd73815e2c0 2024-09-13T18:38:03.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.734+0000 7fd735600640 1 -- 172.21.15.192:0/2876274653 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16801 (secure 0 0 0) 0x7fd724037090 con 0x7fd73815e2c0 2024-09-13T18:38:03.736 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:03.736 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":59,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:51.664800+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.15","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":0}]},{"pgid":"7.33","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 msgr2=0x7fd71806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 0x7fd71806d0c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd72c006fd0 tx=0x7fd72c008040 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 msgr2=0x7fd738153c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fd724000c00 tx=0x7fd7240046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 shutdown_connections 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd71806ac00 0x7fd71806d0c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd738154730 0x7fd738135820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd73815e2c0 0x7fd738153c70 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 --2- 172.21.15.192:0/2876274653 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd73815dee0 0x7fd738154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 >> 172.21.15.192:0/2876274653 conn(0x7fd7380ae960 msgr2=0x7fd73806b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:03.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 shutdown_connections 2024-09-13T18:38:03.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.736+0000 7fd740200640 1 -- 172.21.15.192:0/2876274653 wait complete. 2024-09-13T18:38:03.754 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:38:03.754 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:03.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.904+0000 7f8287200640 1 Processor -- start 2024-09-13T18:38:03.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.904+0000 7f8287200640 1 -- start start 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.905+0000 7f8287200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280150480 0x7f828015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8287200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8280071810 0x7f82800b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8287200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82800b2230 0x7f82800cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8287200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8280071dd0 con 0x7f82800b2230 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8287200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82800cb770 con 0x7f8280071810 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8287200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82800cba50 con 0x7f8280150480 2024-09-13T18:38:03.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82800b2230 0x7f82800cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f82800b2230 0x7f82800cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54178/0 (socket says 172.21.15.192:54178) 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 -- 172.21.15.192:0/1470273550 learned_addr learned my addr 172.21.15.192:0/1470273550 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f827f400640 1 --2- 172.21.15.192:0/1470273550 >> v2:172.21.15.194:3300/0 conn(0x7f8280071810 0x7f82800b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f827fe00640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280150480 0x7f828015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 -- 172.21.15.192:0/1470273550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280150480 msgr2=0x7f828015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280150480 0x7f828015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 -- 172.21.15.192:0/1470273550 >> v2:172.21.15.194:3300/0 conn(0x7f8280071810 msgr2=0x7f82800b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 --2- 172.21.15.192:0/1470273550 >> v2:172.21.15.194:3300/0 conn(0x7f8280071810 0x7f82800b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.906+0000 7f8285200640 1 -- 172.21.15.192:0/1470273550 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82800cbd30 con 0x7f82800b2230 2024-09-13T18:38:03.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.907+0000 7f8285200640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f82800cc530 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f828006ccf0 tx=0x7f827802c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a933b9d0639322 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f827ea00640 1 -- 172.21.15.192:0/1470273550 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827802f070 con 0x7f82800b2230 2024-09-13T18:38:03.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f827ea00640 1 -- 172.21.15.192:0/1470273550 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827800b2e0 con 0x7f82800b2230 2024-09-13T18:38:03.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f827ea00640 1 -- 172.21.15.192:0/1470273550 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8278009820 con 0x7f82800b2230 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 -- 172.21.15.192:0/1470273550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 msgr2=0x7f82800cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f82800cc530 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f828006ccf0 tx=0x7f827802c8a0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 -- 172.21.15.192:0/1470273550 shutdown_connections 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f82800cc530 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 --2- 172.21.15.192:0/1470273550 >> v2:172.21.15.194:3300/0 conn(0x7f8280071810 0x7f82800b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 --2- 172.21.15.192:0/1470273550 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280150480 0x7f828015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 -- 172.21.15.192:0/1470273550 >> 172.21.15.192:0/1470273550 conn(0x7f82800ae960 msgr2=0x7f828006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 -- 172.21.15.192:0/1470273550 shutdown_connections 2024-09-13T18:38:03.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.908+0000 7f8287200640 1 -- 172.21.15.192:0/1470273550 wait complete. 2024-09-13T18:38:03.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.910+0000 7f8287200640 1 Processor -- start 2024-09-13T18:38:03.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.910+0000 7f8287200640 1 -- start start 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280071810 0x7f828014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8280150480 0x7f82800af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82801539f0 con 0x7f82800b2230 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8280152eb0 con 0x7f8280150480 2024-09-13T18:38:03.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8287200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8280153150 con 0x7f8280071810 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f827f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f827f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54182/0 (socket says 172.21.15.192:54182) 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f827f400640 1 -- 172.21.15.192:0/4094246466 learned_addr learned my addr 172.21.15.192:0/4094246466 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f827fe00640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280071810 0x7f828014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.911+0000 7f8285200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8280150480 0x7f82800af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 -- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280071810 msgr2=0x7f828014ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280071810 0x7f828014ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 -- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8280150480 msgr2=0x7f82800af650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8280150480 0x7f82800af650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 -- 172.21.15.192:0/4094246466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827800bd40 con 0x7f82800b2230 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f827f400640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f826c00e890 tx=0x7f826c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00c940 con 0x7f82800b2230 2024-09-13T18:38:03.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00caa0 con 0x7f82800b2230 2024-09-13T18:38:03.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8280153430 con 0x7f82800b2230 2024-09-13T18:38:03.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00ce30 con 0x7f82800b2230 2024-09-13T18:38:03.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.912+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828014f4d0 con 0x7f82800b2230 2024-09-13T18:38:03.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.913+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82800ae740 con 0x7f82800b2230 2024-09-13T18:38:03.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.914+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f826c013470 con 0x7f82800b2230 2024-09-13T18:38:03.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.915+0000 7f8277e00640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 0x7f826006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:03.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.915+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f826c089520 con 0x7f82800b2230 2024-09-13T18:38:03.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.915+0000 7f827fe00640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 0x7f826006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:03.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.916+0000 7f827fe00640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 0x7f826006d0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8280156050 tx=0x7f8270009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:03.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:03.920+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f826c054710 con 0x7f82800b2230 2024-09-13T18:38:04.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.120+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82800cc530 con 0x7f82800b2230 2024-09-13T18:38:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.121+0000 7f8277e00640 1 -- 172.21.15.192:0/4094246466 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f826c057d30 con 0x7f82800b2230 2024-09-13T18:38:04.123 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:04.123 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:38:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:38:04.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 msgr2=0x7f826006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 0x7f826006d0f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8280156050 tx=0x7f8270009190 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 msgr2=0x7f8280156820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f826c00e890 tx=0x7f826c00ed50 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 shutdown_connections 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f826006ac30 0x7f826006d0f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8280150480 0x7f82800af650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82800b2230 0x7f8280156820 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 --2- 172.21.15.192:0/4094246466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8280071810 0x7f828014ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.123+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 >> 172.21.15.192:0/4094246466 conn(0x7f82800ae960 msgr2=0x7f828015aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.124+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 shutdown_connections 2024-09-13T18:38:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.124+0000 7f8287200640 1 -- 172.21.15.192:0/4094246466 wait complete. 2024-09-13T18:38:04.141 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:04.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.291+0000 7f4ccc800640 1 Processor -- start 2024-09-13T18:38:04.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.291+0000 7f4ccc800640 1 -- start start 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4ccc800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4cc40b3f10 0x7f4cc415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4ccc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc40b2f00 con 0x7f4cc40b0490 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4ccc800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cc40b3150 con 0x7f4cc415dee0 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4ccc800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cc40b3430 con 0x7f4cc40b3f10 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4cca800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4cc40b0490 0x7f4cc415a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52216/0 (socket says 172.21.15.192:52216) 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.292+0000 7f4cca800640 1 -- 172.21.15.192:0/3216827784 learned_addr learned my addr 172.21.15.192:0/3216827784 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:04.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc9400640 1 --2- 172.21.15.192:0/3216827784 >> v2:172.21.15.194:3300/0 conn(0x7f4cc40b3f10 0x7f4cc415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc8a00640 1 -- 172.21.15.192:0/3216827784 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2636028336 0 0) 0x7f4cc40b2f00 con 0x7f4cc40b0490 2024-09-13T18:38:04.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc8a00640 1 -- 172.21.15.192:0/3216827784 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cac005730 con 0x7f4cc40b0490 2024-09-13T18:38:04.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc9400640 1 -- 172.21.15.192:0/3216827784 >> v1:172.21.15.194:6789/0 conn(0x7f4cc415dee0 legacy=0x7f4cc40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc9400640 1 -- 172.21.15.192:0/3216827784 >> v1:172.21.15.192:6789/0 conn(0x7f4cc40b0490 legacy=0x7f4cc415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.293+0000 7f4cc9400640 1 -- 172.21.15.192:0/3216827784 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cc40b3710 con 0x7f4cc40b3f10 2024-09-13T18:38:04.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.294+0000 7f4cc9400640 1 --2- 172.21.15.192:0/3216827784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc40b3f10 0x7f4cc415a440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097a0 tx=0x7f4cb402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf6af0b48e1904dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.294+0000 7f4cc8a00640 1 -- 172.21.15.192:0/3216827784 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4032440 con 0x7f4cc40b3f10 2024-09-13T18:38:04.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.294+0000 7f4cc8a00640 1 -- 172.21.15.192:0/3216827784 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb40325a0 con 0x7f4cc40b3f10 2024-09-13T18:38:04.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4cc8a00640 1 -- 172.21.15.192:0/3216827784 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb4032910 con 0x7f4cc40b3f10 2024-09-13T18:38:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 -- 172.21.15.192:0/3216827784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc40b3f10 msgr2=0x7f4cc415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 --2- 172.21.15.192:0/3216827784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc40b3f10 0x7f4cc415a440 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4cb40097a0 tx=0x7f4cb402a230 comp rx=0 tx=0).stop 2024-09-13T18:38:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 -- 172.21.15.192:0/3216827784 shutdown_connections 2024-09-13T18:38:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 --2- 172.21.15.192:0/3216827784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc40b3f10 0x7f4cc415a440 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 -- 172.21.15.192:0/3216827784 >> 172.21.15.192:0/3216827784 conn(0x7f4cc40ae960 msgr2=0x7f4cc406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:04.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 -- 172.21.15.192:0/3216827784 shutdown_connections 2024-09-13T18:38:04.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.295+0000 7f4ccc800640 1 -- 172.21.15.192:0/3216827784 wait complete. 2024-09-13T18:38:04.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.297+0000 7f4ccc800640 1 Processor -- start 2024-09-13T18:38:04.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.297+0000 7f4ccc800640 1 -- start start 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc415dee0 0x7f4cc4136eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cc40705e0 0x7f4cc40b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4070a70 con 0x7f4cc40b0490 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4137d90 con 0x7f4cc415dee0 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4ccc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cc4070ce0 con 0x7f4cc40705e0 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54194/0 (socket says 172.21.15.192:54194) 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9e00640 1 -- 172.21.15.192:0/1248377910 learned_addr learned my addr 172.21.15.192:0/1248377910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:04.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9400640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc415dee0 0x7f4cc4136eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cca800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cc40705e0 0x7f4cc40b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9e00640 1 -- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cc40705e0 msgr2=0x7f4cc40b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.298+0000 7f4cc9e00640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cc40705e0 0x7f4cc40b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cc9e00640 1 -- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc415dee0 msgr2=0x7f4cc4136eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cc9e00640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc415dee0 0x7f4cc4136eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cc9e00640 1 -- 172.21.15.192:0/1248377910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb4009400 con 0x7f4cc40b0490 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cc9e00640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c400 tx=0x7f4cb800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80052d0 con 0x7f4cc40b0490 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cb8005430 con 0x7f4cc40b0490 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8003830 con 0x7f4cc40b0490 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cc4070fc0 con 0x7f4cc40b0490 2024-09-13T18:38:04.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.299+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cc413d100 con 0x7f4cc40b0490 2024-09-13T18:38:04.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.300+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cc40afd80 con 0x7f4cc40b0490 2024-09-13T18:38:04.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.301+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4cb8003990 con 0x7f4cc40b0490 2024-09-13T18:38:04.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.302+0000 7f4cbe000640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 0x7f4ca806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.302+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f4cb8088950 con 0x7f4cc40b0490 2024-09-13T18:38:04.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.302+0000 7f4cc9400640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 0x7f4ca806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.303+0000 7f4cc9400640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 0x7f4ca806d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4034000 tx=0x7f4cb402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.306+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4cb8053ab0 con 0x7f4cc40b0490 2024-09-13T18:38:04.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.505+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4cc406c3f0 con 0x7f4cc40b0490 2024-09-13T18:38:04.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.506+0000 7f4cbe000640 1 -- 172.21.15.192:0/1248377910 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f4cb8017090 con 0x7f4cc40b0490 2024-09-13T18:38:04.508 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:04.508 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":24,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:37:22.957094+0000","modified":"2024-09-13T18:37:25.977539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5461},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5461":{"gid":5461,"name":"b","rank":0,"incarnation":20,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/530866381","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":530866381},{"type":"v1","addr":"172.21.15.194:6834","nonce":530866381}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-09-13T18:38:04.508 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 24 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 msgr2=0x7f4ca806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 0x7f4ca806d0c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f4cb4034000 tx=0x7f4cb402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 msgr2=0x7f4cc41374f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c400 tx=0x7f4cb800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 shutdown_connections 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4ca806ac00 0x7f4ca806d0c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cc40705e0 0x7f4cc40b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cc415dee0 0x7f4cc4136eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 --2- 172.21.15.192:0/1248377910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cc40b0490 0x7f4cc41374f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 >> 172.21.15.192:0/1248377910 conn(0x7f4cc40ae960 msgr2=0x7f4cc41590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 shutdown_connections 2024-09-13T18:38:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.508+0000 7f4ccc800640 1 -- 172.21.15.192:0/1248377910 wait complete. 2024-09-13T18:38:04.526 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:04.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.676+0000 7f8d73c00640 1 Processor -- start 2024-09-13T18:38:04.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.677+0000 7f8d73c00640 1 -- start start 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d73c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d6c0cacd0 0x7f8d6c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d73c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 0x7f8d6c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d73c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d6c140480 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d73c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d6c0cb520 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d73c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c15ee90 con 0x7f8d6c15bc20 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d6c0cacd0 0x7f8d6c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8d6c0cacd0 0x7f8d6c15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54202/0 (socket says 172.21.15.192:54202) 2024-09-13T18:38:04.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 -- 172.21.15.192:0/1902127787 learned_addr learned my addr 172.21.15.192:0/1902127787 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:04.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 -- 172.21.15.192:0/1902127787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 msgr2=0x7f8d6c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:04.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71c00640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 0x7f8d6c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 0x7f8d6c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 -- 172.21.15.192:0/1902127787 >> v1:172.21.15.194:6789/0 conn(0x7f8d6c0cb0b0 legacy=0x7f8d6c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71200640 1 -- 172.21.15.192:0/1902127787 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c15f170 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.678+0000 7f8d71c00640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 0x7f8d6c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.679+0000 7f8d71200640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cacd0 0x7f8d6c15e790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009870 tx=0x7f8d5c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cf0bcd34e379172 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d6be00640 1 -- 172.21.15.192:0/1902127787 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c032440 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d6be00640 1 -- 172.21.15.192:0/1902127787 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d5c0325a0 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d6be00640 1 -- 172.21.15.192:0/1902127787 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5c032930 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 -- 172.21.15.192:0/1902127787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cacd0 msgr2=0x7f8d6c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cacd0 0x7f8d6c15e790 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009870 tx=0x7f8d5c02a200 comp rx=0 tx=0).stop 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 -- 172.21.15.192:0/1902127787 shutdown_connections 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c15bc20 0x7f8d6c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 --2- 172.21.15.192:0/1902127787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cacd0 0x7f8d6c15e790 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 -- 172.21.15.192:0/1902127787 >> 172.21.15.192:0/1902127787 conn(0x7f8d6c0ae960 msgr2=0x7f8d6c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 -- 172.21.15.192:0/1902127787 shutdown_connections 2024-09-13T18:38:04.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.680+0000 7f8d73c00640 1 -- 172.21.15.192:0/1902127787 wait complete. 2024-09-13T18:38:04.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.682+0000 7f8d73c00640 1 Processor -- start 2024-09-13T18:38:04.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.682+0000 7f8d73c00640 1 -- start start 2024-09-13T18:38:04.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c0cacd0 0x7f8d6c13cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d6c15bc20 0x7f8d6c159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c069ea0 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c06bcd0 con 0x7f8d6c15bc20 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d73c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d6c06a160 con 0x7f8d6c0cacd0 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d63e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54204/0 (socket says 172.21.15.192:54204) 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d63e00640 1 -- 172.21.15.192:0/2282825116 learned_addr learned my addr 172.21.15.192:0/2282825116 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d71c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d6c15bc20 0x7f8d6c159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.683+0000 7f8d71200640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c0cacd0 0x7f8d6c13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 -- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c0cacd0 msgr2=0x7f8d6c13cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c0cacd0 0x7f8d6c13cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 -- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d6c15bc20 msgr2=0x7f8d6c159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d6c15bc20 0x7f8d6c159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 -- 172.21.15.192:0/2282825116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0094d0 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d63e00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400b3f0 tx=0x7f8d5400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54011830 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54011990 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d6c06a440 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54011d40 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.684+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d6c06ac40 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.685+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d6c06ae60 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.686+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d5401a400 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.687+0000 7f8d69600640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 0x7f8d4806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:04.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.687+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7f8d540890a0 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.687+0000 7f8d71200640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 0x7f8d4806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:04.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.688+0000 7f8d71200640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 0x7f8d4806d0f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c034000 tx=0x7f8d5c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:04.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.691+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d54054330 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.864+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d6c15e790 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.865+0000 7f8d69600640 1 -- 172.21.15.192:0/2282825116 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16801 (secure 0 0 0) 0x7f8d54057950 con 0x7f8d6c0cb0b0 2024-09-13T18:38:04.868 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:04.869 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":59,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:37:51.664800+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:37:20.953486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-13T18:37:21.953576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.3","mappings":[{"from":5,"to":7}]},{"pgid":"7.15","mappings":[{"from":5,"to":7}]},{"pgid":"7.2e","mappings":[{"from":5,"to":7}]},{"pgid":"7.31","mappings":[{"from":5,"to":0}]},{"pgid":"7.33","mappings":[{"from":5,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:04.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 msgr2=0x7f8d4806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 0x7f8d4806d0f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c034000 tx=0x7f8d5c02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 msgr2=0x7f8d6c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f8d5400b3f0 tx=0x7f8d5400b8b0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 shutdown_connections 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d4806ac30 0x7f8d4806d0f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d6c15bc20 0x7f8d6c159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d6c0cb0b0 0x7f8d6c13d2b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 --2- 172.21.15.192:0/2282825116 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d6c0cacd0 0x7f8d6c13cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 >> 172.21.15.192:0/2282825116 conn(0x7f8d6c0ae960 msgr2=0x7f8d6c071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 shutdown_connections 2024-09-13T18:38:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:04.868+0000 7f8d73c00640 1 -- 172.21.15.192:0/2282825116 wait complete. 2024-09-13T18:38:04.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:38:05.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.039+0000 7fe10e600640 1 Processor -- start 2024-09-13T18:38:05.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.039+0000 7fe10e600640 1 -- start start 2024-09-13T18:38:05.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe108156af0 0x7fe108071640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10e600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe108156ed0 0x7fe1080b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10e600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe108159a90 con 0x7fe10806bea0 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10e600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe10806eba0 con 0x7fe108156ed0 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe108159d70 con 0x7fe108156af0 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe0ffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe108156ed0 0x7fe1080b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe0ffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe108156ed0 0x7fe1080b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54216/0 (socket says 172.21.15.192:54216) 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe0ffe00640 1 -- 172.21.15.192:0/3841634076 learned_addr learned my addr 172.21.15.192:0/3841634076 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.040+0000 7fe10dc00640 1 --1- 172.21.15.192:0/3841634076 >> v1:172.21.15.192:6789/0 conn(0x7fe10806bea0 0x7fe10815cd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52220/0 (socket says 172.21.15.192:52220) 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe10d200640 1 --2- 172.21.15.192:0/3841634076 >> v2:172.21.15.194:3300/0 conn(0x7fe108156af0 0x7fe108071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe0ffe00640 1 -- 172.21.15.192:0/3841634076 >> v2:172.21.15.194:3300/0 conn(0x7fe108156af0 msgr2=0x7fe108071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe0ffe00640 1 --2- 172.21.15.192:0/3841634076 >> v2:172.21.15.194:3300/0 conn(0x7fe108156af0 0x7fe108071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe0ffe00640 1 -- 172.21.15.192:0/3841634076 >> v1:172.21.15.192:6789/0 conn(0x7fe10806bea0 legacy=0x7fe10815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe107e00640 1 -- 172.21.15.192:0/3841634076 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1311764009 0 0) 0x7fe108159a90 con 0x7fe10806bea0 2024-09-13T18:38:05.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.041+0000 7fe0ffe00640 1 -- 172.21.15.192:0/3841634076 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe10815a050 con 0x7fe108156ed0 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.042+0000 7fe0ffe00640 1 --2- 172.21.15.192:0/3841634076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156ed0 0x7fe1080b3600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b16f0 tx=0x7fe0f002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae6de9dc2a73edb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.042+0000 7fe107e00640 1 -- 172.21.15.192:0/3841634076 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0032640 con 0x7fe108156ed0 2024-09-13T18:38:05.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.042+0000 7fe107e00640 1 -- 172.21.15.192:0/3841634076 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f00327a0 con 0x7fe108156ed0 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.042+0000 7fe107e00640 1 -- 172.21.15.192:0/3841634076 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0032b30 con 0x7fe108156ed0 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 -- 172.21.15.192:0/3841634076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156ed0 msgr2=0x7fe1080b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 --2- 172.21.15.192:0/3841634076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156ed0 0x7fe1080b3600 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fe1080b16f0 tx=0x7fe0f002a300 comp rx=0 tx=0).stop 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 -- 172.21.15.192:0/3841634076 shutdown_connections 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 --2- 172.21.15.192:0/3841634076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156ed0 0x7fe1080b3600 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 --2- 172.21.15.192:0/3841634076 >> v2:172.21.15.194:3300/0 conn(0x7fe108156af0 0x7fe108071640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 -- 172.21.15.192:0/3841634076 >> 172.21.15.192:0/3841634076 conn(0x7fe1080736d0 msgr2=0x7fe1080b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 -- 172.21.15.192:0/3841634076 shutdown_connections 2024-09-13T18:38:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.043+0000 7fe10e600640 1 -- 172.21.15.192:0/3841634076 wait complete. 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.044+0000 7fe10e600640 1 Processor -- start 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 -- start start 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe10806bea0 0x7fe1080b2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe108156ed0 0x7fe1081523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe108151a00 con 0x7fe108156af0 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe108155ac0 con 0x7fe10806bea0 2024-09-13T18:38:05.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.045+0000 7fe10e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe108155da0 con 0x7fe108156ed0 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54222/0 (socket says 172.21.15.192:54222) 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 -- 172.21.15.192:0/473884415 learned_addr learned my addr 172.21.15.192:0/473884415 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe10dc00640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe108156ed0 0x7fe1081523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe10d200640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe10806bea0 0x7fe1080b2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 -- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe108156ed0 msgr2=0x7fe1081523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe108156ed0 0x7fe1081523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 -- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe10806bea0 msgr2=0x7fe1080b2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe10806bea0 0x7fe1080b2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 -- 172.21.15.192:0/473884415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f00094d0 con 0x7fe108156af0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.046+0000 7fe0ffe00640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe0f002a340 tx=0x7fe0f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.047+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0030850 con 0x7fe108156af0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.047+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0f00309b0 con 0x7fe108156af0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.047+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0f0030d60 con 0x7fe108156af0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.047+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe108156080 con 0x7fe108156af0 2024-09-13T18:38:05.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.047+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe10814c950 con 0x7fe108156af0 2024-09-13T18:38:05.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.048+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe108151b70 con 0x7fe108156af0 2024-09-13T18:38:05.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.049+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe0f0039040 con 0x7fe108156af0 2024-09-13T18:38:05.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.050+0000 7fe105600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 0x7fe0e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.050+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5854+0+0 (secure 0 0 0) 0x7fe0f00a9ec0 con 0x7fe108156af0 2024-09-13T18:38:05.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.050+0000 7fe10d200640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 0x7fe0e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.051+0000 7fe10d200640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 0x7fe0e406d0f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006fd0 tx=0x7fe0f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.054+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe0f00750b0 con 0x7fe108156af0 2024-09-13T18:38:05.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.254+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe1080cb670 con 0x7fe108156af0 2024-09-13T18:38:05.258 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:38:05.255+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:38:05.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.265+0000 7fe105600640 1 -- 172.21.15.192:0/473884415 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe0f004b090 con 0x7fe108156af0 2024-09-13T18:38:05.268 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 msgr2=0x7fe0e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 0x7fe0e406d0f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe0f8006fd0 tx=0x7fe0f8008040 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 msgr2=0x7fe108151e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fe0f002a340 tx=0x7fe0f00046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 shutdown_connections 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe0e406ac30 0x7fe0e406d0f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe108156ed0 0x7fe1081523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe108156af0 0x7fe108151e90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 --2- 172.21.15.192:0/473884415 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe10806bea0 0x7fe1080b2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 >> 172.21.15.192:0/473884415 conn(0x7fe1080736d0 msgr2=0x7fe108153840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 shutdown_connections 2024-09-13T18:38:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.268+0000 7fe10e600640 1 -- 172.21.15.192:0/473884415 wait complete. 2024-09-13T18:38:05.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:38:05.336 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:38:05.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.437+0000 7f779d800640 1 Processor -- start 2024-09-13T18:38:05.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.437+0000 7f779d800640 1 -- start start 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f779d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f77980b3af0 0x7f779815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f779d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 0x7f779806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f779d800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980b2000 con 0x7f77981589f0 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f779d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779806ca80 con 0x7f77980b3af0 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f779d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980b2ba0 con 0x7f779806c0b0 2024-09-13T18:38:05.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f7796a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f77981589f0 0x7f77980b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52226/0 (socket says 172.21.15.192:52226) 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.438+0000 7f7796a00640 1 -- 172.21.15.192:0/948730809 learned_addr learned my addr 172.21.15.192:0/948730809 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7797400640 1 --2- 172.21.15.192:0/948730809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 0x7f779806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7796000640 1 --2- 172.21.15.192:0/948730809 >> v2:172.21.15.194:3300/0 conn(0x7f77980b3af0 0x7f779815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089410409 0 0) 0x7f77980b2000 con 0x7f77981589f0 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f777c003520 con 0x7f77981589f0 2024-09-13T18:38:05.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 268241325 0 0) 0x7f777c003520 con 0x7f77981589f0 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7797400640 1 -- 172.21.15.192:0/948730809 >> v2:172.21.15.194:3300/0 conn(0x7f77980b3af0 msgr2=0x7f779815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7797400640 1 --2- 172.21.15.192:0/948730809 >> v2:172.21.15.194:3300/0 conn(0x7f77980b3af0 0x7f779815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7797400640 1 -- 172.21.15.192:0/948730809 >> v1:172.21.15.192:6789/0 conn(0x7f77981589f0 legacy=0x7f77980b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.439+0000 7f7797400640 1 -- 172.21.15.192:0/948730809 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779815bbd0 con 0x7f779806c0b0 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f7797400640 1 --2- 172.21.15.192:0/948730809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 0x7f779806c540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7790009d90 tx=0x7f779002a5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=716d837653ef6059 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788001670 con 0x7f779806c0b0 2024-09-13T18:38:05.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779002d050 con 0x7f779806c0b0 2024-09-13T18:38:05.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f7795600640 1 -- 172.21.15.192:0/948730809 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7790007760 con 0x7f779806c0b0 2024-09-13T18:38:05.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f779d800640 1 -- 172.21.15.192:0/948730809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 msgr2=0x7f779806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f779d800640 1 --2- 172.21.15.192:0/948730809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 0x7f779806c540 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7790009d90 tx=0x7f779002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f779d800640 1 -- 172.21.15.192:0/948730809 shutdown_connections 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f779d800640 1 --2- 172.21.15.192:0/948730809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f779806c0b0 0x7f779806c540 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.441+0000 7f779d800640 1 --2- 172.21.15.192:0/948730809 >> v2:172.21.15.194:3300/0 conn(0x7f77980b3af0 0x7f779815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.442+0000 7f779d800640 1 -- 172.21.15.192:0/948730809 >> 172.21.15.192:0/948730809 conn(0x7f77980b08f0 msgr2=0x7f77980b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.442+0000 7f779d800640 1 -- 172.21.15.192:0/948730809 shutdown_connections 2024-09-13T18:38:05.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.442+0000 7f779d800640 1 -- 172.21.15.192:0/948730809 wait complete. 2024-09-13T18:38:05.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.443+0000 7f779d800640 1 Processor -- start 2024-09-13T18:38:05.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.443+0000 7f779d800640 1 -- start start 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 0x7f77980ad880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 0x7f779814a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980ae2f0 con 0x7f779806c0b0 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77981e4090 con 0x7f77981589f0 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f779d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7798158100 con 0x7f77980b3af0 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f7796a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f7796a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54228/0 (socket says 172.21.15.192:54228) 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.444+0000 7f7796a00640 1 -- 172.21.15.192:0/359131881 learned_addr learned my addr 172.21.15.192:0/359131881 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:05.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796000640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 0x7f77980ad880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7797400640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 0x7f779814a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 -- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 msgr2=0x7f77980ad880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 0x7f77980ad880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 -- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 msgr2=0x7f779814a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 0x7f779814a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 -- 172.21.15.192:0/359131881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790009a70 con 0x7f779806c0b0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796000640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 0x7f77980ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7797400640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 0x7f779814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f7796a00640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f778800c770 tx=0x7f778800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788005ad0 con 0x7f779806c0b0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7788005c50 con 0x7f779806c0b0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788007070 con 0x7f779806c0b0 2024-09-13T18:38:05.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980addc0 con 0x7f779806c0b0 2024-09-13T18:38:05.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.445+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77981e39d0 con 0x7f779806c0b0 2024-09-13T18:38:05.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.446+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77981e3830 con 0x7f779806c0b0 2024-09-13T18:38:05.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.447+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f77880071d0 con 0x7f779806c0b0 2024-09-13T18:38:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.448+0000 7f778ea00640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 0x7f777806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.448+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f7788088d00 con 0x7f779806c0b0 2024-09-13T18:38:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.448+0000 7f7796000640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 0x7f777806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.449+0000 7f7796000640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 0x7f777806d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77981e55e0 tx=0x7f7784008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:05.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.452+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f77981e3830 con 0x7f779806c0b0 2024-09-13T18:38:05.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:05.656+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f77981e41d0 con 0x7f779806c0b0 2024-09-13T18:38:06.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.267+0000 7f778ea00640 1 -- 172.21.15.192:0/359131881 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) v1 ==== 104+0+0 (secure 0 0 0) 0x7f77981e41d0 con 0x7f779806c0b0 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 msgr2=0x7f777806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 0x7f777806d0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f77981e55e0 tx=0x7f7784008040 comp rx=0 tx=0).stop 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 msgr2=0x7f77981f08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f778800c770 tx=0x7f778800cc30 comp rx=0 tx=0).stop 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 shutdown_connections 2024-09-13T18:38:06.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f777806ac00 0x7f777806d0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77981589f0 0x7f779814a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77980b3af0 0x7f77980ad880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 --2- 172.21.15.192:0/359131881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f779806c0b0 0x7f77981f08f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 >> 172.21.15.192:0/359131881 conn(0x7f77980b08f0 msgr2=0x7f7798159570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 shutdown_connections 2024-09-13T18:38:06.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.270+0000 7f779d800640 1 -- 172.21.15.192:0/359131881 wait complete. 2024-09-13T18:38:06.292 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:38:06.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.447+0000 7f3363e00640 1 Processor -- start 2024-09-13T18:38:06.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.447+0000 7f3363e00640 1 -- start start 2024-09-13T18:38:06.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640cd440 0x7f33640cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33640cdd60 0x7f33640d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336415d330 con 0x7f33640d25a0 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640b6c10 con 0x7f33640cdd60 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640b5f90 con 0x7f33640cd440 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f335be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33640cdd60 0x7f33640d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f33640d25a0 0x7f33640b7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52242/0 (socket says 172.21.15.192:52242) 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f335be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33640cdd60 0x7f33640d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54234/0 (socket says 172.21.15.192:54234) 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.448+0000 7f3363400640 1 -- 172.21.15.192:0/510656724 learned_addr learned my addr 172.21.15.192:0/510656724 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f3362a00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640cd440 0x7f33640cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f335be00640 1 -- 172.21.15.192:0/510656724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640cd440 msgr2=0x7f33640cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f335be00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640cd440 0x7f33640cd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f335be00640 1 -- 172.21.15.192:0/510656724 >> v1:172.21.15.192:6789/0 conn(0x7f33640d25a0 legacy=0x7f33640b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f335be00640 1 -- 172.21.15.192:0/510656724 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640b6270 con 0x7f33640cdd60 2024-09-13T18:38:06.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.449+0000 7f3362000640 1 -- 172.21.15.192:0/510656724 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305837981 0 0) 0x7f336415d330 con 0x7f33640d25a0 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.450+0000 7f335be00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640d2060 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f334c0097a0 tx=0x7f334c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d975f36e37c0116 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.450+0000 7f3362000640 1 -- 172.21.15.192:0/510656724 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c032440 con 0x7f33640cdd60 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.450+0000 7f3362000640 1 -- 172.21.15.192:0/510656724 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c0325a0 con 0x7f33640cdd60 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.450+0000 7f3362000640 1 -- 172.21.15.192:0/510656724 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c032930 con 0x7f33640cdd60 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 -- 172.21.15.192:0/510656724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 msgr2=0x7f33640d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640d2060 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f334c0097a0 tx=0x7f334c02a210 comp rx=0 tx=0).stop 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 -- 172.21.15.192:0/510656724 shutdown_connections 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640d2060 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 --2- 172.21.15.192:0/510656724 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640cd440 0x7f33640cd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 -- 172.21.15.192:0/510656724 >> 172.21.15.192:0/510656724 conn(0x7f33640b48e0 msgr2=0x7f33640b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:06.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 -- 172.21.15.192:0/510656724 shutdown_connections 2024-09-13T18:38:06.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.451+0000 7f3363e00640 1 -- 172.21.15.192:0/510656724 wait complete. 2024-09-13T18:38:06.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.452+0000 7f3363e00640 1 Processor -- start 2024-09-13T18:38:06.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.452+0000 7f3363e00640 1 -- start start 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 0x7f3364155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640d25a0 0x7f3364157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364159270 con 0x7f33640cdd60 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364158ab0 con 0x7f33640cd440 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.453+0000 7f3363e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3364157680 con 0x7f33640d25a0 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54248/0 (socket says 172.21.15.192:54248) 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 -- 172.21.15.192:0/1532175551 learned_addr learned my addr 172.21.15.192:0/1532175551 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f3363400640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640d25a0 0x7f3364157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f3362a00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 0x7f3364155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 -- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640d25a0 msgr2=0x7f3364157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640d25a0 0x7f3364157ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 -- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 msgr2=0x7f3364155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:06.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 0x7f3364155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:06.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 -- 172.21.15.192:0/1532175551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334c009400 con 0x7f33640cdd60 2024-09-13T18:38:06.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f3362a00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 0x7f3364155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.454+0000 7f335be00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f334c035040 tx=0x7f334c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.455+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c032440 con 0x7f33640cdd60 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.455+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c006e10 con 0x7f33640cdd60 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.455+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c030be0 con 0x7f33640cdd60 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.455+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3364157960 con 0x7f33640cdd60 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.455+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3364157c40 con 0x7f33640cdd60 2024-09-13T18:38:06.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.456+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3364158f90 con 0x7f33640cdd60 2024-09-13T18:38:06.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.457+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f334c039040 con 0x7f33640cdd60 2024-09-13T18:38:06.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.457+0000 7f335aa00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:06.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.458+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5940+0+0 (secure 0 0 0) 0x7f334c0a9d80 con 0x7f33640cdd60 2024-09-13T18:38:06.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.458+0000 7f3362a00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:06.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.458+0000 7f3362a00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3354006fd0 tx=0x7f3354008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:06.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.462+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3364158f90 con 0x7f33640cdd60 2024-09-13T18:38:06.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:06.628+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3364158f90 con 0x7f33640cdd60 2024-09-13T18:38:06.897 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:06.901 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:07.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.278+0000 7f335aa00640 1 -- 172.21.15.192:0/1532175551 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v61) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3364158f90 con 0x7f33640cdd60 2024-09-13T18:38:07.281 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:38:07.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 msgr2=0x7f334006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3354006fd0 tx=0x7f3354008040 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 msgr2=0x7f33640a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f334c035040 tx=0x7f334c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 shutdown_connections 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33640d25a0 0x7f3364157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33640cdd60 0x7f33640a99e0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 --2- 172.21.15.192:0/1532175551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33640cd440 0x7f3364155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 >> 172.21.15.192:0/1532175551 conn(0x7f33640b48e0 msgr2=0x7f33640d1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 shutdown_connections 2024-09-13T18:38:07.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.280+0000 7f3363e00640 1 -- 172.21.15.192:0/1532175551 wait complete. 2024-09-13T18:38:07.299 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:38:07.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.452+0000 7fe269e00640 1 Processor -- start 2024-09-13T18:38:07.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.452+0000 7fe269e00640 1 -- start start 2024-09-13T18:38:07.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.453+0000 7fe269e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 0x7fe264070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.453+0000 7fe269e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 0x7fe2640cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe269e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26406a330 con 0x7fe264071b80 2024-09-13T18:38:07.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe269e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe26413e0f0 con 0x7fe2641403e0 2024-09-13T18:38:07.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe269e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26415b300 con 0x7fe264071100 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe262000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 0x7fe264070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe263400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 0x7fe2640cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe262a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe264071b80 0x7fe26415f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:58158/0 (socket says 172.21.15.192:58158) 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.454+0000 7fe262a00640 1 -- 172.21.15.192:0/3382271981 learned_addr learned my addr 172.21.15.192:0/3382271981 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe261600640 1 -- 172.21.15.192:0/3382271981 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2431701471 0 0) 0x7fe254001110 con 0x7fe264071b80 2024-09-13T18:38:07.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe261600640 1 -- 172.21.15.192:0/3382271981 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe248003520 con 0x7fe264071b80 2024-09-13T18:38:07.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe263400640 1 -- 172.21.15.192:0/3382271981 >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 msgr2=0x7fe264070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:07.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe263400640 1 --2- 172.21.15.192:0/3382271981 >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 0x7fe264070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe263400640 1 -- 172.21.15.192:0/3382271981 >> v1:172.21.15.194:6789/0 conn(0x7fe264071b80 legacy=0x7fe26415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe263400640 1 -- 172.21.15.192:0/3382271981 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2641408a0 con 0x7fe264071100 2024-09-13T18:38:07.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.455+0000 7fe262000640 1 --2- 172.21.15.192:0/3382271981 >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 0x7fe264070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.456+0000 7fe263400640 1 --2- 172.21.15.192:0/3382271981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 0x7fe2640cd9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009d90 tx=0x7fe25c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a589e74ceb3bfa40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.456+0000 7fe261600640 1 -- 172.21.15.192:0/3382271981 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c007740 con 0x7fe264071100 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.456+0000 7fe261600640 1 -- 172.21.15.192:0/3382271981 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25c02d050 con 0x7fe264071100 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.456+0000 7fe261600640 1 -- 172.21.15.192:0/3382271981 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25c007ac0 con 0x7fe264071100 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 -- 172.21.15.192:0/3382271981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 msgr2=0x7fe2640cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 --2- 172.21.15.192:0/3382271981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 0x7fe2640cd9c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe25c009d90 tx=0x7fe25c02a660 comp rx=0 tx=0).stop 2024-09-13T18:38:07.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 -- 172.21.15.192:0/3382271981 shutdown_connections 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 --2- 172.21.15.192:0/3382271981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe264071100 0x7fe2640cd9c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 --2- 172.21.15.192:0/3382271981 >> v2:172.21.15.194:3300/0 conn(0x7fe2641403e0 0x7fe264070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 -- 172.21.15.192:0/3382271981 >> 172.21.15.192:0/3382271981 conn(0x7fe2640b0c40 msgr2=0x7fe2640b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 -- 172.21.15.192:0/3382271981 shutdown_connections 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.457+0000 7fe269e00640 1 -- 172.21.15.192:0/3382271981 wait complete. 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.458+0000 7fe269e00640 1 Processor -- start 2024-09-13T18:38:07.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 -- start start 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe264071100 0x7fe264154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2641403e0 0x7fe26413b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2641553e0 con 0x7fe264071b80 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe264159fd0 con 0x7fe264071100 2024-09-13T18:38:07.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.459+0000 7fe269e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe264159170 con 0x7fe2641403e0 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe264071100 0x7fe264154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54258/0 (socket says 172.21.15.192:54258) 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 -- 172.21.15.192:0/4053320491 learned_addr learned my addr 172.21.15.192:0/4053320491 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe263400640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2641403e0 0x7fe26413b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 -- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2641403e0 msgr2=0x7fe26413b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2641403e0 0x7fe26413b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 -- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe264071100 msgr2=0x7fe264154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe264071100 0x7fe264154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:07.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.460+0000 7fe262000640 1 -- 172.21.15.192:0/4053320491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe250009400 con 0x7fe264071b80 2024-09-13T18:38:07.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe262000640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e960 tx=0x7fe25000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe25000ca00 con 0x7fe264071b80 2024-09-13T18:38:07.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe25000cb60 con 0x7fe264071b80 2024-09-13T18:38:07.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe250013470 con 0x7fe264071b80 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe25c009a70 con 0x7fe264071b80 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.461+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26415ad00 con 0x7fe264071b80 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.462+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26415a160 con 0x7fe264071b80 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.463+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe2500135d0 con 0x7fe264071b80 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.464+0000 7fe25b400640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 0x7fe24406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:07.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.464+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5502+0+0 (secure 0 0 0) 0x7fe250089460 con 0x7fe264071b80 2024-09-13T18:38:07.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.464+0000 7fe262a00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 0x7fe24406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:07.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.465+0000 7fe262a00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 0x7fe24406d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe254001270 tx=0x7fe254007bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:07.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.468+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe2500547b0 con 0x7fe264071b80 2024-09-13T18:38:07.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:07.635+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe264070bc0 con 0x7fe264071b80 2024-09-13T18:38:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.278+0000 7fe25b400640 1 -- 172.21.15.192:0/4053320491 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v62) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe250057dd0 con 0x7fe264071b80 2024-09-13T18:38:08.284 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:38:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 msgr2=0x7fe24406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 0x7fe24406d0c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe254001270 tx=0x7fe254007bb0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 msgr2=0x7fe264158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e960 tx=0x7fe25000ee20 comp rx=0 tx=0).stop 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 shutdown_connections 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe24406ac00 0x7fe24406d0c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2641403e0 0x7fe26413b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe264071b80 0x7fe264158c30 secure :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fe25000e960 tx=0x7fe25000ee20 comp rx=0 tx=0).stop 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 --2- 172.21.15.192:0/4053320491 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe264071100 0x7fe264154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.282+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 >> 172.21.15.192:0/4053320491 conn(0x7fe2640b0c40 msgr2=0x7fe26406b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.283+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 shutdown_connections 2024-09-13T18:38:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.283+0000 7fe269e00640 1 -- 172.21.15.192:0/4053320491 wait complete. 2024-09-13T18:38:08.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:38:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.458+0000 7f6d7a000640 1 Processor -- start 2024-09-13T18:38:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.458+0000 7f6d7a000640 1 -- start start 2024-09-13T18:38:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.459+0000 7f6d7a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d740cb330 0x7f6d7406ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.459+0000 7f6d7a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7415a8e0 con 0x7f6d740b3470 2024-09-13T18:38:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.459+0000 7f6d7a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d740b2fe0 con 0x7f6d740cdf60 2024-09-13T18:38:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.459+0000 7f6d7a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d740b26b0 con 0x7f6d740cb330 2024-09-13T18:38:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d73e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6d740b3470 0x7f6d740b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52246/0 (socket says 172.21.15.192:52246) 2024-09-13T18:38:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d73e00640 1 -- 172.21.15.192:0/2274495356 learned_addr learned my addr 172.21.15.192:0/2274495356 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d73400640 1 --2- 172.21.15.192:0/2274495356 >> v2:172.21.15.194:3300/0 conn(0x7f6d740cb330 0x7f6d7406ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3035635061 0 0) 0x7f6d7415a8e0 con 0x7f6d740b3470 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d58003520 con 0x7f6d740b3470 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2454714834 0 0) 0x7f6d58003520 con 0x7f6d740b3470 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 >> v2:172.21.15.194:3300/0 conn(0x7f6d740cb330 msgr2=0x7f6d7406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 --2- 172.21.15.192:0/2274495356 >> v2:172.21.15.194:3300/0 conn(0x7f6d740cb330 0x7f6d7406ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 >> v1:172.21.15.194:6789/0 conn(0x7f6d740cdf60 legacy=0x7f6d740ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d740b2990 con 0x7f6d740b3470 2024-09-13T18:38:08.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f6d6c0019f0 con 0x7f6d740b3470 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 >> v1:172.21.15.192:6789/0 conn(0x7f6d740b3470 legacy=0x7f6d740b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d58003970 0x7f6d58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.460+0000 7f6d72000640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d580047c0 0x7f6d58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d72000640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 0x7f6d5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d740b26b0 con 0x7f6d580052a0 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800c170 con 0x7f6d580047c0 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800c330 con 0x7f6d58003970 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 0x7f6d5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73400640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d58003970 0x7f6d58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d72a00640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d580047c0 0x7f6d58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 -- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d58003970 msgr2=0x7f6d58003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d58003970 0x7f6d58003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 -- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d580047c0 msgr2=0x7f6d58004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d580047c0 0x7f6d58004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.461+0000 7f6d73e00640 1 -- 172.21.15.192:0/2274495356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58003520 con 0x7f6d580052a0 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.462+0000 7f6d73e00640 1 -- 172.21.15.192:0/2274495356 reap_dead start 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.462+0000 7f6d73e00640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 0x7f6d5800b980 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00a7f0 tx=0x7f6d580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c4c2b92687ba10 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.462+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c02ba10 con 0x7f6d580052a0 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.462+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c02bb70 con 0x7f6d580052a0 2024-09-13T18:38:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d72000640 1 -- 172.21.15.192:0/2274495356 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034470 con 0x7f6d580052a0 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 -- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 msgr2=0x7f6d5800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 0x7f6d5800b980 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c00a7f0 tx=0x7f6d580057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 -- 172.21.15.192:0/2274495356 shutdown_connections 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 --2- 172.21.15.192:0/2274495356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d580052a0 0x7f6d5800b980 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 -- 172.21.15.192:0/2274495356 >> 172.21.15.192:0/2274495356 conn(0x7f6d740b08f0 msgr2=0x7f6d740b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 -- 172.21.15.192:0/2274495356 shutdown_connections 2024-09-13T18:38:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.463+0000 7f6d7a000640 1 -- 172.21.15.192:0/2274495356 wait complete. 2024-09-13T18:38:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.465+0000 7f6d7a000640 1 Processor -- start 2024-09-13T18:38:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.465+0000 7f6d7a000640 1 -- start start 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 0x7f6d7414a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d74154000 0x7f6d740ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7414aba0 con 0x7f6d74154480 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74155870 con 0x7f6d74154000 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d7a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d74154a50 con 0x7f6d580052a0 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54280/0 (socket says 172.21.15.192:54280) 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 -- 172.21.15.192:0/3700140729 learned_addr learned my addr 172.21.15.192:0/3700140729 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d72a00640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d74154000 0x7f6d740ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73400640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 0x7f6d7414a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 -- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 msgr2=0x7f6d7414a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 0x7f6d7414a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 -- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d74154000 msgr2=0x7f6d740ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d74154000 0x7f6d740ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73e00640 1 -- 172.21.15.192:0/3700140729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d74154d30 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.466+0000 7f6d73400640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 0x7f6d7414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d73e00640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c001580 tx=0x7f6d6c02d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c03b040 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6c004b60 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6c034470 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d74155010 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.467+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7414c520 con 0x7f6d74154480 2024-09-13T18:38:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.468+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7406b0f0 con 0x7f6d74154480 2024-09-13T18:38:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.469+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d6c031070 con 0x7f6d74154480 2024-09-13T18:38:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.470+0000 7f6d6b400640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 0x7f6d5406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.470+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6d6c0a91b0 con 0x7f6d74154480 2024-09-13T18:38:08.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.470+0000 7f6d73400640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 0x7f6d5406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.471+0000 7f6d73400640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 0x7f6d5406d0f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d640093d0 tx=0x7f6d64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.474+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6d6c074720 con 0x7f6d74154480 2024-09-13T18:38:08.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.645+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6d741559b0 con 0x7f6d74154480 2024-09-13T18:38:08.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.650+0000 7f6d6b400640 1 -- 172.21.15.192:0/3700140729 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6d6c032370 con 0x7f6d74154480 2024-09-13T18:38:08.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 msgr2=0x7f6d5406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 0x7f6d5406d0f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6d640093d0 tx=0x7f6d64008040 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 msgr2=0x7f6d740add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6d6c001580 tx=0x7f6d6c02d070 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 shutdown_connections 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d5406ac30 0x7f6d5406d0f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d74154480 0x7f6d740add80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d74154000 0x7f6d740ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.652+0000 7f6d7a000640 1 --2- 172.21.15.192:0/3700140729 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d580052a0 0x7f6d7414a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.653+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 >> 172.21.15.192:0/3700140729 conn(0x7f6d740b08f0 msgr2=0x7f6d74153600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.653+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 shutdown_connections 2024-09-13T18:38:08.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.653+0000 7f6d7a000640 1 -- 172.21.15.192:0/3700140729 wait complete. 2024-09-13T18:38:08.671 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2024-09-13T18:38:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.822+0000 7f7c16800640 1 Processor -- start 2024-09-13T18:38:08.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.822+0000 7f7c16800640 1 -- start start 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.823+0000 7f7c16800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.823+0000 7f7c16800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.823+0000 7f7c16800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 0x7f7c1015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.823+0000 7f7c16800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b2f00 con 0x7f7c1015dee0 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c16800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b3150 con 0x7f7c1015e2c0 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c16800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c100b3430 con 0x7f7c100b3f10 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54292/0 (socket says 172.21.15.192:54292) 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 -- 172.21.15.192:0/2653221624 learned_addr learned my addr 172.21.15.192:0/2653221624 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/2653221624 >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 0x7f7c1015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 -- 172.21.15.192:0/2653221624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 msgr2=0x7f7c100b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0ea00640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 -- 172.21.15.192:0/2653221624 >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 msgr2=0x7f7c1015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 --2- 172.21.15.192:0/2653221624 >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 0x7f7c1015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0f400640 1 -- 172.21.15.192:0/2653221624 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b3710 con 0x7f7c1015dee0 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/2653221624 >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 0x7f7c1015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:08.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.824+0000 7f7c0ea00640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:08.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.825+0000 7f7c0f400640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b4f50 tx=0x7f7c0002c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebd4b12402392a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.825+0000 7f7c0e000640 1 -- 172.21.15.192:0/2653221624 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00031710 con 0x7f7c1015dee0 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.825+0000 7f7c0e000640 1 -- 172.21.15.192:0/2653221624 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0002f050 con 0x7f7c1015dee0 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.825+0000 7f7c0e000640 1 -- 172.21.15.192:0/2653221624 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c00031a90 con 0x7f7c1015dee0 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 -- 172.21.15.192:0/2653221624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 msgr2=0x7f7c100afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b4f50 tx=0x7f7c0002c3f0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 -- 172.21.15.192:0/2653221624 shutdown_connections 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 --2- 172.21.15.192:0/2653221624 >> v2:172.21.15.194:3300/0 conn(0x7f7c1015e2c0 0x7f7c1015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 --2- 172.21.15.192:0/2653221624 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 -- 172.21.15.192:0/2653221624 >> 172.21.15.192:0/2653221624 conn(0x7f7c100ae960 msgr2=0x7f7c1006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 -- 172.21.15.192:0/2653221624 shutdown_connections 2024-09-13T18:38:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.826+0000 7f7c16800640 1 -- 172.21.15.192:0/2653221624 wait complete. 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.828+0000 7f7c16800640 1 Processor -- start 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.828+0000 7f7c16800640 1 -- start start 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 0x7f7c10151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015e2c0 0x7f7c1006b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013d9d0 con 0x7f7c1015cad0 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013dcb0 con 0x7f7c1015e2c0 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c16800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013df90 con 0x7f7c1015dee0 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54302/0 (socket says 172.21.15.192:54302) 2024-09-13T18:38:08.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 -- 172.21.15.192:0/4225526590 learned_addr learned my addr 172.21.15.192:0/4225526590 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0f400640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 0x7f7c10151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0ea00640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015e2c0 0x7f7c1006b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 -- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 msgr2=0x7f7c10151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 0x7f7c10151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 -- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015e2c0 msgr2=0x7f7c1006b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015e2c0 0x7f7c1006b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0fe00640 1 -- 172.21.15.192:0/4225526590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c000094d0 con 0x7f7c1015cad0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.829+0000 7f7c0f400640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 0x7f7c10151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800cef0 tx=0x7f7c0800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800d840 con 0x7f7c1015cad0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800d9c0 con 0x7f7c1015cad0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800dd70 con 0x7f7c1015cad0 2024-09-13T18:38:08.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c1013e270 con 0x7f7c1015cad0 2024-09-13T18:38:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.830+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c101516d0 con 0x7f7c1015cad0 2024-09-13T18:38:08.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.831+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c1013e790 con 0x7f7c1015cad0 2024-09-13T18:38:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.832+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c0801e3b0 con 0x7f7c1015cad0 2024-09-13T18:38:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.833+0000 7f7c07400640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 0x7f7bf006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.833+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7c080899a0 con 0x7f7c1015cad0 2024-09-13T18:38:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.833+0000 7f7c0f400640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 0x7f7bf006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:08.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.834+0000 7f7c0f400640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 0x7f7bf006d0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c00035000 tx=0x7f7c00008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:08.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:08.837+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c1013e790 con 0x7f7c1015cad0 2024-09-13T18:38:09.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.070+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7f7c1013e790 con 0x7f7c1015cad0 2024-09-13T18:38:09.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.279+0000 7f7c07400640 1 -- 172.21.15.192:0/4225526590 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v152) v1 ==== 142+0+0 (secure 0 0 0) 0x7f7c1013e790 con 0x7f7c1015cad0 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 msgr2=0x7f7bf006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 0x7f7bf006d0f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f7c00035000 tx=0x7f7c00008030 comp rx=0 tx=0).stop 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 msgr2=0x7f7c1013d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800cef0 tx=0x7f7c0800a710 comp rx=0 tx=0).stop 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 shutdown_connections 2024-09-13T18:38:09.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac30 0x7f7bf006d0f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015cad0 0x7f7c1013d060 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015e2c0 0x7f7c1006b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 --2- 172.21.15.192:0/4225526590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015dee0 0x7f7c10151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 >> 172.21.15.192:0/4225526590 conn(0x7f7c100ae960 msgr2=0x7f7c1013c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 shutdown_connections 2024-09-13T18:38:09.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.281+0000 7f7c16800640 1 -- 172.21.15.192:0/4225526590 wait complete. 2024-09-13T18:38:09.300 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-13T18:38:09.300 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2024-09-13T18:38:09.301 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:09.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.450+0000 7f5205e00640 1 Processor -- start 2024-09-13T18:38:09.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.450+0000 7f5205e00640 1 -- start start 2024-09-13T18:38:09.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.451+0000 7f5205e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 0x7f520015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.451+0000 7f5205e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.451+0000 7f5205e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5200071dd0 con 0x7f52000b2230 2024-09-13T18:38:09.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.451+0000 7f5205e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52000cb770 con 0x7f5200150480 2024-09-13T18:38:09.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.451+0000 7f5205e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52000cba50 con 0x7f5200071810 2024-09-13T18:38:09.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 0x7f520015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:35106/0 (socket says 172.21.15.192:35106) 2024-09-13T18:38:09.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51ff400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f52000b2230 0x7f52000cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:58178/0 (socket says 172.21.15.192:58178) 2024-09-13T18:38:09.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 0x7f520015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:47540/0 (socket says 172.21.15.192:47540) 2024-09-13T18:38:09.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 -- 172.21.15.192:0/339329266 learned_addr learned my addr 172.21.15.192:0/339329266 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:09.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 -- 172.21.15.192:0/339329266 >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 msgr2=0x7f520015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:09.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 --2- 172.21.15.192:0/339329266 >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 0x7f520015a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 -- 172.21.15.192:0/339329266 >> v1:172.21.15.194:6789/0 conn(0x7f52000b2230 legacy=0x7f52000cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.452+0000 7f51fe000640 1 -- 172.21.15.192:0/339329266 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52000cbd30 con 0x7f5200071810 2024-09-13T18:38:09.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.453+0000 7f51fe000640 1 --2- 172.21.15.192:0/339329266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02a1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c7fb1a634d30385 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f51fd600640 1 -- 172.21.15.192:0/339329266 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec032440 con 0x7f5200071810 2024-09-13T18:38:09.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f51fd600640 1 -- 172.21.15.192:0/339329266 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec0325a0 con 0x7f5200071810 2024-09-13T18:38:09.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f51fd600640 1 -- 172.21.15.192:0/339329266 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec032930 con 0x7f5200071810 2024-09-13T18:38:09.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 -- 172.21.15.192:0/339329266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 msgr2=0x7f52000b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 --2- 172.21.15.192:0/339329266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f51ec009870 tx=0x7f51ec02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 -- 172.21.15.192:0/339329266 shutdown_connections 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 --2- 172.21.15.192:0/339329266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200071810 0x7f52000b1cf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 --2- 172.21.15.192:0/339329266 >> v2:172.21.15.194:3300/0 conn(0x7f5200150480 0x7f520015a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 -- 172.21.15.192:0/339329266 >> 172.21.15.192:0/339329266 conn(0x7f52000ae960 msgr2=0x7f520006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 -- 172.21.15.192:0/339329266 shutdown_connections 2024-09-13T18:38:09.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.454+0000 7f5205e00640 1 -- 172.21.15.192:0/339329266 wait complete. 2024-09-13T18:38:09.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.456+0000 7f5205e00640 1 Processor -- start 2024-09-13T18:38:09.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.456+0000 7f5205e00640 1 -- start start 2024-09-13T18:38:09.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 0x7f520014cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200150480 0x7f52000ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5200071690 con 0x7f5200071810 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52001541d0 con 0x7f52000b2230 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f5205e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5200154470 con 0x7f5200150480 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f51fea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f51fea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54312/0 (socket says 172.21.15.192:54312) 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.457+0000 7f51fea00640 1 -- 172.21.15.192:0/1835934224 learned_addr learned my addr 172.21.15.192:0/1835934224 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51ff400640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200150480 0x7f52000ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fe000640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 0x7f520014cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 -- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200150480 msgr2=0x7f52000ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200150480 0x7f52000ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 -- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 msgr2=0x7f520014cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 0x7f520014cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 -- 172.21.15.192:0/1835934224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0094d0 con 0x7f5200071810 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fe000640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 0x7f520014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51fea00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f51f000bfd0 tx=0x7f51f000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f000de00 con 0x7f5200071810 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f0010440 con 0x7f5200071810 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5200154750 con 0x7f5200071810 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.458+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f00107f0 con 0x7f5200071810 2024-09-13T18:38:09.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.459+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5200071380 con 0x7f5200071810 2024-09-13T18:38:09.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.460+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52000b1cf0 con 0x7f5200071810 2024-09-13T18:38:09.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.460+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f51f0010950 con 0x7f5200071810 2024-09-13T18:38:09.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.461+0000 7f51f7400640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 0x7f51e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.461+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f51f0089880 con 0x7f5200071810 2024-09-13T18:38:09.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.462+0000 7f51fe000640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 0x7f51e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.462+0000 7f51fe000640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 0x7f51e006d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.465+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f51f0054cd0 con 0x7f5200071810 2024-09-13T18:38:09.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.634+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5200065f10 con 0x7f5200071810 2024-09-13T18:38:09.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.635+0000 7f51f7400640 1 -- 172.21.15.192:0/1835934224 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+13046 (secure 0 0 0) 0x7f51f001d020 con 0x7f5200071810 2024-09-13T18:38:09.638 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:09.638 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:08.273636+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6834/530866381":"2024-09-14T18:38:05.256428+0000","172.21.15.194:6832/530866381":"2024-09-14T18:38:05.256428+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 msgr2=0x7f51e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 0x7f51e006d0c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f51ec034000 tx=0x7f51ec02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 msgr2=0x7f5200070e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f51f000bfd0 tx=0x7f51f000ee60 comp rx=0 tx=0).stop 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 shutdown_connections 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f51e006ac00 0x7f51e006d0c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5200150480 0x7f52000ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f52000b2230 0x7f520014cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 --2- 172.21.15.192:0/1835934224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5200071810 0x7f5200070e40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 >> 172.21.15.192:0/1835934224 conn(0x7f52000ae960 msgr2=0x7f52000afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 shutdown_connections 2024-09-13T18:38:09.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.637+0000 7f5205e00640 1 -- 172.21.15.192:0/1835934224 wait complete. 2024-09-13T18:38:09.656 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:38:09.656 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:09.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.808+0000 7f9bdde00640 1 Processor -- start 2024-09-13T18:38:09.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.808+0000 7f9bdde00640 1 -- start start 2024-09-13T18:38:09.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bdde00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9bd80cb330 0x7f9bd806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bdde00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd815a8e0 con 0x7f9bd80b3470 2024-09-13T18:38:09.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bdde00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd80b2fe0 con 0x7f9bd80cdf60 2024-09-13T18:38:09.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bdde00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd80b26b0 con 0x7f9bd80cb330 2024-09-13T18:38:09.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bd7400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9bd80b3470 0x7f9bd80b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52252/0 (socket says 172.21.15.192:52252) 2024-09-13T18:38:09.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.809+0000 7f9bd7400640 1 -- 172.21.15.192:0/1317372714 learned_addr learned my addr 172.21.15.192:0/1317372714 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:09.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6a00640 1 --2- 172.21.15.192:0/1317372714 >> v2:172.21.15.194:3300/0 conn(0x7f9bd80cb330 0x7f9bd806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6000640 1 -- 172.21.15.192:0/1317372714 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2783071193 0 0) 0x7f9bd815a8e0 con 0x7f9bd80b3470 2024-09-13T18:38:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6000640 1 -- 172.21.15.192:0/1317372714 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bbc005730 con 0x7f9bd80b3470 2024-09-13T18:38:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6a00640 1 -- 172.21.15.192:0/1317372714 >> v1:172.21.15.194:6789/0 conn(0x7f9bd80cdf60 legacy=0x7f9bd80ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6a00640 1 -- 172.21.15.192:0/1317372714 >> v1:172.21.15.192:6789/0 conn(0x7f9bd80b3470 legacy=0x7f9bd80b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.810+0000 7f9bd6a00640 1 -- 172.21.15.192:0/1317372714 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80b2990 con 0x7f9bd80cb330 2024-09-13T18:38:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.811+0000 7f9bd6a00640 1 --2- 172.21.15.192:0/1317372714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd806ac00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80097a0 tx=0x7f9bc802a110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40cbdfbc8e6d6b0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bd6000640 1 -- 172.21.15.192:0/1317372714 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc802ae60 con 0x7f9bd80cb330 2024-09-13T18:38:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bd6000640 1 -- 172.21.15.192:0/1317372714 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8032440 con 0x7f9bd80cb330 2024-09-13T18:38:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bd6000640 1 -- 172.21.15.192:0/1317372714 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80327d0 con 0x7f9bd80cb330 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 -- 172.21.15.192:0/1317372714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 msgr2=0x7f9bd806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 --2- 172.21.15.192:0/1317372714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd806ac00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9bc80097a0 tx=0x7f9bc802a110 comp rx=0 tx=0).stop 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 -- 172.21.15.192:0/1317372714 shutdown_connections 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 --2- 172.21.15.192:0/1317372714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd806ac00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 -- 172.21.15.192:0/1317372714 >> 172.21.15.192:0/1317372714 conn(0x7f9bd80b08f0 msgr2=0x7f9bd80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 -- 172.21.15.192:0/1317372714 shutdown_connections 2024-09-13T18:38:09.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.812+0000 7f9bdde00640 1 -- 172.21.15.192:0/1317372714 wait complete. 2024-09-13T18:38:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.814+0000 7f9bdde00640 1 Processor -- start 2024-09-13T18:38:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.814+0000 7f9bdde00640 1 -- start start 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd8151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 0x7f9bd8157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8070a50 con 0x7f9bd80b3470 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8154b20 con 0x7f9bd80cb330 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bdde00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8154e00 con 0x7f9bd80cdf60 2024-09-13T18:38:09.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bd6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bd6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54328/0 (socket says 172.21.15.192:54328) 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.815+0000 7f9bd6a00640 1 -- 172.21.15.192:0/552569108 learned_addr learned my addr 172.21.15.192:0/552569108 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bce000640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd8151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd7400640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 0x7f9bd8157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 -- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 msgr2=0x7f9bd8157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 0x7f9bd8157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 -- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 msgr2=0x7f9bd8151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd8151660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 -- 172.21.15.192:0/552569108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc8009400 con 0x7f9bd80b3470 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd7400640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 0x7f9bd8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bd6a00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8035040 tx=0x7f9bc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8030910 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bc8030a90 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bc8030e40 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd81550e0 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.816+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd81556a0 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.817+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd8155890 con 0x7f9bd80b3470 2024-09-13T18:38:09.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.818+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9bc8039040 con 0x7f9bd80b3470 2024-09-13T18:38:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.820+0000 7f9bcfe00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 0x7f9bb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.820+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9bc80a98e0 con 0x7f9bd80b3470 2024-09-13T18:38:09.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.820+0000 7f9bce000640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 0x7f9bb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:09.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.820+0000 7f9bce000640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 0x7f9bb406d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9bd81f6190 tx=0x7f9bc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:09.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.824+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9bc8074ee0 con 0x7f9bd80b3470 2024-09-13T18:38:09.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.991+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9bd806b110 con 0x7f9bd80b3470 2024-09-13T18:38:09.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.991+0000 7f9bcfe00640 1 -- 172.21.15.192:0/552569108 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v62) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9bc8078500 con 0x7f9bd80b3470 2024-09-13T18:38:09.994 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:38:09.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 msgr2=0x7f9bb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 0x7f9bb406d0c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9bd81f6190 tx=0x7f9bc0009040 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 msgr2=0x7f9bd8070510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9bc8035040 tx=0x7f9bc80046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 shutdown_connections 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9bb406ac00 0x7f9bb406d0c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9bd80cdf60 0x7f9bd8157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9bd80cb330 0x7f9bd8151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 --2- 172.21.15.192:0/552569108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9bd80b3470 0x7f9bd8070510 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.993+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 >> 172.21.15.192:0/552569108 conn(0x7f9bd80b08f0 msgr2=0x7f9bd8071450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.994+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 shutdown_connections 2024-09-13T18:38:09.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:09.994+0000 7f9bdde00640 1 -- 172.21.15.192:0/552569108 wait complete. 2024-09-13T18:38:10.012 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-13T18:38:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.161+0000 7fcf85e00640 1 Processor -- start 2024-09-13T18:38:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.161+0000 7fcf85e00640 1 -- start start 2024-09-13T18:38:10.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.162+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf800b3f10 0x7fcf8015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.162+0000 7fcf85e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcf800b0490 0x7fcf8015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.162+0000 7fcf85e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf800b2f00 con 0x7fcf8015dee0 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.162+0000 7fcf85e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8015aec0 con 0x7fcf800b0490 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.162+0000 7fcf85e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b3150 con 0x7fcf800b3f10 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcf8015dee0 0x7fcf800afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52264/0 (socket says 172.21.15.192:52264) 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7ea00640 1 -- 172.21.15.192:0/1689038930 learned_addr learned my addr 172.21.15.192:0/1689038930 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf76000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf800b3f10 0x7fcf8015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> v2:172.21.15.194:3300/0 conn(0x7fcf800b0490 0x7fcf8015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240792484 0 0) 0x7fcf800b2f00 con 0x7fcf8015dee0 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf64005730 con 0x7fcf8015dee0 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2994734763 0 0) 0x7fcf64005730 con 0x7fcf8015dee0 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf800b3f10 msgr2=0x7fcf8015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf800b3f10 0x7fcf8015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 >> v2:172.21.15.194:3300/0 conn(0x7fcf800b0490 msgr2=0x7fcf8015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:10.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 --2- 172.21.15.192:0/1689038930 >> v2:172.21.15.194:3300/0 conn(0x7fcf800b0490 0x7fcf8015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.163+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf800b3430 con 0x7fcf8015dee0 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fcf70001670 con 0x7fcf8015dee0 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> v2:172.21.15.194:3300/0 conn(0x7fcf800b0490 0x7fcf8015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 >> v1:172.21.15.192:6789/0 conn(0x7fcf8015dee0 legacy=0x7fcf800afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf64005b80 0x7fcf64005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf640069d0 0x7fcf64006e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf64007350 0x7fcf6400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8015aec0 con 0x7fcf64007350 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800b3150 con 0x7fcf64005b80 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64006800 con 0x7fcf640069d0 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf64007350 0x7fcf6400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf76000640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf640069d0 0x7fcf64006e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7ea00640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf64005b80 0x7fcf64005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 -- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf640069d0 msgr2=0x7fcf64006e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf640069d0 0x7fcf64006e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 -- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf64005b80 msgr2=0x7fcf64005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf64005b80 0x7fcf64005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.164+0000 7fcf7f400640 1 -- 172.21.15.192:0/1689038930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64005730 con 0x7fcf64007350 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.165+0000 7fcf7f400640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf64007350 0x7fcf6400db90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800e380 tx=0x7fcf64007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8845061236114e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802c620 con 0x7fcf64007350 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7800f040 con 0x7fcf64007350 2024-09-13T18:38:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf7e000640 1 -- 172.21.15.192:0/1689038930 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7802c980 con 0x7fcf64007350 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 -- 172.21.15.192:0/1689038930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf64007350 msgr2=0x7fcf6400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 --2- 172.21.15.192:0/1689038930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf64007350 0x7fcf6400db90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800e380 tx=0x7fcf64007a00 comp rx=0 tx=0).stop 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf7f400640 1 -- 172.21.15.192:0/1689038930 reap_dead start 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 -- 172.21.15.192:0/1689038930 shutdown_connections 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 -- 172.21.15.192:0/1689038930 >> 172.21.15.192:0/1689038930 conn(0x7fcf800ae960 msgr2=0x7fcf8006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 -- 172.21.15.192:0/1689038930 shutdown_connections 2024-09-13T18:38:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.166+0000 7fcf85e00640 1 -- 172.21.15.192:0/1689038930 wait complete. 2024-09-13T18:38:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.168+0000 7fcf85e00640 1 Processor -- start 2024-09-13T18:38:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.168+0000 7fcf85e00640 1 -- start start 2024-09-13T18:38:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf64007350 0x7fcf801f1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf801f3480 0x7fcf800ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf800ae200 con 0x7fcf800add80 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8012ede0 con 0x7fcf801f3480 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf85e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8012f0c0 con 0x7fcf64007350 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf7f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf7f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:54336/0 (socket says 172.21.15.192:54336) 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.169+0000 7fcf7f400640 1 -- 172.21.15.192:0/2318713238 learned_addr learned my addr 172.21.15.192:0/2318713238 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 -- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf64007350 msgr2=0x7fcf801f1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf64007350 0x7fcf801f1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 -- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf801f3480 msgr2=0x7fcf800ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf801f3480 0x7fcf800ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 -- 172.21.15.192:0/2318713238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8012f3a0 con 0x7fcf800add80 2024-09-13T18:38:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf7f400640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800e380 tx=0x7fcf78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:10.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78003b90 con 0x7fcf800add80 2024-09-13T18:38:10.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf78003d10 con 0x7fcf800add80 2024-09-13T18:38:10.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf78004260 con 0x7fcf800add80 2024-09-13T18:38:10.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf8012f680 con 0x7fcf800add80 2024-09-13T18:38:10.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.170+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf801f3900 con 0x7fcf800add80 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.171+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8012fba0 con 0x7fcf800add80 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.172+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcf780043c0 con 0x7fcf800add80 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.173+0000 7fcf77e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 0x7fcf5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.173+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcf7803d070 con 0x7fcf800add80 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.173+0000 7fcf7ea00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 0x7fcf5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:10.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.174+0000 7fcf7ea00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 0x7fcf5c06d0f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcf700011e0 tx=0x7fcf70001170 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.177+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcf8012fba0 con 0x7fcf800add80 2024-09-13T18:38:10.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:10.409+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fcf8012fba0 con 0x7fcf800add80 2024-09-13T18:38:11.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.286+0000 7fcf77e00640 1 -- 172.21.15.192:0/2318713238 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v154) v1 ==== 137+0+0 (secure 0 0 0) 0x7fcf8012fba0 con 0x7fcf800add80 2024-09-13T18:38:11.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.288+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 msgr2=0x7fcf5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.288+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 0x7fcf5c06d0f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcf700011e0 tx=0x7fcf70001170 comp rx=0 tx=0).stop 2024-09-13T18:38:11.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.288+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 msgr2=0x7fcf801547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.288+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fcf7800e380 tx=0x7fcf78009750 comp rx=0 tx=0).stop 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 shutdown_connections 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcf5c06ac30 0x7fcf5c06d0f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf800add80 0x7fcf801547a0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcf801f3480 0x7fcf800ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 --2- 172.21.15.192:0/2318713238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcf64007350 0x7fcf801f1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 >> 172.21.15.192:0/2318713238 conn(0x7fcf800ae960 msgr2=0x7fcf80069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:11.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 shutdown_connections 2024-09-13T18:38:11.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.289+0000 7fcf85e00640 1 -- 172.21.15.192:0/2318713238 wait complete. 2024-09-13T18:38:11.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-13T18:38:11.480 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_objectstore":"memstore"} 2024-09-13T18:38:11.481 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-13T18:38:11.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:38:11.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.632+0000 7fa68ee00640 1 Processor -- start 2024-09-13T18:38:11.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.632+0000 7fa68ee00640 1 -- start start 2024-09-13T18:38:11.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa6880b3af0 0x7fa68815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ee00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6880b2000 con 0x7fa68806c0b0 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ee00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6880b2ba0 con 0x7fa6881589f0 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68815bbd0 con 0x7fa6880b3af0 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ce00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa68806c0b0 0x7fa6880cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40786/0 (socket says 172.21.15.192:40786) 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa68ce00640 1 -- 172.21.15.192:0/1469879713 learned_addr learned my addr 172.21.15.192:0/1469879713 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa67fe00640 1 --2- 172.21.15.192:0/1469879713 >> v2:172.21.15.194:3300/0 conn(0x7fa6880b3af0 0x7fa68815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.634+0000 7fa687400640 1 -- 172.21.15.192:0/1469879713 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334951633 0 0) 0x7fa6880b2000 con 0x7fa68806c0b0 2024-09-13T18:38:11.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.635+0000 7fa687400640 1 -- 172.21.15.192:0/1469879713 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa66c003520 con 0x7fa68806c0b0 2024-09-13T18:38:11.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.635+0000 7fa67fe00640 1 -- 172.21.15.192:0/1469879713 >> v1:172.21.15.194:6789/0 conn(0x7fa6881589f0 legacy=0x7fa6880b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.635+0000 7fa67fe00640 1 -- 172.21.15.192:0/1469879713 >> v1:172.21.15.192:6789/0 conn(0x7fa68806c0b0 legacy=0x7fa6880cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.635+0000 7fa67fe00640 1 -- 172.21.15.192:0/1469879713 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68815beb0 con 0x7fa6880b3af0 2024-09-13T18:38:11.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.636+0000 7fa67fe00640 1 --2- 172.21.15.192:0/1469879713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6880b3af0 0x7fa68815b260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6700097a0 tx=0x7fa67002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d78745f485e9c3be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:11.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.636+0000 7fa687400640 1 -- 172.21.15.192:0/1469879713 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670032440 con 0x7fa6880b3af0 2024-09-13T18:38:11.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.636+0000 7fa687400640 1 -- 172.21.15.192:0/1469879713 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6700325a0 con 0x7fa6880b3af0 2024-09-13T18:38:11.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.636+0000 7fa687400640 1 -- 172.21.15.192:0/1469879713 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa670032930 con 0x7fa6880b3af0 2024-09-13T18:38:11.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 -- 172.21.15.192:0/1469879713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6880b3af0 msgr2=0x7fa68815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 --2- 172.21.15.192:0/1469879713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6880b3af0 0x7fa68815b260 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa6700097a0 tx=0x7fa67002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 -- 172.21.15.192:0/1469879713 shutdown_connections 2024-09-13T18:38:11.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 --2- 172.21.15.192:0/1469879713 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa6880b3af0 0x7fa68815b260 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 -- 172.21.15.192:0/1469879713 >> 172.21.15.192:0/1469879713 conn(0x7fa6880b08f0 msgr2=0x7fa6880b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 -- 172.21.15.192:0/1469879713 shutdown_connections 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.637+0000 7fa68ee00640 1 -- 172.21.15.192:0/1469879713 wait complete. 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.639+0000 7fa68ee00640 1 Processor -- start 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.639+0000 7fa68ee00640 1 -- start start 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68806c0b0 0x7fa6881f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6880b3af0 0x7fa688154e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:11.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881f6400 con 0x7fa6881589f0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881e4830 con 0x7fa68806c0b0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6881e4b10 con 0x7fa6880b3af0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49590/0 (socket says 172.21.15.192:49590) 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 -- 172.21.15.192:0/4204059349 learned_addr learned my addr 172.21.15.192:0/4204059349 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa687e00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68806c0b0 0x7fa6881f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa67fe00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6880b3af0 0x7fa688154e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 -- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6880b3af0 msgr2=0x7fa688154e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6880b3af0 0x7fa688154e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.640+0000 7fa68ce00640 1 -- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68806c0b0 msgr2=0x7fa6881f6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa68ce00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68806c0b0 0x7fa6881f6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa68ce00640 1 -- 172.21.15.192:0/4204059349 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa670009400 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa68ce00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa68000cb40 tx=0x7fa68000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68000aca0 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68000ae00 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa680012620 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6881f6650 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.641+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6881558a0 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.642+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6881e4d30 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.643+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa680007070 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.644+0000 7fa684c00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.644+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa6800890c0 con 0x7fa6881589f0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.644+0000 7fa687e00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:11.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.645+0000 7fa687e00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 0x7fa66406d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa68815e670 tx=0x7fa678009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:11.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.648+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa6800545b0 con 0x7fa6881589f0 2024-09-13T18:38:11.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.817+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa68815b260 con 0x7fa6881589f0 2024-09-13T18:38:11.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.822+0000 7fa684c00640 1 -- 172.21.15.192:0/4204059349 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa680057bd0 con 0x7fa6881589f0 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 msgr2=0x7fa66406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 0x7fa66406d0c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa68815e670 tx=0x7fa678009040 comp rx=0 tx=0).stop 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 msgr2=0x7fa6881e3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa68000cb40 tx=0x7fa68000a060 comp rx=0 tx=0).stop 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 shutdown_connections 2024-09-13T18:38:11.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66406ac00 0x7fa66406d0c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa6881589f0 0x7fa6881e3e50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa6880b3af0 0x7fa688154e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 --2- 172.21.15.192:0/4204059349 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68806c0b0 0x7fa6881f6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 >> 172.21.15.192:0/4204059349 conn(0x7fa6880b08f0 msgr2=0x7fa688069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 shutdown_connections 2024-09-13T18:38:11.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:11.824+0000 7fa68ee00640 1 -- 172.21.15.192:0/4204059349 wait complete. 2024-09-13T18:38:11.842 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:38:11.843 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:38:11.937 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:38:12.029 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:38:12.029 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:38:12.029 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:12.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:38:12.065 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:38:12.065 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:12.101 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:38:12.102 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:38:12.102 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:12.139 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:38:12.139 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:38:12.139 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:12.176 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:38:12.177 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:38:12.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:12.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.330+0000 7f08e9200640 1 Processor -- start 2024-09-13T18:38:12.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.330+0000 7f08e9200640 1 -- start start 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e9200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08e40cc530 0x7f08e40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e9200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e40ccec0 con 0x7f08e4071810 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e9200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08e4071dd0 con 0x7f08e4150480 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e9200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e40cb770 con 0x7f08e40cc530 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e1400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f08e4071810 0x7f08e40b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40802/0 (socket says 172.21.15.192:40802) 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e1400640 1 -- 172.21.15.192:0/18295755 learned_addr learned my addr 172.21.15.192:0/18295755 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:12.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.331+0000 7f08e2800640 1 --2- 172.21.15.192:0/18295755 >> v2:172.21.15.192:3300/0 conn(0x7f08e40cc530 0x7f08e40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2040432638 0 0) 0x7f08e40ccec0 con 0x7f08e4071810 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08c8003520 con 0x7f08e4071810 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2553996854 0 0) 0x7f08e4071dd0 con 0x7f08e4150480 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e2800640 1 -- 172.21.15.192:0/18295755 >> v1:172.21.15.194:6789/0 conn(0x7f08e4150480 legacy=0x7f08e415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e2800640 1 -- 172.21.15.192:0/18295755 >> v1:172.21.15.192:6789/0 conn(0x7f08e4071810 legacy=0x7f08e40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.332+0000 7f08e2800640 1 -- 172.21.15.192:0/18295755 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e40cba50 con 0x7f08e40cc530 2024-09-13T18:38:12.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.333+0000 7f08e2800640 1 --2- 172.21.15.192:0/18295755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e40cc530 0x7f08e40cc980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00aea0 tx=0x7f08dc02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747a3e5db941e0e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.333+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc008640 con 0x7f08e40cc530 2024-09-13T18:38:12.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.333+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc02e050 con 0x7f08e40cc530 2024-09-13T18:38:12.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.333+0000 7f08e0a00640 1 -- 172.21.15.192:0/18295755 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc0089a0 con 0x7f08e40cc530 2024-09-13T18:38:12.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 -- 172.21.15.192:0/18295755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e40cc530 msgr2=0x7f08e40cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 --2- 172.21.15.192:0/18295755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e40cc530 0x7f08e40cc980 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f08dc00aea0 tx=0x7f08dc02b7b0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 -- 172.21.15.192:0/18295755 shutdown_connections 2024-09-13T18:38:12.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 --2- 172.21.15.192:0/18295755 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e40cc530 0x7f08e40cc980 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 -- 172.21.15.192:0/18295755 >> 172.21.15.192:0/18295755 conn(0x7f08e40ae960 msgr2=0x7f08e406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 -- 172.21.15.192:0/18295755 shutdown_connections 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.334+0000 7f08e9200640 1 -- 172.21.15.192:0/18295755 wait complete. 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.336+0000 7f08e9200640 1 Processor -- start 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.336+0000 7f08e9200640 1 -- start start 2024-09-13T18:38:12.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 0x7f08e406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08e4150480 0x7f08e406b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e406efe0 con 0x7f08e4071810 2024-09-13T18:38:12.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e406faf0 con 0x7f08e40cc530 2024-09-13T18:38:12.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e9200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e406f1c0 con 0x7f08e4150480 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49610/0 (socket says 172.21.15.192:49610) 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 -- 172.21.15.192:0/2353579956 learned_addr learned my addr 172.21.15.192:0/2353579956 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 -- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08e4150480 msgr2=0x7f08e406b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08e4150480 0x7f08e406b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1400640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 0x7f08e406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 -- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 msgr2=0x7f08e406aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 0x7f08e406aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1e00640 1 -- 172.21.15.192:0/2353579956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08dc00ab80 con 0x7f08e4071810 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.337+0000 7f08e1400640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 0x7f08e406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08e1e00640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c440 tx=0x7f08d400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4005480 con 0x7f08e4071810 2024-09-13T18:38:12.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d40035f0 con 0x7f08e4071810 2024-09-13T18:38:12.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e406f4a0 con 0x7f08e4071810 2024-09-13T18:38:12.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d40039a0 con 0x7f08e4071810 2024-09-13T18:38:12.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.338+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e414cab0 con 0x7f08e4071810 2024-09-13T18:38:12.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.339+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e40cc980 con 0x7f08e4071810 2024-09-13T18:38:12.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.340+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08d4003b00 con 0x7f08e4071810 2024-09-13T18:38:12.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.341+0000 7f08da000640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 0x7f08c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.341+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08d4088510 con 0x7f08e4071810 2024-09-13T18:38:12.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.341+0000 7f08e1400640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 0x7f08c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.341+0000 7f08e1400640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 0x7f08c406d0f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f08e40705c0 tx=0x7f08d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.345+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f08d40539f0 con 0x7f08e4071810 2024-09-13T18:38:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.544+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08e415cb40 con 0x7f08e4071810 2024-09-13T18:38:12.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.545+0000 7f08da000640 1 -- 172.21.15.192:0/2353579956 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f08d4017020 con 0x7f08e4071810 2024-09-13T18:38:12.549 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:12.549 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":26,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5108,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1858811393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1858811393},{"type":"v1","addr":"172.21.15.194:6835","nonce":1858811393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5111,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/1160842178","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1160842178},{"type":"v1","addr":"172.21.15.192:6836","nonce":1160842178}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3982240145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3982240145},{"type":"v1","addr":"172.21.15.192:6837","nonce":3982240145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19},{"gid":5788,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3053367851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3053367851},{"type":"v1","addr":"172.21.15.194:6834","nonce":3053367851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[]} 2024-09-13T18:38:12.550 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 26 2024-09-13T18:38:12.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 msgr2=0x7f08c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 0x7f08c406d0f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f08e40705c0 tx=0x7f08d0009040 comp rx=0 tx=0).stop 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 msgr2=0x7f08e414c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f08d400c440 tx=0x7f08d400c900 comp rx=0 tx=0).stop 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 shutdown_connections 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f08c406ac30 0x7f08c406d0f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08e4150480 0x7f08e406b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08e40cc530 0x7f08e406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 --2- 172.21.15.192:0/2353579956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08e4071810 0x7f08e414c570 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 >> 172.21.15.192:0/2353579956 conn(0x7f08e40ae960 msgr2=0x7f08e415ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 shutdown_connections 2024-09-13T18:38:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.547+0000 7f08e9200640 1 -- 172.21.15.192:0/2353579956 wait complete. 2024-09-13T18:38:12.566 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:38:12.567 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:38:12.567 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:38:12.567 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:12.567 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:38:12.567 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:38:12.569 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:38:12.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:12.569 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:38:12.569 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:38:12.569 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:38:12.569 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:12.569 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:38:12.570 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:38:12.570 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:38:12.570 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:38:12.581 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:38:12.582 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:38:12.583 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:38:12.583 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:38:12.586 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:38:12.587 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:38:12.587 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:38:12.588 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:38:12.627 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:38:12.627 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:12.630 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:38:12.630 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:12.631 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:38:12.632 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:12.634 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:38:12.634 DEBUG:teuthology.parallel:result is None 2024-09-13T18:38:12.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:38:12.758 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:38:12.758 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:38:12.760 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:38:12.760 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:38:12.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.794+0000 7fc977400640 1 Processor -- start 2024-09-13T18:38:12.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.795+0000 7fc977400640 1 -- start start 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc977400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc9700cacd0 0x7fc97015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc977400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc977400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc970140480 con 0x7fc9700cb0b0 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc977400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9700cb520 con 0x7fc9700cacd0 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc977400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97015ee90 con 0x7fc97015bc20 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc974a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc9700cacd0 0x7fc97015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc96fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc9700cb0b0 0x7fc970140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40832/0 (socket says 172.21.15.192:40832) 2024-09-13T18:38:12.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc96fe00640 1 -- 172.21.15.192:0/2007683293 learned_addr learned my addr 172.21.15.192:0/2007683293 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:12.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc975400640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc974a00640 1 -- 172.21.15.192:0/2007683293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 msgr2=0x7fc9700afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:12.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc974a00640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc974a00640 1 -- 172.21.15.192:0/2007683293 >> v1:172.21.15.192:6789/0 conn(0x7fc9700cb0b0 legacy=0x7fc970140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.796+0000 7fc974a00640 1 -- 172.21.15.192:0/2007683293 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc97015f170 con 0x7fc9700cacd0 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.797+0000 7fc974a00640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cacd0 0x7fc97015e790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc9640097a0 tx=0x7fc96402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19116b09290aa71 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc96f400640 1 -- 172.21.15.192:0/2007683293 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964032440 con 0x7fc9700cacd0 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc96f400640 1 -- 172.21.15.192:0/2007683293 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9640325a0 con 0x7fc9700cacd0 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc96f400640 1 -- 172.21.15.192:0/2007683293 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc964032930 con 0x7fc9700cacd0 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 -- 172.21.15.192:0/2007683293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cacd0 msgr2=0x7fc97015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cacd0 0x7fc97015e790 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc9640097a0 tx=0x7fc96402a180 comp rx=0 tx=0).stop 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 -- 172.21.15.192:0/2007683293 shutdown_connections 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 --2- 172.21.15.192:0/2007683293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cacd0 0x7fc97015e790 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 -- 172.21.15.192:0/2007683293 >> 172.21.15.192:0/2007683293 conn(0x7fc9700ae960 msgr2=0x7fc97006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 -- 172.21.15.192:0/2007683293 shutdown_connections 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.798+0000 7fc977400640 1 -- 172.21.15.192:0/2007683293 wait complete. 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.800+0000 7fc977400640 1 Processor -- start 2024-09-13T18:38:12.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.800+0000 7fc977400640 1 -- start start 2024-09-13T18:38:12.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9700cacd0 0x7fc97015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97012ea70 con 0x7fc9700cb0b0 2024-09-13T18:38:12.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97013d680 con 0x7fc9700cacd0 2024-09-13T18:38:12.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc977400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97006c380 con 0x7fc97015bc20 2024-09-13T18:38:12.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc96fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc96fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49642/0 (socket says 172.21.15.192:49642) 2024-09-13T18:38:12.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc96fe00640 1 -- 172.21.15.192:0/731854007 learned_addr learned my addr 172.21.15.192:0/731854007 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:12.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc974a00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9700cacd0 0x7fc97015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.801+0000 7fc975400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 -- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 msgr2=0x7fc9700add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 -- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9700cacd0 msgr2=0x7fc97015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:12.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9700cacd0 0x7fc97015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:12.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 -- 172.21.15.192:0/731854007 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009400 con 0x7fc9700cb0b0 2024-09-13T18:38:12.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96fe00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c480 tx=0x7fc95c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c005ce0 con 0x7fc9700cb0b0 2024-09-13T18:38:12.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95c005e40 con 0x7fc9700cb0b0 2024-09-13T18:38:12.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0072d0 con 0x7fc9700cb0b0 2024-09-13T18:38:12.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97006c0a0 con 0x7fc9700cb0b0 2024-09-13T18:38:12.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.802+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc97012e690 con 0x7fc9700cb0b0 2024-09-13T18:38:12.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.803+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97012ebb0 con 0x7fc9700cb0b0 2024-09-13T18:38:12.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.804+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc95c007430 con 0x7fc9700cb0b0 2024-09-13T18:38:12.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.805+0000 7fc96cc00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 0x7fc95006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:12.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.805+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc95c088150 con 0x7fc9700cb0b0 2024-09-13T18:38:12.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.805+0000 7fc974a00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 0x7fc95006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:12.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.806+0000 7fc974a00640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 0x7fc95006d0f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc964034000 tx=0x7fc96402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:12.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.809+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc97012ebb0 con 0x7fc9700cb0b0 2024-09-13T18:38:12.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:12.986+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc97012ebb0 con 0x7fc9700cb0b0 2024-09-13T18:38:13.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.791+0000 7fc96cc00640 1 -- 172.21.15.192:0/731854007 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v67) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc97012ebb0 con 0x7fc9700cb0b0 2024-09-13T18:38:13.794 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:38:13.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 msgr2=0x7fc95006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 0x7fc95006d0f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc964034000 tx=0x7fc96402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 msgr2=0x7fc9700ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc95c00c480 tx=0x7fc95c00c940 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 shutdown_connections 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc95006ac30 0x7fc95006d0f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc97015bc20 0x7fc9700add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc9700cb0b0 0x7fc9700ad840 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 --2- 172.21.15.192:0/731854007 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc9700cacd0 0x7fc97015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 >> 172.21.15.192:0/731854007 conn(0x7fc9700ae960 msgr2=0x7fc970070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 shutdown_connections 2024-09-13T18:38:13.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.794+0000 7fc977400640 1 -- 172.21.15.192:0/731854007 wait complete. 2024-09-13T18:38:13.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:38:13.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.968+0000 7f3d13200640 1 Processor -- start 2024-09-13T18:38:13.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.968+0000 7f3d13200640 1 -- start start 2024-09-13T18:38:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.969+0000 7f3d13200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3d0c146610 0x7f3d0c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d13200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d0c0b2780 0x7f3d0c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d13200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d0c0ae770 con 0x7f3d0c0afd80 2024-09-13T18:38:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d13200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cd920 con 0x7f3d0c0b2780 2024-09-13T18:38:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d13200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d0c0cdb30 con 0x7f3d0c146610 2024-09-13T18:38:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d0c0b2780 0x7f3d0c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d0c0b2780 0x7f3d0c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49648/0 (socket says 172.21.15.192:49648) 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 -- 172.21.15.192:0/2669530235 learned_addr learned my addr 172.21.15.192:0/2669530235 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d0be00640 1 --2- 172.21.15.192:0/2669530235 >> v2:172.21.15.194:3300/0 conn(0x7f3d0c146610 0x7f3d0c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 -- 172.21.15.192:0/2669530235 >> v2:172.21.15.194:3300/0 conn(0x7f3d0c146610 msgr2=0x7f3d0c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 --2- 172.21.15.192:0/2669530235 >> v2:172.21.15.194:3300/0 conn(0x7f3d0c146610 0x7f3d0c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d03400640 1 -- 172.21.15.192:0/2669530235 >> v1:172.21.15.192:6789/0 conn(0x7f3d0c0afd80 legacy=0x7f3d0c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.971+0000 7f3d03400640 1 -- 172.21.15.192:0/2669530235 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c0ae1b0 con 0x7f3d0c0b2780 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.970+0000 7f3d0b400640 1 -- 172.21.15.192:0/2669530235 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560010806 0 0) 0x7f3d0c0ae770 con 0x7f3d0c0afd80 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.971+0000 7f3d03400640 1 --2- 172.21.15.192:0/2669530235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c0ad840 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009870 tx=0x7f3cf402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0447a539e676c58 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d0b400640 1 -- 172.21.15.192:0/2669530235 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4032440 con 0x7f3d0c0b2780 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d0b400640 1 -- 172.21.15.192:0/2669530235 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf40325a0 con 0x7f3d0c0b2780 2024-09-13T18:38:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d0b400640 1 -- 172.21.15.192:0/2669530235 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4032930 con 0x7f3d0c0b2780 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 -- 172.21.15.192:0/2669530235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 msgr2=0x7f3d0c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 --2- 172.21.15.192:0/2669530235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c0ad840 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009870 tx=0x7f3cf402a210 comp rx=0 tx=0).stop 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 -- 172.21.15.192:0/2669530235 shutdown_connections 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 --2- 172.21.15.192:0/2669530235 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c0ad840 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 --2- 172.21.15.192:0/2669530235 >> v2:172.21.15.194:3300/0 conn(0x7f3d0c146610 0x7f3d0c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 -- 172.21.15.192:0/2669530235 >> 172.21.15.192:0/2669530235 conn(0x7f3d0c0ae960 msgr2=0x7f3d0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 -- 172.21.15.192:0/2669530235 shutdown_connections 2024-09-13T18:38:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.972+0000 7f3d13200640 1 -- 172.21.15.192:0/2669530235 wait complete. 2024-09-13T18:38:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.974+0000 7f3d13200640 1 Processor -- start 2024-09-13T18:38:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.974+0000 7f3d13200640 1 -- start start 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0c0afd80 0x7f3d0c13fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0c146610 0x7f3d0c070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c142250 con 0x7f3d0c0b2780 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c140ff0 con 0x7f3d0c0afd80 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d13200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d0c13f000 con 0x7f3d0c146610 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d03400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d03400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49660/0 (socket says 172.21.15.192:49660) 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.975+0000 7f3d03400640 1 -- 172.21.15.192:0/3850278912 learned_addr learned my addr 172.21.15.192:0/3850278912 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d0be00640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0c0afd80 0x7f3d0c13fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d11200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0c146610 0x7f3d0c070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 -- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0c146610 msgr2=0x7f3d0c070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0c146610 0x7f3d0c070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 -- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0c0afd80 msgr2=0x7f3d0c13fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0c0afd80 0x7f3d0c13fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 -- 172.21.15.192:0/3850278912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cf40094d0 con 0x7f3d0c0b2780 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d03400640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4000c00 tx=0x7f3cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4032440 con 0x7f3d0c0b2780 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cf4030980 con 0x7f3d0c0b2780 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.976+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cf4030d30 con 0x7f3d0c0b2780 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.977+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d0c13f2e0 con 0x7f3d0c0b2780 2024-09-13T18:38:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.977+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d0c140a50 con 0x7f3d0c0b2780 2024-09-13T18:38:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.978+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d0c13ee60 con 0x7f3d0c0b2780 2024-09-13T18:38:13.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.978+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cf4039040 con 0x7f3d0c0b2780 2024-09-13T18:38:13.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.979+0000 7f3d08c00640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 0x7f3ce806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:13.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.979+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3cf40a98b0 con 0x7f3d0c0b2780 2024-09-13T18:38:13.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.980+0000 7f3d0be00640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 0x7f3ce806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:13.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.980+0000 7f3d0be00640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 0x7f3ce806d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009aa0 tx=0x7f3cfc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:13.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:13.983+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3d0c13ee60 con 0x7f3d0c0b2780 2024-09-13T18:38:14.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.213+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3d0c13f800 con 0x7f3d0c0b2780 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.213+0000 7f3d08c00640 1 -- 172.21.15.192:0/3850278912 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f3d0c13f800 con 0x7f3d0c0b2780 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.216 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.217 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:38:14.218 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:38:14.220 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.221 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:38:14.223 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:38:14.225 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:38:14.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.227 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:38:14.228 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:38:14.229 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:38:14.230 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:38:14.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 msgr2=0x7f3ce806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 0x7f3ce806d0c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc009aa0 tx=0x7f3cfc009190 comp rx=0 tx=0).stop 2024-09-13T18:38:14.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 msgr2=0x7f3d0c141d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4000c00 tx=0x7f3cf40046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 shutdown_connections 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ce806ac00 0x7f3ce806d0c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d0c146610 0x7f3d0c070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d0c0b2780 0x7f3d0c141d10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 --2- 172.21.15.192:0/3850278912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d0c0afd80 0x7f3d0c13fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 >> 172.21.15.192:0/3850278912 conn(0x7f3d0c0ae960 msgr2=0x7f3d0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 shutdown_connections 2024-09-13T18:38:14.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.216+0000 7f3d13200640 1 -- 172.21.15.192:0/3850278912 wait complete. 2024-09-13T18:38:14.235 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:14.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.386+0000 7f3656e00640 1 Processor -- start 2024-09-13T18:38:14.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.386+0000 7f3656e00640 1 -- start start 2024-09-13T18:38:14.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3656e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f36500cacd0 0x7f365015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3656e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3650140480 con 0x7f365015bc20 2024-09-13T18:38:14.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3656e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36500cb520 con 0x7f36500cb0b0 2024-09-13T18:38:14.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3656e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365015ee90 con 0x7f36500cacd0 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3654e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f365015bc20 0x7f36500afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40844/0 (socket says 172.21.15.192:40844) 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.387+0000 7f3654e00640 1 -- 172.21.15.192:0/2698078455 learned_addr learned my addr 172.21.15.192:0/2698078455 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364fe00640 1 --2- 172.21.15.192:0/2698078455 >> v2:172.21.15.194:3300/0 conn(0x7f36500cacd0 0x7f365015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364ea00640 1 -- 172.21.15.192:0/2698078455 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1913445505 0 0) 0x7f3650140480 con 0x7f365015bc20 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364ea00640 1 -- 172.21.15.192:0/2698078455 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3634003520 con 0x7f365015bc20 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364fe00640 1 -- 172.21.15.192:0/2698078455 >> v1:172.21.15.194:6789/0 conn(0x7f36500cb0b0 legacy=0x7f3650140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364fe00640 1 -- 172.21.15.192:0/2698078455 >> v1:172.21.15.192:6789/0 conn(0x7f365015bc20 legacy=0x7f36500afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.388+0000 7f364fe00640 1 -- 172.21.15.192:0/2698078455 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f365015f170 con 0x7f36500cacd0 2024-09-13T18:38:14.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.389+0000 7f364fe00640 1 --2- 172.21.15.192:0/2698078455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36500cacd0 0x7f365015e790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f36400097a0 tx=0x7f364002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73715c026109445 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.389+0000 7f364ea00640 1 -- 172.21.15.192:0/2698078455 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640032440 con 0x7f36500cacd0 2024-09-13T18:38:14.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.389+0000 7f364ea00640 1 -- 172.21.15.192:0/2698078455 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36400325a0 con 0x7f36500cacd0 2024-09-13T18:38:14.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.389+0000 7f364ea00640 1 -- 172.21.15.192:0/2698078455 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640032930 con 0x7f36500cacd0 2024-09-13T18:38:14.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 -- 172.21.15.192:0/2698078455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36500cacd0 msgr2=0x7f365015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 --2- 172.21.15.192:0/2698078455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36500cacd0 0x7f365015e790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f36400097a0 tx=0x7f364002a230 comp rx=0 tx=0).stop 2024-09-13T18:38:14.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 -- 172.21.15.192:0/2698078455 shutdown_connections 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 --2- 172.21.15.192:0/2698078455 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36500cacd0 0x7f365015e790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 -- 172.21.15.192:0/2698078455 >> 172.21.15.192:0/2698078455 conn(0x7f36500ae960 msgr2=0x7f365006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 -- 172.21.15.192:0/2698078455 shutdown_connections 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.390+0000 7f3656e00640 1 -- 172.21.15.192:0/2698078455 wait complete. 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.392+0000 7f3656e00640 1 Processor -- start 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.392+0000 7f3656e00640 1 -- start start 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36500cb0b0 0x7f36501576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 0x7f3650157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500af990 con 0x7f36500cacd0 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500a9430 con 0x7f365015bc20 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3656e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500add30 con 0x7f36500cb0b0 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49672/0 (socket says 172.21.15.192:49672) 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 -- 172.21.15.192:0/2381152089 learned_addr learned my addr 172.21.15.192:0/2381152089 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3654e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 0x7f3650157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364f400640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36500cb0b0 0x7f36501576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 -- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36500cb0b0 msgr2=0x7f36501576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36500cb0b0 0x7f36501576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 -- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 msgr2=0x7f3650157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 0x7f3650157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f364fe00640 1 -- 172.21.15.192:0/2381152089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3640009400 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.393+0000 7f3654e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 0x7f3650157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f364fe00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3640035040 tx=0x7f36400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640006e10 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640032e90 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500ae010 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3640030ba0 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.394+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36500ae5d0 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.395+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3650140e20 con 0x7f36500cacd0 2024-09-13T18:38:14.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.396+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3640039040 con 0x7f36500cacd0 2024-09-13T18:38:14.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.397+0000 7f3647e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.397+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f36400a99f0 con 0x7f36500cacd0 2024-09-13T18:38:14.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.397+0000 7f364f400640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.397+0000 7f364f400640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 0x7f363006d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36500aff10 tx=0x7f363c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.401+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3640074e80 con 0x7f36500cacd0 2024-09-13T18:38:14.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.570+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36500a95a0 con 0x7f36500cacd0 2024-09-13T18:38:14.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.571+0000 7f3647e00640 1 -- 172.21.15.192:0/2381152089 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v67) v1 ==== 74+0+12917 (secure 0 0 0) 0x7f36400784a0 con 0x7f36500cacd0 2024-09-13T18:38:14.574 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:14.574 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":67,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:13.788050+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 msgr2=0x7f363006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 0x7f363006d0c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f36500aff10 tx=0x7f363c009040 comp rx=0 tx=0).stop 2024-09-13T18:38:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 msgr2=0x7f36500ad620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3640035040 tx=0x7f36400046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 shutdown_connections 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f363006ac00 0x7f363006d0c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f365015bc20 0x7f3650157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36500cb0b0 0x7f36501576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 --2- 172.21.15.192:0/2381152089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36500cacd0 0x7f36500ad620 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 >> 172.21.15.192:0/2381152089 conn(0x7f36500ae960 msgr2=0x7f365015d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 shutdown_connections 2024-09-13T18:38:14.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.573+0000 7f3656e00640 1 -- 172.21.15.192:0/2381152089 wait complete. 2024-09-13T18:38:14.592 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:38:14.593 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:38:14.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.746+0000 7f2f0f200640 1 Processor -- start 2024-09-13T18:38:14.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.746+0000 7f2f0f200640 1 -- start start 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0815a910 0x7f2f080b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f080adf50 0x7f2f08160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f080b2b40 con 0x7f2f08160ac0 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080b21e0 con 0x7f2f080adf50 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080b1bf0 con 0x7f2f0815a910 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0d200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f080adf50 0x7f2f08160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0d200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2f080adf50 0x7f2f08160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49674/0 (socket says 172.21.15.192:49674) 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0d200640 1 -- 172.21.15.192:0/3438781596 learned_addr learned my addr 172.21.15.192:0/3438781596 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:14.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f07e00640 1 --2- 172.21.15.192:0/3438781596 >> v2:172.21.15.194:3300/0 conn(0x7f2f0815a910 0x7f2f080b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0d200640 1 -- 172.21.15.192:0/3438781596 >> v2:172.21.15.194:3300/0 conn(0x7f2f0815a910 msgr2=0x7f2f080b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.748+0000 7f2f0d200640 1 --2- 172.21.15.192:0/3438781596 >> v2:172.21.15.194:3300/0 conn(0x7f2f0815a910 0x7f2f080b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.749+0000 7f2f0d200640 1 -- 172.21.15.192:0/3438781596 >> v1:172.21.15.194:6789/0 conn(0x7f2f08160ac0 legacy=0x7f2f080ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.749+0000 7f2f0d200640 1 -- 172.21.15.192:0/3438781596 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08161510 con 0x7f2f080adf50 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.749+0000 7f2f0d200640 1 --2- 172.21.15.192:0/3438781596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08160f30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2f080b18c0 tx=0x7f2f0002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6fb29440adb660 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f07400640 1 -- 172.21.15.192:0/3438781596 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00031600 con 0x7f2f080adf50 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f07400640 1 -- 172.21.15.192:0/3438781596 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0002d050 con 0x7f2f080adf50 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f07400640 1 -- 172.21.15.192:0/3438781596 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00031980 con 0x7f2f080adf50 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 -- 172.21.15.192:0/3438781596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 msgr2=0x7f2f08160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 --2- 172.21.15.192:0/3438781596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08160f30 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2f080b18c0 tx=0x7f2f0002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 -- 172.21.15.192:0/3438781596 shutdown_connections 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 --2- 172.21.15.192:0/3438781596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08160f30 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 --2- 172.21.15.192:0/3438781596 >> v2:172.21.15.194:3300/0 conn(0x7f2f0815a910 0x7f2f080b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 -- 172.21.15.192:0/3438781596 >> 172.21.15.192:0/3438781596 conn(0x7f2f080b08f0 msgr2=0x7f2f080b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.750+0000 7f2f0f200640 1 -- 172.21.15.192:0/3438781596 shutdown_connections 2024-09-13T18:38:14.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.751+0000 7f2f0f200640 1 -- 172.21.15.192:0/3438781596 wait complete. 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.752+0000 7f2f0f200640 1 Processor -- start 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.752+0000 7f2f0f200640 1 -- start start 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815a910 0x7f2f08158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f08160ac0 0x7f2f08159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806b7f0 con 0x7f2f080adf50 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806f500 con 0x7f2f0815a910 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f0f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0806f7e0 con 0x7f2f08160ac0 2024-09-13T18:38:14.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49678/0 (socket says 172.21.15.192:49678) 2024-09-13T18:38:14.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.753+0000 7f2f07e00640 1 -- 172.21.15.192:0/2776094938 learned_addr learned my addr 172.21.15.192:0/2776094938 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f0d200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f08160ac0 0x7f2f08159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2eff400640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815a910 0x7f2f08158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 -- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f08160ac0 msgr2=0x7f2f08159490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f08160ac0 0x7f2f08159490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 -- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815a910 msgr2=0x7f2f08158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815a910 0x7f2f08158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 -- 172.21.15.192:0/2776094938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f00009b30 con 0x7f2f080adf50 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f07e00640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800d800 tx=0x7f2ef800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800b6c0 con 0x7f2f080adf50 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef800b820 con 0x7f2f080adf50 2024-09-13T18:38:14.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef800bbb0 con 0x7f2f080adf50 2024-09-13T18:38:14.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0806fac0 con 0x7f2f080adf50 2024-09-13T18:38:14.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.754+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f08070080 con 0x7f2f080adf50 2024-09-13T18:38:14.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.755+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0815be70 con 0x7f2f080adf50 2024-09-13T18:38:14.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.756+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ef800bd10 con 0x7f2f080adf50 2024-09-13T18:38:14.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.758+0000 7f2f04c00640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 0x7f2ee406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:14.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.758+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2ef80896e0 con 0x7f2f080adf50 2024-09-13T18:38:14.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.758+0000 7f2eff400640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 0x7f2ee406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:14.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.758+0000 7f2eff400640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 0x7f2ee406d0c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f081f5900 tx=0x7f2ef0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:14.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.762+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2ef8054ae0 con 0x7f2f080adf50 2024-09-13T18:38:14.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.931+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f081574f0 con 0x7f2f080adf50 2024-09-13T18:38:14.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.931+0000 7f2f04c00640 1 -- 172.21.15.192:0/2776094938 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v67) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ef8058100 con 0x7f2f080adf50 2024-09-13T18:38:14.934 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 msgr2=0x7f2ee406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 0x7f2ee406d0c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2f081f5900 tx=0x7f2ef0009040 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 msgr2=0x7f2f08156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800d800 tx=0x7f2ef800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 shutdown_connections 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee406ac00 0x7f2ee406d0c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f08160ac0 0x7f2f08159490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815a910 0x7f2f08158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 --2- 172.21.15.192:0/2776094938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f080adf50 0x7f2f08156fb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 >> 172.21.15.192:0/2776094938 conn(0x7f2f080b08f0 msgr2=0x7f2f080b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 shutdown_connections 2024-09-13T18:38:14.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:14.934+0000 7f2f0f200640 1 -- 172.21.15.192:0/2776094938 wait complete. 2024-09-13T18:38:14.952 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:38:15.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.101+0000 7fb723400640 1 Processor -- start 2024-09-13T18:38:15.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.101+0000 7fb723400640 1 -- start start 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb723400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb71c071810 0x7fb71c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb723400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c0b2230 0x7fb71c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb723400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c071dd0 con 0x7fb71c150480 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb723400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c0cb770 con 0x7fb71c071810 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb723400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0cba50 con 0x7fb71c0b2230 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb71be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb71c071810 0x7fb71c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb720a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb71c150480 0x7fb71c15a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40856/0 (socket says 172.21.15.192:40856) 2024-09-13T18:38:15.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb720a00640 1 -- 172.21.15.192:0/3915770396 learned_addr learned my addr 172.21.15.192:0/3915770396 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.103+0000 7fb721400640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c0b2230 0x7fb71c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.104+0000 7fb71be00640 1 -- 172.21.15.192:0/3915770396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c0b2230 msgr2=0x7fb71c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.104+0000 7fb71be00640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c0b2230 0x7fb71c0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.104+0000 7fb71be00640 1 -- 172.21.15.192:0/3915770396 >> v1:172.21.15.192:6789/0 conn(0x7fb71c150480 legacy=0x7fb71c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.104+0000 7fb71be00640 1 -- 172.21.15.192:0/3915770396 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c0cbd30 con 0x7fb71c071810 2024-09-13T18:38:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb71be00640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c071810 0x7fb71c0b1cf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097a0 tx=0x7fb70802b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1584531beec7b1d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb71b400640 1 -- 172.21.15.192:0/3915770396 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708033440 con 0x7fb71c071810 2024-09-13T18:38:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb71b400640 1 -- 172.21.15.192:0/3915770396 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080335a0 con 0x7fb71c071810 2024-09-13T18:38:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb71b400640 1 -- 172.21.15.192:0/3915770396 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708033930 con 0x7fb71c071810 2024-09-13T18:38:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 -- 172.21.15.192:0/3915770396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c071810 msgr2=0x7fb71c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c071810 0x7fb71c0b1cf0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb7080097a0 tx=0x7fb70802b200 comp rx=0 tx=0).stop 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 -- 172.21.15.192:0/3915770396 shutdown_connections 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c0b2230 0x7fb71c0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 --2- 172.21.15.192:0/3915770396 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c071810 0x7fb71c0b1cf0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 -- 172.21.15.192:0/3915770396 >> 172.21.15.192:0/3915770396 conn(0x7fb71c0ae960 msgr2=0x7fb71c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.105+0000 7fb723400640 1 -- 172.21.15.192:0/3915770396 shutdown_connections 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.106+0000 7fb723400640 1 -- 172.21.15.192:0/3915770396 wait complete. 2024-09-13T18:38:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.107+0000 7fb723400640 1 Processor -- start 2024-09-13T18:38:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.107+0000 7fb723400640 1 -- start start 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 0x7fb71c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 0x7fb71c151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c150d30 con 0x7fb71c0b2230 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c06a7d0 con 0x7fb71c071810 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb723400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c1524e0 con 0x7fb71c150480 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb71be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb71be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49710/0 (socket says 172.21.15.192:49710) 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.108+0000 7fb71be00640 1 -- 172.21.15.192:0/810187639 learned_addr learned my addr 172.21.15.192:0/810187639 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 -- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 msgr2=0x7fb71c151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb721400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 0x7fb71c151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb720a00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 0x7fb71c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 0x7fb71c151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 -- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 msgr2=0x7fb71c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 0x7fb71c0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 -- 172.21.15.192:0/810187639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708009400 con 0x7fb71c0b2230 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb721400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 0x7fb71c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb720a00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 0x7fb71c0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb71be00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb708036040 tx=0x7fb7080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708042070 con 0x7fb71c0b2230 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708006e10 con 0x7fb71c0b2230 2024-09-13T18:38:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb71c069ea0 con 0x7fb71c0b2230 2024-09-13T18:38:15.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb708031be0 con 0x7fb71c0b2230 2024-09-13T18:38:15.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.109+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c06a460 con 0x7fb71c0b2230 2024-09-13T18:38:15.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.110+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c06a960 con 0x7fb71c0b2230 2024-09-13T18:38:15.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.111+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb70803a070 con 0x7fb71c0b2230 2024-09-13T18:38:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.112+0000 7fb718c00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 0x7fb6fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.112+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb7080a98a0 con 0x7fb71c0b2230 2024-09-13T18:38:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.112+0000 7fb720a00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 0x7fb6fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.113+0000 7fb720a00640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 0x7fb6fc06d0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb70c005880 tx=0x7fb70c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.116+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb708074dc0 con 0x7fb71c0b2230 2024-09-13T18:38:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.286+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb71c152650 con 0x7fb71c0b2230 2024-09-13T18:38:15.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.287+0000 7fb718c00640 1 -- 172.21.15.192:0/810187639 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v67) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb708038020 con 0x7fb71c0b2230 2024-09-13T18:38:15.289 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:38:15.290 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 msgr2=0x7fb6fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 0x7fb6fc06d0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fb70c005880 tx=0x7fb70c009040 comp rx=0 tx=0).stop 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 msgr2=0x7fb71c151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb708036040 tx=0x7fb7080046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 shutdown_connections 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6fc06ac00 0x7fb6fc06d0c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb71c150480 0x7fb71c151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb71c0b2230 0x7fb71c151900 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 --2- 172.21.15.192:0/810187639 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb71c071810 0x7fb71c0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 >> 172.21.15.192:0/810187639 conn(0x7fb71c0ae960 msgr2=0x7fb71c0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 shutdown_connections 2024-09-13T18:38:15.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.289+0000 7fb723400640 1 -- 172.21.15.192:0/810187639 wait complete. 2024-09-13T18:38:15.310 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:38:15.310 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:38:15.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.463+0000 7f7d0ae00640 1 Processor -- start 2024-09-13T18:38:15.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.463+0000 7f7d0ae00640 1 -- start start 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d0ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 0x7f7d0415d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d0ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 0x7f7d040cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d0ae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d0415e110 con 0x7f7d040cca60 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d0ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d040cced0 con 0x7f7d040cb730 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d0ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d0415e3f0 con 0x7f7d040b3d90 2024-09-13T18:38:15.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d08e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7d040cca60 0x7f7d0406fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40868/0 (socket says 172.21.15.192:40868) 2024-09-13T18:38:15.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d08e00640 1 -- 172.21.15.192:0/3563181199 learned_addr learned my addr 172.21.15.192:0/3563181199 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:15.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.464+0000 7f7d03e00640 1 --2- 172.21.15.192:0/3563181199 >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 0x7f7d0415d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3563181199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 0x7f7d040cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7d03400640 1 -- 172.21.15.192:0/3563181199 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 657883307 0 0) 0x7f7d0415e110 con 0x7f7d040cca60 2024-09-13T18:38:15.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7d03400640 1 -- 172.21.15.192:0/3563181199 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ce8003520 con 0x7f7d040cca60 2024-09-13T18:38:15.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7cfbe00640 1 -- 172.21.15.192:0/3563181199 >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 msgr2=0x7f7d0415d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:15.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3563181199 >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 0x7f7d0415d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7cfbe00640 1 -- 172.21.15.192:0/3563181199 >> v1:172.21.15.192:6789/0 conn(0x7f7d040cca60 legacy=0x7f7d0406fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7cfbe00640 1 -- 172.21.15.192:0/3563181199 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d0415e6d0 con 0x7f7d040b3d90 2024-09-13T18:38:15.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.465+0000 7f7d03e00640 1 --2- 172.21.15.192:0/3563181199 >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 0x7f7d0415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:15.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.466+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3563181199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 0x7f7d040cc520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d0edddce1d611e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.466+0000 7f7d03400640 1 -- 172.21.15.192:0/3563181199 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec032440 con 0x7f7d040b3d90 2024-09-13T18:38:15.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.466+0000 7f7d03400640 1 -- 172.21.15.192:0/3563181199 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec0325a0 con 0x7f7d040b3d90 2024-09-13T18:38:15.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.466+0000 7f7d03400640 1 -- 172.21.15.192:0/3563181199 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec032930 con 0x7f7d040b3d90 2024-09-13T18:38:15.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3563181199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 msgr2=0x7f7d040cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3563181199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 0x7f7d040cc520 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02a180 comp rx=0 tx=0).stop 2024-09-13T18:38:15.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3563181199 shutdown_connections 2024-09-13T18:38:15.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3563181199 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040b3d90 0x7f7d040cc520 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3563181199 >> v2:172.21.15.194:3300/0 conn(0x7f7d040cb730 0x7f7d0415d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3563181199 >> 172.21.15.192:0/3563181199 conn(0x7f7d040b0c40 msgr2=0x7f7d040b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3563181199 shutdown_connections 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.467+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3563181199 wait complete. 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.469+0000 7f7d0ae00640 1 Processor -- start 2024-09-13T18:38:15.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.469+0000 7f7d0ae00640 1 -- start start 2024-09-13T18:38:15.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 0x7f7d0415c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040cca60 0x7f7d0415c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04159b10 con 0x7f7d040b3d90 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04159550 con 0x7f7d040cb730 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d0ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d04159830 con 0x7f7d040cca60 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49720/0 (socket says 172.21.15.192:49720) 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 -- 172.21.15.192:0/3862683617 learned_addr learned my addr 172.21.15.192:0/3862683617 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d08e00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040cca60 0x7f7d0415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 0x7f7d0415c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 -- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040cca60 msgr2=0x7f7d0415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040cca60 0x7f7d0415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 -- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 msgr2=0x7f7d0415c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 0x7f7d0415c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7d03e00640 1 -- 172.21.15.192:0/3862683617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf4009400 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.470+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 0x7f7d0415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d03e00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400ebe0 tx=0x7f7cf400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4009760 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400cc30 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400eee0 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cec009400 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.471+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d041f12a0 con 0x7f7d040b3d90 2024-09-13T18:38:15.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.472+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d040cc520 con 0x7f7d040b3d90 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.473+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7cf4013470 con 0x7f7d040b3d90 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.474+0000 7f7d00c00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 0x7f7ce006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.474+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7cf40893c0 con 0x7f7d040b3d90 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.474+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 0x7f7ce006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.474+0000 7f7cfbe00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 0x7f7ce006d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:15.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.478+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7cf4054850 con 0x7f7d040b3d90 2024-09-13T18:38:15.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:15.646+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7d0413c520 con 0x7f7d040b3d90 2024-09-13T18:38:16.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.307+0000 7f7d00c00640 1 -- 172.21.15.192:0/3862683617 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v68) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cf4057e70 con 0x7f7d040b3d90 2024-09-13T18:38:16.310 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 msgr2=0x7f7ce006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 0x7f7ce006d0c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7cec0097a0 tx=0x7f7cec02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 msgr2=0x7f7d0413b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400ebe0 tx=0x7f7cf400c520 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 shutdown_connections 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7ce006ac00 0x7f7ce006d0c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d040cca60 0x7f7d0415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d040cb730 0x7f7d0415c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 --2- 172.21.15.192:0/3862683617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d040b3d90 0x7f7d0413b5b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.311+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 >> 172.21.15.192:0/3862683617 conn(0x7f7d040b0c40 msgr2=0x7f7d0406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.312+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 shutdown_connections 2024-09-13T18:38:16.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.312+0000 7f7d0ae00640 1 -- 172.21.15.192:0/3862683617 wait complete. 2024-09-13T18:38:16.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:38:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.492+0000 7fead5800640 1 Processor -- start 2024-09-13T18:38:16.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.492+0000 7fead5800640 1 -- start start 2024-09-13T18:38:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7fead5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fead00b3af0 0x7fead015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7fead5800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fead006c0b0 0x7fead006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7fead5800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead00b2000 con 0x7fead01589f0 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7fead5800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead00b2ba0 con 0x7fead006c0b0 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7fead5800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead006ca30 con 0x7fead00b3af0 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7feacea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fead01589f0 0x7fead00b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40874/0 (socket says 172.21.15.192:40874) 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7feacea00640 1 -- 172.21.15.192:0/1340987250 learned_addr learned my addr 172.21.15.192:0/1340987250 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.493+0000 7feacf400640 1 --2- 172.21.15.192:0/1340987250 >> v2:172.21.15.192:3300/0 conn(0x7fead006c0b0 0x7fead006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.494+0000 7feac7e00640 1 --2- 172.21.15.192:0/1340987250 >> v2:172.21.15.194:3300/0 conn(0x7fead00b3af0 0x7fead015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.494+0000 7feacf400640 1 -- 172.21.15.192:0/1340987250 >> v2:172.21.15.194:3300/0 conn(0x7fead00b3af0 msgr2=0x7fead015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.494+0000 7feacf400640 1 --2- 172.21.15.192:0/1340987250 >> v2:172.21.15.194:3300/0 conn(0x7fead00b3af0 0x7fead015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.494+0000 7feacf400640 1 -- 172.21.15.192:0/1340987250 >> v1:172.21.15.192:6789/0 conn(0x7fead01589f0 legacy=0x7fead00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.494+0000 7feacf400640 1 -- 172.21.15.192:0/1340987250 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead015bbd0 con 0x7fead006c0b0 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.495+0000 7feacf400640 1 --2- 172.21.15.192:0/1340987250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead006c0b0 0x7fead006c4f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fead006edf0 tx=0x7feac802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d2ef1667550fed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.495+0000 7feace000640 1 -- 172.21.15.192:0/1340987250 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8007740 con 0x7fead006c0b0 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.495+0000 7feace000640 1 -- 172.21.15.192:0/1340987250 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac802d050 con 0x7fead006c0b0 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.495+0000 7feace000640 1 -- 172.21.15.192:0/1340987250 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac8007ac0 con 0x7fead006c0b0 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 -- 172.21.15.192:0/1340987250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead006c0b0 msgr2=0x7fead006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 --2- 172.21.15.192:0/1340987250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead006c0b0 0x7fead006c4f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fead006edf0 tx=0x7feac802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 -- 172.21.15.192:0/1340987250 shutdown_connections 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 --2- 172.21.15.192:0/1340987250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead006c0b0 0x7fead006c4f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 --2- 172.21.15.192:0/1340987250 >> v2:172.21.15.194:3300/0 conn(0x7fead00b3af0 0x7fead015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 -- 172.21.15.192:0/1340987250 >> 172.21.15.192:0/1340987250 conn(0x7fead00b08f0 msgr2=0x7fead00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 -- 172.21.15.192:0/1340987250 shutdown_connections 2024-09-13T18:38:16.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.496+0000 7fead5800640 1 -- 172.21.15.192:0/1340987250 wait complete. 2024-09-13T18:38:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.497+0000 7fead5800640 1 Processor -- start 2024-09-13T18:38:16.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.497+0000 7fead5800640 1 -- start start 2024-09-13T18:38:16.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 0x7fead01f0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 0x7fead015cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ab1b0 con 0x7fead00b3af0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ab490 con 0x7fead01589f0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7fead5800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead00ac7a0 con 0x7fead006c0b0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.498+0000 7feac7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49742/0 (socket says 172.21.15.192:49742) 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 -- 172.21.15.192:0/3258177358 learned_addr learned my addr 172.21.15.192:0/3258177358 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feacea00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 0x7fead01f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 -- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 msgr2=0x7fead01f0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feacf400640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 0x7fead015cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 0x7fead01f0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 -- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 msgr2=0x7fead015cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 0x7fead015cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 -- 172.21.15.192:0/3258177358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac8009a70 con 0x7fead00b3af0 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feacea00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 0x7fead01f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feacf400640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 0x7fead015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac7e00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7feab800d800 tx=0x7feab800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.499+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800b6c0 con 0x7fead00b3af0 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.500+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feab800b820 con 0x7fead00b3af0 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.500+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead00aca80 con 0x7fead00b3af0 2024-09-13T18:38:16.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.500+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feab800bbb0 con 0x7fead00b3af0 2024-09-13T18:38:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.500+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead014eb90 con 0x7fead00b3af0 2024-09-13T18:38:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.500+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead006c4f0 con 0x7fead00b3af0 2024-09-13T18:38:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.502+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feab800bd10 con 0x7fead00b3af0 2024-09-13T18:38:16.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.503+0000 7feac6a00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.503+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 5227+0+0 (secure 0 0 0) 0x7feab808a1e0 con 0x7fead00b3af0 2024-09-13T18:38:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.503+0000 7feacea00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:16.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.503+0000 7feacea00640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 0x7feaac06d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feac0005880 tx=0x7feac0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:16.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.506+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feab8055610 con 0x7fead00b3af0 2024-09-13T18:38:16.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:16.676+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fead00cb8f0 con 0x7fead00b3af0 2024-09-13T18:38:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.320+0000 7feac6a00640 1 -- 172.21.15.192:0/3258177358 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v69) v1 ==== 170+0+0 (secure 0 0 0) 0x7feab8058c30 con 0x7fead00b3af0 2024-09-13T18:38:17.323 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:38:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.326+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 msgr2=0x7feaac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.326+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 0x7feaac06d0c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feac0005880 tx=0x7feac0009040 comp rx=0 tx=0).stop 2024-09-13T18:38:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.326+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 msgr2=0x7fead014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.326+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7feab800d800 tx=0x7feab800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 shutdown_connections 2024-09-13T18:38:17.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaac06ac00 0x7feaac06d0c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fead01589f0 0x7fead015cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fead00b3af0 0x7fead014e650 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 --2- 172.21.15.192:0/3258177358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fead006c0b0 0x7fead01f0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 >> 172.21.15.192:0/3258177358 conn(0x7fead00b08f0 msgr2=0x7fead015c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.327+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 shutdown_connections 2024-09-13T18:38:17.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.328+0000 7fead5800640 1 -- 172.21.15.192:0/3258177358 wait complete. 2024-09-13T18:38:17.347 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:38:17.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.499+0000 7fd49f000640 1 Processor -- start 2024-09-13T18:38:17.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.499+0000 7fd49f000640 1 -- start start 2024-09-13T18:38:17.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.500+0000 7fd49f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4980cb330 0x7fd49806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.500+0000 7fd49f000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd4980cdf60 0x7fd4980ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd49f000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49815a8e0 con 0x7fd4980b3470 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd49f000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980b2fe0 con 0x7fd4980cdf60 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd49f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4980b26b0 con 0x7fd4980cb330 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd4980cdf60 0x7fd4980ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd49d000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd4980b3470 0x7fd4980b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40882/0 (socket says 172.21.15.192:40882) 2024-09-13T18:38:17.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd49d000640 1 -- 172.21.15.192:0/3734608976 learned_addr learned my addr 172.21.15.192:0/3734608976 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497e00640 1 --2- 172.21.15.192:0/3734608976 >> v2:172.21.15.194:3300/0 conn(0x7fd4980cb330 0x7fd49806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497400640 1 -- 172.21.15.192:0/3734608976 >> v2:172.21.15.194:3300/0 conn(0x7fd4980cb330 msgr2=0x7fd49806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497400640 1 --2- 172.21.15.192:0/3734608976 >> v2:172.21.15.194:3300/0 conn(0x7fd4980cb330 0x7fd49806ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497400640 1 -- 172.21.15.192:0/3734608976 >> v1:172.21.15.192:6789/0 conn(0x7fd4980b3470 legacy=0x7fd4980b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.501+0000 7fd497400640 1 -- 172.21.15.192:0/3734608976 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980b2990 con 0x7fd4980cdf60 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.502+0000 7fd497400640 1 --2- 172.21.15.192:0/3734608976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980cdf60 0x7fd4980ce3f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd4980b18c0 tx=0x7fd48402a080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efadce05b8ae2613 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.502+0000 7fd496a00640 1 -- 172.21.15.192:0/3734608976 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48402add0 con 0x7fd4980cdf60 2024-09-13T18:38:17.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd496a00640 1 -- 172.21.15.192:0/3734608976 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484032440 con 0x7fd4980cdf60 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd496a00640 1 -- 172.21.15.192:0/3734608976 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4840327d0 con 0x7fd4980cdf60 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 -- 172.21.15.192:0/3734608976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980cdf60 msgr2=0x7fd4980ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 --2- 172.21.15.192:0/3734608976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980cdf60 0x7fd4980ce3f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fd4980b18c0 tx=0x7fd48402a080 comp rx=0 tx=0).stop 2024-09-13T18:38:17.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 -- 172.21.15.192:0/3734608976 shutdown_connections 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 --2- 172.21.15.192:0/3734608976 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980cdf60 0x7fd4980ce3f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 --2- 172.21.15.192:0/3734608976 >> v2:172.21.15.194:3300/0 conn(0x7fd4980cb330 0x7fd49806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 -- 172.21.15.192:0/3734608976 >> 172.21.15.192:0/3734608976 conn(0x7fd4980b08f0 msgr2=0x7fd4980b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 -- 172.21.15.192:0/3734608976 shutdown_connections 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.503+0000 7fd49f000640 1 -- 172.21.15.192:0/3734608976 wait complete. 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.505+0000 7fd49f000640 1 Processor -- start 2024-09-13T18:38:17.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.505+0000 7fd49f000640 1 -- start start 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 0x7fd498155610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 0x7fd49814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814ef00 con 0x7fd4980b3470 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814bb70 con 0x7fd4980cb330 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49814e280 con 0x7fd4980cdf60 2024-09-13T18:38:17.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49754/0 (socket says 172.21.15.192:49754) 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 -- 172.21.15.192:0/772897564 learned_addr learned my addr 172.21.15.192:0/772897564 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49d000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 0x7fd49814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497400640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 0x7fd498155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 -- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 msgr2=0x7fd49814aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 0x7fd49814aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 -- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 msgr2=0x7fd498155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 0x7fd498155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497e00640 1 -- 172.21.15.192:0/772897564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd484009400 con 0x7fd4980b3470 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd497400640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 0x7fd498155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.506+0000 7fd49d000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 0x7fd49814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:17.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd497e00640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd48800d620 tx=0x7fd48800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800b620 con 0x7fd4980b3470 2024-09-13T18:38:17.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48800b780 con 0x7fd4980b3470 2024-09-13T18:38:17.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48800bb30 con 0x7fd4980b3470 2024-09-13T18:38:17.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd49814e560 con 0x7fd4980b3470 2024-09-13T18:38:17.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.507+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd49814eb20 con 0x7fd4980b3470 2024-09-13T18:38:17.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.508+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4980b0fb0 con 0x7fd4980b3470 2024-09-13T18:38:17.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.509+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd48800bc90 con 0x7fd4980b3470 2024-09-13T18:38:17.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.510+0000 7fd48fe00640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 0x7fd47806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.510+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd4880897b0 con 0x7fd4980b3470 2024-09-13T18:38:17.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.510+0000 7fd497400640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 0x7fd47806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.511+0000 7fd497400640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 0x7fd47806d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd484034000 tx=0x7fd48402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.515+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd4880549e0 con 0x7fd4980b3470 2024-09-13T18:38:17.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.715+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd4980b0cd0 con 0x7fd4980b3470 2024-09-13T18:38:17.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.723+0000 7fd48fe00640 1 -- 172.21.15.192:0/772897564 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd488058000 con 0x7fd4980b3470 2024-09-13T18:38:17.729 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 8 and data pool 9 2024-09-13T18:38:17.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 msgr2=0x7fd47806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 0x7fd47806d0c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd484034000 tx=0x7fd48402e000 comp rx=0 tx=0).stop 2024-09-13T18:38:17.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 msgr2=0x7fd49814dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd48800d620 tx=0x7fd48800dae0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 shutdown_connections 2024-09-13T18:38:17.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd47806ac00 0x7fd47806d0c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4980cdf60 0x7fd49814aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4980cb330 0x7fd498155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 --2- 172.21.15.192:0/772897564 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4980b3470 0x7fd49814dc10 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.727+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 >> 172.21.15.192:0/772897564 conn(0x7fd4980b08f0 msgr2=0x7fd49806bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.729+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 shutdown_connections 2024-09-13T18:38:17.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.729+0000 7fd49f000640 1 -- 172.21.15.192:0/772897564 wait complete. 2024-09-13T18:38:17.757 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:17.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.908+0000 7fd9dec00640 1 Processor -- start 2024-09-13T18:38:17.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.908+0000 7fd9dec00640 1 -- start start 2024-09-13T18:38:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.909+0000 7fd9dec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.909+0000 7fd9dec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.909+0000 7fd9dec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d80b2f00 con 0x7fd9d80b3f10 2024-09-13T18:38:17.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.909+0000 7fd9dec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d80b3150 con 0x7fd9d815e2c0 2024-09-13T18:38:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.909+0000 7fd9dec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80b3430 con 0x7fd9d815dee0 2024-09-13T18:38:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9dcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9d7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9dcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:50136/0 (socket says 172.21.15.192:50136) 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9d7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37888/0 (socket says 172.21.15.192:37888) 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9dcc00640 1 -- 172.21.15.192:0/2844465009 learned_addr learned my addr 172.21.15.192:0/2844465009 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.910+0000 7fd9d7400640 1 --1- 172.21.15.192:0/2844465009 >> v1:172.21.15.194:6789/0 conn(0x7fd9d80b3f10 0x7fd9d815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:35286/0 (socket says 172.21.15.192:35286) 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.911+0000 7fd9d7e00640 1 -- 172.21.15.192:0/2844465009 >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 msgr2=0x7fd9d815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.911+0000 7fd9d7e00640 1 --2- 172.21.15.192:0/2844465009 >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.911+0000 7fd9d7e00640 1 -- 172.21.15.192:0/2844465009 >> v1:172.21.15.194:6789/0 conn(0x7fd9d80b3f10 legacy=0x7fd9d815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.911+0000 7fd9d7e00640 1 -- 172.21.15.192:0/2844465009 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80b3710 con 0x7fd9d815dee0 2024-09-13T18:38:17.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.911+0000 7fd9dcc00640 1 --2- 172.21.15.192:0/2844465009 >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9d7e00640 1 --2- 172.21.15.192:0/2844465009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80097a0 tx=0x7fd9c802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1590f66fea02e426 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9d6a00640 1 -- 172.21.15.192:0/2844465009 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8032440 con 0x7fd9d815dee0 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9d6a00640 1 -- 172.21.15.192:0/2844465009 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c80325a0 con 0x7fd9d815dee0 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9d6a00640 1 -- 172.21.15.192:0/2844465009 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8032930 con 0x7fd9d815dee0 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9dec00640 1 -- 172.21.15.192:0/2844465009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 msgr2=0x7fd9d80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.912+0000 7fd9dec00640 1 --2- 172.21.15.192:0/2844465009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fd9c80097a0 tx=0x7fd9c802a180 comp rx=0 tx=0).stop 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 -- 172.21.15.192:0/2844465009 shutdown_connections 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 --2- 172.21.15.192:0/2844465009 >> v2:172.21.15.194:3300/0 conn(0x7fd9d815e2c0 0x7fd9d815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 --2- 172.21.15.192:0/2844465009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d80afd80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 -- 172.21.15.192:0/2844465009 >> 172.21.15.192:0/2844465009 conn(0x7fd9d80ae960 msgr2=0x7fd9d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 -- 172.21.15.192:0/2844465009 shutdown_connections 2024-09-13T18:38:17.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.913+0000 7fd9dec00640 1 -- 172.21.15.192:0/2844465009 wait complete. 2024-09-13T18:38:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.914+0000 7fd9dec00640 1 Processor -- start 2024-09-13T18:38:17.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.914+0000 7fd9dec00640 1 -- start start 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d813bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d815e2c0 0x7fd9d80ac540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d80acf10 con 0x7fd9d80aca80 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d8129590 con 0x7fd9d815e2c0 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.915+0000 7fd9dec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d813f8d0 con 0x7fd9d815dee0 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49756/0 (socket says 172.21.15.192:49756) 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 -- 172.21.15.192:0/89957817 learned_addr learned my addr 172.21.15.192:0/89957817 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:17.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9d7400640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d815e2c0 0x7fd9d80ac540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9d7e00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d813bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 -- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 msgr2=0x7fd9d813bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d813bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 -- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d815e2c0 msgr2=0x7fd9d80ac540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d815e2c0 0x7fd9d80ac540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 -- 172.21.15.192:0/89957817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d0009b30 con 0x7fd9d80aca80 2024-09-13T18:38:17.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.916+0000 7fd9dcc00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000efc0 tx=0x7fd9d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.917+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0018070 con 0x7fd9d80aca80 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.917+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000f040 con 0x7fd9d80aca80 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.917+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9c8009400 con 0x7fd9d80aca80 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.917+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000ce00 con 0x7fd9d80aca80 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.917+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d8128f40 con 0x7fd9d80aca80 2024-09-13T18:38:17.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.918+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d8129700 con 0x7fd9d80aca80 2024-09-13T18:38:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.919+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9d0014480 con 0x7fd9d80aca80 2024-09-13T18:38:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.919+0000 7fd9cfe00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 0x7fd9b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.920+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9d0089400 con 0x7fd9d80aca80 2024-09-13T18:38:17.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.920+0000 7fd9d7e00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 0x7fd9b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:17.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.921+0000 7fd9d7e00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 0x7fd9b806d0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8034000 tx=0x7fd9c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:17.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:17.924+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9d00545f0 con 0x7fd9d80aca80 2024-09-13T18:38:18.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.092+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d80afd80 con 0x7fd9d80aca80 2024-09-13T18:38:18.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.094+0000 7fd9cfe00640 1 -- 172.21.15.192:0/89957817 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16638 (secure 0 0 0) 0x7fd9d0057c10 con 0x7fd9d80aca80 2024-09-13T18:38:18.097 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:18.097 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:17.717546+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:18.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 msgr2=0x7fd9b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 0x7fd9b806d0f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8034000 tx=0x7fd9c802e000 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 msgr2=0x7fd9d813eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000efc0 tx=0x7fd9d000c490 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 shutdown_connections 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b806ac30 0x7fd9b806d0f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d80aca80 0x7fd9d813eb50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d815e2c0 0x7fd9d80ac540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 --2- 172.21.15.192:0/89957817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d815dee0 0x7fd9d813bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 >> 172.21.15.192:0/89957817 conn(0x7fd9d80ae960 msgr2=0x7fd9d80b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 shutdown_connections 2024-09-13T18:38:18.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.096+0000 7fd9dec00640 1 -- 172.21.15.192:0/89957817 wait complete. 2024-09-13T18:38:18.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:18.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.264+0000 7fd29c800640 1 Processor -- start 2024-09-13T18:38:18.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.264+0000 7fd29c800640 1 -- start start 2024-09-13T18:38:18.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd29c800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2940b3f10 0x7fd29415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd29c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940b2f00 con 0x7fd29415dee0 2024-09-13T18:38:18.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd29c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2940b3150 con 0x7fd2940b0490 2024-09-13T18:38:18.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd29c800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2940b3430 con 0x7fd2940b3f10 2024-09-13T18:38:18.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd299e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd29415dee0 0x7fd2940afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:40884/0 (socket says 172.21.15.192:40884) 2024-09-13T18:38:18.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.265+0000 7fd299e00640 1 -- 172.21.15.192:0/2395145558 learned_addr learned my addr 172.21.15.192:0/2395145558 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd299400640 1 --2- 172.21.15.192:0/2395145558 >> v2:172.21.15.194:3300/0 conn(0x7fd2940b3f10 0x7fd29415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289295589 0 0) 0x7fd2940b2f00 con 0x7fd29415dee0 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd27c003520 con 0x7fd29415dee0 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd299400640 1 -- 172.21.15.192:0/2395145558 >> v1:172.21.15.194:6789/0 conn(0x7fd2940b0490 legacy=0x7fd29415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 486009660 0 0) 0x7fd27c003520 con 0x7fd29415dee0 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd299400640 1 -- 172.21.15.192:0/2395145558 >> v1:172.21.15.192:6789/0 conn(0x7fd29415dee0 legacy=0x7fd2940afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.266+0000 7fd299400640 1 -- 172.21.15.192:0/2395145558 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2940b3710 con 0x7fd2940b3f10 2024-09-13T18:38:18.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.267+0000 7fd299400640 1 --2- 172.21.15.192:0/2395145558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b3f10 0x7fd29415a440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd2840097a0 tx=0x7fd28402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0149f04d357f631 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.267+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288001670 con 0x7fd2940b3f10 2024-09-13T18:38:18.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28402ac50 con 0x7fd2940b3f10 2024-09-13T18:38:18.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd298a00640 1 -- 172.21.15.192:0/2395145558 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284032440 con 0x7fd2940b3f10 2024-09-13T18:38:18.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 -- 172.21.15.192:0/2395145558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b3f10 msgr2=0x7fd29415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 --2- 172.21.15.192:0/2395145558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b3f10 0x7fd29415a440 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd2840097a0 tx=0x7fd28402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 -- 172.21.15.192:0/2395145558 shutdown_connections 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 --2- 172.21.15.192:0/2395145558 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b3f10 0x7fd29415a440 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 -- 172.21.15.192:0/2395145558 >> 172.21.15.192:0/2395145558 conn(0x7fd2940ae960 msgr2=0x7fd29406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 -- 172.21.15.192:0/2395145558 shutdown_connections 2024-09-13T18:38:18.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.268+0000 7fd29c800640 1 -- 172.21.15.192:0/2395145558 wait complete. 2024-09-13T18:38:18.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.270+0000 7fd29c800640 1 Processor -- start 2024-09-13T18:38:18.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.270+0000 7fd29c800640 1 -- start start 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b0490 0x7fd294070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2941f4020 0x7fd2941f44d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2941549c0 con 0x7fd29415dee0 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd294071260 con 0x7fd2940b0490 2024-09-13T18:38:18.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2940702d0 con 0x7fd2941f4020 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd299400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd299400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49758/0 (socket says 172.21.15.192:49758) 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd299400640 1 -- 172.21.15.192:0/2076418031 learned_addr learned my addr 172.21.15.192:0/2076418031 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd299e00640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b0490 0x7fd294070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.271+0000 7fd29a800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2941f4020 0x7fd2941f44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 -- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2941f4020 msgr2=0x7fd2941f44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2941f4020 0x7fd2941f44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 -- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b0490 msgr2=0x7fd294070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b0490 0x7fd294070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 -- 172.21.15.192:0/2076418031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd284009400 con 0x7fd29415dee0 2024-09-13T18:38:18.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd299400640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd284035040 tx=0x7fd2840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28403c680 con 0x7fd29415dee0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28403c7e0 con 0x7fd29415dee0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29413fb10 con 0x7fd29415dee0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28403cb70 con 0x7fd29415dee0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.272+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd294070520 con 0x7fd29415dee0 2024-09-13T18:38:18.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.273+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2940afd80 con 0x7fd29415dee0 2024-09-13T18:38:18.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.274+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd284039040 con 0x7fd29415dee0 2024-09-13T18:38:18.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.275+0000 7fd28e000640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 0x7fd27806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.276+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2840a96e0 con 0x7fd29415dee0 2024-09-13T18:38:18.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.276+0000 7fd299e00640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 0x7fd27806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.276+0000 7fd299e00640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 0x7fd27806d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd288000f60 tx=0x7fd288001ce0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.280+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd2840748d0 con 0x7fd29415dee0 2024-09-13T18:38:18.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.453+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd294067410 con 0x7fd29415dee0 2024-09-13T18:38:18.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.454+0000 7fd28e000640 1 -- 172.21.15.192:0/2076418031 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16638 (secure 0 0 0) 0x7fd284077ef0 con 0x7fd29415dee0 2024-09-13T18:38:18.457 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:18.457 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:17.717546+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:18.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 msgr2=0x7fd27806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 0x7fd27806d0f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd288000f60 tx=0x7fd288001ce0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 msgr2=0x7fd294136540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fd284035040 tx=0x7fd2840046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 shutdown_connections 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd27806ac30 0x7fd27806d0f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2941f4020 0x7fd2941f44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd29415dee0 0x7fd294136540 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 --2- 172.21.15.192:0/2076418031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2940b0490 0x7fd294070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 >> 172.21.15.192:0/2076418031 conn(0x7fd2940ae960 msgr2=0x7fd2941383b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.456+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 shutdown_connections 2024-09-13T18:38:18.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.457+0000 7fd29c800640 1 -- 172.21.15.192:0/2076418031 wait complete. 2024-09-13T18:38:18.476 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:38:18.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.628+0000 7fa15e000640 1 Processor -- start 2024-09-13T18:38:18.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.628+0000 7fa15e000640 1 -- start start 2024-09-13T18:38:18.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.629+0000 7fa15e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa1580cb330 0x7fa15806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.629+0000 7fa15e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa1580cdf60 0x7fa1580ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.629+0000 7fa15e000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa15815a8e0 con 0x7fa1580b3470 2024-09-13T18:38:18.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.629+0000 7fa15e000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1580b2fe0 con 0x7fa1580cdf60 2024-09-13T18:38:18.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.629+0000 7fa15e000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1580b26b0 con 0x7fa1580cb330 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa1580cdf60 0x7fa1580ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa1580cdf60 0x7fa1580ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49774/0 (socket says 172.21.15.192:49774) 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 -- 172.21.15.192:0/2131299899 learned_addr learned my addr 172.21.15.192:0/2131299899 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa157400640 1 --2- 172.21.15.192:0/2131299899 >> v2:172.21.15.194:3300/0 conn(0x7fa1580cb330 0x7fa15806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 -- 172.21.15.192:0/2131299899 >> v2:172.21.15.194:3300/0 conn(0x7fa1580cb330 msgr2=0x7fa15806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 --2- 172.21.15.192:0/2131299899 >> v2:172.21.15.194:3300/0 conn(0x7fa1580cb330 0x7fa15806ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 -- 172.21.15.192:0/2131299899 >> v1:172.21.15.192:6789/0 conn(0x7fa1580b3470 legacy=0x7fa1580b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa14ea00640 1 -- 172.21.15.192:0/2131299899 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580b2990 con 0x7fa1580cdf60 2024-09-13T18:38:18.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.630+0000 7fa156a00640 1 -- 172.21.15.192:0/2131299899 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2123497234 0 0) 0x7fa15815a8e0 con 0x7fa1580b3470 2024-09-13T18:38:18.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.631+0000 7fa14ea00640 1 --2- 172.21.15.192:0/2131299899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa1580ce3f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b18c0 tx=0x7fa14002a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2599275c3da30c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.631+0000 7fa156a00640 1 -- 172.21.15.192:0/2131299899 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14002aea0 con 0x7fa1580cdf60 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.631+0000 7fa156a00640 1 -- 172.21.15.192:0/2131299899 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa140032440 con 0x7fa1580cdf60 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.631+0000 7fa156a00640 1 -- 172.21.15.192:0/2131299899 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1400327d0 con 0x7fa1580cdf60 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 -- 172.21.15.192:0/2131299899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 msgr2=0x7fa1580ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 --2- 172.21.15.192:0/2131299899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa1580ce3f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b18c0 tx=0x7fa14002a150 comp rx=0 tx=0).stop 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 -- 172.21.15.192:0/2131299899 shutdown_connections 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 --2- 172.21.15.192:0/2131299899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa1580ce3f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 --2- 172.21.15.192:0/2131299899 >> v2:172.21.15.194:3300/0 conn(0x7fa1580cb330 0x7fa15806ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 -- 172.21.15.192:0/2131299899 >> 172.21.15.192:0/2131299899 conn(0x7fa1580b08f0 msgr2=0x7fa1580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 -- 172.21.15.192:0/2131299899 shutdown_connections 2024-09-13T18:38:18.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.632+0000 7fa15e000640 1 -- 172.21.15.192:0/2131299899 wait complete. 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.634+0000 7fa15e000640 1 Processor -- start 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.634+0000 7fa15e000640 1 -- start start 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580b3470 0x7fa15815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1580cb330 0x7fa1581567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15815aef0 con 0x7fa1580cdf60 2024-09-13T18:38:18.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15814dc60 con 0x7fa1580cb330 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa15e000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15814ca30 con 0x7fa1580b3470 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49786/0 (socket says 172.21.15.192:49786) 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 -- 172.21.15.192:0/1168353402 learned_addr learned my addr 172.21.15.192:0/1168353402 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa14ea00640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1580cb330 0x7fa1581567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157400640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580b3470 0x7fa15815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 -- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580b3470 msgr2=0x7fa15815c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580b3470 0x7fa15815c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 -- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1580cb330 msgr2=0x7fa1581567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1580cb330 0x7fa1581567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:18.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.635+0000 7fa157e00640 1 -- 172.21.15.192:0/1168353402 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1400094d0 con 0x7fa1580cdf60 2024-09-13T18:38:18.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa157e00640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c710 tx=0x7fa15000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150003da0 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15000ce20 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150005290 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15814cd10 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.636+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15814d2d0 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.637+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15815b060 con 0x7fa1580cdf60 2024-09-13T18:38:18.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.638+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa1500053f0 con 0x7fa1580cdf60 2024-09-13T18:38:18.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.639+0000 7fa14fe00640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 0x7fa13406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:18.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.639+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa150088b10 con 0x7fa1580cdf60 2024-09-13T18:38:18.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.639+0000 7fa157400640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 0x7fa13406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:18.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.640+0000 7fa157400640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 0x7fa13406d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa1480079a0 tx=0x7fa148008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:18.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.643+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa150053da0 con 0x7fa1580cdf60 2024-09-13T18:38:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:18.850+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa15806b0e0 con 0x7fa1580cdf60 2024-09-13T18:38:19.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.742+0000 7fa14fe00640 1 -- 172.21.15.192:0/1168353402 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa150017070 con 0x7fa1580cdf60 2024-09-13T18:38:19.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 msgr2=0x7fa13406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 0x7fa13406d0c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa1480079a0 tx=0x7fa148008040 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 msgr2=0x7fa15815d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c710 tx=0x7fa15000cbd0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 shutdown_connections 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13406ac00 0x7fa13406d0c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa1580cdf60 0x7fa15815d200 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa1580cb330 0x7fa1581567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 --2- 172.21.15.192:0/1168353402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580b3470 0x7fa15815c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.744+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 >> 172.21.15.192:0/1168353402 conn(0x7fa1580b08f0 msgr2=0x7fa1580b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.745+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 shutdown_connections 2024-09-13T18:38:19.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.745+0000 7fa15e000640 1 -- 172.21.15.192:0/1168353402 wait complete. 2024-09-13T18:38:19.764 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:38:19.765 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:38:19.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.920+0000 7ffb01e00640 1 Processor -- start 2024-09-13T18:38:19.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.920+0000 7ffb01e00640 1 -- start start 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb01e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffafc1402c0 0x7ffafc15e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb01e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc15b070 con 0x7ffafc15b810 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb01e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffafc15eba0 con 0x7ffafc0b02f0 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb01e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffafc15ee20 con 0x7ffafc1402c0 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb00a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffafc1402c0 0x7ffafc15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb00a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffafc1402c0 0x7ffafc15e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49802/0 (socket says 172.21.15.192:49802) 2024-09-13T18:38:19.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.921+0000 7ffb00a00640 1 -- 172.21.15.192:0/4225766203 learned_addr learned my addr 172.21.15.192:0/4225766203 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:19.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.922+0000 7ffb00a00640 1 -- 172.21.15.192:0/4225766203 >> v1:172.21.15.194:6789/0 conn(0x7ffafc0b02f0 legacy=0x7ffafc1406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:19.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.922+0000 7ffb00a00640 1 -- 172.21.15.192:0/4225766203 >> v1:172.21.15.192:6789/0 conn(0x7ffafc15b810 legacy=0x7ffafc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.922+0000 7ffb00a00640 1 -- 172.21.15.192:0/4225766203 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc15f100 con 0x7ffafc1402c0 2024-09-13T18:38:19.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb00a00640 1 --2- 172.21.15.192:0/4225766203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc15e660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2a60fcc1e18b968 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffafb400640 1 -- 172.21.15.192:0/4225766203 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec032440 con 0x7ffafc1402c0 2024-09-13T18:38:19.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffafb400640 1 -- 172.21.15.192:0/4225766203 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec0325a0 con 0x7ffafc1402c0 2024-09-13T18:38:19.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffafb400640 1 -- 172.21.15.192:0/4225766203 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec032930 con 0x7ffafc1402c0 2024-09-13T18:38:19.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb01e00640 1 -- 172.21.15.192:0/4225766203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 msgr2=0x7ffafc15e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb01e00640 1 --2- 172.21.15.192:0/4225766203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc15e660 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec02a2a0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb01e00640 1 -- 172.21.15.192:0/4225766203 shutdown_connections 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb01e00640 1 --2- 172.21.15.192:0/4225766203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc15e660 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.923+0000 7ffb01e00640 1 -- 172.21.15.192:0/4225766203 >> 172.21.15.192:0/4225766203 conn(0x7ffafc0ae7f0 msgr2=0x7ffafc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.924+0000 7ffb01e00640 1 -- 172.21.15.192:0/4225766203 shutdown_connections 2024-09-13T18:38:19.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.924+0000 7ffb01e00640 1 -- 172.21.15.192:0/4225766203 wait complete. 2024-09-13T18:38:19.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.925+0000 7ffb01e00640 1 Processor -- start 2024-09-13T18:38:19.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.925+0000 7ffb01e00640 1 -- start start 2024-09-13T18:38:19.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 0x7ffafc15a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 0x7ffafc1f2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc15a550 con 0x7ffafc1402c0 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc1415a0 con 0x7ffafc0b02f0 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffb01e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffafc141880 con 0x7ffafc15b810 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffafbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffafbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49806/0 (socket says 172.21.15.192:49806) 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.926+0000 7ffafbe00640 1 -- 172.21.15.192:0/2253698053 learned_addr learned my addr 172.21.15.192:0/2253698053 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffb01400640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 0x7ffafc1f2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffb00a00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 0x7ffafc15a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 -- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 msgr2=0x7ffafc1f2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 0x7ffafc1f2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 -- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 msgr2=0x7ffafc15a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 0x7ffafc15a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 -- 172.21.15.192:0/2253698053 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec0094d0 con 0x7ffafc1402c0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffb01400640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 0x7ffafc1f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffb00a00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 0x7ffafc15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffafbe00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c400 tx=0x7ffae800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80052d0 con 0x7ffafc1402c0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8005450 con 0x7ffafc1402c0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffafc141b60 con 0x7ffafc1402c0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.927+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8007260 con 0x7ffafc1402c0 2024-09-13T18:38:19.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.928+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffafc142120 con 0x7ffafc1402c0 2024-09-13T18:38:19.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.928+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffafc15e660 con 0x7ffafc1402c0 2024-09-13T18:38:19.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.929+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffae80073c0 con 0x7ffafc1402c0 2024-09-13T18:38:19.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.931+0000 7ffaf8c00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 0x7ffadc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:19.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.931+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae80887a0 con 0x7ffafc1402c0 2024-09-13T18:38:19.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.931+0000 7ffb00a00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 0x7ffadc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:19.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.931+0000 7ffb00a00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 0x7ffadc06d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffaec034000 tx=0x7ffaec02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:19.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:19.935+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffae8053970 con 0x7ffafc1402c0 2024-09-13T18:38:20.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.139+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ffafc066f70 con 0x7ffafc1402c0 2024-09-13T18:38:20.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.744+0000 7ffaf8c00640 1 -- 172.21.15.192:0/2253698053 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7ffae8056f90 con 0x7ffafc1402c0 2024-09-13T18:38:20.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 msgr2=0x7ffadc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 0x7ffadc06d0c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ffaec034000 tx=0x7ffaec02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:20.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 msgr2=0x7ffafc0b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c400 tx=0x7ffae800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 shutdown_connections 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffadc06ac00 0x7ffadc06d0c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffafc15b810 0x7ffafc1f2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffafc1402c0 0x7ffafc0b30b0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 --2- 172.21.15.192:0/2253698053 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffafc0b02f0 0x7ffafc15a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 >> 172.21.15.192:0/2253698053 conn(0x7ffafc0ae7f0 msgr2=0x7ffafc0706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 shutdown_connections 2024-09-13T18:38:20.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.746+0000 7ffb01e00640 1 -- 172.21.15.192:0/2253698053 wait complete. 2024-09-13T18:38:20.766 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:38:20.766 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:20.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.918+0000 7f7e96000640 1 Processor -- start 2024-09-13T18:38:20.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.918+0000 7f7e96000640 1 -- start start 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e96000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e900cacd0 0x7f7e9015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e96000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e9015bc20 0x7f7e900afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e96000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e90140480 con 0x7f7e900cb0b0 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e96000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e900cb520 con 0x7f7e900cacd0 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e96000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e9015ee90 con 0x7f7e9015bc20 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e8f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e900cacd0 0x7f7e9015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e8f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7e900cacd0 0x7f7e9015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34666/0 (socket says 172.21.15.192:34666) 2024-09-13T18:38:20.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.919+0000 7f7e8f400640 1 -- 172.21.15.192:0/185943686 learned_addr learned my addr 172.21.15.192:0/185943686 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:20.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.920+0000 7f7e8fe00640 1 --2- 172.21.15.192:0/185943686 >> v2:172.21.15.194:3300/0 conn(0x7f7e9015bc20 0x7f7e900afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.920+0000 7f7e8f400640 1 -- 172.21.15.192:0/185943686 >> v2:172.21.15.194:3300/0 conn(0x7f7e9015bc20 msgr2=0x7f7e900afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:20.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.920+0000 7f7e8f400640 1 --2- 172.21.15.192:0/185943686 >> v2:172.21.15.194:3300/0 conn(0x7f7e9015bc20 0x7f7e900afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.920+0000 7f7e8f400640 1 -- 172.21.15.192:0/185943686 >> v1:172.21.15.194:6789/0 conn(0x7f7e900cb0b0 legacy=0x7f7e90140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:20.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.920+0000 7f7e8f400640 1 -- 172.21.15.192:0/185943686 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9015f170 con 0x7f7e900cacd0 2024-09-13T18:38:20.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.921+0000 7f7e8f400640 1 --2- 172.21.15.192:0/185943686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cacd0 0x7f7e9015e790 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7e90158ce0 tx=0x7f7e8002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fba581ac6f51411 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.921+0000 7f7e8e000640 1 -- 172.21.15.192:0/185943686 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80032440 con 0x7f7e900cacd0 2024-09-13T18:38:20.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.921+0000 7f7e8e000640 1 -- 172.21.15.192:0/185943686 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800325a0 con 0x7f7e900cacd0 2024-09-13T18:38:20.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.921+0000 7f7e8e000640 1 -- 172.21.15.192:0/185943686 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80032930 con 0x7f7e900cacd0 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 -- 172.21.15.192:0/185943686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cacd0 msgr2=0x7f7e9015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 --2- 172.21.15.192:0/185943686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cacd0 0x7f7e9015e790 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f7e90158ce0 tx=0x7f7e8002a230 comp rx=0 tx=0).stop 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 -- 172.21.15.192:0/185943686 shutdown_connections 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 --2- 172.21.15.192:0/185943686 >> v2:172.21.15.194:3300/0 conn(0x7f7e9015bc20 0x7f7e900afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 --2- 172.21.15.192:0/185943686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cacd0 0x7f7e9015e790 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 -- 172.21.15.192:0/185943686 >> 172.21.15.192:0/185943686 conn(0x7f7e900ae960 msgr2=0x7f7e9006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 -- 172.21.15.192:0/185943686 shutdown_connections 2024-09-13T18:38:20.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.922+0000 7f7e96000640 1 -- 172.21.15.192:0/185943686 wait complete. 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.923+0000 7f7e96000640 1 Processor -- start 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 -- start start 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cacd0 0x7f7e901557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e9015bc20 0x7f7e90154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e900b4d70 con 0x7f7e900cb0b0 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90155220 con 0x7f7e900cacd0 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.924+0000 7f7e96000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e90155eb0 con 0x7f7e9015bc20 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34678/0 (socket says 172.21.15.192:34678) 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 -- 172.21.15.192:0/2945678862 learned_addr learned my addr 172.21.15.192:0/2945678862 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8f400640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cacd0 0x7f7e901557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8fe00640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e9015bc20 0x7f7e90154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 -- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e9015bc20 msgr2=0x7f7e90154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e9015bc20 0x7f7e90154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 -- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cacd0 msgr2=0x7f7e901557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cacd0 0x7f7e901557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 -- 172.21.15.192:0/2945678862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800094d0 con 0x7f7e900cb0b0 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.925+0000 7f7e8ea00640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c430 tx=0x7f7e7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.926+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011790 con 0x7f7e900cb0b0 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.926+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7c0118f0 con 0x7f7e900cb0b0 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.926+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7c011ce0 con 0x7f7e900cb0b0 2024-09-13T18:38:20.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.926+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e90156190 con 0x7f7e900cb0b0 2024-09-13T18:38:20.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.926+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e90156750 con 0x7f7e900cb0b0 2024-09-13T18:38:20.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.927+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e9015e790 con 0x7f7e900cb0b0 2024-09-13T18:38:20.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.928+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e7c01c460 con 0x7f7e900cb0b0 2024-09-13T18:38:20.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.929+0000 7f7e87400640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 0x7f7e70071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:20.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.929+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e7c0891a0 con 0x7f7e900cb0b0 2024-09-13T18:38:20.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.929+0000 7f7e8f400640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 0x7f7e70071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:20.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.930+0000 7f7e8f400640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 0x7f7e70071500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034000 tx=0x7f7e8002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:20.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:20.933+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e7c054410 con 0x7f7e900cb0b0 2024-09-13T18:38:21.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.136+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e9006c6c0 con 0x7f7e900cb0b0 2024-09-13T18:38:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.136+0000 7f7e87400640 1 -- 172.21.15.192:0/2945678862 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f7e7c057a30 con 0x7f7e900cb0b0 2024-09-13T18:38:21.139 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:21.139 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:38:21.140 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 msgr2=0x7f7e70071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 0x7f7e70071500 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7e80034000 tx=0x7f7e8002e000 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 msgr2=0x7f7e900b4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7e7c00c430 tx=0x7f7e7c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 shutdown_connections 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e7006f040 0x7f7e70071500 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e9015bc20 0x7f7e90154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e900cb0b0 0x7f7e900b4830 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 --2- 172.21.15.192:0/2945678862 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e900cacd0 0x7f7e901557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.142 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 >> 172.21.15.192:0/2945678862 conn(0x7f7e900ae960 msgr2=0x7f7e900afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 shutdown_connections 2024-09-13T18:38:21.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.139+0000 7f7e96000640 1 -- 172.21.15.192:0/2945678862 wait complete. 2024-09-13T18:38:21.157 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:38:21.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.309+0000 7f3a9f000640 1 Processor -- start 2024-09-13T18:38:21.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.309+0000 7f3a9f000640 1 -- start start 2024-09-13T18:38:21.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9f000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a981592d0 0x7f3a98070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a980b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a9806f830 con 0x7f3a980b3600 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9f000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a980b3fb0 con 0x7f3a981592d0 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9806fa80 con 0x7f3a9806c3b0 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a981592d0 0x7f3a98070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a981592d0 0x7f3a98070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34694/0 (socket says 172.21.15.192:34694) 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.310+0000 7f3a9dc00640 1 -- 172.21.15.192:0/3737456717 learned_addr learned my addr 172.21.15.192:0/3737456717 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9dc00640 1 -- 172.21.15.192:0/3737456717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 msgr2=0x7f3a980b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9e600640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a980b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9dc00640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a980b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9dc00640 1 -- 172.21.15.192:0/3737456717 >> v1:172.21.15.194:6789/0 conn(0x7f3a980b3600 legacy=0x7f3a9806bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:21.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9dc00640 1 -- 172.21.15.192:0/3737456717 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a9806fd60 con 0x7f3a981592d0 2024-09-13T18:38:21.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.311+0000 7f3a9e600640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a980b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.312+0000 7f3a9dc00640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a981592d0 0x7f3a98070b20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c009870 tx=0x7f3a8c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa9fad6da7eb3f03 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.312+0000 7f3a97e00640 1 -- 172.21.15.192:0/3737456717 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c032440 con 0x7f3a981592d0 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.312+0000 7f3a97e00640 1 -- 172.21.15.192:0/3737456717 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8c0325a0 con 0x7f3a981592d0 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.312+0000 7f3a97e00640 1 -- 172.21.15.192:0/3737456717 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c032930 con 0x7f3a981592d0 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 -- 172.21.15.192:0/3737456717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a981592d0 msgr2=0x7f3a98070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a981592d0 0x7f3a98070b20 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c009870 tx=0x7f3a8c02a200 comp rx=0 tx=0).stop 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 -- 172.21.15.192:0/3737456717 shutdown_connections 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a980b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 --2- 172.21.15.192:0/3737456717 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a981592d0 0x7f3a98070b20 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 -- 172.21.15.192:0/3737456717 >> 172.21.15.192:0/3737456717 conn(0x7f3a980736d0 msgr2=0x7f3a980b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 -- 172.21.15.192:0/3737456717 shutdown_connections 2024-09-13T18:38:21.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.313+0000 7f3a9f000640 1 -- 172.21.15.192:0/3737456717 wait complete. 2024-09-13T18:38:21.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.314+0000 7f3a9f000640 1 Processor -- start 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.314+0000 7f3a9f000640 1 -- start start 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a98145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 0x7f3a9814fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9812ffd0 con 0x7f3a980b3600 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980a9e80 con 0x7f3a981592d0 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.315+0000 7f3a9f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980aa160 con 0x7f3a9806c3b0 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34710/0 (socket says 172.21.15.192:34710) 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 -- 172.21.15.192:0/1160083490 learned_addr learned my addr 172.21.15.192:0/1160083490 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9dc00640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a98145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9e600640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 0x7f3a9814fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 -- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 msgr2=0x7f3a98145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a98145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 -- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 msgr2=0x7f3a9814fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 0x7f3a9814fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 -- 172.21.15.192:0/1160083490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8c0094d0 con 0x7f3a980b3600 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9e600640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 0x7f3a9814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:21.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.316+0000 7f3a9d200640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c430 tx=0x7f3a8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.317+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011790 con 0x7f3a980b3600 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.317+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a840118f0 con 0x7f3a980b3600 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.317+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a84011ce0 con 0x7f3a980b3600 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.317+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a9812fc60 con 0x7f3a980b3600 2024-09-13T18:38:21.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.317+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a980aa440 con 0x7f3a980b3600 2024-09-13T18:38:21.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.318+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a980b3a70 con 0x7f3a980b3600 2024-09-13T18:38:21.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.319+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a8401c460 con 0x7f3a980b3600 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.320+0000 7f3a95600640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 0x7f3a7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.320+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a840892d0 con 0x7f3a980b3600 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.320+0000 7f3a9dc00640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 0x7f3a7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.320+0000 7f3a9dc00640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 0x7f3a7806d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c034000 tx=0x7f3a8c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.324+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a84054410 con 0x7f3a980b3600 2024-09-13T18:38:21.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.493+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a9806ef30 con 0x7f3a980b3600 2024-09-13T18:38:21.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.495+0000 7f3a95600640 1 -- 172.21.15.192:0/1160083490 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16625 (secure 0 0 0) 0x7f3a84057a30 con 0x7f3a980b3600 2024-09-13T18:38:21.498 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:21.498 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":71,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:18.721651+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"70","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:38:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 msgr2=0x7f3a7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 0x7f3a7806d0c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c034000 tx=0x7f3a8c02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 msgr2=0x7f3a980a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3a8400c430 tx=0x7f3a8400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 shutdown_connections 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a7806ac00 0x7f3a7806d0c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a981592d0 0x7f3a9814fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a980b3600 0x7f3a980a9430 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 --2- 172.21.15.192:0/1160083490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a9806c3b0 0x7f3a98145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 >> 172.21.15.192:0/1160083490 conn(0x7f3a980736d0 msgr2=0x7f3a980af210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 shutdown_connections 2024-09-13T18:38:21.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.497+0000 7f3a9f000640 1 -- 172.21.15.192:0/1160083490 wait complete. 2024-09-13T18:38:21.516 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:38:21.516 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:21.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.665+0000 7fef85e00640 1 Processor -- start 2024-09-13T18:38:21.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.665+0000 7fef85e00640 1 -- start start 2024-09-13T18:38:21.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef85e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef8015a9e0 0x7fef8006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef85e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef8006c5d0 con 0x7fef8006b3d0 2024-09-13T18:38:21.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef85e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800b3920 con 0x7fef800cdfd0 2024-09-13T18:38:21.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef85e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800b3730 con 0x7fef8015a9e0 2024-09-13T18:38:21.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef84a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef8015a9e0 0x7fef8006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef84a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef8015a9e0 0x7fef8006ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34726/0 (socket says 172.21.15.192:34726) 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef84a00640 1 -- 172.21.15.192:0/2940718480 learned_addr learned my addr 172.21.15.192:0/2940718480 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.666+0000 7fef77e00640 1 --1- 172.21.15.192:0/2940718480 >> v1:172.21.15.192:6789/0 conn(0x7fef8006b3d0 0x7fef800cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48134/0 (socket says 172.21.15.192:48134) 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.667+0000 7fef84a00640 1 -- 172.21.15.192:0/2940718480 >> v1:172.21.15.194:6789/0 conn(0x7fef800cdfd0 legacy=0x7fef80070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.667+0000 7fef84a00640 1 -- 172.21.15.192:0/2940718480 >> v1:172.21.15.192:6789/0 conn(0x7fef8006b3d0 legacy=0x7fef800cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.667+0000 7fef84a00640 1 -- 172.21.15.192:0/2940718480 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef800b3c00 con 0x7fef8015a9e0 2024-09-13T18:38:21.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.667+0000 7fef7fe00640 1 -- 172.21.15.192:0/2940718480 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3024344436 0 0) 0x7fef8006c5d0 con 0x7fef8006b3d0 2024-09-13T18:38:21.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef84a00640 1 --2- 172.21.15.192:0/2940718480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef8015a9e0 0x7fef8006ae90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fef70009870 tx=0x7fef7002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3d4b66314d4cb64 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef7fe00640 1 -- 172.21.15.192:0/2940718480 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70032640 con 0x7fef8015a9e0 2024-09-13T18:38:21.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef7fe00640 1 -- 172.21.15.192:0/2940718480 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700327a0 con 0x7fef8015a9e0 2024-09-13T18:38:21.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef7fe00640 1 -- 172.21.15.192:0/2940718480 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70032b30 con 0x7fef8015a9e0 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef85e00640 1 -- 172.21.15.192:0/2940718480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef8015a9e0 msgr2=0x7fef8006ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.668+0000 7fef85e00640 1 --2- 172.21.15.192:0/2940718480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef8015a9e0 0x7fef8006ae90 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fef70009870 tx=0x7fef7002a300 comp rx=0 tx=0).stop 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.669+0000 7fef85e00640 1 -- 172.21.15.192:0/2940718480 shutdown_connections 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.669+0000 7fef85e00640 1 --2- 172.21.15.192:0/2940718480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef8015a9e0 0x7fef8006ae90 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.669+0000 7fef85e00640 1 -- 172.21.15.192:0/2940718480 >> 172.21.15.192:0/2940718480 conn(0x7fef800736d0 msgr2=0x7fef800b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.669+0000 7fef85e00640 1 -- 172.21.15.192:0/2940718480 shutdown_connections 2024-09-13T18:38:21.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.669+0000 7fef85e00640 1 -- 172.21.15.192:0/2940718480 wait complete. 2024-09-13T18:38:21.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.670+0000 7fef85e00640 1 Processor -- start 2024-09-13T18:38:21.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.670+0000 7fef85e00640 1 -- start start 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8006b3d0 0x7fef80151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 0x7fef800cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef801f26b0 con 0x7fef800cdfd0 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef801582d0 con 0x7fef8006b3d0 2024-09-13T18:38:21.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef85e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef80154970 con 0x7fef8015a9e0 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.671+0000 7fef77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34732/0 (socket says 172.21.15.192:34732) 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 -- 172.21.15.192:0/1580706445 learned_addr learned my addr 172.21.15.192:0/1580706445 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef84a00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8006b3d0 0x7fef80151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef85400640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 0x7fef800cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 -- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 msgr2=0x7fef800cc6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 0x7fef800cc6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 -- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8006b3d0 msgr2=0x7fef80151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8006b3d0 0x7fef80151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 -- 172.21.15.192:0/1580706445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094d0 con 0x7fef800cdfd0 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef85400640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 0x7fef800cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:21.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef77e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c3f0 tx=0x7fef6800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef680074e0 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68007660 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef80157750 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.672+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68004a20 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.673+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef80157d10 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.673+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef800cb4b0 con 0x7fef800cdfd0 2024-09-13T18:38:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.674+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef68004b80 con 0x7fef800cdfd0 2024-09-13T18:38:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.675+0000 7fef7d600640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 0x7fef5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.675+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef68089090 con 0x7fef800cdfd0 2024-09-13T18:38:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.675+0000 7fef84a00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 0x7fef5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:21.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.676+0000 7fef84a00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 0x7fef5c06d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef70034000 tx=0x7fef7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:21.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.680+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef68054260 con 0x7fef800cdfd0 2024-09-13T18:38:21.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.848+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef8006a970 con 0x7fef5c06ac00 2024-09-13T18:38:21.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.856+0000 7fef7d600640 1 -- 172.21.15.192:0/1580706445 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284981 (secure 0 0 0) 0x7fef70046450 con 0x7fef5c06ac00 2024-09-13T18:38:21.864 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:21.865 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 msgr2=0x7fef5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 0x7fef5c06d0c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef70034000 tx=0x7fef7002e000 comp rx=0 tx=0).stop 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 msgr2=0x7fef80154430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c3f0 tx=0x7fef6800c8b0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 shutdown_connections 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5c06ac00 0x7fef5c06d0c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef8015a9e0 0x7fef800cc6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef800cdfd0 0x7fef80154430 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 --2- 172.21.15.192:0/1580706445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef8006b3d0 0x7fef80151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:21.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 >> 172.21.15.192:0/1580706445 conn(0x7fef800736d0 msgr2=0x7fef800711b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:21.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.860+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 shutdown_connections 2024-09-13T18:38:21.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:21.861+0000 7fef85e00640 1 -- 172.21.15.192:0/1580706445 wait complete. 2024-09-13T18:38:21.878 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-13T18:38:20.766250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3986,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558513,"statfs":{"total":1600000000,"available":1595917436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.459646"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747288+0000","last_change":"2024-09-13T18:38:17.746489+0000","last_active":"2024-09-13T18:38:17.747288+0000","last_peered":"2024-09-13T18:38:17.747288+0000","last_clean":"2024-09-13T18:38:17.747288+0000","last_became_active":"2024-09-13T18:38:17.746274+0000","last_became_peered":"2024-09-13T18:38:17.746274+0000","last_unstale":"2024-09-13T18:38:17.747288+0000","last_undegraded":"2024-09-13T18:38:17.747288+0000","last_fullsized":"2024-09-13T18:38:17.747288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.748435+0000","last_change":"2024-09-13T18:38:17.748359+0000","last_active":"2024-09-13T18:38:17.748435+0000","last_peered":"2024-09-13T18:38:17.748435+0000","last_clean":"2024-09-13T18:38:17.748435+0000","last_became_active":"2024-09-13T18:38:17.748086+0000","last_became_peered":"2024-09-13T18:38:17.748086+0000","last_unstale":"2024-09-13T18:38:17.748435+0000","last_undegraded":"2024-09-13T18:38:17.748435+0000","last_fullsized":"2024-09-13T18:38:17.748435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.945035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729474+0000","last_change":"2024-09-13T18:38:17.731711+0000","last_active":"2024-09-13T18:38:18.729474+0000","last_peered":"2024-09-13T18:38:18.729474+0000","last_clean":"2024-09-13T18:38:18.729474+0000","last_became_active":"2024-09-13T18:38:17.731498+0000","last_became_peered":"2024-09-13T18:38:17.731498+0000","last_unstale":"2024-09-13T18:38:18.729474+0000","last_undegraded":"2024-09-13T18:38:18.729474+0000","last_fullsized":"2024-09-13T18:38:18.729474+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729432+0000","last_change":"2024-09-13T18:38:17.747332+0000","last_active":"2024-09-13T18:38:18.729432+0000","last_peered":"2024-09-13T18:38:18.729432+0000","last_clean":"2024-09-13T18:38:18.729432+0000","last_became_active":"2024-09-13T18:38:17.747063+0000","last_became_peered":"2024-09-13T18:38:17.747063+0000","last_unstale":"2024-09-13T18:38:18.729432+0000","last_undegraded":"2024-09-13T18:38:18.729432+0000","last_fullsized":"2024-09-13T18:38:18.729432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:15.622090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.749234+0000","last_change":"2024-09-13T18:38:17.749162+0000","last_active":"2024-09-13T18:38:17.749234+0000","last_peered":"2024-09-13T18:38:17.749234+0000","last_clean":"2024-09-13T18:38:17.749234+0000","last_became_active":"2024-09-13T18:38:17.748802+0000","last_became_peered":"2024-09-13T18:38:17.748802+0000","last_unstale":"2024-09-13T18:38:17.749234+0000","last_undegraded":"2024-09-13T18:38:17.749234+0000","last_fullsized":"2024-09-13T18:38:17.749234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.746083+0000","last_change":"2024-09-13T18:38:17.745961+0000","last_active":"2024-09-13T18:38:17.746083+0000","last_peered":"2024-09-13T18:38:17.746083+0000","last_clean":"2024-09-13T18:38:17.746083+0000","last_became_active":"2024-09-13T18:38:17.745408+0000","last_became_peered":"2024-09-13T18:38:17.745408+0000","last_unstale":"2024-09-13T18:38:17.746083+0000","last_undegraded":"2024-09-13T18:38:17.746083+0000","last_fullsized":"2024-09-13T18:38:17.746083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729451+0000","last_change":"2024-09-13T18:38:17.744163+0000","last_active":"2024-09-13T18:38:18.729451+0000","last_peered":"2024-09-13T18:38:18.729451+0000","last_clean":"2024-09-13T18:38:18.729451+0000","last_became_active":"2024-09-13T18:38:17.743265+0000","last_became_peered":"2024-09-13T18:38:17.743265+0000","last_unstale":"2024-09-13T18:38:18.729451+0000","last_undegraded":"2024-09-13T18:38:18.729451+0000","last_fullsized":"2024-09-13T18:38:18.729451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:19.116809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237534+0000","last_change":"2024-09-13T18:38:17.747670+0000","last_active":"2024-09-13T18:38:19.237534+0000","last_peered":"2024-09-13T18:38:19.237534+0000","last_clean":"2024-09-13T18:38:19.237534+0000","last_became_active":"2024-09-13T18:38:17.747379+0000","last_became_peered":"2024-09-13T18:38:17.747379+0000","last_unstale":"2024-09-13T18:38:19.237534+0000","last_undegraded":"2024-09-13T18:38:19.237534+0000","last_fullsized":"2024-09-13T18:38:19.237534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:17.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745096+0000","last_change":"2024-09-13T18:38:17.739301+0000","last_active":"2024-09-13T18:38:17.745096+0000","last_peered":"2024-09-13T18:38:17.745096+0000","last_clean":"2024-09-13T18:38:17.745096+0000","last_became_active":"2024-09-13T18:38:17.738490+0000","last_became_peered":"2024-09-13T18:38:17.738490+0000","last_unstale":"2024-09-13T18:38:17.745096+0000","last_undegraded":"2024-09-13T18:38:17.745096+0000","last_fullsized":"2024-09-13T18:38:17.745096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:17.364770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.744987+0000","last_change":"2024-09-13T18:38:17.740368+0000","last_active":"2024-09-13T18:38:17.744987+0000","last_peered":"2024-09-13T18:38:17.744987+0000","last_clean":"2024-09-13T18:38:17.744987+0000","last_became_active":"2024-09-13T18:38:17.740148+0000","last_became_peered":"2024-09-13T18:38:17.740148+0000","last_unstale":"2024-09-13T18:38:17.744987+0000","last_undegraded":"2024-09-13T18:38:17.744987+0000","last_fullsized":"2024-09-13T18:38:17.744987+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:07.605029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724894+0000","last_change":"2024-09-13T18:38:17.747083+0000","last_active":"2024-09-13T18:38:18.724894+0000","last_peered":"2024-09-13T18:38:18.724894+0000","last_clean":"2024-09-13T18:38:18.724894+0000","last_became_active":"2024-09-13T18:38:17.746863+0000","last_became_peered":"2024-09-13T18:38:17.746863+0000","last_unstale":"2024-09-13T18:38:18.724894+0000","last_undegraded":"2024-09-13T18:38:18.724894+0000","last_fullsized":"2024-09-13T18:38:18.724894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745164+0000","last_change":"2024-09-13T18:38:17.743038+0000","last_active":"2024-09-13T18:38:17.745164+0000","last_peered":"2024-09-13T18:38:17.745164+0000","last_clean":"2024-09-13T18:38:17.745164+0000","last_became_active":"2024-09-13T18:38:17.742815+0000","last_became_peered":"2024-09-13T18:38:17.742815+0000","last_unstale":"2024-09-13T18:38:17.745164+0000","last_undegraded":"2024-09-13T18:38:17.745164+0000","last_fullsized":"2024-09-13T18:38:17.745164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:44.337450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739908+0000","last_change":"2024-09-13T18:38:17.739846+0000","last_active":"2024-09-13T18:38:17.739908+0000","last_peered":"2024-09-13T18:38:17.739908+0000","last_clean":"2024-09-13T18:38:17.739908+0000","last_became_active":"2024-09-13T18:38:17.739256+0000","last_became_peered":"2024-09-13T18:38:17.739256+0000","last_unstale":"2024-09-13T18:38:17.739908+0000","last_undegraded":"2024-09-13T18:38:17.739908+0000","last_fullsized":"2024-09-13T18:38:17.739908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729454+0000","last_change":"2024-09-13T18:38:17.740645+0000","last_active":"2024-09-13T18:38:18.729454+0000","last_peered":"2024-09-13T18:38:18.729454+0000","last_clean":"2024-09-13T18:38:18.729454+0000","last_became_active":"2024-09-13T18:38:17.739849+0000","last_became_peered":"2024-09-13T18:38:17.739849+0000","last_unstale":"2024-09-13T18:38:18.729454+0000","last_undegraded":"2024-09-13T18:38:18.729454+0000","last_fullsized":"2024-09-13T18:38:18.729454+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.177737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739051+0000","last_change":"2024-09-13T18:38:17.738717+0000","last_active":"2024-09-13T18:38:17.739051+0000","last_peered":"2024-09-13T18:38:17.739051+0000","last_clean":"2024-09-13T18:38:17.739051+0000","last_became_active":"2024-09-13T18:38:17.738518+0000","last_became_peered":"2024-09-13T18:38:17.738518+0000","last_unstale":"2024-09-13T18:38:17.739051+0000","last_undegraded":"2024-09-13T18:38:17.739051+0000","last_fullsized":"2024-09-13T18:38:17.739051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:38.910491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.750012+0000","last_change":"2024-09-13T18:38:17.749921+0000","last_active":"2024-09-13T18:38:17.750012+0000","last_peered":"2024-09-13T18:38:17.750012+0000","last_clean":"2024-09-13T18:38:17.750012+0000","last_became_active":"2024-09-13T18:38:17.749471+0000","last_became_peered":"2024-09-13T18:38:17.749471+0000","last_unstale":"2024-09-13T18:38:17.750012+0000","last_undegraded":"2024-09-13T18:38:17.750012+0000","last_fullsized":"2024-09-13T18:38:17.750012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747498+0000","last_change":"2024-09-13T18:38:17.747400+0000","last_active":"2024-09-13T18:38:17.747498+0000","last_peered":"2024-09-13T18:38:17.747498+0000","last_clean":"2024-09-13T18:38:17.747498+0000","last_became_active":"2024-09-13T18:38:17.745545+0000","last_became_peered":"2024-09-13T18:38:17.745545+0000","last_unstale":"2024-09-13T18:38:17.747498+0000","last_undegraded":"2024-09-13T18:38:17.747498+0000","last_fullsized":"2024-09-13T18:38:17.747498+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:38.910491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729558+0000","last_change":"2024-09-13T18:38:17.729975+0000","last_active":"2024-09-13T18:38:18.729558+0000","last_peered":"2024-09-13T18:38:18.729558+0000","last_clean":"2024-09-13T18:38:18.729558+0000","last_became_active":"2024-09-13T18:38:17.729503+0000","last_became_peered":"2024-09-13T18:38:17.729503+0000","last_unstale":"2024-09-13T18:38:18.729558+0000","last_undegraded":"2024-09-13T18:38:18.729558+0000","last_fullsized":"2024-09-13T18:38:18.729558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:23.601319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.741183+0000","last_change":"2024-09-13T18:38:17.740938+0000","last_active":"2024-09-13T18:38:17.741183+0000","last_peered":"2024-09-13T18:38:17.741183+0000","last_clean":"2024-09-13T18:38:17.741183+0000","last_became_active":"2024-09-13T18:38:17.740589+0000","last_became_peered":"2024-09-13T18:38:17.740589+0000","last_unstale":"2024-09-13T18:38:17.741183+0000","last_undegraded":"2024-09-13T18:38:17.741183+0000","last_fullsized":"2024-09-13T18:38:17.741183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.238536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724890+0000","last_change":"2024-09-13T18:38:17.736406+0000","last_active":"2024-09-13T18:38:18.724890+0000","last_peered":"2024-09-13T18:38:18.724890+0000","last_clean":"2024-09-13T18:38:18.724890+0000","last_became_active":"2024-09-13T18:38:17.736134+0000","last_became_peered":"2024-09-13T18:38:17.736134+0000","last_unstale":"2024-09-13T18:38:18.724890+0000","last_undegraded":"2024-09-13T18:38:18.724890+0000","last_fullsized":"2024-09-13T18:38:18.724890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740713+0000","last_change":"2024-09-13T18:38:17.740256+0000","last_active":"2024-09-13T18:38:17.740713+0000","last_peered":"2024-09-13T18:38:17.740713+0000","last_clean":"2024-09-13T18:38:17.740713+0000","last_became_active":"2024-09-13T18:38:17.737301+0000","last_became_peered":"2024-09-13T18:38:17.737301+0000","last_unstale":"2024-09-13T18:38:17.740713+0000","last_undegraded":"2024-09-13T18:38:17.740713+0000","last_fullsized":"2024-09-13T18:38:17.740713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724794+0000","last_change":"2024-09-13T18:38:17.729679+0000","last_active":"2024-09-13T18:38:18.724794+0000","last_peered":"2024-09-13T18:38:18.724794+0000","last_clean":"2024-09-13T18:38:18.724794+0000","last_became_active":"2024-09-13T18:38:17.729031+0000","last_became_peered":"2024-09-13T18:38:17.729031+0000","last_unstale":"2024-09-13T18:38:18.724794+0000","last_undegraded":"2024-09-13T18:38:18.724794+0000","last_fullsized":"2024-09-13T18:38:18.724794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729553+0000","last_change":"2024-09-13T18:38:17.743590+0000","last_active":"2024-09-13T18:38:18.729553+0000","last_peered":"2024-09-13T18:38:18.729553+0000","last_clean":"2024-09-13T18:38:18.729553+0000","last_became_active":"2024-09-13T18:38:17.741743+0000","last_became_peered":"2024-09-13T18:38:17.741743+0000","last_unstale":"2024-09-13T18:38:18.729553+0000","last_undegraded":"2024-09-13T18:38:18.729553+0000","last_fullsized":"2024-09-13T18:38:18.729553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:26.479170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745079+0000","last_change":"2024-09-13T18:38:17.739180+0000","last_active":"2024-09-13T18:38:17.745079+0000","last_peered":"2024-09-13T18:38:17.745079+0000","last_clean":"2024-09-13T18:38:17.745079+0000","last_became_active":"2024-09-13T18:38:17.738207+0000","last_became_peered":"2024-09-13T18:38:17.738207+0000","last_unstale":"2024-09-13T18:38:17.745079+0000","last_undegraded":"2024-09-13T18:38:17.745079+0000","last_fullsized":"2024-09-13T18:38:17.745079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.738842+0000","last_change":"2024-09-13T18:38:17.738651+0000","last_active":"2024-09-13T18:38:17.738842+0000","last_peered":"2024-09-13T18:38:17.738842+0000","last_clean":"2024-09-13T18:38:17.738842+0000","last_became_active":"2024-09-13T18:38:17.737775+0000","last_became_peered":"2024-09-13T18:38:17.737775+0000","last_unstale":"2024-09-13T18:38:17.738842+0000","last_undegraded":"2024-09-13T18:38:17.738842+0000","last_fullsized":"2024-09-13T18:38:17.738842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:34.994084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740729+0000","last_change":"2024-09-13T18:38:17.740391+0000","last_active":"2024-09-13T18:38:17.740729+0000","last_peered":"2024-09-13T18:38:17.740729+0000","last_clean":"2024-09-13T18:38:17.740729+0000","last_became_active":"2024-09-13T18:38:17.740041+0000","last_became_peered":"2024-09-13T18:38:17.740041+0000","last_unstale":"2024-09-13T18:38:17.740729+0000","last_undegraded":"2024-09-13T18:38:17.740729+0000","last_fullsized":"2024-09-13T18:38:17.740729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.730831+0000","last_change":"2024-09-13T18:38:17.730683+0000","last_active":"2024-09-13T18:38:17.730831+0000","last_peered":"2024-09-13T18:38:17.730831+0000","last_clean":"2024-09-13T18:38:17.730831+0000","last_became_active":"2024-09-13T18:38:17.729757+0000","last_became_peered":"2024-09-13T18:38:17.729757+0000","last_unstale":"2024-09-13T18:38:17.730831+0000","last_undegraded":"2024-09-13T18:38:17.730831+0000","last_fullsized":"2024-09-13T18:38:17.730831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:51.093088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237640+0000","last_change":"2024-09-13T18:38:17.742238+0000","last_active":"2024-09-13T18:38:19.237640+0000","last_peered":"2024-09-13T18:38:19.237640+0000","last_clean":"2024-09-13T18:38:19.237640+0000","last_became_active":"2024-09-13T18:38:17.741983+0000","last_became_peered":"2024-09-13T18:38:17.741983+0000","last_unstale":"2024-09-13T18:38:19.237640+0000","last_undegraded":"2024-09-13T18:38:19.237640+0000","last_fullsized":"2024-09-13T18:38:19.237640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:20.226148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237439+0000","last_change":"2024-09-13T18:38:17.747702+0000","last_active":"2024-09-13T18:38:19.237439+0000","last_peered":"2024-09-13T18:38:19.237439+0000","last_clean":"2024-09-13T18:38:19.237439+0000","last_became_active":"2024-09-13T18:38:17.747454+0000","last_became_peered":"2024-09-13T18:38:17.747454+0000","last_unstale":"2024-09-13T18:38:19.237439+0000","last_undegraded":"2024-09-13T18:38:19.237439+0000","last_fullsized":"2024-09-13T18:38:19.237439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:16.770375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730117+0000","last_change":"2024-09-13T18:38:17.740761+0000","last_active":"2024-09-13T18:38:18.730117+0000","last_peered":"2024-09-13T18:38:18.730117+0000","last_clean":"2024-09-13T18:38:18.730117+0000","last_became_active":"2024-09-13T18:38:17.740535+0000","last_became_peered":"2024-09-13T18:38:17.740535+0000","last_unstale":"2024-09-13T18:38:18.730117+0000","last_undegraded":"2024-09-13T18:38:18.730117+0000","last_fullsized":"2024-09-13T18:38:18.730117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:12.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735227+0000","last_change":"2024-09-13T18:38:17.735058+0000","last_active":"2024-09-13T18:38:17.735227+0000","last_peered":"2024-09-13T18:38:17.735227+0000","last_clean":"2024-09-13T18:38:17.735227+0000","last_became_active":"2024-09-13T18:38:17.734833+0000","last_became_peered":"2024-09-13T18:38:17.734833+0000","last_unstale":"2024-09-13T18:38:17.735227+0000","last_undegraded":"2024-09-13T18:38:17.735227+0000","last_fullsized":"2024-09-13T18:38:17.735227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:43.723738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724898+0000","last_change":"2024-09-13T18:38:17.729351+0000","last_active":"2024-09-13T18:38:18.724898+0000","last_peered":"2024-09-13T18:38:18.724898+0000","last_clean":"2024-09-13T18:38:18.724898+0000","last_became_active":"2024-09-13T18:38:17.728335+0000","last_became_peered":"2024-09-13T18:38:17.728335+0000","last_unstale":"2024-09-13T18:38:18.724898+0000","last_undegraded":"2024-09-13T18:38:18.724898+0000","last_fullsized":"2024-09-13T18:38:18.724898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.748902+0000","last_change":"2024-09-13T18:38:17.748728+0000","last_active":"2024-09-13T18:38:17.748902+0000","last_peered":"2024-09-13T18:38:17.748902+0000","last_clean":"2024-09-13T18:38:17.748902+0000","last_became_active":"2024-09-13T18:38:17.747440+0000","last_became_peered":"2024-09-13T18:38:17.747440+0000","last_unstale":"2024-09-13T18:38:17.748902+0000","last_undegraded":"2024-09-13T18:38:17.748902+0000","last_fullsized":"2024-09-13T18:38:17.748902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:53.060074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"70'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724926+0000","last_change":"2024-09-13T18:38:17.323785+0000","last_active":"2024-09-13T18:38:18.724926+0000","last_peered":"2024-09-13T18:38:18.724926+0000","last_clean":"2024-09-13T18:38:18.724926+0000","last_became_active":"2024-09-13T18:38:17.323570+0000","last_became_peered":"2024-09-13T18:38:17.323570+0000","last_unstale":"2024-09-13T18:38:18.724926+0000","last_undegraded":"2024-09-13T18:38:18.724926+0000","last_fullsized":"2024-09-13T18:38:18.724926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:02.417461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.746067+0000","last_change":"2024-09-13T18:38:17.745986+0000","last_active":"2024-09-13T18:38:17.746067+0000","last_peered":"2024-09-13T18:38:17.746067+0000","last_clean":"2024-09-13T18:38:17.746067+0000","last_became_active":"2024-09-13T18:38:17.745767+0000","last_became_peered":"2024-09-13T18:38:17.745767+0000","last_unstale":"2024-09-13T18:38:17.746067+0000","last_undegraded":"2024-09-13T18:38:17.746067+0000","last_fullsized":"2024-09-13T18:38:17.746067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:37.293071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740757+0000","last_change":"2024-09-13T18:38:17.328199+0000","last_active":"2024-09-13T18:38:17.740757+0000","last_peered":"2024-09-13T18:38:17.740757+0000","last_clean":"2024-09-13T18:38:17.740757+0000","last_became_active":"2024-09-13T18:38:17.327510+0000","last_became_peered":"2024-09-13T18:38:17.327510+0000","last_unstale":"2024-09-13T18:38:17.740757+0000","last_undegraded":"2024-09-13T18:38:17.740757+0000","last_fullsized":"2024-09-13T18:38:17.740757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:25.268097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237877+0000","last_change":"2024-09-13T18:38:17.746727+0000","last_active":"2024-09-13T18:38:19.237877+0000","last_peered":"2024-09-13T18:38:19.237877+0000","last_clean":"2024-09-13T18:38:19.237877+0000","last_became_active":"2024-09-13T18:38:17.746488+0000","last_became_peered":"2024-09-13T18:38:17.746488+0000","last_unstale":"2024-09-13T18:38:19.237877+0000","last_undegraded":"2024-09-13T18:38:19.237877+0000","last_fullsized":"2024-09-13T18:38:19.237877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:10.475692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.741365+0000","last_change":"2024-09-13T18:38:17.328744+0000","last_active":"2024-09-13T18:38:17.741365+0000","last_peered":"2024-09-13T18:38:17.741365+0000","last_clean":"2024-09-13T18:38:17.741365+0000","last_became_active":"2024-09-13T18:38:17.328438+0000","last_became_peered":"2024-09-13T18:38:17.328438+0000","last_unstale":"2024-09-13T18:38:17.741365+0000","last_undegraded":"2024-09-13T18:38:17.741365+0000","last_fullsized":"2024-09-13T18:38:17.741365+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:44.353139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.744791+0000","last_change":"2024-09-13T18:38:17.738009+0000","last_active":"2024-09-13T18:38:17.744791+0000","last_peered":"2024-09-13T18:38:17.744791+0000","last_clean":"2024-09-13T18:38:17.744791+0000","last_became_active":"2024-09-13T18:38:17.737599+0000","last_became_peered":"2024-09-13T18:38:17.737599+0000","last_unstale":"2024-09-13T18:38:17.744791+0000","last_undegraded":"2024-09-13T18:38:17.744791+0000","last_fullsized":"2024-09-13T18:38:17.744791+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729601+0000","last_change":"2024-09-13T18:38:17.323841+0000","last_active":"2024-09-13T18:38:18.729601+0000","last_peered":"2024-09-13T18:38:18.729601+0000","last_clean":"2024-09-13T18:38:18.729601+0000","last_became_active":"2024-09-13T18:38:17.323331+0000","last_became_peered":"2024-09-13T18:38:17.323331+0000","last_unstale":"2024-09-13T18:38:18.729601+0000","last_undegraded":"2024-09-13T18:38:18.729601+0000","last_fullsized":"2024-09-13T18:38:18.729601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:48.489708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237744+0000","last_change":"2024-09-13T18:38:17.740376+0000","last_active":"2024-09-13T18:38:19.237744+0000","last_peered":"2024-09-13T18:38:19.237744+0000","last_clean":"2024-09-13T18:38:19.237744+0000","last_became_active":"2024-09-13T18:38:17.740144+0000","last_became_peered":"2024-09-13T18:38:17.740144+0000","last_unstale":"2024-09-13T18:38:19.237744+0000","last_undegraded":"2024-09-13T18:38:19.237744+0000","last_fullsized":"2024-09-13T18:38:19.237744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:34.108241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"70'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729931+0000","last_change":"2024-09-13T18:38:17.323020+0000","last_active":"2024-09-13T18:38:18.729931+0000","last_peered":"2024-09-13T18:38:18.729931+0000","last_clean":"2024-09-13T18:38:18.729931+0000","last_became_active":"2024-09-13T18:38:17.322785+0000","last_became_peered":"2024-09-13T18:38:17.322785+0000","last_unstale":"2024-09-13T18:38:18.729931+0000","last_undegraded":"2024-09-13T18:38:18.729931+0000","last_fullsized":"2024-09-13T18:38:18.729931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.427314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.725027+0000","last_change":"2024-09-13T18:38:17.729539+0000","last_active":"2024-09-13T18:38:18.725027+0000","last_peered":"2024-09-13T18:38:18.725027+0000","last_clean":"2024-09-13T18:38:18.725027+0000","last_became_active":"2024-09-13T18:38:17.728679+0000","last_became_peered":"2024-09-13T18:38:17.728679+0000","last_unstale":"2024-09-13T18:38:18.725027+0000","last_undegraded":"2024-09-13T18:38:18.725027+0000","last_fullsized":"2024-09-13T18:38:18.725027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745052+0000","last_change":"2024-09-13T18:38:17.329388+0000","last_active":"2024-09-13T18:38:17.745052+0000","last_peered":"2024-09-13T18:38:17.745052+0000","last_clean":"2024-09-13T18:38:17.745052+0000","last_became_active":"2024-09-13T18:38:17.328755+0000","last_became_peered":"2024-09-13T18:38:17.328755+0000","last_unstale":"2024-09-13T18:38:17.745052+0000","last_undegraded":"2024-09-13T18:38:17.745052+0000","last_fullsized":"2024-09-13T18:38:17.745052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:42.716636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729888+0000","last_change":"2024-09-13T18:38:17.738055+0000","last_active":"2024-09-13T18:38:18.729888+0000","last_peered":"2024-09-13T18:38:18.729888+0000","last_clean":"2024-09-13T18:38:18.729888+0000","last_became_active":"2024-09-13T18:38:17.737844+0000","last_became_peered":"2024-09-13T18:38:17.737844+0000","last_unstale":"2024-09-13T18:38:18.729888+0000","last_undegraded":"2024-09-13T18:38:18.729888+0000","last_fullsized":"2024-09-13T18:38:18.729888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.731691+0000","last_change":"2024-09-13T18:38:17.327675+0000","last_active":"2024-09-13T18:38:17.731691+0000","last_peered":"2024-09-13T18:38:17.731691+0000","last_clean":"2024-09-13T18:38:17.731691+0000","last_became_active":"2024-09-13T18:38:17.327481+0000","last_became_peered":"2024-09-13T18:38:17.327481+0000","last_unstale":"2024-09-13T18:38:17.731691+0000","last_undegraded":"2024-09-13T18:38:17.731691+0000","last_fullsized":"2024-09-13T18:38:17.731691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:32.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745016+0000","last_change":"2024-09-13T18:38:17.741601+0000","last_active":"2024-09-13T18:38:17.745016+0000","last_peered":"2024-09-13T18:38:17.745016+0000","last_clean":"2024-09-13T18:38:17.745016+0000","last_became_active":"2024-09-13T18:38:17.740629+0000","last_became_peered":"2024-09-13T18:38:17.740629+0000","last_unstale":"2024-09-13T18:38:17.745016+0000","last_undegraded":"2024-09-13T18:38:17.745016+0000","last_fullsized":"2024-09-13T18:38:17.745016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:03.077050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732494+0000","last_change":"2024-09-13T18:38:17.329826+0000","last_active":"2024-09-13T18:38:17.732494+0000","last_peered":"2024-09-13T18:38:17.732494+0000","last_clean":"2024-09-13T18:38:17.732494+0000","last_became_active":"2024-09-13T18:38:17.329645+0000","last_became_peered":"2024-09-13T18:38:17.329645+0000","last_unstale":"2024-09-13T18:38:17.732494+0000","last_undegraded":"2024-09-13T18:38:17.732494+0000","last_fullsized":"2024-09-13T18:38:17.732494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:14.739181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735259+0000","last_change":"2024-09-13T18:38:17.732615+0000","last_active":"2024-09-13T18:38:17.735259+0000","last_peered":"2024-09-13T18:38:17.735259+0000","last_clean":"2024-09-13T18:38:17.735259+0000","last_became_active":"2024-09-13T18:38:17.732477+0000","last_became_peered":"2024-09-13T18:38:17.732477+0000","last_unstale":"2024-09-13T18:38:17.735259+0000","last_undegraded":"2024-09-13T18:38:17.735259+0000","last_fullsized":"2024-09-13T18:38:17.735259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732560+0000","last_change":"2024-09-13T18:38:17.328653+0000","last_active":"2024-09-13T18:38:17.732560+0000","last_peered":"2024-09-13T18:38:17.732560+0000","last_clean":"2024-09-13T18:38:17.732560+0000","last_became_active":"2024-09-13T18:38:17.328420+0000","last_became_peered":"2024-09-13T18:38:17.328420+0000","last_unstale":"2024-09-13T18:38:17.732560+0000","last_undegraded":"2024-09-13T18:38:17.732560+0000","last_fullsized":"2024-09-13T18:38:17.732560+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:55.875972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729846+0000","last_change":"2024-09-13T18:38:17.742849+0000","last_active":"2024-09-13T18:38:18.729846+0000","last_peered":"2024-09-13T18:38:18.729846+0000","last_clean":"2024-09-13T18:38:18.729846+0000","last_became_active":"2024-09-13T18:38:17.742199+0000","last_became_peered":"2024-09-13T18:38:17.742199+0000","last_unstale":"2024-09-13T18:38:18.729846+0000","last_undegraded":"2024-09-13T18:38:18.729846+0000","last_fullsized":"2024-09-13T18:38:18.729846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237645+0000","last_change":"2024-09-13T18:38:17.324552+0000","last_active":"2024-09-13T18:38:19.237645+0000","last_peered":"2024-09-13T18:38:19.237645+0000","last_clean":"2024-09-13T18:38:19.237645+0000","last_became_active":"2024-09-13T18:38:17.324334+0000","last_became_peered":"2024-09-13T18:38:17.324334+0000","last_unstale":"2024-09-13T18:38:19.237645+0000","last_undegraded":"2024-09-13T18:38:19.237645+0000","last_fullsized":"2024-09-13T18:38:19.237645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:11.038492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237532+0000","last_change":"2024-09-13T18:38:17.745837+0000","last_active":"2024-09-13T18:38:19.237532+0000","last_peered":"2024-09-13T18:38:19.237532+0000","last_clean":"2024-09-13T18:38:19.237532+0000","last_became_active":"2024-09-13T18:38:17.745612+0000","last_became_peered":"2024-09-13T18:38:17.745612+0000","last_unstale":"2024-09-13T18:38:19.237532+0000","last_undegraded":"2024-09-13T18:38:19.237532+0000","last_fullsized":"2024-09-13T18:38:19.237532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:03.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"70'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729787+0000","last_change":"2024-09-13T18:38:17.326506+0000","last_active":"2024-09-13T18:38:18.729787+0000","last_peered":"2024-09-13T18:38:18.729787+0000","last_clean":"2024-09-13T18:38:18.729787+0000","last_became_active":"2024-09-13T18:38:17.326276+0000","last_became_peered":"2024-09-13T18:38:17.326276+0000","last_unstale":"2024-09-13T18:38:18.729787+0000","last_undegraded":"2024-09-13T18:38:18.729787+0000","last_fullsized":"2024-09-13T18:38:18.729787+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:13.296936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729709+0000","last_change":"2024-09-13T18:38:17.743738+0000","last_active":"2024-09-13T18:38:18.729709+0000","last_peered":"2024-09-13T18:38:18.729709+0000","last_clean":"2024-09-13T18:38:18.729709+0000","last_became_active":"2024-09-13T18:38:17.742043+0000","last_became_peered":"2024-09-13T18:38:17.742043+0000","last_unstale":"2024-09-13T18:38:18.729709+0000","last_undegraded":"2024-09-13T18:38:18.729709+0000","last_fullsized":"2024-09-13T18:38:18.729709+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:09.150023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"70'6","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745041+0000","last_change":"2024-09-13T18:38:17.327632+0000","last_active":"2024-09-13T18:38:17.745041+0000","last_peered":"2024-09-13T18:38:17.745041+0000","last_clean":"2024-09-13T18:38:17.745041+0000","last_became_active":"2024-09-13T18:38:17.327412+0000","last_became_peered":"2024-09-13T18:38:17.327412+0000","last_unstale":"2024-09-13T18:38:17.745041+0000","last_undegraded":"2024-09-13T18:38:17.745041+0000","last_fullsized":"2024-09-13T18:38:17.745041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.097908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745120+0000","last_change":"2024-09-13T18:38:17.739388+0000","last_active":"2024-09-13T18:38:17.745120+0000","last_peered":"2024-09-13T18:38:17.745120+0000","last_clean":"2024-09-13T18:38:17.745120+0000","last_became_active":"2024-09-13T18:38:17.738799+0000","last_became_peered":"2024-09-13T18:38:17.738799+0000","last_unstale":"2024-09-13T18:38:17.745120+0000","last_undegraded":"2024-09-13T18:38:17.745120+0000","last_fullsized":"2024-09-13T18:38:17.745120+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:51.093088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237810+0000","last_change":"2024-09-13T18:38:17.326014+0000","last_active":"2024-09-13T18:38:19.237810+0000","last_peered":"2024-09-13T18:38:19.237810+0000","last_clean":"2024-09-13T18:38:19.237810+0000","last_became_active":"2024-09-13T18:38:17.321938+0000","last_became_peered":"2024-09-13T18:38:17.321938+0000","last_unstale":"2024-09-13T18:38:19.237810+0000","last_undegraded":"2024-09-13T18:38:19.237810+0000","last_fullsized":"2024-09-13T18:38:19.237810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:10.905952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729979+0000","last_change":"2024-09-13T18:38:17.732887+0000","last_active":"2024-09-13T18:38:18.729979+0000","last_peered":"2024-09-13T18:38:18.729979+0000","last_clean":"2024-09-13T18:38:18.729979+0000","last_became_active":"2024-09-13T18:38:17.732675+0000","last_became_peered":"2024-09-13T18:38:17.732675+0000","last_unstale":"2024-09-13T18:38:18.729979+0000","last_undegraded":"2024-09-13T18:38:18.729979+0000","last_fullsized":"2024-09-13T18:38:18.729979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729904+0000","last_change":"2024-09-13T18:38:17.324423+0000","last_active":"2024-09-13T18:38:18.729904+0000","last_peered":"2024-09-13T18:38:18.729904+0000","last_clean":"2024-09-13T18:38:18.729904+0000","last_became_active":"2024-09-13T18:38:17.323621+0000","last_became_peered":"2024-09-13T18:38:17.323621+0000","last_unstale":"2024-09-13T18:38:18.729904+0000","last_undegraded":"2024-09-13T18:38:18.729904+0000","last_fullsized":"2024-09-13T18:38:18.729904+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.763274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.733311+0000","last_change":"2024-09-13T18:38:17.733255+0000","last_active":"2024-09-13T18:38:17.733311+0000","last_peered":"2024-09-13T18:38:17.733311+0000","last_clean":"2024-09-13T18:38:17.733311+0000","last_became_active":"2024-09-13T18:38:17.733027+0000","last_became_peered":"2024-09-13T18:38:17.733027+0000","last_unstale":"2024-09-13T18:38:17.733311+0000","last_undegraded":"2024-09-13T18:38:17.733311+0000","last_fullsized":"2024-09-13T18:38:17.733311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:45.709814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729616+0000","last_change":"2024-09-13T18:38:17.323472+0000","last_active":"2024-09-13T18:38:18.729616+0000","last_peered":"2024-09-13T18:38:18.729616+0000","last_clean":"2024-09-13T18:38:18.729616+0000","last_became_active":"2024-09-13T18:38:17.323020+0000","last_became_peered":"2024-09-13T18:38:17.323020+0000","last_unstale":"2024-09-13T18:38:18.729616+0000","last_undegraded":"2024-09-13T18:38:18.729616+0000","last_fullsized":"2024-09-13T18:38:18.729616+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:01.634334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729541+0000","last_change":"2024-09-13T18:38:17.738055+0000","last_active":"2024-09-13T18:38:18.729541+0000","last_peered":"2024-09-13T18:38:18.729541+0000","last_clean":"2024-09-13T18:38:18.729541+0000","last_became_active":"2024-09-13T18:38:17.737844+0000","last_became_peered":"2024-09-13T18:38:17.737844+0000","last_unstale":"2024-09-13T18:38:18.729541+0000","last_undegraded":"2024-09-13T18:38:18.729541+0000","last_fullsized":"2024-09-13T18:38:18.729541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:54.283731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"70'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729867+0000","last_change":"2024-09-13T18:38:17.325123+0000","last_active":"2024-09-13T18:38:18.729867+0000","last_peered":"2024-09-13T18:38:18.729867+0000","last_clean":"2024-09-13T18:38:18.729867+0000","last_became_active":"2024-09-13T18:38:17.323888+0000","last_became_peered":"2024-09-13T18:38:17.323888+0000","last_unstale":"2024-09-13T18:38:18.729867+0000","last_undegraded":"2024-09-13T18:38:18.729867+0000","last_fullsized":"2024-09-13T18:38:18.729867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:34.260102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730055+0000","last_change":"2024-09-13T18:38:17.735920+0000","last_active":"2024-09-13T18:38:18.730055+0000","last_peered":"2024-09-13T18:38:18.730055+0000","last_clean":"2024-09-13T18:38:18.730055+0000","last_became_active":"2024-09-13T18:38:17.735715+0000","last_became_peered":"2024-09-13T18:38:17.735715+0000","last_unstale":"2024-09-13T18:38:18.730055+0000","last_undegraded":"2024-09-13T18:38:18.730055+0000","last_fullsized":"2024-09-13T18:38:18.730055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739929+0000","last_change":"2024-09-13T18:38:17.330525+0000","last_active":"2024-09-13T18:38:17.739929+0000","last_peered":"2024-09-13T18:38:17.739929+0000","last_clean":"2024-09-13T18:38:17.739929+0000","last_became_active":"2024-09-13T18:38:17.330227+0000","last_became_peered":"2024-09-13T18:38:17.330227+0000","last_unstale":"2024-09-13T18:38:17.739929+0000","last_undegraded":"2024-09-13T18:38:17.739929+0000","last_fullsized":"2024-09-13T18:38:17.739929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:06.737081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729538+0000","last_change":"2024-09-13T18:38:17.740519+0000","last_active":"2024-09-13T18:38:18.729538+0000","last_peered":"2024-09-13T18:38:18.729538+0000","last_clean":"2024-09-13T18:38:18.729538+0000","last_became_active":"2024-09-13T18:38:17.739560+0000","last_became_peered":"2024-09-13T18:38:17.739560+0000","last_unstale":"2024-09-13T18:38:18.729538+0000","last_undegraded":"2024-09-13T18:38:18.729538+0000","last_fullsized":"2024-09-13T18:38:18.729538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:53.060074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237908+0000","last_change":"2024-09-13T18:38:17.322174+0000","last_active":"2024-09-13T18:38:19.237908+0000","last_peered":"2024-09-13T18:38:19.237908+0000","last_clean":"2024-09-13T18:38:19.237908+0000","last_became_active":"2024-09-13T18:38:17.321610+0000","last_became_peered":"2024-09-13T18:38:17.321610+0000","last_unstale":"2024-09-13T18:38:19.237908+0000","last_undegraded":"2024-09-13T18:38:19.237908+0000","last_fullsized":"2024-09-13T18:38:19.237908+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:02.170635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.743954+0000","last_change":"2024-09-13T18:38:17.742631+0000","last_active":"2024-09-13T18:38:17.743954+0000","last_peered":"2024-09-13T18:38:17.743954+0000","last_clean":"2024-09-13T18:38:17.743954+0000","last_became_active":"2024-09-13T18:38:17.742407+0000","last_became_peered":"2024-09-13T18:38:17.742407+0000","last_unstale":"2024-09-13T18:38:17.743954+0000","last_undegraded":"2024-09-13T18:38:17.743954+0000","last_fullsized":"2024-09-13T18:38:17.743954+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:45.709814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"70'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729934+0000","last_change":"2024-09-13T18:38:17.327084+0000","last_active":"2024-09-13T18:38:18.729934+0000","last_peered":"2024-09-13T18:38:18.729934+0000","last_clean":"2024-09-13T18:38:18.729934+0000","last_became_active":"2024-09-13T18:38:17.326824+0000","last_became_peered":"2024-09-13T18:38:17.326824+0000","last_unstale":"2024-09-13T18:38:18.729934+0000","last_undegraded":"2024-09-13T18:38:18.729934+0000","last_fullsized":"2024-09-13T18:38:18.729934+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:44.702712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729507+0000","last_change":"2024-09-13T18:38:17.747383+0000","last_active":"2024-09-13T18:38:18.729507+0000","last_peered":"2024-09-13T18:38:18.729507+0000","last_clean":"2024-09-13T18:38:18.729507+0000","last_became_active":"2024-09-13T18:38:17.746699+0000","last_became_peered":"2024-09-13T18:38:17.746699+0000","last_unstale":"2024-09-13T18:38:18.729507+0000","last_undegraded":"2024-09-13T18:38:18.729507+0000","last_fullsized":"2024-09-13T18:38:18.729507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:03.936077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237763+0000","last_change":"2024-09-13T18:38:17.330533+0000","last_active":"2024-09-13T18:38:19.237763+0000","last_peered":"2024-09-13T18:38:19.237763+0000","last_clean":"2024-09-13T18:38:19.237763+0000","last_became_active":"2024-09-13T18:38:17.330146+0000","last_became_peered":"2024-09-13T18:38:17.330146+0000","last_unstale":"2024-09-13T18:38:19.237763+0000","last_undegraded":"2024-09-13T18:38:19.237763+0000","last_fullsized":"2024-09-13T18:38:19.237763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:25.379276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745037+0000","last_change":"2024-09-13T18:38:17.738699+0000","last_active":"2024-09-13T18:38:17.745037+0000","last_peered":"2024-09-13T18:38:17.745037+0000","last_clean":"2024-09-13T18:38:17.745037+0000","last_became_active":"2024-09-13T18:38:17.737870+0000","last_became_peered":"2024-09-13T18:38:17.737870+0000","last_unstale":"2024-09-13T18:38:17.745037+0000","last_undegraded":"2024-09-13T18:38:17.745037+0000","last_fullsized":"2024-09-13T18:38:17.745037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:46.001194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.725000+0000","last_change":"2024-09-13T18:38:17.331212+0000","last_active":"2024-09-13T18:38:18.725000+0000","last_peered":"2024-09-13T18:38:18.725000+0000","last_clean":"2024-09-13T18:38:18.725000+0000","last_became_active":"2024-09-13T18:38:17.330972+0000","last_became_peered":"2024-09-13T18:38:17.330972+0000","last_unstale":"2024-09-13T18:38:18.725000+0000","last_undegraded":"2024-09-13T18:38:18.725000+0000","last_fullsized":"2024-09-13T18:38:18.725000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.097908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237984+0000","last_change":"2024-09-13T18:38:17.738825+0000","last_active":"2024-09-13T18:38:19.237984+0000","last_peered":"2024-09-13T18:38:19.237984+0000","last_clean":"2024-09-13T18:38:19.237984+0000","last_became_active":"2024-09-13T18:38:17.738585+0000","last_became_peered":"2024-09-13T18:38:17.738585+0000","last_unstale":"2024-09-13T18:38:19.237984+0000","last_undegraded":"2024-09-13T18:38:19.237984+0000","last_fullsized":"2024-09-13T18:38:19.237984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:01.463366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237903+0000","last_change":"2024-09-13T18:38:17.329703+0000","last_active":"2024-09-13T18:38:19.237903+0000","last_peered":"2024-09-13T18:38:19.237903+0000","last_clean":"2024-09-13T18:38:19.237903+0000","last_became_active":"2024-09-13T18:38:17.323771+0000","last_became_peered":"2024-09-13T18:38:17.323771+0000","last_unstale":"2024-09-13T18:38:19.237903+0000","last_undegraded":"2024-09-13T18:38:19.237903+0000","last_fullsized":"2024-09-13T18:38:19.237903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:28.460168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237658+0000","last_change":"2024-09-13T18:38:17.742003+0000","last_active":"2024-09-13T18:38:19.237658+0000","last_peered":"2024-09-13T18:38:19.237658+0000","last_clean":"2024-09-13T18:38:19.237658+0000","last_became_active":"2024-09-13T18:38:17.741748+0000","last_became_peered":"2024-09-13T18:38:17.741748+0000","last_unstale":"2024-09-13T18:38:19.237658+0000","last_undegraded":"2024-09-13T18:38:19.237658+0000","last_fullsized":"2024-09-13T18:38:19.237658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:38.550639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732642+0000","last_change":"2024-09-13T18:38:17.326457+0000","last_active":"2024-09-13T18:38:17.732642+0000","last_peered":"2024-09-13T18:38:17.732642+0000","last_clean":"2024-09-13T18:38:17.732642+0000","last_became_active":"2024-09-13T18:38:17.326248+0000","last_became_peered":"2024-09-13T18:38:17.326248+0000","last_unstale":"2024-09-13T18:38:17.732642+0000","last_undegraded":"2024-09-13T18:38:17.732642+0000","last_fullsized":"2024-09-13T18:38:17.732642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:31.179318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729643+0000","last_change":"2024-09-13T18:38:17.730122+0000","last_active":"2024-09-13T18:38:18.729643+0000","last_peered":"2024-09-13T18:38:18.729643+0000","last_clean":"2024-09-13T18:38:18.729643+0000","last_became_active":"2024-09-13T18:38:17.729775+0000","last_became_peered":"2024-09-13T18:38:17.729775+0000","last_unstale":"2024-09-13T18:38:18.729643+0000","last_undegraded":"2024-09-13T18:38:18.729643+0000","last_fullsized":"2024-09-13T18:38:18.729643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:46.577337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735648+0000","last_change":"2024-09-13T18:38:17.329269+0000","last_active":"2024-09-13T18:38:17.735648+0000","last_peered":"2024-09-13T18:38:17.735648+0000","last_clean":"2024-09-13T18:38:17.735648+0000","last_became_active":"2024-09-13T18:38:17.328455+0000","last_became_peered":"2024-09-13T18:38:17.328455+0000","last_unstale":"2024-09-13T18:38:17.735648+0000","last_undegraded":"2024-09-13T18:38:17.735648+0000","last_fullsized":"2024-09-13T18:38:17.735648+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:55.875972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729845+0000","last_change":"2024-09-13T18:38:17.741494+0000","last_active":"2024-09-13T18:38:18.729845+0000","last_peered":"2024-09-13T18:38:18.729845+0000","last_clean":"2024-09-13T18:38:18.729845+0000","last_became_active":"2024-09-13T18:38:17.740093+0000","last_became_peered":"2024-09-13T18:38:17.740093+0000","last_unstale":"2024-09-13T18:38:18.729845+0000","last_undegraded":"2024-09-13T18:38:18.729845+0000","last_fullsized":"2024-09-13T18:38:18.729845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:03.077050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740023+0000","last_change":"2024-09-13T18:38:17.329226+0000","last_active":"2024-09-13T18:38:17.740023+0000","last_peered":"2024-09-13T18:38:17.740023+0000","last_clean":"2024-09-13T18:38:17.740023+0000","last_became_active":"2024-09-13T18:38:17.328430+0000","last_became_peered":"2024-09-13T18:38:17.328430+0000","last_unstale":"2024-09-13T18:38:17.740023+0000","last_undegraded":"2024-09-13T18:38:17.740023+0000","last_fullsized":"2024-09-13T18:38:17.740023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.427314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739795+0000","last_change":"2024-09-13T18:38:17.739422+0000","last_active":"2024-09-13T18:38:17.739795+0000","last_peered":"2024-09-13T18:38:17.739795+0000","last_clean":"2024-09-13T18:38:17.739795+0000","last_became_active":"2024-09-13T18:38:17.739099+0000","last_became_peered":"2024-09-13T18:38:17.739099+0000","last_unstale":"2024-09-13T18:38:17.739795+0000","last_undegraded":"2024-09-13T18:38:17.739795+0000","last_fullsized":"2024-09-13T18:38:17.739795+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:37.434416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732140+0000","last_change":"2024-09-13T18:38:17.327252+0000","last_active":"2024-09-13T18:38:17.732140+0000","last_peered":"2024-09-13T18:38:17.732140+0000","last_clean":"2024-09-13T18:38:17.732140+0000","last_became_active":"2024-09-13T18:38:17.327026+0000","last_became_peered":"2024-09-13T18:38:17.327026+0000","last_unstale":"2024-09-13T18:38:17.732140+0000","last_undegraded":"2024-09-13T18:38:17.732140+0000","last_fullsized":"2024-09-13T18:38:17.732140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.581890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237705+0000","last_change":"2024-09-13T18:38:17.744234+0000","last_active":"2024-09-13T18:38:19.237705+0000","last_peered":"2024-09-13T18:38:19.237705+0000","last_clean":"2024-09-13T18:38:19.237705+0000","last_became_active":"2024-09-13T18:38:17.743495+0000","last_became_peered":"2024-09-13T18:38:17.743495+0000","last_unstale":"2024-09-13T18:38:19.237705+0000","last_undegraded":"2024-09-13T18:38:19.237705+0000","last_fullsized":"2024-09-13T18:38:19.237705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:08.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730139+0000","last_change":"2024-09-13T18:38:17.324699+0000","last_active":"2024-09-13T18:38:18.730139+0000","last_peered":"2024-09-13T18:38:18.730139+0000","last_clean":"2024-09-13T18:38:18.730139+0000","last_became_active":"2024-09-13T18:38:17.324435+0000","last_became_peered":"2024-09-13T18:38:17.324435+0000","last_unstale":"2024-09-13T18:38:18.730139+0000","last_undegraded":"2024-09-13T18:38:18.730139+0000","last_fullsized":"2024-09-13T18:38:18.730139+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:50.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747482+0000","last_change":"2024-09-13T18:38:17.746725+0000","last_active":"2024-09-13T18:38:17.747482+0000","last_peered":"2024-09-13T18:38:17.747482+0000","last_clean":"2024-09-13T18:38:17.747482+0000","last_became_active":"2024-09-13T18:38:17.745168+0000","last_became_peered":"2024-09-13T18:38:17.745168+0000","last_unstale":"2024-09-13T18:38:17.747482+0000","last_undegraded":"2024-09-13T18:38:17.747482+0000","last_fullsized":"2024-09-13T18:38:17.747482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:30.014666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.725553+0000","last_change":"2024-09-13T18:38:17.331434+0000","last_active":"2024-09-13T18:38:17.725553+0000","last_peered":"2024-09-13T18:38:17.725553+0000","last_clean":"2024-09-13T18:38:17.725553+0000","last_became_active":"2024-09-13T18:38:17.329781+0000","last_became_peered":"2024-09-13T18:38:17.329781+0000","last_unstale":"2024-09-13T18:38:17.725553+0000","last_undegraded":"2024-09-13T18:38:17.725553+0000","last_fullsized":"2024-09-13T18:38:17.725553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:32.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.742618+0000","last_change":"2024-09-13T18:38:17.741426+0000","last_active":"2024-09-13T18:38:17.742618+0000","last_peered":"2024-09-13T18:38:17.742618+0000","last_clean":"2024-09-13T18:38:17.742618+0000","last_became_active":"2024-09-13T18:38:17.741235+0000","last_became_peered":"2024-09-13T18:38:17.741235+0000","last_unstale":"2024-09-13T18:38:17.742618+0000","last_undegraded":"2024-09-13T18:38:17.742618+0000","last_fullsized":"2024-09-13T18:38:17.742618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730012+0000","last_change":"2024-09-13T18:38:17.319728+0000","last_active":"2024-09-13T18:38:18.730012+0000","last_peered":"2024-09-13T18:38:18.730012+0000","last_clean":"2024-09-13T18:38:18.730012+0000","last_became_active":"2024-09-13T18:38:17.319520+0000","last_became_peered":"2024-09-13T18:38:17.319520+0000","last_unstale":"2024-09-13T18:38:18.730012+0000","last_undegraded":"2024-09-13T18:38:18.730012+0000","last_fullsized":"2024-09-13T18:38:18.730012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:43.330348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237834+0000","last_change":"2024-09-13T18:38:17.744385+0000","last_active":"2024-09-13T18:38:19.237834+0000","last_peered":"2024-09-13T18:38:19.237834+0000","last_clean":"2024-09-13T18:38:19.237834+0000","last_became_active":"2024-09-13T18:38:17.743964+0000","last_became_peered":"2024-09-13T18:38:17.743964+0000","last_unstale":"2024-09-13T18:38:19.237834+0000","last_undegraded":"2024-09-13T18:38:19.237834+0000","last_fullsized":"2024-09-13T18:38:19.237834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:56.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740590+0000","last_change":"2024-09-13T18:38:17.325081+0000","last_active":"2024-09-13T18:38:17.740590+0000","last_peered":"2024-09-13T18:38:17.740590+0000","last_clean":"2024-09-13T18:38:17.740590+0000","last_became_active":"2024-09-13T18:38:17.324807+0000","last_became_peered":"2024-09-13T18:38:17.324807+0000","last_unstale":"2024-09-13T18:38:17.740590+0000","last_undegraded":"2024-09-13T18:38:17.740590+0000","last_fullsized":"2024-09-13T18:38:17.740590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:50.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.727889+0000","last_change":"2024-09-13T18:38:17.727109+0000","last_active":"2024-09-13T18:38:17.727889+0000","last_peered":"2024-09-13T18:38:17.727889+0000","last_clean":"2024-09-13T18:38:17.727889+0000","last_became_active":"2024-09-13T18:38:17.726818+0000","last_became_peered":"2024-09-13T18:38:17.726818+0000","last_unstale":"2024-09-13T18:38:17.727889+0000","last_undegraded":"2024-09-13T18:38:17.727889+0000","last_fullsized":"2024-09-13T18:38:17.727889+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:45.360240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237964+0000","last_change":"2024-09-13T18:38:17.329525+0000","last_active":"2024-09-13T18:38:19.237964+0000","last_peered":"2024-09-13T18:38:19.237964+0000","last_clean":"2024-09-13T18:38:19.237964+0000","last_became_active":"2024-09-13T18:38:17.323469+0000","last_became_peered":"2024-09-13T18:38:17.323469+0000","last_unstale":"2024-09-13T18:38:19.237964+0000","last_undegraded":"2024-09-13T18:38:19.237964+0000","last_fullsized":"2024-09-13T18:38:19.237964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:42.490478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237950+0000","last_change":"2024-09-13T18:38:17.744291+0000","last_active":"2024-09-13T18:38:19.237950+0000","last_peered":"2024-09-13T18:38:19.237950+0000","last_clean":"2024-09-13T18:38:19.237950+0000","last_became_active":"2024-09-13T18:38:17.743665+0000","last_became_peered":"2024-09-13T18:38:17.743665+0000","last_unstale":"2024-09-13T18:38:19.237950+0000","last_undegraded":"2024-09-13T18:38:19.237950+0000","last_fullsized":"2024-09-13T18:38:19.237950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:49.496809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732587+0000","last_change":"2024-09-13T18:38:17.325564+0000","last_active":"2024-09-13T18:38:17.732587+0000","last_peered":"2024-09-13T18:38:17.732587+0000","last_clean":"2024-09-13T18:38:17.732587+0000","last_became_active":"2024-09-13T18:38:17.325352+0000","last_became_peered":"2024-09-13T18:38:17.325352+0000","last_unstale":"2024-09-13T18:38:17.732587+0000","last_undegraded":"2024-09-13T18:38:17.732587+0000","last_fullsized":"2024-09-13T18:38:17.732587+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.986982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.321000+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:38:17.321000+0000","last_peered":"2024-09-13T18:38:17.321000+0000","last_clean":"2024-09-13T18:38:17.321000+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:38:17.321000+0000","last_undegraded":"2024-09-13T18:38:17.321000+0000","last_fullsized":"2024-09-13T18:38:17.321000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.46899999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.51600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0880000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.86599999999999999,"15min":0.90000000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0189999999999999,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.48099999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.101,"5min":1.371,"15min":1.371},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94699999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91600000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0369999999999999,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.86799999999999999,"15min":0.90100000000000002},"min":{"1min":0.47599999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88300000000000001,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.85499999999999998,"15min":0.88200000000000001},"min":{"1min":0.55100000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.746},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":0.94599999999999995},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":0.86099999999999999},"min":{"1min":0.52700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91100000000000003,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.89900000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.44600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.621}]},{"osd":5,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.48699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.67600000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.59899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":2.0579999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":2.3399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.51900000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.876}]},{"osd":2,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86599999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":3.742}]},{"osd":3,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86399999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":3.6909999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":1.175}]},{"osd":5,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":4.952},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":3.7989999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.41899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":5.5069999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.56999999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.3720000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45200000000000001,"15min":0.45700000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.442,"15min":0.443},"min":{"1min":0.26100000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66000000000000003,"5min":0.752,"15min":0.752},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.80100000000000005,"15min":0.85899999999999999},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61399999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.57999999999999996,"15min":0.60699999999999998},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63600000000000001,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.621,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68799999999999994,"5min":7.798,"15min":7.798},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.036,"5min":3.093,"15min":3.093},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0189999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91800000000000004,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.58699999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.0149999999999999,"15min":1.0569999999999999},"min":{"1min":0.59299999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1240000000000001,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.748}]},{"osd":7,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.59999999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0840000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52900000000000003,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.55700000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.47199999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.56899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46800000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.503}]},{"osd":3,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81299999999999994,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91100000000000003,"5min":1.02,"15min":1.02},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86699999999999999,"5min":1.052,"15min":1.052},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.875,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.84299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.89700000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194381,"statfs":{"total":200000000,"available":199046912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56100000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.747},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.63},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.40200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.59499999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.64000000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 18:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.58799999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90500000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85199999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.27600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54000000000000004,"5min":1.669,"15min":1.669},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54100000000000004,"5min":0.874,"15min":0.874},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.33100000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58499999999999996,"5min":1.591,"15min":1.591},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.34599999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.499,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.251,"15min":0.251},"max":{"1min":0.503,"5min":1.03,"15min":1.03},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":1.637,"15min":1.637},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.698,"15min":1.698},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":1.204},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96699999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95699999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93200000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.1830000000000001}]}]}],"pool_statfs":[]}} 2024-09-13T18:38:21.884 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:38:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.069+0000 7fb109400640 1 Processor -- start 2024-09-13T18:38:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.069+0000 7fb109400640 1 -- start start 2024-09-13T18:38:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.070+0000 7fb109400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.070+0000 7fb109400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb1040cb0b0 0x7fb10415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.070+0000 7fb109400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb104140480 con 0x7fb104140980 2024-09-13T18:38:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.070+0000 7fb109400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb10415c160 con 0x7fb1040cb0b0 2024-09-13T18:38:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.070+0000 7fb109400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb10415ee90 con 0x7fb1040cacd0 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.071+0000 7fb0f9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb1040cb0b0 0x7fb10415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.071+0000 7fb102800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.071+0000 7fb0f9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb1040cb0b0 0x7fb10415bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:35682/0 (socket says 172.21.15.192:35682) 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.071+0000 7fb102800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:60030/0 (socket says 172.21.15.192:60030) 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.071+0000 7fb0f9e00640 1 -- 172.21.15.192:0/2377982104 learned_addr learned my addr 172.21.15.192:0/2377982104 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb0f9e00640 1 -- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 msgr2=0x7fb10415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb0f9e00640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb0f9e00640 1 -- 172.21.15.192:0/2377982104 >> v1:172.21.15.194:6789/0 conn(0x7fb104140980 legacy=0x7fb1040afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb0f9e00640 1 -- 172.21.15.192:0/2377982104 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb10415f170 con 0x7fb1040cb0b0 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb101e00640 1 -- 172.21.15.192:0/2377982104 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2077853384 0 0) 0x7fb104140480 con 0x7fb104140980 2024-09-13T18:38:22.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.072+0000 7fb102800640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb0f9e00640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cb0b0 0x7fb10415bc20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009870 tx=0x7fb0ec02a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2705fd39588b874 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb101e00640 1 -- 172.21.15.192:0/2377982104 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec032440 con 0x7fb1040cb0b0 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb101e00640 1 -- 172.21.15.192:0/2377982104 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec0325a0 con 0x7fb1040cb0b0 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb101e00640 1 -- 172.21.15.192:0/2377982104 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec032930 con 0x7fb1040cb0b0 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 -- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cb0b0 msgr2=0x7fb10415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cb0b0 0x7fb10415bc20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec009870 tx=0x7fb0ec02a250 comp rx=0 tx=0).stop 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 -- 172.21.15.192:0/2377982104 shutdown_connections 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cb0b0 0x7fb10415bc20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 --2- 172.21.15.192:0/2377982104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1040cacd0 0x7fb10415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.073+0000 7fb109400640 1 -- 172.21.15.192:0/2377982104 >> 172.21.15.192:0/2377982104 conn(0x7fb1040ae960 msgr2=0x7fb10406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.074+0000 7fb109400640 1 -- 172.21.15.192:0/2377982104 shutdown_connections 2024-09-13T18:38:22.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.074+0000 7fb109400640 1 -- 172.21.15.192:0/2377982104 wait complete. 2024-09-13T18:38:22.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.075+0000 7fb109400640 1 Processor -- start 2024-09-13T18:38:22.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.075+0000 7fb109400640 1 -- start start 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cacd0 0x7fb10413d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb104140980 0x7fb1040ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040b2b80 con 0x7fb1040cb0b0 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040cdc80 con 0x7fb1040cacd0 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.076+0000 7fb109400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1040cdef0 con 0x7fb104140980 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34742/0 (socket says 172.21.15.192:34742) 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 -- 172.21.15.192:0/3291798613 learned_addr learned my addr 172.21.15.192:0/3291798613 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb102800640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cacd0 0x7fb10413d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb103200640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb104140980 0x7fb1040ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 -- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb104140980 msgr2=0x7fb1040ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb104140980 0x7fb1040ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 -- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cacd0 msgr2=0x7fb10413d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cacd0 0x7fb10413d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 -- 172.21.15.192:0/3291798613 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4009400 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.077+0000 7fb0f9e00640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec000c00 tx=0x7fb0ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.078+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec032440 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.078+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec030980 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.078+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec030d30 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.078+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0ec0094d0 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.078+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1040ce4b0 con 0x7fb1040cb0b0 2024-09-13T18:38:22.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.079+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb104141180 con 0x7fb1040cb0b0 2024-09-13T18:38:22.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.080+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0ec039040 con 0x7fb1040cb0b0 2024-09-13T18:38:22.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.081+0000 7fb0fb400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 0x7fb0e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.081+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb0ec0a9be0 con 0x7fb1040cb0b0 2024-09-13T18:38:22.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.081+0000 7fb102800640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 0x7fb0e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.082+0000 7fb102800640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 0x7fb0e006d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009c30 tx=0x7fb0f4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.086+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0ec074dd0 con 0x7fb1040cb0b0 2024-09-13T18:38:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.250+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb104140db0 con 0x7fb0e006ac00 2024-09-13T18:38:22.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.258+0000 7fb0fb400640 1 -- 172.21.15.192:0/3291798613 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284981 (secure 0 0 0) 0x7fb0f4009880 con 0x7fb0e006ac00 2024-09-13T18:38:22.263 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:22.265 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 msgr2=0x7fb0e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 0x7fb0e006d0c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4009c30 tx=0x7fb0f4009190 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 msgr2=0x7fb1040cb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec000c00 tx=0x7fb0ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 shutdown_connections 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0e006ac00 0x7fb0e006d0c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb104140980 0x7fb1040ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1040cb0b0 0x7fb1040cb490 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 --2- 172.21.15.192:0/3291798613 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1040cacd0 0x7fb10413d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 >> 172.21.15.192:0/3291798613 conn(0x7fb1040ae960 msgr2=0x7fb104159210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 shutdown_connections 2024-09-13T18:38:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.262+0000 7fb109400640 1 -- 172.21.15.192:0/3291798613 wait complete. 2024-09-13T18:38:22.280 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-13T18:38:20.766250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3986,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558513,"statfs":{"total":1600000000,"available":1595917436,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.459646"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747288+0000","last_change":"2024-09-13T18:38:17.746489+0000","last_active":"2024-09-13T18:38:17.747288+0000","last_peered":"2024-09-13T18:38:17.747288+0000","last_clean":"2024-09-13T18:38:17.747288+0000","last_became_active":"2024-09-13T18:38:17.746274+0000","last_became_peered":"2024-09-13T18:38:17.746274+0000","last_unstale":"2024-09-13T18:38:17.747288+0000","last_undegraded":"2024-09-13T18:38:17.747288+0000","last_fullsized":"2024-09-13T18:38:17.747288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.748435+0000","last_change":"2024-09-13T18:38:17.748359+0000","last_active":"2024-09-13T18:38:17.748435+0000","last_peered":"2024-09-13T18:38:17.748435+0000","last_clean":"2024-09-13T18:38:17.748435+0000","last_became_active":"2024-09-13T18:38:17.748086+0000","last_became_peered":"2024-09-13T18:38:17.748086+0000","last_unstale":"2024-09-13T18:38:17.748435+0000","last_undegraded":"2024-09-13T18:38:17.748435+0000","last_fullsized":"2024-09-13T18:38:17.748435+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:57.945035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729474+0000","last_change":"2024-09-13T18:38:17.731711+0000","last_active":"2024-09-13T18:38:18.729474+0000","last_peered":"2024-09-13T18:38:18.729474+0000","last_clean":"2024-09-13T18:38:18.729474+0000","last_became_active":"2024-09-13T18:38:17.731498+0000","last_became_peered":"2024-09-13T18:38:17.731498+0000","last_unstale":"2024-09-13T18:38:18.729474+0000","last_undegraded":"2024-09-13T18:38:18.729474+0000","last_fullsized":"2024-09-13T18:38:18.729474+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729432+0000","last_change":"2024-09-13T18:38:17.747332+0000","last_active":"2024-09-13T18:38:18.729432+0000","last_peered":"2024-09-13T18:38:18.729432+0000","last_clean":"2024-09-13T18:38:18.729432+0000","last_became_active":"2024-09-13T18:38:17.747063+0000","last_became_peered":"2024-09-13T18:38:17.747063+0000","last_unstale":"2024-09-13T18:38:18.729432+0000","last_undegraded":"2024-09-13T18:38:18.729432+0000","last_fullsized":"2024-09-13T18:38:18.729432+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:20:15.622090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.749234+0000","last_change":"2024-09-13T18:38:17.749162+0000","last_active":"2024-09-13T18:38:17.749234+0000","last_peered":"2024-09-13T18:38:17.749234+0000","last_clean":"2024-09-13T18:38:17.749234+0000","last_became_active":"2024-09-13T18:38:17.748802+0000","last_became_peered":"2024-09-13T18:38:17.748802+0000","last_unstale":"2024-09-13T18:38:17.749234+0000","last_undegraded":"2024-09-13T18:38:17.749234+0000","last_fullsized":"2024-09-13T18:38:17.749234+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.746083+0000","last_change":"2024-09-13T18:38:17.745961+0000","last_active":"2024-09-13T18:38:17.746083+0000","last_peered":"2024-09-13T18:38:17.746083+0000","last_clean":"2024-09-13T18:38:17.746083+0000","last_became_active":"2024-09-13T18:38:17.745408+0000","last_became_peered":"2024-09-13T18:38:17.745408+0000","last_unstale":"2024-09-13T18:38:17.746083+0000","last_undegraded":"2024-09-13T18:38:17.746083+0000","last_fullsized":"2024-09-13T18:38:17.746083+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729451+0000","last_change":"2024-09-13T18:38:17.744163+0000","last_active":"2024-09-13T18:38:18.729451+0000","last_peered":"2024-09-13T18:38:18.729451+0000","last_clean":"2024-09-13T18:38:18.729451+0000","last_became_active":"2024-09-13T18:38:17.743265+0000","last_became_peered":"2024-09-13T18:38:17.743265+0000","last_unstale":"2024-09-13T18:38:18.729451+0000","last_undegraded":"2024-09-13T18:38:18.729451+0000","last_fullsized":"2024-09-13T18:38:18.729451+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:51:19.116809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237534+0000","last_change":"2024-09-13T18:38:17.747670+0000","last_active":"2024-09-13T18:38:19.237534+0000","last_peered":"2024-09-13T18:38:19.237534+0000","last_clean":"2024-09-13T18:38:19.237534+0000","last_became_active":"2024-09-13T18:38:17.747379+0000","last_became_peered":"2024-09-13T18:38:17.747379+0000","last_unstale":"2024-09-13T18:38:19.237534+0000","last_undegraded":"2024-09-13T18:38:19.237534+0000","last_fullsized":"2024-09-13T18:38:19.237534+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:48:17.676985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745096+0000","last_change":"2024-09-13T18:38:17.739301+0000","last_active":"2024-09-13T18:38:17.745096+0000","last_peered":"2024-09-13T18:38:17.745096+0000","last_clean":"2024-09-13T18:38:17.745096+0000","last_became_active":"2024-09-13T18:38:17.738490+0000","last_became_peered":"2024-09-13T18:38:17.738490+0000","last_unstale":"2024-09-13T18:38:17.745096+0000","last_undegraded":"2024-09-13T18:38:17.745096+0000","last_fullsized":"2024-09-13T18:38:17.745096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:17.364770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.744987+0000","last_change":"2024-09-13T18:38:17.740368+0000","last_active":"2024-09-13T18:38:17.744987+0000","last_peered":"2024-09-13T18:38:17.744987+0000","last_clean":"2024-09-13T18:38:17.744987+0000","last_became_active":"2024-09-13T18:38:17.740148+0000","last_became_peered":"2024-09-13T18:38:17.740148+0000","last_unstale":"2024-09-13T18:38:17.744987+0000","last_undegraded":"2024-09-13T18:38:17.744987+0000","last_fullsized":"2024-09-13T18:38:17.744987+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:36:07.605029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724894+0000","last_change":"2024-09-13T18:38:17.747083+0000","last_active":"2024-09-13T18:38:18.724894+0000","last_peered":"2024-09-13T18:38:18.724894+0000","last_clean":"2024-09-13T18:38:18.724894+0000","last_became_active":"2024-09-13T18:38:17.746863+0000","last_became_peered":"2024-09-13T18:38:17.746863+0000","last_unstale":"2024-09-13T18:38:18.724894+0000","last_undegraded":"2024-09-13T18:38:18.724894+0000","last_fullsized":"2024-09-13T18:38:18.724894+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745164+0000","last_change":"2024-09-13T18:38:17.743038+0000","last_active":"2024-09-13T18:38:17.745164+0000","last_peered":"2024-09-13T18:38:17.745164+0000","last_clean":"2024-09-13T18:38:17.745164+0000","last_became_active":"2024-09-13T18:38:17.742815+0000","last_became_peered":"2024-09-13T18:38:17.742815+0000","last_unstale":"2024-09-13T18:38:17.745164+0000","last_undegraded":"2024-09-13T18:38:17.745164+0000","last_fullsized":"2024-09-13T18:38:17.745164+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:44.337450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739908+0000","last_change":"2024-09-13T18:38:17.739846+0000","last_active":"2024-09-13T18:38:17.739908+0000","last_peered":"2024-09-13T18:38:17.739908+0000","last_clean":"2024-09-13T18:38:17.739908+0000","last_became_active":"2024-09-13T18:38:17.739256+0000","last_became_peered":"2024-09-13T18:38:17.739256+0000","last_unstale":"2024-09-13T18:38:17.739908+0000","last_undegraded":"2024-09-13T18:38:17.739908+0000","last_fullsized":"2024-09-13T18:38:17.739908+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729454+0000","last_change":"2024-09-13T18:38:17.740645+0000","last_active":"2024-09-13T18:38:18.729454+0000","last_peered":"2024-09-13T18:38:18.729454+0000","last_clean":"2024-09-13T18:38:18.729454+0000","last_became_active":"2024-09-13T18:38:17.739849+0000","last_became_peered":"2024-09-13T18:38:17.739849+0000","last_unstale":"2024-09-13T18:38:18.729454+0000","last_undegraded":"2024-09-13T18:38:18.729454+0000","last_fullsized":"2024-09-13T18:38:18.729454+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:03.177737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739051+0000","last_change":"2024-09-13T18:38:17.738717+0000","last_active":"2024-09-13T18:38:17.739051+0000","last_peered":"2024-09-13T18:38:17.739051+0000","last_clean":"2024-09-13T18:38:17.739051+0000","last_became_active":"2024-09-13T18:38:17.738518+0000","last_became_peered":"2024-09-13T18:38:17.738518+0000","last_unstale":"2024-09-13T18:38:17.739051+0000","last_undegraded":"2024-09-13T18:38:17.739051+0000","last_fullsized":"2024-09-13T18:38:17.739051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:38.910491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.750012+0000","last_change":"2024-09-13T18:38:17.749921+0000","last_active":"2024-09-13T18:38:17.750012+0000","last_peered":"2024-09-13T18:38:17.750012+0000","last_clean":"2024-09-13T18:38:17.750012+0000","last_became_active":"2024-09-13T18:38:17.749471+0000","last_became_peered":"2024-09-13T18:38:17.749471+0000","last_unstale":"2024-09-13T18:38:17.750012+0000","last_undegraded":"2024-09-13T18:38:17.750012+0000","last_fullsized":"2024-09-13T18:38:17.750012+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747498+0000","last_change":"2024-09-13T18:38:17.747400+0000","last_active":"2024-09-13T18:38:17.747498+0000","last_peered":"2024-09-13T18:38:17.747498+0000","last_clean":"2024-09-13T18:38:17.747498+0000","last_became_active":"2024-09-13T18:38:17.745545+0000","last_became_peered":"2024-09-13T18:38:17.745545+0000","last_unstale":"2024-09-13T18:38:17.747498+0000","last_undegraded":"2024-09-13T18:38:17.747498+0000","last_fullsized":"2024-09-13T18:38:17.747498+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:38.910491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729558+0000","last_change":"2024-09-13T18:38:17.729975+0000","last_active":"2024-09-13T18:38:18.729558+0000","last_peered":"2024-09-13T18:38:18.729558+0000","last_clean":"2024-09-13T18:38:18.729558+0000","last_became_active":"2024-09-13T18:38:17.729503+0000","last_became_peered":"2024-09-13T18:38:17.729503+0000","last_unstale":"2024-09-13T18:38:18.729558+0000","last_undegraded":"2024-09-13T18:38:18.729558+0000","last_fullsized":"2024-09-13T18:38:18.729558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:41:23.601319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.741183+0000","last_change":"2024-09-13T18:38:17.740938+0000","last_active":"2024-09-13T18:38:17.741183+0000","last_peered":"2024-09-13T18:38:17.741183+0000","last_clean":"2024-09-13T18:38:17.741183+0000","last_became_active":"2024-09-13T18:38:17.740589+0000","last_became_peered":"2024-09-13T18:38:17.740589+0000","last_unstale":"2024-09-13T18:38:17.741183+0000","last_undegraded":"2024-09-13T18:38:17.741183+0000","last_fullsized":"2024-09-13T18:38:17.741183+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:35:31.238536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724890+0000","last_change":"2024-09-13T18:38:17.736406+0000","last_active":"2024-09-13T18:38:18.724890+0000","last_peered":"2024-09-13T18:38:18.724890+0000","last_clean":"2024-09-13T18:38:18.724890+0000","last_became_active":"2024-09-13T18:38:17.736134+0000","last_became_peered":"2024-09-13T18:38:17.736134+0000","last_unstale":"2024-09-13T18:38:18.724890+0000","last_undegraded":"2024-09-13T18:38:18.724890+0000","last_fullsized":"2024-09-13T18:38:18.724890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740713+0000","last_change":"2024-09-13T18:38:17.740256+0000","last_active":"2024-09-13T18:38:17.740713+0000","last_peered":"2024-09-13T18:38:17.740713+0000","last_clean":"2024-09-13T18:38:17.740713+0000","last_became_active":"2024-09-13T18:38:17.737301+0000","last_became_peered":"2024-09-13T18:38:17.737301+0000","last_unstale":"2024-09-13T18:38:17.740713+0000","last_undegraded":"2024-09-13T18:38:17.740713+0000","last_fullsized":"2024-09-13T18:38:17.740713+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724794+0000","last_change":"2024-09-13T18:38:17.729679+0000","last_active":"2024-09-13T18:38:18.724794+0000","last_peered":"2024-09-13T18:38:18.724794+0000","last_clean":"2024-09-13T18:38:18.724794+0000","last_became_active":"2024-09-13T18:38:17.729031+0000","last_became_peered":"2024-09-13T18:38:17.729031+0000","last_unstale":"2024-09-13T18:38:18.724794+0000","last_undegraded":"2024-09-13T18:38:18.724794+0000","last_fullsized":"2024-09-13T18:38:18.724794+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729553+0000","last_change":"2024-09-13T18:38:17.743590+0000","last_active":"2024-09-13T18:38:18.729553+0000","last_peered":"2024-09-13T18:38:18.729553+0000","last_clean":"2024-09-13T18:38:18.729553+0000","last_became_active":"2024-09-13T18:38:17.741743+0000","last_became_peered":"2024-09-13T18:38:17.741743+0000","last_unstale":"2024-09-13T18:38:18.729553+0000","last_undegraded":"2024-09-13T18:38:18.729553+0000","last_fullsized":"2024-09-13T18:38:18.729553+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:31:26.479170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745079+0000","last_change":"2024-09-13T18:38:17.739180+0000","last_active":"2024-09-13T18:38:17.745079+0000","last_peered":"2024-09-13T18:38:17.745079+0000","last_clean":"2024-09-13T18:38:17.745079+0000","last_became_active":"2024-09-13T18:38:17.738207+0000","last_became_peered":"2024-09-13T18:38:17.738207+0000","last_unstale":"2024-09-13T18:38:17.745079+0000","last_undegraded":"2024-09-13T18:38:17.745079+0000","last_fullsized":"2024-09-13T18:38:17.745079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:11:14.857169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.738842+0000","last_change":"2024-09-13T18:38:17.738651+0000","last_active":"2024-09-13T18:38:17.738842+0000","last_peered":"2024-09-13T18:38:17.738842+0000","last_clean":"2024-09-13T18:38:17.738842+0000","last_became_active":"2024-09-13T18:38:17.737775+0000","last_became_peered":"2024-09-13T18:38:17.737775+0000","last_unstale":"2024-09-13T18:38:17.738842+0000","last_undegraded":"2024-09-13T18:38:17.738842+0000","last_fullsized":"2024-09-13T18:38:17.738842+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:34.994084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740729+0000","last_change":"2024-09-13T18:38:17.740391+0000","last_active":"2024-09-13T18:38:17.740729+0000","last_peered":"2024-09-13T18:38:17.740729+0000","last_clean":"2024-09-13T18:38:17.740729+0000","last_became_active":"2024-09-13T18:38:17.740041+0000","last_became_peered":"2024-09-13T18:38:17.740041+0000","last_unstale":"2024-09-13T18:38:17.740729+0000","last_undegraded":"2024-09-13T18:38:17.740729+0000","last_fullsized":"2024-09-13T18:38:17.740729+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.730831+0000","last_change":"2024-09-13T18:38:17.730683+0000","last_active":"2024-09-13T18:38:17.730831+0000","last_peered":"2024-09-13T18:38:17.730831+0000","last_clean":"2024-09-13T18:38:17.730831+0000","last_became_active":"2024-09-13T18:38:17.729757+0000","last_became_peered":"2024-09-13T18:38:17.729757+0000","last_unstale":"2024-09-13T18:38:17.730831+0000","last_undegraded":"2024-09-13T18:38:17.730831+0000","last_fullsized":"2024-09-13T18:38:17.730831+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:51.093088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237640+0000","last_change":"2024-09-13T18:38:17.742238+0000","last_active":"2024-09-13T18:38:19.237640+0000","last_peered":"2024-09-13T18:38:19.237640+0000","last_clean":"2024-09-13T18:38:19.237640+0000","last_became_active":"2024-09-13T18:38:17.741983+0000","last_became_peered":"2024-09-13T18:38:17.741983+0000","last_unstale":"2024-09-13T18:38:19.237640+0000","last_undegraded":"2024-09-13T18:38:19.237640+0000","last_fullsized":"2024-09-13T18:38:19.237640+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:04:20.226148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237439+0000","last_change":"2024-09-13T18:38:17.747702+0000","last_active":"2024-09-13T18:38:19.237439+0000","last_peered":"2024-09-13T18:38:19.237439+0000","last_clean":"2024-09-13T18:38:19.237439+0000","last_became_active":"2024-09-13T18:38:17.747454+0000","last_became_peered":"2024-09-13T18:38:17.747454+0000","last_unstale":"2024-09-13T18:38:19.237439+0000","last_undegraded":"2024-09-13T18:38:19.237439+0000","last_fullsized":"2024-09-13T18:38:19.237439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:16.770375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730117+0000","last_change":"2024-09-13T18:38:17.740761+0000","last_active":"2024-09-13T18:38:18.730117+0000","last_peered":"2024-09-13T18:38:18.730117+0000","last_clean":"2024-09-13T18:38:18.730117+0000","last_became_active":"2024-09-13T18:38:17.740535+0000","last_became_peered":"2024-09-13T18:38:17.740535+0000","last_unstale":"2024-09-13T18:38:18.730117+0000","last_undegraded":"2024-09-13T18:38:18.730117+0000","last_fullsized":"2024-09-13T18:38:18.730117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:00:12.947792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735227+0000","last_change":"2024-09-13T18:38:17.735058+0000","last_active":"2024-09-13T18:38:17.735227+0000","last_peered":"2024-09-13T18:38:17.735227+0000","last_clean":"2024-09-13T18:38:17.735227+0000","last_became_active":"2024-09-13T18:38:17.734833+0000","last_became_peered":"2024-09-13T18:38:17.734833+0000","last_unstale":"2024-09-13T18:38:17.735227+0000","last_undegraded":"2024-09-13T18:38:17.735227+0000","last_fullsized":"2024-09-13T18:38:17.735227+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:43.723738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724898+0000","last_change":"2024-09-13T18:38:17.729351+0000","last_active":"2024-09-13T18:38:18.724898+0000","last_peered":"2024-09-13T18:38:18.724898+0000","last_clean":"2024-09-13T18:38:18.724898+0000","last_became_active":"2024-09-13T18:38:17.728335+0000","last_became_peered":"2024-09-13T18:38:17.728335+0000","last_unstale":"2024-09-13T18:38:18.724898+0000","last_undegraded":"2024-09-13T18:38:18.724898+0000","last_fullsized":"2024-09-13T18:38:18.724898+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.748902+0000","last_change":"2024-09-13T18:38:17.748728+0000","last_active":"2024-09-13T18:38:17.748902+0000","last_peered":"2024-09-13T18:38:17.748902+0000","last_clean":"2024-09-13T18:38:17.748902+0000","last_became_active":"2024-09-13T18:38:17.747440+0000","last_became_peered":"2024-09-13T18:38:17.747440+0000","last_unstale":"2024-09-13T18:38:17.748902+0000","last_undegraded":"2024-09-13T18:38:17.748902+0000","last_fullsized":"2024-09-13T18:38:17.748902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:53.060074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1f","version":"70'4","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.724926+0000","last_change":"2024-09-13T18:38:17.323785+0000","last_active":"2024-09-13T18:38:18.724926+0000","last_peered":"2024-09-13T18:38:18.724926+0000","last_clean":"2024-09-13T18:38:18.724926+0000","last_became_active":"2024-09-13T18:38:17.323570+0000","last_became_peered":"2024-09-13T18:38:17.323570+0000","last_unstale":"2024-09-13T18:38:18.724926+0000","last_undegraded":"2024-09-13T18:38:18.724926+0000","last_fullsized":"2024-09-13T18:38:18.724926+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:28:02.417461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.746067+0000","last_change":"2024-09-13T18:38:17.745986+0000","last_active":"2024-09-13T18:38:17.746067+0000","last_peered":"2024-09-13T18:38:17.746067+0000","last_clean":"2024-09-13T18:38:17.746067+0000","last_became_active":"2024-09-13T18:38:17.745767+0000","last_became_peered":"2024-09-13T18:38:17.745767+0000","last_unstale":"2024-09-13T18:38:17.746067+0000","last_undegraded":"2024-09-13T18:38:17.746067+0000","last_fullsized":"2024-09-13T18:38:17.746067+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:10:37.293071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740757+0000","last_change":"2024-09-13T18:38:17.328199+0000","last_active":"2024-09-13T18:38:17.740757+0000","last_peered":"2024-09-13T18:38:17.740757+0000","last_clean":"2024-09-13T18:38:17.740757+0000","last_became_active":"2024-09-13T18:38:17.327510+0000","last_became_peered":"2024-09-13T18:38:17.327510+0000","last_unstale":"2024-09-13T18:38:17.740757+0000","last_undegraded":"2024-09-13T18:38:17.740757+0000","last_fullsized":"2024-09-13T18:38:17.740757+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:59:25.268097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237877+0000","last_change":"2024-09-13T18:38:17.746727+0000","last_active":"2024-09-13T18:38:19.237877+0000","last_peered":"2024-09-13T18:38:19.237877+0000","last_clean":"2024-09-13T18:38:19.237877+0000","last_became_active":"2024-09-13T18:38:17.746488+0000","last_became_peered":"2024-09-13T18:38:17.746488+0000","last_unstale":"2024-09-13T18:38:19.237877+0000","last_undegraded":"2024-09-13T18:38:19.237877+0000","last_fullsized":"2024-09-13T18:38:19.237877+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:16:10.475692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1d","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.741365+0000","last_change":"2024-09-13T18:38:17.328744+0000","last_active":"2024-09-13T18:38:17.741365+0000","last_peered":"2024-09-13T18:38:17.741365+0000","last_clean":"2024-09-13T18:38:17.741365+0000","last_became_active":"2024-09-13T18:38:17.328438+0000","last_became_peered":"2024-09-13T18:38:17.328438+0000","last_unstale":"2024-09-13T18:38:17.741365+0000","last_undegraded":"2024-09-13T18:38:17.741365+0000","last_fullsized":"2024-09-13T18:38:17.741365+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:44.353139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.744791+0000","last_change":"2024-09-13T18:38:17.738009+0000","last_active":"2024-09-13T18:38:17.744791+0000","last_peered":"2024-09-13T18:38:17.744791+0000","last_clean":"2024-09-13T18:38:17.744791+0000","last_became_active":"2024-09-13T18:38:17.737599+0000","last_became_peered":"2024-09-13T18:38:17.737599+0000","last_unstale":"2024-09-13T18:38:17.744791+0000","last_undegraded":"2024-09-13T18:38:17.744791+0000","last_fullsized":"2024-09-13T18:38:17.744791+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729601+0000","last_change":"2024-09-13T18:38:17.323841+0000","last_active":"2024-09-13T18:38:18.729601+0000","last_peered":"2024-09-13T18:38:18.729601+0000","last_clean":"2024-09-13T18:38:18.729601+0000","last_became_active":"2024-09-13T18:38:17.323331+0000","last_became_peered":"2024-09-13T18:38:17.323331+0000","last_unstale":"2024-09-13T18:38:18.729601+0000","last_undegraded":"2024-09-13T18:38:18.729601+0000","last_fullsized":"2024-09-13T18:38:18.729601+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:48.489708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237744+0000","last_change":"2024-09-13T18:38:17.740376+0000","last_active":"2024-09-13T18:38:19.237744+0000","last_peered":"2024-09-13T18:38:19.237744+0000","last_clean":"2024-09-13T18:38:19.237744+0000","last_became_active":"2024-09-13T18:38:17.740144+0000","last_became_peered":"2024-09-13T18:38:17.740144+0000","last_unstale":"2024-09-13T18:38:19.237744+0000","last_undegraded":"2024-09-13T18:38:19.237744+0000","last_fullsized":"2024-09-13T18:38:19.237744+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:34.108241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1b","version":"70'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729931+0000","last_change":"2024-09-13T18:38:17.323020+0000","last_active":"2024-09-13T18:38:18.729931+0000","last_peered":"2024-09-13T18:38:18.729931+0000","last_clean":"2024-09-13T18:38:18.729931+0000","last_became_active":"2024-09-13T18:38:17.322785+0000","last_became_peered":"2024-09-13T18:38:17.322785+0000","last_unstale":"2024-09-13T18:38:18.729931+0000","last_undegraded":"2024-09-13T18:38:18.729931+0000","last_fullsized":"2024-09-13T18:38:18.729931+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.427314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.725027+0000","last_change":"2024-09-13T18:38:17.729539+0000","last_active":"2024-09-13T18:38:18.725027+0000","last_peered":"2024-09-13T18:38:18.725027+0000","last_clean":"2024-09-13T18:38:18.725027+0000","last_became_active":"2024-09-13T18:38:17.728679+0000","last_became_peered":"2024-09-13T18:38:17.728679+0000","last_unstale":"2024-09-13T18:38:18.725027+0000","last_undegraded":"2024-09-13T18:38:18.725027+0000","last_fullsized":"2024-09-13T18:38:18.725027+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745052+0000","last_change":"2024-09-13T18:38:17.329388+0000","last_active":"2024-09-13T18:38:17.745052+0000","last_peered":"2024-09-13T18:38:17.745052+0000","last_clean":"2024-09-13T18:38:17.745052+0000","last_became_active":"2024-09-13T18:38:17.328755+0000","last_became_peered":"2024-09-13T18:38:17.328755+0000","last_unstale":"2024-09-13T18:38:17.745052+0000","last_undegraded":"2024-09-13T18:38:17.745052+0000","last_fullsized":"2024-09-13T18:38:17.745052+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:10:42.716636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729888+0000","last_change":"2024-09-13T18:38:17.738055+0000","last_active":"2024-09-13T18:38:18.729888+0000","last_peered":"2024-09-13T18:38:18.729888+0000","last_clean":"2024-09-13T18:38:18.729888+0000","last_became_active":"2024-09-13T18:38:17.737844+0000","last_became_peered":"2024-09-13T18:38:17.737844+0000","last_unstale":"2024-09-13T18:38:18.729888+0000","last_undegraded":"2024-09-13T18:38:18.729888+0000","last_fullsized":"2024-09-13T18:38:18.729888+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:26.386377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.731691+0000","last_change":"2024-09-13T18:38:17.327675+0000","last_active":"2024-09-13T18:38:17.731691+0000","last_peered":"2024-09-13T18:38:17.731691+0000","last_clean":"2024-09-13T18:38:17.731691+0000","last_became_active":"2024-09-13T18:38:17.327481+0000","last_became_peered":"2024-09-13T18:38:17.327481+0000","last_unstale":"2024-09-13T18:38:17.731691+0000","last_undegraded":"2024-09-13T18:38:17.731691+0000","last_fullsized":"2024-09-13T18:38:17.731691+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:32.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745016+0000","last_change":"2024-09-13T18:38:17.741601+0000","last_active":"2024-09-13T18:38:17.745016+0000","last_peered":"2024-09-13T18:38:17.745016+0000","last_clean":"2024-09-13T18:38:17.745016+0000","last_became_active":"2024-09-13T18:38:17.740629+0000","last_became_peered":"2024-09-13T18:38:17.740629+0000","last_unstale":"2024-09-13T18:38:17.745016+0000","last_undegraded":"2024-09-13T18:38:17.745016+0000","last_fullsized":"2024-09-13T18:38:17.745016+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:03.077050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732494+0000","last_change":"2024-09-13T18:38:17.329826+0000","last_active":"2024-09-13T18:38:17.732494+0000","last_peered":"2024-09-13T18:38:17.732494+0000","last_clean":"2024-09-13T18:38:17.732494+0000","last_became_active":"2024-09-13T18:38:17.329645+0000","last_became_peered":"2024-09-13T18:38:17.329645+0000","last_unstale":"2024-09-13T18:38:17.732494+0000","last_undegraded":"2024-09-13T18:38:17.732494+0000","last_fullsized":"2024-09-13T18:38:17.732494+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:14.739181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735259+0000","last_change":"2024-09-13T18:38:17.732615+0000","last_active":"2024-09-13T18:38:17.735259+0000","last_peered":"2024-09-13T18:38:17.735259+0000","last_clean":"2024-09-13T18:38:17.735259+0000","last_became_active":"2024-09-13T18:38:17.732477+0000","last_became_peered":"2024-09-13T18:38:17.732477+0000","last_unstale":"2024-09-13T18:38:17.735259+0000","last_undegraded":"2024-09-13T18:38:17.735259+0000","last_fullsized":"2024-09-13T18:38:17.735259+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:11.913054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732560+0000","last_change":"2024-09-13T18:38:17.328653+0000","last_active":"2024-09-13T18:38:17.732560+0000","last_peered":"2024-09-13T18:38:17.732560+0000","last_clean":"2024-09-13T18:38:17.732560+0000","last_became_active":"2024-09-13T18:38:17.328420+0000","last_became_peered":"2024-09-13T18:38:17.328420+0000","last_unstale":"2024-09-13T18:38:17.732560+0000","last_undegraded":"2024-09-13T18:38:17.732560+0000","last_fullsized":"2024-09-13T18:38:17.732560+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:55.875972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729846+0000","last_change":"2024-09-13T18:38:17.742849+0000","last_active":"2024-09-13T18:38:18.729846+0000","last_peered":"2024-09-13T18:38:18.729846+0000","last_clean":"2024-09-13T18:38:18.729846+0000","last_became_active":"2024-09-13T18:38:17.742199+0000","last_became_peered":"2024-09-13T18:38:17.742199+0000","last_unstale":"2024-09-13T18:38:18.729846+0000","last_undegraded":"2024-09-13T18:38:18.729846+0000","last_fullsized":"2024-09-13T18:38:18.729846+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:43.497580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237645+0000","last_change":"2024-09-13T18:38:17.324552+0000","last_active":"2024-09-13T18:38:19.237645+0000","last_peered":"2024-09-13T18:38:19.237645+0000","last_clean":"2024-09-13T18:38:19.237645+0000","last_became_active":"2024-09-13T18:38:17.324334+0000","last_became_peered":"2024-09-13T18:38:17.324334+0000","last_unstale":"2024-09-13T18:38:19.237645+0000","last_undegraded":"2024-09-13T18:38:19.237645+0000","last_fullsized":"2024-09-13T18:38:19.237645+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:11.038492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237532+0000","last_change":"2024-09-13T18:38:17.745837+0000","last_active":"2024-09-13T18:38:19.237532+0000","last_peered":"2024-09-13T18:38:19.237532+0000","last_clean":"2024-09-13T18:38:19.237532+0000","last_became_active":"2024-09-13T18:38:17.745612+0000","last_became_peered":"2024-09-13T18:38:17.745612+0000","last_unstale":"2024-09-13T18:38:19.237532+0000","last_undegraded":"2024-09-13T18:38:19.237532+0000","last_fullsized":"2024-09-13T18:38:19.237532+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:03.023759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.15","version":"70'3","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729787+0000","last_change":"2024-09-13T18:38:17.326506+0000","last_active":"2024-09-13T18:38:18.729787+0000","last_peered":"2024-09-13T18:38:18.729787+0000","last_clean":"2024-09-13T18:38:18.729787+0000","last_became_active":"2024-09-13T18:38:17.326276+0000","last_became_peered":"2024-09-13T18:38:17.326276+0000","last_unstale":"2024-09-13T18:38:18.729787+0000","last_undegraded":"2024-09-13T18:38:18.729787+0000","last_fullsized":"2024-09-13T18:38:18.729787+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:13.296936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729709+0000","last_change":"2024-09-13T18:38:17.743738+0000","last_active":"2024-09-13T18:38:18.729709+0000","last_peered":"2024-09-13T18:38:18.729709+0000","last_clean":"2024-09-13T18:38:18.729709+0000","last_became_active":"2024-09-13T18:38:17.742043+0000","last_became_peered":"2024-09-13T18:38:17.742043+0000","last_unstale":"2024-09-13T18:38:18.729709+0000","last_undegraded":"2024-09-13T18:38:18.729709+0000","last_fullsized":"2024-09-13T18:38:18.729709+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:56:09.150023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.14","version":"70'6","reported_seq":16,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745041+0000","last_change":"2024-09-13T18:38:17.327632+0000","last_active":"2024-09-13T18:38:17.745041+0000","last_peered":"2024-09-13T18:38:17.745041+0000","last_clean":"2024-09-13T18:38:17.745041+0000","last_became_active":"2024-09-13T18:38:17.327412+0000","last_became_peered":"2024-09-13T18:38:17.327412+0000","last_unstale":"2024-09-13T18:38:17.745041+0000","last_undegraded":"2024-09-13T18:38:17.745041+0000","last_fullsized":"2024-09-13T18:38:17.745041+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.097908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745120+0000","last_change":"2024-09-13T18:38:17.739388+0000","last_active":"2024-09-13T18:38:17.745120+0000","last_peered":"2024-09-13T18:38:17.745120+0000","last_clean":"2024-09-13T18:38:17.745120+0000","last_became_active":"2024-09-13T18:38:17.738799+0000","last_became_peered":"2024-09-13T18:38:17.738799+0000","last_unstale":"2024-09-13T18:38:17.745120+0000","last_undegraded":"2024-09-13T18:38:17.745120+0000","last_fullsized":"2024-09-13T18:38:17.745120+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:51.093088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237810+0000","last_change":"2024-09-13T18:38:17.326014+0000","last_active":"2024-09-13T18:38:19.237810+0000","last_peered":"2024-09-13T18:38:19.237810+0000","last_clean":"2024-09-13T18:38:19.237810+0000","last_became_active":"2024-09-13T18:38:17.321938+0000","last_became_peered":"2024-09-13T18:38:17.321938+0000","last_unstale":"2024-09-13T18:38:19.237810+0000","last_undegraded":"2024-09-13T18:38:19.237810+0000","last_fullsized":"2024-09-13T18:38:19.237810+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:27:10.905952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729979+0000","last_change":"2024-09-13T18:38:17.732887+0000","last_active":"2024-09-13T18:38:18.729979+0000","last_peered":"2024-09-13T18:38:18.729979+0000","last_clean":"2024-09-13T18:38:18.729979+0000","last_became_active":"2024-09-13T18:38:17.732675+0000","last_became_peered":"2024-09-13T18:38:17.732675+0000","last_unstale":"2024-09-13T18:38:18.729979+0000","last_undegraded":"2024-09-13T18:38:18.729979+0000","last_fullsized":"2024-09-13T18:38:18.729979+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729904+0000","last_change":"2024-09-13T18:38:17.324423+0000","last_active":"2024-09-13T18:38:18.729904+0000","last_peered":"2024-09-13T18:38:18.729904+0000","last_clean":"2024-09-13T18:38:18.729904+0000","last_became_active":"2024-09-13T18:38:17.323621+0000","last_became_peered":"2024-09-13T18:38:17.323621+0000","last_unstale":"2024-09-13T18:38:18.729904+0000","last_undegraded":"2024-09-13T18:38:18.729904+0000","last_fullsized":"2024-09-13T18:38:18.729904+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:15.763274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.733311+0000","last_change":"2024-09-13T18:38:17.733255+0000","last_active":"2024-09-13T18:38:17.733311+0000","last_peered":"2024-09-13T18:38:17.733311+0000","last_clean":"2024-09-13T18:38:17.733311+0000","last_became_active":"2024-09-13T18:38:17.733027+0000","last_became_peered":"2024-09-13T18:38:17.733027+0000","last_unstale":"2024-09-13T18:38:17.733311+0000","last_undegraded":"2024-09-13T18:38:17.733311+0000","last_fullsized":"2024-09-13T18:38:17.733311+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:45.709814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729616+0000","last_change":"2024-09-13T18:38:17.323472+0000","last_active":"2024-09-13T18:38:18.729616+0000","last_peered":"2024-09-13T18:38:18.729616+0000","last_clean":"2024-09-13T18:38:18.729616+0000","last_became_active":"2024-09-13T18:38:17.323020+0000","last_became_peered":"2024-09-13T18:38:17.323020+0000","last_unstale":"2024-09-13T18:38:18.729616+0000","last_undegraded":"2024-09-13T18:38:18.729616+0000","last_fullsized":"2024-09-13T18:38:18.729616+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:50:01.634334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729541+0000","last_change":"2024-09-13T18:38:17.738055+0000","last_active":"2024-09-13T18:38:18.729541+0000","last_peered":"2024-09-13T18:38:18.729541+0000","last_clean":"2024-09-13T18:38:18.729541+0000","last_became_active":"2024-09-13T18:38:17.737844+0000","last_became_peered":"2024-09-13T18:38:17.737844+0000","last_unstale":"2024-09-13T18:38:18.729541+0000","last_undegraded":"2024-09-13T18:38:18.729541+0000","last_fullsized":"2024-09-13T18:38:18.729541+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:54.283731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.10","version":"70'8","reported_seq":19,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729867+0000","last_change":"2024-09-13T18:38:17.325123+0000","last_active":"2024-09-13T18:38:18.729867+0000","last_peered":"2024-09-13T18:38:18.729867+0000","last_clean":"2024-09-13T18:38:18.729867+0000","last_became_active":"2024-09-13T18:38:17.323888+0000","last_became_peered":"2024-09-13T18:38:17.323888+0000","last_unstale":"2024-09-13T18:38:18.729867+0000","last_undegraded":"2024-09-13T18:38:18.729867+0000","last_fullsized":"2024-09-13T18:38:18.729867+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:34.260102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730055+0000","last_change":"2024-09-13T18:38:17.735920+0000","last_active":"2024-09-13T18:38:18.730055+0000","last_peered":"2024-09-13T18:38:18.730055+0000","last_clean":"2024-09-13T18:38:18.730055+0000","last_became_active":"2024-09-13T18:38:17.735715+0000","last_became_peered":"2024-09-13T18:38:17.735715+0000","last_unstale":"2024-09-13T18:38:18.730055+0000","last_undegraded":"2024-09-13T18:38:18.730055+0000","last_fullsized":"2024-09-13T18:38:18.730055+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.467270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.f","version":"70'1","reported_seq":11,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739929+0000","last_change":"2024-09-13T18:38:17.330525+0000","last_active":"2024-09-13T18:38:17.739929+0000","last_peered":"2024-09-13T18:38:17.739929+0000","last_clean":"2024-09-13T18:38:17.739929+0000","last_became_active":"2024-09-13T18:38:17.330227+0000","last_became_peered":"2024-09-13T18:38:17.330227+0000","last_unstale":"2024-09-13T18:38:17.739929+0000","last_undegraded":"2024-09-13T18:38:17.739929+0000","last_fullsized":"2024-09-13T18:38:17.739929+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:06.737081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729538+0000","last_change":"2024-09-13T18:38:17.740519+0000","last_active":"2024-09-13T18:38:18.729538+0000","last_peered":"2024-09-13T18:38:18.729538+0000","last_clean":"2024-09-13T18:38:18.729538+0000","last_became_active":"2024-09-13T18:38:17.739560+0000","last_became_peered":"2024-09-13T18:38:17.739560+0000","last_unstale":"2024-09-13T18:38:18.729538+0000","last_undegraded":"2024-09-13T18:38:18.729538+0000","last_fullsized":"2024-09-13T18:38:18.729538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:24:53.060074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237908+0000","last_change":"2024-09-13T18:38:17.322174+0000","last_active":"2024-09-13T18:38:19.237908+0000","last_peered":"2024-09-13T18:38:19.237908+0000","last_clean":"2024-09-13T18:38:19.237908+0000","last_became_active":"2024-09-13T18:38:17.321610+0000","last_became_peered":"2024-09-13T18:38:17.321610+0000","last_unstale":"2024-09-13T18:38:19.237908+0000","last_undegraded":"2024-09-13T18:38:19.237908+0000","last_fullsized":"2024-09-13T18:38:19.237908+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:02.170635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.743954+0000","last_change":"2024-09-13T18:38:17.742631+0000","last_active":"2024-09-13T18:38:17.743954+0000","last_peered":"2024-09-13T18:38:17.743954+0000","last_clean":"2024-09-13T18:38:17.743954+0000","last_became_active":"2024-09-13T18:38:17.742407+0000","last_became_peered":"2024-09-13T18:38:17.742407+0000","last_unstale":"2024-09-13T18:38:17.743954+0000","last_undegraded":"2024-09-13T18:38:17.743954+0000","last_fullsized":"2024-09-13T18:38:17.743954+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:45.709814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.d","version":"70'1","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729934+0000","last_change":"2024-09-13T18:38:17.327084+0000","last_active":"2024-09-13T18:38:18.729934+0000","last_peered":"2024-09-13T18:38:18.729934+0000","last_clean":"2024-09-13T18:38:18.729934+0000","last_became_active":"2024-09-13T18:38:17.326824+0000","last_became_peered":"2024-09-13T18:38:17.326824+0000","last_unstale":"2024-09-13T18:38:18.729934+0000","last_undegraded":"2024-09-13T18:38:18.729934+0000","last_fullsized":"2024-09-13T18:38:18.729934+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:23:44.702712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729507+0000","last_change":"2024-09-13T18:38:17.747383+0000","last_active":"2024-09-13T18:38:18.729507+0000","last_peered":"2024-09-13T18:38:18.729507+0000","last_clean":"2024-09-13T18:38:18.729507+0000","last_became_active":"2024-09-13T18:38:17.746699+0000","last_became_peered":"2024-09-13T18:38:17.746699+0000","last_unstale":"2024-09-13T18:38:18.729507+0000","last_undegraded":"2024-09-13T18:38:18.729507+0000","last_fullsized":"2024-09-13T18:38:18.729507+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:03.936077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237763+0000","last_change":"2024-09-13T18:38:17.330533+0000","last_active":"2024-09-13T18:38:19.237763+0000","last_peered":"2024-09-13T18:38:19.237763+0000","last_clean":"2024-09-13T18:38:19.237763+0000","last_became_active":"2024-09-13T18:38:17.330146+0000","last_became_peered":"2024-09-13T18:38:17.330146+0000","last_unstale":"2024-09-13T18:38:19.237763+0000","last_undegraded":"2024-09-13T18:38:19.237763+0000","last_fullsized":"2024-09-13T18:38:19.237763+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:47:25.379276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.745037+0000","last_change":"2024-09-13T18:38:17.738699+0000","last_active":"2024-09-13T18:38:17.745037+0000","last_peered":"2024-09-13T18:38:17.745037+0000","last_clean":"2024-09-13T18:38:17.745037+0000","last_became_active":"2024-09-13T18:38:17.737870+0000","last_became_peered":"2024-09-13T18:38:17.737870+0000","last_unstale":"2024-09-13T18:38:17.745037+0000","last_undegraded":"2024-09-13T18:38:17.745037+0000","last_fullsized":"2024-09-13T18:38:17.745037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:46.001194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.b","version":"70'2","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.725000+0000","last_change":"2024-09-13T18:38:17.331212+0000","last_active":"2024-09-13T18:38:18.725000+0000","last_peered":"2024-09-13T18:38:18.725000+0000","last_clean":"2024-09-13T18:38:18.725000+0000","last_became_active":"2024-09-13T18:38:17.330972+0000","last_became_peered":"2024-09-13T18:38:17.330972+0000","last_unstale":"2024-09-13T18:38:18.725000+0000","last_undegraded":"2024-09-13T18:38:18.725000+0000","last_fullsized":"2024-09-13T18:38:18.725000+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:44:37.097908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237984+0000","last_change":"2024-09-13T18:38:17.738825+0000","last_active":"2024-09-13T18:38:19.237984+0000","last_peered":"2024-09-13T18:38:19.237984+0000","last_clean":"2024-09-13T18:38:19.237984+0000","last_became_active":"2024-09-13T18:38:17.738585+0000","last_became_peered":"2024-09-13T18:38:17.738585+0000","last_unstale":"2024-09-13T18:38:19.237984+0000","last_undegraded":"2024-09-13T18:38:19.237984+0000","last_fullsized":"2024-09-13T18:38:19.237984+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:09:01.463366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237903+0000","last_change":"2024-09-13T18:38:17.329703+0000","last_active":"2024-09-13T18:38:19.237903+0000","last_peered":"2024-09-13T18:38:19.237903+0000","last_clean":"2024-09-13T18:38:19.237903+0000","last_became_active":"2024-09-13T18:38:17.323771+0000","last_became_peered":"2024-09-13T18:38:17.323771+0000","last_unstale":"2024-09-13T18:38:19.237903+0000","last_undegraded":"2024-09-13T18:38:19.237903+0000","last_fullsized":"2024-09-13T18:38:19.237903+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:28.460168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237658+0000","last_change":"2024-09-13T18:38:17.742003+0000","last_active":"2024-09-13T18:38:19.237658+0000","last_peered":"2024-09-13T18:38:19.237658+0000","last_clean":"2024-09-13T18:38:19.237658+0000","last_became_active":"2024-09-13T18:38:17.741748+0000","last_became_peered":"2024-09-13T18:38:17.741748+0000","last_unstale":"2024-09-13T18:38:19.237658+0000","last_undegraded":"2024-09-13T18:38:19.237658+0000","last_fullsized":"2024-09-13T18:38:19.237658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:40:38.550639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732642+0000","last_change":"2024-09-13T18:38:17.326457+0000","last_active":"2024-09-13T18:38:17.732642+0000","last_peered":"2024-09-13T18:38:17.732642+0000","last_clean":"2024-09-13T18:38:17.732642+0000","last_became_active":"2024-09-13T18:38:17.326248+0000","last_became_peered":"2024-09-13T18:38:17.326248+0000","last_unstale":"2024-09-13T18:38:17.732642+0000","last_undegraded":"2024-09-13T18:38:17.732642+0000","last_fullsized":"2024-09-13T18:38:17.732642+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:31.179318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729643+0000","last_change":"2024-09-13T18:38:17.730122+0000","last_active":"2024-09-13T18:38:18.729643+0000","last_peered":"2024-09-13T18:38:18.729643+0000","last_clean":"2024-09-13T18:38:18.729643+0000","last_became_active":"2024-09-13T18:38:17.729775+0000","last_became_peered":"2024-09-13T18:38:17.729775+0000","last_unstale":"2024-09-13T18:38:18.729643+0000","last_undegraded":"2024-09-13T18:38:18.729643+0000","last_fullsized":"2024-09-13T18:38:18.729643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:46.577337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"70'2","reported_seq":12,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.735648+0000","last_change":"2024-09-13T18:38:17.329269+0000","last_active":"2024-09-13T18:38:17.735648+0000","last_peered":"2024-09-13T18:38:17.735648+0000","last_clean":"2024-09-13T18:38:17.735648+0000","last_became_active":"2024-09-13T18:38:17.328455+0000","last_became_peered":"2024-09-13T18:38:17.328455+0000","last_unstale":"2024-09-13T18:38:17.735648+0000","last_undegraded":"2024-09-13T18:38:17.735648+0000","last_fullsized":"2024-09-13T18:38:17.735648+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:55.875972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.729845+0000","last_change":"2024-09-13T18:38:17.741494+0000","last_active":"2024-09-13T18:38:18.729845+0000","last_peered":"2024-09-13T18:38:18.729845+0000","last_clean":"2024-09-13T18:38:18.729845+0000","last_became_active":"2024-09-13T18:38:17.740093+0000","last_became_peered":"2024-09-13T18:38:17.740093+0000","last_unstale":"2024-09-13T18:38:18.729845+0000","last_undegraded":"2024-09-13T18:38:18.729845+0000","last_fullsized":"2024-09-13T18:38:18.729845+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:03.077050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740023+0000","last_change":"2024-09-13T18:38:17.329226+0000","last_active":"2024-09-13T18:38:17.740023+0000","last_peered":"2024-09-13T18:38:17.740023+0000","last_clean":"2024-09-13T18:38:17.740023+0000","last_became_active":"2024-09-13T18:38:17.328430+0000","last_became_peered":"2024-09-13T18:38:17.328430+0000","last_unstale":"2024-09-13T18:38:17.740023+0000","last_undegraded":"2024-09-13T18:38:17.740023+0000","last_fullsized":"2024-09-13T18:38:17.740023+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:36.427314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.739795+0000","last_change":"2024-09-13T18:38:17.739422+0000","last_active":"2024-09-13T18:38:17.739795+0000","last_peered":"2024-09-13T18:38:17.739795+0000","last_clean":"2024-09-13T18:38:17.739795+0000","last_became_active":"2024-09-13T18:38:17.739099+0000","last_became_peered":"2024-09-13T18:38:17.739099+0000","last_unstale":"2024-09-13T18:38:17.739795+0000","last_undegraded":"2024-09-13T18:38:17.739795+0000","last_fullsized":"2024-09-13T18:38:17.739795+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:37.434416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732140+0000","last_change":"2024-09-13T18:38:17.327252+0000","last_active":"2024-09-13T18:38:17.732140+0000","last_peered":"2024-09-13T18:38:17.732140+0000","last_clean":"2024-09-13T18:38:17.732140+0000","last_became_active":"2024-09-13T18:38:17.327026+0000","last_became_peered":"2024-09-13T18:38:17.327026+0000","last_unstale":"2024-09-13T18:38:17.732140+0000","last_undegraded":"2024-09-13T18:38:17.732140+0000","last_fullsized":"2024-09-13T18:38:17.732140+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:34:13.581890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237705+0000","last_change":"2024-09-13T18:38:17.744234+0000","last_active":"2024-09-13T18:38:19.237705+0000","last_peered":"2024-09-13T18:38:19.237705+0000","last_clean":"2024-09-13T18:38:19.237705+0000","last_became_active":"2024-09-13T18:38:17.743495+0000","last_became_peered":"2024-09-13T18:38:17.743495+0000","last_unstale":"2024-09-13T18:38:19.237705+0000","last_undegraded":"2024-09-13T18:38:19.237705+0000","last_fullsized":"2024-09-13T18:38:19.237705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:08.695423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730139+0000","last_change":"2024-09-13T18:38:17.324699+0000","last_active":"2024-09-13T18:38:18.730139+0000","last_peered":"2024-09-13T18:38:18.730139+0000","last_clean":"2024-09-13T18:38:18.730139+0000","last_became_active":"2024-09-13T18:38:17.324435+0000","last_became_peered":"2024-09-13T18:38:17.324435+0000","last_unstale":"2024-09-13T18:38:18.730139+0000","last_undegraded":"2024-09-13T18:38:18.730139+0000","last_fullsized":"2024-09-13T18:38:18.730139+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:50.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.747482+0000","last_change":"2024-09-13T18:38:17.746725+0000","last_active":"2024-09-13T18:38:17.747482+0000","last_peered":"2024-09-13T18:38:17.747482+0000","last_clean":"2024-09-13T18:38:17.747482+0000","last_became_active":"2024-09-13T18:38:17.745168+0000","last_became_peered":"2024-09-13T18:38:17.745168+0000","last_unstale":"2024-09-13T18:38:17.747482+0000","last_undegraded":"2024-09-13T18:38:17.747482+0000","last_fullsized":"2024-09-13T18:38:17.747482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:00:30.014666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.725553+0000","last_change":"2024-09-13T18:38:17.331434+0000","last_active":"2024-09-13T18:38:17.725553+0000","last_peered":"2024-09-13T18:38:17.725553+0000","last_clean":"2024-09-13T18:38:17.725553+0000","last_became_active":"2024-09-13T18:38:17.329781+0000","last_became_peered":"2024-09-13T18:38:17.329781+0000","last_unstale":"2024-09-13T18:38:17.725553+0000","last_undegraded":"2024-09-13T18:38:17.725553+0000","last_fullsized":"2024-09-13T18:38:17.725553+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:36:32.799287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.742618+0000","last_change":"2024-09-13T18:38:17.741426+0000","last_active":"2024-09-13T18:38:17.742618+0000","last_peered":"2024-09-13T18:38:17.742618+0000","last_clean":"2024-09-13T18:38:17.742618+0000","last_became_active":"2024-09-13T18:38:17.741235+0000","last_became_peered":"2024-09-13T18:38:17.741235+0000","last_unstale":"2024-09-13T18:38:17.742618+0000","last_undegraded":"2024-09-13T18:38:17.742618+0000","last_fullsized":"2024-09-13T18:38:17.742618+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:12.045594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:18.730012+0000","last_change":"2024-09-13T18:38:17.319728+0000","last_active":"2024-09-13T18:38:18.730012+0000","last_peered":"2024-09-13T18:38:18.730012+0000","last_clean":"2024-09-13T18:38:18.730012+0000","last_became_active":"2024-09-13T18:38:17.319520+0000","last_became_peered":"2024-09-13T18:38:17.319520+0000","last_unstale":"2024-09-13T18:38:18.730012+0000","last_undegraded":"2024-09-13T18:38:18.730012+0000","last_fullsized":"2024-09-13T18:38:18.730012+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:43.330348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237834+0000","last_change":"2024-09-13T18:38:17.744385+0000","last_active":"2024-09-13T18:38:19.237834+0000","last_peered":"2024-09-13T18:38:19.237834+0000","last_clean":"2024-09-13T18:38:19.237834+0000","last_became_active":"2024-09-13T18:38:17.743964+0000","last_became_peered":"2024-09-13T18:38:17.743964+0000","last_unstale":"2024-09-13T18:38:19.237834+0000","last_undegraded":"2024-09-13T18:38:19.237834+0000","last_fullsized":"2024-09-13T18:38:19.237834+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:56.878631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.740590+0000","last_change":"2024-09-13T18:38:17.325081+0000","last_active":"2024-09-13T18:38:17.740590+0000","last_peered":"2024-09-13T18:38:17.740590+0000","last_clean":"2024-09-13T18:38:17.740590+0000","last_became_active":"2024-09-13T18:38:17.324807+0000","last_became_peered":"2024-09-13T18:38:17.324807+0000","last_unstale":"2024-09-13T18:38:17.740590+0000","last_undegraded":"2024-09-13T18:38:17.740590+0000","last_fullsized":"2024-09-13T18:38:17.740590+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:03:50.085987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.727889+0000","last_change":"2024-09-13T18:38:17.727109+0000","last_active":"2024-09-13T18:38:17.727889+0000","last_peered":"2024-09-13T18:38:17.727889+0000","last_clean":"2024-09-13T18:38:17.727889+0000","last_became_active":"2024-09-13T18:38:17.726818+0000","last_became_peered":"2024-09-13T18:38:17.726818+0000","last_unstale":"2024-09-13T18:38:17.727889+0000","last_undegraded":"2024-09-13T18:38:17.727889+0000","last_fullsized":"2024-09-13T18:38:17.727889+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:03:45.360240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237964+0000","last_change":"2024-09-13T18:38:17.329525+0000","last_active":"2024-09-13T18:38:19.237964+0000","last_peered":"2024-09-13T18:38:19.237964+0000","last_clean":"2024-09-13T18:38:19.237964+0000","last_became_active":"2024-09-13T18:38:17.323469+0000","last_became_peered":"2024-09-13T18:38:17.323469+0000","last_unstale":"2024-09-13T18:38:19.237964+0000","last_undegraded":"2024-09-13T18:38:19.237964+0000","last_fullsized":"2024-09-13T18:38:19.237964+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:21:42.490478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-09-13T18:38:19.237950+0000","last_change":"2024-09-13T18:38:17.744291+0000","last_active":"2024-09-13T18:38:19.237950+0000","last_peered":"2024-09-13T18:38:19.237950+0000","last_clean":"2024-09-13T18:38:19.237950+0000","last_became_active":"2024-09-13T18:38:17.743665+0000","last_became_peered":"2024-09-13T18:38:17.743665+0000","last_unstale":"2024-09-13T18:38:19.237950+0000","last_undegraded":"2024-09-13T18:38:19.237950+0000","last_fullsized":"2024-09-13T18:38:19.237950+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:17.306656+0000","last_clean_scrub_stamp":"2024-09-13T18:38:17.306656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:25:49.496809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.732587+0000","last_change":"2024-09-13T18:38:17.325564+0000","last_active":"2024-09-13T18:38:17.732587+0000","last_peered":"2024-09-13T18:38:17.732587+0000","last_clean":"2024-09-13T18:38:17.732587+0000","last_became_active":"2024-09-13T18:38:17.325352+0000","last_became_peered":"2024-09-13T18:38:17.325352+0000","last_unstale":"2024-09-13T18:38:17.732587+0000","last_undegraded":"2024-09-13T18:38:17.732587+0000","last_fullsized":"2024-09-13T18:38:17.732587+0000","mapping_epoch":68,"log_start":"0'0","ondisk_log_start":"0'0","created":68,"last_epoch_clean":69,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:38:16.299554+0000","last_clean_scrub_stamp":"2024-09-13T18:38:16.299554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:07:33.986982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":210,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-13T18:38:17.321000+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:38:17.321000+0000","last_peered":"2024-09-13T18:38:17.321000+0000","last_clean":"2024-09-13T18:38:17.321000+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:38:17.321000+0000","last_undegraded":"2024-09-13T18:38:17.321000+0000","last_fullsized":"2024-09-13T18:38:17.321000+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194382,"statfs":{"total":200000000,"available":199047460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.46899999999999997,"5min":0.313,"15min":0.313},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.626,"15min":0.61399999999999999},"min":{"1min":0.48799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.65700000000000003,"15min":0.65400000000000003},"min":{"1min":0.46000000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.44500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.65400000000000003,"15min":0.64700000000000002},"min":{"1min":0.51600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.879,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64000000000000001,"15min":0.63900000000000001},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.86299999999999999,"15min":0.88800000000000001},"min":{"1min":0.52400000000000002,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0880000000000001,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.86599999999999999,"15min":0.90000000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0189999999999999,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.33400000000000002,"5min":0.313,"15min":0.313},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.61399999999999999,"15min":0.61599999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64200000000000002,"15min":0.63500000000000001},"min":{"1min":0.48099999999999998,"5min":0.441,"15min":0.441},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72199999999999998,"15min":0.72599999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.101,"5min":1.371,"15min":1.371},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.66700000000000004,"15min":0.66100000000000003},"min":{"1min":0.53000000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.84599999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574884,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637770,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.621,"15min":0.61699999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.62,"15min":0.61699999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.63300000000000001,"15min":0.622},"min":{"1min":0.49399999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.48399999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.88900000000000001,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.92500000000000004,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.76400000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94699999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.84799999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60299999999999998,"15min":0.59899999999999998},"min":{"1min":0.45000000000000001,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.46300000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.91600000000000004,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.54400000000000004,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.65700000000000003,"15min":0.65200000000000002},"min":{"1min":0.497,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.59299999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:37:33 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70999999999999996,"15min":0.70299999999999996},"min":{"1min":0.56699999999999995,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.73699999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.55500000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574884,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.84699999999999998,"15min":0.873},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0369999999999999,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.63600000000000001,"15min":0.626},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.90000000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.77500000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.86799999999999999,"15min":0.90100000000000002},"min":{"1min":0.47599999999999998,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.88300000000000001,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.85499999999999998,"15min":0.88200000000000001},"min":{"1min":0.55100000000000005,"5min":0.438,"15min":0.438},"max":{"1min":0.85999999999999999,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.48499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.64200000000000002,"15min":0.63400000000000001},"min":{"1min":0.505,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.746},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.91100000000000003,"15min":0.94599999999999995},"min":{"1min":0.51700000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.91400000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.84199999999999997,"15min":0.86099999999999999},"min":{"1min":0.52700000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91100000000000003,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.50700000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.89900000000000002,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.69099999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.628,"15min":0.61799999999999999},"min":{"1min":0.47199999999999998,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68799999999999994,"15min":0.68400000000000005},"min":{"1min":0.44600000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88300000000000001,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.621}]},{"osd":5,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.60099999999999998,"15min":0.59099999999999997},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.62,"15min":0.60999999999999999},"min":{"1min":0.48699999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58299999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.68500000000000005,"15min":0.67600000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.68899999999999995,"15min":0.67700000000000005},"min":{"1min":0.59899999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.76000000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":354,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637246,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.40500000000000003,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":2.0579999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.63,"15min":0.626},"min":{"1min":0.54100000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":2.3399999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.66600000000000004,"15min":0.66100000000000003},"min":{"1min":0.51900000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.66800000000000004,"15min":0.66900000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.88600000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.876}]},{"osd":2,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":0.86599999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65700000000000003,"15min":0.65600000000000003},"min":{"1min":0.50600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"last":3.742}]},{"osd":3,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.68600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86399999999999999,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":3.6909999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65900000000000003,"15min":0.65000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":1.175}]},{"osd":5,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.35799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":1.9970000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.876,"5min":0.876,"15min":0.876},"last":0.60699999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88600000000000001,"5min":1.4870000000000001,"15min":1.4870000000000001},"last":4.952},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67600000000000005,"15min":0.67400000000000004},"min":{"1min":0.45800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":3.7989999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59199999999999997,"15min":0.58399999999999996},"min":{"1min":0.41899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":5.5069999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.68200000000000005,"15min":0.67400000000000004},"min":{"1min":0.56999999999999995,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":1.3720000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574884,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":353,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194958,"statfs":{"total":200000000,"available":199637772,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45200000000000001,"15min":0.45700000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54600000000000004,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.442,"15min":0.443},"min":{"1min":0.26100000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66000000000000003,"5min":0.752,"15min":0.752},"last":0.45700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.80100000000000005,"15min":0.85899999999999999},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.61399999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.57999999999999996,"15min":0.60699999999999998},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.63600000000000001,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.47999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.621,"15min":0.64300000000000002},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68300000000000005,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68799999999999994,"5min":7.798,"15min":7.798},"last":0.56999999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.80000000000000004,"15min":0.80900000000000005},"min":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.036,"5min":3.093,"15min":3.093},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.0189999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91800000000000004,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.70899999999999996,"15min":0.70399999999999996},"min":{"1min":0.58699999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.879}]},{"osd":6,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.0149999999999999,"15min":1.0569999999999999},"min":{"1min":0.59299999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1240000000000001,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.94399999999999995,"15min":0.98099999999999998},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.94399999999999995,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.748}]},{"osd":7,"last update":"Fri Sep 13 18:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69299999999999995,"15min":0.68600000000000005},"min":{"1min":0.59999999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.85099999999999998,"15min":0.86399999999999999},"min":{"1min":0.626,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0840000000000001,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.78400000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636138,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.27600000000000002,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.52900000000000003,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.27700000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.55700000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.34799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.47199999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.56899999999999995,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.47899999999999998,"15min":0.49299999999999999},"min":{"1min":0.33400000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.46800000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.503}]},{"osd":3,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.50700000000000001,"15min":0.51500000000000001},"min":{"1min":0.35999999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.59699999999999998,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57299999999999995,"15min":0.57999999999999996},"min":{"1min":0.435,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.81299999999999994,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.69999999999999996,"15min":0.70599999999999996},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.99199999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68600000000000005,"15min":0.68999999999999995},"min":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.91100000000000003,"5min":1.02,"15min":1.02},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.74199999999999999,"15min":0.749},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.86699999999999999,"5min":1.052,"15min":1.052},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.878,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.70899999999999996,"15min":0.71299999999999997},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.875,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.67900000000000005,"15min":0.68400000000000005},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.84299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.76800000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:37:31 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.72399999999999998,"15min":0.72799999999999998},"min":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.93300000000000005,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":0.89700000000000002,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.80600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":930,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194381,"statfs":{"total":200000000,"available":199046912,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42599999999999999,"15min":0.42999999999999999},"min":{"1min":0.28100000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.56100000000000005,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.307},{"interface":"front","average":{"1min":0.433,"5min":0.46800000000000003,"15min":0.47399999999999998},"min":{"1min":0.311,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.59799999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.38900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.44800000000000001,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.56699999999999995,"5min":0.747,"15min":0.747},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46200000000000002,"15min":0.46000000000000002},"min":{"1min":0.32300000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.60499999999999998,"5min":0.63,"15min":0.63},"last":0.41099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.5,"15min":0.496},"min":{"1min":0.40200000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.49399999999999999,"15min":0.5},"min":{"1min":0.375,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.59499999999999997,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.437}]},{"osd":4,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.749,"15min":0.747},"min":{"1min":0.64000000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.753,"15min":0.755},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.88}]},{"osd":5,"last update":"Fri Sep 13 18:37:35 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.71999999999999997,"15min":0.71899999999999997},"min":{"1min":0.58799999999999997,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.90500000000000003,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.70399999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.85199999999999998,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.85399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77000000000000002,"15min":0.77200000000000002},"min":{"1min":0.59099999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.079,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.76100000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.73999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:37:30 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73699999999999999,"15min":0.74099999999999999},"min":{"1min":0.51300000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0429999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.76000000000000001,"15min":0.76400000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83999999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":355,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194957,"statfs":{"total":200000000,"available":199636298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.45900000000000002,"15min":0.46899999999999997},"min":{"1min":0.27600000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54000000000000004,"5min":1.669,"15min":1.669},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.439,"15min":0.44400000000000001},"min":{"1min":0.27800000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.54100000000000004,"5min":0.874,"15min":0.874},"last":0.45100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.501,"15min":0.51200000000000001},"min":{"1min":0.33100000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.58499999999999996,"5min":1.591,"15min":1.591},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.46200000000000002,"15min":0.46600000000000003},"min":{"1min":0.34599999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.499,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.32000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.318,"5min":0.251,"15min":0.251},"max":{"1min":0.503,"5min":1.03,"15min":1.03},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35799999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.67800000000000005,"5min":1.637,"15min":1.637},"last":0.41899999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.68799999999999994,"15min":0.68700000000000006},"min":{"1min":0.495,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":1.1559999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.69299999999999995,"15min":0.69799999999999995},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85699999999999998,"5min":1.698,"15min":1.698},"last":1.0009999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:37:34 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72099999999999997,"15min":0.71899999999999997},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.95499999999999996,"5min":1.028,"15min":1.028},"last":1.204},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.96699999999999997,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.96999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.748,"15min":0.75600000000000001},"min":{"1min":0.60299999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.95699999999999996,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":1.1100000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68799999999999994,"15min":0.68899999999999995},"min":{"1min":0.54400000000000004,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.81899999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0580000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:37:28 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.75600000000000001,"15min":0.76500000000000001},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93200000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.55100000000000005,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.83399999999999996,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":1.1830000000000001}]}]}],"pool_statfs":[]}} 2024-09-13T18:38:22.285 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:38:22.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:38:22.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.477+0000 7fbb72e00640 1 Processor -- start 2024-09-13T18:38:22.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.477+0000 7fbb72e00640 1 -- start start 2024-09-13T18:38:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb72e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb72e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbb6c0b3bd0 0x7fbb6c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb72e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb6c06cc40 con 0x7fbb6c1434c0 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb72e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb6c0b4060 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb72e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c0ce770 con 0x7fbb6c06c800 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb6be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbb6c1434c0 0x7fbb6c06a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48142/0 (socket says 172.21.15.192:48142) 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb6be00640 1 -- 172.21.15.192:0/1671273318 learned_addr learned my addr 172.21.15.192:0/1671273318 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb70e00640 1 --2- 172.21.15.192:0/1671273318 >> v2:172.21.15.192:3300/0 conn(0x7fbb6c0b3bd0 0x7fbb6c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb63400640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb6b400640 1 -- 172.21.15.192:0/1671273318 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 164379753 0 0) 0x7fbb6c06cc40 con 0x7fbb6c1434c0 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb6b400640 1 -- 172.21.15.192:0/1671273318 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb50003520 con 0x7fbb6c1434c0 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb70e00640 1 -- 172.21.15.192:0/1671273318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 msgr2=0x7fbb6c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb70e00640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb70e00640 1 -- 172.21.15.192:0/1671273318 >> v1:172.21.15.192:6789/0 conn(0x7fbb6c1434c0 legacy=0x7fbb6c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.479+0000 7fbb70e00640 1 -- 172.21.15.192:0/1671273318 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c06b480 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.480+0000 7fbb70e00640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c06e920 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009dc0 tx=0x7fbb6402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adb2100853afbb51 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb6b400640 1 -- 172.21.15.192:0/1671273318 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64007740 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb6b400640 1 -- 172.21.15.192:0/1671273318 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb6402d050 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb6b400640 1 -- 172.21.15.192:0/1671273318 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb64007ac0 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 -- 172.21.15.192:0/1671273318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 msgr2=0x7fbb6c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c06e920 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009dc0 tx=0x7fbb6402a680 comp rx=0 tx=0).stop 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 -- 172.21.15.192:0/1671273318 shutdown_connections 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c06e920 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 --2- 172.21.15.192:0/1671273318 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 -- 172.21.15.192:0/1671273318 >> 172.21.15.192:0/1671273318 conn(0x7fbb6c0b08f0 msgr2=0x7fbb6c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 -- 172.21.15.192:0/1671273318 shutdown_connections 2024-09-13T18:38:22.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.481+0000 7fbb72e00640 1 -- 172.21.15.192:0/1671273318 wait complete. 2024-09-13T18:38:22.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.483+0000 7fbb72e00640 1 Processor -- start 2024-09-13T18:38:22.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.483+0000 7fbb72e00640 1 -- start start 2024-09-13T18:38:22.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb6c1434c0 0x7fbb6c1507b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c152f70 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c1594b0 con 0x7fbb6c1434c0 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb72e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c13b7a0 con 0x7fbb6c06c800 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb63400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb63400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34766/0 (socket says 172.21.15.192:34766) 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb63400640 1 -- 172.21.15.192:0/2984401607 learned_addr learned my addr 172.21.15.192:0/2984401607 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb6be00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.484+0000 7fbb70e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb6c1434c0 0x7fbb6c1507b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 -- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 msgr2=0x7fbb6c158f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c158f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 -- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb6c1434c0 msgr2=0x7fbb6c1507b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb6c1434c0 0x7fbb6c1507b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 -- 172.21.15.192:0/2984401607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb64009a70 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb63400640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d830 tx=0x7fbb5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400b6c0 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb5400b820 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb5400bbb0 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb6c13ae70 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.485+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb6c13b430 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.486+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6c06c2e0 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.487+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbb5401e460 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.488+0000 7fbb68c00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 0x7fbb4806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.488+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb54089a40 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.488+0000 7fbb6be00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 0x7fbb4806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.489+0000 7fbb6be00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 0x7fbb4806d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0011e0 tx=0x7fbb5c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.492+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb54054c30 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.723+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fbb6c13b8e0 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.727+0000 7fbb68c00640 1 -- 172.21.15.192:0/2984401607 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fbb54058250 con 0x7fbb6c0b3bd0 2024-09-13T18:38:22.730 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 msgr2=0x7fbb4806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 0x7fbb4806d0c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c0011e0 tx=0x7fbb5c007d30 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 msgr2=0x7fbb6c150270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400d830 tx=0x7fbb5400dcf0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 shutdown_connections 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbb4806ac00 0x7fbb4806d0c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb6c1434c0 0x7fbb6c1507b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb6c0b3bd0 0x7fbb6c150270 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 --2- 172.21.15.192:0/2984401607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb6c06c800 0x7fbb6c158f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 >> 172.21.15.192:0/2984401607 conn(0x7fbb6c0b08f0 msgr2=0x7fbb6c0af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 shutdown_connections 2024-09-13T18:38:22.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.730+0000 7fbb72e00640 1 -- 172.21.15.192:0/2984401607 wait complete. 2024-09-13T18:38:22.748 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:22.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.899+0000 7faf7fe00640 1 Processor -- start 2024-09-13T18:38:22.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.899+0000 7faf7fe00640 1 -- start start 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf800b3480 0x7faf80159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7faf8006bc30 0x7faf8015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7fe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8015af60 con 0x7faf80159b00 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf8006b7a0 con 0x7faf8006bc30 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8015ac80 con 0x7faf800b3480 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7faf80159b00 0x7faf800b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48158/0 (socket says 172.21.15.192:48158) 2024-09-13T18:38:22.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7ea00640 1 -- 172.21.15.192:0/996121239 learned_addr learned my addr 172.21.15.192:0/996121239 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:22.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.900+0000 7faf7f400640 1 --2- 172.21.15.192:0/996121239 >> v2:172.21.15.192:3300/0 conn(0x7faf8006bc30 0x7faf8015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf77e00640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf800b3480 0x7faf80159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7e000640 1 -- 172.21.15.192:0/996121239 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163715867 0 0) 0x7faf8015af60 con 0x7faf80159b00 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7e000640 1 -- 172.21.15.192:0/996121239 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf64003520 con 0x7faf80159b00 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7f400640 1 -- 172.21.15.192:0/996121239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf800b3480 msgr2=0x7faf80159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7f400640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf800b3480 0x7faf80159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7f400640 1 -- 172.21.15.192:0/996121239 >> v1:172.21.15.192:6789/0 conn(0x7faf80159b00 legacy=0x7faf800b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.901+0000 7faf7f400640 1 -- 172.21.15.192:0/996121239 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8006b150 con 0x7faf8006bc30 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.902+0000 7faf7f400640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8006bc30 0x7faf8015a420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf78009d90 tx=0x7faf7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b233daac0c238a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.902+0000 7faf7e000640 1 -- 172.21.15.192:0/996121239 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78007740 con 0x7faf8006bc30 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.902+0000 7faf7e000640 1 -- 172.21.15.192:0/996121239 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7802d050 con 0x7faf8006bc30 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.902+0000 7faf7e000640 1 -- 172.21.15.192:0/996121239 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78007aa0 con 0x7faf8006bc30 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 -- 172.21.15.192:0/996121239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8006bc30 msgr2=0x7faf8015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8006bc30 0x7faf8015a420 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7faf78009d90 tx=0x7faf7802a660 comp rx=0 tx=0).stop 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 -- 172.21.15.192:0/996121239 shutdown_connections 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf8006bc30 0x7faf8015a420 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 --2- 172.21.15.192:0/996121239 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf800b3480 0x7faf80159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 -- 172.21.15.192:0/996121239 >> 172.21.15.192:0/996121239 conn(0x7faf800736d0 msgr2=0x7faf800b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 -- 172.21.15.192:0/996121239 shutdown_connections 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.903+0000 7faf7fe00640 1 -- 172.21.15.192:0/996121239 wait complete. 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.904+0000 7faf7fe00640 1 Processor -- start 2024-09-13T18:38:22.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.904+0000 7faf7fe00640 1 -- start start 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf8006bc30 0x7faf801f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf80159b00 0x7faf8006a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf800affd0 con 0x7faf800b3480 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf800af3c0 con 0x7faf80159b00 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.905+0000 7faf7fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf800af6a0 con 0x7faf8006bc30 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34770/0 (socket says 172.21.15.192:34770) 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 -- 172.21.15.192:0/1015963205 learned_addr learned my addr 172.21.15.192:0/1015963205 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf7ea00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf8006bc30 0x7faf801f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf7f400640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf80159b00 0x7faf8006a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 -- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf8006bc30 msgr2=0x7faf801f5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf8006bc30 0x7faf801f5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 -- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf80159b00 msgr2=0x7faf8006a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf80159b00 0x7faf8006a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 -- 172.21.15.192:0/1015963205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf78009a70 con 0x7faf800b3480 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.906+0000 7faf77e00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d800 tx=0x7faf6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.907+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800b6c0 con 0x7faf800b3480 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.907+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6800b820 con 0x7faf800b3480 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.907+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6800bbd0 con 0x7faf800b3480 2024-09-13T18:38:22.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.907+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf800af980 con 0x7faf800b3480 2024-09-13T18:38:22.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.907+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf801f5dd0 con 0x7faf800b3480 2024-09-13T18:38:22.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.908+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf800b0180 con 0x7faf800b3480 2024-09-13T18:38:22.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.909+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faf6800bd30 con 0x7faf800b3480 2024-09-13T18:38:22.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.910+0000 7faf76a00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:22.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.910+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf68089700 con 0x7faf800b3480 2024-09-13T18:38:22.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.910+0000 7faf7ea00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:22.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.910+0000 7faf7ea00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 0x7faf5c06d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faf70005880 tx=0x7faf70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:22.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:22.914+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faf800b0180 con 0x7faf800b3480 2024-09-13T18:38:23.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.120+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf800b2d70 con 0x7faf800b3480 2024-09-13T18:38:23.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.120+0000 7faf76a00640 1 -- 172.21.15.192:0/1015963205 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7faf68054990 con 0x7faf800b3480 2024-09-13T18:38:23.125 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:23.125 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:38:23.126 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 msgr2=0x7faf5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 0x7faf5c06d0c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faf70005880 tx=0x7faf70009040 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 msgr2=0x7faf8006a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7faf6800d800 tx=0x7faf6800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 shutdown_connections 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faf5c06ac00 0x7faf5c06d0c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faf80159b00 0x7faf8006a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf800b3480 0x7faf8006a220 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 --2- 172.21.15.192:0/1015963205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faf8006bc30 0x7faf801f5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.122+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 >> 172.21.15.192:0/1015963205 conn(0x7faf800736d0 msgr2=0x7faf80158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.123+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 shutdown_connections 2024-09-13T18:38:23.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.123+0000 7faf7fe00640 1 -- 172.21.15.192:0/1015963205 wait complete. 2024-09-13T18:38:23.301 INFO:tasks.ceph.mds.c.smithi192.stderr:2024-09-13T18:38:23.298+0000 7ff457e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:38:23.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:38:17.717892+0000', 'modified': '2024-09-13T18:38:20.741559+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6033}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6033': {'gid': 6033, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6836/2146307069', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6834', 'nonce': 2146307069}, {'type': 'v1', 'addr': '172.21.15.192:6836', 'nonce': 2146307069}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:38:23.544 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:38:23.545 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:38:23.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.697+0000 7ff18fc00640 1 Processor -- start 2024-09-13T18:38:23.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.697+0000 7ff18fc00640 1 -- start start 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.698+0000 7ff18fc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff188150480 0x7ff18815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.698+0000 7ff18fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff188071810 0x7ff1880b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.698+0000 7ff18fc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff188071dd0 con 0x7ff1880b2230 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.698+0000 7ff18fc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1880cb770 con 0x7ff188150480 2024-09-13T18:38:23.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.698+0000 7ff18fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1880cba50 con 0x7ff188071810 2024-09-13T18:38:23.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18dc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff1880b2230 0x7ff1880cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48166/0 (socket says 172.21.15.192:48166) 2024-09-13T18:38:23.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18dc00640 1 -- 172.21.15.192:0/1987646690 learned_addr learned my addr 172.21.15.192:0/1987646690 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:23.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18d200640 1 --2- 172.21.15.192:0/1987646690 >> v2:172.21.15.194:3300/0 conn(0x7ff188150480 0x7ff18815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff187e00640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff188071810 0x7ff1880b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff187400640 1 -- 172.21.15.192:0/1987646690 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389511789 0 0) 0x7ff188071dd0 con 0x7ff1880b2230 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff187400640 1 -- 172.21.15.192:0/1987646690 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff170003440 con 0x7ff1880b2230 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18d200640 1 -- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff188071810 msgr2=0x7ff1880b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18d200640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff188071810 0x7ff1880b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18d200640 1 -- 172.21.15.192:0/1987646690 >> v1:172.21.15.192:6789/0 conn(0x7ff1880b2230 legacy=0x7ff1880cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.699+0000 7ff18d200640 1 -- 172.21.15.192:0/1987646690 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1880cbd30 con 0x7ff188150480 2024-09-13T18:38:23.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.700+0000 7ff18d200640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188150480 0x7ff18815a3e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=260a330fb7145b4c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff187400640 1 -- 172.21.15.192:0/1987646690 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c02ae50 con 0x7ff188150480 2024-09-13T18:38:23.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff187400640 1 -- 172.21.15.192:0/1987646690 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c032440 con 0x7ff188150480 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff187400640 1 -- 172.21.15.192:0/1987646690 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c0327d0 con 0x7ff188150480 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 -- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188150480 msgr2=0x7ff18815a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188150480 0x7ff18815a3e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0097a0 tx=0x7ff17c02a100 comp rx=0 tx=0).stop 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 -- 172.21.15.192:0/1987646690 shutdown_connections 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff188071810 0x7ff1880b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 --2- 172.21.15.192:0/1987646690 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188150480 0x7ff18815a3e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 -- 172.21.15.192:0/1987646690 >> 172.21.15.192:0/1987646690 conn(0x7ff1880ae960 msgr2=0x7ff18806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 -- 172.21.15.192:0/1987646690 shutdown_connections 2024-09-13T18:38:23.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.701+0000 7ff18fc00640 1 -- 172.21.15.192:0/1987646690 wait complete. 2024-09-13T18:38:23.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.703+0000 7ff18fc00640 1 Processor -- start 2024-09-13T18:38:23.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.703+0000 7ff18fc00640 1 -- start start 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188071810 0x7ff18813e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 0x7ff188153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff188153970 con 0x7ff188150480 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18806be70 con 0x7ff188071810 2024-09-13T18:38:23.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18fc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff188154160 con 0x7ff1880b2230 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34782/0 (socket says 172.21.15.192:34782) 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18dc00640 1 -- 172.21.15.192:0/206439073 learned_addr learned my addr 172.21.15.192:0/206439073 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.704+0000 7ff18d200640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188071810 0x7ff18813e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff187e00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 0x7ff188153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 -- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 msgr2=0x7ff188153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 0x7ff188153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 -- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188071810 msgr2=0x7ff18813e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188071810 0x7ff18813e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 -- 172.21.15.192:0/206439073 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c009400 con 0x7ff188150480 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff187e00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 0x7ff188153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18dc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff18000cbb0 tx=0x7ff18000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff184c00640 1 -- 172.21.15.192:0/206439073 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000ad40 con 0x7ff188150480 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff184c00640 1 -- 172.21.15.192:0/206439073 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff180012400 con 0x7ff188150480 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff184c00640 1 -- 172.21.15.192:0/206439073 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18000aea0 con 0x7ff188150480 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff188154440 con 0x7ff188150480 2024-09-13T18:38:23.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.705+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18814f5b0 con 0x7ff188150480 2024-09-13T18:38:23.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.707+0000 7ff184c00640 1 -- 172.21.15.192:0/206439073 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff180007070 con 0x7ff188150480 2024-09-13T18:38:23.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.708+0000 7ff184c00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 0x7ff16806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.708+0000 7ff184c00640 1 -- 172.21.15.192:0/206439073 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff180089220 con 0x7ff188150480 2024-09-13T18:38:23.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.708+0000 7ff18d200640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 0x7ff16806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.709+0000 7ff192a4e740 1 Processor -- start 2024-09-13T18:38:23.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.709+0000 7ff192a4e740 1 -- start start 2024-09-13T18:38:23.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.709+0000 7ff18d200640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 0x7ff16806d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff17c034000 tx=0x7ff17c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 0x55b038362860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0382cbab0 con 0x55b0383a6690 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0382c9240 con 0x55b038362da0 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0382c4b30 con 0x55b03835e170 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34794/0 (socket says 172.21.15.192:34794) 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 -- 172.21.15.192:0/1631690358 learned_addr learned my addr 172.21.15.192:0/1631690358 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18d200640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 0x55b038362860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff187e00640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 -- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 msgr2=0x55b038362860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 0x55b038362860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 -- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 msgr2=0x55b03838c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18dc00640 1 -- 172.21.15.192:0/1631690358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b03828fbd0 con 0x55b0383a6690 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.710+0000 7ff18d200640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 0x55b038362860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff18dc00640 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff180054660 tx=0x7ff180057dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82fec22a3b2a32e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff179600640 1 -- 172.21.15.192:0/1631690358 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1800604a0 con 0x55b0383a6690 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff179600640 1 -- 172.21.15.192:0/1631690358 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1800562a0 con 0x55b0383a6690 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff179600640 1 -- 172.21.15.192:0/1631690358 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18005e0d0 con 0x55b0383a6690 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff192a4e740 1 -- 172.21.15.192:0/1631690358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 msgr2=0x55b03838c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.711+0000 7ff192a4e740 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ff180054660 tx=0x7ff180057dd0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 -- 172.21.15.192:0/1631690358 shutdown_connections 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838c7f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 --2- 172.21.15.192:0/1631690358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b03835e170 0x55b038362860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 -- 172.21.15.192:0/1631690358 >> 172.21.15.192:0/1631690358 conn(0x55b03835ee00 msgr2=0x55b0383a72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 -- 172.21.15.192:0/1631690358 shutdown_connections 2024-09-13T18:38:23.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 -- 172.21.15.192:0/1631690358 wait complete. 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 -- start start 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.712+0000 7ff192a4e740 1 Processor -- start 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038362da0 0x55b03837bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038395110 0x55b038395590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b038266260 con 0x55b0383a6690 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b038265f00 con 0x55b038395110 2024-09-13T18:38:23.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b03802bf20 con 0x55b038362da0 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.713+0000 7ff192a4e740 10 client.0 _ll_register_callbacks cb 0x55b0382be1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34800/0 (socket says 172.21.15.192:34800) 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 -- 172.21.15.192:0/789115567 learned_addr learned my addr 172.21.15.192:0/789115567 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff18dc00640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038395110 0x55b038395590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff18d200640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038362da0 0x55b03837bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 -- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038362da0 msgr2=0x55b03837bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038362da0 0x55b03837bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 -- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038395110 msgr2=0x55b038395590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038395110 0x55b038395590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 -- 172.21.15.192:0/789115567 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18814f5b0 con 0x55b0383a6690 2024-09-13T18:38:23.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff187e00640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff174009de0 tx=0x7ff1740136b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cdbaab0bfda569b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.714+0000 7ff16e000640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174016870 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff174013e80 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0382eecd0 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1740169d0 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 10 client.6186 fetch_fsmap learned FSMap version 32 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55b0382c31b0 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b0382eecd0 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff174016b30 con 0x55b0383a6690 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 10 client.6186 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T18:38:23.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 10 client.6186 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 20 client.6186 populate_metadata read hostname 'smithi192' 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b03837d2f0 0x55b03837d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 4 client.6186 mds_command: new command op to 6033 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.715+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 --> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b037fb83c0 con 0x55b03837d2f0 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.716+0000 7ff18d200640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b03837d2f0 0x55b03837d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.716+0000 7ff16e000640 10 client.6186 ms_handle_connect on v2:172.21.15.192:6834/2146307069 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.716+0000 7ff18d200640 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b03837d2f0 0x55b03837d6d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=702b368b8968e220 server_cookie=2a148a782ccc1d26 in_seq=0 out_seq=0 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff16e000640 1 -- 172.21.15.192:0/789115567 <== mds.0 v2:172.21.15.192:6834/2146307069 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b037fb83c0 con 0x55b03837d2f0 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff16e000640 10 client.6186 handle_command_reply: tid=0 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 client.6186 shutdown 2024-09-13T18:38:23.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 msgr2=0x55b03838b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ff174009de0 tx=0x7ff1740136b0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 shutdown_connections 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b03837d2f0 0x55b03837d6d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038395110 0x55b038395590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b0383a6690 0x55b03838b8e0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 --2- 172.21.15.192:0/789115567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038362da0 0x55b03837bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff16e000640 0 client.6186 ms_handle_reset on v2:172.21.15.192:6834/2146307069 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 >> 172.21.15.192:0/789115567 conn(0x55b03835e170 msgr2=0x55b0383a58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 shutdown_connections 2024-09-13T18:38:23.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.717+0000 7ff192a4e740 1 -- 172.21.15.192:0/789115567 wait complete. 2024-09-13T18:38:23.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.718+0000 7ff192a4e740 20 client.6186 trim_cache size 0 max 16384 2024-09-13T18:38:23.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.733+0000 7ff192a4e740 1 Processor -- start 2024-09-13T18:38:23.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.733+0000 7ff192a4e740 1 -- start start 2024-09-13T18:38:23.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b0383a6690 0x55b03838b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03835e8c0 con 0x55b038395110 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b038390a00 con 0x55b038362da0 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b0383a6f00 con 0x55b0383a6690 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34814/0 (socket says 172.21.15.192:34814) 2024-09-13T18:38:23.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 -- 172.21.15.192:0/3690492305 learned_addr learned my addr 172.21.15.192:0/3690492305 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 -- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b0383a6690 msgr2=0x55b03838b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b0383a6690 0x55b03838b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 -- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 msgr2=0x55b03838d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff18d200640 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff187e00640 1 -- 172.21.15.192:0/3690492305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b038265470 con 0x55b038395110 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.734+0000 7ff18d200640 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff187e00640 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff174006a20 tx=0x7ff174018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be67b8681d5e6a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff17a000640 1 -- 172.21.15.192:0/3690492305 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174016870 con 0x55b038395110 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff17a000640 1 -- 172.21.15.192:0/3690492305 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1740169d0 con 0x55b038395110 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff17a000640 1 -- 172.21.15.192:0/3690492305 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff174013e80 con 0x55b038395110 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 -- 172.21.15.192:0/3690492305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 msgr2=0x55b03838b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff174006a20 tx=0x7ff174018000 comp rx=0 tx=0).stop 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 -- 172.21.15.192:0/3690492305 shutdown_connections 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b0383a6690 0x55b03838b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038395110 0x55b03838b420 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.735+0000 7ff192a4e740 1 --2- 172.21.15.192:0/3690492305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b038362da0 0x55b03838d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.736+0000 7ff192a4e740 1 -- 172.21.15.192:0/3690492305 >> 172.21.15.192:0/3690492305 conn(0x55b03835e170 msgr2=0x55b0383603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.736+0000 7ff192a4e740 1 -- 172.21.15.192:0/3690492305 shutdown_connections 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.736+0000 7ff192a4e740 1 -- 172.21.15.192:0/3690492305 wait complete. 2024-09-13T18:38:23.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.736+0000 7ff192a4e740 1 -- start start 2024-09-13T18:38:23.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.736+0000 7ff192a4e740 1 Processor -- start 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038395110 0x55b03840f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b0383a6690 0x55b03838a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03838b880 con 0x55b038362da0 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b03837a710 con 0x55b0383a6690 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b03838ae30 con 0x55b038395110 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff192a4e740 10 client.0 _ll_register_callbacks cb 0x7ff1740099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.737+0000 7ff18d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34824/0 (socket says 172.21.15.192:34824) 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 -- 172.21.15.192:0/333707255 learned_addr learned my addr 172.21.15.192:0/333707255 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff187e00640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038395110 0x55b03840f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18dc00640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b0383a6690 0x55b03838a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 -- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038395110 msgr2=0x55b03840f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038395110 0x55b03840f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 -- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b0383a6690 msgr2=0x55b03838a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b0383a6690 0x55b03838a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 -- 172.21.15.192:0/333707255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0382c31b0 con 0x55b038362da0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff18d200640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff17c035040 tx=0x7ff17c02c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf6dd9c32c3841a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff16e000640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c03cac0 con 0x55b038362da0 2024-09-13T18:38:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1800562a0 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.738+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff17c03cc20 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff17c03cde0 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 10 client.6192 fetch_fsmap learned FSMap version 32 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x55b03828a980 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1800562a0 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff17c055060 con 0x55b038362da0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 10 client.6192 fetch_fsmap finished waiting for FSMap version 32 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 10 client.6192 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 20 client.6192 populate_metadata read hostname 'smithi192' 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b0383bd3b0 0x55b0383bd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 4 client.6192 mds_command: new command op to 6033 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 --> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b037fc96c0 con 0x55b0383bd3b0 2024-09-13T18:38:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.739+0000 7ff187e00640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b0383bd3b0 0x55b0383bd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff187e00640 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b0383bd3b0 0x55b0383bd790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3f34f3fa5e5c057 server_cookie=b4bd7697327694e1 in_seq=0 out_seq=0 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff16e000640 10 client.6192 ms_handle_connect on v2:172.21.15.192:6834/2146307069 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff16e000640 1 -- 172.21.15.192:0/333707255 <== mds.0 v2:172.21.15.192:6834/2146307069 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55b037fc96c0 con 0x55b0383bd3b0 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff16e000640 10 client.6192 handle_command_reply: tid=0 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 client.6192 shutdown 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 msgr2=0x55b03837aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff17c035040 tx=0x7ff17c02c070 comp rx=0 tx=0).stop 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 shutdown_connections 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:6834/2146307069,v1:172.21.15.192:6836/2146307069] conn(0x55b0383bd3b0 0x55b0383bd790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b0383a6690 0x55b03838a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b038395110 0x55b03840f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff16e000640 0 client.6192 ms_handle_reset on v2:172.21.15.192:6834/2146307069 2024-09-13T18:38:23.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 --2- 172.21.15.192:0/333707255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b038362da0 0x55b03837aff0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 >> 172.21.15.192:0/333707255 conn(0x55b03835e170 msgr2=0x55b03835bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 shutdown_connections 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.740+0000 7ff192a4e740 1 -- 172.21.15.192:0/333707255 wait complete. 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff192a4e740 20 client.6192 trim_cache size 0 max 16384 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 6033, 2024-09-13T18:38:23.748 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0189938549999997, 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 32, 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 71, 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 71, 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 10.980714077 2024-09-13T18:38:23.749 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 msgr2=0x7ff16806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 0x7ff16806d0c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff17c034000 tx=0x7ff17c02e000 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 msgr2=0x7ff18815c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ff18000cbb0 tx=0x7ff18000a430 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 shutdown_connections 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff16806ac00 0x7ff16806d0c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff188150480 0x7ff18815c6d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1880b2230 0x7ff188153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 --2- 172.21.15.192:0/206439073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff188071810 0x7ff18813e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 >> 172.21.15.192:0/206439073 conn(0x7ff1880ae960 msgr2=0x7ff18815d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 shutdown_connections 2024-09-13T18:38:23.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.741+0000 7ff18fc00640 1 -- 172.21.15.192:0/206439073 wait complete. 2024-09-13T18:38:23.760 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:38:23.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.910+0000 7f5f3ee00640 1 Processor -- start 2024-09-13T18:38:23.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.910+0000 7f5f3ee00640 1 -- start start 2024-09-13T18:38:23.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f380ae9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f3815d9c0 0x7f5f3806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3ee00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3806bd20 con 0x7f5f3806b380 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f380cf130 con 0x7f5f3815d9c0 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f38160c60 con 0x7f5f3815a9e0 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3d000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5f3806b380 0x7f5f3815d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48182/0 (socket says 172.21.15.192:48182) 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3d000640 1 -- 172.21.15.192:0/1169909705 learned_addr learned my addr 172.21.15.192:0/1169909705 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.911+0000 7f5f3e400640 1 --2- 172.21.15.192:0/1169909705 >> v2:172.21.15.194:3300/0 conn(0x7f5f3815d9c0 0x7f5f3806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f380ae9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1212206156 0 0) 0x7f5f3806bd20 con 0x7f5f3806b380 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f20003520 con 0x7f5f3806b380 2024-09-13T18:38:23.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1274257236 0 0) 0x7f5f20003520 con 0x7f5f3806b380 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 msgr2=0x7f5f380ae9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f380ae9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 >> v2:172.21.15.194:3300/0 conn(0x7f5f3815d9c0 msgr2=0x7f5f3806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 --2- 172.21.15.192:0/1169909705 >> v2:172.21.15.194:3300/0 conn(0x7f5f3815d9c0 0x7f5f3806b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f380ae540 con 0x7f5f3806b380 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f5f24001670 con 0x7f5f3806b380 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 >> v1:172.21.15.192:6789/0 conn(0x7f5f3806b380 legacy=0x7f5f3815d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f20003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f200047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f20004d00 0x7f5f20005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380cf130 con 0x7f5f20003970 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2000b980 con 0x7f5f20004d00 2024-09-13T18:38:23.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2000bac0 con 0x7f5f3815a9e0 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f20003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.912+0000 7f5f3d000640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f200047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3e400640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f20004d00 0x7f5f20005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3da00640 1 -- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 msgr2=0x7f5f200047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815a9e0 0x7f5f200047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3da00640 1 -- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f20004d00 msgr2=0x7f5f20005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f20004d00 0x7f5f20005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3da00640 1 -- 172.21.15.192:0/1169909705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20003520 con 0x7f5f20003970 2024-09-13T18:38:23.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.913+0000 7f5f3e400640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f20004d00 0x7f5f20005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:23.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.914+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f20003d90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009ac0 tx=0x7f5f200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0d0e64c8279f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.914+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c031400 con 0x7f5f20003970 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.914+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c02d050 con 0x7f5f20003970 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.914+0000 7f5f37e00640 1 -- 172.21.15.192:0/1169909705 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c031780 con 0x7f5f20003970 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1169909705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 msgr2=0x7f5f20003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1169909705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f20003d90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009ac0 tx=0x7f5f200057f0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3e400640 1 -- 172.21.15.192:0/1169909705 reap_dead start 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1169909705 shutdown_connections 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1169909705 >> 172.21.15.192:0/1169909705 conn(0x7f5f380cf270 msgr2=0x7f5f380cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1169909705 shutdown_connections 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.915+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1169909705 wait complete. 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.917+0000 7f5f3ee00640 1 Processor -- start 2024-09-13T18:38:23.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.917+0000 7f5f3ee00640 1 -- start start 2024-09-13T18:38:23.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815e280 0x7f5f38071c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 0x7f5f3814bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380ccec0 con 0x7f5f20003970 2024-09-13T18:38:23.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3815f6b0 con 0x7f5f3814b710 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f380b0310 con 0x7f5f3815e280 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34848/0 (socket says 172.21.15.192:34848) 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 -- 172.21.15.192:0/1637997643 learned_addr learned my addr 172.21.15.192:0/1637997643 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 -- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815e280 msgr2=0x7f5f38071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815e280 0x7f5f38071c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 -- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 msgr2=0x7f5f3814bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3e400640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 0x7f5f3814bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 0x7f5f3814bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3da00640 1 -- 172.21.15.192:0/1637997643 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3815f8a0 con 0x7f5f20003970 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.918+0000 7f5f3e400640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 0x7f5f3814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f3da00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009ac0 tx=0x7f5f2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c003b90 con 0x7f5f20003970 2024-09-13T18:38:23.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c003cf0 con 0x7f5f20003970 2024-09-13T18:38:23.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c044650 con 0x7f5f20003970 2024-09-13T18:38:23.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3815fb80 con 0x7f5f20003970 2024-09-13T18:38:23.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.919+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f380ccae0 con 0x7f5f20003970 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.920+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f38160520 con 0x7f5f20003970 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.921+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f2c038070 con 0x7f5f20003970 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.922+0000 7f5f35600640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 0x7f5f1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.922+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5f2c0a98b0 con 0x7f5f20003970 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.922+0000 7f5f3d000640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 0x7f5f1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:23.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.923+0000 7f5f3d000640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 0x7f5f1806d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5f24001b60 tx=0x7f5f24001af0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:23.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:23.926+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f2c074aa0 con 0x7f5f20003970 2024-09-13T18:38:24.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.130+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f380ccca0 con 0x7f5f20003970 2024-09-13T18:38:24.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.130+0000 7f5f35600640 1 -- 172.21.15.192:0/1637997643 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5f2c036070 con 0x7f5f20003970 2024-09-13T18:38:24.133 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:38:24.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.132+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 msgr2=0x7f5f1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.132+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 0x7f5f1806d0f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5f24001b60 tx=0x7f5f24001af0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.132+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 msgr2=0x7f5f3815f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.132+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009ac0 tx=0x7f5f2c004730 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 shutdown_connections 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f1806ac30 0x7f5f1806d0f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f3814b710 0x7f5f3814bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f3815e280 0x7f5f38071c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 --2- 172.21.15.192:0/1637997643 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f20003970 0x7f5f3815f170 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 >> 172.21.15.192:0/1637997643 conn(0x7f5f380cf270 msgr2=0x7f5f3815b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 shutdown_connections 2024-09-13T18:38:24.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:24.133+0000 7f5f3ee00640 1 -- 172.21.15.192:0/1637997643 wait complete. 2024-09-13T18:38:24.150 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:38:24.151 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:38:24.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.152 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:38:24.187 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:38:24.187 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:38:24.187 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:24.188 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42605sec preferred_lft 42605sec 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:38:24.189 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:24.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.190 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:38:24.281 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:38:24.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.285 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:38:24.320 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:38:24.320 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:38:24.321 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:38:24.321 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:38:24.321 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:38:24.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.321 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:38:24.321 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:38:24.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:38:24.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:38:24.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:38:24.322 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:38:24.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.466 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:38:24.500 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:38:24.500 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:38:24.501 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:38:24.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:38:24.597 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:38:24.597 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:38:24.632 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:38:24.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:38:24.632 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:38:24.707 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:38:24.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.707 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:24.836 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:24.836 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:38:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:38:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:38:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:38:24.862 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:38:24.863 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:38:24.863 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:38:24.863 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:38:24.864 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:38:24.864 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:38:24.866 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:38:24.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.867 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:38:24.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:24.923 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:38:24.966 INFO:teuthology.orchestra.run.smithi192.stdout:client6201 2024-09-13T18:38:24.967 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:38:24.967 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:25.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:38:25.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.231+0000 7f3491200640 1 Processor -- start 2024-09-13T18:38:25.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.231+0000 7f3491200640 1 -- start start 2024-09-13T18:38:25.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3491200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f348c0cacd0 0x7f348c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3491200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f348c15bc20 0x7f348c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3491200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f348c140480 con 0x7f348c0cb0b0 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3491200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c0cb520 con 0x7f348c15bc20 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3491200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f348c15ee90 con 0x7f348c0cacd0 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f348a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f348c15bc20 0x7f348c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3481400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f348c0cb0b0 0x7f348c140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48188/0 (socket says 172.21.15.192:48188) 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3481400640 1 -- 172.21.15.192:0/2885896718 learned_addr learned my addr 172.21.15.192:0/2885896718 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:25.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f3489e00640 1 --2- 172.21.15.192:0/2885896718 >> v2:172.21.15.194:3300/0 conn(0x7f348c0cacd0 0x7f348c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f348a800640 1 -- 172.21.15.192:0/2885896718 >> v2:172.21.15.194:3300/0 conn(0x7f348c0cacd0 msgr2=0x7f348c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:25.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f348a800640 1 --2- 172.21.15.192:0/2885896718 >> v2:172.21.15.194:3300/0 conn(0x7f348c0cacd0 0x7f348c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f348a800640 1 -- 172.21.15.192:0/2885896718 >> v1:172.21.15.192:6789/0 conn(0x7f348c0cb0b0 legacy=0x7f348c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.233+0000 7f348a800640 1 -- 172.21.15.192:0/2885896718 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f348c15f170 con 0x7f348c15bc20 2024-09-13T18:38:25.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.234+0000 7f348a800640 1 --2- 172.21.15.192:0/2885896718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c15bc20 0x7f348c0afd80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b2350 tx=0x7f348402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51886e6261edaa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3489400640 1 -- 172.21.15.192:0/2885896718 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348402aea0 con 0x7f348c15bc20 2024-09-13T18:38:25.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3489400640 1 -- 172.21.15.192:0/2885896718 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348402d050 con 0x7f348c15bc20 2024-09-13T18:38:25.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3489400640 1 -- 172.21.15.192:0/2885896718 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484007960 con 0x7f348c15bc20 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 -- 172.21.15.192:0/2885896718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c15bc20 msgr2=0x7f348c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 --2- 172.21.15.192:0/2885896718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c15bc20 0x7f348c0afd80 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f348c0b2350 tx=0x7f348402a680 comp rx=0 tx=0).stop 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 -- 172.21.15.192:0/2885896718 shutdown_connections 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 --2- 172.21.15.192:0/2885896718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c15bc20 0x7f348c0afd80 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 --2- 172.21.15.192:0/2885896718 >> v2:172.21.15.194:3300/0 conn(0x7f348c0cacd0 0x7f348c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 -- 172.21.15.192:0/2885896718 >> 172.21.15.192:0/2885896718 conn(0x7f348c0ae960 msgr2=0x7f348c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 -- 172.21.15.192:0/2885896718 shutdown_connections 2024-09-13T18:38:25.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.235+0000 7f3491200640 1 -- 172.21.15.192:0/2885896718 wait complete. 2024-09-13T18:38:25.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.237+0000 7f3491200640 1 Processor -- start 2024-09-13T18:38:25.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.237+0000 7f3491200640 1 -- start start 2024-09-13T18:38:25.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 0x7f348c06ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f348c15bc20 0x7f348c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cd5e0 con 0x7f348c0cb0b0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0cc960 con 0x7f348c0cacd0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3491200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348c0ccc40 con 0x7f348c15bc20 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3481400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3481400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34860/0 (socket says 172.21.15.192:34860) 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.238+0000 7f3481400640 1 -- 172.21.15.192:0/341799902 learned_addr learned my addr 172.21.15.192:0/341799902 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f348a800640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f348c15bc20 0x7f348c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3489e00640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 0x7f348c06ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 -- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f348c15bc20 msgr2=0x7f348c0cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f348c15bc20 0x7f348c0cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 -- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 msgr2=0x7f348c06ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 0x7f348c06ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 -- 172.21.15.192:0/341799902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3484009a70 con 0x7f348c0cb0b0 2024-09-13T18:38:25.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3489e00640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 0x7f348c06ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3481400640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f347400c4a0 tx=0x7f347400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474005ce0 con 0x7f348c0cb0b0 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3474005e40 con 0x7f348c0cb0b0 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474007270 con 0x7f348c0cb0b0 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.239+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348c0ccf20 con 0x7f348c0cb0b0 2024-09-13T18:38:25.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.240+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f348c0cc630 con 0x7f348c0cb0b0 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.240+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f348c15e790 con 0x7f348c0cb0b0 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.241+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f34740073d0 con 0x7f348c0cb0b0 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.242+0000 7f3482a00640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 0x7f346806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.242+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3474088760 con 0x7f348c0cb0b0 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.242+0000 7f3489e00640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 0x7f346806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:25.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.243+0000 7f3489e00640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 0x7f346806d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f347c009af0 tx=0x7f347c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:25.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.247+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f34740539e0 con 0x7f348c0cb0b0 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.451+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f348c06c6c0 con 0x7f348c0cb0b0 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.452+0000 7f3482a00640 1 -- 172.21.15.192:0/341799902 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3474017070 con 0x7f348c0cb0b0 2024-09-13T18:38:25.455 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 msgr2=0x7f346806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 0x7f346806d0c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f347c009af0 tx=0x7f347c008040 comp rx=0 tx=0).stop 2024-09-13T18:38:25.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 msgr2=0x7f348c13d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f347400c4a0 tx=0x7f347400c960 comp rx=0 tx=0).stop 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 shutdown_connections 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f346806ac00 0x7f346806d0c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f348c15bc20 0x7f348c0cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f348c0cb0b0 0x7f348c13d560 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 --2- 172.21.15.192:0/341799902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f348c0cacd0 0x7f348c06ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.454+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 >> 172.21.15.192:0/341799902 conn(0x7f348c0ae960 msgr2=0x7f348c13ebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.455+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 shutdown_connections 2024-09-13T18:38:25.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:25.455+0000 7f3491200640 1 -- 172.21.15.192:0/341799902 wait complete. 2024-09-13T18:38:25.474 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:38:25.474 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:38:25.474 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:38:25.474 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:38:25.475 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:25.475 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:38:25.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:38:25.475 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:38:25.475 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:38:25.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.476 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:38:25.518 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:38:25.519 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:38:25.519 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:38:25.519 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.519 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:38:25.519 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.520 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:25.520 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:25.520 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:38:25.520 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:25.520 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:25.521 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:38:25.522 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42609sec preferred_lft 42609sec 2024-09-13T18:38:25.522 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:38:25.522 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.522 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.523 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:38:25.524 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:38:25.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.525 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:38:25.616 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:38:25.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.619 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:38:25.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:38:25.657 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:38:25.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.808 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:38:25.843 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:38:25.843 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:38:25.844 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:38:25.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:25.844 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:38:25.939 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:38:25.939 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:25.974 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:38:25.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:38:25.975 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:26.049 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:38:26.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:26.049 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:26.178 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:26.178 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:38:26.203 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:38:26.204 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:38:26.204 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:38:26.204 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:38:26.204 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:38:26.205 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:38:26.205 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:38:26.205 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:38:26.205 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:38:26.205 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:38:26.208 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:38:26.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:26.208 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:38:26.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:38:26.263 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:38:26.301 INFO:teuthology.orchestra.run.smithi194.stdout:client5989 2024-09-13T18:38:26.301 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:38:26.302 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:38:26.377 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:38:26.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.532+0000 7f924b400640 1 Processor -- start 2024-09-13T18:38:26.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.532+0000 7f924b400640 1 -- start start 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.533+0000 7f924b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 0x7f924415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.533+0000 7f924b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92440cb0b0 0x7f924415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.533+0000 7f924b400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9244140480 con 0x7f9244140980 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.533+0000 7f924b400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924415c160 con 0x7f92440cb0b0 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.533+0000 7f924b400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92440cb520 con 0x7f92440cacd0 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9243e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f92440cb0b0 0x7f924415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9249400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9244140980 0x7f92440afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48204/0 (socket says 172.21.15.192:48204) 2024-09-13T18:38:26.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9249400640 1 -- 172.21.15.192:0/1692614410 learned_addr learned my addr 172.21.15.192:0/1692614410 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:38:26.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9248a00640 1 --2- 172.21.15.192:0/1692614410 >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 0x7f924415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9243e00640 1 -- 172.21.15.192:0/1692614410 >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 msgr2=0x7f924415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:38:26.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9243e00640 1 --2- 172.21.15.192:0/1692614410 >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 0x7f924415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9243e00640 1 -- 172.21.15.192:0/1692614410 >> v1:172.21.15.192:6789/0 conn(0x7f9244140980 legacy=0x7f92440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9243e00640 1 -- 172.21.15.192:0/1692614410 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924415ee90 con 0x7f92440cb0b0 2024-09-13T18:38:26.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.534+0000 7f9248a00640 1 --2- 172.21.15.192:0/1692614410 >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 0x7f924415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:26.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.535+0000 7f9243e00640 1 --2- 172.21.15.192:0/1692614410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f924415bc20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f92440b2350 tx=0x7f923002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f166e12b6cfa22d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.535+0000 7f9243400640 1 -- 172.21.15.192:0/1692614410 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230032440 con 0x7f92440cb0b0 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.535+0000 7f9243400640 1 -- 172.21.15.192:0/1692614410 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92300325a0 con 0x7f92440cb0b0 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.535+0000 7f9243400640 1 -- 172.21.15.192:0/1692614410 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230032930 con 0x7f92440cb0b0 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 -- 172.21.15.192:0/1692614410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 msgr2=0x7f924415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 --2- 172.21.15.192:0/1692614410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f924415bc20 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f92440b2350 tx=0x7f923002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 -- 172.21.15.192:0/1692614410 shutdown_connections 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 --2- 172.21.15.192:0/1692614410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f924415bc20 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 --2- 172.21.15.192:0/1692614410 >> v2:172.21.15.194:3300/0 conn(0x7f92440cacd0 0x7f924415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 -- 172.21.15.192:0/1692614410 >> 172.21.15.192:0/1692614410 conn(0x7f92440ae960 msgr2=0x7f924406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:26.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 -- 172.21.15.192:0/1692614410 shutdown_connections 2024-09-13T18:38:26.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.536+0000 7f924b400640 1 -- 172.21.15.192:0/1692614410 wait complete. 2024-09-13T18:38:26.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.537+0000 7f924b400640 1 Processor -- start 2024-09-13T18:38:26.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.538+0000 7f924b400640 1 -- start start 2024-09-13T18:38:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.538+0000 7f924b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92440cacd0 0x7f924413d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.538+0000 7f924b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.538+0000 7f924b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 0x7f92440add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f924b400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924413db30 con 0x7f92440cb0b0 2024-09-13T18:38:26.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f924b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244155c90 con 0x7f92440cacd0 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f924b400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92440b3d60 con 0x7f9244140980 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:34872/0 (socket says 172.21.15.192:34872) 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 -- 172.21.15.192:0/2332970709 learned_addr learned my addr 172.21.15.192:0/2332970709 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9248a00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92440cacd0 0x7f924413d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9249400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 0x7f92440add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 -- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 msgr2=0x7f92440add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 0x7f92440add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 -- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92440cacd0 msgr2=0x7f924413d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92440cacd0 0x7f924413d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 -- 172.21.15.192:0/2332970709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9230009400 con 0x7f92440cb0b0 2024-09-13T18:38:26.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9249400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 0x7f92440add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.539+0000 7f9243e00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c00 tx=0x7f92300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.540+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9230030b80 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.540+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9230030d00 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.540+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923003d680 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.540+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92440b4040 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.540+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92440b4600 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.541+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92440b4790 con 0x7f92440cb0b0 2024-09-13T18:38:26.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.542+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9230039040 con 0x7f92440cb0b0 2024-09-13T18:38:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.543+0000 7f9240c00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 0x7f922406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:38:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.543+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f92300a9ee0 con 0x7f92440cb0b0 2024-09-13T18:38:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.543+0000 7f9248a00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 0x7f922406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:38:26.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.544+0000 7f9248a00640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 0x7f922406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f923800a950 tx=0x7f9238008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:38:26.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.547+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9230075160 con 0x7f92440cb0b0 2024-09-13T18:38:26.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.746+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f924415bc20 con 0x7f92440cb0b0 2024-09-13T18:38:26.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.747+0000 7f9240c00640 1 -- 172.21.15.192:0/2332970709 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f9230078780 con 0x7f92440cb0b0 2024-09-13T18:38:26.750 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:38:26.750 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:38:26.750 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 msgr2=0x7f922406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 0x7f922406d0c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f923800a950 tx=0x7f9238008040 comp rx=0 tx=0).stop 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 msgr2=0x7f92440ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9230000c00 tx=0x7f92300046c0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 shutdown_connections 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f922406ac00 0x7f922406d0c0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9244140980 0x7f92440add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92440cb0b0 0x7f92440ad840 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 --2- 172.21.15.192:0/2332970709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f92440cacd0 0x7f924413d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:38:26.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 >> 172.21.15.192:0/2332970709 conn(0x7f92440ae960 msgr2=0x7f924415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:38:26.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 shutdown_connections 2024-09-13T18:38:26.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:38:26.749+0000 7f924b400640 1 -- 172.21.15.192:0/2332970709 wait complete. 2024-09-13T18:38:26.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:38:26.943 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":6033,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.2051137409999999,"mdsmap_epoch":32,"osdmap_epoch":71,"osdmap_epoch_barrier":71,"uptime":14.166837113} 2024-09-13T18:38:26.943 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 6033, "mdsmap_epoch": 32, "osdmap_epoch": 71, "osdmap_epoch_barrier": 71, "rank_uptime": 9.205113741, "state": "up:active", "uptime": 14.166837113, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:38:26.944 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:38:27.113 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:38:27.114 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:38:27.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-13T18:38:27.274 INFO:teuthology.orchestra.run.smithi192.stdout:{"mon_tick_interval":"5"} 2024-09-13T18:38:27.275 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-13T18:38:27.275 INFO:tasks.cephfs.test_full:pool capacity 557012544, 531MB should be enough to fill it 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> import time 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> import datetime 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:38:27.275 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> # Write some buffered data through before going full, all should be well 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> print("writing some data through which we expect to succeed") 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> bytes = 0 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> # buffered IO, the error should always only appear from fsync and not 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> # from write 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> full = False 2024-09-13T18:38:27.276 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(531 * 0.9)): 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> print("done writing {0} bytes".format(bytes)) 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> # OK, now we should sneak in under the full condition 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> # due to the time it takes the OSDs to report to the 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> # mons, and get a successful fsync on our full-making data 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> # buffered write, add more dirty data to the buffer 2024-09-13T18:38:27.277 DEBUG:teuthology.orchestra.run.smithi192:> print("starting buffered write") 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(531 * 0.2)): 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(15.0) 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> except OSError: 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> pass; 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> # Wait long enough for a background flush that should fail 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(30) 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.278 DEBUG:teuthology.orchestra.run.smithi192:> if False: 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> # ...and check that the failed background flush is reflected in fclose 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> except OSError: 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> print("close() returned an error as expected") 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("close() failed to raise error") 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> # The kernel cephfs client does not raise errors on fclose 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-13T18:38:27.279 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:writing some data through which we expect to succeed 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-13T18:38:27.929 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-13T18:38:27.930 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 30932992 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 31981568 bytes via buffered write, may repeat 2024-09-13T18:38:27.931 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 33030144 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 34078720 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 35127296 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 36175872 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 37224448 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 38273024 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 39321600 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 40370176 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 41418752 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 42467328 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 43515904 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 44564480 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 45613056 bytes via buffered write, may repeat 2024-09-13T18:38:27.932 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 46661632 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 47710208 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 48758784 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 49807360 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 50855936 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 51904512 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 52953088 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 54001664 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 55050240 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 56098816 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 57147392 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 58195968 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 59244544 bytes via buffered write, may repeat 2024-09-13T18:38:27.933 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 60293120 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 61341696 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 62390272 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 63438848 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 64487424 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 65536000 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 66584576 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 67633152 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 68681728 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 69730304 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 70778880 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 71827456 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 72876032 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 73924608 bytes via buffered write, may repeat 2024-09-13T18:38:27.934 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 74973184 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 76021760 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 77070336 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 78118912 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 79167488 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 80216064 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 81264640 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 82313216 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 83361792 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 84410368 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 85458944 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 86507520 bytes via buffered write, may repeat 2024-09-13T18:38:27.935 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 87556096 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 88604672 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 89653248 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 90701824 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 91750400 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 92798976 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 93847552 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 94896128 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 95944704 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 96993280 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 98041856 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 99090432 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 100139008 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 101187584 bytes via buffered write, may repeat 2024-09-13T18:38:27.936 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 102236160 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 103284736 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 104333312 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 105381888 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 106430464 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 107479040 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 108527616 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 109576192 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 110624768 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 111673344 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 112721920 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 113770496 bytes via buffered write, may repeat 2024-09-13T18:38:27.937 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 114819072 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 115867648 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 116916224 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 117964800 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 119013376 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 120061952 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 121110528 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 122159104 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 123207680 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 124256256 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 125304832 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 126353408 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 127401984 bytes via buffered write, may repeat 2024-09-13T18:38:27.938 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 128450560 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 129499136 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 130547712 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 131596288 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 132644864 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 133693440 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 134742016 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 135790592 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 136839168 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 137887744 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 138936320 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 139984896 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 141033472 bytes via buffered write, may repeat 2024-09-13T18:38:27.939 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 142082048 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 143130624 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 144179200 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 145227776 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 146276352 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 147324928 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 148373504 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 149422080 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 150470656 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 151519232 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 152567808 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 153616384 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 154664960 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 155713536 bytes via buffered write, may repeat 2024-09-13T18:38:27.940 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 156762112 bytes via buffered write, may repeat 2024-09-13T18:38:27.941 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 157810688 bytes via buffered write, may repeat 2024-09-13T18:38:27.941 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 158859264 bytes via buffered write, may repeat 2024-09-13T18:38:27.941 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 159907840 bytes via buffered write, may repeat 2024-09-13T18:38:27.941 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 160956416 bytes via buffered write, may repeat 2024-09-13T18:38:27.941 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 162004992 bytes via buffered write, may repeat 2024-09-13T18:38:28.076 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 163053568 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 164102144 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 165150720 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 166199296 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 167247872 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 168296448 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 169345024 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 170393600 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 171442176 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 172490752 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 173539328 bytes via buffered write, may repeat 2024-09-13T18:38:28.077 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 174587904 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 175636480 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 176685056 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 177733632 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 178782208 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 179830784 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 180879360 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 181927936 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 182976512 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 184025088 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 185073664 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 186122240 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 187170816 bytes via buffered write, may repeat 2024-09-13T18:38:28.078 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 188219392 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 189267968 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 190316544 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 191365120 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 192413696 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 193462272 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 194510848 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 195559424 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 196608000 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 197656576 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 198705152 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 199753728 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 200802304 bytes via buffered write, may repeat 2024-09-13T18:38:28.079 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 201850880 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 202899456 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 203948032 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 204996608 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 206045184 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 207093760 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 208142336 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 209190912 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 210239488 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 211288064 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 212336640 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 213385216 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 214433792 bytes via buffered write, may repeat 2024-09-13T18:38:28.080 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 215482368 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 216530944 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 217579520 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 218628096 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 219676672 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 220725248 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 221773824 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 222822400 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 223870976 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 224919552 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 225968128 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 227016704 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 228065280 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 229113856 bytes via buffered write, may repeat 2024-09-13T18:38:28.081 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 230162432 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 231211008 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 232259584 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 233308160 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 234356736 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 235405312 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 236453888 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 237502464 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 238551040 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 239599616 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 240648192 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 241696768 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 242745344 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 243793920 bytes via buffered write, may repeat 2024-09-13T18:38:28.082 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 244842496 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 245891072 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 246939648 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 247988224 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 249036800 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 250085376 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 251133952 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 252182528 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 253231104 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 254279680 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 255328256 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 256376832 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 257425408 bytes via buffered write, may repeat 2024-09-13T18:38:28.083 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 258473984 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 259522560 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 260571136 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 261619712 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 262668288 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 263716864 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 264765440 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 265814016 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 266862592 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 267911168 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 268959744 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 270008320 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 271056896 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 272105472 bytes via buffered write, may repeat 2024-09-13T18:38:28.084 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 273154048 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 274202624 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 275251200 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 276299776 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 277348352 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 278396928 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 279445504 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 280494080 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 281542656 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 282591232 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 283639808 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 284688384 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 285736960 bytes via buffered write, may repeat 2024-09-13T18:38:28.085 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 286785536 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 287834112 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 288882688 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 289931264 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 290979840 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 292028416 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 293076992 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 294125568 bytes via buffered write, may repeat 2024-09-13T18:38:28.086 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 295174144 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 296222720 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 297271296 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 298319872 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 299368448 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 300417024 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 301465600 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 302514176 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 303562752 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 304611328 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 305659904 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 306708480 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 307757056 bytes via buffered write, may repeat 2024-09-13T18:38:28.087 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 308805632 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 309854208 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 310902784 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 311951360 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 312999936 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 314048512 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 315097088 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 316145664 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 317194240 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 318242816 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 319291392 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 320339968 bytes via buffered write, may repeat 2024-09-13T18:38:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 321388544 bytes via buffered write, may repeat 2024-09-13T18:38:28.089 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 322437120 bytes via buffered write, may repeat 2024-09-13T18:38:28.089 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 323485696 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 324534272 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 325582848 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 326631424 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 327680000 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 328728576 bytes via buffered write, may repeat 2024-09-13T18:38:28.223 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 329777152 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 330825728 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 331874304 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 332922880 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 333971456 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 335020032 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 336068608 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 337117184 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 338165760 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 339214336 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 340262912 bytes via buffered write, may repeat 2024-09-13T18:38:28.224 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 341311488 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 342360064 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 343408640 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 344457216 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 345505792 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 346554368 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 347602944 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 348651520 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 349700096 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 350748672 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 351797248 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 352845824 bytes via buffered write, may repeat 2024-09-13T18:38:28.225 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 353894400 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 354942976 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 355991552 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 357040128 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 358088704 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 359137280 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 360185856 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 361234432 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 362283008 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 363331584 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 364380160 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 365428736 bytes via buffered write, may repeat 2024-09-13T18:38:28.226 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 366477312 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 367525888 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 368574464 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 369623040 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 370671616 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 371720192 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 372768768 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 373817344 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 374865920 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 375914496 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 376963072 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 378011648 bytes via buffered write, may repeat 2024-09-13T18:38:28.227 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 379060224 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 380108800 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 381157376 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 382205952 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 383254528 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 384303104 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 385351680 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 386400256 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 387448832 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 388497408 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 389545984 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 390594560 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 391643136 bytes via buffered write, may repeat 2024-09-13T18:38:28.228 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 392691712 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 393740288 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 394788864 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 395837440 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 396886016 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 397934592 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 398983168 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 400031744 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 401080320 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 402128896 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 403177472 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 404226048 bytes via buffered write, may repeat 2024-09-13T18:38:28.229 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 405274624 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 406323200 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 407371776 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 408420352 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 409468928 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 410517504 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 411566080 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 412614656 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 413663232 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 414711808 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 415760384 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 416808960 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 417857536 bytes via buffered write, may repeat 2024-09-13T18:38:28.230 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 418906112 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 419954688 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 421003264 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 422051840 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 423100416 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 424148992 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 425197568 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 426246144 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 427294720 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 428343296 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 429391872 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 430440448 bytes via buffered write, may repeat 2024-09-13T18:38:28.231 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 431489024 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 432537600 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 433586176 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 434634752 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 435683328 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 436731904 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 437780480 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 438829056 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 439877632 bytes via buffered write, may repeat 2024-09-13T18:38:28.232 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 440926208 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 441974784 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 443023360 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 444071936 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 445120512 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 446169088 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 447217664 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 448266240 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 449314816 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 450363392 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 451411968 bytes via buffered write, may repeat 2024-09-13T18:38:28.233 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 452460544 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 453509120 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 454557696 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 455606272 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 456654848 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 457703424 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 458752000 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 459800576 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 460849152 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 461897728 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 462946304 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 463994880 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 465043456 bytes via buffered write, may repeat 2024-09-13T18:38:28.234 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 466092032 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 467140608 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 468189184 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 469237760 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 470286336 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 471334912 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 472383488 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 473432064 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 474480640 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 475529216 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 476577792 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 477626368 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 478674944 bytes via buffered write, may repeat 2024-09-13T18:38:28.235 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 479723520 bytes via buffered write, may repeat 2024-09-13T18:38:28.236 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 480772096 bytes via buffered write, may repeat 2024-09-13T18:38:28.236 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 481820672 bytes via buffered write, may repeat 2024-09-13T18:38:28.236 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 482869248 bytes via buffered write, may repeat 2024-09-13T18:38:28.236 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 483917824 bytes via buffered write, may repeat 2024-09-13T18:38:28.236 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 484966400 bytes via buffered write, may repeat 2024-09-13T18:38:30.792 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:38:30.789+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-13T18:38:36.787 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:38:36.784+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2024-09-13T18:38:36.994 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:38:36.999 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:07.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:07.098 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:29.596 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 486014976 bytes via buffered write, may repeat 2024-09-13T18:39:29.596 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 487063552 bytes via buffered write, may repeat 2024-09-13T18:39:29.596 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 488112128 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 489160704 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 490209280 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 491257856 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 492306432 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 493355008 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 494403584 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 495452160 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 496500736 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 497549312 bytes via buffered write, may repeat 2024-09-13T18:39:29.597 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 498597888 bytes via buffered write, may repeat 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 499646464 bytes via buffered write, may repeat 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 500695040 bytes via buffered write, may repeat 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:done writing 500695040 bytes 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:successfully fsync'ed prior to getting full state reported 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:starting buffered write 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:39:29.598 INFO:teuthology.orchestra.run.smithi192.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-13T18:39:29.659 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:39:29.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:39:29.749 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:39:29.842 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:39:29.842 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:39:29.842 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:29.881 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:39:29.881 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:29.956 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:30.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.144+0000 7ff7fbe00640 1 Processor -- start 2024-09-13T18:39:30.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.144+0000 7ff7fbe00640 1 -- start start 2024-09-13T18:39:30.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7fbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff7f415dee0 0x7ff7f40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7fbe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40b2f00 con 0x7ff7f40b3f10 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7fbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40b3150 con 0x7ff7f415e2c0 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7fbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7f40b3430 con 0x7ff7f415dee0 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7f9400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff7f415dee0 0x7ff7f40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7f8a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff7f40b3f10 0x7ff7f415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47672/0 (socket says 172.21.15.192:47672) 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7f8a00640 1 -- 172.21.15.192:0/2007684036 learned_addr learned my addr 172.21.15.192:0/2007684036 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7f9400640 1 -- 172.21.15.192:0/2007684036 >> v1:172.21.15.194:6789/0 conn(0x7ff7f415e2c0 legacy=0x7ff7f41637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.146+0000 7ff7f9400640 1 -- 172.21.15.192:0/2007684036 >> v1:172.21.15.192:6789/0 conn(0x7ff7f40b3f10 legacy=0x7ff7f415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.147+0000 7ff7f9400640 1 -- 172.21.15.192:0/2007684036 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f40b3710 con 0x7ff7f415dee0 2024-09-13T18:39:30.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.147+0000 7ff7f3e00640 1 -- 172.21.15.192:0/2007684036 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099137146 0 0) 0x7ff7f40b2f00 con 0x7ff7f40b3f10 2024-09-13T18:39:30.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7f9400640 1 --2- 172.21.15.192:0/2007684036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415dee0 0x7ff7f40afd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097a0 tx=0x7ff7e802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc5d10a75288561 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7f3e00640 1 -- 172.21.15.192:0/2007684036 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8032440 con 0x7ff7f415dee0 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7f3e00640 1 -- 172.21.15.192:0/2007684036 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e80325a0 con 0x7ff7f415dee0 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7f3e00640 1 -- 172.21.15.192:0/2007684036 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8032930 con 0x7ff7f415dee0 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2007684036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415dee0 msgr2=0x7ff7f40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.148+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2007684036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415dee0 0x7ff7f40afd80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097a0 tx=0x7ff7e802a230 comp rx=0 tx=0).stop 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.149+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2007684036 shutdown_connections 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.149+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2007684036 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415dee0 0x7ff7f40afd80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.149+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2007684036 >> 172.21.15.192:0/2007684036 conn(0x7ff7f40ae960 msgr2=0x7ff7f406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.149+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2007684036 shutdown_connections 2024-09-13T18:39:30.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.149+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2007684036 wait complete. 2024-09-13T18:39:30.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.150+0000 7ff7fbe00640 1 Processor -- start 2024-09-13T18:39:30.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.150+0000 7ff7fbe00640 1 -- start start 2024-09-13T18:39:30.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7f415dee0 0x7ff7f413b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7f413c3c0 0x7ff7f4140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4151e60 con 0x7ff7f415e2c0 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f41ee9a0 con 0x7ff7f415dee0 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7fbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f41511e0 con 0x7ff7f413c3c0 2024-09-13T18:39:30.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7f8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7f8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40412/0 (socket says 172.21.15.192:40412) 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7f8a00640 1 -- 172.21.15.192:0/2986504705 learned_addr learned my addr 172.21.15.192:0/2986504705 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.151+0000 7ff7f9400640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7f415dee0 0x7ff7f413b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f9e00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7f413c3c0 0x7ff7f4140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 -- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7f413c3c0 msgr2=0x7ff7f4140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7f413c3c0 0x7ff7f4140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 -- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7f415dee0 msgr2=0x7ff7f413b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7f415dee0 0x7ff7f413b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009400 con 0x7ff7f415e2c0 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f8a00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c4a0 tx=0x7ff7e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e00074e0 con 0x7ff7f415e2c0 2024-09-13T18:39:30.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e0007640 con 0x7ff7f415e2c0 2024-09-13T18:39:30.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0004a00 con 0x7ff7f415e2c0 2024-09-13T18:39:30.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.152+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f41514c0 con 0x7ff7f415e2c0 2024-09-13T18:39:30.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.153+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f4151a80 con 0x7ff7f415e2c0 2024-09-13T18:39:30.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.153+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4151fa0 con 0x7ff7f415e2c0 2024-09-13T18:39:30.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.154+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff7e0004b60 con 0x7ff7f415e2c0 2024-09-13T18:39:30.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.155+0000 7ff7f1600640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 0x7ff7d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.155+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff7e0088450 con 0x7ff7f415e2c0 2024-09-13T18:39:30.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.155+0000 7ff7f9400640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 0x7ff7d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.155+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7ff7d40727f0 con 0x7ff7f415e2c0 2024-09-13T18:39:30.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.156+0000 7ff7f9400640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 0x7ff7d406d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8034000 tx=0x7ff7e802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.160+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff7e0018060 con 0x7ff7f415e2c0 2024-09-13T18:39:30.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.328+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7f415a440 con 0x7ff7f415e2c0 2024-09-13T18:39:30.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.329+0000 7ff7f1600640 1 -- 172.21.15.192:0/2986504705 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16772 (secure 0 0 0) 0x7ff7f4151fa0 con 0x7ff7f415e2c0 2024-09-13T18:39:30.332 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:30.332 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":76,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:32.849357+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":1}]},{"pgid":"9.1e","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 msgr2=0x7ff7d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 0x7ff7d406d0c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8034000 tx=0x7ff7e802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 msgr2=0x7ff7f41405e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff7e000c4a0 tx=0x7ff7e000c960 comp rx=0 tx=0).stop 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 shutdown_connections 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff7d406ac00 0x7ff7d406d0c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff7f413c3c0 0x7ff7f4140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff7f415e2c0 0x7ff7f41405e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 --2- 172.21.15.192:0/2986504705 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff7f415dee0 0x7ff7f413b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 >> 172.21.15.192:0/2986504705 conn(0x7ff7f40ae960 msgr2=0x7ff7f4071560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 shutdown_connections 2024-09-13T18:39:30.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.331+0000 7ff7fbe00640 1 -- 172.21.15.192:0/2986504705 wait complete. 2024-09-13T18:39:30.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:38:15.686427+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:38:16.717080+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:39:30.351 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:30.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.503+0000 7f1d00a00640 1 Processor -- start 2024-09-13T18:39:30.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.503+0000 7f1d00a00640 1 -- start start 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1cfc156e30 0x7f1cfc157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 0x7f1cfc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc15d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc157750 con 0x7f1cfc156e30 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0b3c90 con 0x7f1cfc161210 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1d00a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0ae210 con 0x7f1cfc0add80 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1cfc156e30 0x7f1cfc157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1cfc156e30 0x7f1cfc157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49940/0 (socket says 172.21.15.192:49940) 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 -- 172.21.15.192:0/3184358079 learned_addr learned my addr 172.21.15.192:0/3184358079 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:30.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfb200640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc15d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cf9e00640 1 --2- 172.21.15.192:0/3184358079 >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 0x7f1cfc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 -- 172.21.15.192:0/3184358079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 msgr2=0x7f1cfc15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc15d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 -- 172.21.15.192:0/3184358079 >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 msgr2=0x7f1cfc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 --2- 172.21.15.192:0/3184358079 >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 0x7f1cfc0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfa800640 1 -- 172.21.15.192:0/3184358079 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0b3110 con 0x7f1cfc156e30 2024-09-13T18:39:30.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cfb200640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.505+0000 7f1cf9e00640 1 --2- 172.21.15.192:0/3184358079 >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 0x7f1cfc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.506+0000 7f1cfa800640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc157210 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cd230 tx=0x7f1cec02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdb4bfb7545d2153 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1cf9400640 1 -- 172.21.15.192:0/3184358079 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec031600 con 0x7f1cfc156e30 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1cf9400640 1 -- 172.21.15.192:0/3184358079 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec02d050 con 0x7f1cfc156e30 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1cf9400640 1 -- 172.21.15.192:0/3184358079 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec031980 con 0x7f1cfc156e30 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 -- 172.21.15.192:0/3184358079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 msgr2=0x7f1cfc157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc157210 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0cd230 tx=0x7f1cec02a6a0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 -- 172.21.15.192:0/3184358079 shutdown_connections 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc15d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 --2- 172.21.15.192:0/3184358079 >> v2:172.21.15.194:3300/0 conn(0x7f1cfc161210 0x7f1cfc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 --2- 172.21.15.192:0/3184358079 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc157210 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 -- 172.21.15.192:0/3184358079 >> 172.21.15.192:0/3184358079 conn(0x7f1cfc0736d0 msgr2=0x7f1cfc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 -- 172.21.15.192:0/3184358079 shutdown_connections 2024-09-13T18:39:30.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.507+0000 7f1d00a00640 1 -- 172.21.15.192:0/3184358079 wait complete. 2024-09-13T18:39:30.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.509+0000 7f1d00a00640 1 Processor -- start 2024-09-13T18:39:30.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.509+0000 7f1d00a00640 1 -- start start 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc06e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 0x7f1cfc142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc143520 con 0x7f1cfc156e30 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc141230 con 0x7f1cfc161210 2024-09-13T18:39:30.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1d00a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc1425a0 con 0x7f1cfc0add80 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49956/0 (socket says 172.21.15.192:49956) 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1cf9e00640 1 -- 172.21.15.192:0/429256660 learned_addr learned my addr 172.21.15.192:0/429256660 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1cfa800640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc06e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.510+0000 7f1cfb200640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 0x7f1cfc142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 -- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 msgr2=0x7f1cfc06e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc06e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 -- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 msgr2=0x7f1cfc142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 0x7f1cfc142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec009b30 con 0x7f1cfc156e30 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cfb200640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 0x7f1cfc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:30.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf9e00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d800 tx=0x7f1ce800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004030 con 0x7f1cfc156e30 2024-09-13T18:39:30.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce8004190 con 0x7f1cfc156e30 2024-09-13T18:39:30.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc141c70 con 0x7f1cfc156e30 2024-09-13T18:39:30.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce8004520 con 0x7f1cfc156e30 2024-09-13T18:39:30.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.511+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc142230 con 0x7f1cfc156e30 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.512+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc0cb8e0 con 0x7f1cfc156e30 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.513+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ce80096a0 con 0x7f1cfc156e30 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.514+0000 7f1cf2a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 0x7f1cdc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.514+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1ce80894b0 con 0x7f1cfc156e30 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.514+0000 7f1cfa800640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 0x7f1cdc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.514+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f1cdc072820 con 0x7f1cfc156e30 2024-09-13T18:39:30.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.515+0000 7f1cfa800640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 0x7f1cdc06d0f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1cec033000 tx=0x7f1cec009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.518+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1ce80545b0 con 0x7f1cfc156e30 2024-09-13T18:39:30.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.684+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cfc0af150 con 0x7f1cfc156e30 2024-09-13T18:39:30.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.684+0000 7f1cf2a00640 1 -- 172.21.15.192:0/429256660 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ce8057bd0 con 0x7f1cfc156e30 2024-09-13T18:39:30.687 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 msgr2=0x7f1cdc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 0x7f1cdc06d0f0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1cec033000 tx=0x7f1cec009000 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 msgr2=0x7f1cfc142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f1ce800d800 tx=0x7f1ce800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 shutdown_connections 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cdc06ac30 0x7f1cdc06d0f0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1cfc161210 0x7f1cfc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cfc156e30 0x7f1cfc142a30 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 --2- 172.21.15.192:0/429256660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1cfc0add80 0x7f1cfc06e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 >> 172.21.15.192:0/429256660 conn(0x7f1cfc0736d0 msgr2=0x7f1cfc06a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 shutdown_connections 2024-09-13T18:39:30.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.687+0000 7f1d00a00640 1 -- 172.21.15.192:0/429256660 wait complete. 2024-09-13T18:39:30.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:30.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.857+0000 7f5c06400640 1 Processor -- start 2024-09-13T18:39:30.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.857+0000 7f5c06400640 1 -- start start 2024-09-13T18:39:30.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c06400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 0x7f5c000b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c06400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c000b41a0 0x7f5c000afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c06400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c000b31a0 con 0x7f5c00146460 2024-09-13T18:39:30.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c06400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000b3840 con 0x7f5c000b41a0 2024-09-13T18:39:30.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c06400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000b4610 con 0x7f5c00146840 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c000b41a0 0x7f5c000afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c000b41a0 0x7f5c000afbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49958/0 (socket says 172.21.15.192:49958) 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 -- 172.21.15.192:0/2145801887 learned_addr learned my addr 172.21.15.192:0/2145801887 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5bf7e00640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 0x7f5c000b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 -- 172.21.15.192:0/2145801887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 msgr2=0x7f5c000b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 0x7f5c000b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.859+0000 7f5c05a00640 1 -- 172.21.15.192:0/2145801887 >> v1:172.21.15.194:6789/0 conn(0x7f5c00146460 legacy=0x7f5c0015d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.860+0000 7f5c05a00640 1 -- 172.21.15.192:0/2145801887 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000b2b20 con 0x7f5c000b41a0 2024-09-13T18:39:30.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.860+0000 7f5bf7e00640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 0x7f5c000b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:30.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.860+0000 7f5c05a00640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c000b41a0 0x7f5c000afbe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e50 tx=0x7f5bf802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ebb8d2bdbae66d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5bffe00640 1 -- 172.21.15.192:0/2145801887 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf802aea0 con 0x7f5c000b41a0 2024-09-13T18:39:30.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5bffe00640 1 -- 172.21.15.192:0/2145801887 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf802d050 con 0x7f5c000b41a0 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5bffe00640 1 -- 172.21.15.192:0/2145801887 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8031820 con 0x7f5c000b41a0 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 -- 172.21.15.192:0/2145801887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c000b41a0 msgr2=0x7f5c000afbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c000b41a0 0x7f5c000afbe0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e50 tx=0x7f5bf802a680 comp rx=0 tx=0).stop 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 -- 172.21.15.192:0/2145801887 shutdown_connections 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c000b41a0 0x7f5c000afbe0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 --2- 172.21.15.192:0/2145801887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c00146840 0x7f5c000b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.861+0000 7f5c06400640 1 -- 172.21.15.192:0/2145801887 >> 172.21.15.192:0/2145801887 conn(0x7f5c000ae7f0 msgr2=0x7f5c0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.862+0000 7f5c06400640 1 -- 172.21.15.192:0/2145801887 shutdown_connections 2024-09-13T18:39:30.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.862+0000 7f5c06400640 1 -- 172.21.15.192:0/2145801887 wait complete. 2024-09-13T18:39:30.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.863+0000 7f5c06400640 1 Processor -- start 2024-09-13T18:39:30.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.863+0000 7f5c06400640 1 -- start start 2024-09-13T18:39:30.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c000b41a0 0x7f5c0015c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c00146460 0x7f5c0013d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00141860 con 0x7f5c00146840 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c00141b40 con 0x7f5c00146460 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c06400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0013e9b0 con 0x7f5c000b41a0 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.864+0000 7f5c05a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49962/0 (socket says 172.21.15.192:49962) 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 -- 172.21.15.192:0/1658948303 learned_addr learned my addr 172.21.15.192:0/1658948303 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05000640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c000b41a0 0x7f5c0015c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5bf7e00640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c00146460 0x7f5c0013d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 -- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c000b41a0 msgr2=0x7f5c0015c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c000b41a0 0x7f5c0015c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 -- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c00146460 msgr2=0x7f5c0013d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:30.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c00146460 0x7f5c0013d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:30.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf8009b30 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.865+0000 7f5c05a00640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e50 tx=0x7f5bf8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.866+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf803d860 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.866+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf803d9e0 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.866+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf803dd90 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.866+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0015dc30 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.866+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0015c9d0 con 0x7f5c00146840 2024-09-13T18:39:30.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.867+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0015cb60 con 0x7f5c00146840 2024-09-13T18:39:30.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.868+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5bf803b400 con 0x7f5c00146840 2024-09-13T18:39:30.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.868+0000 7f5bfd600640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 0x7f5bdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:30.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.869+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5bf80aa0e0 con 0x7f5c00146840 2024-09-13T18:39:30.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.869+0000 7f5c05000640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 0x7f5bdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:30.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.869+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f5bdc0727f0 con 0x7f5c00146840 2024-09-13T18:39:30.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.869+0000 7f5c05000640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 0x7f5bdc06d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0000f60 tx=0x7f5bf0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:30.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:30.873+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5c0015cb60 con 0x7f5c00146840 2024-09-13T18:39:31.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.043+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5c0015cb60 con 0x7f5c00146840 2024-09-13T18:39:31.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.044+0000 7f5bfd600640 1 -- 172.21.15.192:0/1658948303 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bf8036020 con 0x7f5c00146840 2024-09-13T18:39:31.046 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 msgr2=0x7f5bdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 0x7f5bdc06d0c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0000f60 tx=0x7f5bf0009040 comp rx=0 tx=0).stop 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 msgr2=0x7f5c0015fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8009e50 tx=0x7f5bf8004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 shutdown_connections 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5bdc06ac00 0x7f5bdc06d0c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c00146840 0x7f5c0015fb20 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c00146460 0x7f5c0013d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 --2- 172.21.15.192:0/1658948303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c000b41a0 0x7f5c0015c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 >> 172.21.15.192:0/1658948303 conn(0x7f5c000ae7f0 msgr2=0x7f5c00069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 shutdown_connections 2024-09-13T18:39:31.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.046+0000 7f5c06400640 1 -- 172.21.15.192:0/1658948303 wait complete. 2024-09-13T18:39:31.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:31.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.215+0000 7f81c3a00640 1 Processor -- start 2024-09-13T18:39:31.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.215+0000 7f81c3a00640 1 -- start start 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.216+0000 7f81c3a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81bc144150 0x7f81bc164ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.216+0000 7f81c3a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81bc0b2000 con 0x7f81bc165420 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c3a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81bc0ce900 con 0x7f81bc0cdd40 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c3a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81bc165e40 con 0x7f81bc144150 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f81bc144150 0x7f81bc164ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81bbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f81bc165420 0x7f81bc0cd630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51102/0 (socket says 172.21.15.192:51102) 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81bbe00640 1 -- 172.21.15.192:0/727988479 learned_addr learned my addr 172.21.15.192:0/727988479 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:31.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c1000640 1 -- 172.21.15.192:0/727988479 >> v1:172.21.15.194:6789/0 conn(0x7f81bc0cdd40 legacy=0x7f81bc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c1000640 1 -- 172.21.15.192:0/727988479 >> v1:172.21.15.192:6789/0 conn(0x7f81bc165420 legacy=0x7f81bc0cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81c1000640 1 -- 172.21.15.192:0/727988479 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81bc0ce340 con 0x7f81bc144150 2024-09-13T18:39:31.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.217+0000 7f81bb400640 1 -- 172.21.15.192:0/727988479 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1406695800 0 0) 0x7f81bc0b2000 con 0x7f81bc165420 2024-09-13T18:39:31.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.218+0000 7f81c1000640 1 --2- 172.21.15.192:0/727988479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc164ee0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f81b00097a0 tx=0x7f81b002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c61f49ad484161 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.218+0000 7f81bb400640 1 -- 172.21.15.192:0/727988479 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0032440 con 0x7f81bc144150 2024-09-13T18:39:31.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.218+0000 7f81bb400640 1 -- 172.21.15.192:0/727988479 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b00325a0 con 0x7f81bc144150 2024-09-13T18:39:31.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81bb400640 1 -- 172.21.15.192:0/727988479 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0032930 con 0x7f81bc144150 2024-09-13T18:39:31.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 -- 172.21.15.192:0/727988479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 msgr2=0x7f81bc164ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 --2- 172.21.15.192:0/727988479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc164ee0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f81b00097a0 tx=0x7f81b002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 -- 172.21.15.192:0/727988479 shutdown_connections 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 --2- 172.21.15.192:0/727988479 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc164ee0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 -- 172.21.15.192:0/727988479 >> 172.21.15.192:0/727988479 conn(0x7f81bc0b08f0 msgr2=0x7f81bc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 -- 172.21.15.192:0/727988479 shutdown_connections 2024-09-13T18:39:31.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.219+0000 7f81c3a00640 1 -- 172.21.15.192:0/727988479 wait complete. 2024-09-13T18:39:31.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.221+0000 7f81c3a00640 1 Processor -- start 2024-09-13T18:39:31.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.221+0000 7f81c3a00640 1 -- start start 2024-09-13T18:39:31.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81bc0cdd40 0x7f81bc1f7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81bc165420 0x7f81bc159f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc1f7fb0 con 0x7f81bc144150 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc15c0c0 con 0x7f81bc165420 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81bc15c3a0 con 0x7f81bc0cdd40 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49978/0 (socket says 172.21.15.192:49978) 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81bbe00640 1 -- 172.21.15.192:0/2028293727 learned_addr learned my addr 172.21.15.192:0/2028293727 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c1000640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81bc0cdd40 0x7f81bc1f7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.222+0000 7f81c1a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81bc165420 0x7f81bc159f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 -- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81bc0cdd40 msgr2=0x7f81bc1f7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81bc0cdd40 0x7f81bc1f7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 -- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81bc165420 msgr2=0x7f81bc159f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81bc165420 0x7f81bc159f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b0009400 con 0x7f81bc144150 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81bbe00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81a800c430 tx=0x7f81a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a80074e0 con 0x7f81bc144150 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a8007660 con 0x7f81bc144150 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a8004a20 con 0x7f81bc144150 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81bc15c680 con 0x7f81bc144150 2024-09-13T18:39:31.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.223+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81bc0cc2c0 con 0x7f81bc144150 2024-09-13T18:39:31.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.224+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81bc067490 con 0x7f81bc144150 2024-09-13T18:39:31.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.225+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f81a8004b80 con 0x7f81bc144150 2024-09-13T18:39:31.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.226+0000 7f81b8c00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 0x7f819c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.227+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f81a80890f0 con 0x7f81bc144150 2024-09-13T18:39:31.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.227+0000 7f81c1000640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 0x7f819c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.227+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f819c0727f0 con 0x7f81bc144150 2024-09-13T18:39:31.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.227+0000 7f81c1000640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 0x7f819c06d0c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034000 tx=0x7f81b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.231+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f81a80542a0 con 0x7f81bc144150 2024-09-13T18:39:31.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.398+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81bc157f60 con 0x7f81bc144150 2024-09-13T18:39:31.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.399+0000 7f81b8c00640 1 -- 172.21.15.192:0/2028293727 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81a80578c0 con 0x7f81bc144150 2024-09-13T18:39:31.402 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 msgr2=0x7f819c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 0x7f819c06d0c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f81b0034000 tx=0x7f81b002e000 comp rx=0 tx=0).stop 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 msgr2=0x7f81bc15ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f81a800c430 tx=0x7f81a800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 shutdown_connections 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f819c06ac00 0x7f819c06d0c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f81bc165420 0x7f81bc159f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f81bc144150 0x7f81bc15ec70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 --2- 172.21.15.192:0/2028293727 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f81bc0cdd40 0x7f81bc1f7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 >> 172.21.15.192:0/2028293727 conn(0x7f81bc0b08f0 msgr2=0x7f81bc157850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 shutdown_connections 2024-09-13T18:39:31.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.401+0000 7f81c3a00640 1 -- 172.21.15.192:0/2028293727 wait complete. 2024-09-13T18:39:31.420 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:39:31.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.569+0000 7f280b200640 1 Processor -- start 2024-09-13T18:39:31.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.569+0000 7f280b200640 1 -- start start 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f280b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f280c1598d0 0x7f280c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f280b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c06bf10 con 0x7f280c0cd5b0 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f280b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0b2e10 con 0x7f280c06b890 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f280b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c06bd20 con 0x7f280c1598d0 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f2809e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f280c1598d0 0x7f280c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f2803e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f280c0cd5b0 0x7f280c06b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51104/0 (socket says 172.21.15.192:51104) 2024-09-13T18:39:31.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.570+0000 7f2803e00640 1 -- 172.21.15.192:0/3354681251 learned_addr learned my addr 172.21.15.192:0/3354681251 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.571+0000 7f2809e00640 1 -- 172.21.15.192:0/3354681251 >> v1:172.21.15.194:6789/0 conn(0x7f280c06b890 legacy=0x7f280c15b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:31.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.571+0000 7f2809e00640 1 -- 172.21.15.192:0/3354681251 >> v1:172.21.15.192:6789/0 conn(0x7f280c0cd5b0 legacy=0x7f280c06b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.571+0000 7f2809e00640 1 -- 172.21.15.192:0/3354681251 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0b30f0 con 0x7f280c1598d0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f2809e00640 1 --2- 172.21.15.192:0/3354681251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c1598d0 0x7f280c0b3bd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887ea9984568257d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f2809400640 1 -- 172.21.15.192:0/3354681251 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc034640 con 0x7f280c1598d0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f2809400640 1 -- 172.21.15.192:0/3354681251 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc0347a0 con 0x7f280c1598d0 2024-09-13T18:39:31.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f2809400640 1 -- 172.21.15.192:0/3354681251 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc034b30 con 0x7f280c1598d0 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f280b200640 1 -- 172.21.15.192:0/3354681251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c1598d0 msgr2=0x7f280c0b3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.572+0000 7f280b200640 1 --2- 172.21.15.192:0/3354681251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c1598d0 0x7f280c0b3bd0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0097a0 tx=0x7f27fc02c3f0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.573+0000 7f280b200640 1 -- 172.21.15.192:0/3354681251 shutdown_connections 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.573+0000 7f280b200640 1 --2- 172.21.15.192:0/3354681251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c1598d0 0x7f280c0b3bd0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.573+0000 7f280b200640 1 -- 172.21.15.192:0/3354681251 >> 172.21.15.192:0/3354681251 conn(0x7f280c0736d0 msgr2=0x7f280c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.573+0000 7f280b200640 1 -- 172.21.15.192:0/3354681251 shutdown_connections 2024-09-13T18:39:31.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.573+0000 7f280b200640 1 -- 172.21.15.192:0/3354681251 wait complete. 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.574+0000 7f280b200640 1 Processor -- start 2024-09-13T18:39:31.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.574+0000 7f280b200640 1 -- start start 2024-09-13T18:39:31.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 0x7f280c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f280c1598d0 0x7f280c141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15b0c0 con 0x7f280c06b890 2024-09-13T18:39:31.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c150bc0 con 0x7f280c1598d0 2024-09-13T18:39:31.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.575+0000 7f280b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c15b310 con 0x7f280c0cd5b0 2024-09-13T18:39:31.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50006/0 (socket says 172.21.15.192:50006) 2024-09-13T18:39:31.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 -- 172.21.15.192:0/2698691526 learned_addr learned my addr 172.21.15.192:0/2698691526 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:31.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f280a800640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f280c1598d0 0x7f280c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2803e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 0x7f280c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 -- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 msgr2=0x7f280c158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 0x7f280c158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 -- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f280c1598d0 msgr2=0x7f280c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f280c1598d0 0x7f280c141020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2809e00640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009400 con 0x7f280c06b890 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.576+0000 7f2803e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 0x7f280c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:31.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f2809e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc032b80 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc032ce0 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc03e640 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c15b5f0 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.577+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c15bbb0 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.578+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c0b3bd0 con 0x7f280c06b890 2024-09-13T18:39:31.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.579+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f27fc03e7a0 con 0x7f280c06b890 2024-09-13T18:39:31.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.580+0000 7f2802000640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 0x7f27e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:31.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.580+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f27fc0aa400 con 0x7f280c06b890 2024-09-13T18:39:31.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.580+0000 7f2803e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 0x7f27e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:31.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.580+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f27e80727f0 con 0x7f280c06b890 2024-09-13T18:39:31.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.581+0000 7f2803e00640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 0x7f27e806d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f280c15e290 tx=0x7f27f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:31.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.584+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27fc0755a0 con 0x7f280c06b890 2024-09-13T18:39:31.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.763+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f280c0b3bd0 con 0x7f280c06b890 2024-09-13T18:39:31.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.763+0000 7f2802000640 1 -- 172.21.15.192:0/2698691526 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27fc039030 con 0x7f280c06b890 2024-09-13T18:39:31.766 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.765+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 msgr2=0x7f27e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.765+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 0x7f27e806d0c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f280c15e290 tx=0x7f27f4009040 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 msgr2=0x7f280c0703e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f27fc000c00 tx=0x7f27fc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 shutdown_connections 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27e806ac00 0x7f27e806d0c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f280c1598d0 0x7f280c141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f280c0cd5b0 0x7f280c158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 --2- 172.21.15.192:0/2698691526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f280c06b890 0x7f280c0703e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 >> 172.21.15.192:0/2698691526 conn(0x7f280c0736d0 msgr2=0x7f280c0afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 shutdown_connections 2024-09-13T18:39:31.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:31.766+0000 7f280b200640 1 -- 172.21.15.192:0/2698691526 wait complete. 2024-09-13T18:39:31.784 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:39:31.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:31.784 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:39:31.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:39:31.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:31.847 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:39:31.883 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:39:31.883 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:31.923 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:39:31.923 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:32.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:32.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.152+0000 7f466ea00640 1 Processor -- start 2024-09-13T18:39:32.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.153+0000 7f466ea00640 1 -- start start 2024-09-13T18:39:32.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 0x7f46680b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466ea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466815af60 con 0x7f466806bc30 2024-09-13T18:39:32.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f466815aaa0 con 0x7f466815a5f0 2024-09-13T18:39:32.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466806b7a0 con 0x7f4668159b00 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466e000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 0x7f46680b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:56596/0 (socket says 172.21.15.192:56596) 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.154+0000 7f466d600640 1 -- 172.21.15.192:0/1665714545 learned_addr learned my addr 172.21.15.192:0/1665714545 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.155+0000 7f466d600640 1 -- 172.21.15.192:0/1665714545 >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 msgr2=0x7f46680b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.155+0000 7f466d600640 1 --2- 172.21.15.192:0/1665714545 >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 0x7f46680b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.155+0000 7f466d600640 1 -- 172.21.15.192:0/1665714545 >> v1:172.21.15.194:6789/0 conn(0x7f466806bc30 legacy=0x7f4668159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.155+0000 7f466d600640 1 -- 172.21.15.192:0/1665714545 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466815ac80 con 0x7f4668159b00 2024-09-13T18:39:32.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.155+0000 7f466e000640 1 --2- 172.21.15.192:0/1665714545 >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 0x7f46680b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:32.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.156+0000 7f466d600640 1 --2- 172.21.15.192:0/1665714545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f465c009870 tx=0x7f465c02a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=142d351ef7408e4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.156+0000 7f4667e00640 1 -- 172.21.15.192:0/1665714545 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c032440 con 0x7f4668159b00 2024-09-13T18:39:32.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.156+0000 7f4667e00640 1 -- 172.21.15.192:0/1665714545 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c0325a0 con 0x7f4668159b00 2024-09-13T18:39:32.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.156+0000 7f4667e00640 1 -- 172.21.15.192:0/1665714545 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c032930 con 0x7f4668159b00 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 -- 172.21.15.192:0/1665714545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 msgr2=0x7f46680b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 --2- 172.21.15.192:0/1665714545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f465c009870 tx=0x7f465c02a250 comp rx=0 tx=0).stop 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 -- 172.21.15.192:0/1665714545 shutdown_connections 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 --2- 172.21.15.192:0/1665714545 >> v2:172.21.15.194:3300/0 conn(0x7f466815a5f0 0x7f46680b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 --2- 172.21.15.192:0/1665714545 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f46680b2d70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 -- 172.21.15.192:0/1665714545 >> 172.21.15.192:0/1665714545 conn(0x7f46680736d0 msgr2=0x7f46680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 -- 172.21.15.192:0/1665714545 shutdown_connections 2024-09-13T18:39:32.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.157+0000 7f466ea00640 1 -- 172.21.15.192:0/1665714545 wait complete. 2024-09-13T18:39:32.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.158+0000 7f466ea00640 1 Processor -- start 2024-09-13T18:39:32.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 -- start start 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f4668070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f466815a5f0 0x7f46681549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466806fe90 con 0x7f466806bc30 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466806f580 con 0x7f466815a5f0 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.159+0000 7f466ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466814c960 con 0x7f4668159b00 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50020/0 (socket says 172.21.15.192:50020) 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 -- 172.21.15.192:0/2417204039 learned_addr learned my addr 172.21.15.192:0/2417204039 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466cc00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f4668070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466e000640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f466815a5f0 0x7f46681549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 -- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 msgr2=0x7f4668070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f4668070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 -- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f466815a5f0 msgr2=0x7f46681549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f466815a5f0 0x7f46681549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009a70 con 0x7f466806bc30 2024-09-13T18:39:32.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.160+0000 7f466d600640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f465c02a290 tx=0x7f465c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.161+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c032440 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.161+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465c030980 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.161+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465c030d50 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.161+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f465c0094d0 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.161+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f466806f7d0 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.162+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466806ffd0 con 0x7f466806bc30 2024-09-13T18:39:32.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.163+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f465c039040 con 0x7f466806bc30 2024-09-13T18:39:32.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.163+0000 7f4665600640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 0x7f464806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.164+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f465c0a9bd0 con 0x7f466806bc30 2024-09-13T18:39:32.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.164+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f46480727f0 con 0x7f466806bc30 2024-09-13T18:39:32.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.164+0000 7f466cc00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 0x7f464806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.164+0000 7f466cc00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 0x7f464806d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46681e5ad0 tx=0x7f4654009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.168+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f466806ffd0 con 0x7f466806bc30 2024-09-13T18:39:32.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.335+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f466806ffd0 con 0x7f466806bc30 2024-09-13T18:39:32.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.337+0000 7f4665600640 1 -- 172.21.15.192:0/2417204039 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16772 (secure 0 0 0) 0x7f465c037090 con 0x7f466806bc30 2024-09-13T18:39:32.340 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:32.340 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":76,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:32.849357+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":1}]},{"pgid":"9.1e","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 msgr2=0x7f464806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 0x7f464806d0c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46681e5ad0 tx=0x7f4654009040 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 msgr2=0x7f466814c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f465c02a290 tx=0x7f465c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 shutdown_connections 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f464806ac00 0x7f464806d0c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f466815a5f0 0x7f46681549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4668159b00 0x7f4668070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 --2- 172.21.15.192:0/2417204039 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f466806bc30 0x7f466814c420 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 >> 172.21.15.192:0/2417204039 conn(0x7f46680736d0 msgr2=0x7f46680b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 shutdown_connections 2024-09-13T18:39:32.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.339+0000 7f466ea00640 1 -- 172.21.15.192:0/2417204039 wait complete. 2024-09-13T18:39:32.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:38:15.686427+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:38:16.717080+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:39:32.358 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:32.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.510+0000 7f2171800640 1 Processor -- start 2024-09-13T18:39:32.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.510+0000 7f2171800640 1 -- start start 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2171800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c0b3af0 0x7f216c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2171800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f216c06c0b0 0x7f216c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2171800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f216c0b2000 con 0x7f216c1589f0 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2171800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f216c06ca80 con 0x7f216c06c0b0 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2171800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c0b2ba0 con 0x7f216c0b3af0 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f216c06c0b0 0x7f216c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f216c06c0b0 0x7f216c06c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50026/0 (socket says 172.21.15.192:50026) 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 -- 172.21.15.192:0/2450599416 learned_addr learned my addr 172.21.15.192:0/2450599416 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f2162000640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c0b3af0 0x7f216c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 -- 172.21.15.192:0/2450599416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c0b3af0 msgr2=0x7f216c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c0b3af0 0x7f216c15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.512+0000 7f216b400640 1 -- 172.21.15.192:0/2450599416 >> v1:172.21.15.194:6789/0 conn(0x7f216c1589f0 legacy=0x7f216c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.513+0000 7f216b400640 1 -- 172.21.15.192:0/2450599416 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f216c15bbd0 con 0x7f216c06c0b0 2024-09-13T18:39:32.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.513+0000 7f216b400640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c06c0b0 0x7f216c06c540 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e50 tx=0x7f216402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c719bb39b841e7d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f216a000640 1 -- 172.21.15.192:0/2450599416 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164031600 con 0x7f216c06c0b0 2024-09-13T18:39:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f216a000640 1 -- 172.21.15.192:0/2450599416 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216402d050 con 0x7f216c06c0b0 2024-09-13T18:39:32.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f216a000640 1 -- 172.21.15.192:0/2450599416 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2164031980 con 0x7f216c06c0b0 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 -- 172.21.15.192:0/2450599416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c06c0b0 msgr2=0x7f216c06c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c06c0b0 0x7f216c06c540 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f2164009e50 tx=0x7f216402a710 comp rx=0 tx=0).stop 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 -- 172.21.15.192:0/2450599416 shutdown_connections 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c06c0b0 0x7f216c06c540 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 --2- 172.21.15.192:0/2450599416 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c0b3af0 0x7f216c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 -- 172.21.15.192:0/2450599416 >> 172.21.15.192:0/2450599416 conn(0x7f216c0b08f0 msgr2=0x7f216c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 -- 172.21.15.192:0/2450599416 shutdown_connections 2024-09-13T18:39:32.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.514+0000 7f2171800640 1 -- 172.21.15.192:0/2450599416 wait complete. 2024-09-13T18:39:32.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.516+0000 7f2171800640 1 Processor -- start 2024-09-13T18:39:32.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.516+0000 7f2171800640 1 -- start start 2024-09-13T18:39:32.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c06c0b0 0x7f216c14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 0x7f216c1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c150240 con 0x7f216c0b3af0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216c155a40 con 0x7f216c06c0b0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2171800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216c1562a0 con 0x7f216c1589f0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2162000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2162000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50042/0 (socket says 172.21.15.192:50042) 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f2162000640 1 -- 172.21.15.192:0/3740029710 learned_addr learned my addr 172.21.15.192:0/3740029710 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f216aa00640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c06c0b0 0x7f216c14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.517+0000 7f216b400640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 0x7f216c1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 -- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 msgr2=0x7f216c1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 0x7f216c1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 -- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c06c0b0 msgr2=0x7f216c14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c06c0b0 0x7f216c14f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2164009b30 con 0x7f216c0b3af0 2024-09-13T18:39:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f216b400640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 0x7f216c1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:32.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2162000640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f215400e8e0 tx=0x7f215400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400c940 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215400caa0 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215400ce50 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f216c14ff60 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.518+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f216c155f30 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.520+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f216c06c540 con 0x7f216c0b3af0 2024-09-13T18:39:32.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.520+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2154013470 con 0x7f216c0b3af0 2024-09-13T18:39:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.521+0000 7f2163400640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 0x7f214806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.521+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2154089630 con 0x7f216c0b3af0 2024-09-13T18:39:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.521+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f2148072820 con 0x7f216c0b3af0 2024-09-13T18:39:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.521+0000 7f216aa00640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 0x7f214806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.522+0000 7f216aa00640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 0x7f214806d0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f215c000f60 tx=0x7f215c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.525+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21540547e0 con 0x7f216c0b3af0 2024-09-13T18:39:32.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.693+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f216c1563e0 con 0x7f216c0b3af0 2024-09-13T18:39:32.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.693+0000 7f2163400640 1 -- 172.21.15.192:0/3740029710 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21540210a0 con 0x7f216c0b3af0 2024-09-13T18:39:32.696 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:39:32.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.695+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 msgr2=0x7f214806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.695+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 0x7f214806d0f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f215c000f60 tx=0x7f215c009040 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.695+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 msgr2=0x7f216c14e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f215400e8e0 tx=0x7f215400eda0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 shutdown_connections 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f214806ac30 0x7f214806d0f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f216c1589f0 0x7f216c1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f216c0b3af0 0x7f216c14e7c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 --2- 172.21.15.192:0/3740029710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f216c06c0b0 0x7f216c14f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 >> 172.21.15.192:0/3740029710 conn(0x7f216c0b08f0 msgr2=0x7f216c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 shutdown_connections 2024-09-13T18:39:32.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.696+0000 7f2171800640 1 -- 172.21.15.192:0/3740029710 wait complete. 2024-09-13T18:39:32.714 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:32.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.923+0000 7f8d27000640 1 Processor -- start 2024-09-13T18:39:32.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.924+0000 7f8d27000640 1 -- start start 2024-09-13T18:39:32.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.925+0000 7f8d27000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d1f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d27000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d20152070 con 0x7f8d20151c90 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d27000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d200b55a0 con 0x7f8d200b44f0 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d27000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2006c1e0 con 0x7f8d200712b0 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d1f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:56636/0 (socket says 172.21.15.192:56636) 2024-09-13T18:39:32.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.926+0000 7f8d1f400640 1 -- 172.21.15.192:0/2902263273 learned_addr learned my addr 172.21.15.192:0/2902263273 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.927+0000 7f8d1f400640 1 -- 172.21.15.192:0/2902263273 >> v1:172.21.15.194:6789/0 conn(0x7f8d200b44f0 legacy=0x7f8d2006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.927+0000 7f8d1ea00640 1 -- 172.21.15.192:0/2902263273 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3775369906 0 0) 0x7f8d200b55a0 con 0x7f8d200b44f0 2024-09-13T18:39:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.927+0000 7f8d1f400640 1 -- 172.21.15.192:0/2902263273 >> v1:172.21.15.192:6789/0 conn(0x7f8d20151c90 legacy=0x7f8d20070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.927+0000 7f8d1f400640 1 -- 172.21.15.192:0/2902263273 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d200b4d00 con 0x7f8d200712b0 2024-09-13T18:39:32.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.930+0000 7f8d1f400640 1 --2- 172.21.15.192:0/2902263273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0098a0 tx=0x7f8d0c02a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e29e97c3298461f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.930+0000 7f8d1ea00640 1 -- 172.21.15.192:0/2902263273 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c02add0 con 0x7f8d200712b0 2024-09-13T18:39:32.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.930+0000 7f8d1ea00640 1 -- 172.21.15.192:0/2902263273 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c032440 con 0x7f8d200712b0 2024-09-13T18:39:32.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.930+0000 7f8d1ea00640 1 -- 172.21.15.192:0/2902263273 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c0327d0 con 0x7f8d200712b0 2024-09-13T18:39:32.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.931+0000 7f8d27000640 1 -- 172.21.15.192:0/2902263273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 msgr2=0x7f8d200b3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.931+0000 7f8d27000640 1 --2- 172.21.15.192:0/2902263273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0098a0 tx=0x7f8d0c02a140 comp rx=0 tx=0).stop 2024-09-13T18:39:32.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.931+0000 7f8d27000640 1 -- 172.21.15.192:0/2902263273 shutdown_connections 2024-09-13T18:39:32.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.931+0000 7f8d27000640 1 --2- 172.21.15.192:0/2902263273 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d200712b0 0x7f8d200b3fb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.931+0000 7f8d27000640 1 -- 172.21.15.192:0/2902263273 >> 172.21.15.192:0/2902263273 conn(0x7f8d200b2af0 msgr2=0x7f8d200b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:32.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.932+0000 7f8d27000640 1 -- 172.21.15.192:0/2902263273 shutdown_connections 2024-09-13T18:39:32.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.932+0000 7f8d27000640 1 -- 172.21.15.192:0/2902263273 wait complete. 2024-09-13T18:39:32.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.934+0000 7f8d27000640 1 Processor -- start 2024-09-13T18:39:32.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.935+0000 7f8d27000640 1 -- start start 2024-09-13T18:39:32.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 0x7f8d20145e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 0x7f8d20146340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d201525c0 con 0x7f8d200b44f0 2024-09-13T18:39:32.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d201528a0 con 0x7f8d200712b0 2024-09-13T18:39:32.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.936+0000 7f8d27000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d20152b80 con 0x7f8d20151c90 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d25000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d1fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 0x7f8d20145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d25000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:56648/0 (socket says 172.21.15.192:56648) 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d1fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 0x7f8d20145e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41248/0 (socket says 172.21.15.192:41248) 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d25000640 1 -- 172.21.15.192:0/4249367707 learned_addr learned my addr 172.21.15.192:0/4249367707 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.937+0000 7f8d1f400640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 0x7f8d20146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 -- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 msgr2=0x7f8d20145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 0x7f8d20145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 -- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 msgr2=0x7f8d20146340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:32.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 0x7f8d20146340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:32.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c0094d0 con 0x7f8d20151c90 2024-09-13T18:39:32.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d1f400640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 0x7f8d20146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.938+0000 7f8d25000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c840 tx=0x7f8d1800cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.939+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18003da0 con 0x7f8d20151c90 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.939+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d18005070 con 0x7f8d20151c90 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.939+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d18005400 con 0x7f8d20151c90 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.939+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d20146bc0 con 0x7f8d20151c90 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.939+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d20152e60 con 0x7f8d20151c90 2024-09-13T18:39:32.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.941+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d200b3fb0 con 0x7f8d20151c90 2024-09-13T18:39:32.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.942+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8d18005560 con 0x7f8d20151c90 2024-09-13T18:39:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.942+0000 7f8d17e00640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 0x7f8d0006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:32.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.943+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8d18089260 con 0x7f8d20151c90 2024-09-13T18:39:32.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.943+0000 7f8d1fe00640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 0x7f8d0006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:32.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.943+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f8d00072840 con 0x7f8d20151c90 2024-09-13T18:39:32.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.943+0000 7f8d1fe00640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 0x7f8d0006d110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000f60 tx=0x7f8d10009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:32.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:32.948+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8d180543e0 con 0x7f8d20151c90 2024-09-13T18:39:33.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.117+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d200b25b0 con 0x7f8d20151c90 2024-09-13T18:39:33.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.118+0000 7f8d17e00640 1 -- 172.21.15.192:0/4249367707 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8d18005810 con 0x7f8d20151c90 2024-09-13T18:39:33.120 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 msgr2=0x7f8d0006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 0x7f8d0006d110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8d10000f60 tx=0x7f8d10009040 comp rx=0 tx=0).stop 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 msgr2=0x7f8d2006a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800c840 tx=0x7f8d1800cd00 comp rx=0 tx=0).stop 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 shutdown_connections 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8d0006ac50 0x7f8d0006d110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8d20151c90 0x7f8d2006a2f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8d200b44f0 0x7f8d20146340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 --2- 172.21.15.192:0/4249367707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8d200712b0 0x7f8d20145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 >> 172.21.15.192:0/4249367707 conn(0x7f8d200b2af0 msgr2=0x7f8d200d16a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 shutdown_connections 2024-09-13T18:39:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.120+0000 7f8d27000640 1 -- 172.21.15.192:0/4249367707 wait complete. 2024-09-13T18:39:33.138 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:33.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.290+0000 7f91aa600640 1 Processor -- start 2024-09-13T18:39:33.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.291+0000 7f91aa600640 1 -- start start 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91aa600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 0x7f91a40b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91aa600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 0x7f91a406fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91aa600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a406f940 con 0x7f91a40b2d90 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91aa600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a406f610 con 0x7f91a40b02f0 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91aa600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a40b3530 con 0x7f91a4142e00 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91a9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 0x7f91a406fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91a9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 0x7f91a40b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91a9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 0x7f91a406fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41258/0 (socket says 172.21.15.192:41258) 2024-09-13T18:39:33.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.292+0000 7f91a9c00640 1 -- 172.21.15.192:0/4212762805 learned_addr learned my addr 172.21.15.192:0/4212762805 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.293+0000 7f91a9200640 1 -- 172.21.15.192:0/4212762805 >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 msgr2=0x7f91a406fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.293+0000 7f91a9200640 1 --2- 172.21.15.192:0/4212762805 >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 0x7f91a406fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.293+0000 7f91a9200640 1 -- 172.21.15.192:0/4212762805 >> v1:172.21.15.194:6789/0 conn(0x7f91a40b2d90 legacy=0x7f91a40afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.293+0000 7f91a9200640 1 -- 172.21.15.192:0/4212762805 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40b3810 con 0x7f91a4142e00 2024-09-13T18:39:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.294+0000 7f91a9200640 1 --2- 172.21.15.192:0/4212762805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 0x7f91a40b4910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13d43260511e4763 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.294+0000 7f91a3e00640 1 -- 172.21.15.192:0/4212762805 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194032440 con 0x7f91a4142e00 2024-09-13T18:39:33.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.294+0000 7f91a3e00640 1 -- 172.21.15.192:0/4212762805 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91940325a0 con 0x7f91a4142e00 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.294+0000 7f91a3e00640 1 -- 172.21.15.192:0/4212762805 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194032930 con 0x7f91a4142e00 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 -- 172.21.15.192:0/4212762805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 msgr2=0x7f91a40b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 --2- 172.21.15.192:0/4212762805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 0x7f91a40b4910 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f91940097a0 tx=0x7f919402a180 comp rx=0 tx=0).stop 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 -- 172.21.15.192:0/4212762805 shutdown_connections 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 --2- 172.21.15.192:0/4212762805 >> v2:172.21.15.194:3300/0 conn(0x7f91a40b02f0 0x7f91a406fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 --2- 172.21.15.192:0/4212762805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a4142e00 0x7f91a40b4910 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 -- 172.21.15.192:0/4212762805 >> 172.21.15.192:0/4212762805 conn(0x7f91a40ae7f0 msgr2=0x7f91a406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 -- 172.21.15.192:0/4212762805 shutdown_connections 2024-09-13T18:39:33.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.295+0000 7f91aa600640 1 -- 172.21.15.192:0/4212762805 wait complete. 2024-09-13T18:39:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.296+0000 7f91aa600640 1 Processor -- start 2024-09-13T18:39:33.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 -- start start 2024-09-13T18:39:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a40b2d90 0x7f91a41594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a412beb0 con 0x7f91a4142e00 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4159a10 con 0x7f91a40b2d90 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.297+0000 7f91aa600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a412b230 con 0x7f91a40b02f0 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50058/0 (socket says 172.21.15.192:50058) 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9c00640 1 -- 172.21.15.192:0/2870028082 learned_addr learned my addr 172.21.15.192:0/2870028082 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f919be00640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a40b2d90 0x7f91a41594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:56678/0 (socket says 172.21.15.192:56678) 2024-09-13T18:39:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 -- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a40b2d90 msgr2=0x7f91a41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a40b2d90 0x7f91a41594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 -- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 msgr2=0x7f91a40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9194009400 con 0x7f91a40b02f0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9c00640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.298+0000 7f91a9200640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f91a40b3670 tx=0x7f91940046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.299+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194006e10 con 0x7f91a40b02f0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.299+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a4143360 con 0x7f91a40b02f0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.299+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9194030980 con 0x7f91a40b02f0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.299+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194030d10 con 0x7f91a40b02f0 2024-09-13T18:39:33.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.299+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a412b7f0 con 0x7f91a40b02f0 2024-09-13T18:39:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.300+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a404e2d0 con 0x7f91a40b02f0 2024-09-13T18:39:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.301+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9194039040 con 0x7f91a40b02f0 2024-09-13T18:39:33.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.302+0000 7f91a1600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 0x7f918006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.302+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f91940a9b90 con 0x7f91a40b02f0 2024-09-13T18:39:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.302+0000 7f919be00640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 0x7f918006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.302+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f91800727f0 con 0x7f91a40b02f0 2024-09-13T18:39:33.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.303+0000 7f919be00640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 0x7f918006d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ccd70 tx=0x7f918c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.306+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9194074df0 con 0x7f91a40b02f0 2024-09-13T18:39:33.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.473+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91a40b4910 con 0x7f91a40b02f0 2024-09-13T18:39:33.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.473+0000 7f91a1600640 1 -- 172.21.15.192:0/2870028082 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91940410a0 con 0x7f91a40b02f0 2024-09-13T18:39:33.477 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:39:33.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 msgr2=0x7f918006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 0x7f918006d0c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f91a40ccd70 tx=0x7f918c009040 comp rx=0 tx=0).stop 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 msgr2=0x7f91a41e33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f91a40b3670 tx=0x7f91940046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 shutdown_connections 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f918006ac00 0x7f918006d0c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91a4142e00 0x7f91a40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91a40b2d90 0x7f91a41594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.475+0000 7f91aa600640 1 --2- 172.21.15.192:0/2870028082 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91a40b02f0 0x7f91a41e33b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.476+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 >> 172.21.15.192:0/2870028082 conn(0x7f91a40ae7f0 msgr2=0x7f91a40ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.476+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 shutdown_connections 2024-09-13T18:39:33.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.476+0000 7f91aa600640 1 -- 172.21.15.192:0/2870028082 wait complete. 2024-09-13T18:39:33.494 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:39:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.645+0000 7f1a98200640 1 Processor -- start 2024-09-13T18:39:33.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.645+0000 7f1a98200640 1 -- start start 2024-09-13T18:39:33.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.646+0000 7f1a98200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a900b2780 0x7f1a900ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.646+0000 7f1a98200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a900afd80 0x7f1a900b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.646+0000 7f1a98200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a900ae770 con 0x7f1a90146610 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.646+0000 7f1a98200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900cd920 con 0x7f1a900afd80 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.646+0000 7f1a98200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a900b0730 con 0x7f1a900b2780 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a96200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a900afd80 0x7f1a900b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a94e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a900b2780 0x7f1a900ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a95800640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f1a90146610 0x7f1a900ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:33720/0 (socket says 172.21.15.192:33720) 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a95800640 1 -- 172.21.15.192:0/3412630521 learned_addr learned my addr 172.21.15.192:0/3412630521 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a96200640 1 -- 172.21.15.192:0/3412630521 >> v2:172.21.15.194:3300/0 conn(0x7f1a900b2780 msgr2=0x7f1a900ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a96200640 1 --2- 172.21.15.192:0/3412630521 >> v2:172.21.15.194:3300/0 conn(0x7f1a900b2780 0x7f1a900ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a96200640 1 -- 172.21.15.192:0/3412630521 >> v1:172.21.15.194:6789/0 conn(0x7f1a90146610 legacy=0x7f1a900ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a96200640 1 -- 172.21.15.192:0/3412630521 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a900cdb30 con 0x7f1a900afd80 2024-09-13T18:39:33.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.647+0000 7f1a8fe00640 1 -- 172.21.15.192:0/3412630521 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881444881 0 0) 0x7f1a900ae770 con 0x7f1a90146610 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.648+0000 7f1a96200640 1 --2- 172.21.15.192:0/3412630521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a900afd80 0x7f1a900b01f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e96788b972f3ff8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.648+0000 7f1a8fe00640 1 -- 172.21.15.192:0/3412630521 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031600 con 0x7f1a900afd80 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.648+0000 7f1a8fe00640 1 -- 172.21.15.192:0/3412630521 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8802d050 con 0x7f1a900afd80 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.648+0000 7f1a8fe00640 1 -- 172.21.15.192:0/3412630521 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88031980 con 0x7f1a900afd80 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 -- 172.21.15.192:0/3412630521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a900afd80 msgr2=0x7f1a900b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 --2- 172.21.15.192:0/3412630521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a900afd80 0x7f1a900b01f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009d90 tx=0x7f1a8802a610 comp rx=0 tx=0).stop 2024-09-13T18:39:33.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 -- 172.21.15.192:0/3412630521 shutdown_connections 2024-09-13T18:39:33.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 --2- 172.21.15.192:0/3412630521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a900afd80 0x7f1a900b01f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 --2- 172.21.15.192:0/3412630521 >> v2:172.21.15.194:3300/0 conn(0x7f1a900b2780 0x7f1a900ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 -- 172.21.15.192:0/3412630521 >> 172.21.15.192:0/3412630521 conn(0x7f1a900ae960 msgr2=0x7f1a9006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 -- 172.21.15.192:0/3412630521 shutdown_connections 2024-09-13T18:39:33.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.649+0000 7f1a98200640 1 -- 172.21.15.192:0/3412630521 wait complete. 2024-09-13T18:39:33.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.650+0000 7f1a98200640 1 Processor -- start 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 -- start start 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 0x7f1a9006ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a900b2780 0x7f1a9015afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a901f2850 con 0x7f1a90146610 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a900708d0 con 0x7f1a900b2780 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.651+0000 7f1a98200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a90158690 con 0x7f1a900afd80 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50074/0 (socket says 172.21.15.192:50074) 2024-09-13T18:39:33.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 -- 172.21.15.192:0/3411095011 learned_addr learned my addr 172.21.15.192:0/3411095011 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a95800640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 0x7f1a9006ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a94e00640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a900b2780 0x7f1a9015afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 -- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 msgr2=0x7f1a9006ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 0x7f1a9006ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 -- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a900b2780 msgr2=0x7f1a9015afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a900b2780 0x7f1a9015afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a96200640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88009a70 con 0x7f1a90146610 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.652+0000 7f1a95800640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 0x7f1a9006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a96200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009eb0 tx=0x7f1a88004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8803c830 con 0x7f1a90146610 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a8803c990 con 0x7f1a90146610 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8803cd00 con 0x7f1a90146610 2024-09-13T18:39:33.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a90158970 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.653+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a90070b90 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.654+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a900b01f0 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.655+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a8803b3b0 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.656+0000 7f1a8d600640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 0x7f1a7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.656+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1a880aace0 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.656+0000 7f1a95800640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 0x7f1a7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.656+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f1a700727f0 con 0x7f1a90146610 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.657+0000 7f1a95800640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 0x7f1a7006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a84007fd0 tx=0x7f1a84007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:33.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.660+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a88040060 con 0x7f1a90146610 2024-09-13T18:39:33.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.843+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1a90157670 con 0x7f1a90146610 2024-09-13T18:39:33.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.843+0000 7f1a8d600640 1 -- 172.21.15.192:0/3411095011 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1a8804a030 con 0x7f1a90146610 2024-09-13T18:39:33.846 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:39:33.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 msgr2=0x7f1a7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 0x7f1a7006d0c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f1a84007fd0 tx=0x7f1a84007de0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 msgr2=0x7f1a90158f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:33.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f1a88009eb0 tx=0x7f1a88004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:33.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 shutdown_connections 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a7006ac00 0x7f1a7006d0c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a90146610 0x7f1a90158f70 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a900b2780 0x7f1a9015afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 --2- 172.21.15.192:0/3411095011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a900afd80 0x7f1a9006ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 >> 172.21.15.192:0/3411095011 conn(0x7f1a900ae960 msgr2=0x7f1a9015ee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 shutdown_connections 2024-09-13T18:39:33.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:33.846+0000 7f1a98200640 1 -- 172.21.15.192:0/3411095011 wait complete. 2024-09-13T18:39:33.865 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:39:33.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:33.865 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:39:33.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:39:33.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:39:33.932 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:39:33.973 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:39:33.973 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:34.009 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:39:34.009 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:39:34.009 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:34.049 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:39:34.049 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:34.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.198+0000 7f2bbaa00640 1 Processor -- start 2024-09-13T18:39:34.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.198+0000 7f2bbaa00640 1 -- start start 2024-09-13T18:39:34.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bbaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2bb415dee0 0x7f2bb40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bbaa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2bb415e2c0 0x7f2bb415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bbaa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bb40b2f00 con 0x7f2bb40b3f10 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bbaa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40b3150 con 0x7f2bb415dee0 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bbaa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bb40b3430 con 0x7f2bb415e2c0 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bb3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2bb415dee0 0x7f2bb40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bb3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2bb40b3f10 0x7f2bb415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51124/0 (socket says 172.21.15.192:51124) 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bb3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2bb415dee0 0x7f2bb40afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50088/0 (socket says 172.21.15.192:50088) 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.199+0000 7f2bb3400640 1 -- 172.21.15.192:0/1055832744 learned_addr learned my addr 172.21.15.192:0/1055832744 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb8a00640 1 --2- 172.21.15.192:0/1055832744 >> v2:172.21.15.194:3300/0 conn(0x7f2bb415e2c0 0x7f2bb415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb3e00640 1 -- 172.21.15.192:0/1055832744 >> v2:172.21.15.194:3300/0 conn(0x7f2bb415e2c0 msgr2=0x7f2bb415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:34.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb3e00640 1 --2- 172.21.15.192:0/1055832744 >> v2:172.21.15.194:3300/0 conn(0x7f2bb415e2c0 0x7f2bb415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb3e00640 1 -- 172.21.15.192:0/1055832744 >> v1:172.21.15.192:6789/0 conn(0x7f2bb40b3f10 legacy=0x7f2bb415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb3e00640 1 -- 172.21.15.192:0/1055832744 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40b3710 con 0x7f2bb415dee0 2024-09-13T18:39:34.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.200+0000 7f2bb2a00640 1 -- 172.21.15.192:0/1055832744 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476387929 0 0) 0x7f2bb40b2f00 con 0x7f2bb40b3f10 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.201+0000 7f2bb3e00640 1 --2- 172.21.15.192:0/1055832744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb415dee0 0x7f2bb40afd80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40cec10 tx=0x7f2ba402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb12b3c8056b1313 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.201+0000 7f2bb2a00640 1 -- 172.21.15.192:0/1055832744 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4032440 con 0x7f2bb415dee0 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.201+0000 7f2bb2a00640 1 -- 172.21.15.192:0/1055832744 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba40325a0 con 0x7f2bb415dee0 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.201+0000 7f2bb2a00640 1 -- 172.21.15.192:0/1055832744 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4032930 con 0x7f2bb415dee0 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 -- 172.21.15.192:0/1055832744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb415dee0 msgr2=0x7f2bb40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/1055832744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb415dee0 0x7f2bb40afd80 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40cec10 tx=0x7f2ba402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 -- 172.21.15.192:0/1055832744 shutdown_connections 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/1055832744 >> v2:172.21.15.194:3300/0 conn(0x7f2bb415e2c0 0x7f2bb415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/1055832744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb415dee0 0x7f2bb40afd80 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 -- 172.21.15.192:0/1055832744 >> 172.21.15.192:0/1055832744 conn(0x7f2bb40ae960 msgr2=0x7f2bb406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 -- 172.21.15.192:0/1055832744 shutdown_connections 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.202+0000 7f2bbaa00640 1 -- 172.21.15.192:0/1055832744 wait complete. 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.203+0000 7f2bbaa00640 1 Processor -- start 2024-09-13T18:39:34.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.204+0000 7f2bbaa00640 1 -- start start 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.204+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb415dee0 0x7f2bb41f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.204+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb415e2c0 0x7f2bb4158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bbaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb415b210 con 0x7f2bb4151810 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb415b460 con 0x7f2bb415e2c0 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bbaa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb415b740 con 0x7f2bb415dee0 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb415e2c0 0x7f2bb4158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50090/0 (socket says 172.21.15.192:50090) 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 -- 172.21.15.192:0/864421212 learned_addr learned my addr 172.21.15.192:0/864421212 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb3e00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb415dee0 0x7f2bb41f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 -- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb415dee0 msgr2=0x7f2bb41f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb415dee0 0x7f2bb41f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 -- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb415e2c0 msgr2=0x7f2bb4158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb415e2c0 0x7f2bb4158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba4009400 con 0x7f2bb4151810 2024-09-13T18:39:34.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.205+0000 7f2bb8a00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00efc0 tx=0x7f2bac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.206+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac009ba0 con 0x7f2bb4151810 2024-09-13T18:39:34.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.206+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bac00f040 con 0x7f2bb4151810 2024-09-13T18:39:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.206+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac0146c0 con 0x7f2bb4151810 2024-09-13T18:39:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.206+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb415ba20 con 0x7f2bb4151810 2024-09-13T18:39:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.206+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb415bfe0 con 0x7f2bb4151810 2024-09-13T18:39:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.207+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bb415c1a0 con 0x7f2bb4151810 2024-09-13T18:39:34.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.208+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2bac014820 con 0x7f2bb4151810 2024-09-13T18:39:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.209+0000 7f2babe00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 0x7f2b9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.209+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2bac08a050 con 0x7f2bb4151810 2024-09-13T18:39:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.209+0000 7f2bb3e00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 0x7f2b9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.209+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f2b940727f0 con 0x7f2bb4151810 2024-09-13T18:39:34.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.210+0000 7f2bb3e00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 0x7f2b9406d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4034000 tx=0x7f2ba402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.213+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2bac018060 con 0x7f2bb4151810 2024-09-13T18:39:34.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.414+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bb40afd80 con 0x7f2bb4151810 2024-09-13T18:39:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.414+0000 7f2babe00640 1 -- 172.21.15.192:0/864421212 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f2bac0552a0 con 0x7f2bb4151810 2024-09-13T18:39:34.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:34.417 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:39:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:39:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 msgr2=0x7f2b9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 0x7f2b9406d0c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4034000 tx=0x7f2ba402e000 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 msgr2=0x7f2bb415c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00efc0 tx=0x7f2bac00c490 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 shutdown_connections 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b9406ac00 0x7f2b9406d0c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2bb4151810 0x7f2bb415c4e0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2bb415e2c0 0x7f2bb4158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 --2- 172.21.15.192:0/864421212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2bb415dee0 0x7f2bb41f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.416+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 >> 172.21.15.192:0/864421212 conn(0x7f2bb40ae960 msgr2=0x7f2bb40714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.417+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 shutdown_connections 2024-09-13T18:39:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.417+0000 7f2bbaa00640 1 -- 172.21.15.192:0/864421212 wait complete. 2024-09-13T18:39:34.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:34.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.584+0000 7f4148c00640 1 Processor -- start 2024-09-13T18:39:34.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.585+0000 7f4148c00640 1 -- start start 2024-09-13T18:39:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4148c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41441592d0 0x7f4144070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4148c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4148c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f414406f830 con 0x7f414406bca0 2024-09-13T18:39:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4148c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41440b3fb0 con 0x7f41441592d0 2024-09-13T18:39:34.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4148c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414406fa80 con 0x7f41440b3600 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4142a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4143400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41441592d0 0x7f4144070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4143e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f414406bca0 0x7f414406c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:33734/0 (socket says 172.21.15.192:33734) 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.586+0000 7f4143e00640 1 -- 172.21.15.192:0/3657916359 learned_addr learned my addr 172.21.15.192:0/3657916359 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.587+0000 7f4143400640 1 -- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 msgr2=0x7f41440b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.587+0000 7f4143400640 1 --2- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.587+0000 7f4143400640 1 -- 172.21.15.192:0/3657916359 >> v1:172.21.15.194:6789/0 conn(0x7f414406bca0 legacy=0x7f414406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.587+0000 7f4143400640 1 -- 172.21.15.192:0/3657916359 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414406fd60 con 0x7f41441592d0 2024-09-13T18:39:34.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4143400640 1 --2- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41441592d0 0x7f4144070b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f41340097a0 tx=0x7f413402c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc835296f13c9754 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4142000640 1 -- 172.21.15.192:0/3657916359 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134034640 con 0x7f41441592d0 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4142000640 1 -- 172.21.15.192:0/3657916359 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41340347a0 con 0x7f41441592d0 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4142000640 1 -- 172.21.15.192:0/3657916359 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134034b30 con 0x7f41441592d0 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4148c00640 1 -- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41441592d0 msgr2=0x7f4144070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.588+0000 7f4148c00640 1 --2- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41441592d0 0x7f4144070b20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f41340097a0 tx=0x7f413402c390 comp rx=0 tx=0).stop 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 -- 172.21.15.192:0/3657916359 shutdown_connections 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 --2- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 --2- 172.21.15.192:0/3657916359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f41441592d0 0x7f4144070b20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 -- 172.21.15.192:0/3657916359 >> 172.21.15.192:0/3657916359 conn(0x7f41440736d0 msgr2=0x7f41440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 -- 172.21.15.192:0/3657916359 shutdown_connections 2024-09-13T18:39:34.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.589+0000 7f4148c00640 1 -- 172.21.15.192:0/3657916359 wait complete. 2024-09-13T18:39:34.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.590+0000 7f4148c00640 1 Processor -- start 2024-09-13T18:39:34.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.590+0000 7f4148c00640 1 -- start start 2024-09-13T18:39:34.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 0x7f41441414c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4144143ff0 con 0x7f41441592d0 2024-09-13T18:39:34.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41441442d0 con 0x7f414406bca0 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4148c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41441445b0 con 0x7f41440b3600 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.591+0000 7f4143e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4142a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 0x7f41441414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50096/0 (socket says 172.21.15.192:50096) 2024-09-13T18:39:34.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143e00640 1 -- 172.21.15.192:0/3587581883 learned_addr learned my addr 172.21.15.192:0/3587581883 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 -- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 msgr2=0x7f41440aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 -- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 msgr2=0x7f41440af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134009400 con 0x7f414406bca0 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143e00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:34.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.592+0000 7f4143400640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 0x7f41441414c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4134033000 tx=0x7f41340046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.593+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413403f8f0 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.593+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413403fa70 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.593+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413403fe20 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.593+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4144144890 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.593+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4144143280 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.594+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41440b3a70 con 0x7f414406bca0 2024-09-13T18:39:34.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.595+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f413403b040 con 0x7f414406bca0 2024-09-13T18:39:34.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.596+0000 7f413b400640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 0x7f412406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.596+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f41340abc40 con 0x7f414406bca0 2024-09-13T18:39:34.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.596+0000 7f4142a00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 0x7f412406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.596+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f41240727f0 con 0x7f414406bca0 2024-09-13T18:39:34.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.597+0000 7f4142a00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 0x7f412406d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f41440b0f10 tx=0x7f4130009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.600+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4134076e80 con 0x7f414406bca0 2024-09-13T18:39:34.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.770+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41440b33e0 con 0x7f414406bca0 2024-09-13T18:39:34.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.772+0000 7f413b400640 1 -- 172.21.15.192:0/3587581883 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+16772 (secure 0 0 0) 0x7f4134039070 con 0x7f414406bca0 2024-09-13T18:39:34.775 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:34.775 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":76,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:38:32.849357+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","full","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":1}]},{"pgid":"9.1e","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:34.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 msgr2=0x7f412406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 0x7f412406d0c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f41440b0f10 tx=0x7f4130009190 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 msgr2=0x7f41441414c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 0x7f41441414c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4134033000 tx=0x7f41340046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 shutdown_connections 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac00 0x7f412406d0c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f41441592d0 0x7f41440af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41440b3600 0x7f41440aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 --2- 172.21.15.192:0/3587581883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414406bca0 0x7f41441414c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 >> 172.21.15.192:0/3587581883 conn(0x7f41440736d0 msgr2=0x7f414414f650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 shutdown_connections 2024-09-13T18:39:34.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.774+0000 7f4148c00640 1 -- 172.21.15.192:0/3587581883 wait complete. 2024-09-13T18:39:34.793 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:38:15.686427+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:38:16.717080+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:39:34.794 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:34.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.946+0000 7f5601800640 1 Processor -- start 2024-09-13T18:39:34.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.946+0000 7f5601800640 1 -- start start 2024-09-13T18:39:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 0x7f55fc0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55fc160ac0 0x7f55fc160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 0x7f55fc0adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0b21e0 con 0x7f55fc160ac0 2024-09-13T18:39:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55fc0b1bf0 con 0x7f55fc15a910 2024-09-13T18:39:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.947+0000 7f5601800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc0ae1d0 con 0x7f55fc0ad840 2024-09-13T18:39:34.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55fc160ac0 0x7f55fc160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55fc160ac0 0x7f55fc160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50100/0 (socket says 172.21.15.192:50100) 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 -- 172.21.15.192:0/3418660415 learned_addr learned my addr 172.21.15.192:0/3418660415 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55fb400640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 0x7f55fc0adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55faa00640 1 --2- 172.21.15.192:0/3418660415 >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 0x7f55fc0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 -- 172.21.15.192:0/3418660415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 msgr2=0x7f55fc0adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 0x7f55fc0adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 -- 172.21.15.192:0/3418660415 >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 msgr2=0x7f55fc0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 --2- 172.21.15.192:0/3418660415 >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 0x7f55fc0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55f3e00640 1 -- 172.21.15.192:0/3418660415 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc0b2b40 con 0x7f55fc160ac0 2024-09-13T18:39:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55fb400640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 0x7f55fc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:34.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.948+0000 7f55faa00640 1 --2- 172.21.15.192:0/3418660415 >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 0x7f55fc0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.949+0000 7f55f3e00640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc160ac0 0x7f55fc160f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0b18c0 tx=0x7f55e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e36dbb16e62725 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.949+0000 7f55fa000640 1 -- 172.21.15.192:0/3418660415 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e402ae90 con 0x7f55fc160ac0 2024-09-13T18:39:34.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.949+0000 7f55fa000640 1 -- 172.21.15.192:0/3418660415 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e4032440 con 0x7f55fc160ac0 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.949+0000 7f55fa000640 1 -- 172.21.15.192:0/3418660415 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e40327d0 con 0x7f55fc160ac0 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 -- 172.21.15.192:0/3418660415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc160ac0 msgr2=0x7f55fc160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc160ac0 0x7f55fc160f30 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0b18c0 tx=0x7f55e402a140 comp rx=0 tx=0).stop 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 -- 172.21.15.192:0/3418660415 shutdown_connections 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc0ad840 0x7f55fc0adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 --2- 172.21.15.192:0/3418660415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc160ac0 0x7f55fc160f30 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 --2- 172.21.15.192:0/3418660415 >> v2:172.21.15.194:3300/0 conn(0x7f55fc15a910 0x7f55fc0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 -- 172.21.15.192:0/3418660415 >> 172.21.15.192:0/3418660415 conn(0x7f55fc0b08f0 msgr2=0x7f55fc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 -- 172.21.15.192:0/3418660415 shutdown_connections 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.950+0000 7f5601800640 1 -- 172.21.15.192:0/3418660415 wait complete. 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.952+0000 7f5601800640 1 Processor -- start 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.952+0000 7f5601800640 1 -- start start 2024-09-13T18:39:34.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 0x7f55fc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 0x7f55fc15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc06ae50 con 0x7f55fc0ad840 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc06a240 con 0x7f55fc160ac0 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f5601800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55fc06a520 con 0x7f55fc15a910 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50114/0 (socket says 172.21.15.192:50114) 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 -- 172.21.15.192:0/2854134018 learned_addr learned my addr 172.21.15.192:0/2854134018 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55f3e00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 0x7f55fc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55fb400640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 0x7f55fc15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 -- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 msgr2=0x7f55fc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 0x7f55fc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 -- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 msgr2=0x7f55fc15bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 0x7f55fc15bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55faa00640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e40094d0 con 0x7f55fc0ad840 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55f3e00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 0x7f55fc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.953+0000 7f55fb400640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 0x7f55fc15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f55faa00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c7f0 tx=0x7f55ec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec007a30 con 0x7f55fc0ad840 2024-09-13T18:39:34.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec007b90 con 0x7f55fc0ad840 2024-09-13T18:39:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55fc06a800 con 0x7f55fc0ad840 2024-09-13T18:39:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec00ce40 con 0x7f55fc0ad840 2024-09-13T18:39:34.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.954+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55fc155080 con 0x7f55fc0ad840 2024-09-13T18:39:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.955+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55fc15acf0 con 0x7f55fc0ad840 2024-09-13T18:39:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.956+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55ec0113f0 con 0x7f55fc0ad840 2024-09-13T18:39:34.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.957+0000 7f55f2a00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 0x7f55d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.957+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f55ec089560 con 0x7f55fc0ad840 2024-09-13T18:39:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.957+0000 7f55f3e00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 0x7f55d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.957+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=77}) v3 -- 0x7f55d8072820 con 0x7f55fc0ad840 2024-09-13T18:39:34.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.958+0000 7f55f3e00640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 0x7f55d806d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f55e4034000 tx=0x7f55e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.961+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55ec01f060 con 0x7f55fc0ad840 2024-09-13T18:39:34.985 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:39:34.982+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-13T18:39:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.992+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(77..77 src has 1..77) v4 ==== 304+0+0 (secure 0 0 0) 0x7f55ec058ab0 con 0x7f55fc0ad840 2024-09-13T18:39:34.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:34.992+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f55d80730d0 con 0x7f55fc0ad840 2024-09-13T18:39:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.134+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55fc0cb500 con 0x7f55fc0ad840 2024-09-13T18:39:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.134+0000 7f55f2a00640 1 -- 172.21.15.192:0/2854134018 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55ec0546f0 con 0x7f55fc0ad840 2024-09-13T18:39:35.137 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:39:35.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.136+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 msgr2=0x7f55d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.136+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 0x7f55d806d0f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f55e4034000 tx=0x7f55e402e000 comp rx=0 tx=0).stop 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.136+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 msgr2=0x7f55fc154b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.136+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00c7f0 tx=0x7f55ec00cbf0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 shutdown_connections 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55d806ac30 0x7f55d806d0f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55fc160ac0 0x7f55fc15bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55fc15a910 0x7f55fc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 --2- 172.21.15.192:0/2854134018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55fc0ad840 0x7f55fc154b40 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 >> 172.21.15.192:0/2854134018 conn(0x7f55fc0b08f0 msgr2=0x7f55fc0cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:35.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 shutdown_connections 2024-09-13T18:39:35.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.137+0000 7f5601800640 1 -- 172.21.15.192:0/2854134018 wait complete. 2024-09-13T18:39:35.156 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:39:35.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.307+0000 7fe8d6000640 1 Processor -- start 2024-09-13T18:39:35.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.308+0000 7fe8d6000640 1 -- start start 2024-09-13T18:39:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d6000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe8d0142e00 0x7fe8d00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d6000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe8d00b02f0 0x7fe8d006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d6000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d006f940 con 0x7fe8d00b2d90 2024-09-13T18:39:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d6000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d006f610 con 0x7fe8d00b02f0 2024-09-13T18:39:35.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d6000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d00b3530 con 0x7fe8d0142e00 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d5600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe8d00b02f0 0x7fe8d006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8c7e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe8d00b2d90 0x7fe8d00afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51138/0 (socket says 172.21.15.192:51138) 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8c7e00640 1 -- 172.21.15.192:0/1250137441 learned_addr learned my addr 172.21.15.192:0/1250137441 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d4c00640 1 --2- 172.21.15.192:0/1250137441 >> v2:172.21.15.194:3300/0 conn(0x7fe8d0142e00 0x7fe8d00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.309+0000 7fe8d5600640 1 -- 172.21.15.192:0/1250137441 >> v2:172.21.15.194:3300/0 conn(0x7fe8d0142e00 msgr2=0x7fe8d00b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.310+0000 7fe8d5600640 1 --2- 172.21.15.192:0/1250137441 >> v2:172.21.15.194:3300/0 conn(0x7fe8d0142e00 0x7fe8d00b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.310+0000 7fe8d5600640 1 -- 172.21.15.192:0/1250137441 >> v1:172.21.15.192:6789/0 conn(0x7fe8d00b2d90 legacy=0x7fe8d00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.310+0000 7fe8d5600640 1 -- 172.21.15.192:0/1250137441 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d00b3810 con 0x7fe8d00b02f0 2024-09-13T18:39:35.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.310+0000 7fe8cfe00640 1 -- 172.21.15.192:0/1250137441 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 218894347 0 0) 0x7fe8d006f940 con 0x7fe8d00b2d90 2024-09-13T18:39:35.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.310+0000 7fe8d5600640 1 --2- 172.21.15.192:0/1250137441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d006fdd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0071ee0 tx=0x7fe8c802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564d08e15dd154ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8cfe00640 1 -- 172.21.15.192:0/1250137441 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c802aea0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8cfe00640 1 -- 172.21.15.192:0/1250137441 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c802d050 con 0x7fe8d00b02f0 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8cfe00640 1 -- 172.21.15.192:0/1250137441 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c8007960 con 0x7fe8d00b02f0 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 -- 172.21.15.192:0/1250137441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 msgr2=0x7fe8d006fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 --2- 172.21.15.192:0/1250137441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d006fdd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0071ee0 tx=0x7fe8c802a680 comp rx=0 tx=0).stop 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 -- 172.21.15.192:0/1250137441 shutdown_connections 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 --2- 172.21.15.192:0/1250137441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d006fdd0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 --2- 172.21.15.192:0/1250137441 >> v2:172.21.15.194:3300/0 conn(0x7fe8d0142e00 0x7fe8d00b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 -- 172.21.15.192:0/1250137441 >> 172.21.15.192:0/1250137441 conn(0x7fe8d00ae7f0 msgr2=0x7fe8d006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 -- 172.21.15.192:0/1250137441 shutdown_connections 2024-09-13T18:39:35.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.311+0000 7fe8d6000640 1 -- 172.21.15.192:0/1250137441 wait complete. 2024-09-13T18:39:35.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.313+0000 7fe8d6000640 1 Processor -- start 2024-09-13T18:39:35.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.313+0000 7fe8d6000640 1 -- start start 2024-09-13T18:39:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d00b2d90 0x7fe8d006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d0142e00 0x7fe8d0070310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0166640 con 0x7fe8d00b02f0 2024-09-13T18:39:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0159a40 con 0x7fe8d0142e00 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d6000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d0137be0 con 0x7fe8d00b2d90 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50132/0 (socket says 172.21.15.192:50132) 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.314+0000 7fe8d4c00640 1 -- 172.21.15.192:0/727623565 learned_addr learned my addr 172.21.15.192:0/727623565 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 -- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d00b2d90 msgr2=0x7fe8d006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d00b2d90 0x7fe8d006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 -- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d0142e00 msgr2=0x7fe8d0070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d0142e00 0x7fe8d0070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c8009a70 con 0x7fe8d00b02f0 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d4c00640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d650 tx=0x7fe8c000db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000b660 con 0x7fe8d00b02f0 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c000b7c0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c000bb70 con 0x7fe8d00b02f0 2024-09-13T18:39:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.315+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d0143360 con 0x7fe8d00b02f0 2024-09-13T18:39:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.316+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d0165880 con 0x7fe8d00b02f0 2024-09-13T18:39:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.317+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d0139990 con 0x7fe8d00b02f0 2024-09-13T18:39:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.317+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe8c000bcd0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.318+0000 7fe8cd600640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.318+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe8c00898a0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.319+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7fe8ac0727f0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.319+0000 7fe8c7e00640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.319+0000 7fe8c7e00640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.322+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe8c00549a0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.491+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8d01396b0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.491+0000 7fe8cd600640 1 -- 172.21.15.192:0/727623565 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8c0057fc0 con 0x7fe8d00b02f0 2024-09-13T18:39:35.494 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:39:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 msgr2=0x7fe8ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8007fd0 tx=0x7fe8b8007920 comp rx=0 tx=0).stop 2024-09-13T18:39:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 msgr2=0x7fe8d0158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe8c000d650 tx=0x7fe8c000db10 comp rx=0 tx=0).stop 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 shutdown_connections 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe8ac06ac00 0x7fe8ac06d0c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe8d0142e00 0x7fe8d0070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe8d00b2d90 0x7fe8d006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 --2- 172.21.15.192:0/727623565 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe8d00b02f0 0x7fe8d0158fe0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 >> 172.21.15.192:0/727623565 conn(0x7fe8d00ae7f0 msgr2=0x7fe8d0070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 shutdown_connections 2024-09-13T18:39:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.493+0000 7fe8d6000640 1 -- 172.21.15.192:0/727623565 wait complete. 2024-09-13T18:39:35.512 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:39:35.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.666+0000 7f55e0e00640 1 Processor -- start 2024-09-13T18:39:35.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.666+0000 7f55e0e00640 1 -- start start 2024-09-13T18:39:35.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55e0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 0x7f55dc15e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55e0e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc15b070 con 0x7f55dc15b810 2024-09-13T18:39:35.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55e0e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55dc15eba0 con 0x7f55dc0b02f0 2024-09-13T18:39:35.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55e0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15ee20 con 0x7f55dc1402c0 2024-09-13T18:39:35.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55daa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f55dc15b810 0x7f55dc0afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51150/0 (socket says 172.21.15.192:51150) 2024-09-13T18:39:35.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55daa00640 1 -- 172.21.15.192:0/357020512 learned_addr learned my addr 172.21.15.192:0/357020512 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55db400640 1 --2- 172.21.15.192:0/357020512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 0x7f55dc15e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.668+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497789377 0 0) 0x7f55dc15b070 con 0x7f55dc15b810 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.669+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c0003520 con 0x7f55dc15b810 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.669+0000 7f55db400640 1 -- 172.21.15.192:0/357020512 >> v1:172.21.15.194:6789/0 conn(0x7f55dc0b02f0 legacy=0x7f55dc1406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.669+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030614927 0 0) 0x7f55dc15eba0 con 0x7f55dc0b02f0 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.669+0000 7f55db400640 1 -- 172.21.15.192:0/357020512 >> v1:172.21.15.192:6789/0 conn(0x7f55dc15b810 legacy=0x7f55dc0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.669+0000 7f55db400640 1 -- 172.21.15.192:0/357020512 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc15f100 con 0x7f55dc1402c0 2024-09-13T18:39:35.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.670+0000 7f55db400640 1 --2- 172.21.15.192:0/357020512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 0x7f55dc15e660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097d0 tx=0x7f55cc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a27127bc5c0d6428 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.670+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80015f0 con 0x7f55dc1402c0 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.670+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc02ac10 con 0x7f55dc1402c0 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.670+0000 7f55da000640 1 -- 172.21.15.192:0/357020512 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc032440 con 0x7f55dc1402c0 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 -- 172.21.15.192:0/357020512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 msgr2=0x7f55dc15e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 --2- 172.21.15.192:0/357020512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 0x7f55dc15e660 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0097d0 tx=0x7f55cc02a180 comp rx=0 tx=0).stop 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 -- 172.21.15.192:0/357020512 shutdown_connections 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 --2- 172.21.15.192:0/357020512 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc1402c0 0x7f55dc15e660 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 -- 172.21.15.192:0/357020512 >> 172.21.15.192:0/357020512 conn(0x7f55dc0ae7f0 msgr2=0x7f55dc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:35.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 -- 172.21.15.192:0/357020512 shutdown_connections 2024-09-13T18:39:35.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.671+0000 7f55e0e00640 1 -- 172.21.15.192:0/357020512 wait complete. 2024-09-13T18:39:35.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.672+0000 7f55e0e00640 1 Processor -- start 2024-09-13T18:39:35.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 -- start start 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55dc0b02f0 0x7f55dc0aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc15b810 0x7f55dc143c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc1441b0 con 0x7f55dc1402c0 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc142bd0 con 0x7f55dc0b02f0 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.673+0000 7f55e0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc142eb0 con 0x7f55dc15b810 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50138/0 (socket says 172.21.15.192:50138) 2024-09-13T18:39:35.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 -- 172.21.15.192:0/2576009353 learned_addr learned my addr 172.21.15.192:0/2576009353 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55db400640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55dc0b02f0 0x7f55dc0aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55dbe00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc15b810 0x7f55dc143c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 -- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc15b810 msgr2=0x7f55dc143c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc15b810 0x7f55dc143c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 -- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55dc0b02f0 msgr2=0x7f55dc0aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55dc0b02f0 0x7f55dc0aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc009400 con 0x7f55dc1402c0 2024-09-13T18:39:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.674+0000 7f55daa00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c780 tx=0x7f55c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.675+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8005ad0 con 0x7f55dc1402c0 2024-09-13T18:39:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.675+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8005c30 con 0x7f55dc1402c0 2024-09-13T18:39:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.675+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8007270 con 0x7f55dc1402c0 2024-09-13T18:39:35.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.675+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc143190 con 0x7f55dc1402c0 2024-09-13T18:39:35.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.675+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc143750 con 0x7f55dc1402c0 2024-09-13T18:39:35.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.676+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc143970 con 0x7f55dc1402c0 2024-09-13T18:39:35.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.677+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55c80073d0 con 0x7f55dc1402c0 2024-09-13T18:39:35.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.677+0000 7f55d3400640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 0x7f55bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:35.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.678+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f55c80890b0 con 0x7f55dc1402c0 2024-09-13T18:39:35.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.678+0000 7f55db400640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 0x7f55bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:35.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.678+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f55bc0727f0 con 0x7f55dc1402c0 2024-09-13T18:39:35.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.678+0000 7f55db400640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 0x7f55bc06d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:35.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.682+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55c8054260 con 0x7f55dc1402c0 2024-09-13T18:39:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.849+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f55dc15bc30 con 0x7f55dc1402c0 2024-09-13T18:39:35.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.850+0000 7f55d3400640 1 -- 172.21.15.192:0/2576009353 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7f55c8057880 con 0x7f55dc1402c0 2024-09-13T18:39:35.852 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 msgr2=0x7f55bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 0x7f55bc06d0c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f55cc034000 tx=0x7f55cc02e000 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 msgr2=0x7f55dc13cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c780 tx=0x7f55c800cc40 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 shutdown_connections 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55bc06ac00 0x7f55bc06d0c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55dc15b810 0x7f55dc143c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55dc1402c0 0x7f55dc13cf50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 --2- 172.21.15.192:0/2576009353 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55dc0b02f0 0x7f55dc0aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 >> 172.21.15.192:0/2576009353 conn(0x7f55dc0ae7f0 msgr2=0x7f55dc0706a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 shutdown_connections 2024-09-13T18:39:35.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:35.852+0000 7f55e0e00640 1 -- 172.21.15.192:0/2576009353 wait complete. 2024-09-13T18:39:35.870 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:36.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.019+0000 7f5fa0800640 1 Processor -- start 2024-09-13T18:39:36.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.019+0000 7f5fa0800640 1 -- start start 2024-09-13T18:39:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.020+0000 7f5fa0800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 0x7f5f9815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.020+0000 7f5fa0800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.020+0000 7f5fa0800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f98140480 con 0x7f5f98140980 2024-09-13T18:39:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.020+0000 7f5fa0800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9815c160 con 0x7f5f980cacd0 2024-09-13T18:39:36.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.020+0000 7f5fa0800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9815ee90 con 0x7f5f980cb0b0 2024-09-13T18:39:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 0x7f5f9815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 0x7f5f9815e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41402/0 (socket says 172.21.15.192:41402) 2024-09-13T18:39:36.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9de00640 1 -- 172.21.15.192:0/3722407385 learned_addr learned my addr 172.21.15.192:0/3722407385 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9d400640 1 -- 172.21.15.192:0/3722407385 >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 msgr2=0x7f5f9815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9d400640 1 --2- 172.21.15.192:0/3722407385 >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 0x7f5f9815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.021+0000 7f5f9d400640 1 -- 172.21.15.192:0/3722407385 >> v1:172.21.15.194:6789/0 conn(0x7f5f98140980 legacy=0x7f5f980afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.022+0000 7f5f9d400640 1 -- 172.21.15.192:0/3722407385 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9815f170 con 0x7f5f980cb0b0 2024-09-13T18:39:36.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.022+0000 7f5f9d400640 1 --2- 172.21.15.192:0/3722407385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9815bc20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097a0 tx=0x7f5f8802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0eea15321ac654 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5f9ca00640 1 -- 172.21.15.192:0/3722407385 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88032440 con 0x7f5f980cb0b0 2024-09-13T18:39:36.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5f9ca00640 1 -- 172.21.15.192:0/3722407385 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f880325a0 con 0x7f5f980cb0b0 2024-09-13T18:39:36.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5f9ca00640 1 -- 172.21.15.192:0/3722407385 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f88032930 con 0x7f5f980cb0b0 2024-09-13T18:39:36.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 -- 172.21.15.192:0/3722407385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 msgr2=0x7f5f9815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 --2- 172.21.15.192:0/3722407385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9815bc20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5f880097a0 tx=0x7f5f8802a180 comp rx=0 tx=0).stop 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 -- 172.21.15.192:0/3722407385 shutdown_connections 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 --2- 172.21.15.192:0/3722407385 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9815bc20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 --2- 172.21.15.192:0/3722407385 >> v2:172.21.15.194:3300/0 conn(0x7f5f980cacd0 0x7f5f9815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 -- 172.21.15.192:0/3722407385 >> 172.21.15.192:0/3722407385 conn(0x7f5f980ae960 msgr2=0x7f5f9806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.023+0000 7f5fa0800640 1 -- 172.21.15.192:0/3722407385 shutdown_connections 2024-09-13T18:39:36.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.024+0000 7f5fa0800640 1 -- 172.21.15.192:0/3722407385 wait complete. 2024-09-13T18:39:36.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.025+0000 7f5fa0800640 1 Processor -- start 2024-09-13T18:39:36.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.025+0000 7f5fa0800640 1 -- start start 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9813ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f98140980 0x7f5f9813f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9806b6f0 con 0x7f5f980cacd0 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98156380 con 0x7f5f98140980 2024-09-13T18:39:36.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5fa0800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f98156660 con 0x7f5f980cb0b0 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5f9de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5f9de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50140/0 (socket says 172.21.15.192:50140) 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.026+0000 7f5f9de00640 1 -- 172.21.15.192:0/1944807553 learned_addr learned my addr 172.21.15.192:0/1944807553 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9d400640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9813ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9e800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f98140980 0x7f5f9813f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 -- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 msgr2=0x7f5f9813ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9813ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 -- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f98140980 msgr2=0x7f5f9813f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f98140980 0x7f5f9813f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f88009400 con 0x7f5f980cacd0 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9d400640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:36.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f9de00640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00e840 tx=0x7f5f8c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00c8e0 con 0x7f5f980cacd0 2024-09-13T18:39:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c00ca40 con 0x7f5f980cacd0 2024-09-13T18:39:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f98156940 con 0x7f5f980cacd0 2024-09-13T18:39:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.027+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c00cdf0 con 0x7f5f980cacd0 2024-09-13T18:39:36.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.028+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9813f920 con 0x7f5f980cacd0 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.029+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f981561e0 con 0x7f5f980cacd0 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.029+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f8c013470 con 0x7f5f980cacd0 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.030+0000 7f5f92000640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 0x7f5f7c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.030+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5f8c089520 con 0x7f5f980cacd0 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.030+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f5f7c0727f0 con 0x7f5f980cacd0 2024-09-13T18:39:36.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.030+0000 7f5f9d400640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 0x7f5f7c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.031+0000 7f5f9d400640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 0x7f5f7c06d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f88034000 tx=0x7f5f8802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.034+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f981561e0 con 0x7f5f980cacd0 2024-09-13T18:39:36.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.235+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f981561e0 con 0x7f5f980cacd0 2024-09-13T18:39:36.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.235+0000 7f5f92000640 1 -- 172.21.15.192:0/1944807553 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f5f981561e0 con 0x7f5f980cacd0 2024-09-13T18:39:36.238 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:39:36.239 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.237+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 msgr2=0x7f5f7c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.237+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 0x7f5f7c06d0c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5f88034000 tx=0x7f5f8802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 msgr2=0x7f5f9806b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00e840 tx=0x7f5f8c00ed00 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 shutdown_connections 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f7c06ac00 0x7f5f7c06d0c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f98140980 0x7f5f9813f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f980cb0b0 0x7f5f9813ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 --2- 172.21.15.192:0/1944807553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f980cacd0 0x7f5f9806b110 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 >> 172.21.15.192:0/1944807553 conn(0x7f5f980ae960 msgr2=0x7f5f9815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 shutdown_connections 2024-09-13T18:39:36.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.238+0000 7f5fa0800640 1 -- 172.21.15.192:0/1944807553 wait complete. 2024-09-13T18:39:36.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:36.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.405+0000 7f3df5e00640 1 Processor -- start 2024-09-13T18:39:36.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.405+0000 7f3df5e00640 1 -- start start 2024-09-13T18:39:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.406+0000 7f3df5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 0x7f3df015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.406+0000 7f3df5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3df00b0490 0x7f3df015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.406+0000 7f3df5e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3df00b2f00 con 0x7f3df015dee0 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.406+0000 7f3df5e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df015aec0 con 0x7f3df00b0490 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.406+0000 7f3df5e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3df00b3150 con 0x7f3df00b3f10 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3df00b0490 0x7f3df015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3df00b0490 0x7f3df015a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50146/0 (socket says 172.21.15.192:50146) 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 -- 172.21.15.192:0/3847431889 learned_addr learned my addr 172.21.15.192:0/3847431889 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:36.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3deea00640 1 --1- 172.21.15.192:0/3847431889 >> v1:172.21.15.192:6789/0 conn(0x7f3df015dee0 0x7f3df00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51156/0 (socket says 172.21.15.192:51156) 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3dee000640 1 --2- 172.21.15.192:0/3847431889 >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 0x7f3df015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 -- 172.21.15.192:0/3847431889 >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 msgr2=0x7f3df015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 --2- 172.21.15.192:0/3847431889 >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 0x7f3df015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 -- 172.21.15.192:0/3847431889 >> v1:172.21.15.192:6789/0 conn(0x7f3df015dee0 legacy=0x7f3df00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3def400640 1 -- 172.21.15.192:0/3847431889 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df00b3430 con 0x7f3df00b0490 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.407+0000 7f3dee000640 1 --2- 172.21.15.192:0/3847431889 >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 0x7f3df015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:36.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.408+0000 7f3def400640 1 --2- 172.21.15.192:0/3847431889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df00b0490 0x7f3df015a980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3df00b4700 tx=0x7f3de802a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11d6a20b7cf70dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.408+0000 7f3ded600640 1 -- 172.21.15.192:0/3847431889 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8031600 con 0x7f3df00b0490 2024-09-13T18:39:36.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.408+0000 7f3ded600640 1 -- 172.21.15.192:0/3847431889 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de802d050 con 0x7f3df00b0490 2024-09-13T18:39:36.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.408+0000 7f3ded600640 1 -- 172.21.15.192:0/3847431889 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de8031980 con 0x7f3df00b0490 2024-09-13T18:39:36.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 -- 172.21.15.192:0/3847431889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df00b0490 msgr2=0x7f3df015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3847431889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df00b0490 0x7f3df015a980 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3df00b4700 tx=0x7f3de802a740 comp rx=0 tx=0).stop 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 -- 172.21.15.192:0/3847431889 shutdown_connections 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3847431889 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df00b0490 0x7f3df015a980 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3847431889 >> v2:172.21.15.194:3300/0 conn(0x7f3df00b3f10 0x7f3df015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 -- 172.21.15.192:0/3847431889 >> 172.21.15.192:0/3847431889 conn(0x7f3df00ae960 msgr2=0x7f3df006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 -- 172.21.15.192:0/3847431889 shutdown_connections 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.409+0000 7f3df5e00640 1 -- 172.21.15.192:0/3847431889 wait complete. 2024-09-13T18:39:36.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.411+0000 7f3df5e00640 1 Processor -- start 2024-09-13T18:39:36.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.411+0000 7f3df5e00640 1 -- start start 2024-09-13T18:39:36.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00b0490 0x7f3df01587f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3df015dee0 0x7f3df013b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df015c2b0 con 0x7f3df01f2990 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df0158d30 con 0x7f3df00b0490 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3df5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df00ad840 con 0x7f3df015dee0 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3def400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3def400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50162/0 (socket says 172.21.15.192:50162) 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3def400640 1 -- 172.21.15.192:0/3864679816 learned_addr learned my addr 172.21.15.192:0/3864679816 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3deea00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00b0490 0x7f3df01587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3dee000640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3df015dee0 0x7f3df013b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3def400640 1 -- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3df015dee0 msgr2=0x7f3df013b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.412+0000 7f3def400640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3df015dee0 0x7f3df013b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3def400640 1 -- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00b0490 msgr2=0x7f3df01587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3def400640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00b0490 0x7f3df01587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3def400640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de8009b30 con 0x7f3df01f2990 2024-09-13T18:39:36.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3def400640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3de802ad30 tx=0x7f3de8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de803b810 con 0x7f3df01f2990 2024-09-13T18:39:36.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de803b970 con 0x7f3df01f2990 2024-09-13T18:39:36.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de803bd20 con 0x7f3df01f2990 2024-09-13T18:39:36.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3df013fd70 con 0x7f3df01f2990 2024-09-13T18:39:36.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.413+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3df00add50 con 0x7f3df01f2990 2024-09-13T18:39:36.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.414+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3df015c3f0 con 0x7f3df01f2990 2024-09-13T18:39:36.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.415+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3de803a3a0 con 0x7f3df01f2990 2024-09-13T18:39:36.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.416+0000 7f3de7400640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 0x7f3dd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.416+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3de80aa150 con 0x7f3df01f2990 2024-09-13T18:39:36.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.416+0000 7f3deea00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 0x7f3dd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.416+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f3dd00727f0 con 0x7f3df01f2990 2024-09-13T18:39:36.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.417+0000 7f3deea00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 0x7f3dd006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3de0000f60 tx=0x7f3de0007c80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.420+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3df015c3f0 con 0x7f3df01f2990 2024-09-13T18:39:36.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.590+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3df015c3f0 con 0x7f3df01f2990 2024-09-13T18:39:36.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.591+0000 7f3de7400640 1 -- 172.21.15.192:0/3864679816 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+16758 (secure 0 0 0) 0x7f3df015c3f0 con 0x7f3df01f2990 2024-09-13T18:39:36.594 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:36.594 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":77,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:34.983567+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["backfillfull","exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":1}]},{"pgid":"9.1e","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 msgr2=0x7f3dd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 0x7f3dd006d0c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3de0000f60 tx=0x7f3de0007c80 comp rx=0 tx=0).stop 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 msgr2=0x7f3df013bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3de802ad30 tx=0x7f3de8004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 shutdown_connections 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3dd006ac00 0x7f3dd006d0c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df01f2990 0x7f3df013bf30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3df015dee0 0x7f3df013b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 --2- 172.21.15.192:0/3864679816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3df00b0490 0x7f3df01587f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 >> 172.21.15.192:0/3864679816 conn(0x7f3df00ae960 msgr2=0x7f3df01421b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 shutdown_connections 2024-09-13T18:39:36.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.593+0000 7f3df5e00640 1 -- 172.21.15.192:0/3864679816 wait complete. 2024-09-13T18:39:36.611 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:39:36.612 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.762+0000 7f6cfc800640 1 Processor -- start 2024-09-13T18:39:36.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.762+0000 7f6cfc800640 1 -- start start 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cfc800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6cf40b3f10 0x7f6cf415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cfc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf40b0490 0x7f6cf415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cfc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cf40b2f00 con 0x7f6cf415dee0 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cfc800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cf415aec0 con 0x7f6cf40b3f10 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cfc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf40b3150 con 0x7f6cf40b0490 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.763+0000 7f6cf9e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6cf415dee0 0x7f6cf40afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51160/0 (socket says 172.21.15.192:51160) 2024-09-13T18:39:36.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9e00640 1 -- 172.21.15.192:0/2608214251 learned_addr learned my addr 172.21.15.192:0/2608214251 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:36.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9400640 1 --2- 172.21.15.192:0/2608214251 >> v2:172.21.15.192:3300/0 conn(0x7f6cf40b3f10 0x7f6cf415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cfa800640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf40b0490 0x7f6cf415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9400640 1 -- 172.21.15.192:0/2608214251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf40b0490 msgr2=0x7f6cf415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:36.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9400640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf40b0490 0x7f6cf415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9400640 1 -- 172.21.15.192:0/2608214251 >> v1:172.21.15.192:6789/0 conn(0x7f6cf415dee0 legacy=0x7f6cf40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.768 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.764+0000 7f6cf9400640 1 -- 172.21.15.192:0/2608214251 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf40b3430 con 0x7f6cf40b3f10 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.765+0000 7f6cf9400640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b3f10 0x7f6cf415a440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cc32e22b11a985 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.765+0000 7f6cf8a00640 1 -- 172.21.15.192:0/2608214251 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4034640 con 0x7f6cf40b3f10 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.765+0000 7f6cf8a00640 1 -- 172.21.15.192:0/2608214251 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce40347a0 con 0x7f6cf40b3f10 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.765+0000 7f6cf8a00640 1 -- 172.21.15.192:0/2608214251 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4034b30 con 0x7f6cf40b3f10 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 -- 172.21.15.192:0/2608214251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b3f10 msgr2=0x7f6cf415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b3f10 0x7f6cf415a440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40097a0 tx=0x7f6ce402c390 comp rx=0 tx=0).stop 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 -- 172.21.15.192:0/2608214251 shutdown_connections 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf40b0490 0x7f6cf415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 --2- 172.21.15.192:0/2608214251 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b3f10 0x7f6cf415a440 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 -- 172.21.15.192:0/2608214251 >> 172.21.15.192:0/2608214251 conn(0x7f6cf40ae960 msgr2=0x7f6cf406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 -- 172.21.15.192:0/2608214251 shutdown_connections 2024-09-13T18:39:36.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.766+0000 7f6cfc800640 1 -- 172.21.15.192:0/2608214251 wait complete. 2024-09-13T18:39:36.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.768+0000 7f6cfc800640 1 Processor -- start 2024-09-13T18:39:36.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.768+0000 7f6cfc800640 1 -- start start 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf415dee0 0x7f6cf4158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf413c4f0 0x7f6cf4159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf4153d00 con 0x7f6cf40b0490 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf41345a0 con 0x7f6cf413c4f0 2024-09-13T18:39:36.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf413d060 con 0x7f6cf415dee0 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50176/0 (socket says 172.21.15.192:50176) 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 -- 172.21.15.192:0/314504212 learned_addr learned my addr 172.21.15.192:0/314504212 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9400640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf415dee0 0x7f6cf4158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cfa800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf413c4f0 0x7f6cf4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 -- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf415dee0 msgr2=0x7f6cf4158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf415dee0 0x7f6cf4158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 -- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf413c4f0 msgr2=0x7f6cf4159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf413c4f0 0x7f6cf4159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.769+0000 7f6cf9e00640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce4009400 con 0x7f6cf40b0490 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cf9e00640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c480 tx=0x7f6ce800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8005ce0 con 0x7f6cf40b0490 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce8005e40 con 0x7f6cf40b0490 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce80072f0 con 0x7f6cf40b0490 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf41347f0 con 0x7f6cf40b0490 2024-09-13T18:39:36.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.770+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf4150f30 con 0x7f6cf40b0490 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.771+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf4151120 con 0x7f6cf40b0490 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.772+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6ce8007510 con 0x7f6cf40b0490 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.773+0000 7f6cee000640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 0x7f6cd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.773+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6ce80888a0 con 0x7f6cf40b0490 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.773+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=78}) v3 -- 0x7f6cd80727f0 con 0x7f6cf40b0490 2024-09-13T18:39:36.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.773+0000 7f6cf9400640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 0x7f6cd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:36.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.774+0000 7f6cf9400640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 0x7f6cd806d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4036000 tx=0x7f6ce4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:36.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.777+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6ce8017020 con 0x7f6cf40b0490 2024-09-13T18:39:36.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.979+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cf40afd80 con 0x7f6cf40b0490 2024-09-13T18:39:36.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.980+0000 7f6cee000640 1 -- 172.21.15.192:0/314504212 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7f6ce8053ae0 con 0x7f6cf40b0490 2024-09-13T18:39:36.983 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:36.983 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:39:36.983 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 msgr2=0x7f6cd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 0x7f6cd806d0c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4036000 tx=0x7f6ce4030000 comp rx=0 tx=0).stop 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 msgr2=0x7f6cf41f2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800c480 tx=0x7f6ce800c940 comp rx=0 tx=0).stop 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 shutdown_connections 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6cd806ac00 0x7f6cd806d0c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6cf413c4f0 0x7f6cf4159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6cf415dee0 0x7f6cf4158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 --2- 172.21.15.192:0/314504212 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf40b0490 0x7f6cf41f2b70 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:36.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 >> 172.21.15.192:0/314504212 conn(0x7f6cf40ae960 msgr2=0x7f6cf4070980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:36.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 shutdown_connections 2024-09-13T18:39:36.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:36.982+0000 7f6cfc800640 1 -- 172.21.15.192:0/314504212 wait complete. 2024-09-13T18:39:37.002 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:37.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.153+0000 7fa748e00640 1 Processor -- start 2024-09-13T18:39:37.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.153+0000 7fa748e00640 1 -- start start 2024-09-13T18:39:37.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.154+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7440afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.154+0000 7fa748e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7440b2f00 con 0x7fa7440b3f10 2024-09-13T18:39:37.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.154+0000 7fa748e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7440b3150 con 0x7fa74415e2c0 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.154+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440b3430 con 0x7fa74415dee0 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa741400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa7440b3f10 0x7fa74415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51176/0 (socket says 172.21.15.192:51176) 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa741400640 1 -- 172.21.15.192:0/4107962961 learned_addr learned my addr 172.21.15.192:0/4107962961 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa741e00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7440afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495063919 0 0) 0x7fa7440b2f00 con 0x7fa7440b3f10 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa728003520 con 0x7fa7440b3f10 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3015045706 0 0) 0x7fa728003520 con 0x7fa7440b3f10 2024-09-13T18:39:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 msgr2=0x7fa7440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7440afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 >> v1:172.21.15.194:6789/0 conn(0x7fa74415e2c0 legacy=0x7fa7441637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440b3710 con 0x7fa7440b3f10 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fa730001670 con 0x7fa7440b3f10 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 >> v1:172.21.15.192:6789/0 conn(0x7fa7440b3f10 legacy=0x7fa74415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.155+0000 7fa740a00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7280039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa740a00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa728003ee0 0x7fa7280047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa740a00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728004d00 0x7fa728005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440b3430 con 0x7fa728003ee0 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72800ba30 con 0x7fa728004d00 2024-09-13T18:39:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa72800bbf0 con 0x7fa74415dee0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa728003ee0 0x7fa7280047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741e00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7280039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa742800640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728004d00 0x7fa728005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 -- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 msgr2=0x7fa7280039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74415dee0 0x7fa7280039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 -- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728004d00 msgr2=0x7fa728005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728004d00 0x7fa728005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.156+0000 7fa741400640 1 -- 172.21.15.192:0/4107962961 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa728003520 con 0x7fa728003ee0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.157+0000 7fa741400640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa728003ee0 0x7fa7280047c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c190 tx=0x7fa7280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed8ba0a11dcfe15 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.157+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730005ad0 con 0x7fa728003ee0 2024-09-13T18:39:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.157+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73002d070 con 0x7fa728003ee0 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.157+0000 7fa740a00640 1 -- 172.21.15.192:0/4107962961 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730005e70 con 0x7fa728003ee0 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 -- 172.21.15.192:0/4107962961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa728003ee0 msgr2=0x7fa7280047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 --2- 172.21.15.192:0/4107962961 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa728003ee0 0x7fa7280047c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c190 tx=0x7fa7280057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa742800640 1 -- 172.21.15.192:0/4107962961 reap_dead start 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 -- 172.21.15.192:0/4107962961 shutdown_connections 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 -- 172.21.15.192:0/4107962961 >> 172.21.15.192:0/4107962961 conn(0x7fa7440ae960 msgr2=0x7fa74406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 -- 172.21.15.192:0/4107962961 shutdown_connections 2024-09-13T18:39:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.158+0000 7fa748e00640 1 -- 172.21.15.192:0/4107962961 wait complete. 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.160+0000 7fa748e00640 1 Processor -- start 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.160+0000 7fa748e00640 1 -- start start 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728003ee0 0x7fa7440ab720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74414fd50 0x7fa7441f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7440ae540 con 0x7fa744155580 2024-09-13T18:39:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441f6e70 con 0x7fa728003ee0 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa748e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa744155d50 con 0x7fa74414fd50 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50194/0 (socket says 172.21.15.192:50194) 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 -- 172.21.15.192:0/2430900144 learned_addr learned my addr 172.21.15.192:0/2430900144 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa742800640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74414fd50 0x7fa7441f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728003ee0 0x7fa7440ab720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 -- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74414fd50 msgr2=0x7fa7441f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74414fd50 0x7fa7441f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 -- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728003ee0 msgr2=0x7fa7440ab720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728003ee0 0x7fa7440ab720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.161+0000 7fa741400640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7441589d0 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa741400640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c2b0 tx=0x7fa730001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730005b00 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730005c60 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa744155a90 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730007070 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.162+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7441586f0 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.163+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74415a440 con 0x7fa744155580 2024-09-13T18:39:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.164+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa73002f030 con 0x7fa744155580 2024-09-13T18:39:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.165+0000 7fa73a000640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.165+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa7300a9350 con 0x7fa744155580 2024-09-13T18:39:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.166+0000 7fa741e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.166+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7fa7240727f0 con 0x7fa744155580 2024-09-13T18:39:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.166+0000 7fa741e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c40 tx=0x7fa734009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.169+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa730074590 con 0x7fa744155580 2024-09-13T18:39:37.223 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:37.227 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:39:37.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.379+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa74413ce40 con 0x7fa744155580 2024-09-13T18:39:37.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.380+0000 7fa73a000640 1 -- 172.21.15.192:0/2430900144 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4737 (secure 0 0 0) 0x7fa730041070 con 0x7fa744155580 2024-09-13T18:39:37.383 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:37.383 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:38:17.717892+0000","modified":"2024-09-13T18:38:20.741559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6033},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6033":{"gid":6033,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6836/2146307069","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2146307069},{"type":"v1","addr":"172.21.15.192:6836","nonce":2146307069}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-09-13T18:39:37.383 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 32 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 msgr2=0x7fa72406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fa734009c40 tx=0x7fa734009190 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 msgr2=0x7fa7440ae000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa73000c2b0 tx=0x7fa730001930 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 shutdown_connections 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa74414fd50 0x7fa7441f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa744155580 0x7fa7440ae000 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 --2- 172.21.15.192:0/2430900144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa728003ee0 0x7fa7440ab720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 >> 172.21.15.192:0/2430900144 conn(0x7fa7440ae960 msgr2=0x7fa7440b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:37.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 shutdown_connections 2024-09-13T18:39:37.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.382+0000 7fa748e00640 1 -- 172.21.15.192:0/2430900144 wait complete. 2024-09-13T18:39:37.401 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:37.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.549+0000 7f32ff200640 1 Processor -- start 2024-09-13T18:39:37.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.549+0000 7f32ff200640 1 -- start start 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.550+0000 7f32ff200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33001592d0 0x7f3300070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.550+0000 7f32ff200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33000b3600 0x7f33000b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.550+0000 7f32ff200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330006f830 con 0x7f330006bca0 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.550+0000 7f32ff200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33000b3fb0 con 0x7f33001592d0 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.550+0000 7f32ff200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330006fa80 con 0x7f33000b3600 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33001592d0 0x7f3300070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33001592d0 0x7f3300070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50206/0 (socket says 172.21.15.192:50206) 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 -- 172.21.15.192:0/3848822965 learned_addr learned my addr 172.21.15.192:0/3848822965 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fd400640 1 --2- 172.21.15.192:0/3848822965 >> v2:172.21.15.194:3300/0 conn(0x7f33000b3600 0x7f33000b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 -- 172.21.15.192:0/3848822965 >> v2:172.21.15.194:3300/0 conn(0x7f33000b3600 msgr2=0x7f33000b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 --2- 172.21.15.192:0/3848822965 >> v2:172.21.15.194:3300/0 conn(0x7f33000b3600 0x7f33000b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 -- 172.21.15.192:0/3848822965 >> v1:172.21.15.194:6789/0 conn(0x7f330006bca0 legacy=0x7f330006c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.551+0000 7f32fde00640 1 -- 172.21.15.192:0/3848822965 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330006fd60 con 0x7f33001592d0 2024-09-13T18:39:37.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.552+0000 7f32fde00640 1 --2- 172.21.15.192:0/3848822965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f3300070b20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f330006cc90 tx=0x7f32f002b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bc56a132c66aa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.552+0000 7f32fca00640 1 -- 172.21.15.192:0/3848822965 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0030710 con 0x7f33001592d0 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.552+0000 7f32fca00640 1 -- 172.21.15.192:0/3848822965 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f002e050 con 0x7f33001592d0 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.552+0000 7f32fca00640 1 -- 172.21.15.192:0/3848822965 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0030a90 con 0x7f33001592d0 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 -- 172.21.15.192:0/3848822965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 msgr2=0x7f3300070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 --2- 172.21.15.192:0/3848822965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f3300070b20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f330006cc90 tx=0x7f32f002b630 comp rx=0 tx=0).stop 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 -- 172.21.15.192:0/3848822965 shutdown_connections 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 --2- 172.21.15.192:0/3848822965 >> v2:172.21.15.194:3300/0 conn(0x7f33000b3600 0x7f33000b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 --2- 172.21.15.192:0/3848822965 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f3300070b20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 -- 172.21.15.192:0/3848822965 >> 172.21.15.192:0/3848822965 conn(0x7f33000736d0 msgr2=0x7f33000b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 -- 172.21.15.192:0/3848822965 shutdown_connections 2024-09-13T18:39:37.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.553+0000 7f32ff200640 1 -- 172.21.15.192:0/3848822965 wait complete. 2024-09-13T18:39:37.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.555+0000 7f32ff200640 1 Processor -- start 2024-09-13T18:39:37.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.555+0000 7f32ff200640 1 -- start start 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.555+0000 7f32ff200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f330006bca0 0x7f33001500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.555+0000 7f32ff200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33000b3600 0x7f33000ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32ff200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32ff200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33001de740 con 0x7f33001592d0 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32ff200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33000ac350 con 0x7f330006bca0 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32ff200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33000ac630 con 0x7f33000b3600 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50220/0 (socket says 172.21.15.192:50220) 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 -- 172.21.15.192:0/1336150169 learned_addr learned my addr 172.21.15.192:0/1336150169 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fd400640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33000b3600 0x7f33000ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fde00640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f330006bca0 0x7f33001500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 -- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33000b3600 msgr2=0x7f33000ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33000b3600 0x7f33000ad3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 -- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f330006bca0 msgr2=0x7f33001500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f330006bca0 0x7f33001500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.556+0000 7f32fe800640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f000a670 con 0x7f33001592d0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32fe800640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7a0 tx=0x7f32f800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8003b70 con 0x7f33001592d0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8003cf0 con 0x7f33001592d0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8003ea0 con 0x7f33001592d0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33000ac910 con 0x7f33001592d0 2024-09-13T18:39:37.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.557+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33000aced0 con 0x7f33001592d0 2024-09-13T18:39:37.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.558+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33000ad0f0 con 0x7f33001592d0 2024-09-13T18:39:37.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.559+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f32f800aa90 con 0x7f33001592d0 2024-09-13T18:39:37.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.560+0000 7f32f6000640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 0x7f32e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.560+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f32f80890c0 con 0x7f33001592d0 2024-09-13T18:39:37.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.560+0000 7f32fde00640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 0x7f32e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.560+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f32e00727f0 con 0x7f33001592d0 2024-09-13T18:39:37.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.561+0000 7f32fde00640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 0x7f32e006d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f32f0035000 tx=0x7f32f0034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.564+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f32f8054310 con 0x7f33001592d0 2024-09-13T18:39:37.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.732+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33000b3a70 con 0x7f33001592d0 2024-09-13T18:39:37.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.734+0000 7f32f6000640 1 -- 172.21.15.192:0/1336150169 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+16743 (secure 0 0 0) 0x7f32f8057930 con 0x7f33001592d0 2024-09-13T18:39:37.737 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:37.737 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:36.991766+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:38:15.686427+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-13T18:38:16.717080+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"9.1d","mappings":[{"from":6,"to":1}]},{"pgid":"9.1e","mappings":[{"from":6,"to":4}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 msgr2=0x7f32e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 0x7f32e006d0c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f32f0035000 tx=0x7f32f0034040 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 msgr2=0x7f33000ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c7a0 tx=0x7f32f800cc60 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 shutdown_connections 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32e006ac00 0x7f32e006d0c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33001592d0 0x7f33000ad930 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33000b3600 0x7f33000ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 --2- 172.21.15.192:0/1336150169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f330006bca0 0x7f33001500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 >> 172.21.15.192:0/1336150169 conn(0x7f33000736d0 msgr2=0x7f33000b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 shutdown_connections 2024-09-13T18:39:37.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.736+0000 7f32ff200640 1 -- 172.21.15.192:0/1336150169 wait complete. 2024-09-13T18:39:37.756 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:39:37.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.906+0000 7f85c3e00640 1 Processor -- start 2024-09-13T18:39:37.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.906+0000 7f85c3e00640 1 -- start start 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 0x7f85c40b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85c406bea0 0x7f85c40b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c4159a90 con 0x7f85c4156af0 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c4071d50 con 0x7f85c406bea0 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c406eba0 con 0x7f85c4156ed0 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c2a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f85c4156af0 0x7f85c4071640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:51192/0 (socket says 172.21.15.192:51192) 2024-09-13T18:39:37.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c2a00640 1 -- 172.21.15.192:0/2557283967 learned_addr learned my addr 172.21.15.192:0/2557283967 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:37.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.907+0000 7f85c3400640 1 --2- 172.21.15.192:0/2557283967 >> v2:172.21.15.192:3300/0 conn(0x7f85c406bea0 0x7f85c40b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c2000640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 0x7f85c40b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c1600640 1 -- 172.21.15.192:0/2557283967 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465536434 0 0) 0x7f85c4159a90 con 0x7f85c4156af0 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c3400640 1 -- 172.21.15.192:0/2557283967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 msgr2=0x7f85c40b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c3400640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 0x7f85c40b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c3400640 1 -- 172.21.15.192:0/2557283967 >> v1:172.21.15.192:6789/0 conn(0x7f85c4156af0 legacy=0x7f85c4071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c3400640 1 -- 172.21.15.192:0/2557283967 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4159d70 con 0x7f85c406bea0 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.908+0000 7f85c2000640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 0x7f85c40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.909+0000 7f85c3400640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c406bea0 0x7f85c40b3b40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00aea0 tx=0x7f85bc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33712c8848817106 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.909+0000 7f85c1600640 1 -- 172.21.15.192:0/2557283967 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc02f050 con 0x7f85c406bea0 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.909+0000 7f85c1600640 1 -- 172.21.15.192:0/2557283967 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85bc008640 con 0x7f85c406bea0 2024-09-13T18:39:37.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.909+0000 7f85c1600640 1 -- 172.21.15.192:0/2557283967 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85bc0089d0 con 0x7f85c406bea0 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 -- 172.21.15.192:0/2557283967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c406bea0 msgr2=0x7f85c40b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c406bea0 0x7f85c40b3b40 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00aea0 tx=0x7f85bc02b840 comp rx=0 tx=0).stop 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 -- 172.21.15.192:0/2557283967 shutdown_connections 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c406bea0 0x7f85c40b3b40 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 --2- 172.21.15.192:0/2557283967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c4156ed0 0x7f85c40b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 -- 172.21.15.192:0/2557283967 >> 172.21.15.192:0/2557283967 conn(0x7f85c40736d0 msgr2=0x7f85c40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 -- 172.21.15.192:0/2557283967 shutdown_connections 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.910+0000 7f85c3e00640 1 -- 172.21.15.192:0/2557283967 wait complete. 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.911+0000 7f85c3e00640 1 Processor -- start 2024-09-13T18:39:37.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.911+0000 7f85c3e00640 1 -- start start 2024-09-13T18:39:37.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c406bea0 0x7f85c41526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4156ed0 0x7f85c40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4152c10 con 0x7f85c4156af0 2024-09-13T18:39:37.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415d930 con 0x7f85c4156ed0 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.912+0000 7f85c3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c415d4a0 con 0x7f85c406bea0 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50250/0 (socket says 172.21.15.192:50250) 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 -- 172.21.15.192:0/827885784 learned_addr learned my addr 172.21.15.192:0/827885784 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2a00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c406bea0 0x7f85c41526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c3400640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4156ed0 0x7f85c40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 -- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c406bea0 msgr2=0x7f85c41526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c406bea0 0x7f85c41526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 -- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4156ed0 msgr2=0x7f85c40cb980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:37.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4156ed0 0x7f85c40cb980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85bc00ab80 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.913+0000 7f85c2000640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f85b000d800 tx=0x7f85b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.914+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0004030 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.914+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0004190 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.914+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0004500 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.914+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4163820 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.914+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c415ce50 con 0x7f85c4156af0 2024-09-13T18:39:37.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.915+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c4071640 con 0x7f85c4156af0 2024-09-13T18:39:37.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.916+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b00096a0 con 0x7f85c4156af0 2024-09-13T18:39:37.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.916+0000 7f85bb400640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 0x7f85a406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:37.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.917+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f85b0089420 con 0x7f85c4156af0 2024-09-13T18:39:37.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.917+0000 7f85c2a00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 0x7f85a406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:37.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.917+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=79}) v3 -- 0x7f85a4072820 con 0x7f85c4156af0 2024-09-13T18:39:37.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.917+0000 7f85c2a00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 0x7f85a406d0f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000f60 tx=0x7f85b4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:37.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:37.921+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85b00545d0 con 0x7f85c4156af0 2024-09-13T18:39:38.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.003+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(79..79 src has 1..79) v4 ==== 1468+0+0 (secure 0 0 0) 0x7f85b0058290 con 0x7f85c4156af0 2024-09-13T18:39:38.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.003+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=80}) v3 -- 0x7f85a4073a90 con 0x7f85c4156af0 2024-09-13T18:39:38.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.127+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f85c4165b20 con 0x7f85c4156af0 2024-09-13T18:39:38.130 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:39:38.128+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:39:38.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.135+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 8 ==== osd_map(80..80 src has 1..80) v4 ==== 374+0+0 (secure 0 0 0) 0x7f85b00605d0 con 0x7f85c4156af0 2024-09-13T18:39:38.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.141+0000 7f85bb400640 1 -- 172.21.15.192:0/827885784 <== mon.0 v2:172.21.15.192:3300/0 9 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f85b0057bf0 con 0x7f85c4156af0 2024-09-13T18:39:38.144 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:39:38.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 msgr2=0x7f85a406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 0x7f85a406d0f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f85b4000f60 tx=0x7f85b4007d50 comp rx=0 tx=0).stop 2024-09-13T18:39:38.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 msgr2=0x7f85c4162d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f85b000d800 tx=0x7f85b000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 shutdown_connections 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85a406ac30 0x7f85a406d0f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85c4156ed0 0x7f85c40cb980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85c4156af0 0x7f85c4162d80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.143+0000 7f85c3e00640 1 --2- 172.21.15.192:0/827885784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85c406bea0 0x7f85c41526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.144+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 >> 172.21.15.192:0/827885784 conn(0x7f85c40736d0 msgr2=0x7f85c4155b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.144+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 shutdown_connections 2024-09-13T18:39:38.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.144+0000 7f85c3e00640 1 -- 172.21.15.192:0/827885784 wait complete. 2024-09-13T18:39:38.163 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:39:38.210 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:39:38.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.318+0000 7f873d000640 1 Processor -- start 2024-09-13T18:39:38.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.318+0000 7f873d000640 1 -- start start 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f873d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8738144730 0x7f873815b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f873d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 0x7f873806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f873d000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8738071ab0 con 0x7f873806e990 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f873d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87380714f0 con 0x7f8738144730 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f873d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87380717d0 con 0x7f87380cdef0 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f8737400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8738144730 0x7f873815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f8737400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8738144730 0x7f873815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50276/0 (socket says 172.21.15.192:50276) 2024-09-13T18:39:38.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.319+0000 7f8737400640 1 -- 172.21.15.192:0/856053282 learned_addr learned my addr 172.21.15.192:0/856053282 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:38.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737400640 1 -- 172.21.15.192:0/856053282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 msgr2=0x7f873806ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:38.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737e00640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 0x7f873806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8736a00640 1 -- 172.21.15.192:0/856053282 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807451295 0 0) 0x7f8738071ab0 con 0x7f873806e990 2024-09-13T18:39:38.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737400640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 0x7f873806ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737400640 1 -- 172.21.15.192:0/856053282 >> v1:172.21.15.192:6789/0 conn(0x7f873806e990 legacy=0x7f87380cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737400640 1 -- 172.21.15.192:0/856053282 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f873806a510 con 0x7f8738144730 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.320+0000 7f8737e00640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 0x7f873806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f8737400640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873815b100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8728009870 tx=0x7f872802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94498382fb8e7084 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f8736a00640 1 -- 172.21.15.192:0/856053282 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728032440 con 0x7f8738144730 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f8736a00640 1 -- 172.21.15.192:0/856053282 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87280325a0 con 0x7f8738144730 2024-09-13T18:39:38.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f8736a00640 1 -- 172.21.15.192:0/856053282 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728032930 con 0x7f8738144730 2024-09-13T18:39:38.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f873d000640 1 -- 172.21.15.192:0/856053282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 msgr2=0x7f873815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.321+0000 7f873d000640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873815b100 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8728009870 tx=0x7f872802a250 comp rx=0 tx=0).stop 2024-09-13T18:39:38.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 -- 172.21.15.192:0/856053282 shutdown_connections 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f87380cdef0 0x7f873806ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 --2- 172.21.15.192:0/856053282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873815b100 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 -- 172.21.15.192:0/856053282 >> 172.21.15.192:0/856053282 conn(0x7f87380736d0 msgr2=0x7f87380b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 -- 172.21.15.192:0/856053282 shutdown_connections 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.322+0000 7f873d000640 1 -- 172.21.15.192:0/856053282 wait complete. 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.323+0000 7f873d000640 1 Processor -- start 2024-09-13T18:39:38.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 -- start start 2024-09-13T18:39:38.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f873806e990 0x7f87381e35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 0x7f87380adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87380c4530 con 0x7f8738144730 2024-09-13T18:39:38.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87381e3b00 con 0x7f87380cdef0 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.324+0000 7f873d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87381e3da0 con 0x7f873806e990 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50286/0 (socket says 172.21.15.192:50286) 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 -- 172.21.15.192:0/346341317 learned_addr learned my addr 172.21.15.192:0/346341317 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737400640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f873806e990 0x7f87381e35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f872ea00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 0x7f87380adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 -- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f873806e990 msgr2=0x7f87381e35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f873806e990 0x7f87381e35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 -- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 msgr2=0x7f87380adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 0x7f87380adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:38.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 -- 172.21.15.192:0/346341317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87280094d0 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f872ea00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 0x7f87380adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.325+0000 7f8737e00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f873000cef0 tx=0x7f873000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.326+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000d840 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.326+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f873000d9c0 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.326+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f873000dd70 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.326+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87381e4080 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.326+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87381e4640 con 0x7f8738144730 2024-09-13T18:39:38.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.327+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f873806ede0 con 0x7f8738144730 2024-09-13T18:39:38.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.328+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f873001e3b0 con 0x7f8738144730 2024-09-13T18:39:38.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.329+0000 7f872fe00640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 0x7f871406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:38.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.329+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8730089e20 con 0x7f8738144730 2024-09-13T18:39:38.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.329+0000 7f8737400640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 0x7f871406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:38.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.330+0000 7f8737400640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 0x7f871406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8728034000 tx=0x7f872802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:38.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.333+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87300550d0 con 0x7f8738144730 2024-09-13T18:39:38.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:38.536+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87380668d0 con 0x7f8738144730 2024-09-13T18:39:39.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.146+0000 7f872fe00640 1 -- 172.21.15.192:0/346341317 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f873001a0a0 con 0x7f8738144730 2024-09-13T18:39:39.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 msgr2=0x7f871406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 0x7f871406d0c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8728034000 tx=0x7f872802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 msgr2=0x7f873813ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f873000cef0 tx=0x7f873000a710 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 shutdown_connections 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f871406ac00 0x7f871406d0c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8738144730 0x7f873813ff80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87380cdef0 0x7f87380adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 --2- 172.21.15.192:0/346341317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f873806e990 0x7f87381e35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.149+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 >> 172.21.15.192:0/346341317 conn(0x7f87380736d0 msgr2=0x7f87380b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.150+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 shutdown_connections 2024-09-13T18:39:39.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.150+0000 7f873d000640 1 -- 172.21.15.192:0/346341317 wait complete. 2024-09-13T18:39:39.169 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:39:39.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.324+0000 7f858c600640 1 Processor -- start 2024-09-13T18:39:39.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.325+0000 7f858c600640 1 -- start start 2024-09-13T18:39:39.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f85840b3700 0x7f85840b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f858406bcf0 0x7f858406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f858406a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85840b4020 con 0x7f858406bcf0 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8584159b60 con 0x7f85840b3700 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8584159e40 con 0x7f8584069ea0 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f8589200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f858406bcf0 0x7f858406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f8589200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f858406bcf0 0x7f858406c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50292/0 (socket says 172.21.15.192:50292) 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f8589200640 1 -- 172.21.15.192:0/4158355631 learned_addr learned my addr 172.21.15.192:0/4158355631 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f8589c00640 1 --2- 172.21.15.192:0/4158355631 >> v2:172.21.15.194:3300/0 conn(0x7f85840b3700 0x7f85840b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.326+0000 7f858a600640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f858406a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.327+0000 7f8589200640 1 -- 172.21.15.192:0/4158355631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 msgr2=0x7f858406a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:39.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.327+0000 7f8589200640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f858406a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.327+0000 7f8589200640 1 -- 172.21.15.192:0/4158355631 >> v2:172.21.15.194:3300/0 conn(0x7f85840b3700 msgr2=0x7f85840b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:39.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.327+0000 7f8589200640 1 --2- 172.21.15.192:0/4158355631 >> v2:172.21.15.194:3300/0 conn(0x7f85840b3700 0x7f85840b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.327+0000 7f8589200640 1 -- 172.21.15.192:0/4158355631 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858415a120 con 0x7f858406bcf0 2024-09-13T18:39:39.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f8589200640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858406bcf0 0x7f858406c160 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8570009870 tx=0x7f857002c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44137c38a6341e42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:39.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f8583e00640 1 -- 172.21.15.192:0/4158355631 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570031710 con 0x7f858406bcf0 2024-09-13T18:39:39.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f8583e00640 1 -- 172.21.15.192:0/4158355631 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857002f050 con 0x7f858406bcf0 2024-09-13T18:39:39.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f8583e00640 1 -- 172.21.15.192:0/4158355631 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570031a90 con 0x7f858406bcf0 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 -- 172.21.15.192:0/4158355631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858406bcf0 msgr2=0x7f858406c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858406bcf0 0x7f858406c160 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f8570009870 tx=0x7f857002c420 comp rx=0 tx=0).stop 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 -- 172.21.15.192:0/4158355631 shutdown_connections 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f858406a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 --2- 172.21.15.192:0/4158355631 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f858406bcf0 0x7f858406c160 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.328+0000 7f858c600640 1 --2- 172.21.15.192:0/4158355631 >> v2:172.21.15.194:3300/0 conn(0x7f85840b3700 0x7f85840b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.329+0000 7f858c600640 1 -- 172.21.15.192:0/4158355631 >> 172.21.15.192:0/4158355631 conn(0x7f85840b0c40 msgr2=0x7f85840b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.329+0000 7f858c600640 1 -- 172.21.15.192:0/4158355631 shutdown_connections 2024-09-13T18:39:39.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.329+0000 7f858c600640 1 -- 172.21.15.192:0/4158355631 wait complete. 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.330+0000 7f858c600640 1 Processor -- start 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.330+0000 7f858c600640 1 -- start start 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f85841f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f858406bcf0 0x7f85840a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8584148260 con 0x7f85840b3700 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85841429c0 con 0x7f858406bcf0 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.331+0000 7f858c600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8584142ca0 con 0x7f8584069ea0 2024-09-13T18:39:39.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:50296/0 (socket says 172.21.15.192:50296) 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 -- 172.21.15.192:0/732000765 learned_addr learned my addr 172.21.15.192:0/732000765 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f8589c00640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f85841f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f8589200640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f858406bcf0 0x7f85840a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 -- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 msgr2=0x7f85841f2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f85841f2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 -- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f858406bcf0 msgr2=0x7f85840a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f858406bcf0 0x7f85840a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:39.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 -- 172.21.15.192:0/732000765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700094d0 con 0x7f85840b3700 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f858a600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f857c007e60 tx=0x7f857c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.332+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c014620 con 0x7f85840b3700 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.333+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c00ee90 con 0x7f85840b3700 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.333+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0149e0 con 0x7f85840b3700 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.333+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8584142f80 con 0x7f85840b3700 2024-09-13T18:39:39.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.333+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8584143540 con 0x7f85840b3700 2024-09-13T18:39:39.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.334+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85841436d0 con 0x7f85840b3700 2024-09-13T18:39:39.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.334+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f857c014b40 con 0x7f85840b3700 2024-09-13T18:39:39.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.335+0000 7f8581600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:39.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.335+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f857c089c80 con 0x7f85840b3700 2024-09-13T18:39:39.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.336+0000 7f8589c00640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:39.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.336+0000 7f8589c00640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 0x7f856406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f857800baf0 tx=0x7f8578008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:39.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.340+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f857c054de0 con 0x7f85840b3700 2024-09-13T18:39:39.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:39.506+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8584159790 con 0x7f85840b3700 2024-09-13T18:39:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.148+0000 7f8581600640 1 -- 172.21.15.192:0/732000765 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v81) v1 ==== 181+0+0 (secure 0 0 0) 0x7f857c058400 con 0x7f85840b3700 2024-09-13T18:39:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 msgr2=0x7f856406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 0x7f856406d0c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f857800baf0 tx=0x7f8578008040 comp rx=0 tx=0).stop 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 msgr2=0x7f85840a9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f857c007e60 tx=0x7f857c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 shutdown_connections 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f856406ac00 0x7f856406d0c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85840b3700 0x7f85840a9970 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f858406bcf0 0x7f85840a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 --2- 172.21.15.192:0/732000765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8584069ea0 0x7f85841f2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 >> 172.21.15.192:0/732000765 conn(0x7f85840b0c40 msgr2=0x7f85840cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:40.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 shutdown_connections 2024-09-13T18:39:40.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.151+0000 7f858c600640 1 -- 172.21.15.192:0/732000765 wait complete. 2024-09-13T18:39:40.174 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:39:40.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 Processor -- start 2024-09-13T18:39:40.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 -- start start 2024-09-13T18:39:40.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e140b8040 0x7f1e140d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cdf30 0x7f1e140d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e140d2ae0 con 0x7f1e140cd440 2024-09-13T18:39:40.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e140b6c10 con 0x7f1e140b8040 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e13e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415d330 con 0x7f1e140cdf30 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e12000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e140b8040 0x7f1e140d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e12000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e140b8040 0x7f1e140d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59636/0 (socket says 172.21.15.192:59636) 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.329+0000 7f1e12000640 1 -- 172.21.15.192:0/2027121865 learned_addr learned my addr 172.21.15.192:0/2027121865 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.330+0000 7f1e13400640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cdf30 0x7f1e140d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.330+0000 7f1e12000640 1 -- 172.21.15.192:0/2027121865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cdf30 msgr2=0x7f1e140d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.330+0000 7f1e12000640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cdf30 0x7f1e140d25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.330+0000 7f1e12000640 1 -- 172.21.15.192:0/2027121865 >> v1:172.21.15.194:6789/0 conn(0x7f1e140cd440 legacy=0x7f1e140cd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.330+0000 7f1e12000640 1 -- 172.21.15.192:0/2027121865 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e140b5f90 con 0x7f1e140b8040 2024-09-13T18:39:40.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.331+0000 7f1e12000640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140b8040 0x7f1e140d2060 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e0002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2506ad891ef665c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:40.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.331+0000 7f1e11600640 1 -- 172.21.15.192:0/2027121865 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00032440 con 0x7f1e140b8040 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.331+0000 7f1e11600640 1 -- 172.21.15.192:0/2027121865 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e000325a0 con 0x7f1e140b8040 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.331+0000 7f1e11600640 1 -- 172.21.15.192:0/2027121865 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e00032930 con 0x7f1e140b8040 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 -- 172.21.15.192:0/2027121865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140b8040 msgr2=0x7f1e140d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140b8040 0x7f1e140d2060 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009870 tx=0x7f1e0002a250 comp rx=0 tx=0).stop 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 -- 172.21.15.192:0/2027121865 shutdown_connections 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cdf30 0x7f1e140d25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 --2- 172.21.15.192:0/2027121865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140b8040 0x7f1e140d2060 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 -- 172.21.15.192:0/2027121865 >> 172.21.15.192:0/2027121865 conn(0x7f1e140b48e0 msgr2=0x7f1e140b4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:40.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 -- 172.21.15.192:0/2027121865 shutdown_connections 2024-09-13T18:39:40.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.332+0000 7f1e13e00640 1 -- 172.21.15.192:0/2027121865 wait complete. 2024-09-13T18:39:40.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.333+0000 7f1e13e00640 1 Processor -- start 2024-09-13T18:39:40.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.333+0000 7f1e13e00640 1 -- start start 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e140b8040 0x7f1e1406a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cd440 0x7f1e140c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e14150a80 con 0x7f1e140cdf30 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1415b540 con 0x7f1e140b8040 2024-09-13T18:39:40.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.334+0000 7f1e13e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1406aca0 con 0x7f1e140cd440 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59640/0 (socket says 172.21.15.192:59640) 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 -- 172.21.15.192:0/3050953657 learned_addr learned my addr 172.21.15.192:0/3050953657 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e12000640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cd440 0x7f1e140c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e12a00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e140b8040 0x7f1e1406a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 -- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cd440 msgr2=0x7f1e140c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cd440 0x7f1e140c8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 -- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e140b8040 msgr2=0x7f1e1406a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e140b8040 0x7f1e1406a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 -- 172.21.15.192:0/3050953657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e000094d0 con 0x7f1e140cdf30 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13400640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007dc0 tx=0x7f1e0c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:40.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c014420 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e0c0145a0 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c014950 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.335+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1406aa20 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.336+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1415ac10 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.336+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e140cd820 con 0x7f1e140cdf30 2024-09-13T18:39:40.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.337+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e0c014ab0 con 0x7f1e140cdf30 2024-09-13T18:39:40.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.338+0000 7f1e0aa00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 0x7f1df406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:40.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.338+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f1e0c089a70 con 0x7f1e140cdf30 2024-09-13T18:39:40.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.338+0000 7f1e12a00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 0x7f1df406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:40.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.339+0000 7f1e12a00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 0x7f1df406d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1e141f6320 tx=0x7f1e04009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:40.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.343+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e0c054e10 con 0x7f1e140cdf30 2024-09-13T18:39:40.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:40.511+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e1415b680 con 0x7f1e140cdf30 2024-09-13T18:39:41.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.158+0000 7f1e0aa00640 1 -- 172.21.15.192:0/3050953657 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v82) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e0c058430 con 0x7f1e140cdf30 2024-09-13T18:39:41.160 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 msgr2=0x7f1df406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 0x7f1df406d0c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1e141f6320 tx=0x7f1e04009040 comp rx=0 tx=0).stop 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 msgr2=0x7f1e140d1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c007dc0 tx=0x7f1e0c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 shutdown_connections 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1df406ac00 0x7f1df406d0c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e140cdf30 0x7f1e140d1160 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e140cd440 0x7f1e140c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 --2- 172.21.15.192:0/3050953657 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e140b8040 0x7f1e1406a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 >> 172.21.15.192:0/3050953657 conn(0x7f1e140b48e0 msgr2=0x7f1e140b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:41.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 shutdown_connections 2024-09-13T18:39:41.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.162+0000 7f1e13e00640 1 -- 172.21.15.192:0/3050953657 wait complete. 2024-09-13T18:39:41.182 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:39:41.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.340+0000 7f9fefc00640 1 Processor -- start 2024-09-13T18:39:41.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.340+0000 7f9fefc00640 1 -- start start 2024-09-13T18:39:41.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.341+0000 7f9fefc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9fe80b2600 0x7f9fe80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.341+0000 7f9fefc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe80ae1d0 con 0x7f9fe80add80 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.341+0000 7f9fefc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe8161510 con 0x7f9fe815a910 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.341+0000 7f9fefc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80b21e0 con 0x7f9fe80b2600 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fedc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9fe80add80 0x7f9fe80cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38034/0 (socket says 172.21.15.192:38034) 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fedc00640 1 -- 172.21.15.192:0/688212514 learned_addr learned my addr 172.21.15.192:0/688212514 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/688212514 >> v2:172.21.15.194:3300/0 conn(0x7f9fe80b2600 0x7f9fe80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1036774792 0 0) 0x7f9fe0001490 con 0x7f9fe80add80 2024-09-13T18:39:41.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fd0003520 con 0x7f9fe80add80 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2362014247 0 0) 0x7f9fd0003520 con 0x7f9fe80add80 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 >> v2:172.21.15.194:3300/0 conn(0x7f9fe80b2600 msgr2=0x7f9fe80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 --2- 172.21.15.192:0/688212514 >> v2:172.21.15.194:3300/0 conn(0x7f9fe80b2600 0x7f9fe80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 >> v1:172.21.15.194:6789/0 conn(0x7f9fe815a910 legacy=0x7f9fe8160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe81617f0 con 0x7f9fe80add80 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f9fe0001b80 con 0x7f9fe80add80 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 >> v1:172.21.15.192:6789/0 conn(0x7f9fe80add80 legacy=0x7f9fe80cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd0003970 0x7f9fd0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 0x7f9fd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd0005180 0x7f9fd000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80b21e0 con 0x7f9fd00047c0 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd000c120 con 0x7f9fd0003970 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.342+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd000c2e0 con 0x7f9fd0005180 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 0x7f9fd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fed200640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd0003970 0x7f9fd0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fedc00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd0005180 0x7f9fd000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 -- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd0005180 msgr2=0x7f9fd000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd0005180 0x7f9fd000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 -- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd0003970 msgr2=0x7f9fd0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fd0003970 0x7f9fd0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fe7e00640 1 -- 172.21.15.192:0/688212514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd0003520 con 0x7f9fd00047c0 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fedc00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd0005180 0x7f9fd000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.343+0000 7f9fedc00640 1 -- 172.21.15.192:0/688212514 reap_dead start 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.344+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 0x7f9fd0004c40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009ac0 tx=0x7f9fd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b884f4f15feb481 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.344+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4031400 con 0x7f9fd00047c0 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.344+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd402d050 con 0x7f9fd00047c0 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.344+0000 7f9fe7400640 1 -- 172.21.15.192:0/688212514 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd4031780 con 0x7f9fd00047c0 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 -- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 msgr2=0x7f9fd0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 0x7f9fd0004c40 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f9fd4009ac0 tx=0x7f9fd00057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 -- 172.21.15.192:0/688212514 shutdown_connections 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 --2- 172.21.15.192:0/688212514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fd00047c0 0x7f9fd0004c40 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 -- 172.21.15.192:0/688212514 >> 172.21.15.192:0/688212514 conn(0x7f9fe80b08f0 msgr2=0x7f9fe80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 -- 172.21.15.192:0/688212514 shutdown_connections 2024-09-13T18:39:41.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.345+0000 7f9fefc00640 1 -- 172.21.15.192:0/688212514 wait complete. 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.347+0000 7f9fefc00640 1 Processor -- start 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.347+0000 7f9fefc00640 1 -- start start 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 0x7f9fe81f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 0x7f9fe806f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815e990 con 0x7f9fe8070c20 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe806f5d0 con 0x7f9fe806ec10 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fefc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe815eba0 con 0x7f9fd00047c0 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59660/0 (socket says 172.21.15.192:59660) 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 -- 172.21.15.192:0/3802612357 learned_addr learned my addr 172.21.15.192:0/3802612357 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fed200640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 0x7f9fe81f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 0x7f9fe806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 -- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 msgr2=0x7f9fe81f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 0x7f9fe81f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 -- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 msgr2=0x7f9fe806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 0x7f9fe806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fedc00640 1 -- 172.21.15.192:0/3802612357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe815ee80 con 0x7f9fe8070c20 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fed200640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 0x7f9fe81f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.348+0000 7f9fe7e00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 0x7f9fe806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fedc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001370 tx=0x7f9fe0007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000e960 con 0x7f9fe8070c20 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000eac0 con 0x7f9fe8070c20 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe815f160 con 0x7f9fe8070c20 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000ee70 con 0x7f9fe8070c20 2024-09-13T18:39:41.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.349+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80715e0 con 0x7f9fe8070c20 2024-09-13T18:39:41.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.350+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe8067490 con 0x7f9fe8070c20 2024-09-13T18:39:41.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.351+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9fe001e460 con 0x7f9fe8070c20 2024-09-13T18:39:41.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.352+0000 7f9fe4c00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 0x7f9fc806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.352+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9fe0089140 con 0x7f9fe8070c20 2024-09-13T18:39:41.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.352+0000 7f9fed200640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 0x7f9fc806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.353+0000 7f9fed200640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 0x7f9fc806d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fe81604e0 tx=0x7f9fdc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.356+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9fe0054580 con 0x7f9fe8070c20 2024-09-13T18:39:41.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.524+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9fe80ae1d0 con 0x7f9fe8070c20 2024-09-13T18:39:41.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.529+0000 7f9fe4c00640 1 -- 172.21.15.192:0/3802612357 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9fe80ae1d0 con 0x7f9fe8070c20 2024-09-13T18:39:41.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 msgr2=0x7f9fc806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 0x7f9fc806d0f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9fe81604e0 tx=0x7f9fdc009040 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 msgr2=0x7f9fe80710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f9fe0001370 tx=0x7f9fe0007b00 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 shutdown_connections 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9fc806ac30 0x7f9fc806d0f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9fe8070c20 0x7f9fe80710a0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9fe806ec10 0x7f9fe806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 --2- 172.21.15.192:0/3802612357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9fd00047c0 0x7f9fe81f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 >> 172.21.15.192:0/3802612357 conn(0x7f9fe80b08f0 msgr2=0x7f9fe80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 shutdown_connections 2024-09-13T18:39:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.531+0000 7f9fefc00640 1 -- 172.21.15.192:0/3802612357 wait complete. 2024-09-13T18:39:41.549 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2024-09-13T18:39:41.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.699+0000 7fac71e00640 1 Processor -- start 2024-09-13T18:39:41.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.699+0000 7fac71e00640 1 -- start start 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.700+0000 7fac71e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 0x7fac6c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.700+0000 7fac71e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c071dd0 con 0x7fac6c0b2230 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.700+0000 7fac71e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac6c0cb770 con 0x7fac6c150480 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.700+0000 7fac71e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c0cba50 con 0x7fac6c071810 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.700+0000 7fac6b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fac6c0b2230 0x7fac6c0cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38036/0 (socket says 172.21.15.192:38036) 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac6b400640 1 -- 172.21.15.192:0/888477477 learned_addr learned my addr 172.21.15.192:0/888477477 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:41.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac6a000640 1 --2- 172.21.15.192:0/888477477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 0x7fac6c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313883921 0 0) 0x7fac6c071dd0 con 0x7fac6c0b2230 2024-09-13T18:39:41.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003440 con 0x7fac6c0b2230 2024-09-13T18:39:41.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309245993 0 0) 0x7fac6c0cb770 con 0x7fac6c150480 2024-09-13T18:39:41.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac6c071dd0 con 0x7fac6c150480 2024-09-13T18:39:41.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac6a000640 1 -- 172.21.15.192:0/888477477 >> v1:172.21.15.194:6789/0 conn(0x7fac6c150480 legacy=0x7fac6c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac6a000640 1 -- 172.21.15.192:0/888477477 >> v1:172.21.15.192:6789/0 conn(0x7fac6c0b2230 legacy=0x7fac6c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.701+0000 7fac6a000640 1 -- 172.21.15.192:0/888477477 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac6c0cbd30 con 0x7fac6c071810 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.702+0000 7fac6a000640 1 --2- 172.21.15.192:0/888477477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 0x7fac6c0b1cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac580097d0 tx=0x7fac5802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9b808037b8075d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58032440 con 0x7fac6c071810 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac580325a0 con 0x7fac6c071810 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac69600640 1 -- 172.21.15.192:0/888477477 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac58032930 con 0x7fac6c071810 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 -- 172.21.15.192:0/888477477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 msgr2=0x7fac6c0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 --2- 172.21.15.192:0/888477477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 0x7fac6c0b1cf0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fac580097d0 tx=0x7fac5802a180 comp rx=0 tx=0).stop 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 -- 172.21.15.192:0/888477477 shutdown_connections 2024-09-13T18:39:41.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 --2- 172.21.15.192:0/888477477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c071810 0x7fac6c0b1cf0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 -- 172.21.15.192:0/888477477 >> 172.21.15.192:0/888477477 conn(0x7fac6c0ae960 msgr2=0x7fac6c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:41.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 -- 172.21.15.192:0/888477477 shutdown_connections 2024-09-13T18:39:41.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.703+0000 7fac71e00640 1 -- 172.21.15.192:0/888477477 wait complete. 2024-09-13T18:39:41.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.705+0000 7fac71e00640 1 Processor -- start 2024-09-13T18:39:41.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.705+0000 7fac71e00640 1 -- start start 2024-09-13T18:39:41.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 0x7fac6c15c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac6c150480 0x7fac6c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c146fb0 con 0x7fac6c071810 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c153890 con 0x7fac6c150480 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac71e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac6c142cf0 con 0x7fac6c0b2230 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac6aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac6aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59670/0 (socket says 172.21.15.192:59670) 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.706+0000 7fac6aa00640 1 -- 172.21.15.192:0/3111158434 learned_addr learned my addr 172.21.15.192:0/3111158434 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6a000640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 0x7fac6c15c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6b400640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac6c150480 0x7fac6c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 -- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 msgr2=0x7fac6c15c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 0x7fac6c15c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 -- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac6c150480 msgr2=0x7fac6c15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:41.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac6c150480 0x7fac6c15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:41.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 -- 172.21.15.192:0/3111158434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58009400 con 0x7fac6c071810 2024-09-13T18:39:41.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6a000640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 0x7fac6c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:41.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac6aa00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c490 tx=0x7fac5c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c0052d0 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac5c005430 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac5c012870 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac6c142fd0 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.707+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac6c143590 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.708+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6c0b1cf0 con 0x7fac6c071810 2024-09-13T18:39:41.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.709+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fac5c0129d0 con 0x7fac6c071810 2024-09-13T18:39:41.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.710+0000 7fac63400640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 0x7fac4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:41.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.710+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fac5c088d10 con 0x7fac6c071810 2024-09-13T18:39:41.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.710+0000 7fac6a000640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 0x7fac4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:41.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.711+0000 7fac6a000640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 0x7fac4c06d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac58034000 tx=0x7fac5802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:41.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.714+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fac5c08e020 con 0x7fac6c071810 2024-09-13T18:39:41.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:41.945+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fac6c0afea0 con 0x7fac6c071810 2024-09-13T18:39:42.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.160+0000 7fac63400640 1 -- 172.21.15.192:0/3111158434 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v217) v1 ==== 134+0+0 (secure 0 0 0) 0x7fac5c054150 con 0x7fac6c071810 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 msgr2=0x7fac4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 0x7fac4c06d0c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fac58034000 tx=0x7fac5802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 msgr2=0x7fac6c151360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c490 tx=0x7fac5c00c950 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 shutdown_connections 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fac4c06ac00 0x7fac4c06d0c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac6c150480 0x7fac6c15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac6c0b2230 0x7fac6c15c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 --2- 172.21.15.192:0/3111158434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac6c071810 0x7fac6c151360 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 >> 172.21.15.192:0/3111158434 conn(0x7fac6c0ae960 msgr2=0x7fac6c15d200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:42.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 shutdown_connections 2024-09-13T18:39:42.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.163+0000 7fac71e00640 1 -- 172.21.15.192:0/3111158434 wait complete. 2024-09-13T18:39:42.181 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-13T18:39:42.181 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2024-09-13T18:39:42.182 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2024-09-13T18:39:42.182 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:42.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.333+0000 7fbb06c00640 1 Processor -- start 2024-09-13T18:39:42.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.333+0000 7fbb06c00640 1 -- start start 2024-09-13T18:39:42.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbb06c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbb00146610 0x7fbb000ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbb06c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb000adf50 con 0x7fbb000b2780 2024-09-13T18:39:42.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbb06c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb000cd920 con 0x7fbb00146610 2024-09-13T18:39:42.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbb06c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000b0730 con 0x7fbb000afd80 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.334+0000 7fbaffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbb00146610 0x7fbb000ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbb00146610 0x7fbb000ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59686/0 (socket says 172.21.15.192:59686) 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 -- 172.21.15.192:0/1250455960 learned_addr learned my addr 172.21.15.192:0/1250455960 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbb04c00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 -- 172.21.15.192:0/1250455960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 msgr2=0x7fbb000b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 -- 172.21.15.192:0/1250455960 >> v1:172.21.15.194:6789/0 conn(0x7fbb000b2780 legacy=0x7fbb000ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbaffe00640 1 -- 172.21.15.192:0/1250455960 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb000ae770 con 0x7fbb00146610 2024-09-13T18:39:42.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.335+0000 7fbb04c00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.336+0000 7fbaffe00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb000ce2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00098a0 tx=0x7fbaf002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b7feef76a6988a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.336+0000 7fbafea00640 1 -- 172.21.15.192:0/1250455960 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0032440 con 0x7fbb00146610 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.336+0000 7fbafea00640 1 -- 172.21.15.192:0/1250455960 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf00325a0 con 0x7fbb00146610 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.336+0000 7fbafea00640 1 -- 172.21.15.192:0/1250455960 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf0032930 con 0x7fbb00146610 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 -- 172.21.15.192:0/1250455960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 msgr2=0x7fbb000ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb000ce2f0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fbaf00098a0 tx=0x7fbaf002a250 comp rx=0 tx=0).stop 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 -- 172.21.15.192:0/1250455960 shutdown_connections 2024-09-13T18:39:42.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1250455960 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb000ce2f0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 -- 172.21.15.192:0/1250455960 >> 172.21.15.192:0/1250455960 conn(0x7fbb000ae960 msgr2=0x7fbb0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 -- 172.21.15.192:0/1250455960 shutdown_connections 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.337+0000 7fbb06c00640 1 -- 172.21.15.192:0/1250455960 wait complete. 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.338+0000 7fbb06c00640 1 Processor -- start 2024-09-13T18:39:42.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.339+0000 7fbb06c00640 1 -- start start 2024-09-13T18:39:42.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.339+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.339+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000b2780 0x7fbb0013a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb06c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb06c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb000cb820 con 0x7fbb00146610 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb06c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0013acd0 con 0x7fbb000b2780 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb06c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb001396f0 con 0x7fbb000afd80 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59700/0 (socket says 172.21.15.192:59700) 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbaffe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 -- 172.21.15.192:0/1698432490 learned_addr learned my addr 172.21.15.192:0/1698432490 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbaff400640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000b2780 0x7fbb0013a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 -- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 msgr2=0x7fbb000cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 -- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000b2780 msgr2=0x7fbb0013a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000b2780 0x7fbb0013a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 -- 172.21.15.192:0/1698432490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaf00094d0 con 0x7fbb00146610 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.340+0000 7fbb04c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800cef0 tx=0x7fbaf800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.341+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800d840 con 0x7fbb00146610 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.341+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaf800d9c0 con 0x7fbb00146610 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.341+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb001399d0 con 0x7fbb00146610 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.341+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf800dd70 con 0x7fbb00146610 2024-09-13T18:39:42.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.341+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb00139f90 con 0x7fbb00146610 2024-09-13T18:39:42.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.342+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb000ae470 con 0x7fbb00146610 2024-09-13T18:39:42.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.343+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbaf801e3b0 con 0x7fbb00146610 2024-09-13T18:39:42.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.344+0000 7fbaf7e00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 0x7fbae006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.344+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbaf8089af0 con 0x7fbb00146610 2024-09-13T18:39:42.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.344+0000 7fbaffe00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 0x7fbae006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.344+0000 7fbaffe00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 0x7fbae006d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.348+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbb000ae470 con 0x7fbb00146610 2024-09-13T18:39:42.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.517+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb000ae470 con 0x7fbb00146610 2024-09-13T18:39:42.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.518+0000 7fbaf7e00640 1 -- 172.21.15.192:0/1698432490 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+13048 (secure 0 0 0) 0x7fbb000ae470 con 0x7fbb00146610 2024-09-13T18:39:42.520 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:42.520 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":82,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:41.148450+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6836/2146307069":"2024-09-14T18:39:38.128629+0000","172.21.15.192:6834/2146307069":"2024-09-14T18:39:38.128629+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 msgr2=0x7fbae006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 0x7fbae006d0c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fbaf0034000 tx=0x7fbaf002e000 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 msgr2=0x7fbb00070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fbaf800cef0 tx=0x7fbaf800a710 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 shutdown_connections 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbae006ac00 0x7fbae006d0c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbb00146610 0x7fbb00070ac0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbb000b2780 0x7fbb0013a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 --2- 172.21.15.192:0/1698432490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbb000afd80 0x7fbb000cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 >> 172.21.15.192:0/1698432490 conn(0x7fbb000ae960 msgr2=0x7fbb000aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 shutdown_connections 2024-09-13T18:39:42.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.521+0000 7fbb06c00640 1 -- 172.21.15.192:0/1698432490 wait complete. 2024-09-13T18:39:42.539 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:39:42.539 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:42.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.692+0000 7fb7de200640 1 Processor -- start 2024-09-13T18:39:42.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.692+0000 7fb7de200640 1 -- start start 2024-09-13T18:39:42.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.693+0000 7fb7de200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7d806c800 0x7fb7d80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7de200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7d806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7de200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d806cc70 con 0x7fb7d81434c0 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7de200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d80b4060 con 0x7fb7d806c800 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7de200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80ce770 con 0x7fb7d80b3bd0 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7d7400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb7d81434c0 0x7fb7d806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38052/0 (socket says 172.21.15.192:38052) 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7d7400640 1 -- 172.21.15.192:0/3333921776 learned_addr learned my addr 172.21.15.192:0/3333921776 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 896911778 0 0) 0x7fb7d806cc70 con 0x7fb7d81434c0 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7cea00640 1 --2- 172.21.15.192:0/3333921776 >> v2:172.21.15.194:3300/0 conn(0x7fb7d806c800 0x7fb7d80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7d806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.694+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7bc005730 con 0x7fb7d81434c0 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2141288267 0 0) 0x7fb7bc005730 con 0x7fb7d81434c0 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 msgr2=0x7fb7d806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7d806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 >> v2:172.21.15.194:3300/0 conn(0x7fb7d806c800 msgr2=0x7fb7d80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 --2- 172.21.15.192:0/3333921776 >> v2:172.21.15.194:3300/0 conn(0x7fb7d806c800 0x7fb7d80b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d806b480 con 0x7fb7d81434c0 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fb7c8001670 con 0x7fb7d81434c0 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7cea00640 1 --2- 172.21.15.192:0/3333921776 >> v2:172.21.15.194:3300/0 conn(0x7fb7d806c800 0x7fb7d80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:39:42.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 >> v1:172.21.15.192:6789/0 conn(0x7fb7d81434c0 legacy=0x7fb7d806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc005b80 0x7fb7bc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7bc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7bc0064e0 0x7fb7bc006f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80b4060 con 0x7fb7bc0064e0 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80ce770 con 0x7fb7bc005b80 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7bc007730 con 0x7fb7d80b3bd0 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7bc0064e0 0x7fb7bc006f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7400640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc005b80 0x7fb7bc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7cea00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7bc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 -- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 msgr2=0x7fb7bc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d80b3bd0 0x7fb7bc0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 -- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc005b80 msgr2=0x7fb7bc005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:42.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc005b80 0x7fb7bc005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.695+0000 7fb7d7e00640 1 -- 172.21.15.192:0/3333921776 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7bc005730 con 0x7fb7bc0064e0 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.696+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7bc0064e0 0x7fb7bc006f10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7bc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9c8da4d7bd2124 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0031640 con 0x7fb7bc0064e0 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d002d070 con 0x7fb7bc0064e0 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7d6a00640 1 -- 172.21.15.192:0/3333921776 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00319e0 con 0x7fb7bc0064e0 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 -- 172.21.15.192:0/3333921776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7bc0064e0 msgr2=0x7fb7bc006f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 --2- 172.21.15.192:0/3333921776 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7bc0064e0 0x7fb7bc006f10 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7bc007a00 comp rx=0 tx=0).stop 2024-09-13T18:39:42.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7d7e00640 1 -- 172.21.15.192:0/3333921776 reap_dead start 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 -- 172.21.15.192:0/3333921776 shutdown_connections 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 -- 172.21.15.192:0/3333921776 >> 172.21.15.192:0/3333921776 conn(0x7fb7d80b08f0 msgr2=0x7fb7d80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 -- 172.21.15.192:0/3333921776 shutdown_connections 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.697+0000 7fb7de200640 1 -- 172.21.15.192:0/3333921776 wait complete. 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.699+0000 7fb7de200640 1 Processor -- start 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.699+0000 7fb7de200640 1 -- start start 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc0064e0 0x7fb7d80abb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d813e750 0x7fb7d80b2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80b2a20 con 0x7fb7d80b2570 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81eefa0 con 0x7fb7bc0064e0 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7de200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81ef280 con 0x7fb7d813e750 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7d7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7d7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59718/0 (socket says 172.21.15.192:59718) 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7d7e00640 1 -- 172.21.15.192:0/606145263 learned_addr learned my addr 172.21.15.192:0/606145263 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7d7400640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc0064e0 0x7fb7d80abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.700+0000 7fb7cea00640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d813e750 0x7fb7d80b2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 -- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d813e750 msgr2=0x7fb7d80b2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d813e750 0x7fb7d80b2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 -- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc0064e0 msgr2=0x7fb7d80abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc0064e0 0x7fb7d80abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 -- 172.21.15.192:0/606145263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80ab040 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7d7e00640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e230 tx=0x7fb7d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0031df0 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0040070 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003bd0 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d80ab320 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.701+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d81424a0 con 0x7fb7d80b2570 2024-09-13T18:39:42.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.703+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80ab840 con 0x7fb7d80b2570 2024-09-13T18:39:42.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.703+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7d0042030 con 0x7fb7d80b2570 2024-09-13T18:39:42.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.704+0000 7fb7cfe00640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 0x7fb7b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.704+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb7d00a9f70 con 0x7fb7d80b2570 2024-09-13T18:39:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.704+0000 7fb7d7400640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 0x7fb7b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.705+0000 7fb7d7400640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 0x7fb7b406d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80017a0 tx=0x7fb7c80013b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:42.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.708+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7d80ab840 con 0x7fb7d80b2570 2024-09-13T18:39:42.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.881+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7d80ab840 con 0x7fb7d80b2570 2024-09-13T18:39:42.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.882+0000 7fb7cfe00640 1 -- 172.21.15.192:0/606145263 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7d80ab840 con 0x7fb7d80b2570 2024-09-13T18:39:42.884 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 msgr2=0x7fb7b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 0x7fb7b406d0c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80017a0 tx=0x7fb7c80013b0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 msgr2=0x7fb7d81ee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e230 tx=0x7fb7d0009750 comp rx=0 tx=0).stop 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 shutdown_connections 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7b406ac00 0x7fb7b406d0c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7d80b2570 0x7fb7d81ee3c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7d813e750 0x7fb7d80b2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 --2- 172.21.15.192:0/606145263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7bc0064e0 0x7fb7d80abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:42.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 >> 172.21.15.192:0/606145263 conn(0x7fb7d80b08f0 msgr2=0x7fb7d806ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:42.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 shutdown_connections 2024-09-13T18:39:42.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:42.884+0000 7fb7de200640 1 -- 172.21.15.192:0/606145263 wait complete. 2024-09-13T18:39:42.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-13T18:39:43.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.051+0000 7f0941000640 1 Processor -- start 2024-09-13T18:39:43.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.051+0000 7f0941000640 1 -- start start 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0941000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0941000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f093c0b1cf0 0x7f093c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0941000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c071dd0 con 0x7f093c15a3e0 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0941000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c071bf0 con 0x7f093c0b1cf0 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0941000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c0b0490 con 0x7f093c071810 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f093a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f093c0b1cf0 0x7f093c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f093a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f093c0b1cf0 0x7f093c0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59730/0 (socket says 172.21.15.192:59730) 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f093a800640 1 -- 172.21.15.192:0/477987861 learned_addr learned my addr 172.21.15.192:0/477987861 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:43.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.053+0000 7f0939e00640 1 --2- 172.21.15.192:0/477987861 >> v2:172.21.15.194:3300/0 conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.054+0000 7f093a800640 1 -- 172.21.15.192:0/477987861 >> v2:172.21.15.194:3300/0 conn(0x7f093c071810 msgr2=0x7f093c150480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.054+0000 7f093a800640 1 --2- 172.21.15.192:0/477987861 >> v2:172.21.15.194:3300/0 conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.054+0000 7f093a800640 1 -- 172.21.15.192:0/477987861 >> v1:172.21.15.194:6789/0 conn(0x7f093c15a3e0 legacy=0x7f093c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.054+0000 7f093a800640 1 -- 172.21.15.192:0/477987861 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c0cb770 con 0x7f093c0b1cf0 2024-09-13T18:39:43.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f093a800640 1 --2- 172.21.15.192:0/477987861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c0b1cf0 0x7f093c0cc530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f093c0b07c0 tx=0x7f093402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83196533e454ae server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:43.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0938a00640 1 -- 172.21.15.192:0/477987861 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934032440 con 0x7f093c0b1cf0 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0938a00640 1 -- 172.21.15.192:0/477987861 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09340325a0 con 0x7f093c0b1cf0 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0938a00640 1 -- 172.21.15.192:0/477987861 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934032930 con 0x7f093c0b1cf0 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 -- 172.21.15.192:0/477987861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c0b1cf0 msgr2=0x7f093c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 --2- 172.21.15.192:0/477987861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c0b1cf0 0x7f093c0cc530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f093c0b07c0 tx=0x7f093402a2a0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 -- 172.21.15.192:0/477987861 shutdown_connections 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 --2- 172.21.15.192:0/477987861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c0b1cf0 0x7f093c0cc530 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 --2- 172.21.15.192:0/477987861 >> v2:172.21.15.194:3300/0 conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.055+0000 7f0941000640 1 -- 172.21.15.192:0/477987861 >> 172.21.15.192:0/477987861 conn(0x7f093c0ae960 msgr2=0x7f093c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.056+0000 7f0941000640 1 -- 172.21.15.192:0/477987861 shutdown_connections 2024-09-13T18:39:43.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.056+0000 7f0941000640 1 -- 172.21.15.192:0/477987861 wait complete. 2024-09-13T18:39:43.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.057+0000 7f0941000640 1 Processor -- start 2024-09-13T18:39:43.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.057+0000 7f0941000640 1 -- start start 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0b1cf0 0x7f093c14f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f093c15a3e0 0x7f093c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c154f30 con 0x7f093c071810 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c151570 con 0x7f093c0b1cf0 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0941000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c1518b0 con 0x7f093c15a3e0 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.058+0000 7f0939e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59746/0 (socket says 172.21.15.192:59746) 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 -- 172.21.15.192:0/3064421594 learned_addr learned my addr 172.21.15.192:0/3064421594 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939400640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0b1cf0 0x7f093c14f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f093a800640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f093c15a3e0 0x7f093c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 -- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f093c15a3e0 msgr2=0x7f093c070030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f093c15a3e0 0x7f093c070030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 -- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0b1cf0 msgr2=0x7f093c14f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0b1cf0 0x7f093c14f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 -- 172.21.15.192:0/3064421594 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09340094d0 con 0x7f093c071810 2024-09-13T18:39:43.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0939e00640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f092c009db0 tx=0x7f092c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.059+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c014480 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.060+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c00f040 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.060+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c150cd0 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.060+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c014800 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.060+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c151290 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.061+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c0b2140 con 0x7f093c071810 2024-09-13T18:39:43.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.061+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f092c014960 con 0x7f093c071810 2024-09-13T18:39:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.062+0000 7f0932000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.062+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f092c089b60 con 0x7f093c071810 2024-09-13T18:39:43.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.063+0000 7f0939400640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:43.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.063+0000 7f0939400640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 0x7f091c06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f093c15ee60 tx=0x7f0928009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:43.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.066+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f092c055050 con 0x7f093c071810 2024-09-13T18:39:43.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:43.301+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f093c151a20 con 0x7f093c071810 2024-09-13T18:39:44.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.169+0000 7f0932000640 1 -- 172.21.15.192:0/3064421594 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v219) v1 ==== 136+0+0 (secure 0 0 0) 0x7f093c151a20 con 0x7f093c071810 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 msgr2=0x7f091c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 0x7f091c06d0c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f093c15ee60 tx=0x7f0928009040 comp rx=0 tx=0).stop 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 msgr2=0x7f093c150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f092c009db0 tx=0x7f092c00c490 comp rx=0 tx=0).stop 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 shutdown_connections 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f091c06ac00 0x7f091c06d0c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f093c15a3e0 0x7f093c070030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f093c0b1cf0 0x7f093c14f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 --2- 172.21.15.192:0/3064421594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f093c071810 0x7f093c150480 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 >> 172.21.15.192:0/3064421594 conn(0x7f093c0ae960 msgr2=0x7f093c0b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:44.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 shutdown_connections 2024-09-13T18:39:44.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.172+0000 7f0941000640 1 -- 172.21.15.192:0/3064421594 wait complete. 2024-09-13T18:39:44.193 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-13T18:39:44.364 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_objectstore":"memstore"} 2024-09-13T18:39:44.365 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-13T18:39:44.365 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:39:44.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.518+0000 7f34b0e00640 1 Processor -- start 2024-09-13T18:39:44.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.518+0000 7f34b0e00640 1 -- start start 2024-09-13T18:39:44.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34b0e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 0x7f34ac15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34b0e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f34ac06c0b0 0x7f34ac06c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34b0e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34ac0b2000 con 0x7f34ac1589f0 2024-09-13T18:39:44.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34b0e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac0b2ba0 con 0x7f34ac06c0b0 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34b0e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34ac06ca30 con 0x7f34ac0b3af0 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34aa800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f34ac06c0b0 0x7f34ac06c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34a9e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f34ac1589f0 0x7f34ac0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38054/0 (socket says 172.21.15.192:38054) 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34a9e00640 1 -- 172.21.15.192:0/2750970489 learned_addr learned my addr 172.21.15.192:0/2750970489 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34a9400640 1 --2- 172.21.15.192:0/2750970489 >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 0x7f34ac15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34aa800640 1 -- 172.21.15.192:0/2750970489 >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 msgr2=0x7f34ac15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34aa800640 1 --2- 172.21.15.192:0/2750970489 >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 0x7f34ac15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34aa800640 1 -- 172.21.15.192:0/2750970489 >> v1:172.21.15.192:6789/0 conn(0x7f34ac1589f0 legacy=0x7f34ac0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34aa800640 1 -- 172.21.15.192:0/2750970489 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac15bbd0 con 0x7f34ac06c0b0 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34a9400640 1 --2- 172.21.15.192:0/2750970489 >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 0x7f34ac15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:44.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.520+0000 7f34a8a00640 1 -- 172.21.15.192:0/2750970489 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554306997 0 0) 0x7f34ac0b2000 con 0x7f34ac1589f0 2024-09-13T18:39:44.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.521+0000 7f34aa800640 1 --2- 172.21.15.192:0/2750970489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac06c0b0 0x7f34ac06c4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06edf0 tx=0x7f34a402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee7811045f91e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34a8a00640 1 -- 172.21.15.192:0/2750970489 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4007740 con 0x7f34ac06c0b0 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34a8a00640 1 -- 172.21.15.192:0/2750970489 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a402d050 con 0x7f34ac06c0b0 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34a8a00640 1 -- 172.21.15.192:0/2750970489 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4007ac0 con 0x7f34ac06c0b0 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 -- 172.21.15.192:0/2750970489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac06c0b0 msgr2=0x7f34ac06c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 --2- 172.21.15.192:0/2750970489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac06c0b0 0x7f34ac06c4f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f34ac06edf0 tx=0x7f34a402a5f0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 -- 172.21.15.192:0/2750970489 shutdown_connections 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 --2- 172.21.15.192:0/2750970489 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac06c0b0 0x7f34ac06c4f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 --2- 172.21.15.192:0/2750970489 >> v2:172.21.15.194:3300/0 conn(0x7f34ac0b3af0 0x7f34ac15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 -- 172.21.15.192:0/2750970489 >> 172.21.15.192:0/2750970489 conn(0x7f34ac0b08f0 msgr2=0x7f34ac0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 -- 172.21.15.192:0/2750970489 shutdown_connections 2024-09-13T18:39:44.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.522+0000 7f34b0e00640 1 -- 172.21.15.192:0/2750970489 wait complete. 2024-09-13T18:39:44.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.524+0000 7f34b0e00640 1 Processor -- start 2024-09-13T18:39:44.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.524+0000 7f34b0e00640 1 -- start start 2024-09-13T18:39:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34ac06c0b0 0x7f34ac14d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ac0b3af0 0x7f34ac149d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac06fb80 con 0x7f34ac1589f0 2024-09-13T18:39:44.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac06fe20 con 0x7f34ac0b3af0 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34b0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac070100 con 0x7f34ac06c0b0 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34aa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34aa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59766/0 (socket says 172.21.15.192:59766) 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34aa800640 1 -- 172.21.15.192:0/239226686 learned_addr learned my addr 172.21.15.192:0/239226686 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34a9400640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ac0b3af0 0x7f34ac149d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.525+0000 7f34a9e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34ac06c0b0 0x7f34ac14d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 -- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34ac06c0b0 msgr2=0x7f34ac14d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34ac06c0b0 0x7f34ac14d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 -- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ac0b3af0 msgr2=0x7f34ac149d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ac0b3af0 0x7f34ac149d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 -- 172.21.15.192:0/239226686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a4009a70 con 0x7f34ac1589f0 2024-09-13T18:39:44.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34aa800640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f34a402abe0 tx=0x7f34a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:44.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4031910 con 0x7f34ac1589f0 2024-09-13T18:39:44.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a4031a70 con 0x7f34ac1589f0 2024-09-13T18:39:44.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a4031de0 con 0x7f34ac1589f0 2024-09-13T18:39:44.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac0703e0 con 0x7f34ac1589f0 2024-09-13T18:39:44.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.526+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0709a0 con 0x7f34ac1589f0 2024-09-13T18:39:44.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.528+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac070bc0 con 0x7f34ac1589f0 2024-09-13T18:39:44.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.528+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f34a403c420 con 0x7f34ac1589f0 2024-09-13T18:39:44.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.529+0000 7f34a2000640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 0x7f348c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:44.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.529+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34a40aac80 con 0x7f34ac1589f0 2024-09-13T18:39:44.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.529+0000 7f34a9e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 0x7f348c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:44.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.530+0000 7f34a9e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 0x7f348c06d0f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f349c007fd0 tx=0x7f349c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.533+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f34a4076330 con 0x7f34ac1589f0 2024-09-13T18:39:44.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.699+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f34ac06c4f0 con 0x7f34ac1589f0 2024-09-13T18:39:44.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.704+0000 7f34a2000640 1 -- 172.21.15.192:0/239226686 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f34a4079950 con 0x7f34ac1589f0 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 msgr2=0x7f348c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 0x7f348c06d0f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f349c007fd0 tx=0x7f349c007de0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 msgr2=0x7f34ac06f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f34a402abe0 tx=0x7f34a4004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 shutdown_connections 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f348c06ac30 0x7f348c06d0f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34ac1589f0 0x7f34ac06f640 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34ac0b3af0 0x7f34ac149d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 --2- 172.21.15.192:0/239226686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34ac06c0b0 0x7f34ac14d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:44.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 >> 172.21.15.192:0/239226686 conn(0x7f34ac0b08f0 msgr2=0x7f34ac06b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:44.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 shutdown_connections 2024-09-13T18:39:44.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:44.706+0000 7f34b0e00640 1 -- 172.21.15.192:0/239226686 wait complete. 2024-09-13T18:39:44.724 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:39:44.725 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:39:44.812 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:39:44.919 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:39:44.919 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:39:44.919 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:44.955 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:39:44.955 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:39:44.955 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:44.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:39:44.992 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:39:44.992 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:45.029 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:39:45.030 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:39:45.030 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:39:45.067 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:39:45.068 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:39:45.068 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.219+0000 7f1a3ec00640 1 Processor -- start 2024-09-13T18:39:45.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.220+0000 7f1a3ec00640 1 -- start start 2024-09-13T18:39:45.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1a38159b00 0x7f1a380b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3ec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3815af60 con 0x7f1a3815a5f0 2024-09-13T18:39:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3815aa40 con 0x7f1a3806bc30 2024-09-13T18:39:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a3806b7a0 con 0x7f1a38159b00 2024-09-13T18:39:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3e200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1a3815a5f0 0x7f1a380cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:38064/0 (socket says 172.21.15.192:38064) 2024-09-13T18:39:45.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3e200640 1 -- 172.21.15.192:0/2727118736 learned_addr learned my addr 172.21.15.192:0/2727118736 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a3d800640 1 --2- 172.21.15.192:0/2727118736 >> v2:172.21.15.194:3300/0 conn(0x7f1a38159b00 0x7f1a380b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.221+0000 7f1a37e00640 1 -- 172.21.15.192:0/2727118736 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605024085 0 0) 0x7f1a3815af60 con 0x7f1a3815a5f0 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.222+0000 7f1a37e00640 1 -- 172.21.15.192:0/2727118736 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a20003520 con 0x7f1a3815a5f0 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.222+0000 7f1a3d800640 1 -- 172.21.15.192:0/2727118736 >> v1:172.21.15.194:6789/0 conn(0x7f1a3806bc30 legacy=0x7f1a38159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.222+0000 7f1a3d800640 1 -- 172.21.15.192:0/2727118736 >> v1:172.21.15.192:6789/0 conn(0x7f1a3815a5f0 legacy=0x7f1a380cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.222+0000 7f1a3d800640 1 -- 172.21.15.192:0/2727118736 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3815ac80 con 0x7f1a38159b00 2024-09-13T18:39:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.223+0000 7f1a3d800640 1 --2- 172.21.15.192:0/2727118736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a38159b00 0x7f1a380b2d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0097a0 tx=0x7f1a2c02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d51180840bd61d33 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.223+0000 7f1a37e00640 1 -- 172.21.15.192:0/2727118736 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c032440 con 0x7f1a38159b00 2024-09-13T18:39:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.223+0000 7f1a37e00640 1 -- 172.21.15.192:0/2727118736 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2c0325a0 con 0x7f1a38159b00 2024-09-13T18:39:45.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.223+0000 7f1a37e00640 1 -- 172.21.15.192:0/2727118736 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c032930 con 0x7f1a38159b00 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 -- 172.21.15.192:0/2727118736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a38159b00 msgr2=0x7f1a380b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/2727118736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a38159b00 0x7f1a380b2d70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c0097a0 tx=0x7f1a2c02a230 comp rx=0 tx=0).stop 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 -- 172.21.15.192:0/2727118736 shutdown_connections 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/2727118736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a38159b00 0x7f1a380b2d70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 -- 172.21.15.192:0/2727118736 >> 172.21.15.192:0/2727118736 conn(0x7f1a380736d0 msgr2=0x7f1a380b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 -- 172.21.15.192:0/2727118736 shutdown_connections 2024-09-13T18:39:45.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.224+0000 7f1a3ec00640 1 -- 172.21.15.192:0/2727118736 wait complete. 2024-09-13T18:39:45.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.225+0000 7f1a3ec00640 1 Processor -- start 2024-09-13T18:39:45.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.225+0000 7f1a3ec00640 1 -- start start 2024-09-13T18:39:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a3806bc30 0x7f1a38149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 0x7f1a381585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815c9d0 con 0x7f1a38159b00 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a380afb00 con 0x7f1a3806bc30 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3814d920 con 0x7f1a3815a5f0 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.226+0000 7f1a3ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59780/0 (socket says 172.21.15.192:59780) 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 -- 172.21.15.192:0/288942179 learned_addr learned my addr 172.21.15.192:0/288942179 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3d800640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a3806bc30 0x7f1a38149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3e200640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 0x7f1a381585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 -- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 msgr2=0x7f1a381585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 0x7f1a381585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 -- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a3806bc30 msgr2=0x7f1a38149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a3806bc30 0x7f1a38149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 -- 172.21.15.192:0/288942179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a2c009400 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3e200640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 0x7f1a381585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a3ce00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c480 tx=0x7f1a2400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a240052d0 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a24005430 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.227+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a24012870 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.228+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3815cc20 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.228+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a380afd50 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.229+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a380b2d70 con 0x7f1a38159b00 2024-09-13T18:39:45.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.229+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a240129d0 con 0x7f1a38159b00 2024-09-13T18:39:45.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.230+0000 7f1a35600640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:45.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.230+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1a240889f0 con 0x7f1a38159b00 2024-09-13T18:39:45.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.231+0000 7f1a3d800640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:45.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.231+0000 7f1a3d800640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 0x7f1a1806d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c034000 tx=0x7f1a2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:45.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.234+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a24053ec0 con 0x7f1a38159b00 2024-09-13T18:39:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.434+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a3815aa40 con 0x7f1a38159b00 2024-09-13T18:39:45.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.435+0000 7f1a35600640 1 -- 172.21.15.192:0/288942179 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f1a3815aa40 con 0x7f1a38159b00 2024-09-13T18:39:45.437 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:45.437 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5390,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/402929889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":402929889},{"type":"v1","addr":"172.21.15.192:6837","nonce":402929889}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5396,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/96153468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":96153468},{"type":"v1","addr":"172.21.15.194:6835","nonce":96153468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3908717155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3908717155},{"type":"v1","addr":"172.21.15.194:6834","nonce":3908717155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27},{"gid":6363,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/4263064357","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":4263064357},{"type":"v1","addr":"172.21.15.192:6836","nonce":4263064357}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[]} 2024-09-13T18:39:45.437 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 34 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 msgr2=0x7f1a1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 0x7f1a1806d0c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c034000 tx=0x7f1a2c02e000 comp rx=0 tx=0).stop 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 msgr2=0x7f1a3815b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1a2400c480 tx=0x7f1a2400c940 comp rx=0 tx=0).stop 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 shutdown_connections 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a1806ac00 0x7f1a1806d0c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a3815a5f0 0x7f1a381585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a38159b00 0x7f1a3815b860 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 --2- 172.21.15.192:0/288942179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a3806bc30 0x7f1a38149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:45.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 >> 172.21.15.192:0/288942179 conn(0x7f1a380736d0 msgr2=0x7f1a380cbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:45.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 shutdown_connections 2024-09-13T18:39:45.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:45.437+0000 7f1a3ec00640 1 -- 172.21.15.192:0/288942179 wait complete. 2024-09-13T18:39:45.454 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:39:45.454 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:39:45.455 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:39:45.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:45.455 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:39:45.455 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:39:45.455 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:39:45.455 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:45.455 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:39:45.456 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:39:45.456 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:39:45.456 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:45.456 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:39:45.456 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:39:45.456 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:39:45.456 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:39:45.471 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:39:45.471 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:39:45.472 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:39:45.472 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:39:45.474 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:39:45.474 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:39:45.515 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:39:45.516 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:45.517 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:39:45.518 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:45.519 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:39:45.519 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:45.643 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:39:45.643 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:39:45.644 INFO:tasks.ceph.mds.d.smithi194.stderr:2024-09-13T18:39:45.642+0000 7f8ffe600640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-13T18:39:45.645 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:39:46.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-13T18:39:51.474 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:39:51.474 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:39:51.479 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:39:51.480 DEBUG:teuthology.parallel:result is None 2024-09-13T18:39:51.480 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:39:51.618 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:39:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.642+0000 7fd396800640 1 Processor -- start 2024-09-13T18:39:51.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.643+0000 7fd396800640 1 -- start start 2024-09-13T18:39:51.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd396800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3901551b0 0x7fd3900b38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd396800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39015ba70 0x7fd3900cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd396800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39006ed30 con 0x7fd3900cde00 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd396800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900cb570 con 0x7fd3901551b0 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd396800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd390155590 con 0x7fd39015ba70 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3901551b0 0x7fd3900b38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3901551b0 0x7fd3900b38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41364/0 (socket says 172.21.15.192:41364) 2024-09-13T18:39:51.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 -- 172.21.15.192:0/3731717996 learned_addr learned my addr 172.21.15.192:0/3731717996 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd394a00640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39015ba70 0x7fd3900cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 -- 172.21.15.192:0/3731717996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39015ba70 msgr2=0x7fd3900cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39015ba70 0x7fd3900cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.644+0000 7fd395400640 1 -- 172.21.15.192:0/3731717996 >> v1:172.21.15.194:6789/0 conn(0x7fd3900cde00 legacy=0x7fd39006a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:51.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.645+0000 7fd395400640 1 -- 172.21.15.192:0/3731717996 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39006f010 con 0x7fd3901551b0 2024-09-13T18:39:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd395400640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd3900b38f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd384009870 tx=0x7fd38402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96106995c6cc025 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd38fe00640 1 -- 172.21.15.192:0/3731717996 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384032440 con 0x7fd3901551b0 2024-09-13T18:39:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd38fe00640 1 -- 172.21.15.192:0/3731717996 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840325a0 con 0x7fd3901551b0 2024-09-13T18:39:51.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd38fe00640 1 -- 172.21.15.192:0/3731717996 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd384032930 con 0x7fd3901551b0 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd396800640 1 -- 172.21.15.192:0/3731717996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 msgr2=0x7fd3900b38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.646+0000 7fd396800640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd3900b38f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fd384009870 tx=0x7fd38402a250 comp rx=0 tx=0).stop 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 -- 172.21.15.192:0/3731717996 shutdown_connections 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd39015ba70 0x7fd3900cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 --2- 172.21.15.192:0/3731717996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd3900b38f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 -- 172.21.15.192:0/3731717996 >> 172.21.15.192:0/3731717996 conn(0x7fd3900736d0 msgr2=0x7fd3900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 -- 172.21.15.192:0/3731717996 shutdown_connections 2024-09-13T18:39:51.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.647+0000 7fd396800640 1 -- 172.21.15.192:0/3731717996 wait complete. 2024-09-13T18:39:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.648+0000 7fd396800640 1 Processor -- start 2024-09-13T18:39:51.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.648+0000 7fd396800640 1 -- start start 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3900cde00 0x7fd3901440a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd39015ba70 0x7fd390145a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39015aba0 con 0x7fd3901551b0 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900cd060 con 0x7fd39015ba70 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd396800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd390145590 con 0x7fd3900cde00 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd394a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd394a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41368/0 (socket says 172.21.15.192:41368) 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.649+0000 7fd394a00640 1 -- 172.21.15.192:0/3524707542 learned_addr learned my addr 172.21.15.192:0/3524707542 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd395400640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3900cde00 0x7fd3901440a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd395e00640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd39015ba70 0x7fd390145a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 -- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3900cde00 msgr2=0x7fd3901440a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3900cde00 0x7fd3901440a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 -- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd39015ba70 msgr2=0x7fd390145a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd39015ba70 0x7fd390145a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 -- 172.21.15.192:0/3524707542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3840094d0 con 0x7fd3901551b0 2024-09-13T18:39:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd394a00640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d620 tx=0x7fd37c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00b620 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00b780 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00bb30 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.650+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390148210 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.651+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd390144c60 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.652+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39006a1e0 con 0x7fd3901551b0 2024-09-13T18:39:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.652+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd37c00bc90 con 0x7fd3901551b0 2024-09-13T18:39:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.653+0000 7fd38d600640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 0x7fd37006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.653+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd37c0894f0 con 0x7fd3901551b0 2024-09-13T18:39:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.653+0000 7fd395400640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 0x7fd37006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.654+0000 7fd395400640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 0x7fd37006d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd384034000 tx=0x7fd38402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:51.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.658+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd37c054950 con 0x7fd3901551b0 2024-09-13T18:39:51.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:51.839+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd39006c450 con 0x7fd3901551b0 2024-09-13T18:39:52.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.635+0000 7fd38d600640 1 -- 172.21.15.192:0/3524707542 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v87) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd37c057f70 con 0x7fd3901551b0 2024-09-13T18:39:52.638 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 msgr2=0x7fd37006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 0x7fd37006d0c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fd384034000 tx=0x7fd38402e000 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 msgr2=0x7fd390147cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00d620 tx=0x7fd37c00dae0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 shutdown_connections 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd37006ac00 0x7fd37006d0c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd39015ba70 0x7fd390145a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3901551b0 0x7fd390147cd0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 --2- 172.21.15.192:0/3524707542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3900cde00 0x7fd3901440a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 >> 172.21.15.192:0/3524707542 conn(0x7fd3900736d0 msgr2=0x7fd390153790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:52.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 shutdown_connections 2024-09-13T18:39:52.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.638+0000 7fd396800640 1 -- 172.21.15.192:0/3524707542 wait complete. 2024-09-13T18:39:52.660 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:39:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.813+0000 7f7d54800640 1 Processor -- start 2024-09-13T18:39:52.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.813+0000 7f7d54800640 1 -- start start 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.814+0000 7f7d54800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d4c150480 0x7f7d4c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d54800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7d4c0cc530 0x7f7d4c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d54800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0ccec0 con 0x7f7d4c071810 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d54800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c071dd0 con 0x7f7d4c150480 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d54800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0cb770 con 0x7f7d4c0cc530 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d4c150480 0x7f7d4c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7d4c150480 0x7f7d4c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41384/0 (socket says 172.21.15.192:41384) 2024-09-13T18:39:52.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 -- 172.21.15.192:0/639916745 learned_addr learned my addr 172.21.15.192:0/639916745 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d52800640 1 --2- 172.21.15.192:0/639916745 >> v2:172.21.15.194:3300/0 conn(0x7f7d4c0cc530 0x7f7d4c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 -- 172.21.15.192:0/639916745 >> v2:172.21.15.194:3300/0 conn(0x7f7d4c0cc530 msgr2=0x7f7d4c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 --2- 172.21.15.192:0/639916745 >> v2:172.21.15.194:3300/0 conn(0x7f7d4c0cc530 0x7f7d4c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 -- 172.21.15.192:0/639916745 >> v1:172.21.15.194:6789/0 conn(0x7f7d4c071810 legacy=0x7f7d4c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:52.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.815+0000 7f7d51e00640 1 -- 172.21.15.192:0/639916745 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0cba50 con 0x7f7d4c150480 2024-09-13T18:39:52.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.816+0000 7f7d51e00640 1 --2- 172.21.15.192:0/639916745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c150480 0x7f7d4c15a3e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0b43e0 tx=0x7f7d4002a450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=102636ce391793c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:52.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.816+0000 7f7d50a00640 1 -- 172.21.15.192:0/639916745 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002f710 con 0x7f7d4c150480 2024-09-13T18:39:52.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d50a00640 1 -- 172.21.15.192:0/639916745 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d4002d050 con 0x7f7d4c150480 2024-09-13T18:39:52.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d50a00640 1 -- 172.21.15.192:0/639916745 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d4002fa90 con 0x7f7d4c150480 2024-09-13T18:39:52.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 -- 172.21.15.192:0/639916745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c150480 msgr2=0x7f7d4c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 --2- 172.21.15.192:0/639916745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c150480 0x7f7d4c15a3e0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0b43e0 tx=0x7f7d4002a450 comp rx=0 tx=0).stop 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 -- 172.21.15.192:0/639916745 shutdown_connections 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 --2- 172.21.15.192:0/639916745 >> v2:172.21.15.194:3300/0 conn(0x7f7d4c0cc530 0x7f7d4c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 --2- 172.21.15.192:0/639916745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c150480 0x7f7d4c15a3e0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 -- 172.21.15.192:0/639916745 >> 172.21.15.192:0/639916745 conn(0x7f7d4c0ae960 msgr2=0x7f7d4c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 -- 172.21.15.192:0/639916745 shutdown_connections 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.817+0000 7f7d54800640 1 -- 172.21.15.192:0/639916745 wait complete. 2024-09-13T18:39:52.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.819+0000 7f7d54800640 1 Processor -- start 2024-09-13T18:39:52.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.819+0000 7f7d54800640 1 -- start start 2024-09-13T18:39:52.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 0x7f7d4c1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 0x7f7d4c0af5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c154070 con 0x7f7d4c0cc530 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c156320 con 0x7f7d4c150480 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d54800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c1565d0 con 0x7f7d4c071810 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d51400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d51400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41386/0 (socket says 172.21.15.192:41386) 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d51400640 1 -- 172.21.15.192:0/1037823057 learned_addr learned my addr 172.21.15.192:0/1037823057 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d52800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 0x7f7d4c0af5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.820+0000 7f7d51e00640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 0x7f7d4c1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 -- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 msgr2=0x7f7d4c1f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 0x7f7d4c1f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 -- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 msgr2=0x7f7d4c0af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:52.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 0x7f7d4c0af5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 -- 172.21.15.192:0/1037823057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4000a670 con 0x7f7d4c0cc530 2024-09-13T18:39:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d52800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 0x7f7d4c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51e00640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 0x7f7d4c1f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:52.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d51400640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c430 tx=0x7f7d3c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c011790 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c0118f0 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c1568b0 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c011ce0 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.821+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c156e70 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.822+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c154220 con 0x7f7d4c0cc530 2024-09-13T18:39:52.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.823+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7d3c01c460 con 0x7f7d4c0cc530 2024-09-13T18:39:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.824+0000 7f7d46000640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 0x7f7d3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.824+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d3c088ff0 con 0x7f7d4c0cc530 2024-09-13T18:39:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.824+0000 7f7d51e00640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 0x7f7d3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:52.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.825+0000 7f7d51e00640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 0x7f7d3006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d40034000 tx=0x7f7d4002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:52.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:52.829+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7d4c154220 con 0x7f7d4c0cc530 2024-09-13T18:39:52.947 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-13T18:39:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.057+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7d4c150860 con 0x7f7d4c0cc530 2024-09-13T18:39:53.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.058+0000 7f7d46000640 1 -- 172.21.15.192:0/1037823057 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7d3c054480 con 0x7f7d4c0cc530 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.061 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:39:53.062 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.063 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.065 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.067 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.068 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.069 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:39:53.071 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:39:53.072 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:53.073 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:39:53.074 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:39:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 msgr2=0x7f7d3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 0x7f7d3006d0c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7d40034000 tx=0x7f7d4002f000 comp rx=0 tx=0).stop 2024-09-13T18:39:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 msgr2=0x7f7d4c155de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c00c430 tx=0x7f7d3c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 shutdown_connections 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7d3006ac00 0x7f7d3006d0c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7d4c150480 0x7f7d4c0af5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7d4c0cc530 0x7f7d4c155de0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 --2- 172.21.15.192:0/1037823057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7d4c071810 0x7f7d4c1f3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 >> 172.21.15.192:0/1037823057 conn(0x7f7d4c0ae960 msgr2=0x7f7d4c15d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 shutdown_connections 2024-09-13T18:39:53.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.060+0000 7f7d54800640 1 -- 172.21.15.192:0/1037823057 wait complete. 2024-09-13T18:39:53.079 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:53.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.229+0000 7f3a43800640 1 Processor -- start 2024-09-13T18:39:53.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.229+0000 7f3a43800640 1 -- start start 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 0x7f3a3c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 0x7f3a3c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c0cd920 con 0x7f3a3c0afd80 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a3c0b0710 con 0x7f3a3c0b2780 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a43800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c0ae770 con 0x7f3a3c146610 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a41800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a41800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41402/0 (socket says 172.21.15.192:41402) 2024-09-13T18:39:53.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.230+0000 7f3a41800640 1 -- 172.21.15.192:0/350211094 learned_addr learned my addr 172.21.15.192:0/350211094 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:53.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a40e00640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 0x7f3a3c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a41800640 1 -- 172.21.15.192:0/350211094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 msgr2=0x7f3a3c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a3be00640 1 --2- 172.21.15.192:0/350211094 >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 0x7f3a3c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a41800640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 0x7f3a3c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a41800640 1 -- 172.21.15.192:0/350211094 >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 msgr2=0x7f3a3c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a41800640 1 --2- 172.21.15.192:0/350211094 >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 0x7f3a3c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a41800640 1 -- 172.21.15.192:0/350211094 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c0cdb30 con 0x7f3a3c0afd80 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a40e00640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 0x7f3a3c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.231+0000 7f3a3be00640 1 --2- 172.21.15.192:0/350211094 >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 0x7f3a3c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a41800640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c06cee0 tx=0x7f3a3402a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab4b0ee2ec69415 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a3b400640 1 -- 172.21.15.192:0/350211094 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34031600 con 0x7f3a3c0afd80 2024-09-13T18:39:53.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a3b400640 1 -- 172.21.15.192:0/350211094 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3402d050 con 0x7f3a3c0afd80 2024-09-13T18:39:53.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a3b400640 1 -- 172.21.15.192:0/350211094 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a34031980 con 0x7f3a3c0afd80 2024-09-13T18:39:53.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a43800640 1 -- 172.21.15.192:0/350211094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 msgr2=0x7f3a3c0b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.232+0000 7f3a43800640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c06cee0 tx=0x7f3a3402a6a0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 -- 172.21.15.192:0/350211094 shutdown_connections 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c0b01d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 --2- 172.21.15.192:0/350211094 >> v2:172.21.15.194:3300/0 conn(0x7f3a3c0b2780 0x7f3a3c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 --2- 172.21.15.192:0/350211094 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c146610 0x7f3a3c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 -- 172.21.15.192:0/350211094 >> 172.21.15.192:0/350211094 conn(0x7f3a3c0ae960 msgr2=0x7f3a3c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 -- 172.21.15.192:0/350211094 shutdown_connections 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.233+0000 7f3a43800640 1 -- 172.21.15.192:0/350211094 wait complete. 2024-09-13T18:39:53.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.234+0000 7f3a43800640 1 Processor -- start 2024-09-13T18:39:53.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.234+0000 7f3a43800640 1 -- start start 2024-09-13T18:39:53.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 0x7f3a3c143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 0x7f3a3c15e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c15a990 con 0x7f3a3c0afd80 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c159e10 con 0x7f3a3c146610 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a43800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3c15a0f0 con 0x7f3a3c0b2780 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a40e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a40e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41410/0 (socket says 172.21.15.192:41410) 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.235+0000 7f3a40e00640 1 -- 172.21.15.192:0/1135388084 learned_addr learned my addr 172.21.15.192:0/1135388084 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 -- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 msgr2=0x7f3a3c143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a3be00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 0x7f3a3c143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a41800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 0x7f3a3c15e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 0x7f3a3c143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 -- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 msgr2=0x7f3a3c15e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 0x7f3a3c15e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 -- 172.21.15.192:0/1135388084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a34009b30 con 0x7f3a3c0afd80 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a3be00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 0x7f3a3c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a41800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 0x7f3a3c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a40e00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c7f0 tx=0x7f3a3000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30007820 con 0x7f3a3c0afd80 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a30007980 con 0x7f3a3c0afd80 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a30007cf0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.236+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a3c15a3d0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.237+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a3c143760 con 0x7f3a3c0afd80 2024-09-13T18:39:53.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.238+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a3c157ce0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.238+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3a300113f0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.239+0000 7f3a38c00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 0x7f3a1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.239+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3a300893c0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.239+0000 7f3a3be00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 0x7f3a1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.240+0000 7f3a3be00640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 0x7f3a1c06d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0aded0 tx=0x7f3a28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.243+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3a30054850 con 0x7f3a3c0afd80 2024-09-13T18:39:53.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.412+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a3c0b01d0 con 0x7f3a3c0afd80 2024-09-13T18:39:53.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.413+0000 7f3a38c00640 1 -- 172.21.15.192:0/1135388084 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+12917 (secure 0 0 0) 0x7f3a30057e70 con 0x7f3a3c0afd80 2024-09-13T18:39:53.416 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:53.416 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":87,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:52.632174+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:53.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.415+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 msgr2=0x7f3a1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.415+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 0x7f3a1c06d0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3a3c0aded0 tx=0x7f3a28008040 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.415+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 msgr2=0x7f3a3c144a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.415+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f3a3000c7f0 tx=0x7f3a3000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 shutdown_connections 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a1c06ac00 0x7f3a1c06d0c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3a3c146610 0x7f3a3c15e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3a3c0b2780 0x7f3a3c143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 --2- 172.21.15.192:0/1135388084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3a3c0afd80 0x7f3a3c144a00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 >> 172.21.15.192:0/1135388084 conn(0x7f3a3c0ae960 msgr2=0x7f3a3c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 shutdown_connections 2024-09-13T18:39:53.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.416+0000 7f3a43800640 1 -- 172.21.15.192:0/1135388084 wait complete. 2024-09-13T18:39:53.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '79', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:39:53.435 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:39:53.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.587+0000 7f1acda00640 1 Processor -- start 2024-09-13T18:39:53.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.587+0000 7f1acda00640 1 -- start start 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1ac815a9e0 0x7f1ac806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac806e990 0x7f1ac80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80b3730 con 0x7f1ac806b3d0 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac806c5d0 con 0x7f1ac815a9e0 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80b3920 con 0x7f1ac806e990 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1abf400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1abf400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41426/0 (socket says 172.21.15.192:41426) 2024-09-13T18:39:53.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1abf400640 1 -- 172.21.15.192:0/4069704880 learned_addr learned my addr 172.21.15.192:0/4069704880 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:53.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1acd000640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac806e990 0x7f1ac80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.588+0000 7f1ac7e00640 1 --2- 172.21.15.192:0/4069704880 >> v2:172.21.15.194:3300/0 conn(0x7f1ac815a9e0 0x7f1ac806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.589+0000 7f1abf400640 1 -- 172.21.15.192:0/4069704880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac806e990 msgr2=0x7f1ac80cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.589+0000 7f1abf400640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac806e990 0x7f1ac80cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.589+0000 7f1abf400640 1 -- 172.21.15.192:0/4069704880 >> v2:172.21.15.194:3300/0 conn(0x7f1ac815a9e0 msgr2=0x7f1ac806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.589+0000 7f1abf400640 1 --2- 172.21.15.192:0/4069704880 >> v2:172.21.15.194:3300/0 conn(0x7f1ac815a9e0 0x7f1ac806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.589+0000 7f1abf400640 1 -- 172.21.15.192:0/4069704880 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80b3c00 con 0x7f1ac806b3d0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1abf400640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ac806cc90 tx=0x7f1ab002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ffe4ea121c02420 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1ac7400640 1 -- 172.21.15.192:0/4069704880 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0032440 con 0x7f1ac806b3d0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1ac7400640 1 -- 172.21.15.192:0/4069704880 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab00325a0 con 0x7f1ac806b3d0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1ac7400640 1 -- 172.21.15.192:0/4069704880 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab0032930 con 0x7f1ac806b3d0 2024-09-13T18:39:53.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1acda00640 1 -- 172.21.15.192:0/4069704880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806b3d0 msgr2=0x7f1ac80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.590+0000 7f1acda00640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f1ac806cc90 tx=0x7f1ab002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 -- 172.21.15.192:0/4069704880 shutdown_connections 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac806e990 0x7f1ac80cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 --2- 172.21.15.192:0/4069704880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806b3d0 0x7f1ac80cd8c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 --2- 172.21.15.192:0/4069704880 >> v2:172.21.15.194:3300/0 conn(0x7f1ac815a9e0 0x7f1ac806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 -- 172.21.15.192:0/4069704880 >> 172.21.15.192:0/4069704880 conn(0x7f1ac80736d0 msgr2=0x7f1ac80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 -- 172.21.15.192:0/4069704880 shutdown_connections 2024-09-13T18:39:53.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.591+0000 7f1acda00640 1 -- 172.21.15.192:0/4069704880 wait complete. 2024-09-13T18:39:53.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.592+0000 7f1acda00640 1 Processor -- start 2024-09-13T18:39:53.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.592+0000 7f1acda00640 1 -- start start 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 0x7f1ac81527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac815a9e0 0x7f1ac80af510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8152d10 con 0x7f1ac806e990 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac815c7c0 con 0x7f1ac806b3d0 2024-09-13T18:39:53.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1acda00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8155f60 con 0x7f1ac815a9e0 2024-09-13T18:39:53.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1abf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1abf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41442/0 (socket says 172.21.15.192:41442) 2024-09-13T18:39:53.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.593+0000 7f1abf400640 1 -- 172.21.15.192:0/2729565510 learned_addr learned my addr 172.21.15.192:0/2729565510 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 -- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac815a9e0 msgr2=0x7f1ac80af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1acd000640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac815a9e0 0x7f1ac80af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1ac7e00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 0x7f1ac81527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac815a9e0 0x7f1ac80af510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 -- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 msgr2=0x7f1ac81527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 0x7f1ac81527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 -- 172.21.15.192:0/2729565510 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab00094d0 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1ac7e00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 0x7f1ac81527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1abf400640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1ab002a220 tx=0x7f1ab00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab003b840 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab003b9a0 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac8156240 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.594+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab003bd10 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.595+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac815c450 con 0x7f1ac806e990 2024-09-13T18:39:53.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.596+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac815c5e0 con 0x7f1ac806e990 2024-09-13T18:39:53.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.596+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1ab0039040 con 0x7f1ac806e990 2024-09-13T18:39:53.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.597+0000 7f1ac4c00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 0x7f1aa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.597+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1ab00a99a0 con 0x7f1ac806e990 2024-09-13T18:39:53.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.597+0000 7f1ac7e00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 0x7f1aa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.598+0000 7f1ac7e00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 0x7f1aa406d0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009a20 tx=0x7f1ab8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.601+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1ab0074ec0 con 0x7f1ac806e990 2024-09-13T18:39:53.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.770+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ac815c930 con 0x7f1ac806e990 2024-09-13T18:39:53.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.770+0000 7f1ac4c00640 1 -- 172.21.15.192:0/2729565510 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1ab00784e0 con 0x7f1ac806e990 2024-09-13T18:39:53.774 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:39:53.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.772+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 msgr2=0x7f1aa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.772+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 0x7f1aa406d0c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ab8009a20 tx=0x7f1ab8008040 comp rx=0 tx=0).stop 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 msgr2=0x7f1ac80aefd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f1ab002a220 tx=0x7f1ab00046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 shutdown_connections 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1aa406ac00 0x7f1aa406d0c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1ac815a9e0 0x7f1ac80af510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1ac806e990 0x7f1ac80aefd0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 --2- 172.21.15.192:0/2729565510 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1ac806b3d0 0x7f1ac81527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 >> 172.21.15.192:0/2729565510 conn(0x7f1ac80736d0 msgr2=0x7f1ac806b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 shutdown_connections 2024-09-13T18:39:53.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.773+0000 7f1acda00640 1 -- 172.21.15.192:0/2729565510 wait complete. 2024-09-13T18:39:53.791 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:39:53.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.941+0000 7fb40b600640 1 Processor -- start 2024-09-13T18:39:53.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.941+0000 7fb40b600640 1 -- start start 2024-09-13T18:39:53.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.942+0000 7fb40b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 0x7fb40415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.942+0000 7fb40b600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4040cb0b0 0x7fb40415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.942+0000 7fb40b600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb404140480 con 0x7fb404140980 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.942+0000 7fb40b600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40415c160 con 0x7fb4040cb0b0 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.942+0000 7fb40b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cb520 con 0x7fb4040cacd0 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4040cb0b0 0x7fb40415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb409600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb404140980 0x7fb4040afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41356/0 (socket says 172.21.15.192:41356) 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb409600640 1 -- 172.21.15.192:0/1295258993 learned_addr learned my addr 172.21.15.192:0/1295258993 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 --2- 172.21.15.192:0/1295258993 >> v2:172.21.15.192:3300/0 conn(0x7fb4040cb0b0 0x7fb40415bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41450/0 (socket says 172.21.15.192:41450) 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb408c00640 1 --2- 172.21.15.192:0/1295258993 >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 0x7fb40415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 -- 172.21.15.192:0/1295258993 >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 msgr2=0x7fb40415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:53.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 --2- 172.21.15.192:0/1295258993 >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 0x7fb40415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 -- 172.21.15.192:0/1295258993 >> v1:172.21.15.192:6789/0 conn(0x7fb404140980 legacy=0x7fb4040afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403e00640 1 -- 172.21.15.192:0/1295258993 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40415ee90 con 0x7fb4040cb0b0 2024-09-13T18:39:53.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb403400640 1 -- 172.21.15.192:0/1295258993 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216383153 0 0) 0x7fb404140480 con 0x7fb404140980 2024-09-13T18:39:53.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.943+0000 7fb408c00640 1 --2- 172.21.15.192:0/1295258993 >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 0x7fb40415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.944+0000 7fb403e00640 1 --2- 172.21.15.192:0/1295258993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cb0b0 0x7fb40415bc20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb4040b2350 tx=0x7fb3f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=338a5052ad162783 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.944+0000 7fb403400640 1 -- 172.21.15.192:0/1295258993 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0032440 con 0x7fb4040cb0b0 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.944+0000 7fb403400640 1 -- 172.21.15.192:0/1295258993 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f00325a0 con 0x7fb4040cb0b0 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.944+0000 7fb403400640 1 -- 172.21.15.192:0/1295258993 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0032930 con 0x7fb4040cb0b0 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 -- 172.21.15.192:0/1295258993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cb0b0 msgr2=0x7fb40415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 --2- 172.21.15.192:0/1295258993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cb0b0 0x7fb40415bc20 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb4040b2350 tx=0x7fb3f002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 -- 172.21.15.192:0/1295258993 shutdown_connections 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 --2- 172.21.15.192:0/1295258993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cb0b0 0x7fb40415bc20 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 --2- 172.21.15.192:0/1295258993 >> v2:172.21.15.194:3300/0 conn(0x7fb4040cacd0 0x7fb40415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 -- 172.21.15.192:0/1295258993 >> 172.21.15.192:0/1295258993 conn(0x7fb4040ae960 msgr2=0x7fb40406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 -- 172.21.15.192:0/1295258993 shutdown_connections 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.945+0000 7fb40b600640 1 -- 172.21.15.192:0/1295258993 wait complete. 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.947+0000 7fb40b600640 1 Processor -- start 2024-09-13T18:39:53.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.947+0000 7fb40b600640 1 -- start start 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 0x7fb40406ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb404140980 0x7fb40406b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40406b760 con 0x7fb4040cacd0 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041f6b20 con 0x7fb4040cb0b0 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb40b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4041f61f0 con 0x7fb404140980 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41464/0 (socket says 172.21.15.192:41464) 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 -- 172.21.15.192:0/2000018928 learned_addr learned my addr 172.21.15.192:0/2000018928 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb403e00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 0x7fb40406ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb409600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb404140980 0x7fb40406b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 -- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb404140980 msgr2=0x7fb40406b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb404140980 0x7fb40406b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 -- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 msgr2=0x7fb40406ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 0x7fb40406ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb408c00640 1 -- 172.21.15.192:0/2000018928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f0009400 con 0x7fb4040cacd0 2024-09-13T18:39:53.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.948+0000 7fb403e00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 0x7fb40406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb408c00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800d7d0 tx=0x7fb3f800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004030 con 0x7fb4040cacd0 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f8004190 con 0x7fb4040cacd0 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8004520 con 0x7fb4040cacd0 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4041f64d0 con 0x7fb4040cacd0 2024-09-13T18:39:53.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.949+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040adff0 con 0x7fb4040cacd0 2024-09-13T18:39:53.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.950+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040ae1e0 con 0x7fb4040cacd0 2024-09-13T18:39:53.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.951+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3f80096a0 con 0x7fb4040cacd0 2024-09-13T18:39:53.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.952+0000 7fb400c00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:53.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.952+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3f80891e0 con 0x7fb4040cacd0 2024-09-13T18:39:53.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.952+0000 7fb403e00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:53.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.953+0000 7fb403e00640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0034000 tx=0x7fb3f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:53.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:53.956+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb3f8054670 con 0x7fb4040cacd0 2024-09-13T18:39:54.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.127+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb4040670d0 con 0x7fb4040cacd0 2024-09-13T18:39:54.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.128+0000 7fb400c00640 1 -- 172.21.15.192:0/2000018928 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v87) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb3f8057c90 con 0x7fb4040cacd0 2024-09-13T18:39:54.131 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:39:54.132 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 msgr2=0x7fb3e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0034000 tx=0x7fb3f002e000 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 msgr2=0x7fb4040adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fb3f800d7d0 tx=0x7fb3f800dc90 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 shutdown_connections 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb404140980 0x7fb40406b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4040cb0b0 0x7fb40406ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 --2- 172.21.15.192:0/2000018928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4040cacd0 0x7fb4040adab0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 >> 172.21.15.192:0/2000018928 conn(0x7fb4040ae960 msgr2=0x7fb4040afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 shutdown_connections 2024-09-13T18:39:54.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.130+0000 7fb40b600640 1 -- 172.21.15.192:0/2000018928 wait complete. 2024-09-13T18:39:54.150 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:39:54.150 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:39:54.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.302+0000 7f7764600640 1 Processor -- start 2024-09-13T18:39:54.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.302+0000 7f7764600640 1 -- start start 2024-09-13T18:39:54.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7764600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:54.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7764600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c15e110 con 0x7f775c0ccc30 2024-09-13T18:39:54.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7764600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c15e3f0 con 0x7f775c0b3d90 2024-09-13T18:39:54.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7764600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c15e6d0 con 0x7f775c0cb730 2024-09-13T18:39:54.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7762600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f775c0ccc30 0x7f775c06fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41362/0 (socket says 172.21.15.192:41362) 2024-09-13T18:39:54.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7762600640 1 -- 172.21.15.192:0/4058069206 learned_addr learned my addr 172.21.15.192:0/4058069206 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f7761c00640 1 --2- 172.21.15.192:0/4058069206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3262543252 0 0) 0x7f775c15e110 con 0x7f775c0ccc30 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.304+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7744003520 con 0x7f775c0ccc30 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270307275 0 0) 0x7f775c15e3f0 con 0x7f775c0b3d90 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f775c15e110 con 0x7f775c0b3d90 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f7761c00640 1 -- 172.21.15.192:0/4058069206 >> v1:172.21.15.194:6789/0 conn(0x7f775c0b3d90 legacy=0x7f775c0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f7761c00640 1 -- 172.21.15.192:0/4058069206 >> v1:172.21.15.192:6789/0 conn(0x7f775c0ccc30 legacy=0x7f775c06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2794112690 0 0) 0x7f7744003520 con 0x7f775c0ccc30 2024-09-13T18:39:54.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.305+0000 7f7761c00640 1 -- 172.21.15.192:0/4058069206 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0cbd20 con 0x7f775c0cb730 2024-09-13T18:39:54.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.306+0000 7f7761c00640 1 --2- 172.21.15.192:0/4058069206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c15d810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7750009dc0 tx=0x7f775002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f088a39d7361170 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.306+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754001670 con 0x7f775c0cb730 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.306+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775002d050 con 0x7f775c0cb730 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.306+0000 7f775be00640 1 -- 172.21.15.192:0/4058069206 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750007760 con 0x7f775c0cb730 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 -- 172.21.15.192:0/4058069206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 msgr2=0x7f775c15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 --2- 172.21.15.192:0/4058069206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c15d810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7750009dc0 tx=0x7f775002a660 comp rx=0 tx=0).stop 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 -- 172.21.15.192:0/4058069206 shutdown_connections 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 --2- 172.21.15.192:0/4058069206 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c15d810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 -- 172.21.15.192:0/4058069206 >> 172.21.15.192:0/4058069206 conn(0x7f775c0b0c40 msgr2=0x7f775c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 -- 172.21.15.192:0/4058069206 shutdown_connections 2024-09-13T18:39:54.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.307+0000 7f7764600640 1 -- 172.21.15.192:0/4058069206 wait complete. 2024-09-13T18:39:54.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.308+0000 7f7764600640 1 Processor -- start 2024-09-13T18:39:54.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.308+0000 7f7764600640 1 -- start start 2024-09-13T18:39:54.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:54.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:54.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f775c136f00 0x7f775c137390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:54.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c1378d0 con 0x7f775c0b3d90 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775c157da0 con 0x7f775c136f00 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7764600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c138350 con 0x7f775c0cb730 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.309+0000 7f7761c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41478/0 (socket says 172.21.15.192:41478) 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 -- 172.21.15.192:0/1240631629 learned_addr learned my addr 172.21.15.192:0/1240631629 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7762600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f775c136f00 0x7f775c137390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761200640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 -- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 msgr2=0x7f775c159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 -- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f775c136f00 msgr2=0x7f775c137390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f775c136f00 0x7f775c137390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 -- 172.21.15.192:0/1240631629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7750009a70 con 0x7f775c0b3d90 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7761c00640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f80 tx=0x7f7750004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775003c830 con 0x7f775c0b3d90 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775003c990 con 0x7f775c0b3d90 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775003cd20 con 0x7f775c0b3d90 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.310+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c138630 con 0x7f775c0b3d90 2024-09-13T18:39:54.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.311+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c138bf0 con 0x7f775c0b3d90 2024-09-13T18:39:54.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.311+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c15d810 con 0x7f775c0b3d90 2024-09-13T18:39:54.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.312+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7750031400 con 0x7f775c0b3d90 2024-09-13T18:39:54.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.314+0000 7f7759600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 0x7f773c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:54.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.314+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f77500aabd0 con 0x7f775c0b3d90 2024-09-13T18:39:54.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.314+0000 7f7761200640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 0x7f773c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:54.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.314+0000 7f7761200640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 0x7f773c06d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f775c136730 tx=0x7f7748009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:54.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.318+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7750076210 con 0x7f775c0b3d90 2024-09-13T18:39:54.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.485+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f775c159b60 con 0x7f775c0b3d90 2024-09-13T18:39:54.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.868+0000 7f7759600640 1 -- 172.21.15.192:0/1240631629 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v88) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7750079830 con 0x7f775c0b3d90 2024-09-13T18:39:54.871 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 msgr2=0x7f773c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 0x7f773c06d0c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f775c136730 tx=0x7f7748009040 comp rx=0 tx=0).stop 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 msgr2=0x7f775c157860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f7750000f80 tx=0x7f7750004a40 comp rx=0 tx=0).stop 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 shutdown_connections 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f773c06ac00 0x7f773c06d0c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f775c136f00 0x7f775c137390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f775c0cb730 0x7f775c159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 --2- 172.21.15.192:0/1240631629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f775c0b3d90 0x7f775c157860 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:54.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 >> 172.21.15.192:0/1240631629 conn(0x7f775c0b0c40 msgr2=0x7f775c06f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:54.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 shutdown_connections 2024-09-13T18:39:54.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:54.872+0000 7f7764600640 1 -- 172.21.15.192:0/1240631629 wait complete. 2024-09-13T18:39:54.891 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:39:55.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.047+0000 7f4623e00640 1 Processor -- start 2024-09-13T18:39:55.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.047+0000 7f4623e00640 1 -- start start 2024-09-13T18:39:55.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.048+0000 7f4623e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f461c1589f0 0x7f461c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:55.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.048+0000 7f4623e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c0b2000 con 0x7f461c0b3af0 2024-09-13T18:39:55.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.048+0000 7f4623e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f461c15b970 con 0x7f461c06c0b0 2024-09-13T18:39:55.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.048+0000 7f4623e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f461c15bbd0 con 0x7f461c1589f0 2024-09-13T18:39:55.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4620a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f461c0b3af0 0x7f461c15b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41368/0 (socket says 172.21.15.192:41368) 2024-09-13T18:39:55.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4620a00640 1 -- 172.21.15.192:0/2721056244 learned_addr learned my addr 172.21.15.192:0/2721056244 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:55.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4621400640 1 --2- 172.21.15.192:0/2721056244 >> v2:172.21.15.194:3300/0 conn(0x7f461c1589f0 0x7f461c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f461be00640 1 -- 172.21.15.192:0/2721056244 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888322086 0 0) 0x7f461c0b2000 con 0x7f461c0b3af0 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f461be00640 1 -- 172.21.15.192:0/2721056244 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4604003520 con 0x7f461c0b3af0 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4621400640 1 -- 172.21.15.192:0/2721056244 >> v1:172.21.15.194:6789/0 conn(0x7f461c06c0b0 legacy=0x7f461c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4621400640 1 -- 172.21.15.192:0/2721056244 >> v1:172.21.15.192:6789/0 conn(0x7f461c0b3af0 legacy=0x7f461c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.049+0000 7f4621400640 1 -- 172.21.15.192:0/2721056244 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f461c15beb0 con 0x7f461c1589f0 2024-09-13T18:39:55.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.050+0000 7f4621400640 1 --2- 172.21.15.192:0/2721056244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c0b2490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f46100097a0 tx=0x7f461002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b028b2febf5efc99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:55.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f461be00640 1 -- 172.21.15.192:0/2721056244 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610032440 con 0x7f461c1589f0 2024-09-13T18:39:55.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f461be00640 1 -- 172.21.15.192:0/2721056244 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46100325a0 con 0x7f461c1589f0 2024-09-13T18:39:55.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f461be00640 1 -- 172.21.15.192:0/2721056244 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610032930 con 0x7f461c1589f0 2024-09-13T18:39:55.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 -- 172.21.15.192:0/2721056244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 msgr2=0x7f461c0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 --2- 172.21.15.192:0/2721056244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c0b2490 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f46100097a0 tx=0x7f461002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 -- 172.21.15.192:0/2721056244 shutdown_connections 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 --2- 172.21.15.192:0/2721056244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c0b2490 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 -- 172.21.15.192:0/2721056244 >> 172.21.15.192:0/2721056244 conn(0x7f461c0b08f0 msgr2=0x7f461c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 -- 172.21.15.192:0/2721056244 shutdown_connections 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.051+0000 7f4623e00640 1 -- 172.21.15.192:0/2721056244 wait complete. 2024-09-13T18:39:55.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.053+0000 7f4623e00640 1 Processor -- start 2024-09-13T18:39:55.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.053+0000 7f4623e00640 1 -- start start 2024-09-13T18:39:55.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:55.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f461c0b3af0 0x7f461c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:55.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c154e90 con 0x7f461c06c0b0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f461c151510 con 0x7f461c1589f0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4623e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f461c1517f0 con 0x7f461c0b3af0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4621400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4621400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41484/0 (socket says 172.21.15.192:41484) 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4621400640 1 -- 172.21.15.192:0/1437073929 learned_addr learned my addr 172.21.15.192:0/1437073929 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4620a00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f461c0b3af0 0x7f461c1f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.054+0000 7f4621e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 -- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f461c0b3af0 msgr2=0x7f461c1f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f461c0b3af0 0x7f461c1f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 -- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 msgr2=0x7f461c152a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c152a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 -- 172.21.15.192:0/1437073929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4610009400 con 0x7f461c06c0b0 2024-09-13T18:39:55.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4621400640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4610035040 tx=0x7f46100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:55.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610006e10 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4610032e90 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4610030be0 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f461c151ad0 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.055+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f461c153510 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.056+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f461c151ff0 con 0x7f461c06c0b0 2024-09-13T18:39:55.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.057+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4610039040 con 0x7f461c06c0b0 2024-09-13T18:39:55.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.058+0000 7f4619600640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:55.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.058+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f46100a9b30 con 0x7f461c06c0b0 2024-09-13T18:39:55.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.058+0000 7f4620a00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:55.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.059+0000 7f4620a00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 0x7f45fc06d0c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f461c1f0530 tx=0x7f4608007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:55.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.063+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f461c151ff0 con 0x7f461c06c0b0 2024-09-13T18:39:55.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.231+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f461c151ff0 con 0x7f461c06c0b0 2024-09-13T18:39:55.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.881+0000 7f4619600640 1 -- 172.21.15.192:0/1437073929 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v89) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4610075020 con 0x7f461c06c0b0 2024-09-13T18:39:55.885 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:39:55.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.888+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 msgr2=0x7f45fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.888+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 0x7f45fc06d0c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f461c1f0530 tx=0x7f4608007d30 comp rx=0 tx=0).stop 2024-09-13T18:39:55.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.888+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 msgr2=0x7f461c1522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:55.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.888+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4610035040 tx=0x7f46100046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 shutdown_connections 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f45fc06ac00 0x7f45fc06d0c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f461c1589f0 0x7f461c152a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f461c0b3af0 0x7f461c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 --2- 172.21.15.192:0/1437073929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f461c06c0b0 0x7f461c1522d0 secure :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4610035040 tx=0x7f46100046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.889+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 >> 172.21.15.192:0/1437073929 conn(0x7f461c0b08f0 msgr2=0x7f461c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.890+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 shutdown_connections 2024-09-13T18:39:55.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:55.890+0000 7f4623e00640 1 -- 172.21.15.192:0/1437073929 wait complete. 2024-09-13T18:39:55.912 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:39:56.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.067+0000 7fefe6800640 1 Processor -- start 2024-09-13T18:39:56.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.067+0000 7fefe6800640 1 -- start start 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefe015e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fefe00b02f0 0x7fefe015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe015b070 con 0x7fefe015b810 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe015eba0 con 0x7fefe00b02f0 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe015ee20 con 0x7fefe01402c0 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe4a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fefe015b810 0x7fefe00afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41382/0 (socket says 172.21.15.192:41382) 2024-09-13T18:39:56.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe4a00640 1 -- 172.21.15.192:0/3310118548 learned_addr learned my addr 172.21.15.192:0/3310118548 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:56.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe5e00640 1 --2- 172.21.15.192:0/3310118548 >> v2:172.21.15.194:3300/0 conn(0x7fefe00b02f0 0x7fefe015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.068+0000 7fefe5400640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefe015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515873671 0 0) 0x7fefe015b070 con 0x7fefe015b810 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefc8003520 con 0x7fefe015b810 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1515808266 0 0) 0x7fefc8003520 con 0x7fefe015b810 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 msgr2=0x7fefe015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefe015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 >> v2:172.21.15.194:3300/0 conn(0x7fefe00b02f0 msgr2=0x7fefe015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 --2- 172.21.15.192:0/3310118548 >> v2:172.21.15.194:3300/0 conn(0x7fefe00b02f0 0x7fefe015bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe015f100 con 0x7fefe015b810 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fefcc001670 con 0x7fefe015b810 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 >> v1:172.21.15.192:6789/0 conn(0x7fefe015b810 legacy=0x7fefe00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8003970 0x7fefc8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefc80047c0 0x7fefc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe015eba0 con 0x7fefc8003970 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe015ee20 con 0x7fefc80047c0 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc800b980 con 0x7fefe01402c0 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.069+0000 7fefe5400640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8003970 0x7fefc8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe4a00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefc80047c0 0x7fefc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5e00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5400640 1 -- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 msgr2=0x7fefc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5400640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5400640 1 -- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefc80047c0 msgr2=0x7fefc8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5400640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefc80047c0 0x7fefc8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5400640 1 -- 172.21.15.192:0/3310118548 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc8003520 con 0x7fefc8003970 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe4a00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefc80047c0 0x7fefc8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.070+0000 7fefe5e00640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefe01402c0 0x7fefc8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:56.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.071+0000 7fefe5400640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8003970 0x7fefc8003d90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ac0 tx=0x7fefc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487a80cca353318e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.071+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4031400 con 0x7fefc8003970 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.071+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd402d050 con 0x7fefc8003970 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.071+0000 7fefdfe00640 1 -- 172.21.15.192:0/3310118548 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4031780 con 0x7fefc8003970 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 -- 172.21.15.192:0/3310118548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8003970 msgr2=0x7fefc8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 --2- 172.21.15.192:0/3310118548 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefc8003970 0x7fefc8003d90 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fefd4009ac0 tx=0x7fefc80057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe5e00640 1 -- 172.21.15.192:0/3310118548 reap_dead start 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 -- 172.21.15.192:0/3310118548 shutdown_connections 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 -- 172.21.15.192:0/3310118548 >> 172.21.15.192:0/3310118548 conn(0x7fefe00ae7f0 msgr2=0x7fefe006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 -- 172.21.15.192:0/3310118548 shutdown_connections 2024-09-13T18:39:56.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.072+0000 7fefe6800640 1 -- 172.21.15.192:0/3310118548 wait complete. 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.073+0000 7fefe6800640 1 Processor -- start 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 -- start start 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefc8003970 0x7fefe0142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe0140be0 0x7fefe0155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0141c90 con 0x7fefe00b32c0 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0141080 con 0x7fefe0140be0 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.074+0000 7fefe6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe0141360 con 0x7fefc8003970 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41498/0 (socket says 172.21.15.192:41498) 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 -- 172.21.15.192:0/3599307809 learned_addr learned my addr 172.21.15.192:0/3599307809 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe5400640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefc8003970 0x7fefe0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe5e00640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe0140be0 0x7fefe0155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 -- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefc8003970 msgr2=0x7fefe0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefc8003970 0x7fefe0142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 -- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe0140be0 msgr2=0x7fefe0155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe0140be0 0x7fefe0155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 -- 172.21.15.192:0/3599307809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe0141640 con 0x7fefe00b32c0 2024-09-13T18:39:56.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.075+0000 7fefe4a00640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000ff0 tx=0x7fefcc00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.076+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00c640 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.076+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00c7a0 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.076+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe0141920 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.076+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00cb30 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.076+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe006b300 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.077+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe006b520 con 0x7fefe00b32c0 2024-09-13T18:39:56.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.078+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fefcc027430 con 0x7fefe00b32c0 2024-09-13T18:39:56.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.079+0000 7fefdd600640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 0x7fefc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.079+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fefcc089f00 con 0x7fefe00b32c0 2024-09-13T18:39:56.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.079+0000 7fefe5400640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 0x7fefc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.080+0000 7fefe5400640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 0x7fefc006d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fefd4033000 tx=0x7fefd4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.083+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fefcc0551b0 con 0x7fefe00b32c0 2024-09-13T18:39:56.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.285+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fefe015bc50 con 0x7fefe00b32c0 2024-09-13T18:39:56.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.297+0000 7fefdd600640 1 -- 172.21.15.192:0/3599307809 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) v1 ==== 174+0+0 (secure 0 0 0) 0x7fefcc0014f0 con 0x7fefe00b32c0 2024-09-13T18:39:56.300 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 10 and data pool 11 2024-09-13T18:39:56.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.302+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 msgr2=0x7fefc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.302+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 0x7fefc006d0c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fefd4033000 tx=0x7fefd4008030 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.302+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 msgr2=0x7fefe01406a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.302+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fefcc000ff0 tx=0x7fefcc00eb90 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 shutdown_connections 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fefc006ac00 0x7fefc006d0c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fefe0140be0 0x7fefe0155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fefe00b32c0 0x7fefe01406a0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 --2- 172.21.15.192:0/3599307809 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fefc8003970 0x7fefe0142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.303+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 >> 172.21.15.192:0/3599307809 conn(0x7fefe00ae7f0 msgr2=0x7fefe00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:56.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.304+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 shutdown_connections 2024-09-13T18:39:56.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.304+0000 7fefe6800640 1 -- 172.21.15.192:0/3599307809 wait complete. 2024-09-13T18:39:56.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:56.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.480+0000 7f4260a00640 1 Processor -- start 2024-09-13T18:39:56.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.480+0000 7f4260a00640 1 -- start start 2024-09-13T18:39:56.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4260a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f425c0b3f10 0x7f425c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4260a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0b2f00 con 0x7f425c15dee0 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4260a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f425c0b3150 con 0x7f425c0b0490 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4260a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f425c0b3430 con 0x7f425c0b3f10 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f425c0b3f10 0x7f425c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f425c15dee0 0x7f425c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41392/0 (socket says 172.21.15.192:41392) 2024-09-13T18:39:56.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259e00640 1 -- 172.21.15.192:0/3018063988 learned_addr learned my addr 172.21.15.192:0/3018063988 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:56.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259400640 1 -- 172.21.15.192:0/3018063988 >> v1:172.21.15.194:6789/0 conn(0x7f425c0b0490 legacy=0x7f425c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259400640 1 -- 172.21.15.192:0/3018063988 >> v1:172.21.15.192:6789/0 conn(0x7f425c15dee0 legacy=0x7f425c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4259400640 1 -- 172.21.15.192:0/3018063988 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425c0b3710 con 0x7f425c0b3f10 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.482+0000 7f4258a00640 1 -- 172.21.15.192:0/3018063988 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715918415 0 0) 0x7f425c0b2f00 con 0x7f425c15dee0 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.483+0000 7f4259400640 1 --2- 172.21.15.192:0/3018063988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b3f10 0x7f425c15a440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f424802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4743c8b04cf3e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4258a00640 1 -- 172.21.15.192:0/3018063988 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248032440 con 0x7f425c0b3f10 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4258a00640 1 -- 172.21.15.192:0/3018063988 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42480325a0 con 0x7f425c0b3f10 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4258a00640 1 -- 172.21.15.192:0/3018063988 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4248032930 con 0x7f425c0b3f10 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 -- 172.21.15.192:0/3018063988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b3f10 msgr2=0x7f425c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 --2- 172.21.15.192:0/3018063988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b3f10 0x7f425c15a440 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f42480097a0 tx=0x7f424802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 -- 172.21.15.192:0/3018063988 shutdown_connections 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 --2- 172.21.15.192:0/3018063988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b3f10 0x7f425c15a440 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 -- 172.21.15.192:0/3018063988 >> 172.21.15.192:0/3018063988 conn(0x7f425c0ae960 msgr2=0x7f425c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:56.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 -- 172.21.15.192:0/3018063988 shutdown_connections 2024-09-13T18:39:56.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.484+0000 7f4260a00640 1 -- 172.21.15.192:0/3018063988 wait complete. 2024-09-13T18:39:56.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.486+0000 7f4260a00640 1 Processor -- start 2024-09-13T18:39:56.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.486+0000 7f4260a00640 1 -- start start 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f425c15dee0 0x7f425c1350b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 0x7f425c1355f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c13d1e0 con 0x7f425c0b0490 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425c13d4c0 con 0x7f425c1427a0 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4260a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425c13d7a0 con 0x7f425c15dee0 2024-09-13T18:39:56.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4259e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4259e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41518/0 (socket says 172.21.15.192:41518) 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4259e00640 1 -- 172.21.15.192:0/3273484411 learned_addr learned my addr 172.21.15.192:0/3273484411 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f4259400640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f425c15dee0 0x7f425c1350b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.487+0000 7f425a800640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 0x7f425c1355f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 -- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f425c15dee0 msgr2=0x7f425c1350b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f425c15dee0 0x7f425c1350b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 -- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 msgr2=0x7f425c1355f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 0x7f425c1355f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 -- 172.21.15.192:0/3273484411 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4248009400 con 0x7f425c0b0490 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f425a800640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 0x7f425c1355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4259e00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7c0 tx=0x7f424c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00a640 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424c00a7c0 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c13da80 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424c00ab70 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.488+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c154400 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.489+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f425c13dc10 con 0x7f425c0b0490 2024-09-13T18:39:56.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.490+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f424c00acd0 con 0x7f425c0b0490 2024-09-13T18:39:56.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.491+0000 7f4252000640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 0x7f423c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.492+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f424c088bd0 con 0x7f425c0b0490 2024-09-13T18:39:56.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.492+0000 7f4259400640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 0x7f423c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.492+0000 7f4259400640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 0x7f423c06d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4248034000 tx=0x7f424802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.496+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f424c053db0 con 0x7f425c0b0490 2024-09-13T18:39:56.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.664+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f425c13d320 con 0x7f425c0b0490 2024-09-13T18:39:56.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.666+0000 7f4252000640 1 -- 172.21.15.192:0/3273484411 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f425c13d320 con 0x7f425c0b0490 2024-09-13T18:39:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:56.669 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":90,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:56.286606+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 msgr2=0x7f423c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 0x7f423c06d0c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4248034000 tx=0x7f424802e000 comp rx=0 tx=0).stop 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 msgr2=0x7f425c155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f424c00c7c0 tx=0x7f424c00cc80 comp rx=0 tx=0).stop 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 shutdown_connections 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f423c06ac00 0x7f423c06d0c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f425c1427a0 0x7f425c1355f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f425c15dee0 0x7f425c1350b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 --2- 172.21.15.192:0/3273484411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f425c0b0490 0x7f425c155360 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 >> 172.21.15.192:0/3273484411 conn(0x7f425c0ae960 msgr2=0x7f425c158d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:56.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 shutdown_connections 2024-09-13T18:39:56.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.668+0000 7f4260a00640 1 -- 172.21.15.192:0/3273484411 wait complete. 2024-09-13T18:39:56.688 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:56.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.840+0000 7f3320200640 1 Processor -- start 2024-09-13T18:39:56.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.840+0000 7f3320200640 1 -- start start 2024-09-13T18:39:56.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f3320200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157430 0x7f33180cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f3320200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33180cc1f0 0x7f33180b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f3320200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33180ad9e0 con 0x7f3318157810 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f3320200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33180aea80 con 0x7f33180cc1f0 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f3320200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180adcc0 con 0x7f3318157430 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f331ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33180cc1f0 0x7f33180b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f331ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f33180cc1f0 0x7f33180b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41532/0 (socket says 172.21.15.192:41532) 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.841+0000 7f331e200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3318157810 0x7f3318160b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41398/0 (socket says 172.21.15.192:41398) 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331ce00640 1 -- 172.21.15.192:0/3001533413 learned_addr learned my addr 172.21.15.192:0/3001533413 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331d800640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157430 0x7f33180cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331ce00640 1 -- 172.21.15.192:0/3001533413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157430 msgr2=0x7f33180cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331ce00640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157430 0x7f33180cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331ce00640 1 -- 172.21.15.192:0/3001533413 >> v1:172.21.15.192:6789/0 conn(0x7f3318157810 legacy=0x7f3318160b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f331ce00640 1 -- 172.21.15.192:0/3001533413 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33180adfa0 con 0x7f33180cc1f0 2024-09-13T18:39:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.842+0000 7f3317e00640 1 -- 172.21.15.192:0/3001533413 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858858759 0 0) 0x7f33180ad9e0 con 0x7f3318157810 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.843+0000 7f331ce00640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33180cc1f0 0x7f33180b0e30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3304009870 tx=0x7f330402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b486a06593011434 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.843+0000 7f3317e00640 1 -- 172.21.15.192:0/3001533413 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304032440 con 0x7f33180cc1f0 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.843+0000 7f3317e00640 1 -- 172.21.15.192:0/3001533413 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33040325a0 con 0x7f33180cc1f0 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.843+0000 7f3317e00640 1 -- 172.21.15.192:0/3001533413 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3304032930 con 0x7f33180cc1f0 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 -- 172.21.15.192:0/3001533413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33180cc1f0 msgr2=0x7f33180b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33180cc1f0 0x7f33180b0e30 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3304009870 tx=0x7f330402a270 comp rx=0 tx=0).stop 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 -- 172.21.15.192:0/3001533413 shutdown_connections 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33180cc1f0 0x7f33180b0e30 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 --2- 172.21.15.192:0/3001533413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157430 0x7f33180cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 -- 172.21.15.192:0/3001533413 >> 172.21.15.192:0/3001533413 conn(0x7f33180730a0 msgr2=0x7f33180734b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 -- 172.21.15.192:0/3001533413 shutdown_connections 2024-09-13T18:39:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.844+0000 7f3320200640 1 -- 172.21.15.192:0/3001533413 wait complete. 2024-09-13T18:39:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.845+0000 7f3320200640 1 Processor -- start 2024-09-13T18:39:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 -- start start 2024-09-13T18:39:56.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 0x7f331814ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 0x7f33181f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3318070ce0 con 0x7f33181504f0 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180700d0 con 0x7f3318157430 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.846+0000 7f3320200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180703b0 con 0x7f3318157810 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41534/0 (socket says 172.21.15.192:41534) 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 -- 172.21.15.192:0/1115268972 learned_addr learned my addr 172.21.15.192:0/1115268972 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331d800640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 0x7f331814ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331ce00640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 0x7f33181f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 -- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 msgr2=0x7f33181f2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 0x7f33181f2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 -- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 msgr2=0x7f331814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 0x7f331814ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 -- 172.21.15.192:0/1115268972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33040094d0 con 0x7f33181504f0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331ce00640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 0x7f33181f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331d800640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 0x7f331814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.847+0000 7f331e200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f331000c3e0 tx=0x7f331000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.848+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100074e0 con 0x7f33181504f0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.848+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3310007640 con 0x7f33181504f0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.848+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310004a20 con 0x7f33181504f0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.848+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3318070690 con 0x7f33181504f0 2024-09-13T18:39:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.848+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f331814bec0 con 0x7f33181504f0 2024-09-13T18:39:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.849+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3318070e50 con 0x7f33181504f0 2024-09-13T18:39:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.850+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3310004b80 con 0x7f33181504f0 2024-09-13T18:39:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.851+0000 7f3315600640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 0x7f32f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:56.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.851+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33100890e0 con 0x7f33181504f0 2024-09-13T18:39:56.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.851+0000 7f331d800640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 0x7f32f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:56.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.852+0000 7f331d800640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 0x7f32f806d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f330c009b20 tx=0x7f330c0039d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:56.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:56.855+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f33100542b0 con 0x7f33181504f0 2024-09-13T18:39:56.859 INFO:tasks.ceph.mds.a.smithi192.stderr:2024-09-13T18:39:56.857+0000 7f5e65200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:39:57.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.025+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33180cbcb0 con 0x7f33181504f0 2024-09-13T18:39:57.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.026+0000 7f3315600640 1 -- 172.21.15.192:0/1115268972 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16581 (secure 0 0 0) 0x7f33100578d0 con 0x7f33181504f0 2024-09-13T18:39:57.029 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:57.030 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":90,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:56.286606+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 msgr2=0x7f32f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 0x7f32f806d0c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f330c009b20 tx=0x7f330c0039d0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 msgr2=0x7f33181f32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f331000c3e0 tx=0x7f331000c8a0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 shutdown_connections 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f32f806ac00 0x7f32f806d0c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33181504f0 0x7f33181f32f0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3318157810 0x7f33181f2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 --2- 172.21.15.192:0/1115268972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3318157430 0x7f331814ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 >> 172.21.15.192:0/1115268972 conn(0x7f33180730a0 msgr2=0x7f33181560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:57.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 shutdown_connections 2024-09-13T18:39:57.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.029+0000 7f3320200640 1 -- 172.21.15.192:0/1115268972 wait complete. 2024-09-13T18:39:57.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:39:57.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.200+0000 7f0236600640 1 Processor -- start 2024-09-13T18:39:57.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.200+0000 7f0236600640 1 -- start start 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0236600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f02300b4910 0x7f02300b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0236600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023006f940 con 0x7f0230142e00 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0236600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300b32d0 con 0x7f02300b02f0 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0236600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300b4d20 con 0x7f02300b4910 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0235200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0230142e00 0x7f02300afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41410/0 (socket says 172.21.15.192:41410) 2024-09-13T18:39:57.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0235200640 1 -- 172.21.15.192:0/2284448108 learned_addr learned my addr 172.21.15.192:0/2284448108 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.201+0000 7f0235c00640 1 --2- 172.21.15.192:0/2284448108 >> v2:172.21.15.194:3300/0 conn(0x7f02300b4910 0x7f02300b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091314651 0 0) 0x7f023006f940 con 0x7f0230142e00 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0214003520 con 0x7f0230142e00 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1028174321 0 0) 0x7f0214003520 con 0x7f0230142e00 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 >> v2:172.21.15.194:3300/0 conn(0x7f02300b4910 msgr2=0x7f02300b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 --2- 172.21.15.192:0/2284448108 >> v2:172.21.15.194:3300/0 conn(0x7f02300b4910 0x7f02300b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 >> v1:172.21.15.194:6789/0 conn(0x7f02300b02f0 legacy=0x7f023006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f023006f610 con 0x7f0230142e00 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f0220001670 con 0x7f0230142e00 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 >> v1:172.21.15.192:6789/0 conn(0x7f0230142e00 legacy=0x7f02300afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 0x7f0214003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140047c0 0x7f0214004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0214005180 0x7f021400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021400e260 con 0x7f02140039c0 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021400e3d0 con 0x7f02140047c0 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021400e590 con 0x7f0214005180 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f0235200640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 0x7f0214003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.202+0000 7f022fe00640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140047c0 0x7f0214004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235c00640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0214005180 0x7f021400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235200640 1 -- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0214005180 msgr2=0x7f021400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235200640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0214005180 0x7f021400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235200640 1 -- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140047c0 msgr2=0x7f0214004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235200640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140047c0 0x7f0214004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235200640 1 -- 172.21.15.192:0/2284448108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214003520 con 0x7f02140039c0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.203+0000 7f0235c00640 1 -- 172.21.15.192:0/2284448108 reap_dead start 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0235200640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 0x7f0214003de0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f022000c0e0 tx=0x7f02140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=774d0ed6eae011c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220005ad0 con 0x7f02140039c0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022002d070 con 0x7f02140039c0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f022f400640 1 -- 172.21.15.192:0/2284448108 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220005e90 con 0x7f02140039c0 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0236600640 1 -- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 msgr2=0x7f0214003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0236600640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 0x7f0214003de0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f022000c0e0 tx=0x7f02140057f0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0236600640 1 -- 172.21.15.192:0/2284448108 shutdown_connections 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0236600640 1 --2- 172.21.15.192:0/2284448108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f02140039c0 0x7f0214003de0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.204+0000 7f0236600640 1 -- 172.21.15.192:0/2284448108 >> 172.21.15.192:0/2284448108 conn(0x7f02300ae7f0 msgr2=0x7f023006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.205+0000 7f0236600640 1 -- 172.21.15.192:0/2284448108 shutdown_connections 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.205+0000 7f0236600640 1 -- 172.21.15.192:0/2284448108 wait complete. 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.206+0000 7f0236600640 1 Processor -- start 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.206+0000 7f0236600640 1 -- start start 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140039c0 0x7f0230155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02300ad840 0x7f02300adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300ae200 con 0x7f023013e190 2024-09-13T18:39:57.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023015a070 con 0x7f02140039c0 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0236600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f023013eb80 con 0x7f02300ad840 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0235c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0235c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41558/0 (socket says 172.21.15.192:41558) 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.207+0000 7f0235c00640 1 -- 172.21.15.192:0/845972859 learned_addr learned my addr 172.21.15.192:0/845972859 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235200640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140039c0 0x7f0230155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f022fe00640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02300ad840 0x7f02300adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 -- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02300ad840 msgr2=0x7f02300adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02300ad840 0x7f02300adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 -- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140039c0 msgr2=0x7f0230155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140039c0 0x7f0230155490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 -- 172.21.15.192:0/845972859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02301559d0 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0235c00640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccdc0 tx=0x7f022800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022800e040 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022800f040 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0228015430 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.208+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f023015a2c0 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.209+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f023015a880 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.209+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0230142640 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.210+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0228015590 con 0x7f023013e190 2024-09-13T18:39:57.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.211+0000 7f022cc00640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 0x7f021006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.211+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0228089980 con 0x7f023013e190 2024-09-13T18:39:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.211+0000 7f0235200640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 0x7f021006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.212+0000 7f0235200640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 0x7f021006d0c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0220032000 tx=0x7f022002d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.215+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0228054b70 con 0x7f023013e190 2024-09-13T18:39:57.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:57.420+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f02300afbe0 con 0x7f023013e190 2024-09-13T18:39:58.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.301+0000 7f022cc00640 1 -- 172.21.15.192:0/845972859 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0228058190 con 0x7f023013e190 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 msgr2=0x7f021006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 0x7f021006d0c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0220032000 tx=0x7f022002d000 comp rx=0 tx=0).stop 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 msgr2=0x7f023013e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f02300ccdc0 tx=0x7f022800f580 comp rx=0 tx=0).stop 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 shutdown_connections 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f021006ac00 0x7f021006d0c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f023013e190 0x7f023013e640 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f02300ad840 0x7f02300adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 --2- 172.21.15.192:0/845972859 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02140039c0 0x7f0230155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 >> 172.21.15.192:0/845972859 conn(0x7f02300ae7f0 msgr2=0x7f02300cd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 shutdown_connections 2024-09-13T18:39:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.304+0000 7f0236600640 1 -- 172.21.15.192:0/845972859 wait complete. 2024-09-13T18:39:58.326 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:39:58.327 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:39:58.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.485+0000 7ff64e400640 1 Processor -- start 2024-09-13T18:39:58.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.485+0000 7ff64e400640 1 -- start start 2024-09-13T18:39:58.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff64e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff6480cdf60 0x7ff6480ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff64e400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64815a8e0 con 0x7ff6480b3470 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff64e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6480b2fe0 con 0x7ff6480cb330 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff64e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6480b26b0 con 0x7ff6480cdf60 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff647e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff6480b3470 0x7ff6480b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41414/0 (socket says 172.21.15.192:41414) 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff647e00640 1 -- 172.21.15.192:0/3584953466 learned_addr learned my addr 172.21.15.192:0/3584953466 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:58.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff646a00640 1 --2- 172.21.15.192:0/3584953466 >> v2:172.21.15.194:3300/0 conn(0x7ff6480cdf60 0x7ff6480ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 916743033 0 0) 0x7ff64815a8e0 con 0x7ff6480b3470 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.487+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff62c003520 con 0x7ff6480b3470 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.488+0000 7ff646a00640 1 -- 172.21.15.192:0/3584953466 >> v1:172.21.15.194:6789/0 conn(0x7ff6480cb330 legacy=0x7ff64806ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.488+0000 7ff646a00640 1 -- 172.21.15.192:0/3584953466 >> v1:172.21.15.192:6789/0 conn(0x7ff6480b3470 legacy=0x7ff6480b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.488+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4111295396 0 0) 0x7ff62c003520 con 0x7ff6480b3470 2024-09-13T18:39:58.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.488+0000 7ff646a00640 1 -- 172.21.15.192:0/3584953466 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480b2990 con 0x7ff6480cdf60 2024-09-13T18:39:58.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff646a00640 1 --2- 172.21.15.192:0/3584953466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480cdf60 0x7ff6480ce3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff63400a940 tx=0x7ff63402b460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b058c65f672ef82f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:58.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6400019f0 con 0x7ff6480cdf60 2024-09-13T18:39:58.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff634033440 con 0x7ff6480cdf60 2024-09-13T18:39:58.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff646000640 1 -- 172.21.15.192:0/3584953466 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340337d0 con 0x7ff6480cdf60 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff64e400640 1 -- 172.21.15.192:0/3584953466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480cdf60 msgr2=0x7ff6480ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.489+0000 7ff64e400640 1 --2- 172.21.15.192:0/3584953466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480cdf60 0x7ff6480ce3f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff63400a940 tx=0x7ff63402b460 comp rx=0 tx=0).stop 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.490+0000 7ff64e400640 1 -- 172.21.15.192:0/3584953466 shutdown_connections 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.490+0000 7ff64e400640 1 --2- 172.21.15.192:0/3584953466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480cdf60 0x7ff6480ce3f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.490+0000 7ff64e400640 1 -- 172.21.15.192:0/3584953466 >> 172.21.15.192:0/3584953466 conn(0x7ff6480b08f0 msgr2=0x7ff6480b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.490+0000 7ff64e400640 1 -- 172.21.15.192:0/3584953466 shutdown_connections 2024-09-13T18:39:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.490+0000 7ff64e400640 1 -- 172.21.15.192:0/3584953466 wait complete. 2024-09-13T18:39:58.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.491+0000 7ff64e400640 1 Processor -- start 2024-09-13T18:39:58.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.491+0000 7ff64e400640 1 -- start start 2024-09-13T18:39:58.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480b3470 0x7ff6480adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:58.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:58.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6480cdf60 0x7ff648156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:58.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff648146f90 con 0x7ff6480cb330 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481461d0 con 0x7ff6480b3470 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.492+0000 7ff64e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6481464b0 con 0x7ff6480cdf60 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41562/0 (socket says 172.21.15.192:41562) 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 -- 172.21.15.192:0/3048294095 learned_addr learned my addr 172.21.15.192:0/3048294095 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff647400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480b3470 0x7ff6480adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff647e00640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6480cdf60 0x7ff648156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 -- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6480cdf60 msgr2=0x7ff648156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6480cdf60 0x7ff648156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 -- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480b3470 msgr2=0x7ff6480adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480b3470 0x7ff6480adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 -- 172.21.15.192:0/3048294095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63400a5a0 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.493+0000 7ff646a00640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff634000c00 tx=0x7ff6340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.494+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63403e910 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.494+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63403ea70 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.494+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff648146790 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.494+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63403ee20 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.494+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6481f6d10 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.495+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff648146cb0 con 0x7ff6480cb330 2024-09-13T18:39:58.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.496+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff63403a040 con 0x7ff6480cb330 2024-09-13T18:39:58.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.496+0000 7ff63f400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:58.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.497+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6340a9b40 con 0x7ff6480cb330 2024-09-13T18:39:58.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.497+0000 7ff647400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:58.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.497+0000 7ff647400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff6480712e0 tx=0x7ff638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:58.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.500+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff648146cb0 con 0x7ff6480cb330 2024-09-13T18:39:58.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:58.699+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff648146cb0 con 0x7ff6480cb330 2024-09-13T18:39:59.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.309+0000 7ff63f400640 1 -- 172.21.15.192:0/3048294095 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff648146cb0 con 0x7ff6480cb330 2024-09-13T18:39:59.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.311+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 msgr2=0x7ff62806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.311+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7ff6480712e0 tx=0x7ff638009040 comp rx=0 tx=0).stop 2024-09-13T18:39:59.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.311+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 msgr2=0x7ff6481563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.311+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7ff634000c00 tx=0x7ff6340046c0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 shutdown_connections 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6480cdf60 0x7ff648156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6480cb330 0x7ff6481563c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 --2- 172.21.15.192:0/3048294095 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6480b3470 0x7ff6480adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 >> 172.21.15.192:0/3048294095 conn(0x7ff6480b08f0 msgr2=0x7ff64806abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 shutdown_connections 2024-09-13T18:39:59.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.312+0000 7ff64e400640 1 -- 172.21.15.192:0/3048294095 wait complete. 2024-09-13T18:39:59.331 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:39:59.331 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:39:59.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.482+0000 7fe253200640 1 Processor -- start 2024-09-13T18:39:59.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.482+0000 7fe253200640 1 -- start start 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.483+0000 7fe253200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe24c071810 0x7fe24c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.483+0000 7fe253200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c071dd0 con 0x7fe24c150480 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.483+0000 7fe253200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c0cb770 con 0x7fe24c0b2230 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.483+0000 7fe253200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0cba50 con 0x7fe24c071810 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe24c150480 0x7fe24c15a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41418/0 (socket says 172.21.15.192:41418) 2024-09-13T18:39:59.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24be00640 1 -- 172.21.15.192:0/2717829074 learned_addr learned my addr 172.21.15.192:0/2717829074 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:59.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24b400640 1 --2- 172.21.15.192:0/2717829074 >> v2:172.21.15.194:3300/0 conn(0x7fe24c071810 0x7fe24c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106684907 0 0) 0x7fe24c071dd0 con 0x7fe24c150480 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe230005730 con 0x7fe24c150480 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714960121 0 0) 0x7fe230005730 con 0x7fe24c150480 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 >> v2:172.21.15.194:3300/0 conn(0x7fe24c071810 msgr2=0x7fe24c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 --2- 172.21.15.192:0/2717829074 >> v2:172.21.15.194:3300/0 conn(0x7fe24c071810 0x7fe24c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 >> v1:172.21.15.194:6789/0 conn(0x7fe24c0b2230 legacy=0x7fe24c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c0cbd30 con 0x7fe24c150480 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe23c001670 con 0x7fe24c150480 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 >> v1:172.21.15.192:6789/0 conn(0x7fe24c150480 legacy=0x7fe24c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.484+0000 7fe24aa00640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230005b80 0x7fe230005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24aa00640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2300069d0 0x7fe230006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24aa00640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 0x7fe23000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0cba50 con 0x7fe230007390 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000e330 con 0x7fe2300069d0 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23000e4f0 con 0x7fe230005b80 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 0x7fe23000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24b400640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2300069d0 0x7fe230006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe24be00640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230005b80 0x7fe230005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 -- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230005b80 msgr2=0x7fe230005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230005b80 0x7fe230005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 -- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2300069d0 msgr2=0x7fe230006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe2300069d0 0x7fe230006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.485+0000 7fe251200640 1 -- 172.21.15.192:0/2717829074 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230005730 con 0x7fe230007390 2024-09-13T18:39:59.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.486+0000 7fe251200640 1 -- 172.21.15.192:0/2717829074 reap_dead start 2024-09-13T18:39:59.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.486+0000 7fe251200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 0x7fe23000db90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe244001e20 tx=0x7fe230007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ff8634098bca62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.486+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24402ae40 con 0x7fe230007390 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244003970 con 0x7fe230007390 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe24aa00640 1 -- 172.21.15.192:0/2717829074 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244003d20 con 0x7fe230007390 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 -- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 msgr2=0x7fe23000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 0x7fe23000db90 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe244001e20 tx=0x7fe230007a00 comp rx=0 tx=0).stop 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 -- 172.21.15.192:0/2717829074 shutdown_connections 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 --2- 172.21.15.192:0/2717829074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe230007390 0x7fe23000db90 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 -- 172.21.15.192:0/2717829074 >> 172.21.15.192:0/2717829074 conn(0x7fe24c0ae960 msgr2=0x7fe24c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 -- 172.21.15.192:0/2717829074 shutdown_connections 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.487+0000 7fe253200640 1 -- 172.21.15.192:0/2717829074 wait complete. 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.489+0000 7fe253200640 1 Processor -- start 2024-09-13T18:39:59.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.489+0000 7fe253200640 1 -- start start 2024-09-13T18:39:59.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230007390 0x7fe24c156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 0x7fe24c1e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c155a30 con 0x7fe24c14c890 2024-09-13T18:39:59.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c155c30 con 0x7fe24c1555b0 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe253200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c155f10 con 0x7fe230007390 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41590/0 (socket says 172.21.15.192:41590) 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 -- 172.21.15.192:0/1855389019 learned_addr learned my addr 172.21.15.192:0/1855389019 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24be00640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230007390 0x7fe24c156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe251200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 0x7fe24c1e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 -- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230007390 msgr2=0x7fe24c156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230007390 0x7fe24c156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 -- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 msgr2=0x7fe24c1e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 0x7fe24c1e3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe24b400640 1 -- 172.21.15.192:0/1855389019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c1561f0 con 0x7fe24c14c890 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.490+0000 7fe251200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 0x7fe24c1e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:39:59.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe24b400640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe2380118e0 tx=0x7fe238011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23800faf0 con 0x7fe24c14c890 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23800fc50 con 0x7fe24c14c890 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238014440 con 0x7fe24c14c890 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c1564d0 con 0x7fe24c14c890 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.491+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c14d800 con 0x7fe24c14c890 2024-09-13T18:39:59.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.492+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c067490 con 0x7fe24c14c890 2024-09-13T18:39:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.493+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe2380145a0 con 0x7fe24c14c890 2024-09-13T18:39:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.494+0000 7fe243e00640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 0x7fe22c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.494+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe238089c10 con 0x7fe24c14c890 2024-09-13T18:39:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.494+0000 7fe24be00640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 0x7fe22c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.495+0000 7fe24be00640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 0x7fe22c06d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe23c001050 tx=0x7fe23c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.498+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe238054de0 con 0x7fe24c14c890 2024-09-13T18:39:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.703+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe24c071dd0 con 0x7fe24c14c890 2024-09-13T18:39:59.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.703+0000 7fe243e00640 1 -- 172.21.15.192:0/1855389019 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fe238058400 con 0x7fe24c14c890 2024-09-13T18:39:59.707 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:39:59.707 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:39:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.705+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 msgr2=0x7fe22c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.705+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 0x7fe22c06d0c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fe23c001050 tx=0x7fe23c009040 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.705+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 msgr2=0x7fe24c155070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.705+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fe2380118e0 tx=0x7fe238011da0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 shutdown_connections 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22c06ac00 0x7fe22c06d0c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24c1555b0 0x7fe24c1e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c14c890 0x7fe24c155070 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 --2- 172.21.15.192:0/1855389019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe230007390 0x7fe24c156cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 >> 172.21.15.192:0/1855389019 conn(0x7fe24c0ae960 msgr2=0x7fe24c15c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 shutdown_connections 2024-09-13T18:39:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.706+0000 7fe253200640 1 -- 172.21.15.192:0/1855389019 wait complete. 2024-09-13T18:39:59.724 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:39:59.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.874+0000 7f686fe00640 1 Processor -- start 2024-09-13T18:39:59.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.874+0000 7f686fe00640 1 -- start start 2024-09-13T18:39:59.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68700d0340 0x7f687006ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686fe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700ce5d0 con 0x7f687015cef0 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68700ce2f0 con 0x7f68700cde60 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68700cda20 con 0x7f68700d0340 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f687015cef0 0x7f68700b2110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41420/0 (socket says 172.21.15.192:41420) 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686ea00640 1 -- 172.21.15.192:0/3191982697 learned_addr learned my addr 172.21.15.192:0/3191982697 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.875+0000 7f686f400640 1 --2- 172.21.15.192:0/3191982697 >> v2:172.21.15.192:3300/0 conn(0x7f68700d0340 0x7f687006ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.876+0000 7f686f400640 1 -- 172.21.15.192:0/3191982697 >> v1:172.21.15.194:6789/0 conn(0x7f68700cde60 legacy=0x7f68700cfc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.876+0000 7f686f400640 1 -- 172.21.15.192:0/3191982697 >> v1:172.21.15.192:6789/0 conn(0x7f687015cef0 legacy=0x7f68700b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.876+0000 7f686f400640 1 -- 172.21.15.192:0/3191982697 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687006af50 con 0x7f68700d0340 2024-09-13T18:39:59.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.877+0000 7f686f400640 1 --2- 172.21.15.192:0/3191982697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68700d0340 0x7f687006ba30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f68700ce7c0 tx=0x7f686802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe52a01d4c09ca0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.877+0000 7f686d600640 1 -- 172.21.15.192:0/3191982697 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868007740 con 0x7f68700d0340 2024-09-13T18:39:59.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.877+0000 7f686d600640 1 -- 172.21.15.192:0/3191982697 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f686802d050 con 0x7f68700d0340 2024-09-13T18:39:59.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.877+0000 7f686d600640 1 -- 172.21.15.192:0/3191982697 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868007ac0 con 0x7f68700d0340 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 -- 172.21.15.192:0/3191982697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68700d0340 msgr2=0x7f687006ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 --2- 172.21.15.192:0/3191982697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68700d0340 0x7f687006ba30 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f68700ce7c0 tx=0x7f686802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 -- 172.21.15.192:0/3191982697 shutdown_connections 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 --2- 172.21.15.192:0/3191982697 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68700d0340 0x7f687006ba30 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 -- 172.21.15.192:0/3191982697 >> 172.21.15.192:0/3191982697 conn(0x7f68700b4b70 msgr2=0x7f68700b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 -- 172.21.15.192:0/3191982697 shutdown_connections 2024-09-13T18:39:59.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.878+0000 7f686fe00640 1 -- 172.21.15.192:0/3191982697 wait complete. 2024-09-13T18:39:59.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.879+0000 7f686fe00640 1 Processor -- start 2024-09-13T18:39:59.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 -- start start 2024-09-13T18:39:59.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d0340 0x7f68701e7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687015cef0 0x7f68700b6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e8180 con 0x7f68701e5f00 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e64c0 con 0x7f687015cef0 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.880+0000 7f686fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68701e67a0 con 0x7f68700d0340 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41616/0 (socket says 172.21.15.192:41616) 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 -- 172.21.15.192:0/4071623798 learned_addr learned my addr 172.21.15.192:0/4071623798 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686e000640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687015cef0 0x7f68700b6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686ea00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d0340 0x7f68701e7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 -- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d0340 msgr2=0x7f68701e7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d0340 0x7f68701e7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 -- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687015cef0 msgr2=0x7f68700b6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687015cef0 0x7f68700b6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.881+0000 7f686f400640 1 -- 172.21.15.192:0/4071623798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6868009a70 con 0x7f68701e5f00 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f686f400640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f686802ac90 tx=0x7f6868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868031910 con 0x7f68701e5f00 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6868031a70 con 0x7f68701e5f00 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6868031e20 con 0x7f68701e5f00 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68701e6a80 con 0x7f68701e5f00 2024-09-13T18:39:59.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.882+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68701e7040 con 0x7f68701e5f00 2024-09-13T18:39:59.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.883+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6870067460 con 0x7f68701e5f00 2024-09-13T18:39:59.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.884+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6868045460 con 0x7f68701e5f00 2024-09-13T18:39:59.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.884+0000 7f6866a00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:39:59.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.885+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f68680ab130 con 0x7f68701e5f00 2024-09-13T18:39:59.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.885+0000 7f686ea00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:39:59.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.885+0000 7f686ea00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6860005880 tx=0x7f6860009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:39:59.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:39:59.888+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f68680762a0 con 0x7f68701e5f00 2024-09-13T18:40:00.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.060+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f687006ba30 con 0x7f68701e5f00 2024-09-13T18:40:00.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.062+0000 7f6866a00640 1 -- 172.21.15.192:0/4071623798 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16568 (secure 0 0 0) 0x7f68680798c0 con 0x7f68701e5f00 2024-09-13T18:40:00.065 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:00.065 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":91,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:39:57.291038+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"79","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"90","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:00.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 msgr2=0x7f685006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6860005880 tx=0x7f6860009040 comp rx=0 tx=0).stop 2024-09-13T18:40:00.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 msgr2=0x7f687014eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f686802ac90 tx=0x7f6868004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 shutdown_connections 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68701e5f00 0x7f687014eba0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f687015cef0 0x7f68700b6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 --2- 172.21.15.192:0/4071623798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68700d0340 0x7f68701e7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 >> 172.21.15.192:0/4071623798 conn(0x7f68700b4b70 msgr2=0x7f687015be00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 shutdown_connections 2024-09-13T18:40:00.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.064+0000 7f686fe00640 1 -- 172.21.15.192:0/4071623798 wait complete. 2024-09-13T18:40:00.083 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:40:00.084 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:40:00.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.237+0000 7f8ce3200640 1 Processor -- start 2024-09-13T18:40:00.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.237+0000 7f8ce3200640 1 -- start start 2024-09-13T18:40:00.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce3200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8cdc15ce30 0x7f8cdc0ade10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8cdc0aefd0 0x7f8cdc160850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cdc0717b0 con 0x7f8cdc06cf90 2024-09-13T18:40:00.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce3200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc0ae350 con 0x7f8cdc15ce30 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cdc06fab0 con 0x7f8cdc0aefd0 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.238+0000 7f8ce1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8cdc15ce30 0x7f8cdc0ade10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8cdc15ce30 0x7f8cdc0ade10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41624/0 (socket says 172.21.15.192:41624) 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 -- 172.21.15.192:0/2549006398 learned_addr learned my addr 172.21.15.192:0/2549006398 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce2800640 1 --2- 172.21.15.192:0/2549006398 >> v2:172.21.15.194:3300/0 conn(0x7f8cdc0aefd0 0x7f8cdc160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 -- 172.21.15.192:0/2549006398 >> v2:172.21.15.194:3300/0 conn(0x7f8cdc0aefd0 msgr2=0x7f8cdc160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:00.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 --2- 172.21.15.192:0/2549006398 >> v2:172.21.15.194:3300/0 conn(0x7f8cdc0aefd0 0x7f8cdc160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 -- 172.21.15.192:0/2549006398 >> v1:172.21.15.194:6789/0 conn(0x7f8cdc06cf90 legacy=0x7f8cdc15c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.239+0000 7f8ce1400640 1 -- 172.21.15.192:0/2549006398 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc070830 con 0x7f8cdc15ce30 2024-09-13T18:40:00.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.240+0000 7f8ce1400640 1 --2- 172.21.15.192:0/2549006398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc0ade10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06f9a0 tx=0x7f8ccc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7725905caa1cbc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.240+0000 7f8ce0a00640 1 -- 172.21.15.192:0/2549006398 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc032440 con 0x7f8cdc15ce30 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.240+0000 7f8ce0a00640 1 -- 172.21.15.192:0/2549006398 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc0325a0 con 0x7f8cdc15ce30 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.240+0000 7f8ce0a00640 1 -- 172.21.15.192:0/2549006398 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc032930 con 0x7f8cdc15ce30 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 -- 172.21.15.192:0/2549006398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 msgr2=0x7f8cdc0ade10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2549006398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc0ade10 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc06f9a0 tx=0x7f8ccc02a270 comp rx=0 tx=0).stop 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 -- 172.21.15.192:0/2549006398 shutdown_connections 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2549006398 >> v2:172.21.15.194:3300/0 conn(0x7f8cdc0aefd0 0x7f8cdc160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2549006398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc0ade10 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 -- 172.21.15.192:0/2549006398 >> 172.21.15.192:0/2549006398 conn(0x7f8cdc06ade0 msgr2=0x7f8cdc06b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:00.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 -- 172.21.15.192:0/2549006398 shutdown_connections 2024-09-13T18:40:00.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.241+0000 7f8ce3200640 1 -- 172.21.15.192:0/2549006398 wait complete. 2024-09-13T18:40:00.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.243+0000 7f8ce3200640 1 Processor -- start 2024-09-13T18:40:00.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.243+0000 7f8ce3200640 1 -- start start 2024-09-13T18:40:00.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc06cf90 0x7f8cdc14f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc0aefd0 0x7f8cdc159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc152520 con 0x7f8cdc15ce30 2024-09-13T18:40:00.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15bb30 con 0x7f8cdc0aefd0 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc15f280 con 0x7f8cdc06cf90 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41636/0 (socket says 172.21.15.192:41636) 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 -- 172.21.15.192:0/2848277481 learned_addr learned my addr 172.21.15.192:0/2848277481 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce1e00640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc06cf90 0x7f8cdc14f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce1400640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc0aefd0 0x7f8cdc159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 -- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc06cf90 msgr2=0x7f8cdc14f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc06cf90 0x7f8cdc14f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 -- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc0aefd0 msgr2=0x7f8cdc159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc0aefd0 0x7f8cdc159df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.244+0000 7f8ce2800640 1 -- 172.21.15.192:0/2848277481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0094d0 con 0x7f8cdc15ce30 2024-09-13T18:40:00.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8ce2800640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800efc0 tx=0x7f8cd800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8014480 con 0x7f8cdc15ce30 2024-09-13T18:40:00.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800f040 con 0x7f8cdc15ce30 2024-09-13T18:40:00.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8014820 con 0x7f8cdc15ce30 2024-09-13T18:40:00.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc160140 con 0x7f8cdc15ce30 2024-09-13T18:40:00.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.245+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc151ed0 con 0x7f8cdc15ce30 2024-09-13T18:40:00.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.246+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc152690 con 0x7f8cdc15ce30 2024-09-13T18:40:00.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.247+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8cd8014980 con 0x7f8cdc15ce30 2024-09-13T18:40:00.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.248+0000 7f8cd6000640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 0x7f8cc006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.248+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8cd8089f10 con 0x7f8cdc15ce30 2024-09-13T18:40:00.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.248+0000 7f8ce1e00640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 0x7f8cc006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.249+0000 7f8ce1e00640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 0x7f8cc006d0c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000f60 tx=0x7f8cd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.252+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8cd8055100 con 0x7f8cdc15ce30 2024-09-13T18:40:00.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.425+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cdc070310 con 0x7f8cc006ac00 2024-09-13T18:40:00.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.433+0000 7f8cd6000640 1 -- 172.21.15.192:0/2848277481 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283298 (secure 0 0 0) 0x7f8cd00014a0 con 0x7f8cc006ac00 2024-09-13T18:40:00.439 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:00.440 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.436+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 msgr2=0x7f8cc006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.436+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 0x7f8cc006d0c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0000f60 tx=0x7f8cd0009040 comp rx=0 tx=0).stop 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.436+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 msgr2=0x7f8cdc15a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.436+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800efc0 tx=0x7f8cd800c490 comp rx=0 tx=0).stop 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 shutdown_connections 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cc006ac00 0x7f8cc006d0c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc15ce30 0x7f8cdc15a330 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc0aefd0 0x7f8cdc159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 --2- 172.21.15.192:0/2848277481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc06cf90 0x7f8cdc14f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 >> 172.21.15.192:0/2848277481 conn(0x7f8cdc06ade0 msgr2=0x7f8cdc0b4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:00.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 shutdown_connections 2024-09-13T18:40:00.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.437+0000 7f8ce3200640 1 -- 172.21.15.192:0/2848277481 wait complete. 2024-09-13T18:40:00.457 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-09-13T18:39:58.791203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":88,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4915,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557584,"statfs":{"total":1600000000,"available":1594966485,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000735"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.308517+0000","last_change":"2024-09-13T18:39:56.307679+0000","last_active":"2024-09-13T18:39:56.308517+0000","last_peered":"2024-09-13T18:39:56.308517+0000","last_clean":"2024-09-13T18:39:56.308517+0000","last_became_active":"2024-09-13T18:39:56.307472+0000","last_became_peered":"2024-09-13T18:39:56.307472+0000","last_unstale":"2024-09-13T18:39:56.308517+0000","last_undegraded":"2024-09-13T18:39:56.308517+0000","last_fullsized":"2024-09-13T18:39:56.308517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:12.093274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381061+0000","last_change":"2024-09-13T18:39:56.309759+0000","last_active":"2024-09-13T18:39:58.381061+0000","last_peered":"2024-09-13T18:39:58.381061+0000","last_clean":"2024-09-13T18:39:58.381061+0000","last_became_active":"2024-09-13T18:39:56.309485+0000","last_became_peered":"2024-09-13T18:39:56.309485+0000","last_unstale":"2024-09-13T18:39:58.381061+0000","last_undegraded":"2024-09-13T18:39:58.381061+0000","last_fullsized":"2024-09-13T18:39:58.381061+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:21.308274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298872+0000","last_change":"2024-09-13T18:39:56.314704+0000","last_active":"2024-09-13T18:39:57.298872+0000","last_peered":"2024-09-13T18:39:57.298872+0000","last_clean":"2024-09-13T18:39:57.298872+0000","last_became_active":"2024-09-13T18:39:56.314172+0000","last_became_peered":"2024-09-13T18:39:56.314172+0000","last_unstale":"2024-09-13T18:39:57.298872+0000","last_undegraded":"2024-09-13T18:39:57.298872+0000","last_fullsized":"2024-09-13T18:39:57.298872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:09.507620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298821+0000","last_change":"2024-09-13T18:39:56.309839+0000","last_active":"2024-09-13T18:39:57.298821+0000","last_peered":"2024-09-13T18:39:57.298821+0000","last_clean":"2024-09-13T18:39:57.298821+0000","last_became_active":"2024-09-13T18:39:56.309629+0000","last_became_peered":"2024-09-13T18:39:56.309629+0000","last_unstale":"2024-09-13T18:39:57.298821+0000","last_undegraded":"2024-09-13T18:39:57.298821+0000","last_fullsized":"2024-09-13T18:39:57.298821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:05.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301804+0000","last_change":"2024-09-13T18:39:56.309846+0000","last_active":"2024-09-13T18:39:57.301804+0000","last_peered":"2024-09-13T18:39:57.301804+0000","last_clean":"2024-09-13T18:39:57.301804+0000","last_became_active":"2024-09-13T18:39:56.309623+0000","last_became_peered":"2024-09-13T18:39:56.309623+0000","last_unstale":"2024-09-13T18:39:57.301804+0000","last_undegraded":"2024-09-13T18:39:57.301804+0000","last_fullsized":"2024-09-13T18:39:57.301804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301604+0000","last_change":"2024-09-13T18:39:56.317679+0000","last_active":"2024-09-13T18:39:57.301604+0000","last_peered":"2024-09-13T18:39:57.301604+0000","last_clean":"2024-09-13T18:39:57.301604+0000","last_became_active":"2024-09-13T18:39:56.314423+0000","last_became_peered":"2024-09-13T18:39:56.314423+0000","last_unstale":"2024-09-13T18:39:57.301604+0000","last_undegraded":"2024-09-13T18:39:57.301604+0000","last_fullsized":"2024-09-13T18:39:57.301604+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:39.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302698+0000","last_change":"2024-09-13T18:39:56.300976+0000","last_active":"2024-09-13T18:39:56.302698+0000","last_peered":"2024-09-13T18:39:56.302698+0000","last_clean":"2024-09-13T18:39:56.302698+0000","last_became_active":"2024-09-13T18:39:56.298719+0000","last_became_peered":"2024-09-13T18:39:56.298719+0000","last_unstale":"2024-09-13T18:39:56.302698+0000","last_undegraded":"2024-09-13T18:39:56.302698+0000","last_fullsized":"2024-09-13T18:39:56.302698+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:33.233444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298956+0000","last_change":"2024-09-13T18:39:56.303949+0000","last_active":"2024-09-13T18:39:57.298956+0000","last_peered":"2024-09-13T18:39:57.298956+0000","last_clean":"2024-09-13T18:39:57.298956+0000","last_became_active":"2024-09-13T18:39:56.303743+0000","last_became_peered":"2024-09-13T18:39:56.303743+0000","last_unstale":"2024-09-13T18:39:57.298956+0000","last_undegraded":"2024-09-13T18:39:57.298956+0000","last_fullsized":"2024-09-13T18:39:57.298956+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:29.045607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302226+0000","last_change":"2024-09-13T18:39:56.319101+0000","last_active":"2024-09-13T18:39:57.302226+0000","last_peered":"2024-09-13T18:39:57.302226+0000","last_clean":"2024-09-13T18:39:57.302226+0000","last_became_active":"2024-09-13T18:39:56.316651+0000","last_became_peered":"2024-09-13T18:39:56.316651+0000","last_unstale":"2024-09-13T18:39:57.302226+0000","last_undegraded":"2024-09-13T18:39:57.302226+0000","last_fullsized":"2024-09-13T18:39:57.302226+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:45.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298423+0000","last_change":"2024-09-13T18:39:56.298366+0000","last_active":"2024-09-13T18:39:56.298423+0000","last_peered":"2024-09-13T18:39:56.298423+0000","last_clean":"2024-09-13T18:39:56.298423+0000","last_became_active":"2024-09-13T18:39:56.298228+0000","last_became_peered":"2024-09-13T18:39:56.298228+0000","last_unstale":"2024-09-13T18:39:56.298423+0000","last_undegraded":"2024-09-13T18:39:56.298423+0000","last_fullsized":"2024-09-13T18:39:56.298423+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:37.159369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.308176+0000","last_change":"2024-09-13T18:39:56.306591+0000","last_active":"2024-09-13T18:39:56.308176+0000","last_peered":"2024-09-13T18:39:56.308176+0000","last_clean":"2024-09-13T18:39:56.308176+0000","last_became_active":"2024-09-13T18:39:56.306330+0000","last_became_peered":"2024-09-13T18:39:56.306330+0000","last_unstale":"2024-09-13T18:39:56.308176+0000","last_undegraded":"2024-09-13T18:39:56.308176+0000","last_fullsized":"2024-09-13T18:39:56.308176+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:37.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298959+0000","last_change":"2024-09-13T18:39:56.314855+0000","last_active":"2024-09-13T18:39:57.298959+0000","last_peered":"2024-09-13T18:39:57.298959+0000","last_clean":"2024-09-13T18:39:57.298959+0000","last_became_active":"2024-09-13T18:39:56.314474+0000","last_became_peered":"2024-09-13T18:39:56.314474+0000","last_unstale":"2024-09-13T18:39:57.298959+0000","last_undegraded":"2024-09-13T18:39:57.298959+0000","last_fullsized":"2024-09-13T18:39:57.298959+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:55.631644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310570+0000","last_change":"2024-09-13T18:39:56.309841+0000","last_active":"2024-09-13T18:39:56.310570+0000","last_peered":"2024-09-13T18:39:56.310570+0000","last_clean":"2024-09-13T18:39:56.310570+0000","last_became_active":"2024-09-13T18:39:56.309408+0000","last_became_peered":"2024-09-13T18:39:56.309408+0000","last_unstale":"2024-09-13T18:39:56.310570+0000","last_undegraded":"2024-09-13T18:39:56.310570+0000","last_fullsized":"2024-09-13T18:39:56.310570+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:21.308274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310533+0000","last_change":"2024-09-13T18:39:56.308774+0000","last_active":"2024-09-13T18:39:56.310533+0000","last_peered":"2024-09-13T18:39:56.310533+0000","last_clean":"2024-09-13T18:39:56.310533+0000","last_became_active":"2024-09-13T18:39:56.308553+0000","last_became_peered":"2024-09-13T18:39:56.308553+0000","last_unstale":"2024-09-13T18:39:56.310533+0000","last_undegraded":"2024-09-13T18:39:56.310533+0000","last_fullsized":"2024-09-13T18:39:56.310533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.296901+0000","last_change":"2024-09-13T18:39:56.296814+0000","last_active":"2024-09-13T18:39:56.296901+0000","last_peered":"2024-09-13T18:39:56.296901+0000","last_clean":"2024-09-13T18:39:56.296901+0000","last_became_active":"2024-09-13T18:39:56.296588+0000","last_became_peered":"2024-09-13T18:39:56.296588+0000","last_unstale":"2024-09-13T18:39:56.296901+0000","last_undegraded":"2024-09-13T18:39:56.296901+0000","last_fullsized":"2024-09-13T18:39:56.296901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:52.390363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307478+0000","last_change":"2024-09-13T18:39:56.305633+0000","last_active":"2024-09-13T18:39:56.307478+0000","last_peered":"2024-09-13T18:39:56.307478+0000","last_clean":"2024-09-13T18:39:56.307478+0000","last_became_active":"2024-09-13T18:39:56.304346+0000","last_became_peered":"2024-09-13T18:39:56.304346+0000","last_unstale":"2024-09-13T18:39:56.307478+0000","last_undegraded":"2024-09-13T18:39:56.307478+0000","last_fullsized":"2024-09-13T18:39:56.307478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:21.274790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381117+0000","last_change":"2024-09-13T18:39:56.304170+0000","last_active":"2024-09-13T18:39:58.381117+0000","last_peered":"2024-09-13T18:39:58.381117+0000","last_clean":"2024-09-13T18:39:58.381117+0000","last_became_active":"2024-09-13T18:39:56.303937+0000","last_became_peered":"2024-09-13T18:39:56.303937+0000","last_unstale":"2024-09-13T18:39:58.381117+0000","last_undegraded":"2024-09-13T18:39:58.381117+0000","last_fullsized":"2024-09-13T18:39:58.381117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301593+0000","last_change":"2024-09-13T18:39:56.309992+0000","last_active":"2024-09-13T18:39:57.301593+0000","last_peered":"2024-09-13T18:39:57.301593+0000","last_clean":"2024-09-13T18:39:57.301593+0000","last_became_active":"2024-09-13T18:39:56.309550+0000","last_became_peered":"2024-09-13T18:39:56.309550+0000","last_unstale":"2024-09-13T18:39:57.301593+0000","last_undegraded":"2024-09-13T18:39:57.301593+0000","last_fullsized":"2024-09-13T18:39:57.301593+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:54.385668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302039+0000","last_change":"2024-09-13T18:39:56.312834+0000","last_active":"2024-09-13T18:39:57.302039+0000","last_peered":"2024-09-13T18:39:57.302039+0000","last_clean":"2024-09-13T18:39:57.302039+0000","last_became_active":"2024-09-13T18:39:56.312459+0000","last_became_peered":"2024-09-13T18:39:56.312459+0000","last_unstale":"2024-09-13T18:39:57.302039+0000","last_undegraded":"2024-09-13T18:39:57.302039+0000","last_fullsized":"2024-09-13T18:39:57.302039+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:51.555165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307523+0000","last_change":"2024-09-13T18:39:56.305775+0000","last_active":"2024-09-13T18:39:56.307523+0000","last_peered":"2024-09-13T18:39:56.307523+0000","last_clean":"2024-09-13T18:39:56.307523+0000","last_became_active":"2024-09-13T18:39:56.304643+0000","last_became_peered":"2024-09-13T18:39:56.304643+0000","last_unstale":"2024-09-13T18:39:56.307523+0000","last_undegraded":"2024-09-13T18:39:56.307523+0000","last_fullsized":"2024-09-13T18:39:56.307523+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:40.787099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302181+0000","last_change":"2024-09-13T18:39:56.317556+0000","last_active":"2024-09-13T18:39:57.302181+0000","last_peered":"2024-09-13T18:39:57.302181+0000","last_clean":"2024-09-13T18:39:57.302181+0000","last_became_active":"2024-09-13T18:39:56.312599+0000","last_became_peered":"2024-09-13T18:39:56.312599+0000","last_unstale":"2024-09-13T18:39:57.302181+0000","last_undegraded":"2024-09-13T18:39:57.302181+0000","last_fullsized":"2024-09-13T18:39:57.302181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:55.350490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.315719+0000","last_change":"2024-09-13T18:39:56.314691+0000","last_active":"2024-09-13T18:39:56.315719+0000","last_peered":"2024-09-13T18:39:56.315719+0000","last_clean":"2024-09-13T18:39:56.315719+0000","last_became_active":"2024-09-13T18:39:56.314490+0000","last_became_peered":"2024-09-13T18:39:56.314490+0000","last_unstale":"2024-09-13T18:39:56.315719+0000","last_undegraded":"2024-09-13T18:39:56.315719+0000","last_fullsized":"2024-09-13T18:39:56.315719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.690216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381061+0000","last_change":"2024-09-13T18:39:56.303489+0000","last_active":"2024-09-13T18:39:58.381061+0000","last_peered":"2024-09-13T18:39:58.381061+0000","last_clean":"2024-09-13T18:39:58.381061+0000","last_became_active":"2024-09-13T18:39:56.303292+0000","last_became_peered":"2024-09-13T18:39:56.303292+0000","last_unstale":"2024-09-13T18:39:58.381061+0000","last_undegraded":"2024-09-13T18:39:58.381061+0000","last_fullsized":"2024-09-13T18:39:58.381061+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:54.616842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299069+0000","last_change":"2024-09-13T18:39:56.311020+0000","last_active":"2024-09-13T18:39:57.299069+0000","last_peered":"2024-09-13T18:39:57.299069+0000","last_clean":"2024-09-13T18:39:57.299069+0000","last_became_active":"2024-09-13T18:39:56.310811+0000","last_became_peered":"2024-09-13T18:39:56.310811+0000","last_unstale":"2024-09-13T18:39:57.299069+0000","last_undegraded":"2024-09-13T18:39:57.299069+0000","last_fullsized":"2024-09-13T18:39:57.299069+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:23.341589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307505+0000","last_change":"2024-09-13T18:39:56.305765+0000","last_active":"2024-09-13T18:39:56.307505+0000","last_peered":"2024-09-13T18:39:56.307505+0000","last_clean":"2024-09-13T18:39:56.307505+0000","last_became_active":"2024-09-13T18:39:56.305173+0000","last_became_peered":"2024-09-13T18:39:56.305173+0000","last_unstale":"2024-09-13T18:39:56.307505+0000","last_undegraded":"2024-09-13T18:39:56.307505+0000","last_fullsized":"2024-09-13T18:39:56.307505+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:33.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381201+0000","last_change":"2024-09-13T18:39:56.303253+0000","last_active":"2024-09-13T18:39:58.381201+0000","last_peered":"2024-09-13T18:39:58.381201+0000","last_clean":"2024-09-13T18:39:58.381201+0000","last_became_active":"2024-09-13T18:39:56.303026+0000","last_became_peered":"2024-09-13T18:39:56.303026+0000","last_unstale":"2024-09-13T18:39:58.381201+0000","last_undegraded":"2024-09-13T18:39:58.381201+0000","last_fullsized":"2024-09-13T18:39:58.381201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:37.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381202+0000","last_change":"2024-09-13T18:39:56.307083+0000","last_active":"2024-09-13T18:39:58.381202+0000","last_peered":"2024-09-13T18:39:58.381202+0000","last_clean":"2024-09-13T18:39:58.381202+0000","last_became_active":"2024-09-13T18:39:56.306279+0000","last_became_peered":"2024-09-13T18:39:56.306279+0000","last_unstale":"2024-09-13T18:39:58.381202+0000","last_undegraded":"2024-09-13T18:39:58.381202+0000","last_fullsized":"2024-09-13T18:39:58.381202+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:18.414400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.295473+0000","last_change":"2024-09-13T18:39:56.295397+0000","last_active":"2024-09-13T18:39:56.295473+0000","last_peered":"2024-09-13T18:39:56.295473+0000","last_clean":"2024-09-13T18:39:56.295473+0000","last_became_active":"2024-09-13T18:39:56.295167+0000","last_became_peered":"2024-09-13T18:39:56.295167+0000","last_unstale":"2024-09-13T18:39:56.295473+0000","last_undegraded":"2024-09-13T18:39:56.295473+0000","last_fullsized":"2024-09-13T18:39:56.295473+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:54.512386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"90'4","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301681+0000","last_change":"2024-09-13T18:39:55.886792+0000","last_active":"2024-09-13T18:39:57.301681+0000","last_peered":"2024-09-13T18:39:57.301681+0000","last_clean":"2024-09-13T18:39:57.301681+0000","last_became_active":"2024-09-13T18:39:55.884389+0000","last_became_peered":"2024-09-13T18:39:55.884389+0000","last_unstale":"2024-09-13T18:39:57.301681+0000","last_undegraded":"2024-09-13T18:39:57.301681+0000","last_fullsized":"2024-09-13T18:39:57.301681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:53.755588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299023+0000","last_change":"2024-09-13T18:39:56.306270+0000","last_active":"2024-09-13T18:39:57.299023+0000","last_peered":"2024-09-13T18:39:57.299023+0000","last_clean":"2024-09-13T18:39:57.299023+0000","last_became_active":"2024-09-13T18:39:56.306061+0000","last_became_peered":"2024-09-13T18:39:56.306061+0000","last_unstale":"2024-09-13T18:39:57.299023+0000","last_undegraded":"2024-09-13T18:39:57.299023+0000","last_fullsized":"2024-09-13T18:39:57.299023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:39.177195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:54.856680+0000","last_change":"2024-09-13T18:39:54.856680+0000","last_active":"2024-09-13T18:39:54.856680+0000","last_peered":"2024-09-13T18:39:54.856680+0000","last_clean":"2024-09-13T18:39:54.856680+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:54.856680+0000","last_undegraded":"2024-09-13T18:39:54.856680+0000","last_fullsized":"2024-09-13T18:39:54.856680+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301884+0000","last_change":"2024-09-13T18:39:56.308323+0000","last_active":"2024-09-13T18:39:57.301884+0000","last_peered":"2024-09-13T18:39:57.301884+0000","last_clean":"2024-09-13T18:39:57.301884+0000","last_became_active":"2024-09-13T18:39:56.307029+0000","last_became_peered":"2024-09-13T18:39:56.307029+0000","last_unstale":"2024-09-13T18:39:57.301884+0000","last_undegraded":"2024-09-13T18:39:57.301884+0000","last_fullsized":"2024-09-13T18:39:57.301884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314270+0000","last_change":"2024-09-13T18:39:55.886436+0000","last_active":"2024-09-13T18:39:56.314270+0000","last_peered":"2024-09-13T18:39:56.314270+0000","last_clean":"2024-09-13T18:39:56.314270+0000","last_became_active":"2024-09-13T18:39:55.886166+0000","last_became_peered":"2024-09-13T18:39:55.886166+0000","last_unstale":"2024-09-13T18:39:56.314270+0000","last_undegraded":"2024-09-13T18:39:56.314270+0000","last_fullsized":"2024-09-13T18:39:56.314270+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:12.288599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302267+0000","last_change":"2024-09-13T18:39:56.316884+0000","last_active":"2024-09-13T18:39:57.302267+0000","last_peered":"2024-09-13T18:39:57.302267+0000","last_clean":"2024-09-13T18:39:57.302267+0000","last_became_active":"2024-09-13T18:39:56.312181+0000","last_became_peered":"2024-09-13T18:39:56.312181+0000","last_unstale":"2024-09-13T18:39:57.302267+0000","last_undegraded":"2024-09-13T18:39:57.302267+0000","last_fullsized":"2024-09-13T18:39:57.302267+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:24.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302087+0000","last_change":"2024-09-13T18:39:55.889553+0000","last_active":"2024-09-13T18:39:57.302087+0000","last_peered":"2024-09-13T18:39:57.302087+0000","last_clean":"2024-09-13T18:39:57.302087+0000","last_became_active":"2024-09-13T18:39:55.888778+0000","last_became_peered":"2024-09-13T18:39:55.888778+0000","last_unstale":"2024-09-13T18:39:57.302087+0000","last_undegraded":"2024-09-13T18:39:57.302087+0000","last_fullsized":"2024-09-13T18:39:57.302087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.062616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302713+0000","last_change":"2024-09-13T18:39:56.301147+0000","last_active":"2024-09-13T18:39:56.302713+0000","last_peered":"2024-09-13T18:39:56.302713+0000","last_clean":"2024-09-13T18:39:56.302713+0000","last_became_active":"2024-09-13T18:39:56.300691+0000","last_became_peered":"2024-09-13T18:39:56.300691+0000","last_unstale":"2024-09-13T18:39:56.302713+0000","last_undegraded":"2024-09-13T18:39:56.302713+0000","last_fullsized":"2024-09-13T18:39:56.302713+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:35.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.311150+0000","last_change":"2024-09-13T18:39:55.889299+0000","last_active":"2024-09-13T18:39:56.311150+0000","last_peered":"2024-09-13T18:39:56.311150+0000","last_clean":"2024-09-13T18:39:56.311150+0000","last_became_active":"2024-09-13T18:39:55.889091+0000","last_became_peered":"2024-09-13T18:39:55.889091+0000","last_unstale":"2024-09-13T18:39:56.311150+0000","last_undegraded":"2024-09-13T18:39:56.311150+0000","last_fullsized":"2024-09-13T18:39:56.311150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301692+0000","last_change":"2024-09-13T18:39:56.310199+0000","last_active":"2024-09-13T18:39:57.301692+0000","last_peered":"2024-09-13T18:39:57.301692+0000","last_clean":"2024-09-13T18:39:57.301692+0000","last_became_active":"2024-09-13T18:39:56.309804+0000","last_became_peered":"2024-09-13T18:39:56.309804+0000","last_unstale":"2024-09-13T18:39:57.301692+0000","last_undegraded":"2024-09-13T18:39:57.301692+0000","last_fullsized":"2024-09-13T18:39:57.301692+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:27.735776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"90'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302136+0000","last_change":"2024-09-13T18:39:55.881229+0000","last_active":"2024-09-13T18:39:57.302136+0000","last_peered":"2024-09-13T18:39:57.302136+0000","last_clean":"2024-09-13T18:39:57.302136+0000","last_became_active":"2024-09-13T18:39:55.880481+0000","last_became_peered":"2024-09-13T18:39:55.880481+0000","last_unstale":"2024-09-13T18:39:57.302136+0000","last_undegraded":"2024-09-13T18:39:57.302136+0000","last_fullsized":"2024-09-13T18:39:57.302136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:35.427580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314504+0000","last_change":"2024-09-13T18:39:56.314409+0000","last_active":"2024-09-13T18:39:56.314504+0000","last_peered":"2024-09-13T18:39:56.314504+0000","last_clean":"2024-09-13T18:39:56.314504+0000","last_became_active":"2024-09-13T18:39:56.314131+0000","last_became_peered":"2024-09-13T18:39:56.314131+0000","last_unstale":"2024-09-13T18:39:56.314504+0000","last_undegraded":"2024-09-13T18:39:56.314504+0000","last_fullsized":"2024-09-13T18:39:56.314504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:21.178324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.300673+0000","last_change":"2024-09-13T18:39:55.890656+0000","last_active":"2024-09-13T18:39:56.300673+0000","last_peered":"2024-09-13T18:39:56.300673+0000","last_clean":"2024-09-13T18:39:56.300673+0000","last_became_active":"2024-09-13T18:39:55.890298+0000","last_became_peered":"2024-09-13T18:39:55.890298+0000","last_unstale":"2024-09-13T18:39:56.300673+0000","last_undegraded":"2024-09-13T18:39:56.300673+0000","last_fullsized":"2024-09-13T18:39:56.300673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310555+0000","last_change":"2024-09-13T18:39:56.309635+0000","last_active":"2024-09-13T18:39:56.310555+0000","last_peered":"2024-09-13T18:39:56.310555+0000","last_clean":"2024-09-13T18:39:56.310555+0000","last_became_active":"2024-09-13T18:39:56.307721+0000","last_became_peered":"2024-09-13T18:39:56.307721+0000","last_unstale":"2024-09-13T18:39:56.310555+0000","last_undegraded":"2024-09-13T18:39:56.310555+0000","last_fullsized":"2024-09-13T18:39:56.310555+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298276+0000","last_change":"2024-09-13T18:39:55.882264+0000","last_active":"2024-09-13T18:39:56.298276+0000","last_peered":"2024-09-13T18:39:56.298276+0000","last_clean":"2024-09-13T18:39:56.298276+0000","last_became_active":"2024-09-13T18:39:55.882014+0000","last_became_peered":"2024-09-13T18:39:55.882014+0000","last_unstale":"2024-09-13T18:39:56.298276+0000","last_undegraded":"2024-09-13T18:39:56.298276+0000","last_fullsized":"2024-09-13T18:39:56.298276+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:35.084021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301694+0000","last_change":"2024-09-13T18:39:56.317165+0000","last_active":"2024-09-13T18:39:57.301694+0000","last_peered":"2024-09-13T18:39:57.301694+0000","last_clean":"2024-09-13T18:39:57.301694+0000","last_became_active":"2024-09-13T18:39:56.312867+0000","last_became_peered":"2024-09-13T18:39:56.312867+0000","last_unstale":"2024-09-13T18:39:57.301694+0000","last_undegraded":"2024-09-13T18:39:57.301694+0000","last_fullsized":"2024-09-13T18:39:57.301694+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:26.513906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.295571+0000","last_change":"2024-09-13T18:39:55.892822+0000","last_active":"2024-09-13T18:39:56.295571+0000","last_peered":"2024-09-13T18:39:56.295571+0000","last_clean":"2024-09-13T18:39:56.295571+0000","last_became_active":"2024-09-13T18:39:55.892585+0000","last_became_peered":"2024-09-13T18:39:55.892585+0000","last_unstale":"2024-09-13T18:39:56.295571+0000","last_undegraded":"2024-09-13T18:39:56.295571+0000","last_fullsized":"2024-09-13T18:39:56.295571+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381298+0000","last_change":"2024-09-13T18:39:56.315036+0000","last_active":"2024-09-13T18:39:58.381298+0000","last_peered":"2024-09-13T18:39:58.381298+0000","last_clean":"2024-09-13T18:39:58.381298+0000","last_became_active":"2024-09-13T18:39:56.314790+0000","last_became_peered":"2024-09-13T18:39:56.314790+0000","last_unstale":"2024-09-13T18:39:58.381298+0000","last_undegraded":"2024-09-13T18:39:58.381298+0000","last_fullsized":"2024-09-13T18:39:58.381298+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381277+0000","last_change":"2024-09-13T18:39:55.888394+0000","last_active":"2024-09-13T18:39:58.381277+0000","last_peered":"2024-09-13T18:39:58.381277+0000","last_clean":"2024-09-13T18:39:58.381277+0000","last_became_active":"2024-09-13T18:39:55.888146+0000","last_became_peered":"2024-09-13T18:39:55.888146+0000","last_unstale":"2024-09-13T18:39:58.381277+0000","last_undegraded":"2024-09-13T18:39:58.381277+0000","last_fullsized":"2024-09-13T18:39:58.381277+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:51.707790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.309682+0000","last_change":"2024-09-13T18:39:56.309621+0000","last_active":"2024-09-13T18:39:56.309682+0000","last_peered":"2024-09-13T18:39:56.309682+0000","last_clean":"2024-09-13T18:39:56.309682+0000","last_became_active":"2024-09-13T18:39:56.309371+0000","last_became_peered":"2024-09-13T18:39:56.309371+0000","last_unstale":"2024-09-13T18:39:56.309682+0000","last_undegraded":"2024-09-13T18:39:56.309682+0000","last_fullsized":"2024-09-13T18:39:56.309682+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:03.788667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.312660+0000","last_change":"2024-09-13T18:39:55.884581+0000","last_active":"2024-09-13T18:39:56.312660+0000","last_peered":"2024-09-13T18:39:56.312660+0000","last_clean":"2024-09-13T18:39:56.312660+0000","last_became_active":"2024-09-13T18:39:55.884341+0000","last_became_peered":"2024-09-13T18:39:55.884341+0000","last_unstale":"2024-09-13T18:39:56.312660+0000","last_undegraded":"2024-09-13T18:39:56.312660+0000","last_fullsized":"2024-09-13T18:39:56.312660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:36.837383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"90'6","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.319132+0000","last_change":"2024-09-13T18:39:55.891483+0000","last_active":"2024-09-13T18:39:56.319132+0000","last_peered":"2024-09-13T18:39:56.319132+0000","last_clean":"2024-09-13T18:39:56.319132+0000","last_became_active":"2024-09-13T18:39:55.891299+0000","last_became_peered":"2024-09-13T18:39:55.891299+0000","last_unstale":"2024-09-13T18:39:56.319132+0000","last_undegraded":"2024-09-13T18:39:56.319132+0000","last_fullsized":"2024-09-13T18:39:56.319132+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.062616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301962+0000","last_change":"2024-09-13T18:39:56.303889+0000","last_active":"2024-09-13T18:39:57.301962+0000","last_peered":"2024-09-13T18:39:57.301962+0000","last_clean":"2024-09-13T18:39:57.301962+0000","last_became_active":"2024-09-13T18:39:56.303697+0000","last_became_peered":"2024-09-13T18:39:56.303697+0000","last_unstale":"2024-09-13T18:39:57.301962+0000","last_undegraded":"2024-09-13T18:39:57.301962+0000","last_fullsized":"2024-09-13T18:39:57.301962+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.317738+0000","last_change":"2024-09-13T18:39:55.893349+0000","last_active":"2024-09-13T18:39:56.317738+0000","last_peered":"2024-09-13T18:39:56.317738+0000","last_clean":"2024-09-13T18:39:56.317738+0000","last_became_active":"2024-09-13T18:39:55.893131+0000","last_became_peered":"2024-09-13T18:39:55.893131+0000","last_unstale":"2024-09-13T18:39:56.317738+0000","last_undegraded":"2024-09-13T18:39:56.317738+0000","last_fullsized":"2024-09-13T18:39:56.317738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302311+0000","last_change":"2024-09-13T18:39:56.319232+0000","last_active":"2024-09-13T18:39:57.302311+0000","last_peered":"2024-09-13T18:39:57.302311+0000","last_clean":"2024-09-13T18:39:57.302311+0000","last_became_active":"2024-09-13T18:39:56.318713+0000","last_became_peered":"2024-09-13T18:39:56.318713+0000","last_unstale":"2024-09-13T18:39:57.302311+0000","last_undegraded":"2024-09-13T18:39:57.302311+0000","last_fullsized":"2024-09-13T18:39:57.302311+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:51.060467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301966+0000","last_change":"2024-09-13T18:39:55.881792+0000","last_active":"2024-09-13T18:39:57.301966+0000","last_peered":"2024-09-13T18:39:57.301966+0000","last_clean":"2024-09-13T18:39:57.301966+0000","last_became_active":"2024-09-13T18:39:55.881573+0000","last_became_peered":"2024-09-13T18:39:55.881573+0000","last_unstale":"2024-09-13T18:39:57.301966+0000","last_undegraded":"2024-09-13T18:39:57.301966+0000","last_fullsized":"2024-09-13T18:39:57.301966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:46.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301939+0000","last_change":"2024-09-13T18:39:55.881051+0000","last_active":"2024-09-13T18:39:57.301939+0000","last_peered":"2024-09-13T18:39:57.301939+0000","last_clean":"2024-09-13T18:39:57.301939+0000","last_became_active":"2024-09-13T18:39:55.880817+0000","last_became_peered":"2024-09-13T18:39:55.880817+0000","last_unstale":"2024-09-13T18:39:57.301939+0000","last_undegraded":"2024-09-13T18:39:57.301939+0000","last_fullsized":"2024-09-13T18:39:57.301939+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:36.515370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298932+0000","last_change":"2024-09-13T18:39:56.308510+0000","last_active":"2024-09-13T18:39:57.298932+0000","last_peered":"2024-09-13T18:39:57.298932+0000","last_clean":"2024-09-13T18:39:57.298932+0000","last_became_active":"2024-09-13T18:39:56.306982+0000","last_became_peered":"2024-09-13T18:39:56.306982+0000","last_unstale":"2024-09-13T18:39:57.298932+0000","last_undegraded":"2024-09-13T18:39:57.298932+0000","last_fullsized":"2024-09-13T18:39:57.298932+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:28.678249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"90'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302226+0000","last_change":"2024-09-13T18:39:55.881369+0000","last_active":"2024-09-13T18:39:57.302226+0000","last_peered":"2024-09-13T18:39:57.302226+0000","last_clean":"2024-09-13T18:39:57.302226+0000","last_became_active":"2024-09-13T18:39:55.880727+0000","last_became_peered":"2024-09-13T18:39:55.880727+0000","last_unstale":"2024-09-13T18:39:57.302226+0000","last_undegraded":"2024-09-13T18:39:57.302226+0000","last_fullsized":"2024-09-13T18:39:57.302226+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:15.124054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381224+0000","last_change":"2024-09-13T18:39:56.308903+0000","last_active":"2024-09-13T18:39:58.381224+0000","last_peered":"2024-09-13T18:39:58.381224+0000","last_clean":"2024-09-13T18:39:58.381224+0000","last_became_active":"2024-09-13T18:39:56.308620+0000","last_became_peered":"2024-09-13T18:39:56.308620+0000","last_unstale":"2024-09-13T18:39:58.381224+0000","last_undegraded":"2024-09-13T18:39:58.381224+0000","last_fullsized":"2024-09-13T18:39:58.381224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:05.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.315086+0000","last_change":"2024-09-13T18:39:55.891359+0000","last_active":"2024-09-13T18:39:56.315086+0000","last_peered":"2024-09-13T18:39:56.315086+0000","last_clean":"2024-09-13T18:39:56.315086+0000","last_became_active":"2024-09-13T18:39:55.890223+0000","last_became_peered":"2024-09-13T18:39:55.890223+0000","last_unstale":"2024-09-13T18:39:56.315086+0000","last_undegraded":"2024-09-13T18:39:56.315086+0000","last_fullsized":"2024-09-13T18:39:56.315086+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:33.531645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381148+0000","last_change":"2024-09-13T18:39:56.299548+0000","last_active":"2024-09-13T18:39:58.381148+0000","last_peered":"2024-09-13T18:39:58.381148+0000","last_clean":"2024-09-13T18:39:58.381148+0000","last_became_active":"2024-09-13T18:39:56.299350+0000","last_became_peered":"2024-09-13T18:39:56.299350+0000","last_unstale":"2024-09-13T18:39:58.381148+0000","last_undegraded":"2024-09-13T18:39:58.381148+0000","last_fullsized":"2024-09-13T18:39:58.381148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:56.184829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381353+0000","last_change":"2024-09-13T18:39:55.891310+0000","last_active":"2024-09-13T18:39:58.381353+0000","last_peered":"2024-09-13T18:39:58.381353+0000","last_clean":"2024-09-13T18:39:58.381353+0000","last_became_active":"2024-09-13T18:39:55.890521+0000","last_became_peered":"2024-09-13T18:39:55.890521+0000","last_unstale":"2024-09-13T18:39:58.381353+0000","last_undegraded":"2024-09-13T18:39:58.381353+0000","last_fullsized":"2024-09-13T18:39:58.381353+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:50.054330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299065+0000","last_change":"2024-09-13T18:39:56.307205+0000","last_active":"2024-09-13T18:39:57.299065+0000","last_peered":"2024-09-13T18:39:57.299065+0000","last_clean":"2024-09-13T18:39:57.299065+0000","last_became_active":"2024-09-13T18:39:56.306486+0000","last_became_peered":"2024-09-13T18:39:56.306486+0000","last_unstale":"2024-09-13T18:39:57.299065+0000","last_undegraded":"2024-09-13T18:39:57.299065+0000","last_fullsized":"2024-09-13T18:39:57.299065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.528052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"90'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381381+0000","last_change":"2024-09-13T18:39:55.892482+0000","last_active":"2024-09-13T18:39:58.381381+0000","last_peered":"2024-09-13T18:39:58.381381+0000","last_clean":"2024-09-13T18:39:58.381381+0000","last_became_active":"2024-09-13T18:39:55.892269+0000","last_became_peered":"2024-09-13T18:39:55.892269+0000","last_unstale":"2024-09-13T18:39:58.381381+0000","last_undegraded":"2024-09-13T18:39:58.381381+0000","last_fullsized":"2024-09-13T18:39:58.381381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:25.507769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298855+0000","last_change":"2024-09-13T18:39:56.311176+0000","last_active":"2024-09-13T18:39:57.298855+0000","last_peered":"2024-09-13T18:39:57.298855+0000","last_clean":"2024-09-13T18:39:57.298855+0000","last_became_active":"2024-09-13T18:39:56.310319+0000","last_became_peered":"2024-09-13T18:39:56.310319+0000","last_unstale":"2024-09-13T18:39:57.298855+0000","last_undegraded":"2024-09-13T18:39:57.298855+0000","last_fullsized":"2024-09-13T18:39:57.298855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:24.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301766+0000","last_change":"2024-09-13T18:39:55.887673+0000","last_active":"2024-09-13T18:39:57.301766+0000","last_peered":"2024-09-13T18:39:57.301766+0000","last_clean":"2024-09-13T18:39:57.301766+0000","last_became_active":"2024-09-13T18:39:55.887463+0000","last_became_peered":"2024-09-13T18:39:55.887463+0000","last_unstale":"2024-09-13T18:39:57.301766+0000","last_undegraded":"2024-09-13T18:39:57.301766+0000","last_fullsized":"2024-09-13T18:39:57.301766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.306427+0000","last_change":"2024-09-13T18:39:56.306367+0000","last_active":"2024-09-13T18:39:56.306427+0000","last_peered":"2024-09-13T18:39:56.306427+0000","last_clean":"2024-09-13T18:39:56.306427+0000","last_became_active":"2024-09-13T18:39:56.304010+0000","last_became_peered":"2024-09-13T18:39:56.304010+0000","last_unstale":"2024-09-13T18:39:56.306427+0000","last_undegraded":"2024-09-13T18:39:56.306427+0000","last_fullsized":"2024-09-13T18:39:56.306427+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:36.090158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301597+0000","last_change":"2024-09-13T18:39:55.883546+0000","last_active":"2024-09-13T18:39:57.301597+0000","last_peered":"2024-09-13T18:39:57.301597+0000","last_clean":"2024-09-13T18:39:57.301597+0000","last_became_active":"2024-09-13T18:39:55.882969+0000","last_became_peered":"2024-09-13T18:39:55.882969+0000","last_unstale":"2024-09-13T18:39:57.301597+0000","last_undegraded":"2024-09-13T18:39:57.301597+0000","last_fullsized":"2024-09-13T18:39:57.301597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.305931+0000","last_change":"2024-09-13T18:39:56.305179+0000","last_active":"2024-09-13T18:39:56.305931+0000","last_peered":"2024-09-13T18:39:56.305931+0000","last_clean":"2024-09-13T18:39:56.305931+0000","last_became_active":"2024-09-13T18:39:56.304956+0000","last_became_peered":"2024-09-13T18:39:56.304956+0000","last_unstale":"2024-09-13T18:39:56.305931+0000","last_undegraded":"2024-09-13T18:39:56.305931+0000","last_fullsized":"2024-09-13T18:39:56.305931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:27.735776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381399+0000","last_change":"2024-09-13T18:39:55.890867+0000","last_active":"2024-09-13T18:39:58.381399+0000","last_peered":"2024-09-13T18:39:58.381399+0000","last_clean":"2024-09-13T18:39:58.381399+0000","last_became_active":"2024-09-13T18:39:55.888701+0000","last_became_peered":"2024-09-13T18:39:55.888701+0000","last_unstale":"2024-09-13T18:39:58.381399+0000","last_undegraded":"2024-09-13T18:39:58.381399+0000","last_fullsized":"2024-09-13T18:39:58.381399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:54.344353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302827+0000","last_change":"2024-09-13T18:39:56.302743+0000","last_active":"2024-09-13T18:39:56.302827+0000","last_peered":"2024-09-13T18:39:56.302827+0000","last_clean":"2024-09-13T18:39:56.302827+0000","last_became_active":"2024-09-13T18:39:56.302515+0000","last_became_peered":"2024-09-13T18:39:56.302515+0000","last_unstale":"2024-09-13T18:39:56.302827+0000","last_undegraded":"2024-09-13T18:39:56.302827+0000","last_fullsized":"2024-09-13T18:39:56.302827+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:10.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:54.856680+0000","last_change":"2024-09-13T18:39:54.856680+0000","last_active":"2024-09-13T18:39:54.856680+0000","last_peered":"2024-09-13T18:39:54.856680+0000","last_clean":"2024-09-13T18:39:54.856680+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:54.856680+0000","last_undegraded":"2024-09-13T18:39:54.856680+0000","last_fullsized":"2024-09-13T18:39:54.856680+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314309+0000","last_change":"2024-09-13T18:39:55.887740+0000","last_active":"2024-09-13T18:39:56.314309+0000","last_peered":"2024-09-13T18:39:56.314309+0000","last_clean":"2024-09-13T18:39:56.314309+0000","last_became_active":"2024-09-13T18:39:55.887360+0000","last_became_peered":"2024-09-13T18:39:55.887360+0000","last_unstale":"2024-09-13T18:39:56.314309+0000","last_undegraded":"2024-09-13T18:39:56.314309+0000","last_fullsized":"2024-09-13T18:39:56.314309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:54.895816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301782+0000","last_change":"2024-09-13T18:39:56.317849+0000","last_active":"2024-09-13T18:39:57.301782+0000","last_peered":"2024-09-13T18:39:57.301782+0000","last_clean":"2024-09-13T18:39:57.301782+0000","last_became_active":"2024-09-13T18:39:56.317447+0000","last_became_peered":"2024-09-13T18:39:56.317447+0000","last_unstale":"2024-09-13T18:39:57.301782+0000","last_undegraded":"2024-09-13T18:39:57.301782+0000","last_fullsized":"2024-09-13T18:39:57.301782+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:52.713927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.293003+0000","last_change":"2024-09-13T18:39:55.890260+0000","last_active":"2024-09-13T18:39:56.293003+0000","last_peered":"2024-09-13T18:39:56.293003+0000","last_clean":"2024-09-13T18:39:56.293003+0000","last_became_active":"2024-09-13T18:39:55.889055+0000","last_became_peered":"2024-09-13T18:39:55.889055+0000","last_unstale":"2024-09-13T18:39:56.293003+0000","last_undegraded":"2024-09-13T18:39:56.293003+0000","last_fullsized":"2024-09-13T18:39:56.293003+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:37.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381305+0000","last_change":"2024-09-13T18:39:56.303130+0000","last_active":"2024-09-13T18:39:58.381305+0000","last_peered":"2024-09-13T18:39:58.381305+0000","last_clean":"2024-09-13T18:39:58.381305+0000","last_became_active":"2024-09-13T18:39:56.302896+0000","last_became_peered":"2024-09-13T18:39:56.302896+0000","last_unstale":"2024-09-13T18:39:58.381305+0000","last_undegraded":"2024-09-13T18:39:58.381305+0000","last_fullsized":"2024-09-13T18:39:58.381305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:10.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298285+0000","last_change":"2024-09-13T18:39:55.890276+0000","last_active":"2024-09-13T18:39:56.298285+0000","last_peered":"2024-09-13T18:39:56.298285+0000","last_clean":"2024-09-13T18:39:56.298285+0000","last_became_active":"2024-09-13T18:39:55.888547+0000","last_became_peered":"2024-09-13T18:39:55.888547+0000","last_unstale":"2024-09-13T18:39:56.298285+0000","last_undegraded":"2024-09-13T18:39:56.298285+0000","last_fullsized":"2024-09-13T18:39:56.298285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:43.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301913+0000","last_change":"2024-09-13T18:39:56.315848+0000","last_active":"2024-09-13T18:39:57.301913+0000","last_peered":"2024-09-13T18:39:57.301913+0000","last_clean":"2024-09-13T18:39:57.301913+0000","last_became_active":"2024-09-13T18:39:56.315071+0000","last_became_peered":"2024-09-13T18:39:56.315071+0000","last_unstale":"2024-09-13T18:39:57.301913+0000","last_undegraded":"2024-09-13T18:39:57.301913+0000","last_fullsized":"2024-09-13T18:39:57.301913+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:09.507620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298379+0000","last_change":"2024-09-13T18:39:55.886455+0000","last_active":"2024-09-13T18:39:56.298379+0000","last_peered":"2024-09-13T18:39:56.298379+0000","last_clean":"2024-09-13T18:39:56.298379+0000","last_became_active":"2024-09-13T18:39:55.886227+0000","last_became_peered":"2024-09-13T18:39:55.886227+0000","last_unstale":"2024-09-13T18:39:56.298379+0000","last_undegraded":"2024-09-13T18:39:56.298379+0000","last_fullsized":"2024-09-13T18:39:56.298379+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:59.904833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.297591+0000","last_change":"2024-09-13T18:39:55.887353+0000","last_active":"2024-09-13T18:39:56.297591+0000","last_peered":"2024-09-13T18:39:56.297591+0000","last_clean":"2024-09-13T18:39:56.297591+0000","last_became_active":"2024-09-13T18:39:55.887092+0000","last_became_peered":"2024-09-13T18:39:55.887092+0000","last_unstale":"2024-09-13T18:39:56.297591+0000","last_undegraded":"2024-09-13T18:39:56.297591+0000","last_fullsized":"2024-09-13T18:39:56.297591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.296233+0000","last_change":"2024-09-13T18:39:56.296084+0000","last_active":"2024-09-13T18:39:56.296233+0000","last_peered":"2024-09-13T18:39:56.296233+0000","last_clean":"2024-09-13T18:39:56.296233+0000","last_became_active":"2024-09-13T18:39:56.295857+0000","last_became_peered":"2024-09-13T18:39:56.295857+0000","last_unstale":"2024-09-13T18:39:56.296233+0000","last_undegraded":"2024-09-13T18:39:56.296233+0000","last_fullsized":"2024-09-13T18:39:56.296233+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.073982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:54.856680+0000","last_change":"2024-09-13T18:39:54.856680+0000","last_active":"2024-09-13T18:39:54.856680+0000","last_peered":"2024-09-13T18:39:54.856680+0000","last_clean":"2024-09-13T18:39:54.856680+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:54.856680+0000","last_undegraded":"2024-09-13T18:39:54.856680+0000","last_fullsized":"2024-09-13T18:39:54.856680+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.304786+0000","last_change":"2024-09-13T18:39:56.304717+0000","last_active":"2024-09-13T18:39:56.304786+0000","last_peered":"2024-09-13T18:39:56.304786+0000","last_clean":"2024-09-13T18:39:56.304786+0000","last_became_active":"2024-09-13T18:39:56.304492+0000","last_became_peered":"2024-09-13T18:39:56.304492+0000","last_unstale":"2024-09-13T18:39:56.304786+0000","last_undegraded":"2024-09-13T18:39:56.304786+0000","last_fullsized":"2024-09-13T18:39:56.304786+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381274+0000","last_change":"2024-09-13T18:39:55.882579+0000","last_active":"2024-09-13T18:39:58.381274+0000","last_peered":"2024-09-13T18:39:58.381274+0000","last_clean":"2024-09-13T18:39:58.381274+0000","last_became_active":"2024-09-13T18:39:55.882368+0000","last_became_peered":"2024-09-13T18:39:55.882368+0000","last_unstale":"2024-09-13T18:39:58.381274+0000","last_undegraded":"2024-09-13T18:39:58.381274+0000","last_fullsized":"2024-09-13T18:39:58.381274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:50.549028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381185+0000","last_change":"2024-09-13T18:39:56.314158+0000","last_active":"2024-09-13T18:39:58.381185+0000","last_peered":"2024-09-13T18:39:58.381185+0000","last_clean":"2024-09-13T18:39:58.381185+0000","last_became_active":"2024-09-13T18:39:56.313844+0000","last_became_peered":"2024-09-13T18:39:56.313844+0000","last_unstale":"2024-09-13T18:39:58.381185+0000","last_undegraded":"2024-09-13T18:39:58.381185+0000","last_fullsized":"2024-09-13T18:39:58.381185+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302326+0000","last_change":"2024-09-13T18:39:55.885862+0000","last_active":"2024-09-13T18:39:57.302326+0000","last_peered":"2024-09-13T18:39:57.302326+0000","last_clean":"2024-09-13T18:39:57.302326+0000","last_became_active":"2024-09-13T18:39:55.883304+0000","last_became_peered":"2024-09-13T18:39:55.883304+0000","last_unstale":"2024-09-13T18:39:57.302326+0000","last_undegraded":"2024-09-13T18:39:57.302326+0000","last_fullsized":"2024-09-13T18:39:57.302326+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:22.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:39:55.862817+0000","last_change":"2024-09-13T18:39:55.862817+0000","last_active":"2024-09-13T18:39:55.862817+0000","last_peered":"2024-09-13T18:39:55.862817+0000","last_clean":"2024-09-13T18:39:55.862817+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:39:55.862817+0000","last_undegraded":"2024-09-13T18:39:55.862817+0000","last_fullsized":"2024-09-13T18:39:55.862817+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302305+0000","last_change":"2024-09-13T18:39:55.883908+0000","last_active":"2024-09-13T18:39:57.302305+0000","last_peered":"2024-09-13T18:39:57.302305+0000","last_clean":"2024-09-13T18:39:57.302305+0000","last_became_active":"2024-09-13T18:39:55.881003+0000","last_became_peered":"2024-09-13T18:39:55.881003+0000","last_unstale":"2024-09-13T18:39:57.302305+0000","last_undegraded":"2024-09-13T18:39:57.302305+0000","last_fullsized":"2024-09-13T18:39:57.302305+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:07.698897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.301383+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:39:56.301383+0000","last_peered":"2024-09-13T18:39:56.301383+0000","last_clean":"2024-09-13T18:39:56.301383+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:39:56.301383+0000","last_undegraded":"2024-09-13T18:39:56.301383+0000","last_fullsized":"2024-09-13T18:39:56.301383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":108,"acting":108,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":37,"ondisk_log_size":37,"up":58,"acting":58,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542201,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1027,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194284,"statfs":{"total":200000000,"available":198947478,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66000000000000003,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":0.997,"15min":0.997},"last":0.78800000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.55200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91600000000000004,"5min":1.054,"15min":1.054},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.64500000000000002},"min":{"1min":0.51400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.84799999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66400000000000003,"15min":0.64700000000000002},"min":{"1min":0.56999999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.63}]},{"osd":3,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0149999999999999,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.876},"min":{"1min":0.56399999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.72699999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":1.036,"15min":1.036},"last":0.5},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75800000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85499999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86299999999999999,"5min":1.371,"15min":1.371},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.143,"15min":1.143},"last":0.751},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":1.125,"15min":1.125},"last":0.76900000000000002}]}]},{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":477,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67400000000000004,"15min":0.63500000000000001},"min":{"1min":0.60999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.876,"5min":1.665,"15min":1.665},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.51400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.67500000000000004,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84199999999999997,"5min":1.591,"15min":1.591},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.67400000000000004},"min":{"1min":0.60699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99099999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.72199999999999998,"15min":0.69799999999999995},"min":{"1min":0.64500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":2.169,"15min":2.169},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.65900000000000003},"min":{"1min":0.56200000000000006,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.87,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66500000000000004,"15min":0.63900000000000001},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90700000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.63300000000000001,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.95599999999999996,"5min":1.115,"15min":1.115},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.81699999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.84899999999999998},"min":{"1min":0.47199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.999,"15min":0.999},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.873},"min":{"1min":0.54900000000000004,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77300000000000002,"15min":0.85499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89800000000000002,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85299999999999998,"5min":1.032,"15min":1.032},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.91400000000000003},"min":{"1min":0.60699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90700000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.84099999999999997},"min":{"1min":0.48699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.81599999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.755}]},{"osd":5,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.125,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518293,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69399999999999995,"15min":0.66500000000000004},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94699999999999995,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.54500000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.47299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.68300000000000005},"min":{"1min":0.61299999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.86199999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":0.91300000000000003,"5min":3.706,"15min":3.706},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.67900000000000005},"min":{"1min":0.58899999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.88800000000000001,"5min":3.742,"15min":3.742},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.70699999999999996},"min":{"1min":0.59099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92100000000000004,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.629},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.66600000000000004},"min":{"1min":0.53600000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83399999999999996,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.81100000000000005,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85799999999999998,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.754},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66100000000000003,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80700000000000005,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92300000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52300000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.67500000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.64100000000000001,"15min":0.80500000000000005},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67800000000000005,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51900000000000002,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71099999999999997,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.624,"15min":0.745},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":7.798,"15min":7.798},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0800000000000001,"5min":3.093,"15min":3.093},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.73699999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.032,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1519999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.90700000000000003,"15min":1.0209999999999999},"min":{"1min":0.57899999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.84799999999999998,"15min":0.94899999999999995},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.997,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.73699999999999999,"15min":0.70099999999999996},"min":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.127,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194836,"statfs":{"total":200000000,"available":199512105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.309,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45600000000000002},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.65600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.48899999999999999},"min":{"1min":0.37,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65400000000000003,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.49199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79500000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60599999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96999999999999997,"5min":1.02,"15min":1.02},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.59899999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.746,"15min":0.71799999999999997},"min":{"1min":0.68100000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.55400000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.034,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1052,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.34000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.432}]},{"osd":2,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.40100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67300000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.499,"15min":0.501},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.65400000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.66100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.73299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0760000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.68700000000000006,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0640000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95299999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.443,"15min":0.46400000000000002},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":1.669,"15min":1.669},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.498,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66500000000000004,"5min":1.591,"15min":1.591},"last":0.505},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48199999999999998,"15min":0.47299999999999998},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.78100000000000003,"5min":1.03,"15min":1.03},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.435,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":1.637,"15min":1.637},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":1.698,"15min":1.698},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0760000000000001,"5min":1.204,"15min":1.204},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0509999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.61299999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98699999999999999,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0189999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93700000000000006,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70699999999999996,"15min":0.68000000000000005},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996}]}]}],"pool_statfs":[]}} 2024-09-13T18:40:00.464 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:40:00.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.651+0000 7feb35400640 1 Processor -- start 2024-09-13T18:40:00.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.651+0000 7feb35400640 1 -- start start 2024-09-13T18:40:00.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb35400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300b3f10 0x7feb3015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb35400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb300b2f00 con 0x7feb300b0490 2024-09-13T18:40:00.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb35400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb300b3150 con 0x7feb3015dee0 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb35400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb300b3430 con 0x7feb300b3f10 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb2f200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7feb300b0490 0x7feb3015a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46634/0 (socket says 172.21.15.192:46634) 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.652+0000 7feb2f200640 1 -- 172.21.15.192:0/3508377226 learned_addr learned my addr 172.21.15.192:0/3508377226 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2de00640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300b3f10 0x7feb3015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283007070 0 0) 0x7feb300b2f00 con 0x7feb300b0490 2024-09-13T18:40:00.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb14003520 con 0x7feb300b0490 2024-09-13T18:40:00.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992113740 0 0) 0x7feb14003520 con 0x7feb300b0490 2024-09-13T18:40:00.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300b3f10 msgr2=0x7feb3015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:00.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300b3f10 0x7feb3015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 >> v1:172.21.15.194:6789/0 conn(0x7feb3015dee0 legacy=0x7feb300afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb300b3710 con 0x7feb300b0490 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7feb280019f0 con 0x7feb300b0490 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 >> v1:172.21.15.192:6789/0 conn(0x7feb300b0490 legacy=0x7feb3015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb14003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb140047c0 0x7feb14004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb14005140 0x7feb1400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300b3430 con 0x7feb140039a0 2024-09-13T18:40:00.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1400bec0 con 0x7feb14005140 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.653+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb1400c000 con 0x7feb140047c0 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb14003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2f200640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb14005140 0x7feb1400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2de00640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb140047c0 0x7feb14004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 -- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb140047c0 msgr2=0x7feb14004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb140047c0 0x7feb14004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 -- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb14005140 msgr2=0x7feb1400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb14005140 0x7feb1400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.654+0000 7feb2e800640 1 -- 172.21.15.192:0/3508377226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb14003520 con 0x7feb140039a0 2024-09-13T18:40:00.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.655+0000 7feb2e800640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb14003d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7feb20001860 tx=0x7feb140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772eeb02f5d43a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.655+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb2002abe0 con 0x7feb140039a0 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.655+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb2002ad60 con 0x7feb140039a0 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.655+0000 7feb2d400640 1 -- 172.21.15.192:0/3508377226 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20032680 con 0x7feb140039a0 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 -- 172.21.15.192:0/3508377226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 msgr2=0x7feb14003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 --2- 172.21.15.192:0/3508377226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb14003d80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7feb20001860 tx=0x7feb140057f0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb2f200640 1 -- 172.21.15.192:0/3508377226 reap_dead start 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 -- 172.21.15.192:0/3508377226 shutdown_connections 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 -- 172.21.15.192:0/3508377226 >> 172.21.15.192:0/3508377226 conn(0x7feb300ae960 msgr2=0x7feb3006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:00.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 -- 172.21.15.192:0/3508377226 shutdown_connections 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.656+0000 7feb35400640 1 -- 172.21.15.192:0/3508377226 wait complete. 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.658+0000 7feb35400640 1 Processor -- start 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.658+0000 7feb35400640 1 -- start start 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300aed70 0x7feb300af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 0x7feb30142a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb300af730 con 0x7feb140039a0 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3013db60 con 0x7feb301425c0 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb35400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb30138a70 con 0x7feb300aed70 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52830/0 (socket says 172.21.15.192:52830) 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 -- 172.21.15.192:0/1931376089 learned_addr learned my addr 172.21.15.192:0/1931376089 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2de00640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300aed70 0x7feb300af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2f200640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 0x7feb30142a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 -- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300aed70 msgr2=0x7feb300af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300aed70 0x7feb300af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 -- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 msgr2=0x7feb30142a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 0x7feb30142a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2e800640 1 -- 172.21.15.192:0/1931376089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3013ddb0 con 0x7feb140039a0 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.659+0000 7feb2f200640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 0x7feb30142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb2e800640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7feb2002a5c0 tx=0x7feb20001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb200054e0 con 0x7feb140039a0 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb200067d0 con 0x7feb140039a0 2024-09-13T18:40:00.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb3013e090 con 0x7feb140039a0 2024-09-13T18:40:00.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20006b60 con 0x7feb140039a0 2024-09-13T18:40:00.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.660+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb3013e650 con 0x7feb140039a0 2024-09-13T18:40:00.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.661+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb300b3f10 con 0x7feb140039a0 2024-09-13T18:40:00.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.662+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb20039040 con 0x7feb140039a0 2024-09-13T18:40:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.663+0000 7feb26a00640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 0x7feb1006d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.663+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb200a9130 con 0x7feb140039a0 2024-09-13T18:40:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.663+0000 7feb2de00640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 0x7feb1006d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.664+0000 7feb2de00640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 0x7feb1006d0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb300ae230 tx=0x7feb1c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:00.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.667+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb20074440 con 0x7feb140039a0 2024-09-13T18:40:00.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.832+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7feb300af730 con 0x7feb1006abf0 2024-09-13T18:40:00.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.839+0000 7feb26a00640 1 -- 172.21.15.192:0/1931376089 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284824 (secure 0 0 0) 0x7feb300af730 con 0x7feb1006abf0 2024-09-13T18:40:00.846 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:00.847 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 msgr2=0x7feb1006d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 0x7feb1006d0b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7feb300ae230 tx=0x7feb1c009190 comp rx=0 tx=0).stop 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 msgr2=0x7feb30138530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7feb2002a5c0 tx=0x7feb20001230 comp rx=0 tx=0).stop 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 shutdown_connections 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb1006abf0 0x7feb1006d0b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb301425c0 0x7feb30142a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb300aed70 0x7feb300af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 --2- 172.21.15.192:0/1931376089 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb140039a0 0x7feb30138530 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:00.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 >> 172.21.15.192:0/1931376089 conn(0x7feb300ae960 msgr2=0x7feb3015a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:00.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 shutdown_connections 2024-09-13T18:40:00.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:00.843+0000 7feb35400640 1 -- 172.21.15.192:0/1931376089 wait complete. 2024-09-13T18:40:00.863 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2024-09-13T18:40:00.791545+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":111,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4940,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557559,"statfs":{"total":1600000000,"available":1594941236,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.926735"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.308517+0000","last_change":"2024-09-13T18:39:56.307679+0000","last_active":"2024-09-13T18:39:56.308517+0000","last_peered":"2024-09-13T18:39:56.308517+0000","last_clean":"2024-09-13T18:39:56.308517+0000","last_became_active":"2024-09-13T18:39:56.307472+0000","last_became_peered":"2024-09-13T18:39:56.307472+0000","last_unstale":"2024-09-13T18:39:56.308517+0000","last_undegraded":"2024-09-13T18:39:56.308517+0000","last_fullsized":"2024-09-13T18:39:56.308517+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:12.093274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381061+0000","last_change":"2024-09-13T18:39:56.309759+0000","last_active":"2024-09-13T18:39:58.381061+0000","last_peered":"2024-09-13T18:39:58.381061+0000","last_clean":"2024-09-13T18:39:58.381061+0000","last_became_active":"2024-09-13T18:39:56.309485+0000","last_became_peered":"2024-09-13T18:39:56.309485+0000","last_unstale":"2024-09-13T18:39:58.381061+0000","last_undegraded":"2024-09-13T18:39:58.381061+0000","last_fullsized":"2024-09-13T18:39:58.381061+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:21.308274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298872+0000","last_change":"2024-09-13T18:39:56.314704+0000","last_active":"2024-09-13T18:39:57.298872+0000","last_peered":"2024-09-13T18:39:57.298872+0000","last_clean":"2024-09-13T18:39:57.298872+0000","last_became_active":"2024-09-13T18:39:56.314172+0000","last_became_peered":"2024-09-13T18:39:56.314172+0000","last_unstale":"2024-09-13T18:39:57.298872+0000","last_undegraded":"2024-09-13T18:39:57.298872+0000","last_fullsized":"2024-09-13T18:39:57.298872+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:09.507620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298821+0000","last_change":"2024-09-13T18:39:56.309839+0000","last_active":"2024-09-13T18:39:57.298821+0000","last_peered":"2024-09-13T18:39:57.298821+0000","last_clean":"2024-09-13T18:39:57.298821+0000","last_became_active":"2024-09-13T18:39:56.309629+0000","last_became_peered":"2024-09-13T18:39:56.309629+0000","last_unstale":"2024-09-13T18:39:57.298821+0000","last_undegraded":"2024-09-13T18:39:57.298821+0000","last_fullsized":"2024-09-13T18:39:57.298821+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:05.317928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894458+0000","last_change":"2024-09-13T18:39:56.310439+0000","last_active":"2024-09-13T18:39:57.894458+0000","last_peered":"2024-09-13T18:39:57.894458+0000","last_clean":"2024-09-13T18:39:57.894458+0000","last_became_active":"2024-09-13T18:39:56.310021+0000","last_became_peered":"2024-09-13T18:39:56.310021+0000","last_unstale":"2024-09-13T18:39:57.894458+0000","last_undegraded":"2024-09-13T18:39:57.894458+0000","last_fullsized":"2024-09-13T18:39:57.894458+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:34.537782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301804+0000","last_change":"2024-09-13T18:39:56.309846+0000","last_active":"2024-09-13T18:39:57.301804+0000","last_peered":"2024-09-13T18:39:57.301804+0000","last_clean":"2024-09-13T18:39:57.301804+0000","last_became_active":"2024-09-13T18:39:56.309623+0000","last_became_peered":"2024-09-13T18:39:56.309623+0000","last_unstale":"2024-09-13T18:39:57.301804+0000","last_undegraded":"2024-09-13T18:39:57.301804+0000","last_fullsized":"2024-09-13T18:39:57.301804+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301604+0000","last_change":"2024-09-13T18:39:56.317679+0000","last_active":"2024-09-13T18:39:57.301604+0000","last_peered":"2024-09-13T18:39:57.301604+0000","last_clean":"2024-09-13T18:39:57.301604+0000","last_became_active":"2024-09-13T18:39:56.314423+0000","last_became_peered":"2024-09-13T18:39:56.314423+0000","last_unstale":"2024-09-13T18:39:57.301604+0000","last_undegraded":"2024-09-13T18:39:57.301604+0000","last_fullsized":"2024-09-13T18:39:57.301604+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:39.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302698+0000","last_change":"2024-09-13T18:39:56.300976+0000","last_active":"2024-09-13T18:39:56.302698+0000","last_peered":"2024-09-13T18:39:56.302698+0000","last_clean":"2024-09-13T18:39:56.302698+0000","last_became_active":"2024-09-13T18:39:56.298719+0000","last_became_peered":"2024-09-13T18:39:56.298719+0000","last_unstale":"2024-09-13T18:39:56.302698+0000","last_undegraded":"2024-09-13T18:39:56.302698+0000","last_fullsized":"2024-09-13T18:39:56.302698+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:33.233444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298956+0000","last_change":"2024-09-13T18:39:56.303949+0000","last_active":"2024-09-13T18:39:57.298956+0000","last_peered":"2024-09-13T18:39:57.298956+0000","last_clean":"2024-09-13T18:39:57.298956+0000","last_became_active":"2024-09-13T18:39:56.303743+0000","last_became_peered":"2024-09-13T18:39:56.303743+0000","last_unstale":"2024-09-13T18:39:57.298956+0000","last_undegraded":"2024-09-13T18:39:57.298956+0000","last_fullsized":"2024-09-13T18:39:57.298956+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:29.045607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302226+0000","last_change":"2024-09-13T18:39:56.319101+0000","last_active":"2024-09-13T18:39:57.302226+0000","last_peered":"2024-09-13T18:39:57.302226+0000","last_clean":"2024-09-13T18:39:57.302226+0000","last_became_active":"2024-09-13T18:39:56.316651+0000","last_became_peered":"2024-09-13T18:39:56.316651+0000","last_unstale":"2024-09-13T18:39:57.302226+0000","last_undegraded":"2024-09-13T18:39:57.302226+0000","last_fullsized":"2024-09-13T18:39:57.302226+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:45.101880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298423+0000","last_change":"2024-09-13T18:39:56.298366+0000","last_active":"2024-09-13T18:39:56.298423+0000","last_peered":"2024-09-13T18:39:56.298423+0000","last_clean":"2024-09-13T18:39:56.298423+0000","last_became_active":"2024-09-13T18:39:56.298228+0000","last_became_peered":"2024-09-13T18:39:56.298228+0000","last_unstale":"2024-09-13T18:39:56.298423+0000","last_undegraded":"2024-09-13T18:39:56.298423+0000","last_fullsized":"2024-09-13T18:39:56.298423+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:02:37.159369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.308176+0000","last_change":"2024-09-13T18:39:56.306591+0000","last_active":"2024-09-13T18:39:56.308176+0000","last_peered":"2024-09-13T18:39:56.308176+0000","last_clean":"2024-09-13T18:39:56.308176+0000","last_became_active":"2024-09-13T18:39:56.306330+0000","last_became_peered":"2024-09-13T18:39:56.306330+0000","last_unstale":"2024-09-13T18:39:56.308176+0000","last_undegraded":"2024-09-13T18:39:56.308176+0000","last_fullsized":"2024-09-13T18:39:56.308176+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:37.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298959+0000","last_change":"2024-09-13T18:39:56.314855+0000","last_active":"2024-09-13T18:39:57.298959+0000","last_peered":"2024-09-13T18:39:57.298959+0000","last_clean":"2024-09-13T18:39:57.298959+0000","last_became_active":"2024-09-13T18:39:56.314474+0000","last_became_peered":"2024-09-13T18:39:56.314474+0000","last_unstale":"2024-09-13T18:39:57.298959+0000","last_undegraded":"2024-09-13T18:39:57.298959+0000","last_fullsized":"2024-09-13T18:39:57.298959+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:51:55.631644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310570+0000","last_change":"2024-09-13T18:39:56.309841+0000","last_active":"2024-09-13T18:39:56.310570+0000","last_peered":"2024-09-13T18:39:56.310570+0000","last_clean":"2024-09-13T18:39:56.310570+0000","last_became_active":"2024-09-13T18:39:56.309408+0000","last_became_peered":"2024-09-13T18:39:56.309408+0000","last_unstale":"2024-09-13T18:39:56.310570+0000","last_undegraded":"2024-09-13T18:39:56.310570+0000","last_fullsized":"2024-09-13T18:39:56.310570+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:21.308274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310533+0000","last_change":"2024-09-13T18:39:56.308774+0000","last_active":"2024-09-13T18:39:56.310533+0000","last_peered":"2024-09-13T18:39:56.310533+0000","last_clean":"2024-09-13T18:39:56.310533+0000","last_became_active":"2024-09-13T18:39:56.308553+0000","last_became_peered":"2024-09-13T18:39:56.308553+0000","last_unstale":"2024-09-13T18:39:56.310533+0000","last_undegraded":"2024-09-13T18:39:56.310533+0000","last_fullsized":"2024-09-13T18:39:56.310533+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.296901+0000","last_change":"2024-09-13T18:39:56.296814+0000","last_active":"2024-09-13T18:39:56.296901+0000","last_peered":"2024-09-13T18:39:56.296901+0000","last_clean":"2024-09-13T18:39:56.296901+0000","last_became_active":"2024-09-13T18:39:56.296588+0000","last_became_peered":"2024-09-13T18:39:56.296588+0000","last_unstale":"2024-09-13T18:39:56.296901+0000","last_undegraded":"2024-09-13T18:39:56.296901+0000","last_fullsized":"2024-09-13T18:39:56.296901+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:18:52.390363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894245+0000","last_change":"2024-09-13T18:39:56.311627+0000","last_active":"2024-09-13T18:39:57.894245+0000","last_peered":"2024-09-13T18:39:57.894245+0000","last_clean":"2024-09-13T18:39:57.894245+0000","last_became_active":"2024-09-13T18:39:56.309968+0000","last_became_peered":"2024-09-13T18:39:56.309968+0000","last_unstale":"2024-09-13T18:39:57.894245+0000","last_undegraded":"2024-09-13T18:39:57.894245+0000","last_fullsized":"2024-09-13T18:39:57.894245+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:52.235087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894111+0000","last_change":"2024-09-13T18:39:56.314152+0000","last_active":"2024-09-13T18:39:57.894111+0000","last_peered":"2024-09-13T18:39:57.894111+0000","last_clean":"2024-09-13T18:39:57.894111+0000","last_became_active":"2024-09-13T18:39:56.313831+0000","last_became_peered":"2024-09-13T18:39:56.313831+0000","last_unstale":"2024-09-13T18:39:57.894111+0000","last_undegraded":"2024-09-13T18:39:57.894111+0000","last_fullsized":"2024-09-13T18:39:57.894111+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:15.674612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307478+0000","last_change":"2024-09-13T18:39:56.305633+0000","last_active":"2024-09-13T18:39:56.307478+0000","last_peered":"2024-09-13T18:39:56.307478+0000","last_clean":"2024-09-13T18:39:56.307478+0000","last_became_active":"2024-09-13T18:39:56.304346+0000","last_became_peered":"2024-09-13T18:39:56.304346+0000","last_unstale":"2024-09-13T18:39:56.307478+0000","last_undegraded":"2024-09-13T18:39:56.307478+0000","last_fullsized":"2024-09-13T18:39:56.307478+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:56:21.274790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894543+0000","last_change":"2024-09-13T18:39:56.308510+0000","last_active":"2024-09-13T18:39:57.894543+0000","last_peered":"2024-09-13T18:39:57.894543+0000","last_clean":"2024-09-13T18:39:57.894543+0000","last_became_active":"2024-09-13T18:39:56.308190+0000","last_became_peered":"2024-09-13T18:39:56.308190+0000","last_unstale":"2024-09-13T18:39:57.894543+0000","last_undegraded":"2024-09-13T18:39:57.894543+0000","last_fullsized":"2024-09-13T18:39:57.894543+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:16.040667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381117+0000","last_change":"2024-09-13T18:39:56.304170+0000","last_active":"2024-09-13T18:39:58.381117+0000","last_peered":"2024-09-13T18:39:58.381117+0000","last_clean":"2024-09-13T18:39:58.381117+0000","last_became_active":"2024-09-13T18:39:56.303937+0000","last_became_peered":"2024-09-13T18:39:56.303937+0000","last_unstale":"2024-09-13T18:39:58.381117+0000","last_undegraded":"2024-09-13T18:39:58.381117+0000","last_fullsized":"2024-09-13T18:39:58.381117+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:37.190867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301593+0000","last_change":"2024-09-13T18:39:56.309992+0000","last_active":"2024-09-13T18:39:57.301593+0000","last_peered":"2024-09-13T18:39:57.301593+0000","last_clean":"2024-09-13T18:39:57.301593+0000","last_became_active":"2024-09-13T18:39:56.309550+0000","last_became_peered":"2024-09-13T18:39:56.309550+0000","last_unstale":"2024-09-13T18:39:57.301593+0000","last_undegraded":"2024-09-13T18:39:57.301593+0000","last_fullsized":"2024-09-13T18:39:57.301593+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:54.385668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302039+0000","last_change":"2024-09-13T18:39:56.312834+0000","last_active":"2024-09-13T18:39:57.302039+0000","last_peered":"2024-09-13T18:39:57.302039+0000","last_clean":"2024-09-13T18:39:57.302039+0000","last_became_active":"2024-09-13T18:39:56.312459+0000","last_became_peered":"2024-09-13T18:39:56.312459+0000","last_unstale":"2024-09-13T18:39:57.302039+0000","last_undegraded":"2024-09-13T18:39:57.302039+0000","last_fullsized":"2024-09-13T18:39:57.302039+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:51.555165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307523+0000","last_change":"2024-09-13T18:39:56.305775+0000","last_active":"2024-09-13T18:39:56.307523+0000","last_peered":"2024-09-13T18:39:56.307523+0000","last_clean":"2024-09-13T18:39:56.307523+0000","last_became_active":"2024-09-13T18:39:56.304643+0000","last_became_peered":"2024-09-13T18:39:56.304643+0000","last_unstale":"2024-09-13T18:39:56.307523+0000","last_undegraded":"2024-09-13T18:39:56.307523+0000","last_fullsized":"2024-09-13T18:39:56.307523+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:16:40.787099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302181+0000","last_change":"2024-09-13T18:39:56.317556+0000","last_active":"2024-09-13T18:39:57.302181+0000","last_peered":"2024-09-13T18:39:57.302181+0000","last_clean":"2024-09-13T18:39:57.302181+0000","last_became_active":"2024-09-13T18:39:56.312599+0000","last_became_peered":"2024-09-13T18:39:56.312599+0000","last_unstale":"2024-09-13T18:39:57.302181+0000","last_undegraded":"2024-09-13T18:39:57.302181+0000","last_fullsized":"2024-09-13T18:39:57.302181+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:55.350490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.315719+0000","last_change":"2024-09-13T18:39:56.314691+0000","last_active":"2024-09-13T18:39:56.315719+0000","last_peered":"2024-09-13T18:39:56.315719+0000","last_clean":"2024-09-13T18:39:56.315719+0000","last_became_active":"2024-09-13T18:39:56.314490+0000","last_became_peered":"2024-09-13T18:39:56.314490+0000","last_unstale":"2024-09-13T18:39:56.315719+0000","last_undegraded":"2024-09-13T18:39:56.315719+0000","last_fullsized":"2024-09-13T18:39:56.315719+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:14.690216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894452+0000","last_change":"2024-09-13T18:39:56.312143+0000","last_active":"2024-09-13T18:39:57.894452+0000","last_peered":"2024-09-13T18:39:57.894452+0000","last_clean":"2024-09-13T18:39:57.894452+0000","last_became_active":"2024-09-13T18:39:56.311372+0000","last_became_peered":"2024-09-13T18:39:56.311372+0000","last_unstale":"2024-09-13T18:39:57.894452+0000","last_undegraded":"2024-09-13T18:39:57.894452+0000","last_fullsized":"2024-09-13T18:39:57.894452+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:52:52.557099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381061+0000","last_change":"2024-09-13T18:39:56.303489+0000","last_active":"2024-09-13T18:39:58.381061+0000","last_peered":"2024-09-13T18:39:58.381061+0000","last_clean":"2024-09-13T18:39:58.381061+0000","last_became_active":"2024-09-13T18:39:56.303292+0000","last_became_peered":"2024-09-13T18:39:56.303292+0000","last_unstale":"2024-09-13T18:39:58.381061+0000","last_undegraded":"2024-09-13T18:39:58.381061+0000","last_fullsized":"2024-09-13T18:39:58.381061+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:40:54.616842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299069+0000","last_change":"2024-09-13T18:39:56.311020+0000","last_active":"2024-09-13T18:39:57.299069+0000","last_peered":"2024-09-13T18:39:57.299069+0000","last_clean":"2024-09-13T18:39:57.299069+0000","last_became_active":"2024-09-13T18:39:56.310811+0000","last_became_peered":"2024-09-13T18:39:56.310811+0000","last_unstale":"2024-09-13T18:39:57.299069+0000","last_undegraded":"2024-09-13T18:39:57.299069+0000","last_fullsized":"2024-09-13T18:39:57.299069+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:23.341589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.307505+0000","last_change":"2024-09-13T18:39:56.305765+0000","last_active":"2024-09-13T18:39:56.307505+0000","last_peered":"2024-09-13T18:39:56.307505+0000","last_clean":"2024-09-13T18:39:56.307505+0000","last_became_active":"2024-09-13T18:39:56.305173+0000","last_became_peered":"2024-09-13T18:39:56.305173+0000","last_unstale":"2024-09-13T18:39:56.307505+0000","last_undegraded":"2024-09-13T18:39:56.307505+0000","last_fullsized":"2024-09-13T18:39:56.307505+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:33.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381201+0000","last_change":"2024-09-13T18:39:56.303253+0000","last_active":"2024-09-13T18:39:58.381201+0000","last_peered":"2024-09-13T18:39:58.381201+0000","last_clean":"2024-09-13T18:39:58.381201+0000","last_became_active":"2024-09-13T18:39:56.303026+0000","last_became_peered":"2024-09-13T18:39:56.303026+0000","last_unstale":"2024-09-13T18:39:58.381201+0000","last_undegraded":"2024-09-13T18:39:58.381201+0000","last_fullsized":"2024-09-13T18:39:58.381201+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:37.700066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381202+0000","last_change":"2024-09-13T18:39:56.307083+0000","last_active":"2024-09-13T18:39:58.381202+0000","last_peered":"2024-09-13T18:39:58.381202+0000","last_clean":"2024-09-13T18:39:58.381202+0000","last_became_active":"2024-09-13T18:39:56.306279+0000","last_became_peered":"2024-09-13T18:39:56.306279+0000","last_unstale":"2024-09-13T18:39:58.381202+0000","last_undegraded":"2024-09-13T18:39:58.381202+0000","last_fullsized":"2024-09-13T18:39:58.381202+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:18.414400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.295473+0000","last_change":"2024-09-13T18:39:56.295397+0000","last_active":"2024-09-13T18:39:56.295473+0000","last_peered":"2024-09-13T18:39:56.295473+0000","last_clean":"2024-09-13T18:39:56.295473+0000","last_became_active":"2024-09-13T18:39:56.295167+0000","last_became_peered":"2024-09-13T18:39:56.295167+0000","last_unstale":"2024-09-13T18:39:56.295473+0000","last_undegraded":"2024-09-13T18:39:56.295473+0000","last_fullsized":"2024-09-13T18:39:56.295473+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:54.512386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1f","version":"90'4","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301681+0000","last_change":"2024-09-13T18:39:55.886792+0000","last_active":"2024-09-13T18:39:57.301681+0000","last_peered":"2024-09-13T18:39:57.301681+0000","last_clean":"2024-09-13T18:39:57.301681+0000","last_became_active":"2024-09-13T18:39:55.884389+0000","last_became_peered":"2024-09-13T18:39:55.884389+0000","last_unstale":"2024-09-13T18:39:57.301681+0000","last_undegraded":"2024-09-13T18:39:57.301681+0000","last_fullsized":"2024-09-13T18:39:57.301681+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:53.755588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299023+0000","last_change":"2024-09-13T18:39:56.306270+0000","last_active":"2024-09-13T18:39:57.299023+0000","last_peered":"2024-09-13T18:39:57.299023+0000","last_clean":"2024-09-13T18:39:57.299023+0000","last_became_active":"2024-09-13T18:39:56.306061+0000","last_became_peered":"2024-09-13T18:39:56.306061+0000","last_unstale":"2024-09-13T18:39:57.299023+0000","last_undegraded":"2024-09-13T18:39:57.299023+0000","last_fullsized":"2024-09-13T18:39:57.299023+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:25:39.177195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1e","version":"90'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894111+0000","last_change":"2024-09-13T18:39:55.882270+0000","last_active":"2024-09-13T18:39:57.894111+0000","last_peered":"2024-09-13T18:39:57.894111+0000","last_clean":"2024-09-13T18:39:57.894111+0000","last_became_active":"2024-09-13T18:39:55.882029+0000","last_became_peered":"2024-09-13T18:39:55.882029+0000","last_unstale":"2024-09-13T18:39:57.894111+0000","last_undegraded":"2024-09-13T18:39:57.894111+0000","last_fullsized":"2024-09-13T18:39:57.894111+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:13:36.184730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301884+0000","last_change":"2024-09-13T18:39:56.308323+0000","last_active":"2024-09-13T18:39:57.301884+0000","last_peered":"2024-09-13T18:39:57.301884+0000","last_clean":"2024-09-13T18:39:57.301884+0000","last_became_active":"2024-09-13T18:39:56.307029+0000","last_became_peered":"2024-09-13T18:39:56.307029+0000","last_unstale":"2024-09-13T18:39:57.301884+0000","last_undegraded":"2024-09-13T18:39:57.301884+0000","last_fullsized":"2024-09-13T18:39:57.301884+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1d","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314270+0000","last_change":"2024-09-13T18:39:55.886436+0000","last_active":"2024-09-13T18:39:56.314270+0000","last_peered":"2024-09-13T18:39:56.314270+0000","last_clean":"2024-09-13T18:39:56.314270+0000","last_became_active":"2024-09-13T18:39:55.886166+0000","last_became_peered":"2024-09-13T18:39:55.886166+0000","last_unstale":"2024-09-13T18:39:56.314270+0000","last_undegraded":"2024-09-13T18:39:56.314270+0000","last_fullsized":"2024-09-13T18:39:56.314270+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:12.288599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302267+0000","last_change":"2024-09-13T18:39:56.316884+0000","last_active":"2024-09-13T18:39:57.302267+0000","last_peered":"2024-09-13T18:39:57.302267+0000","last_clean":"2024-09-13T18:39:57.302267+0000","last_became_active":"2024-09-13T18:39:56.312181+0000","last_became_peered":"2024-09-13T18:39:56.312181+0000","last_unstale":"2024-09-13T18:39:57.302267+0000","last_undegraded":"2024-09-13T18:39:57.302267+0000","last_fullsized":"2024-09-13T18:39:57.302267+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:24.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1c","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302087+0000","last_change":"2024-09-13T18:39:55.889553+0000","last_active":"2024-09-13T18:39:57.302087+0000","last_peered":"2024-09-13T18:39:57.302087+0000","last_clean":"2024-09-13T18:39:57.302087+0000","last_became_active":"2024-09-13T18:39:55.888778+0000","last_became_peered":"2024-09-13T18:39:55.888778+0000","last_unstale":"2024-09-13T18:39:57.302087+0000","last_undegraded":"2024-09-13T18:39:57.302087+0000","last_fullsized":"2024-09-13T18:39:57.302087+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.062616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302713+0000","last_change":"2024-09-13T18:39:56.301147+0000","last_active":"2024-09-13T18:39:56.302713+0000","last_peered":"2024-09-13T18:39:56.302713+0000","last_clean":"2024-09-13T18:39:56.302713+0000","last_became_active":"2024-09-13T18:39:56.300691+0000","last_became_peered":"2024-09-13T18:39:56.300691+0000","last_unstale":"2024-09-13T18:39:56.302713+0000","last_undegraded":"2024-09-13T18:39:56.302713+0000","last_fullsized":"2024-09-13T18:39:56.302713+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:35.422364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1b","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.311150+0000","last_change":"2024-09-13T18:39:55.889299+0000","last_active":"2024-09-13T18:39:56.311150+0000","last_peered":"2024-09-13T18:39:56.311150+0000","last_clean":"2024-09-13T18:39:56.311150+0000","last_became_active":"2024-09-13T18:39:55.889091+0000","last_became_peered":"2024-09-13T18:39:55.889091+0000","last_unstale":"2024-09-13T18:39:56.311150+0000","last_undegraded":"2024-09-13T18:39:56.311150+0000","last_fullsized":"2024-09-13T18:39:56.311150+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301692+0000","last_change":"2024-09-13T18:39:56.310199+0000","last_active":"2024-09-13T18:39:57.301692+0000","last_peered":"2024-09-13T18:39:57.301692+0000","last_clean":"2024-09-13T18:39:57.301692+0000","last_became_active":"2024-09-13T18:39:56.309804+0000","last_became_peered":"2024-09-13T18:39:56.309804+0000","last_unstale":"2024-09-13T18:39:57.301692+0000","last_undegraded":"2024-09-13T18:39:57.301692+0000","last_fullsized":"2024-09-13T18:39:57.301692+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:27.735776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1a","version":"90'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302136+0000","last_change":"2024-09-13T18:39:55.881229+0000","last_active":"2024-09-13T18:39:57.302136+0000","last_peered":"2024-09-13T18:39:57.302136+0000","last_clean":"2024-09-13T18:39:57.302136+0000","last_became_active":"2024-09-13T18:39:55.880481+0000","last_became_peered":"2024-09-13T18:39:55.880481+0000","last_unstale":"2024-09-13T18:39:57.302136+0000","last_undegraded":"2024-09-13T18:39:57.302136+0000","last_fullsized":"2024-09-13T18:39:57.302136+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:33:35.427580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314504+0000","last_change":"2024-09-13T18:39:56.314409+0000","last_active":"2024-09-13T18:39:56.314504+0000","last_peered":"2024-09-13T18:39:56.314504+0000","last_clean":"2024-09-13T18:39:56.314504+0000","last_became_active":"2024-09-13T18:39:56.314131+0000","last_became_peered":"2024-09-13T18:39:56.314131+0000","last_unstale":"2024-09-13T18:39:56.314504+0000","last_undegraded":"2024-09-13T18:39:56.314504+0000","last_fullsized":"2024-09-13T18:39:56.314504+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:37:21.178324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.300673+0000","last_change":"2024-09-13T18:39:55.890656+0000","last_active":"2024-09-13T18:39:56.300673+0000","last_peered":"2024-09-13T18:39:56.300673+0000","last_clean":"2024-09-13T18:39:56.300673+0000","last_became_active":"2024-09-13T18:39:55.890298+0000","last_became_peered":"2024-09-13T18:39:55.890298+0000","last_unstale":"2024-09-13T18:39:56.300673+0000","last_undegraded":"2024-09-13T18:39:56.300673+0000","last_fullsized":"2024-09-13T18:39:56.300673+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.310555+0000","last_change":"2024-09-13T18:39:56.309635+0000","last_active":"2024-09-13T18:39:56.310555+0000","last_peered":"2024-09-13T18:39:56.310555+0000","last_clean":"2024-09-13T18:39:56.310555+0000","last_became_active":"2024-09-13T18:39:56.307721+0000","last_became_peered":"2024-09-13T18:39:56.307721+0000","last_unstale":"2024-09-13T18:39:56.310555+0000","last_undegraded":"2024-09-13T18:39:56.310555+0000","last_fullsized":"2024-09-13T18:39:56.310555+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298276+0000","last_change":"2024-09-13T18:39:55.882264+0000","last_active":"2024-09-13T18:39:56.298276+0000","last_peered":"2024-09-13T18:39:56.298276+0000","last_clean":"2024-09-13T18:39:56.298276+0000","last_became_active":"2024-09-13T18:39:55.882014+0000","last_became_peered":"2024-09-13T18:39:55.882014+0000","last_unstale":"2024-09-13T18:39:56.298276+0000","last_undegraded":"2024-09-13T18:39:56.298276+0000","last_fullsized":"2024-09-13T18:39:56.298276+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:35.084021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301694+0000","last_change":"2024-09-13T18:39:56.317165+0000","last_active":"2024-09-13T18:39:57.301694+0000","last_peered":"2024-09-13T18:39:57.301694+0000","last_clean":"2024-09-13T18:39:57.301694+0000","last_became_active":"2024-09-13T18:39:56.312867+0000","last_became_peered":"2024-09-13T18:39:56.312867+0000","last_unstale":"2024-09-13T18:39:57.301694+0000","last_undegraded":"2024-09-13T18:39:57.301694+0000","last_fullsized":"2024-09-13T18:39:57.301694+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:26.513906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.295571+0000","last_change":"2024-09-13T18:39:55.892822+0000","last_active":"2024-09-13T18:39:56.295571+0000","last_peered":"2024-09-13T18:39:56.295571+0000","last_clean":"2024-09-13T18:39:56.295571+0000","last_became_active":"2024-09-13T18:39:55.892585+0000","last_became_peered":"2024-09-13T18:39:55.892585+0000","last_unstale":"2024-09-13T18:39:56.295571+0000","last_undegraded":"2024-09-13T18:39:56.295571+0000","last_fullsized":"2024-09-13T18:39:56.295571+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:14.668474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381298+0000","last_change":"2024-09-13T18:39:56.315036+0000","last_active":"2024-09-13T18:39:58.381298+0000","last_peered":"2024-09-13T18:39:58.381298+0000","last_clean":"2024-09-13T18:39:58.381298+0000","last_became_active":"2024-09-13T18:39:56.314790+0000","last_became_peered":"2024-09-13T18:39:56.314790+0000","last_unstale":"2024-09-13T18:39:58.381298+0000","last_undegraded":"2024-09-13T18:39:58.381298+0000","last_fullsized":"2024-09-13T18:39:58.381298+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:48.125504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381277+0000","last_change":"2024-09-13T18:39:55.888394+0000","last_active":"2024-09-13T18:39:58.381277+0000","last_peered":"2024-09-13T18:39:58.381277+0000","last_clean":"2024-09-13T18:39:58.381277+0000","last_became_active":"2024-09-13T18:39:55.888146+0000","last_became_peered":"2024-09-13T18:39:55.888146+0000","last_unstale":"2024-09-13T18:39:58.381277+0000","last_undegraded":"2024-09-13T18:39:58.381277+0000","last_fullsized":"2024-09-13T18:39:58.381277+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:51.707790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.309682+0000","last_change":"2024-09-13T18:39:56.309621+0000","last_active":"2024-09-13T18:39:56.309682+0000","last_peered":"2024-09-13T18:39:56.309682+0000","last_clean":"2024-09-13T18:39:56.309682+0000","last_became_active":"2024-09-13T18:39:56.309371+0000","last_became_peered":"2024-09-13T18:39:56.309371+0000","last_unstale":"2024-09-13T18:39:56.309682+0000","last_undegraded":"2024-09-13T18:39:56.309682+0000","last_fullsized":"2024-09-13T18:39:56.309682+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:03.788667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.15","version":"90'3","reported_seq":13,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.312660+0000","last_change":"2024-09-13T18:39:55.884581+0000","last_active":"2024-09-13T18:39:56.312660+0000","last_peered":"2024-09-13T18:39:56.312660+0000","last_clean":"2024-09-13T18:39:56.312660+0000","last_became_active":"2024-09-13T18:39:55.884341+0000","last_became_peered":"2024-09-13T18:39:55.884341+0000","last_unstale":"2024-09-13T18:39:56.312660+0000","last_undegraded":"2024-09-13T18:39:56.312660+0000","last_fullsized":"2024-09-13T18:39:56.312660+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:17:36.837383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894233+0000","last_change":"2024-09-13T18:39:56.310925+0000","last_active":"2024-09-13T18:39:57.894233+0000","last_peered":"2024-09-13T18:39:57.894233+0000","last_clean":"2024-09-13T18:39:57.894233+0000","last_became_active":"2024-09-13T18:39:56.310063+0000","last_became_peered":"2024-09-13T18:39:56.310063+0000","last_unstale":"2024-09-13T18:39:57.894233+0000","last_undegraded":"2024-09-13T18:39:57.894233+0000","last_fullsized":"2024-09-13T18:39:57.894233+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:08.246603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.14","version":"90'6","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.319132+0000","last_change":"2024-09-13T18:39:55.891483+0000","last_active":"2024-09-13T18:39:56.319132+0000","last_peered":"2024-09-13T18:39:56.319132+0000","last_clean":"2024-09-13T18:39:56.319132+0000","last_became_active":"2024-09-13T18:39:55.891299+0000","last_became_peered":"2024-09-13T18:39:55.891299+0000","last_unstale":"2024-09-13T18:39:56.319132+0000","last_undegraded":"2024-09-13T18:39:56.319132+0000","last_fullsized":"2024-09-13T18:39:56.319132+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:47.062616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301962+0000","last_change":"2024-09-13T18:39:56.303889+0000","last_active":"2024-09-13T18:39:57.301962+0000","last_peered":"2024-09-13T18:39:57.301962+0000","last_clean":"2024-09-13T18:39:57.301962+0000","last_became_active":"2024-09-13T18:39:56.303697+0000","last_became_peered":"2024-09-13T18:39:56.303697+0000","last_unstale":"2024-09-13T18:39:57.301962+0000","last_undegraded":"2024-09-13T18:39:57.301962+0000","last_fullsized":"2024-09-13T18:39:57.301962+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.13","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.317738+0000","last_change":"2024-09-13T18:39:55.893349+0000","last_active":"2024-09-13T18:39:56.317738+0000","last_peered":"2024-09-13T18:39:56.317738+0000","last_clean":"2024-09-13T18:39:56.317738+0000","last_became_active":"2024-09-13T18:39:55.893131+0000","last_became_peered":"2024-09-13T18:39:55.893131+0000","last_unstale":"2024-09-13T18:39:56.317738+0000","last_undegraded":"2024-09-13T18:39:56.317738+0000","last_fullsized":"2024-09-13T18:39:56.317738+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302311+0000","last_change":"2024-09-13T18:39:56.319232+0000","last_active":"2024-09-13T18:39:57.302311+0000","last_peered":"2024-09-13T18:39:57.302311+0000","last_clean":"2024-09-13T18:39:57.302311+0000","last_became_active":"2024-09-13T18:39:56.318713+0000","last_became_peered":"2024-09-13T18:39:56.318713+0000","last_unstale":"2024-09-13T18:39:57.302311+0000","last_undegraded":"2024-09-13T18:39:57.302311+0000","last_fullsized":"2024-09-13T18:39:57.302311+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:51.060467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301966+0000","last_change":"2024-09-13T18:39:55.881792+0000","last_active":"2024-09-13T18:39:57.301966+0000","last_peered":"2024-09-13T18:39:57.301966+0000","last_clean":"2024-09-13T18:39:57.301966+0000","last_became_active":"2024-09-13T18:39:55.881573+0000","last_became_peered":"2024-09-13T18:39:55.881573+0000","last_unstale":"2024-09-13T18:39:57.301966+0000","last_undegraded":"2024-09-13T18:39:57.301966+0000","last_fullsized":"2024-09-13T18:39:57.301966+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:46.387779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894343+0000","last_change":"2024-09-13T18:39:56.310316+0000","last_active":"2024-09-13T18:39:57.894343+0000","last_peered":"2024-09-13T18:39:57.894343+0000","last_clean":"2024-09-13T18:39:57.894343+0000","last_became_active":"2024-09-13T18:39:56.309705+0000","last_became_peered":"2024-09-13T18:39:56.309705+0000","last_unstale":"2024-09-13T18:39:57.894343+0000","last_undegraded":"2024-09-13T18:39:57.894343+0000","last_fullsized":"2024-09-13T18:39:57.894343+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:32:13.294736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301939+0000","last_change":"2024-09-13T18:39:55.881051+0000","last_active":"2024-09-13T18:39:57.301939+0000","last_peered":"2024-09-13T18:39:57.301939+0000","last_clean":"2024-09-13T18:39:57.301939+0000","last_became_active":"2024-09-13T18:39:55.880817+0000","last_became_peered":"2024-09-13T18:39:55.880817+0000","last_unstale":"2024-09-13T18:39:57.301939+0000","last_undegraded":"2024-09-13T18:39:57.301939+0000","last_fullsized":"2024-09-13T18:39:57.301939+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:36.515370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298932+0000","last_change":"2024-09-13T18:39:56.308510+0000","last_active":"2024-09-13T18:39:57.298932+0000","last_peered":"2024-09-13T18:39:57.298932+0000","last_clean":"2024-09-13T18:39:57.298932+0000","last_became_active":"2024-09-13T18:39:56.306982+0000","last_became_peered":"2024-09-13T18:39:56.306982+0000","last_unstale":"2024-09-13T18:39:57.298932+0000","last_undegraded":"2024-09-13T18:39:57.298932+0000","last_fullsized":"2024-09-13T18:39:57.298932+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:09:28.678249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.10","version":"90'8","reported_seq":19,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302226+0000","last_change":"2024-09-13T18:39:55.881369+0000","last_active":"2024-09-13T18:39:57.302226+0000","last_peered":"2024-09-13T18:39:57.302226+0000","last_clean":"2024-09-13T18:39:57.302226+0000","last_became_active":"2024-09-13T18:39:55.880727+0000","last_became_peered":"2024-09-13T18:39:55.880727+0000","last_unstale":"2024-09-13T18:39:57.302226+0000","last_undegraded":"2024-09-13T18:39:57.302226+0000","last_fullsized":"2024-09-13T18:39:57.302226+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:43:15.124054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381224+0000","last_change":"2024-09-13T18:39:56.308903+0000","last_active":"2024-09-13T18:39:58.381224+0000","last_peered":"2024-09-13T18:39:58.381224+0000","last_clean":"2024-09-13T18:39:58.381224+0000","last_became_active":"2024-09-13T18:39:56.308620+0000","last_became_peered":"2024-09-13T18:39:56.308620+0000","last_unstale":"2024-09-13T18:39:58.381224+0000","last_undegraded":"2024-09-13T18:39:58.381224+0000","last_fullsized":"2024-09-13T18:39:58.381224+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:25:05.178818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.f","version":"90'1","reported_seq":11,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.315086+0000","last_change":"2024-09-13T18:39:55.891359+0000","last_active":"2024-09-13T18:39:56.315086+0000","last_peered":"2024-09-13T18:39:56.315086+0000","last_clean":"2024-09-13T18:39:56.315086+0000","last_became_active":"2024-09-13T18:39:55.890223+0000","last_became_peered":"2024-09-13T18:39:55.890223+0000","last_unstale":"2024-09-13T18:39:56.315086+0000","last_undegraded":"2024-09-13T18:39:56.315086+0000","last_fullsized":"2024-09-13T18:39:56.315086+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:33.531645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381148+0000","last_change":"2024-09-13T18:39:56.299548+0000","last_active":"2024-09-13T18:39:58.381148+0000","last_peered":"2024-09-13T18:39:58.381148+0000","last_clean":"2024-09-13T18:39:58.381148+0000","last_became_active":"2024-09-13T18:39:56.299350+0000","last_became_peered":"2024-09-13T18:39:56.299350+0000","last_unstale":"2024-09-13T18:39:58.381148+0000","last_undegraded":"2024-09-13T18:39:58.381148+0000","last_fullsized":"2024-09-13T18:39:58.381148+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:56.184829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.e","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381353+0000","last_change":"2024-09-13T18:39:55.891310+0000","last_active":"2024-09-13T18:39:58.381353+0000","last_peered":"2024-09-13T18:39:58.381353+0000","last_clean":"2024-09-13T18:39:58.381353+0000","last_became_active":"2024-09-13T18:39:55.890521+0000","last_became_peered":"2024-09-13T18:39:55.890521+0000","last_unstale":"2024-09-13T18:39:58.381353+0000","last_undegraded":"2024-09-13T18:39:58.381353+0000","last_fullsized":"2024-09-13T18:39:58.381353+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:50.054330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.299065+0000","last_change":"2024-09-13T18:39:56.307205+0000","last_active":"2024-09-13T18:39:57.299065+0000","last_peered":"2024-09-13T18:39:57.299065+0000","last_clean":"2024-09-13T18:39:57.299065+0000","last_became_active":"2024-09-13T18:39:56.306486+0000","last_became_peered":"2024-09-13T18:39:56.306486+0000","last_unstale":"2024-09-13T18:39:57.299065+0000","last_undegraded":"2024-09-13T18:39:57.299065+0000","last_fullsized":"2024-09-13T18:39:57.299065+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:23:54.528052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.d","version":"90'1","reported_seq":12,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381381+0000","last_change":"2024-09-13T18:39:55.892482+0000","last_active":"2024-09-13T18:39:58.381381+0000","last_peered":"2024-09-13T18:39:58.381381+0000","last_clean":"2024-09-13T18:39:58.381381+0000","last_became_active":"2024-09-13T18:39:55.892269+0000","last_became_peered":"2024-09-13T18:39:55.892269+0000","last_unstale":"2024-09-13T18:39:58.381381+0000","last_undegraded":"2024-09-13T18:39:58.381381+0000","last_fullsized":"2024-09-13T18:39:58.381381+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:25.507769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.298855+0000","last_change":"2024-09-13T18:39:56.311176+0000","last_active":"2024-09-13T18:39:57.298855+0000","last_peered":"2024-09-13T18:39:57.298855+0000","last_clean":"2024-09-13T18:39:57.298855+0000","last_became_active":"2024-09-13T18:39:56.310319+0000","last_became_peered":"2024-09-13T18:39:56.310319+0000","last_unstale":"2024-09-13T18:39:57.298855+0000","last_undegraded":"2024-09-13T18:39:57.298855+0000","last_fullsized":"2024-09-13T18:39:57.298855+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:07:24.437711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301766+0000","last_change":"2024-09-13T18:39:55.887673+0000","last_active":"2024-09-13T18:39:57.301766+0000","last_peered":"2024-09-13T18:39:57.301766+0000","last_clean":"2024-09-13T18:39:57.301766+0000","last_became_active":"2024-09-13T18:39:55.887463+0000","last_became_peered":"2024-09-13T18:39:55.887463+0000","last_unstale":"2024-09-13T18:39:57.301766+0000","last_undegraded":"2024-09-13T18:39:57.301766+0000","last_fullsized":"2024-09-13T18:39:57.301766+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.306427+0000","last_change":"2024-09-13T18:39:56.306367+0000","last_active":"2024-09-13T18:39:56.306427+0000","last_peered":"2024-09-13T18:39:56.306427+0000","last_clean":"2024-09-13T18:39:56.306427+0000","last_became_active":"2024-09-13T18:39:56.304010+0000","last_became_peered":"2024-09-13T18:39:56.304010+0000","last_unstale":"2024-09-13T18:39:56.306427+0000","last_undegraded":"2024-09-13T18:39:56.306427+0000","last_fullsized":"2024-09-13T18:39:56.306427+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:36.090158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301597+0000","last_change":"2024-09-13T18:39:55.883546+0000","last_active":"2024-09-13T18:39:57.301597+0000","last_peered":"2024-09-13T18:39:57.301597+0000","last_clean":"2024-09-13T18:39:57.301597+0000","last_became_active":"2024-09-13T18:39:55.882969+0000","last_became_peered":"2024-09-13T18:39:55.882969+0000","last_unstale":"2024-09-13T18:39:57.301597+0000","last_undegraded":"2024-09-13T18:39:57.301597+0000","last_fullsized":"2024-09-13T18:39:57.301597+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:40.119828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.305931+0000","last_change":"2024-09-13T18:39:56.305179+0000","last_active":"2024-09-13T18:39:56.305931+0000","last_peered":"2024-09-13T18:39:56.305931+0000","last_clean":"2024-09-13T18:39:56.305931+0000","last_became_active":"2024-09-13T18:39:56.304956+0000","last_became_peered":"2024-09-13T18:39:56.304956+0000","last_unstale":"2024-09-13T18:39:56.305931+0000","last_undegraded":"2024-09-13T18:39:56.305931+0000","last_fullsized":"2024-09-13T18:39:56.305931+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:59:27.735776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381399+0000","last_change":"2024-09-13T18:39:55.890867+0000","last_active":"2024-09-13T18:39:58.381399+0000","last_peered":"2024-09-13T18:39:58.381399+0000","last_clean":"2024-09-13T18:39:58.381399+0000","last_became_active":"2024-09-13T18:39:55.888701+0000","last_became_peered":"2024-09-13T18:39:55.888701+0000","last_unstale":"2024-09-13T18:39:58.381399+0000","last_undegraded":"2024-09-13T18:39:58.381399+0000","last_fullsized":"2024-09-13T18:39:58.381399+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:54.344353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.302827+0000","last_change":"2024-09-13T18:39:56.302743+0000","last_active":"2024-09-13T18:39:56.302827+0000","last_peered":"2024-09-13T18:39:56.302827+0000","last_clean":"2024-09-13T18:39:56.302827+0000","last_became_active":"2024-09-13T18:39:56.302515+0000","last_became_peered":"2024-09-13T18:39:56.302515+0000","last_unstale":"2024-09-13T18:39:56.302827+0000","last_undegraded":"2024-09-13T18:39:56.302827+0000","last_fullsized":"2024-09-13T18:39:56.302827+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:10.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894323+0000","last_change":"2024-09-13T18:39:55.889121+0000","last_active":"2024-09-13T18:39:57.894323+0000","last_peered":"2024-09-13T18:39:57.894323+0000","last_clean":"2024-09-13T18:39:57.894323+0000","last_became_active":"2024-09-13T18:39:55.888893+0000","last_became_peered":"2024-09-13T18:39:55.888893+0000","last_unstale":"2024-09-13T18:39:57.894323+0000","last_undegraded":"2024-09-13T18:39:57.894323+0000","last_fullsized":"2024-09-13T18:39:57.894323+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:36.693929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894410+0000","last_change":"2024-09-13T18:39:56.307125+0000","last_active":"2024-09-13T18:39:57.894410+0000","last_peered":"2024-09-13T18:39:57.894410+0000","last_clean":"2024-09-13T18:39:57.894410+0000","last_became_active":"2024-09-13T18:39:56.306877+0000","last_became_peered":"2024-09-13T18:39:56.306877+0000","last_unstale":"2024-09-13T18:39:57.894410+0000","last_undegraded":"2024-09-13T18:39:57.894410+0000","last_fullsized":"2024-09-13T18:39:57.894410+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:02:26.978390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.7","version":"90'2","reported_seq":12,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.314309+0000","last_change":"2024-09-13T18:39:55.887740+0000","last_active":"2024-09-13T18:39:56.314309+0000","last_peered":"2024-09-13T18:39:56.314309+0000","last_clean":"2024-09-13T18:39:56.314309+0000","last_became_active":"2024-09-13T18:39:55.887360+0000","last_became_peered":"2024-09-13T18:39:55.887360+0000","last_unstale":"2024-09-13T18:39:56.314309+0000","last_undegraded":"2024-09-13T18:39:56.314309+0000","last_fullsized":"2024-09-13T18:39:56.314309+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:54.895816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301782+0000","last_change":"2024-09-13T18:39:56.317849+0000","last_active":"2024-09-13T18:39:57.301782+0000","last_peered":"2024-09-13T18:39:57.301782+0000","last_clean":"2024-09-13T18:39:57.301782+0000","last_became_active":"2024-09-13T18:39:56.317447+0000","last_became_peered":"2024-09-13T18:39:56.317447+0000","last_unstale":"2024-09-13T18:39:57.301782+0000","last_undegraded":"2024-09-13T18:39:57.301782+0000","last_fullsized":"2024-09-13T18:39:57.301782+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:52.713927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.293003+0000","last_change":"2024-09-13T18:39:55.890260+0000","last_active":"2024-09-13T18:39:56.293003+0000","last_peered":"2024-09-13T18:39:56.293003+0000","last_clean":"2024-09-13T18:39:56.293003+0000","last_became_active":"2024-09-13T18:39:55.889055+0000","last_became_peered":"2024-09-13T18:39:55.889055+0000","last_unstale":"2024-09-13T18:39:56.293003+0000","last_undegraded":"2024-09-13T18:39:56.293003+0000","last_fullsized":"2024-09-13T18:39:56.293003+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:37.604086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381305+0000","last_change":"2024-09-13T18:39:56.303130+0000","last_active":"2024-09-13T18:39:58.381305+0000","last_peered":"2024-09-13T18:39:58.381305+0000","last_clean":"2024-09-13T18:39:58.381305+0000","last_became_active":"2024-09-13T18:39:56.302896+0000","last_became_peered":"2024-09-13T18:39:56.302896+0000","last_unstale":"2024-09-13T18:39:58.381305+0000","last_undegraded":"2024-09-13T18:39:58.381305+0000","last_fullsized":"2024-09-13T18:39:58.381305+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:10.006279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298285+0000","last_change":"2024-09-13T18:39:55.890276+0000","last_active":"2024-09-13T18:39:56.298285+0000","last_peered":"2024-09-13T18:39:56.298285+0000","last_clean":"2024-09-13T18:39:56.298285+0000","last_became_active":"2024-09-13T18:39:55.888547+0000","last_became_peered":"2024-09-13T18:39:55.888547+0000","last_unstale":"2024-09-13T18:39:56.298285+0000","last_undegraded":"2024-09-13T18:39:56.298285+0000","last_fullsized":"2024-09-13T18:39:56.298285+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:44:43.552901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.301913+0000","last_change":"2024-09-13T18:39:56.315848+0000","last_active":"2024-09-13T18:39:57.301913+0000","last_peered":"2024-09-13T18:39:57.301913+0000","last_clean":"2024-09-13T18:39:57.301913+0000","last_became_active":"2024-09-13T18:39:56.315071+0000","last_became_peered":"2024-09-13T18:39:56.315071+0000","last_unstale":"2024-09-13T18:39:57.301913+0000","last_undegraded":"2024-09-13T18:39:57.301913+0000","last_fullsized":"2024-09-13T18:39:57.301913+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:16:09.507620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.298379+0000","last_change":"2024-09-13T18:39:55.886455+0000","last_active":"2024-09-13T18:39:56.298379+0000","last_peered":"2024-09-13T18:39:56.298379+0000","last_clean":"2024-09-13T18:39:56.298379+0000","last_became_active":"2024-09-13T18:39:55.886227+0000","last_became_peered":"2024-09-13T18:39:55.886227+0000","last_unstale":"2024-09-13T18:39:56.298379+0000","last_undegraded":"2024-09-13T18:39:56.298379+0000","last_fullsized":"2024-09-13T18:39:56.298379+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:33:59.904833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894543+0000","last_change":"2024-09-13T18:39:56.310194+0000","last_active":"2024-09-13T18:39:57.894543+0000","last_peered":"2024-09-13T18:39:57.894543+0000","last_clean":"2024-09-13T18:39:57.894543+0000","last_became_active":"2024-09-13T18:39:56.308334+0000","last_became_peered":"2024-09-13T18:39:56.308334+0000","last_unstale":"2024-09-13T18:39:57.894543+0000","last_undegraded":"2024-09-13T18:39:57.894543+0000","last_fullsized":"2024-09-13T18:39:57.894543+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:13:41.715263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.297591+0000","last_change":"2024-09-13T18:39:55.887353+0000","last_active":"2024-09-13T18:39:56.297591+0000","last_peered":"2024-09-13T18:39:56.297591+0000","last_clean":"2024-09-13T18:39:56.297591+0000","last_became_active":"2024-09-13T18:39:55.887092+0000","last_became_peered":"2024-09-13T18:39:55.887092+0000","last_unstale":"2024-09-13T18:39:56.297591+0000","last_undegraded":"2024-09-13T18:39:56.297591+0000","last_fullsized":"2024-09-13T18:39:56.297591+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:06:55.178692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.296233+0000","last_change":"2024-09-13T18:39:56.296084+0000","last_active":"2024-09-13T18:39:56.296233+0000","last_peered":"2024-09-13T18:39:56.296233+0000","last_clean":"2024-09-13T18:39:56.296233+0000","last_became_active":"2024-09-13T18:39:56.295857+0000","last_became_peered":"2024-09-13T18:39:56.295857+0000","last_unstale":"2024-09-13T18:39:56.296233+0000","last_undegraded":"2024-09-13T18:39:56.296233+0000","last_fullsized":"2024-09-13T18:39:56.296233+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.073982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894603+0000","last_change":"2024-09-13T18:39:55.884476+0000","last_active":"2024-09-13T18:39:57.894603+0000","last_peered":"2024-09-13T18:39:57.894603+0000","last_clean":"2024-09-13T18:39:57.894603+0000","last_became_active":"2024-09-13T18:39:55.884255+0000","last_became_peered":"2024-09-13T18:39:55.884255+0000","last_unstale":"2024-09-13T18:39:57.894603+0000","last_undegraded":"2024-09-13T18:39:57.894603+0000","last_fullsized":"2024-09-13T18:39:57.894603+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:48:47.119367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.304786+0000","last_change":"2024-09-13T18:39:56.304717+0000","last_active":"2024-09-13T18:39:56.304786+0000","last_peered":"2024-09-13T18:39:56.304786+0000","last_clean":"2024-09-13T18:39:56.304786+0000","last_became_active":"2024-09-13T18:39:56.304492+0000","last_became_peered":"2024-09-13T18:39:56.304492+0000","last_unstale":"2024-09-13T18:39:56.304786+0000","last_undegraded":"2024-09-13T18:39:56.304786+0000","last_fullsized":"2024-09-13T18:39:56.304786+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381274+0000","last_change":"2024-09-13T18:39:55.882579+0000","last_active":"2024-09-13T18:39:58.381274+0000","last_peered":"2024-09-13T18:39:58.381274+0000","last_clean":"2024-09-13T18:39:58.381274+0000","last_became_active":"2024-09-13T18:39:55.882368+0000","last_became_peered":"2024-09-13T18:39:55.882368+0000","last_unstale":"2024-09-13T18:39:58.381274+0000","last_undegraded":"2024-09-13T18:39:58.381274+0000","last_fullsized":"2024-09-13T18:39:58.381274+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:50.549028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:58.381185+0000","last_change":"2024-09-13T18:39:56.314158+0000","last_active":"2024-09-13T18:39:58.381185+0000","last_peered":"2024-09-13T18:39:58.381185+0000","last_clean":"2024-09-13T18:39:58.381185+0000","last_became_active":"2024-09-13T18:39:56.313844+0000","last_became_peered":"2024-09-13T18:39:56.313844+0000","last_unstale":"2024-09-13T18:39:58.381185+0000","last_undegraded":"2024-09-13T18:39:58.381185+0000","last_fullsized":"2024-09-13T18:39:58.381185+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:49.460269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302326+0000","last_change":"2024-09-13T18:39:55.885862+0000","last_active":"2024-09-13T18:39:57.302326+0000","last_peered":"2024-09-13T18:39:57.302326+0000","last_clean":"2024-09-13T18:39:57.302326+0000","last_became_active":"2024-09-13T18:39:55.883304+0000","last_became_peered":"2024-09-13T18:39:55.883304+0000","last_unstale":"2024-09-13T18:39:57.302326+0000","last_undegraded":"2024-09-13T18:39:57.302326+0000","last_fullsized":"2024-09-13T18:39:57.302326+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:28:22.535124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.894230+0000","last_change":"2024-09-13T18:39:56.311526+0000","last_active":"2024-09-13T18:39:57.894230+0000","last_peered":"2024-09-13T18:39:57.894230+0000","last_clean":"2024-09-13T18:39:57.894230+0000","last_became_active":"2024-09-13T18:39:56.311286+0000","last_became_peered":"2024-09-13T18:39:56.311286+0000","last_unstale":"2024-09-13T18:39:57.894230+0000","last_undegraded":"2024-09-13T18:39:57.894230+0000","last_fullsized":"2024-09-13T18:39:57.894230+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":89,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:55.862817+0000","last_clean_scrub_stamp":"2024-09-13T18:39:55.862817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:44:55.901953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.b","version":"90'2","reported_seq":13,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-09-13T18:39:57.302305+0000","last_change":"2024-09-13T18:39:55.883908+0000","last_active":"2024-09-13T18:39:57.302305+0000","last_peered":"2024-09-13T18:39:57.302305+0000","last_clean":"2024-09-13T18:39:57.302305+0000","last_became_active":"2024-09-13T18:39:55.881003+0000","last_became_peered":"2024-09-13T18:39:55.881003+0000","last_unstale":"2024-09-13T18:39:57.302305+0000","last_undegraded":"2024-09-13T18:39:57.302305+0000","last_fullsized":"2024-09-13T18:39:57.302305+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":88,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:39:54.856680+0000","last_clean_scrub_stamp":"2024-09-13T18:39:54.856680+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:07.698897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-09-13T18:39:56.301383+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:39:56.301383+0000","last_peered":"2024-09-13T18:39:56.301383+0000","last_clean":"2024-09-13T18:39:56.301383+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:39:56.301383+0000","last_undegraded":"2024-09-13T18:39:56.301383+0000","last_fullsized":"2024-09-13T18:39:56.301383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542202,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1052,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194259,"statfs":{"total":200000000,"available":198922229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.626},"min":{"1min":0.48499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66000000000000003,"15min":0.625},"min":{"1min":0.48799999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.88700000000000001,"5min":0.997,"15min":0.997},"last":0.90900000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.68000000000000005,"15min":0.66200000000000003},"min":{"1min":0.55200000000000005,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91600000000000004,"5min":1.054,"15min":1.054},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.66900000000000004,"15min":0.64500000000000002},"min":{"1min":0.51400000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.67500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.67300000000000004,"15min":0.65300000000000002},"min":{"1min":0.47199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.90500000000000003,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66400000000000003,"15min":0.64700000000000002},"min":{"1min":0.56999999999999995,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.64100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.86499999999999999},"min":{"1min":0.58099999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0149999999999999,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.79300000000000004,"15min":0.876},"min":{"1min":0.56399999999999995,"5min":0.44,"15min":0.44},"max":{"1min":0.90900000000000003,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.63}]},{"osd":4,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56299999999999994,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.77800000000000002,"5min":1.036,"15min":1.036},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.44,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.75800000000000001,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.94699999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.65000000000000002,"15min":0.63800000000000001},"min":{"1min":0.41699999999999998,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85499999999999998,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.72099999999999997},"min":{"1min":0.52100000000000002,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.86299999999999999,"5min":1.371,"15min":1.371},"last":0.69799999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:39:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.67700000000000005,"15min":0.66500000000000004},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":1.143,"15min":1.143},"last":1.0349999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.48599999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88600000000000001,"5min":1.125,"15min":1.125},"last":0.84399999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":477,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194835,"statfs":{"total":200000000,"available":199511123,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.67400000000000004,"15min":0.63500000000000001},"min":{"1min":0.60999999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.876,"5min":1.665,"15min":1.665},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.627},"min":{"1min":0.51400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88400000000000001,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.69799999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.67500000000000004,"15min":0.63600000000000001},"min":{"1min":0.496,"5min":0.432,"15min":0.432},"max":{"1min":0.90900000000000003,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.66300000000000003,"15min":0.64200000000000002},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.84199999999999997,"5min":1.591,"15min":1.591},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.71599999999999997,"15min":0.67400000000000004},"min":{"1min":0.60699999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.99099999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.72199999999999998,"15min":0.69799999999999995},"min":{"1min":0.64500000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.95299999999999996,"5min":2.169,"15min":2.169},"last":0.65400000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.69599999999999995,"15min":0.65900000000000003},"min":{"1min":0.56200000000000006,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.87,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.66500000000000004,"15min":0.63900000000000001},"min":{"1min":0.52400000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.90700000000000003,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.503}]},{"osd":4,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.57699999999999996,"15min":0.59099999999999997},"min":{"1min":0.42099999999999999,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.71899999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.63300000000000001,"15min":0.65100000000000002},"min":{"1min":0.434,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.79200000000000004,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68100000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.66900000000000004},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.93100000000000005,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.747},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.64600000000000002,"15min":0.64800000000000002},"min":{"1min":0.45400000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.95599999999999996,"5min":1.115,"15min":1.115},"last":0.55500000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.53600000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92700000000000005,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.53100000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.81699999999999995,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.79000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":471,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194841,"statfs":{"total":200000000,"available":199517389,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77700000000000002,"15min":0.84899999999999998},"min":{"1min":0.47199999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.85299999999999998,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65300000000000002,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.85599999999999998,"5min":0.999,"15min":0.999},"last":0.80700000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.78300000000000003,"15min":0.873},"min":{"1min":0.54900000000000004,"5min":0.377,"15min":0.377},"max":{"1min":0.92000000000000004,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.77300000000000002,"15min":0.85499999999999998},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.89800000000000002,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.78000000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.66700000000000004,"15min":0.64200000000000002},"min":{"1min":0.42499999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.85299999999999998,"5min":1.032,"15min":1.032},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.81399999999999995,"15min":0.91400000000000003},"min":{"1min":0.60699999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.90700000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78200000000000003,"15min":0.84099999999999997},"min":{"1min":0.48699999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.93300000000000005,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66800000000000004,"15min":0.64800000000000002},"min":{"1min":0.46600000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.81599999999999995,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.83999999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.624},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69799999999999995,"15min":0.68700000000000006},"min":{"1min":0.51100000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.755}]},{"osd":5,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.621,"15min":0.59699999999999998},"min":{"1min":0.42499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.64200000000000002,"15min":0.61699999999999999},"min":{"1min":0.44500000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.403,"5min":1.403,"15min":1.403},"last":0.72399999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:39:32 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69799999999999995,"15min":0.68000000000000005},"min":{"1min":0.51700000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.125,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.748,"5min":0.71199999999999997,"15min":0.68400000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81699999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":470,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518293,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.69399999999999995,"15min":0.66500000000000004},"min":{"1min":0.46899999999999997,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.94699999999999995,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67600000000000005,"15min":0.64200000000000002},"min":{"1min":0.54500000000000004,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.85999999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.73799999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.67200000000000004},"min":{"1min":0.47299999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97199999999999998,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71099999999999997,"15min":0.68300000000000005},"min":{"1min":0.61299999999999999,"5min":0.436,"15min":0.436},"max":{"1min":0.86199999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.67600000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.73699999999999999,"15min":0.69699999999999995},"min":{"1min":0.57599999999999996,"5min":0.497,"15min":0.497},"max":{"1min":0.91300000000000003,"5min":3.706,"15min":3.706},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.72699999999999998,"15min":0.67900000000000005},"min":{"1min":0.58899999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.88800000000000001,"5min":3.742,"15min":3.742},"last":0.76700000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.747,"15min":0.70699999999999996},"min":{"1min":0.59099999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92100000000000004,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.629},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.70599999999999996,"15min":0.66600000000000004},"min":{"1min":0.53600000000000003,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.65400000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.41799999999999998,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.83399999999999996,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59899999999999998,"15min":0.58599999999999997},"min":{"1min":0.45000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.877,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.57199999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.81100000000000005,"15min":0.73099999999999998},"min":{"1min":0.502,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.85799999999999998,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.754},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.71799999999999997,"15min":0.68799999999999994},"min":{"1min":0.495,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.85499999999999998,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.66100000000000003,"15min":0.60699999999999998},"min":{"1min":0.47999999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80700000000000005,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70899999999999996,"15min":0.68300000000000005},"min":{"1min":0.55000000000000004,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92300000000000004,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.78000000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.434,"15min":0.45100000000000001},"min":{"1min":0.316,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.52300000000000002,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.45000000000000001},"min":{"1min":0.29599999999999999,"5min":0.248,"15min":0.248},"max":{"1min":0.67500000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.35099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.64100000000000001,"15min":0.80500000000000005},"min":{"1min":0.35999999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.67800000000000005,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.51900000000000002,"15min":0.58699999999999997},"min":{"1min":0.33800000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71099999999999997,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.41999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.57299999999999995,"15min":0.627},"min":{"1min":0.40400000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.77800000000000002,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.624,"15min":0.745},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.75800000000000001,"5min":7.798,"15min":7.798},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.79500000000000004,"15min":0.80700000000000005},"min":{"1min":0.54400000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0800000000000001,"5min":3.093,"15min":3.093},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.753,"15min":0.73699999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.032,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.79900000000000004,"15min":0.80800000000000005},"min":{"1min":0.61499999999999999,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1519999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.745,"15min":0.71599999999999997},"min":{"1min":0.64900000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.90700000000000003,"15min":1.0209999999999999},"min":{"1min":0.57899999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.84799999999999998,"15min":0.94899999999999995},"min":{"1min":0.48299999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.997,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.73599999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:39:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.73699999999999999,"15min":0.70099999999999996},"min":{"1min":0.57899999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83199999999999996,"15min":0.85799999999999998},"min":{"1min":0.61699999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.127,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.82199999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":476,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194836,"statfs":{"total":200000000,"available":199512105,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.42499999999999999,"15min":0.42199999999999999},"min":{"1min":0.309,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.60499999999999998,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.45100000000000001,"15min":0.45600000000000002},"min":{"1min":0.33400000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.65600000000000003,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.434}]},{"osd":1,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.42799999999999999,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.46800000000000003,"15min":0.48899999999999999},"min":{"1min":0.37,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.65800000000000003,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.46500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.504,"15min":0.51400000000000001},"min":{"1min":0.40899999999999997,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.65400000000000003,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57099999999999995,"15min":0.57899999999999996},"min":{"1min":0.49199999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79500000000000004,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.60899999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.72199999999999998,"15min":0.71399999999999997},"min":{"1min":0.60599999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.038,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.746},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71199999999999997,"15min":0.69799999999999995},"min":{"1min":0.5,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.96999999999999997,"5min":1.02,"15min":1.02},"last":0.71199999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.77100000000000002,"15min":0.75900000000000001},"min":{"1min":0.59899999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.746,"15min":0.71799999999999997},"min":{"1min":0.68100000000000005,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.73199999999999998,"15min":0.72099999999999997},"min":{"1min":0.56299999999999994,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.006,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.83999999999999997,"5min":0.71999999999999997,"15min":0.69799999999999995},"min":{"1min":0.55400000000000005,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:39:35 2024","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.754,"15min":0.73799999999999999},"min":{"1min":0.62,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.034,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.875,"5min":0.78500000000000003,"15min":0.76800000000000002},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.89300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1052,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194260,"statfs":{"total":200000000,"available":198922319,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.42999999999999999,"15min":0.43099999999999999},"min":{"1min":0.34000000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.73199999999999998,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.46700000000000003,"15min":0.47299999999999998},"min":{"1min":0.36199999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.70499999999999996,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.432}]},{"osd":2,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.36799999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.48499999999999999,"15min":0.46700000000000003},"min":{"1min":0.40100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.67300000000000004,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.52200000000000002,"15min":0.504},"min":{"1min":0.47199999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.499,"15min":0.501},"min":{"1min":0.41699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.748,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.29499999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.76800000000000002,"15min":0.753},"min":{"1min":0.65400000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.97399999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.76800000000000002,"15min":0.76000000000000001},"min":{"1min":0.66100000000000003,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:39:38 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.73299999999999998,"15min":0.72299999999999998},"min":{"1min":0.56799999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.0369999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.748,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.54400000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.79000000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.77200000000000002,"15min":0.77300000000000002},"min":{"1min":0.55500000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0760000000000001,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.78100000000000003,"15min":0.76700000000000002},"min":{"1min":0.68700000000000006,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:39:34 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.74099999999999999,"15min":0.74199999999999999},"min":{"1min":0.58599999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.0640000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.752,"15min":0.76100000000000001},"min":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95299999999999996,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69199999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":469,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194842,"statfs":{"total":200000000,"available":199518917,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.443,"15min":0.46400000000000002},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":1.669,"15min":1.669},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.498,"5min":0.44900000000000001,"15min":0.44700000000000001},"min":{"1min":0.33900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":0.874,"15min":0.874},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.49299999999999999,"15min":0.50900000000000001},"min":{"1min":0.38300000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66500000000000004,"5min":1.591,"15min":1.591},"last":0.505},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.48199999999999998,"15min":0.47299999999999998},"min":{"1min":0.38900000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.54300000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.46800000000000003,"15min":0.46000000000000002},"min":{"1min":0.32800000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.78100000000000003,"5min":1.03,"15min":1.03},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.435,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":1.637,"15min":1.637},"last":0.46100000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.71699999999999997,"15min":0.69699999999999995},"min":{"1min":0.47599999999999998,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.71299999999999997,"15min":0.70499999999999996},"min":{"1min":0.59599999999999997,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.96199999999999997,"5min":1.698,"15min":1.698},"last":0.67400000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:39:41 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.76500000000000001,"15min":0.73399999999999999},"min":{"1min":0.65500000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.0760000000000001,"5min":1.204,"15min":1.204},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.77500000000000002,"15min":0.78400000000000003},"min":{"1min":0.60899999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.0509999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.75700000000000001},"min":{"1min":0.61299999999999999,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.98699999999999999,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.72199999999999998,"15min":0.69999999999999996},"min":{"1min":0.51200000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0189999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:39:36 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.748,"15min":0.76200000000000001},"min":{"1min":0.56799999999999995,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.93700000000000006,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.70699999999999996,"15min":0.68000000000000005},"min":{"1min":0.59299999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1599999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.70899999999999996}]}]}],"pool_statfs":[]}} 2024-09-13T18:40:00.868 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:40:00.868 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:40:01.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.060+0000 7fd313200640 1 Processor -- start 2024-09-13T18:40:01.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.061+0000 7fd313200640 1 -- start start 2024-09-13T18:40:01.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd313200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 0x7fd314070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd313200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31406c5d0 con 0x7fd31415a9e0 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd313200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3140b3920 con 0x7fd31406e990 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd313200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3140b3730 con 0x7fd3140cdfd0 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd311e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd31415a9e0 0x7fd31406ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46636/0 (socket says 172.21.15.192:46636) 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd311e00640 1 -- 172.21.15.192:0/3174207481 learned_addr learned my addr 172.21.15.192:0/3174207481 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.062+0000 7fd312800640 1 --2- 172.21.15.192:0/3174207481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 0x7fd314070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239550732 0 0) 0x7fd31406c5d0 con 0x7fd31415a9e0 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2f8003520 con 0x7fd31415a9e0 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd312800640 1 -- 172.21.15.192:0/3174207481 >> v1:172.21.15.194:6789/0 conn(0x7fd31406e990 legacy=0x7fd3140cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078945312 0 0) 0x7fd3140b3920 con 0x7fd31406e990 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd312800640 1 -- 172.21.15.192:0/3174207481 >> v1:172.21.15.192:6789/0 conn(0x7fd31415a9e0 legacy=0x7fd31406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.063+0000 7fd312800640 1 -- 172.21.15.192:0/3174207481 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3140b3c00 con 0x7fd3140cdfd0 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.064+0000 7fd312800640 1 --2- 172.21.15.192:0/3174207481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 0x7fd314070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009dc0 tx=0x7fd30c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c566b3df9dbeb814 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.064+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007740 con 0x7fd3140cdfd0 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.064+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c02d050 con 0x7fd3140cdfd0 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.064+0000 7fd311400640 1 -- 172.21.15.192:0/3174207481 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c007aa0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 -- 172.21.15.192:0/3174207481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 msgr2=0x7fd314070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 --2- 172.21.15.192:0/3174207481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 0x7fd314070630 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009dc0 tx=0x7fd30c02a6d0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 -- 172.21.15.192:0/3174207481 shutdown_connections 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 --2- 172.21.15.192:0/3174207481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3140cdfd0 0x7fd314070630 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 -- 172.21.15.192:0/3174207481 >> 172.21.15.192:0/3174207481 conn(0x7fd3140736d0 msgr2=0x7fd3140b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 -- 172.21.15.192:0/3174207481 shutdown_connections 2024-09-13T18:40:01.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.065+0000 7fd313200640 1 -- 172.21.15.192:0/3174207481 wait complete. 2024-09-13T18:40:01.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.066+0000 7fd313200640 1 Processor -- start 2024-09-13T18:40:01.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.066+0000 7fd313200640 1 -- start start 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31406e990 0x7fd31414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31415a9e0 0x7fd3140711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31414f640 con 0x7fd3140cdfd0 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31414dc50 con 0x7fd31406e990 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.067+0000 7fd313200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141550f0 con 0x7fd31415a9e0 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52836/0 (socket says 172.21.15.192:52836) 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 -- 172.21.15.192:0/498653804 learned_addr learned my addr 172.21.15.192:0/498653804 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:01.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd311e00640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31406e990 0x7fd31414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd312800640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31415a9e0 0x7fd3140711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 -- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31415a9e0 msgr2=0x7fd3140711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31415a9e0 0x7fd3140711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 -- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31406e990 msgr2=0x7fd31414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31406e990 0x7fd31414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 -- 172.21.15.192:0/498653804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c009a70 con 0x7fd3140cdfd0 2024-09-13T18:40:01.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.068+0000 7fd309400640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c4b0 tx=0x7fd2fc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.069+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc005480 con 0x7fd3140cdfd0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.069+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2fc0035f0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.069+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31414e9c0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.069+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2fc0039e0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.069+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31414ef80 con 0x7fd3140cdfd0 2024-09-13T18:40:01.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.070+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31415adc0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.071+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd2fc003b40 con 0x7fd3140cdfd0 2024-09-13T18:40:01.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.071+0000 7fd30aa00640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 0x7fd2f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.071+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2fc0888a0 con 0x7fd3140cdfd0 2024-09-13T18:40:01.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.072+0000 7fd311e00640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 0x7fd2f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.072+0000 7fd311e00640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 0x7fd2f006d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3140ae5c0 tx=0x7fd304000bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.075+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd2fc053b20 con 0x7fd3140cdfd0 2024-09-13T18:40:01.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.304+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd31414fa60 con 0x7fd3140cdfd0 2024-09-13T18:40:01.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.309+0000 7fd30aa00640 1 -- 172.21.15.192:0/498653804 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd2fc017070 con 0x7fd3140cdfd0 2024-09-13T18:40:01.312 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:40:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 msgr2=0x7fd2f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 0x7fd2f006d0c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd3140ae5c0 tx=0x7fd304000bc0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 msgr2=0x7fd314070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fd2fc00c4b0 tx=0x7fd2fc00c970 comp rx=0 tx=0).stop 2024-09-13T18:40:01.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 shutdown_connections 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f006ac00 0x7fd2f006d0c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31415a9e0 0x7fd3140711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3140cdfd0 0x7fd314070c60 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 --2- 172.21.15.192:0/498653804 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd31406e990 0x7fd31414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 >> 172.21.15.192:0/498653804 conn(0x7fd3140736d0 msgr2=0x7fd3140af760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 shutdown_connections 2024-09-13T18:40:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.311+0000 7fd313200640 1 -- 172.21.15.192:0/498653804 wait complete. 2024-09-13T18:40:01.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:01.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.479+0000 7f54a1e00640 1 Processor -- start 2024-09-13T18:40:01.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.479+0000 7f54a1e00640 1 -- start start 2024-09-13T18:40:01.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f54a1e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f54a1e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f54a1e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f549c0b2f00 con 0x7f549c0b3f10 2024-09-13T18:40:01.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f54a1e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f549c0b3150 con 0x7f549c15e2c0 2024-09-13T18:40:01.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f54a1e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0b3430 con 0x7f549c15dee0 2024-09-13T18:40:01.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f549aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f549b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f549aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:48706/0 (socket says 172.21.15.192:48706) 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f549b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:59450/0 (socket says 172.21.15.192:59450) 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.481+0000 7f549aa00640 1 -- 172.21.15.192:0/4016306690 learned_addr learned my addr 172.21.15.192:0/4016306690 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.482+0000 7f549aa00640 1 -- 172.21.15.192:0/4016306690 >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 msgr2=0x7f549c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.482+0000 7f549aa00640 1 --2- 172.21.15.192:0/4016306690 >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.482+0000 7f549aa00640 1 -- 172.21.15.192:0/4016306690 >> v1:172.21.15.194:6789/0 conn(0x7f549c0b3f10 legacy=0x7f549c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.482+0000 7f549aa00640 1 -- 172.21.15.192:0/4016306690 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f549c0b3710 con 0x7f549c15dee0 2024-09-13T18:40:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.482+0000 7f549b400640 1 --2- 172.21.15.192:0/4016306690 >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.483+0000 7f549aa00640 1 --2- 172.21.15.192:0/4016306690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c02c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdd9d5fa597ae06f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.483+0000 7f5499600640 1 -- 172.21.15.192:0/4016306690 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031710 con 0x7f549c15dee0 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.483+0000 7f5499600640 1 -- 172.21.15.192:0/4016306690 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c02f050 con 0x7f549c15dee0 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.483+0000 7f5499600640 1 -- 172.21.15.192:0/4016306690 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c031a90 con 0x7f549c15dee0 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 -- 172.21.15.192:0/4016306690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 msgr2=0x7f549c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 --2- 172.21.15.192:0/4016306690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f548c009870 tx=0x7f548c02c480 comp rx=0 tx=0).stop 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 -- 172.21.15.192:0/4016306690 shutdown_connections 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 --2- 172.21.15.192:0/4016306690 >> v2:172.21.15.194:3300/0 conn(0x7f549c15e2c0 0x7f549c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 --2- 172.21.15.192:0/4016306690 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c15dee0 0x7f549c0afd80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 -- 172.21.15.192:0/4016306690 >> 172.21.15.192:0/4016306690 conn(0x7f549c0ae960 msgr2=0x7f549c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 -- 172.21.15.192:0/4016306690 shutdown_connections 2024-09-13T18:40:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.484+0000 7f54a1e00640 1 -- 172.21.15.192:0/4016306690 wait complete. 2024-09-13T18:40:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.485+0000 7f54a1e00640 1 Processor -- start 2024-09-13T18:40:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.485+0000 7f54a1e00640 1 -- start start 2024-09-13T18:40:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f549c15dee0 0x7f549c1f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c0ad840 0x7f549c0adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c0ae230 con 0x7f549c15e2c0 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c13e2d0 con 0x7f549c15dee0 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.486+0000 7f54a1e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f549c13f0f0 con 0x7f549c0ad840 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52844/0 (socket says 172.21.15.192:52844) 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 -- 172.21.15.192:0/472143379 learned_addr learned my addr 172.21.15.192:0/472143379 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549aa00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f549c15dee0 0x7f549c1f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549b400640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c0ad840 0x7f549c0adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 -- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c0ad840 msgr2=0x7f549c0adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c0ad840 0x7f549c0adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 -- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f549c15dee0 msgr2=0x7f549c1f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f549c15dee0 0x7f549c1f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 -- 172.21.15.192:0/472143379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5494009a70 con 0x7f549c15e2c0 2024-09-13T18:40:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.487+0000 7f549a000640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f548800c480 tx=0x7f548800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.488+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54880052d0 con 0x7f549c15e2c0 2024-09-13T18:40:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.488+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5488005430 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.488+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5488003830 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.488+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548c0094d0 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.488+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c13e7c0 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.489+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c13b980 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.490+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5488003990 con 0x7f549c15e2c0 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.490+0000 7f5493400640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 0x7f547c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.491+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54880887a0 con 0x7f549c15e2c0 2024-09-13T18:40:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.491+0000 7f549aa00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 0x7f547c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.491+0000 7f549aa00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 0x7f547c06d0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f548c035000 tx=0x7f548c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:01.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.495+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5488053a20 con 0x7f549c15e2c0 2024-09-13T18:40:01.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.695+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f549c0afd80 con 0x7f549c15e2c0 2024-09-13T18:40:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.696+0000 7f5493400640 1 -- 172.21.15.192:0/472143379 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f5488057040 con 0x7f549c15e2c0 2024-09-13T18:40:01.699 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:01.699 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 msgr2=0x7f547c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 0x7f547c06d0c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f548c035000 tx=0x7f548c008030 comp rx=0 tx=0).stop 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 msgr2=0x7f549c151150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f548800c480 tx=0x7f548800c880 comp rx=0 tx=0).stop 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 shutdown_connections 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f547c06ac00 0x7f547c06d0c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f549c0ad840 0x7f549c0adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f549c15e2c0 0x7f549c151150 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 --2- 172.21.15.192:0/472143379 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f549c15dee0 0x7f549c1f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 >> 172.21.15.192:0/472143379 conn(0x7f549c0ae960 msgr2=0x7f549c159840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 shutdown_connections 2024-09-13T18:40:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:01.698+0000 7f54a1e00640 1 -- 172.21.15.192:0/472143379 wait complete. 2024-09-13T18:40:02.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:39:56.286918+0000', 'modified': '2024-09-13T18:39:59.300225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6453}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6453': {'gid': 6453, 'name': 'a', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/887376150', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 887376150}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 887376150}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:40:02.119 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:40:02.119 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:40:02.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.271+0000 7fb64aa00640 1 Processor -- start 2024-09-13T18:40:02.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.271+0000 7fb64aa00640 1 -- start start 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb6440cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6440cde00 0x7fb64406a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64aa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6440b3d80 con 0x7fb6441551b0 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64aa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6440cb570 con 0x7fb6440cde00 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb644155590 con 0x7fb6440b38f0 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb64a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb6440cde00 0x7fb64406a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb649600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb6441551b0 0x7fb64415ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46650/0 (socket says 172.21.15.192:46650) 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb649600640 1 -- 172.21.15.192:0/883251484 learned_addr learned my addr 172.21.15.192:0/883251484 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:02.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.272+0000 7fb648c00640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb6440cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.273+0000 7fb64a000640 1 -- 172.21.15.192:0/883251484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 msgr2=0x7fb6440cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.273+0000 7fb64a000640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb6440cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.273+0000 7fb64a000640 1 -- 172.21.15.192:0/883251484 >> v1:172.21.15.192:6789/0 conn(0x7fb6441551b0 legacy=0x7fb64415ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.273+0000 7fb64a000640 1 -- 172.21.15.192:0/883251484 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64406ed30 con 0x7fb6440cde00 2024-09-13T18:40:02.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb64a000640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6440cde00 0x7fb64406a370 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec2eeb9c485b52a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb643e00640 1 -- 172.21.15.192:0/883251484 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c007740 con 0x7fb6440cde00 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb643e00640 1 -- 172.21.15.192:0/883251484 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c02d050 con 0x7fb6440cde00 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb643e00640 1 -- 172.21.15.192:0/883251484 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c007ac0 con 0x7fb6440cde00 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb64aa00640 1 -- 172.21.15.192:0/883251484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6440cde00 msgr2=0x7fb64406a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.274+0000 7fb64aa00640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6440cde00 0x7fb64406a370 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c02a560 comp rx=0 tx=0).stop 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 -- 172.21.15.192:0/883251484 shutdown_connections 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6440cde00 0x7fb64406a370 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 --2- 172.21.15.192:0/883251484 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb6440cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 -- 172.21.15.192:0/883251484 >> 172.21.15.192:0/883251484 conn(0x7fb6440736d0 msgr2=0x7fb6440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 -- 172.21.15.192:0/883251484 shutdown_connections 2024-09-13T18:40:02.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.275+0000 7fb64aa00640 1 -- 172.21.15.192:0/883251484 wait complete. 2024-09-13T18:40:02.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.276+0000 7fb64aa00640 1 Processor -- start 2024-09-13T18:40:02.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.276+0000 7fb64aa00640 1 -- start start 2024-09-13T18:40:02.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb644070e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 0x7fb64414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64414b140 con 0x7fb6441551b0 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64414de90 con 0x7fb6440cde00 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64aa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb64414e100 con 0x7fb6440b38f0 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52868/0 (socket says 172.21.15.192:52868) 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 -- 172.21.15.192:0/1018069012 learned_addr learned my addr 172.21.15.192:0/1018069012 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb649600640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb644070e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb648c00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 0x7fb64414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 -- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 msgr2=0x7fb644070e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb644070e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 -- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 msgr2=0x7fb64414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 0x7fb64414d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb64a000640 1 -- 172.21.15.192:0/1018069012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c009a70 con 0x7fb6441551b0 2024-09-13T18:40:02.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.278+0000 7fb648c00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 0x7fb64414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb64a000640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009eb0 tx=0x7fb63c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb641600640 1 -- 172.21.15.192:0/1018069012 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c003b90 con 0x7fb6441551b0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb641600640 1 -- 172.21.15.192:0/1018069012 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c003cf0 con 0x7fb6441551b0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb641600640 1 -- 172.21.15.192:0/1018069012 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c03c8f0 con 0x7fb6441551b0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6441f0690 con 0x7fb6441551b0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.279+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6441f1460 con 0x7fb6441551b0 2024-09-13T18:40:02.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.281+0000 7fb641600640 1 -- 172.21.15.192:0/1018069012 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb63c03ca50 con 0x7fb6441551b0 2024-09-13T18:40:02.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.282+0000 7fb641600640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 0x7fb62406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.282+0000 7fb641600640 1 -- 172.21.15.192:0/1018069012 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb63c0aabd0 con 0x7fb6441551b0 2024-09-13T18:40:02.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.282+0000 7fb649600640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 0x7fb62406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.282+0000 7fb649600640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 0x7fb62406d0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb638000f60 tx=0x7fb638007e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 Processor -- start 2024-09-13T18:40:02.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 -- start start 2024-09-13T18:40:02.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de218cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218a000 0x556de21d9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de20f5ab0 con 0x556de21b3cf0 2024-09-13T18:40:02.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de20f3240 con 0x556de218c840 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.283+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556de20eeb30 con 0x556de218a000 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb649600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de218cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52872/0 (socket says 172.21.15.192:52872) 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 -- 172.21.15.192:0/2844952188 learned_addr learned my addr 172.21.15.192:0/2844952188 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb648c00640 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218a000 0x556de21d9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 -- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218a000 msgr2=0x556de21d9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218a000 0x556de21d9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 -- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 msgr2=0x556de218cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de218cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 -- 172.21.15.192:0/2844952188 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de20b9bd0 con 0x556de21b3cf0 2024-09-13T18:40:02.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.284+0000 7fb64a000640 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb63c081920 tx=0x7fb63c07a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b257239b246b5fed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb636000640 1 -- 172.21.15.192:0/2844952188 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c081e50 con 0x556de21b3cf0 2024-09-13T18:40:02.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb636000640 1 -- 172.21.15.192:0/2844952188 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c077e00 con 0x556de21b3cf0 2024-09-13T18:40:02.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb636000640 1 -- 172.21.15.192:0/2844952188 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c079cc0 con 0x556de21b3cf0 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 -- 172.21.15.192:0/2844952188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 msgr2=0x556de21da250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fb63c081920 tx=0x7fb63c07a2a0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 -- 172.21.15.192:0/2844952188 shutdown_connections 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21da250 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218a000 0x556de21d9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/2844952188 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de218cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 -- 172.21.15.192:0/2844952188 >> 172.21.15.192:0/2844952188 conn(0x556de2188f70 msgr2=0x556de21d1420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 -- 172.21.15.192:0/2844952188 shutdown_connections 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.285+0000 7fb64ee6c740 1 -- 172.21.15.192:0/2844952188 wait complete. 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.286+0000 7fb64ee6c740 1 -- start start 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.286+0000 7fb64ee6c740 1 Processor -- start 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 0x556de21a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de2090260 con 0x556de21d8000 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de208ff00 con 0x556de21b3cf0 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556de1e55f20 con 0x556de218c840 2024-09-13T18:40:02.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64ee6c740 10 client.0 _ll_register_callbacks cb 0x556de20e81a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52878/0 (socket says 172.21.15.192:52878) 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.287+0000 7fb64a000640 1 -- 172.21.15.192:0/1672798970 learned_addr learned my addr 172.21.15.192:0/1672798970 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb648c00640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 0x556de21a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb649600640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 -- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 msgr2=0x556de21ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 -- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 msgr2=0x556de21a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 0x556de21a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 -- 172.21.15.192:0/1672798970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6441f1460 con 0x556de21d8000 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb648c00640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 0x556de21a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:02.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64a000640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c02a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292fd6ea62ceccd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb62aa00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c095070 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb63c079160 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556de2118cd0 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb63c081ed0 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64ee6c740 10 client.6585 fetch_fsmap learned FSMap version 40 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.288+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x556de20ed1b0 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556de2118cd0 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb63c098020 con 0x556de21d8000 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 10 client.6585 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 10 client.6585 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:40:02.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 20 client.6585 populate_metadata read hostname 'smithi192' 2024-09-13T18:40:02.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21866e0 0x556de21f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 4 client.6585 mds_command: new command op to 6453 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:40:02.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 --> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556de1de23c0 con 0x556de21866e0 2024-09-13T18:40:02.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.289+0000 7fb649600640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21866e0 0x556de21f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.290+0000 7fb62aa00640 10 client.6585 ms_handle_connect on v2:172.21.15.192:6836/887376150 2024-09-13T18:40:02.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.290+0000 7fb649600640 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21866e0 0x556de21f27c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8646683c57b32a9e server_cookie=d0aece1f46051a27 in_seq=0 out_seq=0 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.290+0000 7fb62aa00640 1 -- 172.21.15.192:0/1672798970 <== mds.0 v2:172.21.15.192:6836/887376150 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x556de1de23c0 con 0x556de21866e0 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.290+0000 7fb62aa00640 10 client.6585 handle_command_reply: tid=0 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 client.6585 shutdown 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 msgr2=0x556de21a5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009d90 tx=0x7fb63c02a560 comp rx=0 tx=0).stop 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 shutdown_connections 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a5c30 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21866e0 0x556de21f27c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21b3cf0 0x556de21a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1672798970 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb62aa00640 0 client.6585 ms_handle_reset on v2:172.21.15.192:6836/887376150 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 >> 172.21.15.192:0/1672798970 conn(0x556de218a000 msgr2=0x556de21d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 shutdown_connections 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1672798970 wait complete. 2024-09-13T18:40:02.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.291+0000 7fb64ee6c740 20 client.6585 trim_cache size 0 max 16384 2024-09-13T18:40:02.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.306+0000 7fb64ee6c740 1 Processor -- start 2024-09-13T18:40:02.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.306+0000 7fb64ee6c740 1 -- start start 2024-09-13T18:40:02.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21d1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21d8000 0x556de21b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de21cc4b0 con 0x556de21b3cf0 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de21d5710 con 0x556de21d8000 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556de21a6580 con 0x556de218c840 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb648c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.307+0000 7fb648c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52884/0 (socket says 172.21.15.192:52884) 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 -- 172.21.15.192:0/918164708 learned_addr learned my addr 172.21.15.192:0/918164708 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 -- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 msgr2=0x556de21d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21d1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 -- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21d8000 msgr2=0x556de21b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb64a000640 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21d8000 0x556de21b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21d8000 0x556de21b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 -- 172.21.15.192:0/918164708 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556de2122170 con 0x556de21b3cf0 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb648c00640 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb6300079a0 tx=0x7fb630007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09e0b0fcd5bd984 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb636a00640 1 -- 172.21.15.192:0/918164708 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300040f0 con 0x556de21b3cf0 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb636a00640 1 -- 172.21.15.192:0/918164708 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb630004270 con 0x556de21b3cf0 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.308+0000 7fb636a00640 1 -- 172.21.15.192:0/918164708 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6300149f0 con 0x556de21b3cf0 2024-09-13T18:40:02.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 -- 172.21.15.192:0/918164708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 msgr2=0x556de21a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb6300079a0 tx=0x7fb630007e60 comp rx=0 tx=0).stop 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 -- 172.21.15.192:0/918164708 shutdown_connections 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de21d8000 0x556de21b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21b3cf0 0x556de21a5f40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/918164708 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de218c840 0x556de21d1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 -- 172.21.15.192:0/918164708 >> 172.21.15.192:0/918164708 conn(0x556de218a000 msgr2=0x556de21d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 -- 172.21.15.192:0/918164708 shutdown_connections 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.309+0000 7fb64ee6c740 1 -- 172.21.15.192:0/918164708 wait complete. 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.310+0000 7fb64ee6c740 1 -- start start 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.310+0000 7fb64ee6c740 1 Processor -- start 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de223f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 0x556de21a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de21cce90 con 0x556de21d8000 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x556de21cff20 con 0x556de218c840 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x556de21d1f70 con 0x556de21b3cf0 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64ee6c740 10 client.0 _ll_register_callbacks cb 0x7fb638007ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52888/0 (socket says 172.21.15.192:52888) 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 -- 172.21.15.192:0/1513525139 learned_addr learned my addr 172.21.15.192:0/1513525139 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb648c00640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 0x556de21a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb649600640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de223f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 -- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 msgr2=0x556de21a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 0x556de21a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 -- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 msgr2=0x556de223f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:02.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de223f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb64a000640 1 -- 172.21.15.192:0/1513525139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63000e040 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.311+0000 7fb648c00640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 0x556de21a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64a000640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb63c081b30 tx=0x7fb63c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beee1e9d8a8284b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c095040 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb63c085060 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb63c077e00 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb63c075da0 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 10 client.6591 fetch_fsmap learned FSMap version 40 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x556de208f470 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63c077e00 con 0x556de21d8000 2024-09-13T18:40:02.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 40) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb63c04c070 con 0x556de21d8000 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 10 client.6591 fetch_fsmap finished waiting for FSMap version 40 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 10 client.6591 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 20 client.6591 populate_metadata read hostname 'smithi192' 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21aa4d0 0x556de21d2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 4 client.6591 mds_command: new command op to 6453 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.312+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 --> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556de1df36c0 con 0x556de21aa4d0 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb649600640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21aa4d0 0x556de21d2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb649600640 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21aa4d0 0x556de21d2400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cab1c33d8e72f47 server_cookie=73514423eb8bc5 in_seq=0 out_seq=0 2024-09-13T18:40:02.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb62aa00640 10 client.6591 ms_handle_connect on v2:172.21.15.192:6836/887376150 2024-09-13T18:40:02.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb62aa00640 1 -- 172.21.15.192:0/1513525139 <== mds.0 v2:172.21.15.192:6836/887376150 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x556de1df36c0 con 0x556de21aa4d0 2024-09-13T18:40:02.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb62aa00640 10 client.6591 handle_command_reply: tid=0 2024-09-13T18:40:02.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.313+0000 7fb64ee6c740 1 client.6591 shutdown 2024-09-13T18:40:02.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 msgr2=0x556de21a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fb63c081b30 tx=0x7fb63c009750 comp rx=0 tx=0).stop 2024-09-13T18:40:02.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 shutdown_connections 2024-09-13T18:40:02.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x556de21d8000 0x556de21a4b20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x556de21b3cf0 0x556de21a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.192:6836/887376150,v1:172.21.15.192:6837/887376150] conn(0x556de21aa4d0 0x556de21d2400 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 --2- 172.21.15.192:0/1513525139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x556de218c840 0x556de223f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 >> 172.21.15.192:0/1513525139 conn(0x556de218a000 msgr2=0x556de21d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb62aa00640 0 client.6591 ms_handle_reset on v2:172.21.15.192:6836/887376150 2024-09-13T18:40:02.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 shutdown_connections 2024-09-13T18:40:02.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 1 -- 172.21.15.192:0/1513525139 wait complete. 2024-09-13T18:40:02.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64ee6c740 20 client.6591 trim_cache size 0 max 16384 2024-09-13T18:40:02.325 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:40:02.325 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:40:02.326 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:40:02.326 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 6453, 2024-09-13T18:40:02.326 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:40:02.326 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0237043999999997, 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 40, 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 91, 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 91, 2024-09-13T18:40:02.327 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 10.694122160999999 2024-09-13T18:40:02.328 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:40:02.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 msgr2=0x7fb62406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 0x7fb62406d0c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb638000f60 tx=0x7fb638007e00 comp rx=0 tx=0).stop 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 msgr2=0x7fb64414d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.314+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fb63c009eb0 tx=0x7fb63c004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 shutdown_connections 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb62406ac00 0x7fb62406d0c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb6441551b0 0x7fb64414d950 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb6440cde00 0x7fb64414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 --2- 172.21.15.192:0/1018069012 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb6440b38f0 0x7fb644070e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 >> 172.21.15.192:0/1018069012 conn(0x7fb6440736d0 msgr2=0x7fb64415d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 shutdown_connections 2024-09-13T18:40:02.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.315+0000 7fb64aa00640 1 -- 172.21.15.192:0/1018069012 wait complete. 2024-09-13T18:40:02.333 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:40:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.482+0000 7f1820000640 1 Processor -- start 2024-09-13T18:40:02.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.482+0000 7f1820000640 1 -- start start 2024-09-13T18:40:02.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1820000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f18180b0490 0x7f18180cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1820000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f181815ec00 con 0x7f18180cacd0 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1820000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1818140480 con 0x7f181815e790 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1820000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18180cb5f0 con 0x7f18180b0490 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f181d600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f18180cacd0 0x7f1818140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46664/0 (socket says 172.21.15.192:46664) 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f181d600640 1 -- 172.21.15.192:0/3739566144 learned_addr learned my addr 172.21.15.192:0/3739566144 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:02.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f181e000640 1 --2- 172.21.15.192:0/3739566144 >> v2:172.21.15.194:3300/0 conn(0x7f18180b0490 0x7f18180cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1817e00640 1 -- 172.21.15.192:0/3739566144 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059842950 0 0) 0x7f181815ec00 con 0x7f18180cacd0 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.484+0000 7f1817e00640 1 -- 172.21.15.192:0/3739566144 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1800003520 con 0x7f18180cacd0 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.485+0000 7f181e000640 1 -- 172.21.15.192:0/3739566144 >> v1:172.21.15.194:6789/0 conn(0x7f181815e790 legacy=0x7f18180afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.485+0000 7f181e000640 1 -- 172.21.15.192:0/3739566144 >> v1:172.21.15.192:6789/0 conn(0x7f18180cacd0 legacy=0x7f1818140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.485+0000 7f181e000640 1 -- 172.21.15.192:0/3739566144 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f181815ee90 con 0x7f18180b0490 2024-09-13T18:40:02.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f181e000640 1 --2- 172.21.15.192:0/3739566144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f18180cb0b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18100097a0 tx=0x7f181002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ad42bec342908 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1817e00640 1 -- 172.21.15.192:0/3739566144 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810032440 con 0x7f18180b0490 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1817e00640 1 -- 172.21.15.192:0/3739566144 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18100325a0 con 0x7f18180b0490 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1817e00640 1 -- 172.21.15.192:0/3739566144 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810032930 con 0x7f18180b0490 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1820000640 1 -- 172.21.15.192:0/3739566144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 msgr2=0x7f18180cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1820000640 1 --2- 172.21.15.192:0/3739566144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f18180cb0b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f18100097a0 tx=0x7f181002a230 comp rx=0 tx=0).stop 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1820000640 1 -- 172.21.15.192:0/3739566144 shutdown_connections 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1820000640 1 --2- 172.21.15.192:0/3739566144 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f18180cb0b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.486+0000 7f1820000640 1 -- 172.21.15.192:0/3739566144 >> 172.21.15.192:0/3739566144 conn(0x7f18180ae960 msgr2=0x7f181806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.487+0000 7f1820000640 1 -- 172.21.15.192:0/3739566144 shutdown_connections 2024-09-13T18:40:02.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.487+0000 7f1820000640 1 -- 172.21.15.192:0/3739566144 wait complete. 2024-09-13T18:40:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.488+0000 7f1820000640 1 Processor -- start 2024-09-13T18:40:02.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.488+0000 7f1820000640 1 -- start start 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f181806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181815e790 0x7f181806b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1818069ea0 con 0x7f18180cacd0 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181806a740 con 0x7f18180b0490 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f1820000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f181806bc20 con 0x7f181815e790 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.489+0000 7f181cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52902/0 (socket says 172.21.15.192:52902) 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 -- 172.21.15.192:0/1433337180 learned_addr learned my addr 172.21.15.192:0/1433337180 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:02.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181d600640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f181806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181e000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181815e790 0x7f181806b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 -- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181815e790 msgr2=0x7f181806b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181815e790 0x7f181806b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 -- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 msgr2=0x7f181806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f181806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 -- 172.21.15.192:0/1433337180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1810009400 con 0x7f18180cacd0 2024-09-13T18:40:02.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.490+0000 7f181cc00640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f180400c450 tx=0x7f180400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.491+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18040052d0 con 0x7f18180cacd0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.491+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1804005430 con 0x7f18180cacd0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.491+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181806a0f0 con 0x7f18180cacd0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.491+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1804012870 con 0x7f18180cacd0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.491+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181815a510 con 0x7f18180cacd0 2024-09-13T18:40:02.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.492+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181815a6a0 con 0x7f18180cacd0 2024-09-13T18:40:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.493+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f18040129d0 con 0x7f18180cacd0 2024-09-13T18:40:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.493+0000 7f1815600640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 0x7f17f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.493+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1804088d10 con 0x7f18180cacd0 2024-09-13T18:40:02.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.494+0000 7f181d600640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 0x7f17f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:02.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.494+0000 7f181d600640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 0x7f17f806d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f180c001560 tx=0x7f180c001a90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:02.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.498+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f180408e020 con 0x7f18180cacd0 2024-09-13T18:40:02.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.699+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f18180cb0b0 con 0x7f18180cacd0 2024-09-13T18:40:02.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.699+0000 7f1815600640 1 -- 172.21.15.192:0/1433337180 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1804053f90 con 0x7f18180cacd0 2024-09-13T18:40:02.702 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:40:02.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 msgr2=0x7f17f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 0x7f17f806d0c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f180c001560 tx=0x7f180c001a90 comp rx=0 tx=0).stop 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 msgr2=0x7f1818159fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f180400c450 tx=0x7f180400c910 comp rx=0 tx=0).stop 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 shutdown_connections 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f17f806ac00 0x7f17f806d0c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f181815e790 0x7f181806b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f18180cacd0 0x7f1818159fd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 --2- 172.21.15.192:0/1433337180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f18180b0490 0x7f181806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 >> 172.21.15.192:0/1433337180 conn(0x7f18180ae960 msgr2=0x7f181813f740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 shutdown_connections 2024-09-13T18:40:02.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:02.701+0000 7f1820000640 1 -- 172.21.15.192:0/1433337180 wait complete. 2024-09-13T18:40:02.721 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:40:02.721 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:40:02.722 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:40:02.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:02.723 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:02.760 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42506sec preferred_lft 42506sec 2024-09-13T18:40:02.761 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.762 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:40:02.763 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:40:02.763 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:40:02.763 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:02.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:02.763 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:40:02.856 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:40:02.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:02.859 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:40:02.895 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:40:02.895 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:40:02.895 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:40:02.896 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:40:02.896 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:40:02.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:40:02.896 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:40:03.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:03.042 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:40:03.077 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:40:03.078 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:40:03.078 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:40:03.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:03.078 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:40:03.174 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:03.174 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:03.209 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:40:03.209 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:03.209 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:03.284 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:40:03.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:03.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:03.413 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:03.413 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:40:03.440 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:03.440 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:40:03.440 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:40:03.441 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:40:03.441 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:40:03.442 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:40:03.442 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:40:03.442 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:40:03.442 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:40:03.442 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:40:03.445 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:40:03.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:03.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:03.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:03.502 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:40:03.547 INFO:teuthology.orchestra.run.smithi192.stdout:client5726 2024-09-13T18:40:03.548 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:03.548 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:03.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:40:03.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.812+0000 7fbf03400640 1 Processor -- start 2024-09-13T18:40:03.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.812+0000 7fbf03400640 1 -- start start 2024-09-13T18:40:03.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.813+0000 7fbf03400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 0x7fbefc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:03.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.813+0000 7fbf03400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0ae770 con 0x7fbefc146610 2024-09-13T18:40:03.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.813+0000 7fbf03400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbefc0cdb30 con 0x7fbefc0afd80 2024-09-13T18:40:03.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.813+0000 7fbf03400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc0cd920 con 0x7fbefc0b2780 2024-09-13T18:40:03.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbf00a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbefc146610 0x7fbefc0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46666/0 (socket says 172.21.15.192:46666) 2024-09-13T18:40:03.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbf00a00640 1 -- 172.21.15.192:0/1442008774 learned_addr learned my addr 172.21.15.192:0/1442008774 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefbe00640 1 --2- 172.21.15.192:0/1442008774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 0x7fbefc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1405645736 0 0) 0x7fbefc0ae770 con 0x7fbefc146610 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbee4003520 con 0x7fbefc146610 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957902323 0 0) 0x7fbefc0cdb30 con 0x7fbefc0afd80 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbefc0ae770 con 0x7fbefc0afd80 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefbe00640 1 -- 172.21.15.192:0/1442008774 >> v1:172.21.15.194:6789/0 conn(0x7fbefc0afd80 legacy=0x7fbefc0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.815+0000 7fbefbe00640 1 -- 172.21.15.192:0/1442008774 >> v1:172.21.15.192:6789/0 conn(0x7fbefc146610 legacy=0x7fbefc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.814+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1697023875 0 0) 0x7fbee4003520 con 0x7fbefc146610 2024-09-13T18:40:03.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.815+0000 7fbefbe00640 1 -- 172.21.15.192:0/1442008774 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbefc0ae1b0 con 0x7fbefc0b2780 2024-09-13T18:40:03.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbefbe00640 1 --2- 172.21.15.192:0/1442008774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 0x7fbefc0ad840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbee80097d0 tx=0x7fbee802a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76cbf6b6b636b800 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:03.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0001670 con 0x7fbefc0b2780 2024-09-13T18:40:03.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee802ac30 con 0x7fbefc0b2780 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbefb400640 1 -- 172.21.15.192:0/1442008774 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8032440 con 0x7fbefc0b2780 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 -- 172.21.15.192:0/1442008774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 msgr2=0x7fbefc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 --2- 172.21.15.192:0/1442008774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 0x7fbefc0ad840 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbee80097d0 tx=0x7fbee802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 -- 172.21.15.192:0/1442008774 shutdown_connections 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 --2- 172.21.15.192:0/1442008774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc0b2780 0x7fbefc0ad840 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 -- 172.21.15.192:0/1442008774 >> 172.21.15.192:0/1442008774 conn(0x7fbefc0ae960 msgr2=0x7fbefc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.816+0000 7fbf03400640 1 -- 172.21.15.192:0/1442008774 shutdown_connections 2024-09-13T18:40:03.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.817+0000 7fbf03400640 1 -- 172.21.15.192:0/1442008774 wait complete. 2024-09-13T18:40:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.818+0000 7fbf03400640 1 Processor -- start 2024-09-13T18:40:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.818+0000 7fbf03400640 1 -- start start 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbefc0afd80 0x7fbefc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc146610 0x7fbefc06fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc070640 con 0x7fbefc0700c0 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc070920 con 0x7fbefc0afd80 2024-09-13T18:40:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf03400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbefc070c00 con 0x7fbefc146610 2024-09-13T18:40:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf01400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf01400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52912/0 (socket says 172.21.15.192:52912) 2024-09-13T18:40:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf01400640 1 -- 172.21.15.192:0/1568267867 learned_addr learned my addr 172.21.15.192:0/1568267867 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.819+0000 7fbf00a00640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbefc0afd80 0x7fbefc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbefbe00640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc146610 0x7fbefc06fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 -- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc146610 msgr2=0x7fbefc06fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc146610 0x7fbefc06fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 -- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbefc0afd80 msgr2=0x7fbefc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbefc0afd80 0x7fbefc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 -- 172.21.15.192:0/1568267867 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee8009400 con 0x7fbefc0700c0 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf01400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c790 tx=0x7fbef400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400cea0 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4003b70 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbefc070ee0 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.820+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef400a850 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.821+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbefc1573d0 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.822+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbefc071400 con 0x7fbefc0700c0 2024-09-13T18:40:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.822+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbef400a9b0 con 0x7fbefc0700c0 2024-09-13T18:40:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.823+0000 7fbef8c00640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 0x7fbedc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.823+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbef4089070 con 0x7fbefc0700c0 2024-09-13T18:40:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.823+0000 7fbf00a00640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 0x7fbedc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.824+0000 7fbf00a00640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 0x7fbedc06d0f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000f60 tx=0x7fbef0001670 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:03.827+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbef40bc9c0 con 0x7fbefc0700c0 2024-09-13T18:40:04.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.030+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbefc0ad840 con 0x7fbefc0700c0 2024-09-13T18:40:04.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.030+0000 7fbef8c00640 1 -- 172.21.15.192:0/1568267867 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbefc071400 con 0x7fbefc0700c0 2024-09-13T18:40:04.033 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 msgr2=0x7fbedc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 0x7fbedc06d0f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbef0000f60 tx=0x7fbef0001670 comp rx=0 tx=0).stop 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 msgr2=0x7fbefc157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fbef400c790 tx=0x7fbef400cc50 comp rx=0 tx=0).stop 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 shutdown_connections 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbedc06ac30 0x7fbedc06d0f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbefc0700c0 0x7fbefc157ab0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbefc146610 0x7fbefc06fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 --2- 172.21.15.192:0/1568267867 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbefc0afd80 0x7fbefc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 >> 172.21.15.192:0/1568267867 conn(0x7fbefc0ae960 msgr2=0x7fbefc15ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 shutdown_connections 2024-09-13T18:40:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:04.033+0000 7fbf03400640 1 -- 172.21.15.192:0/1568267867 wait complete. 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:40:04.051 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:40:04.052 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:40:04.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.052 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:40:04.088 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:40:04.088 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:40:04.088 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:40:04.089 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42510sec preferred_lft 42510sec 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.090 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:40:04.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.091 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:40:04.182 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:40:04.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.185 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:40:04.221 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:40:04.221 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:40:04.222 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:40:04.222 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:40:04.222 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:40:04.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:40:04.222 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:40:04.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.369 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:40:04.404 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:40:04.404 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:40:04.404 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:40:04.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:40:04.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:04.500 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:40:04.536 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:40:04.537 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:40:04.537 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:40:04.611 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:40:04.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.611 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:04.740 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:04.741 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:40:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:40:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:40:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:40:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:40:04.767 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:40:04.768 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:40:04.769 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:40:04.769 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:40:04.769 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:40:04.769 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:40:04.772 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:40:04.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.772 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:40:04.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:04.828 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:40:04.865 INFO:teuthology.orchestra.run.smithi194.stdout:client6337 2024-09-13T18:40:04.866 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:04.866 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:04.942 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:05.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.092+0000 7f4e6f600640 1 Processor -- start 2024-09-13T18:40:05.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.092+0000 7f4e6f600640 1 -- start start 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.093+0000 7f4e6f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e6815e790 0x7f4e680cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6f600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e6815bc20 0x7f4e680afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6f600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e68140480 con 0x7f4e680cacd0 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6f600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680cb5f0 con 0x7f4e6815bc20 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6815ebd0 con 0x7f4e6815e790 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e6815bc20 0x7f4e680afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e6815bc20 0x7f4e680afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52926/0 (socket says 172.21.15.192:52926) 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 -- 172.21.15.192:0/2645983059 learned_addr learned my addr 172.21.15.192:0/2645983059 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e5fe00640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e6815e790 0x7f4e680cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 -- 172.21.15.192:0/2645983059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e6815e790 msgr2=0x7f4e680cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e6815e790 0x7f4e680cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 -- 172.21.15.192:0/2645983059 >> v1:172.21.15.194:6789/0 conn(0x7f4e680cacd0 legacy=0x7f4e68140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.094+0000 7f4e6d600640 1 -- 172.21.15.192:0/2645983059 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6815ee90 con 0x7f4e6815bc20 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.095+0000 7f4e6d600640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815bc20 0x7f4e680afd80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e141978bad85ea04 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.095+0000 7f4e67e00640 1 -- 172.21.15.192:0/2645983059 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031600 con 0x7f4e6815bc20 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e67e00640 1 -- 172.21.15.192:0/2645983059 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6002d050 con 0x7f4e6815bc20 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e67e00640 1 -- 172.21.15.192:0/2645983059 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031980 con 0x7f4e6815bc20 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 -- 172.21.15.192:0/2645983059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815bc20 msgr2=0x7f4e680afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815bc20 0x7f4e680afd80 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f4e60009e50 tx=0x7f4e6002a710 comp rx=0 tx=0).stop 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 -- 172.21.15.192:0/2645983059 shutdown_connections 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815bc20 0x7f4e680afd80 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 --2- 172.21.15.192:0/2645983059 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e6815e790 0x7f4e680cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 -- 172.21.15.192:0/2645983059 >> 172.21.15.192:0/2645983059 conn(0x7f4e680ae960 msgr2=0x7f4e6806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 -- 172.21.15.192:0/2645983059 shutdown_connections 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.096+0000 7f4e6f600640 1 -- 172.21.15.192:0/2645983059 wait complete. 2024-09-13T18:40:05.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.098+0000 7f4e6f600640 1 Processor -- start 2024-09-13T18:40:05.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.098+0000 7f4e6f600640 1 -- start start 2024-09-13T18:40:05.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e680cacd0 0x7f4e680acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 0x7f4e681f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6813dae0 con 0x7f4e6815e790 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680ade60 con 0x7f4e6815bc20 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680ad250 con 0x7f4e680cacd0 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52938/0 (socket says 172.21.15.192:52938) 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6d600640 1 -- 172.21.15.192:0/3283625683 learned_addr learned my addr 172.21.15.192:0/3283625683 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6cc00640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e680cacd0 0x7f4e680acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e5fe00640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 0x7f4e681f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6d600640 1 -- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e680cacd0 msgr2=0x7f4e680acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.099+0000 7f4e6d600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e680cacd0 0x7f4e680acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6d600640 1 -- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 msgr2=0x7f4e681f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6d600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 0x7f4e681f0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6d600640 1 -- 172.21.15.192:0/3283625683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e60009b30 con 0x7f4e6815e790 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e5fe00640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 0x7f4e681f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:05.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6d600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4e60034040 tx=0x7f4e60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6003d860 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6003d9c0 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6003dd70 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e680ad530 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.100+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e680adaf0 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.101+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e680cb0b0 con 0x7f4e6815e790 2024-09-13T18:40:05.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.102+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e6003b400 con 0x7f4e6815e790 2024-09-13T18:40:05.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.103+0000 7f4e65600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 0x7f4e4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:05.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.103+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e600aa130 con 0x7f4e6815e790 2024-09-13T18:40:05.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.103+0000 7f4e6cc00640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 0x7f4e4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:05.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.104+0000 7f4e6cc00640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 0x7f4e4406d0c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000f60 tx=0x7f4e58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:05.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.108+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e60075320 con 0x7f4e6815e790 2024-09-13T18:40:05.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.308+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e6806c6c0 con 0x7f4e6815e790 2024-09-13T18:40:05.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.309+0000 7f4e65600640 1 -- 172.21.15.192:0/3283625683 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f4e60009510 con 0x7f4e6815e790 2024-09-13T18:40:05.312 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:05.312 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:05.312 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 msgr2=0x7f4e4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 0x7f4e4406d0c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4e58000f60 tx=0x7f4e58009040 comp rx=0 tx=0).stop 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 msgr2=0x7f4e6813d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4e60034040 tx=0x7f4e60004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 shutdown_connections 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e4406ac00 0x7f4e4406d0c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e6815e790 0x7f4e6813d5a0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e6815bc20 0x7f4e681f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 --2- 172.21.15.192:0/3283625683 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e680cacd0 0x7f4e680acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:05.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 >> 172.21.15.192:0/3283625683 conn(0x7f4e680ae960 msgr2=0x7f4e6815d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:05.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 shutdown_connections 2024-09-13T18:40:05.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:05.311+0000 7f4e6f600640 1 -- 172.21.15.192:0/3283625683 wait complete. 2024-09-13T18:40:05.329 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-13T18:40:05.499 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":6453,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.1939796359999999,"mdsmap_epoch":40,"osdmap_epoch":91,"osdmap_epoch_barrier":91,"uptime":13.864403083999999} 2024-09-13T18:40:05.499 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 6453, "mdsmap_epoch": 40, "osdmap_epoch": 91, "osdmap_epoch_barrier": 91, "rank_uptime": 9.193979636, "state": "up:active", "uptime": 13.864403084, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:40:05.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:40:05.667 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:40:05.668 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:40:05.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-13T18:40:05.828 INFO:teuthology.orchestra.run.smithi192.stdout:{"mon_tick_interval":"5"} 2024-09-13T18:40:05.829 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-13T18:40:05.829 INFO:tasks.cephfs.test_full:pool capacity 557012544, 531MB should be enough to fill it 2024-09-13T18:40:05.829 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:40:05.829 DEBUG:teuthology.orchestra.run.smithi192:> import time 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> import datetime 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> # Write some buffered data through before going full, all should be well 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> print("writing some data through which we expect to succeed") 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> bytes = 0 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.830 DEBUG:teuthology.orchestra.run.smithi192:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> # buffered IO, the error should always only appear from fsync and not 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> # from write 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> full = False 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(531 * 1.1)): 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:40:05.831 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> except OSError as e: 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> if False: 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> raise 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> full = True 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> break 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed successfully") 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> except OSError as e: 2024-09-13T18:40:05.832 DEBUG:teuthology.orchestra.run.smithi192:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> full = True 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> break 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> if n > 531 * 0.9: 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> # Be cautious in the last region where we expect to hit 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-13T18:40:05.833 DEBUG:teuthology.orchestra.run.smithi192:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(15.0) 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> if not full: 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> # close() should not raise an error because we already caught it in 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> # since then because all IOs got cancelled on the full flag. 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> print("calling close") 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> print("close() did not raise error") 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-13T18:40:05.834 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:writing some data through which we expect to succeed 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 1.00 MB 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 2.00 MB 2024-09-13T18:40:07.193 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 3.00 MB 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 4.00 MB 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 5.00 MB 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 6.00 MB 2024-09-13T18:40:07.194 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 7.00 MB 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 8.00 MB 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 9.00 MB 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 10.00 MB 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.195 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 11.00 MB 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 12.00 MB 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 13.00 MB 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.196 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 14.00 MB 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 15.00 MB 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 16.00 MB 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 17.00 MB 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.197 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 18.00 MB 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 19.00 MB 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 20.00 MB 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 21.00 MB 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 22.00 MB 2024-09-13T18:40:07.198 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 23.00 MB 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 24.00 MB 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 25.00 MB 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 26.00 MB 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.199 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 27.00 MB 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 28.00 MB 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 29.00 MB 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 30.00 MB 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 31.00 MB 2024-09-13T18:40:07.200 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 32.00 MB 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 33.00 MB 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 34.00 MB 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 35.00 MB 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.201 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 36.00 MB 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 37.00 MB 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 38.00 MB 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 39.00 MB 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 40.00 MB 2024-09-13T18:40:07.202 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 41.00 MB 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 42.00 MB 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 43.00 MB 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.203 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 44.00 MB 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 45.00 MB 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 46.00 MB 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 47.00 MB 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 48.00 MB 2024-09-13T18:40:07.204 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 49.00 MB 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 50.00 MB 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 51.00 MB 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 52.00 MB 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 53.00 MB 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 54.00 MB 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 55.00 MB 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 56.00 MB 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 57.00 MB 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.206 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 58.00 MB 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 59.00 MB 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 60.00 MB 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 61.00 MB 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 62.00 MB 2024-09-13T18:40:07.207 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 63.00 MB 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 64.00 MB 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 65.00 MB 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 66.00 MB 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.208 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 67.00 MB 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 68.00 MB 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 69.00 MB 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 70.00 MB 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 71.00 MB 2024-09-13T18:40:07.209 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 72.00 MB 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 73.00 MB 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 74.00 MB 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 75.00 MB 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.210 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 76.00 MB 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 77.00 MB 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 78.00 MB 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 79.00 MB 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.211 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 80.00 MB 2024-09-13T18:40:07.320 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:40:07.325 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:40:07.724 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.724 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.724 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 81.00 MB 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 82.00 MB 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 83.00 MB 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 84.00 MB 2024-09-13T18:40:07.725 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 85.00 MB 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 86.00 MB 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 87.00 MB 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.726 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 88.00 MB 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 89.00 MB 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 90.00 MB 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.727 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 91.00 MB 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 92.00 MB 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 93.00 MB 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 94.00 MB 2024-09-13T18:40:07.728 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 95.00 MB 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 96.00 MB 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 97.00 MB 2024-09-13T18:40:07.729 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 98.00 MB 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 99.00 MB 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 100.00 MB 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 101.00 MB 2024-09-13T18:40:07.730 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 102.00 MB 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 103.00 MB 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 104.00 MB 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 105.00 MB 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.731 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 106.00 MB 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 107.00 MB 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 108.00 MB 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 109.00 MB 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.732 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 110.00 MB 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 111.00 MB 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 112.00 MB 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 113.00 MB 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.733 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 114.00 MB 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 115.00 MB 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 116.00 MB 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 117.00 MB 2024-09-13T18:40:07.734 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 118.00 MB 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 119.00 MB 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 120.00 MB 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.735 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 121.00 MB 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 122.00 MB 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 123.00 MB 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 124.00 MB 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 125.00 MB 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.736 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 126.00 MB 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 127.00 MB 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 128.00 MB 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 129.00 MB 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.737 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 130.00 MB 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 131.00 MB 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 132.00 MB 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 133.00 MB 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.738 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 134.00 MB 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 135.00 MB 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 136.00 MB 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.739 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 137.00 MB 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 138.00 MB 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 139.00 MB 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.740 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 140.00 MB 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 141.00 MB 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 142.00 MB 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 143.00 MB 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.741 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 144.00 MB 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 145.00 MB 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 146.00 MB 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 147.00 MB 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 148.00 MB 2024-09-13T18:40:07.742 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 149.00 MB 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 150.00 MB 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 151.00 MB 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.743 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 152.00 MB 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 153.00 MB 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 154.00 MB 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 155.00 MB 2024-09-13T18:40:07.744 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 156.00 MB 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 157.00 MB 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 158.00 MB 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.745 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 159.00 MB 2024-09-13T18:40:07.746 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:07.746 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:07.746 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 160.00 MB 2024-09-13T18:40:07.746 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 161.00 MB 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 162.00 MB 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 163.00 MB 2024-09-13T18:40:08.248 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 164.00 MB 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 165.00 MB 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 166.00 MB 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 167.00 MB 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.249 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 168.00 MB 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 169.00 MB 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 170.00 MB 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 171.00 MB 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 172.00 MB 2024-09-13T18:40:08.250 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 173.00 MB 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 174.00 MB 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 175.00 MB 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 176.00 MB 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.251 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 177.00 MB 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 178.00 MB 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 179.00 MB 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.252 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 180.00 MB 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 181.00 MB 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 182.00 MB 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 183.00 MB 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.253 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 184.00 MB 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 185.00 MB 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 186.00 MB 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 187.00 MB 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 188.00 MB 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.254 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 189.00 MB 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 190.00 MB 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 191.00 MB 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 192.00 MB 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.255 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 193.00 MB 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 194.00 MB 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 195.00 MB 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 196.00 MB 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 197.00 MB 2024-09-13T18:40:08.256 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 198.00 MB 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 199.00 MB 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 200.00 MB 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 201.00 MB 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.257 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 202.00 MB 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 203.00 MB 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 204.00 MB 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 205.00 MB 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 206.00 MB 2024-09-13T18:40:08.258 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 207.00 MB 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 208.00 MB 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 209.00 MB 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 210.00 MB 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.259 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 211.00 MB 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 212.00 MB 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 213.00 MB 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 214.00 MB 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 215.00 MB 2024-09-13T18:40:08.260 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 216.00 MB 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 217.00 MB 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 218.00 MB 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 219.00 MB 2024-09-13T18:40:08.261 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 220.00 MB 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 221.00 MB 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 222.00 MB 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 223.00 MB 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.262 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 224.00 MB 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 225.00 MB 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 226.00 MB 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 227.00 MB 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.263 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 228.00 MB 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 229.00 MB 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 230.00 MB 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 231.00 MB 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 232.00 MB 2024-09-13T18:40:08.264 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 233.00 MB 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 234.00 MB 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 235.00 MB 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 236.00 MB 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.265 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 237.00 MB 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 238.00 MB 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 239.00 MB 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 240.00 MB 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.266 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.771 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 241.00 MB 2024-09-13T18:40:08.771 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.771 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.771 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 242.00 MB 2024-09-13T18:40:08.771 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 243.00 MB 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 244.00 MB 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 245.00 MB 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 246.00 MB 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.772 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 247.00 MB 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 248.00 MB 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 249.00 MB 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 250.00 MB 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.773 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 251.00 MB 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 252.00 MB 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 253.00 MB 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 254.00 MB 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 255.00 MB 2024-09-13T18:40:08.774 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 256.00 MB 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 257.00 MB 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 258.00 MB 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 259.00 MB 2024-09-13T18:40:08.775 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 260.00 MB 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 261.00 MB 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 262.00 MB 2024-09-13T18:40:08.776 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 263.00 MB 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 264.00 MB 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 265.00 MB 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 266.00 MB 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.777 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 267.00 MB 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 268.00 MB 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 269.00 MB 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 270.00 MB 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 271.00 MB 2024-09-13T18:40:08.778 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 272.00 MB 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 273.00 MB 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 274.00 MB 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 275.00 MB 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.779 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 276.00 MB 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 277.00 MB 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 278.00 MB 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 279.00 MB 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 280.00 MB 2024-09-13T18:40:08.780 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 281.00 MB 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 282.00 MB 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 283.00 MB 2024-09-13T18:40:08.781 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 284.00 MB 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 285.00 MB 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 286.00 MB 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 287.00 MB 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.782 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 288.00 MB 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 289.00 MB 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 290.00 MB 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 291.00 MB 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 292.00 MB 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 293.00 MB 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 294.00 MB 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 295.00 MB 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 296.00 MB 2024-09-13T18:40:08.784 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 297.00 MB 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 298.00 MB 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 299.00 MB 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 300.00 MB 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.785 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 301.00 MB 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 302.00 MB 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 303.00 MB 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 304.00 MB 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 305.00 MB 2024-09-13T18:40:08.786 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 306.00 MB 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 307.00 MB 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 308.00 MB 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 309.00 MB 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.787 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 310.00 MB 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 311.00 MB 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 312.00 MB 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 313.00 MB 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 314.00 MB 2024-09-13T18:40:08.788 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 315.00 MB 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 316.00 MB 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 317.00 MB 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 318.00 MB 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.789 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 319.00 MB 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 320.00 MB 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:08.790 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 321.00 MB 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 322.00 MB 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 323.00 MB 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 324.00 MB 2024-09-13T18:40:09.272 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 325.00 MB 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 326.00 MB 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 327.00 MB 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 328.00 MB 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.273 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 329.00 MB 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 330.00 MB 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 331.00 MB 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 332.00 MB 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 333.00 MB 2024-09-13T18:40:09.274 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 334.00 MB 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 335.00 MB 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 336.00 MB 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 337.00 MB 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.275 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 338.00 MB 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 339.00 MB 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 340.00 MB 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 341.00 MB 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.276 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 342.00 MB 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 343.00 MB 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 344.00 MB 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 345.00 MB 2024-09-13T18:40:09.277 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 346.00 MB 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 347.00 MB 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 348.00 MB 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 349.00 MB 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.278 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 350.00 MB 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 351.00 MB 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 352.00 MB 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.279 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 353.00 MB 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 354.00 MB 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 355.00 MB 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 356.00 MB 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 357.00 MB 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.280 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 358.00 MB 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 359.00 MB 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 360.00 MB 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.281 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 361.00 MB 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 362.00 MB 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 363.00 MB 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 364.00 MB 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.282 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 365.00 MB 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 366.00 MB 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 367.00 MB 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 368.00 MB 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.283 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 369.00 MB 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 370.00 MB 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 371.00 MB 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 372.00 MB 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.284 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 373.00 MB 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 374.00 MB 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 375.00 MB 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 376.00 MB 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.285 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 377.00 MB 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 378.00 MB 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 379.00 MB 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 380.00 MB 2024-09-13T18:40:09.286 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 381.00 MB 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 382.00 MB 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 383.00 MB 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.287 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 384.00 MB 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 385.00 MB 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 386.00 MB 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.288 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 387.00 MB 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 388.00 MB 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 389.00 MB 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.289 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 390.00 MB 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 391.00 MB 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 392.00 MB 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.290 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 393.00 MB 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 394.00 MB 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 395.00 MB 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 396.00 MB 2024-09-13T18:40:09.291 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 397.00 MB 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 398.00 MB 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 399.00 MB 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 400.00 MB 2024-09-13T18:40:09.292 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:09.293 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:09.293 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 401.00 MB 2024-09-13T18:40:11.854 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:40:11.851+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-13T18:40:21.804 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:40:21.802+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-13T18:40:34.934 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:40:34.932+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2024-09-13T18:40:37.451 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:40:37.456 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 402.00 MB 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 403.00 MB 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.857 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 404.00 MB 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 405.00 MB 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 406.00 MB 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 407.00 MB 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.858 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 408.00 MB 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 409.00 MB 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 410.00 MB 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 411.00 MB 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.859 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 412.00 MB 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 413.00 MB 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 414.00 MB 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 415.00 MB 2024-09-13T18:40:39.860 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 416.00 MB 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 417.00 MB 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 418.00 MB 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.861 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 419.00 MB 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 420.00 MB 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 421.00 MB 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 422.00 MB 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 423.00 MB 2024-09-13T18:40:39.862 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 424.00 MB 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 425.00 MB 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 426.00 MB 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.863 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 427.00 MB 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 428.00 MB 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 429.00 MB 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 430.00 MB 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 431.00 MB 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.864 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 432.00 MB 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 433.00 MB 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 434.00 MB 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 435.00 MB 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.865 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 436.00 MB 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 437.00 MB 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 438.00 MB 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 439.00 MB 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 440.00 MB 2024-09-13T18:40:39.866 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 441.00 MB 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 442.00 MB 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 443.00 MB 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 444.00 MB 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.867 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 445.00 MB 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 446.00 MB 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 447.00 MB 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 448.00 MB 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 449.00 MB 2024-09-13T18:40:39.868 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 450.00 MB 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 451.00 MB 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 452.00 MB 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 453.00 MB 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.869 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 454.00 MB 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 455.00 MB 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 456.00 MB 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 457.00 MB 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.870 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 458.00 MB 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 459.00 MB 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 460.00 MB 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 461.00 MB 2024-09-13T18:40:39.871 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 462.00 MB 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 463.00 MB 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 464.00 MB 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 465.00 MB 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.872 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 466.00 MB 2024-09-13T18:40:39.873 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.873 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.873 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 467.00 MB 2024-09-13T18:40:39.873 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.876 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.876 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 468.00 MB 2024-09-13T18:40:39.876 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.876 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 469.00 MB 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 470.00 MB 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 471.00 MB 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 472.00 MB 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.877 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 473.00 MB 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 474.00 MB 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 475.00 MB 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 476.00 MB 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.878 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 477.00 MB 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 478.00 MB 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 479.00 MB 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 480.00 MB 2024-09-13T18:40:39.879 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:40:39.943 INFO:teuthology.orchestra.run.smithi192.stdout:Reached fullness after 480.00 MB 2024-09-13T18:40:39.943 INFO:teuthology.orchestra.run.smithi192.stdout:calling close 2024-09-13T18:40:39.943 INFO:teuthology.orchestra.run.smithi192.stdout:close() did not raise error 2024-09-13T18:40:39.969 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:40:39.970 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:40:40.065 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:40:40.157 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:40:40.157 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:40.157 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:40.193 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:40.193 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:40.268 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:40.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.458+0000 7fc329400640 1 Processor -- start 2024-09-13T18:40:40.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.458+0000 7fc329400640 1 -- start start 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.459+0000 7fc329400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc3240b3600 0x7fc3240b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.459+0000 7fc329400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc32406bca0 0x7fc32406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.459+0000 7fc329400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc32406f830 con 0x7fc3241592d0 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.459+0000 7fc329400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc324071230 con 0x7fc32406bca0 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.459+0000 7fc329400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240b3fb0 con 0x7fc3240b3600 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc32406bca0 0x7fc32406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc32406bca0 0x7fc32406c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33290/0 (socket says 172.21.15.192:33290) 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 -- 172.21.15.192:0/1952287084 learned_addr learned my addr 172.21.15.192:0/1952287084 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc323400640 1 --2- 172.21.15.192:0/1952287084 >> v2:172.21.15.194:3300/0 conn(0x7fc3240b3600 0x7fc3240b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 -- 172.21.15.192:0/1952287084 >> v2:172.21.15.194:3300/0 conn(0x7fc3240b3600 msgr2=0x7fc3240b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 --2- 172.21.15.192:0/1952287084 >> v2:172.21.15.194:3300/0 conn(0x7fc3240b3600 0x7fc3240b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 -- 172.21.15.192:0/1952287084 >> v1:172.21.15.194:6789/0 conn(0x7fc3241592d0 legacy=0x7fc324070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.460+0000 7fc328a00640 1 -- 172.21.15.192:0/1952287084 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32406fa80 con 0x7fc32406bca0 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.461+0000 7fc328a00640 1 --2- 172.21.15.192:0/1952287084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc32406c0d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc32406cc90 tx=0x7fc31c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15749beddf803475 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.461+0000 7fc322a00640 1 -- 172.21.15.192:0/1952287084 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c031600 con 0x7fc32406bca0 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.461+0000 7fc322a00640 1 -- 172.21.15.192:0/1952287084 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c02d050 con 0x7fc32406bca0 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.461+0000 7fc322a00640 1 -- 172.21.15.192:0/1952287084 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c031980 con 0x7fc32406bca0 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 -- 172.21.15.192:0/1952287084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 msgr2=0x7fc32406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 --2- 172.21.15.192:0/1952287084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc32406c0d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fc32406cc90 tx=0x7fc31c02a710 comp rx=0 tx=0).stop 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 -- 172.21.15.192:0/1952287084 shutdown_connections 2024-09-13T18:40:40.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 --2- 172.21.15.192:0/1952287084 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc32406c0d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 --2- 172.21.15.192:0/1952287084 >> v2:172.21.15.194:3300/0 conn(0x7fc3240b3600 0x7fc3240b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 -- 172.21.15.192:0/1952287084 >> 172.21.15.192:0/1952287084 conn(0x7fc3240736d0 msgr2=0x7fc3240b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 -- 172.21.15.192:0/1952287084 shutdown_connections 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.462+0000 7fc329400640 1 -- 172.21.15.192:0/1952287084 wait complete. 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.464+0000 7fc329400640 1 Processor -- start 2024-09-13T18:40:40.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.464+0000 7fc329400640 1 -- start start 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 0x7fc324153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3241592d0 0x7fc3240afa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324151e30 con 0x7fc32406bca0 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc324151b50 con 0x7fc3240b3600 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc329400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc324150f70 con 0x7fc3241592d0 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33306/0 (socket says 172.21.15.192:33306) 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 -- 172.21.15.192:0/1265705321 learned_addr learned my addr 172.21.15.192:0/1265705321 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:40.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 0x7fc324153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc328a00640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3241592d0 0x7fc3240afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 -- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3241592d0 msgr2=0x7fc3240afa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3241592d0 0x7fc3240afa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 -- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 msgr2=0x7fc324153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 0x7fc324153d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c009b30 con 0x7fc32406bca0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 0x7fc324153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.465+0000 7fc323e00640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc31400b3f0 tx=0x7fc31400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.466+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011830 con 0x7fc32406bca0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.466+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc314011990 con 0x7fc32406bca0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.466+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc324151250 con 0x7fc32406bca0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.466+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc314011d40 con 0x7fc32406bca0 2024-09-13T18:40:40.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.466+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3240b01b0 con 0x7fc32406bca0 2024-09-13T18:40:40.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.467+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc324150db0 con 0x7fc32406bca0 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.468+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc31401a400 con 0x7fc32406bca0 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.468+0000 7fc31be00640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 0x7fc30406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.469+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc314088fe0 con 0x7fc32406bca0 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.469+0000 7fc323400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 0x7fc30406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.469+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fc3040728e0 con 0x7fc32406bca0 2024-09-13T18:40:40.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.469+0000 7fc323400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 0x7fc30406d0f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc324154fc0 tx=0x7fc310008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.473+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc314054150 con 0x7fc32406bca0 2024-09-13T18:40:40.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.642+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc3240b01b0 con 0x7fc32406bca0 2024-09-13T18:40:40.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.644+0000 7fc31be00640 1 -- 172.21.15.192:0/1265705321 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16849 (secure 0 0 0) 0x7fc3240b01b0 con 0x7fc32406bca0 2024-09-13T18:40:40.647 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:40.647 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":96,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:28.902399+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.5","mappings":[{"from":1,"to":7}]},{"pgid":"11.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 msgr2=0x7fc30406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 0x7fc30406d0f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc324154fc0 tx=0x7fc310008040 comp rx=0 tx=0).stop 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 msgr2=0x7fc324151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc31400b3f0 tx=0x7fc31400b8b0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 shutdown_connections 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc30406ac30 0x7fc30406d0f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc3241592d0 0x7fc3240afa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc3240b3600 0x7fc324153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 --2- 172.21.15.192:0/1265705321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc32406bca0 0x7fc324151530 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 >> 172.21.15.192:0/1265705321 conn(0x7fc3240736d0 msgr2=0x7fc3240ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 shutdown_connections 2024-09-13T18:40:40.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.646+0000 7fc329400640 1 -- 172.21.15.192:0/1265705321 wait complete. 2024-09-13T18:40:40.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:54.526138+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:55.272341+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:40.666 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:40.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.818+0000 7f0f4de00640 1 Processor -- start 2024-09-13T18:40:40.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.818+0000 7f0f4de00640 1 -- start start 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 0x7f0f4806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f4806b3d0 0x7f0f480cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4de00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4806c5d0 con 0x7f0f4806e990 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4de00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480b3730 con 0x7f0f4806b3d0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f480b3920 con 0x7f0f4815a9e0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f47e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f4806b3d0 0x7f0f480cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f47e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0f4806b3d0 0x7f0f480cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33310/0 (socket says 172.21.15.192:33310) 2024-09-13T18:40:40.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f47e00640 1 -- 172.21.15.192:0/2781483812 learned_addr learned my addr 172.21.15.192:0/2781483812 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.819+0000 7f0f4ca00640 1 --2- 172.21.15.192:0/2781483812 >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 0x7f0f4806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.820+0000 7f0f47e00640 1 -- 172.21.15.192:0/2781483812 >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 msgr2=0x7f0f4806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.820+0000 7f0f47e00640 1 --2- 172.21.15.192:0/2781483812 >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 0x7f0f4806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.820+0000 7f0f47e00640 1 -- 172.21.15.192:0/2781483812 >> v1:172.21.15.192:6789/0 conn(0x7f0f4806e990 legacy=0x7f0f48070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.820+0000 7f0f47e00640 1 -- 172.21.15.192:0/2781483812 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f480b3c00 con 0x7f0f4806b3d0 2024-09-13T18:40:40.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.820+0000 7f0f4ca00640 1 --2- 172.21.15.192:0/2781483812 >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 0x7f0f4806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f47e00640 1 --2- 172.21.15.192:0/2781483812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806b3d0 0x7f0f480cd8c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806cc90 tx=0x7f0f3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f75c5319bf56171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f47400640 1 -- 172.21.15.192:0/2781483812 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34032440 con 0x7f0f4806b3d0 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f47400640 1 -- 172.21.15.192:0/2781483812 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f340325a0 con 0x7f0f4806b3d0 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f47400640 1 -- 172.21.15.192:0/2781483812 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34032930 con 0x7f0f4806b3d0 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f4de00640 1 -- 172.21.15.192:0/2781483812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806b3d0 msgr2=0x7f0f480cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.821+0000 7f0f4de00640 1 --2- 172.21.15.192:0/2781483812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806b3d0 0x7f0f480cd8c0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f0f4806cc90 tx=0x7f0f3402a270 comp rx=0 tx=0).stop 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 -- 172.21.15.192:0/2781483812 shutdown_connections 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 --2- 172.21.15.192:0/2781483812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806b3d0 0x7f0f480cd8c0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 --2- 172.21.15.192:0/2781483812 >> v2:172.21.15.194:3300/0 conn(0x7f0f4815a9e0 0x7f0f4806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 -- 172.21.15.192:0/2781483812 >> 172.21.15.192:0/2781483812 conn(0x7f0f480736d0 msgr2=0x7f0f480b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:40.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 -- 172.21.15.192:0/2781483812 shutdown_connections 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.822+0000 7f0f4de00640 1 -- 172.21.15.192:0/2781483812 wait complete. 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.823+0000 7f0f4de00640 1 Processor -- start 2024-09-13T18:40:40.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.823+0000 7f0f4de00640 1 -- start start 2024-09-13T18:40:40.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4806b3d0 0x7f0f481533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4815a9e0 0x7f0f4815d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481538f0 con 0x7f0f4806e990 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f48156510 con 0x7f0f4806b3d0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f4de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f481f0140 con 0x7f0f4815a9e0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33326/0 (socket says 172.21.15.192:33326) 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.824+0000 7f0f47e00640 1 -- 172.21.15.192:0/3462708711 learned_addr learned my addr 172.21.15.192:0/3462708711 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f4ca00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4806b3d0 0x7f0f481533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f4d400640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4815a9e0 0x7f0f4815d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 -- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4815a9e0 msgr2=0x7f0f4815d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4815a9e0 0x7f0f4815d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 -- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4806b3d0 msgr2=0x7f0f481533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4806b3d0 0x7f0f481533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340094d0 con 0x7f0f4806e990 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f47e00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f3402a2b0 tx=0x7f0f340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34032440 con 0x7f0f4806e990 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f34030ba0 con 0x7f0f4806e990 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.825+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3403d440 con 0x7f0f4806e990 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.826+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f480b06e0 con 0x7f0f4806e990 2024-09-13T18:40:40.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.826+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f48155f50 con 0x7f0f4806e990 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.827+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f480ce6c0 con 0x7f0f4806e990 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.827+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f34039040 con 0x7f0f4806e990 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.828+0000 7f0f44c00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 0x7f0f2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.828+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0f340a9ff0 con 0x7f0f4806e990 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.829+0000 7f0f4ca00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 0x7f0f2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:40.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.829+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f0f280728b0 con 0x7f0f4806e990 2024-09-13T18:40:40.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.829+0000 7f0f4ca00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 0x7f0f2806d0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006fd0 tx=0x7f0f38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:40.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:40.833+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f340dd9c0 con 0x7f0f4806e990 2024-09-13T18:40:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.003+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f480b0be0 con 0x7f0f4806e990 2024-09-13T18:40:41.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.004+0000 7f0f44c00640 1 -- 172.21.15.192:0/3462708711 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f34037070 con 0x7f0f4806e990 2024-09-13T18:40:41.007 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:40:41.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 msgr2=0x7f0f2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 0x7f0f2806d0c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0f38006fd0 tx=0x7f0f38008040 comp rx=0 tx=0).stop 2024-09-13T18:40:41.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 msgr2=0x7f0f481efc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0f3402a2b0 tx=0x7f0f340046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 shutdown_connections 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2806ac00 0x7f0f2806d0c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f4815a9e0 0x7f0f4815d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4806e990 0x7f0f481efc00 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 --2- 172.21.15.192:0/3462708711 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4806b3d0 0x7f0f481533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 >> 172.21.15.192:0/3462708711 conn(0x7f0f480736d0 msgr2=0x7f0f480cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 shutdown_connections 2024-09-13T18:40:41.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.006+0000 7f0f4de00640 1 -- 172.21.15.192:0/3462708711 wait complete. 2024-09-13T18:40:41.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:40:41.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.176+0000 7f6879800640 1 Processor -- start 2024-09-13T18:40:41.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.176+0000 7f6879800640 1 -- start start 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6879800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68740b1cf0 0x7f68740cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6879800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740b2180 0x7f68740ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6879800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f687415a8e0 con 0x7f68740cb330 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6879800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68740b2fe0 con 0x7f68740b1cf0 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6879800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68740ce9e0 con 0x7f68740b2180 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68740b1cf0 0x7f68740cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f68740b1cf0 0x7f68740cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33342/0 (socket says 172.21.15.192:33342) 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 -- 172.21.15.192:0/2846722145 learned_addr learned my addr 172.21.15.192:0/2846722145 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6873400640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740b2180 0x7f68740ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 -- 172.21.15.192:0/2846722145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740b2180 msgr2=0x7f68740ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740b2180 0x7f68740ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 -- 172.21.15.192:0/2846722145 >> v1:172.21.15.194:6789/0 conn(0x7f68740cb330 legacy=0x7f687406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f686a000640 1 -- 172.21.15.192:0/2846722145 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68740b26b0 con 0x7f68740b1cf0 2024-09-13T18:40:41.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.178+0000 7f6872000640 1 -- 172.21.15.192:0/2846722145 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1436136251 0 0) 0x7f687415a8e0 con 0x7f68740cb330 2024-09-13T18:40:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.179+0000 7f686a000640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f68740cdf60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f685c009870 tx=0x7f685c02a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37090b8789c0aad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6872000640 1 -- 172.21.15.192:0/2846722145 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c02ae80 con 0x7f68740b1cf0 2024-09-13T18:40:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6872000640 1 -- 172.21.15.192:0/2846722145 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f685c032440 con 0x7f68740b1cf0 2024-09-13T18:40:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6872000640 1 -- 172.21.15.192:0/2846722145 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f685c0327b0 con 0x7f68740b1cf0 2024-09-13T18:40:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 -- 172.21.15.192:0/2846722145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 msgr2=0x7f68740cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f68740cdf60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f685c009870 tx=0x7f685c02a130 comp rx=0 tx=0).stop 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 -- 172.21.15.192:0/2846722145 shutdown_connections 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740b2180 0x7f68740ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 --2- 172.21.15.192:0/2846722145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f68740cdf60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 -- 172.21.15.192:0/2846722145 >> 172.21.15.192:0/2846722145 conn(0x7f68740b08f0 msgr2=0x7f68740b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 -- 172.21.15.192:0/2846722145 shutdown_connections 2024-09-13T18:40:41.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.180+0000 7f6879800640 1 -- 172.21.15.192:0/2846722145 wait complete. 2024-09-13T18:40:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.182+0000 7f6879800640 1 Processor -- start 2024-09-13T18:40:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.182+0000 7f6879800640 1 -- start start 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 0x7f68741586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 0x7f6874158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6874155380 con 0x7f68740b1cf0 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f687414db40 con 0x7f68740b2180 2024-09-13T18:40:41.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6879800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6874154d30 con 0x7f68740cb330 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6872a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6872a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33350/0 (socket says 172.21.15.192:33350) 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.183+0000 7f6872a00640 1 -- 172.21.15.192:0/4282053598 learned_addr learned my addr 172.21.15.192:0/4282053598 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f686a000640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 0x7f68741586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 -- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 msgr2=0x7f6874158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6873400640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 0x7f6874158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 0x7f6874158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 -- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 msgr2=0x7f68741586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 0x7f68741586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c0094d0 con 0x7f68740b1cf0 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f686a000640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 0x7f68741586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:41.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6873400640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 0x7f6874158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6872a00640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f686400c3c0 tx=0x7f686400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68640035f0 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6864003770 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6874155010 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.184+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6864003b20 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.185+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f687413ec00 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.186+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f687406ac00 con 0x7f68740b1cf0 2024-09-13T18:40:41.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.186+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6864003c80 con 0x7f68740b1cf0 2024-09-13T18:40:41.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.187+0000 7f686b400640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.187+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f68640888e0 con 0x7f68740b1cf0 2024-09-13T18:40:41.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.188+0000 7f686a000640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.188+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f68500728b0 con 0x7f68740b1cf0 2024-09-13T18:40:41.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.188+0000 7f686a000640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f685c034000 tx=0x7f685c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.191+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6864017020 con 0x7f68740b1cf0 2024-09-13T18:40:41.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.359+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68740caea0 con 0x7f68740b1cf0 2024-09-13T18:40:41.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.359+0000 7f686b400640 1 -- 172.21.15.192:0/4282053598 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6864053ad0 con 0x7f68740b1cf0 2024-09-13T18:40:41.362 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:40:41.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.361+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 msgr2=0x7f685006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.361+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f685c034000 tx=0x7f685c02e000 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 msgr2=0x7f687413e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f686400c3c0 tx=0x7f686400c880 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 shutdown_connections 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f685006ac00 0x7f685006d0c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f68740cb330 0x7f6874158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68740b2180 0x7f68741586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 --2- 172.21.15.192:0/4282053598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68740b1cf0 0x7f687413e6c0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 >> 172.21.15.192:0/4282053598 conn(0x7f68740b08f0 msgr2=0x7f687406b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 shutdown_connections 2024-09-13T18:40:41.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.362+0000 7f6879800640 1 -- 172.21.15.192:0/4282053598 wait complete. 2024-09-13T18:40:41.380 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:40:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.531+0000 7f2393e00640 1 Processor -- start 2024-09-13T18:40:41.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.531+0000 7f2393e00640 1 -- start start 2024-09-13T18:40:41.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2393e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23940b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2393e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239406f940 con 0x7f2394142e00 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2393e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23940b32d0 con 0x7f23940b02f0 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2393e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239406f610 con 0x7f23940b4910 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2392a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2394142e00 0x7f23940afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49496/0 (socket says 172.21.15.192:49496) 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2392a00640 1 -- 172.21.15.192:0/4288728722 learned_addr learned my addr 172.21.15.192:0/4288728722 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:41.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2393400640 1 --2- 172.21.15.192:0/4288728722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23940b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3538785829 0 0) 0x7f239406f940 con 0x7f2394142e00 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.533+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2378005730 con 0x7f2394142e00 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.534+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3604058735 0 0) 0x7f23940b32d0 con 0x7f23940b02f0 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.534+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f239406f940 con 0x7f23940b02f0 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.534+0000 7f2393400640 1 -- 172.21.15.192:0/4288728722 >> v1:172.21.15.194:6789/0 conn(0x7f23940b02f0 legacy=0x7f239406fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.534+0000 7f2393400640 1 -- 172.21.15.192:0/4288728722 >> v1:172.21.15.192:6789/0 conn(0x7f2394142e00 legacy=0x7f23940afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.534+0000 7f2393400640 1 -- 172.21.15.192:0/4288728722 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23940b3530 con 0x7f23940b4910 2024-09-13T18:40:41.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2393400640 1 --2- 172.21.15.192:0/4288728722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23940b2d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097d0 tx=0x7f238c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5ca6ecc833a6a75 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c032440 con 0x7f23940b4910 2024-09-13T18:40:41.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c0325a0 con 0x7f23940b4910 2024-09-13T18:40:41.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2391600640 1 -- 172.21.15.192:0/4288728722 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c032910 con 0x7f23940b4910 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2393e00640 1 -- 172.21.15.192:0/4288728722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 msgr2=0x7f23940b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.535+0000 7f2393e00640 1 --2- 172.21.15.192:0/4288728722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23940b2d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f238c0097d0 tx=0x7f238c02a210 comp rx=0 tx=0).stop 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.536+0000 7f2393e00640 1 -- 172.21.15.192:0/4288728722 shutdown_connections 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.536+0000 7f2393e00640 1 --2- 172.21.15.192:0/4288728722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23940b2d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.536+0000 7f2393e00640 1 -- 172.21.15.192:0/4288728722 >> 172.21.15.192:0/4288728722 conn(0x7f23940ae7f0 msgr2=0x7f239406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.536+0000 7f2393e00640 1 -- 172.21.15.192:0/4288728722 shutdown_connections 2024-09-13T18:40:41.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.536+0000 7f2393e00640 1 -- 172.21.15.192:0/4288728722 wait complete. 2024-09-13T18:40:41.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.537+0000 7f2393e00640 1 Processor -- start 2024-09-13T18:40:41.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.537+0000 7f2393e00640 1 -- start start 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23940b02f0 0x7f239413c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23941416a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239413b660 con 0x7f2394142e00 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239413b940 con 0x7f23940b02f0 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239413bc20 con 0x7f23940b4910 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.538+0000 7f2393400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33364/0 (socket says 172.21.15.192:33364) 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 -- 172.21.15.192:0/3659780142 learned_addr learned my addr 172.21.15.192:0/3659780142 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:41.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2392a00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23940b02f0 0x7f239413c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2392000640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23941416a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 -- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 msgr2=0x7f23941416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23941416a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 -- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23940b02f0 msgr2=0x7f239413c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23940b02f0 0x7f239413c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009400 con 0x7f2394142e00 2024-09-13T18:40:41.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f2393400640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f238c02a250 tx=0x7f238c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.539+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c03e860 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.540+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c03e9c0 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.540+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c03ed50 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.540+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2394143360 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.540+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239413c1e0 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.541+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239415dd10 con 0x7f2394142e00 2024-09-13T18:40:41.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.541+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f238c03c400 con 0x7f2394142e00 2024-09-13T18:40:41.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.542+0000 7f238aa00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 0x7f237406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.542+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f238c0aa1e0 con 0x7f2394142e00 2024-09-13T18:40:41.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.542+0000 7f2392a00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 0x7f237406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.543+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f23740728b0 con 0x7f2394142e00 2024-09-13T18:40:41.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.543+0000 7f2392a00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 0x7f237406d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23840012e0 tx=0x7f2384001ad0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.546+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f238c075350 con 0x7f2394142e00 2024-09-13T18:40:41.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.719+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f23940afbe0 con 0x7f2394142e00 2024-09-13T18:40:41.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.719+0000 7f238aa00640 1 -- 172.21.15.192:0/3659780142 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7f238c078970 con 0x7f2394142e00 2024-09-13T18:40:41.722 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.721+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 msgr2=0x7f237406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.721+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 0x7f237406d0c0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f23840012e0 tx=0x7f2384001ad0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.721+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 msgr2=0x7f2394158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.721+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f238c02a250 tx=0x7f238c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.721+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 shutdown_connections 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f237406ac00 0x7f237406d0c0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2394142e00 0x7f2394158d30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23940b4910 0x7f23941416a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 --2- 172.21.15.192:0/3659780142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23940b02f0 0x7f239413c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 >> 172.21.15.192:0/3659780142 conn(0x7f23940ae7f0 msgr2=0x7f23940cd2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 shutdown_connections 2024-09-13T18:40:41.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.722+0000 7f2393e00640 1 -- 172.21.15.192:0/3659780142 wait complete. 2024-09-13T18:40:41.740 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:40:41.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.890+0000 7fbe7d200640 1 Processor -- start 2024-09-13T18:40:41.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.890+0000 7fbe7d200640 1 -- start start 2024-09-13T18:40:41.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.891+0000 7fbe7d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.891+0000 7fbe7d200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe78140480 con 0x7fbe780cb0b0 2024-09-13T18:40:41.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.891+0000 7fbe7d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7815ee90 con 0x7fbe7815bc20 2024-09-13T18:40:41.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.891+0000 7fbe7d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7815f170 con 0x7fbe780cacd0 2024-09-13T18:40:41.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbe780cb0b0 0x7fbe78140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49502/0 (socket says 172.21.15.192:49502) 2024-09-13T18:40:41.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75400640 1 -- 172.21.15.192:0/253024358 learned_addr learned my addr 172.21.15.192:0/253024358 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:41.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75e00640 1 --2- 172.21.15.192:0/253024358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236373579 0 0) 0x7fbe78140480 con 0x7fbe780cb0b0 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c003520 con 0x7fbe780cb0b0 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433602351 0 0) 0x7fbe7815ee90 con 0x7fbe7815bc20 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe78140480 con 0x7fbe7815bc20 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75e00640 1 -- 172.21.15.192:0/253024358 >> v1:172.21.15.194:6789/0 conn(0x7fbe7815bc20 legacy=0x7fbe780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75e00640 1 -- 172.21.15.192:0/253024358 >> v1:172.21.15.192:6789/0 conn(0x7fbe780cb0b0 legacy=0x7fbe78140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.892+0000 7fbe75e00640 1 -- 172.21.15.192:0/253024358 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7815f450 con 0x7fbe780cacd0 2024-09-13T18:40:41.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe75e00640 1 --2- 172.21.15.192:0/253024358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7815e790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe680097d0 tx=0x7fbe6802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5023b4806fb14772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68032440 con 0x7fbe780cacd0 2024-09-13T18:40:41.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe680325a0 con 0x7fbe780cacd0 2024-09-13T18:40:41.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe74a00640 1 -- 172.21.15.192:0/253024358 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe68032930 con 0x7fbe780cacd0 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe7d200640 1 -- 172.21.15.192:0/253024358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 msgr2=0x7fbe7815e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.894+0000 7fbe7d200640 1 --2- 172.21.15.192:0/253024358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7815e790 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbe680097d0 tx=0x7fbe6802a210 comp rx=0 tx=0).stop 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.895+0000 7fbe7d200640 1 -- 172.21.15.192:0/253024358 shutdown_connections 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.895+0000 7fbe7d200640 1 --2- 172.21.15.192:0/253024358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7815e790 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.895+0000 7fbe7d200640 1 -- 172.21.15.192:0/253024358 >> 172.21.15.192:0/253024358 conn(0x7fbe780ae960 msgr2=0x7fbe7806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.895+0000 7fbe7d200640 1 -- 172.21.15.192:0/253024358 shutdown_connections 2024-09-13T18:40:41.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.895+0000 7fbe7d200640 1 -- 172.21.15.192:0/253024358 wait complete. 2024-09-13T18:40:41.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.896+0000 7fbe7d200640 1 Processor -- start 2024-09-13T18:40:41.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.896+0000 7fbe7d200640 1 -- start start 2024-09-13T18:40:41.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7806bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 0x7fbe78069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe781f0960 con 0x7fbe780cb0b0 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7806c180 con 0x7fbe7815bc20 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe7d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78157c70 con 0x7fbe780cacd0 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.897+0000 7fbe75400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33374/0 (socket says 172.21.15.192:33374) 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 -- 172.21.15.192:0/2755147370 learned_addr learned my addr 172.21.15.192:0/2755147370 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75e00640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7806bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe76800640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 0x7fbe78069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 -- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 msgr2=0x7fbe7806bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7806bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 -- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 msgr2=0x7fbe78069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 0x7fbe78069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:41.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009400 con 0x7fbe780cb0b0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75e00640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe76800640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 0x7fbe78069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe75400640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c4d0 tx=0x7fbe6400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64005ce0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe64005e40 con 0x7fbe780cb0b0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe64007270 con 0x7fbe780cb0b0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.898+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7806b8b0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.899+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe781f46a0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.900+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe781f0ad0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.901+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe640073d0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.902+0000 7fbe6e000640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:41.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.902+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbe640889a0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.902+0000 7fbe75e00640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:41.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.902+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fbe580728b0 con 0x7fbe780cb0b0 2024-09-13T18:40:41.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.903+0000 7fbe75e00640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 0x7fbe5806d0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbe68034000 tx=0x7fbe6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:41.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:41.907+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe64017020 con 0x7fbe780cb0b0 2024-09-13T18:40:42.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.092+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbe7815e790 con 0x7fbe780cb0b0 2024-09-13T18:40:42.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.093+0000 7fbe6e000640 1 -- 172.21.15.192:0/2755147370 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbe640575a0 con 0x7fbe780cb0b0 2024-09-13T18:40:42.096 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:40:42.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 msgr2=0x7fbe5806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 0x7fbe5806d0c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbe68034000 tx=0x7fbe6802e000 comp rx=0 tx=0).stop 2024-09-13T18:40:42.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 msgr2=0x7fbe78157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c4d0 tx=0x7fbe6400c990 comp rx=0 tx=0).stop 2024-09-13T18:40:42.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 shutdown_connections 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe5806ac00 0x7fbe5806d0c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe7815bc20 0x7fbe78069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe780cb0b0 0x7fbe78157730 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 --2- 172.21.15.192:0/2755147370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe780cacd0 0x7fbe7806bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 >> 172.21.15.192:0/2755147370 conn(0x7fbe780ae960 msgr2=0x7fbe78140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 shutdown_connections 2024-09-13T18:40:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.095+0000 7fbe7d200640 1 -- 172.21.15.192:0/2755147370 wait complete. 2024-09-13T18:40:42.113 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:40:42.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.114 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:40:42.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:40:42.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:42.176 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:40:42.211 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:42.211 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:42.251 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:42.251 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:42.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:42.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.546+0000 7fbdc1a00640 1 Processor -- start 2024-09-13T18:40:42.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.546+0000 7fbdc1a00640 1 -- start start 2024-09-13T18:40:42.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.547+0000 7fbdc1a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbdbc0cacd0 0x7fbdbc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdc1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdc1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc140480 con 0x7fbdbc140980 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdc1a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc15c160 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdc1a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc0cb520 con 0x7fbdbc0cacd0 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33382/0 (socket says 172.21.15.192:33382) 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdbb400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbdbc140980 0x7fbdbc0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49510/0 (socket says 172.21.15.192:49510) 2024-09-13T18:40:42.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdba000640 1 -- 172.21.15.192:0/1036729770 learned_addr learned my addr 172.21.15.192:0/1036729770 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/1036729770 >> v2:172.21.15.194:3300/0 conn(0x7fbdbc0cacd0 0x7fbdbc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdba000640 1 -- 172.21.15.192:0/1036729770 >> v2:172.21.15.194:3300/0 conn(0x7fbdbc0cacd0 msgr2=0x7fbdbc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.548+0000 7fbdba000640 1 --2- 172.21.15.192:0/1036729770 >> v2:172.21.15.194:3300/0 conn(0x7fbdbc0cacd0 0x7fbdbc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.549+0000 7fbdba000640 1 -- 172.21.15.192:0/1036729770 >> v1:172.21.15.192:6789/0 conn(0x7fbdbc140980 legacy=0x7fbdbc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.549+0000 7fbdba000640 1 -- 172.21.15.192:0/1036729770 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc15ee90 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.549+0000 7fbdb9600640 1 -- 172.21.15.192:0/1036729770 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587180302 0 0) 0x7fbdbc140480 con 0x7fbdbc140980 2024-09-13T18:40:42.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdba000640 1 --2- 172.21.15.192:0/1036729770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b2350 tx=0x7fbda802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4984b61229b3379 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdb9600640 1 -- 172.21.15.192:0/1036729770 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8032440 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdb9600640 1 -- 172.21.15.192:0/1036729770 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda80325a0 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdb9600640 1 -- 172.21.15.192:0/1036729770 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8032930 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 -- 172.21.15.192:0/1036729770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0cb0b0 msgr2=0x7fbdbc15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/1036729770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0b2350 tx=0x7fbda802a270 comp rx=0 tx=0).stop 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 -- 172.21.15.192:0/1036729770 shutdown_connections 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/1036729770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0cb0b0 0x7fbdbc15bc20 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/1036729770 >> v2:172.21.15.194:3300/0 conn(0x7fbdbc0cacd0 0x7fbdbc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.550+0000 7fbdc1a00640 1 -- 172.21.15.192:0/1036729770 >> 172.21.15.192:0/1036729770 conn(0x7fbdbc0ae960 msgr2=0x7fbdbc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.551+0000 7fbdc1a00640 1 -- 172.21.15.192:0/1036729770 shutdown_connections 2024-09-13T18:40:42.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.551+0000 7fbdc1a00640 1 -- 172.21.15.192:0/1036729770 wait complete. 2024-09-13T18:40:42.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.552+0000 7fbdc1a00640 1 Processor -- start 2024-09-13T18:40:42.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.552+0000 7fbdc1a00640 1 -- start start 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc0cacd0 0x7fbdbc13d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc0cb0b0 0x7fbdbc06b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc13dac0 con 0x7fbdbc140980 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc1567a0 con 0x7fbdbc0cacd0 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdc1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc156a80 con 0x7fbdbc0cb0b0 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdbb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.553+0000 7fbdbb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33388/0 (socket says 172.21.15.192:33388) 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 -- 172.21.15.192:0/4096436474 learned_addr learned my addr 172.21.15.192:0/4096436474 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc0cacd0 0x7fbdbc13d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdba000640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc0cb0b0 0x7fbdbc06b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 -- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc0cb0b0 msgr2=0x7fbdbc06b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc0cb0b0 0x7fbdbc06b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 -- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc0cacd0 msgr2=0x7fbdbc13d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc0cacd0 0x7fbdbc13d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80094d0 con 0x7fbdbc140980 2024-09-13T18:40:42.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdbb400640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c7a0 tx=0x7fbdb400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400a640 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdb400a7a0 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400ab90 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.554+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc156d60 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.555+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc157320 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.556+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc157510 con 0x7fbdbc140980 2024-09-13T18:40:42.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.556+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbdb400acf0 con 0x7fbdbc140980 2024-09-13T18:40:42.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.557+0000 7fbdb2a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.557+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fbdb40888f0 con 0x7fbdbc140980 2024-09-13T18:40:42.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.557+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.558+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fbd9c0728b0 con 0x7fbdbc140980 2024-09-13T18:40:42.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.558+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc1f3ad0 tx=0x7fbdac009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.561+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbdb4018070 con 0x7fbdbc140980 2024-09-13T18:40:42.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.730+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbdbc15bc20 con 0x7fbdbc140980 2024-09-13T18:40:42.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.731+0000 7fbdb2a00640 1 -- 172.21.15.192:0/4096436474 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v96) v1 ==== 74+0+16849 (secure 0 0 0) 0x7fbdb4053af0 con 0x7fbdbc140980 2024-09-13T18:40:42.734 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:42.734 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":96,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:28.902399+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.5","mappings":[{"from":1,"to":7}]},{"pgid":"11.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:42.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 msgr2=0x7fbd9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc1f3ad0 tx=0x7fbdac009190 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 msgr2=0x7fbdbc15c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400c7a0 tx=0x7fbdb400cc60 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 shutdown_connections 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc140980 0x7fbdbc15c2a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc0cb0b0 0x7fbdbc06b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 --2- 172.21.15.192:0/4096436474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc0cacd0 0x7fbdbc13d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.733+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 >> 172.21.15.192:0/4096436474 conn(0x7fbdbc0ae960 msgr2=0x7fbdbc15e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.734+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 shutdown_connections 2024-09-13T18:40:42.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.734+0000 7fbdc1a00640 1 -- 172.21.15.192:0/4096436474 wait complete. 2024-09-13T18:40:42.752 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:54.526138+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:55.272341+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:42.752 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:42.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.906+0000 7f48e5200640 1 Processor -- start 2024-09-13T18:40:42.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.906+0000 7f48e5200640 1 -- start start 2024-09-13T18:40:42.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48e5200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48e01434c0 0x7f48e006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48e5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48e5200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e006b480 con 0x7f48e006a8b0 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48e5200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e00ce770 con 0x7f48e01434c0 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48e5200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e006b760 con 0x7f48e00b3da0 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48dde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48e01434c0 0x7f48e006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48dde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f48e01434c0 0x7f48e006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33390/0 (socket says 172.21.15.192:33390) 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48dde00640 1 -- 172.21.15.192:0/3887767148 learned_addr learned my addr 172.21.15.192:0/3887767148 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.907+0000 7f48de800640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.908+0000 7f48dde00640 1 -- 172.21.15.192:0/3887767148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 msgr2=0x7f48e006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.908+0000 7f48dde00640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.908+0000 7f48dde00640 1 -- 172.21.15.192:0/3887767148 >> v1:172.21.15.194:6789/0 conn(0x7f48e006a8b0 legacy=0x7f48e00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.908+0000 7f48dde00640 1 -- 172.21.15.192:0/3887767148 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e006ba40 con 0x7f48e01434c0 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.909+0000 7f48dde00640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e01434c0 0x7f48e006c800 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bb10 tx=0x7f48d002c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676c3f3b49a72a62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.909+0000 7f48dca00640 1 -- 172.21.15.192:0/3887767148 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0032790 con 0x7f48e01434c0 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.909+0000 7f48dca00640 1 -- 172.21.15.192:0/3887767148 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d00328f0 con 0x7f48e01434c0 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.909+0000 7f48dca00640 1 -- 172.21.15.192:0/3887767148 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d0032c80 con 0x7f48e01434c0 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 -- 172.21.15.192:0/3887767148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e01434c0 msgr2=0x7f48e006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e01434c0 0x7f48e006c800 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bb10 tx=0x7f48d002c890 comp rx=0 tx=0).stop 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 -- 172.21.15.192:0/3887767148 shutdown_connections 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 --2- 172.21.15.192:0/3887767148 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e01434c0 0x7f48e006c800 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 -- 172.21.15.192:0/3887767148 >> 172.21.15.192:0/3887767148 conn(0x7f48e00b08f0 msgr2=0x7f48e00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:42.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 -- 172.21.15.192:0/3887767148 shutdown_connections 2024-09-13T18:40:42.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.910+0000 7f48e5200640 1 -- 172.21.15.192:0/3887767148 wait complete. 2024-09-13T18:40:42.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.911+0000 7f48e5200640 1 Processor -- start 2024-09-13T18:40:42.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.911+0000 7f48e5200640 1 -- start start 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48e01434c0 0x7f48e00add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e013da60 con 0x7f48e006a8b0 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e013dce0 con 0x7f48e01434c0 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.912+0000 7f48e5200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e013dfc0 con 0x7f48e00b3da0 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33400/0 (socket says 172.21.15.192:33400) 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 -- 172.21.15.192:0/321533272 learned_addr learned my addr 172.21.15.192:0/321533272 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dd400640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48de800640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48e01434c0 0x7f48e00add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 -- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 msgr2=0x7f48e00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 -- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48e01434c0 msgr2=0x7f48e00add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48e01434c0 0x7f48e00add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d000b770 con 0x7f48e006a8b0 2024-09-13T18:40:42.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.913+0000 7f48dde00640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f48d002c8d0 tx=0x7f48d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.914+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d003c830 con 0x7f48e006a8b0 2024-09-13T18:40:42.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.914+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d003c990 con 0x7f48e006a8b0 2024-09-13T18:40:42.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.914+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d003cd40 con 0x7f48e006a8b0 2024-09-13T18:40:42.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.914+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e013e2a0 con 0x7f48e006a8b0 2024-09-13T18:40:42.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.914+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e013e860 con 0x7f48e006a8b0 2024-09-13T18:40:42.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.915+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e013e100 con 0x7f48e006a8b0 2024-09-13T18:40:42.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.916+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f48d0033420 con 0x7f48e006a8b0 2024-09-13T18:40:42.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.916+0000 7f48d6000640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 0x7f48c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:42.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.917+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f48d00aa2f0 con 0x7f48e006a8b0 2024-09-13T18:40:42.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.917+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f48c00728b0 con 0x7f48e006a8b0 2024-09-13T18:40:42.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.917+0000 7f48dd400640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 0x7f48c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:42.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.917+0000 7f48dd400640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 0x7f48c006d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48e01f61c0 tx=0x7f48cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:42.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:42.921+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f48e013e100 con 0x7f48e006a8b0 2024-09-13T18:40:43.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.094+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48e013e100 con 0x7f48e006a8b0 2024-09-13T18:40:43.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.094+0000 7f48d6000640 1 -- 172.21.15.192:0/321533272 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v96) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48e013e100 con 0x7f48e006a8b0 2024-09-13T18:40:43.097 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.096+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 msgr2=0x7f48c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.096+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 0x7f48c006d0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f48e01f61c0 tx=0x7f48cc009040 comp rx=0 tx=0).stop 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 msgr2=0x7f48e01394e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f48d002c8d0 tx=0x7f48d0004730 comp rx=0 tx=0).stop 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 shutdown_connections 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48c006ac00 0x7f48c006d0c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f48e01434c0 0x7f48e00add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f48e00b3da0 0x7f48e00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 --2- 172.21.15.192:0/321533272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f48e006a8b0 0x7f48e01394e0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 >> 172.21.15.192:0/321533272 conn(0x7f48e00b08f0 msgr2=0x7f48e00afa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 shutdown_connections 2024-09-13T18:40:43.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.097+0000 7f48e5200640 1 -- 172.21.15.192:0/321533272 wait complete. 2024-09-13T18:40:43.116 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:40:43.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.268+0000 7fdc02a00640 1 Processor -- start 2024-09-13T18:40:43.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.268+0000 7fdc02a00640 1 -- start start 2024-09-13T18:40:43.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.269+0000 7fdc02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.269+0000 7fdc02a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdbfc06c0b0 0x7fdbfc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.269+0000 7fdc02a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbfc0b2000 con 0x7fdbfc1589f0 2024-09-13T18:40:43.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.269+0000 7fdc02a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbfc06ca80 con 0x7fdbfc06c0b0 2024-09-13T18:40:43.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.269+0000 7fdc02a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc0b2ba0 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:44476/0 (socket says 172.21.15.192:44476) 2024-09-13T18:40:43.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfbe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdbfc1589f0 0x7fdbfc0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:48198/0 (socket says 172.21.15.192:48198) 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 -- 172.21.15.192:0/3594896930 learned_addr learned my addr 172.21.15.192:0/3594896930 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdc00a00640 1 --2- 172.21.15.192:0/3594896930 >> v2:172.21.15.194:3300/0 conn(0x7fdbfc06c0b0 0x7fdbfc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 -- 172.21.15.192:0/3594896930 >> v2:172.21.15.194:3300/0 conn(0x7fdbfc06c0b0 msgr2=0x7fdbfc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 --2- 172.21.15.192:0/3594896930 >> v2:172.21.15.194:3300/0 conn(0x7fdbfc06c0b0 0x7fdbfc06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 -- 172.21.15.192:0/3594896930 >> v1:172.21.15.194:6789/0 conn(0x7fdbfc1589f0 legacy=0x7fdbfc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfb400640 1 -- 172.21.15.192:0/3594896930 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbfc15bbd0 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.270+0000 7fdbfaa00640 1 -- 172.21.15.192:0/3594896930 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2694773215 0 0) 0x7fdbfc0b2000 con 0x7fdbfc1589f0 2024-09-13T18:40:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.271+0000 7fdbfb400640 1 --2- 172.21.15.192:0/3594896930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009870 tx=0x7fdbe802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c613f29179d59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.271+0000 7fdbfaa00640 1 -- 172.21.15.192:0/3594896930 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032440 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdbfaa00640 1 -- 172.21.15.192:0/3594896930 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe80325a0 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdbfaa00640 1 -- 172.21.15.192:0/3594896930 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032930 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 -- 172.21.15.192:0/3594896930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 msgr2=0x7fdbfc15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 --2- 172.21.15.192:0/3594896930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8009870 tx=0x7fdbe802a270 comp rx=0 tx=0).stop 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 -- 172.21.15.192:0/3594896930 shutdown_connections 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 --2- 172.21.15.192:0/3594896930 >> v2:172.21.15.194:3300/0 conn(0x7fdbfc06c0b0 0x7fdbfc06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 --2- 172.21.15.192:0/3594896930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc0b3af0 0x7fdbfc15b260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 -- 172.21.15.192:0/3594896930 >> 172.21.15.192:0/3594896930 conn(0x7fdbfc0b08f0 msgr2=0x7fdbfc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 -- 172.21.15.192:0/3594896930 shutdown_connections 2024-09-13T18:40:43.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.272+0000 7fdc02a00640 1 -- 172.21.15.192:0/3594896930 wait complete. 2024-09-13T18:40:43.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.274+0000 7fdc02a00640 1 Processor -- start 2024-09-13T18:40:43.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.274+0000 7fdc02a00640 1 -- start start 2024-09-13T18:40:43.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 0x7fdbfc152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbfc0b3af0 0x7fdbfc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc15d440 con 0x7fdbfc1589f0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc13a0e0 con 0x7fdbfc0b3af0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc02a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbfc15dda0 con 0x7fdbfc06c0b0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc00a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc00a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33412/0 (socket says 172.21.15.192:33412) 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdc00a00640 1 -- 172.21.15.192:0/2207966497 learned_addr learned my addr 172.21.15.192:0/2207966497 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdbfbe00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 0x7fdbfc152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.275+0000 7fdbfb400640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbfc0b3af0 0x7fdbfc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 -- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 msgr2=0x7fdbfc152090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 0x7fdbfc152090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 -- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbfc0b3af0 msgr2=0x7fdbfc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbfc0b3af0 0x7fdbfc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80094d0 con 0x7fdbfc1589f0 2024-09-13T18:40:43.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdbfbe00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 0x7fdbfc152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:43.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc00a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400efc0 tx=0x7fdbf400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4014480 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf400f040 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf4014820 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbfc15c7c0 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.276+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbfc15cd80 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.277+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbfc15d580 con 0x7fdbfc1589f0 2024-09-13T18:40:43.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.278+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdbf4014980 con 0x7fdbfc1589f0 2024-09-13T18:40:43.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.279+0000 7fdbf3e00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 0x7fdbdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.279+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdbf4089e40 con 0x7fdbfc1589f0 2024-09-13T18:40:43.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.279+0000 7fdbfbe00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 0x7fdbdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.279+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fdbdc0728b0 con 0x7fdbfc1589f0 2024-09-13T18:40:43.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.280+0000 7fdbfbe00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 0x7fdbdc06d0c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007fd0 tx=0x7fdbec007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.283+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdbf4018020 con 0x7fdbfc1589f0 2024-09-13T18:40:43.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.451+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbfc06c540 con 0x7fdbfc1589f0 2024-09-13T18:40:43.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.451+0000 7fdbf3e00640 1 -- 172.21.15.192:0/2207966497 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v96) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbfc15d580 con 0x7fdbfc1589f0 2024-09-13T18:40:43.454 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:40:43.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 msgr2=0x7fdbdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 0x7fdbdc06d0c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fdbec007fd0 tx=0x7fdbec007de0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 msgr2=0x7fdbfc13c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fdbf400efc0 tx=0x7fdbf400c490 comp rx=0 tx=0).stop 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 shutdown_connections 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbdc06ac00 0x7fdbdc06d0c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdbfc1589f0 0x7fdbfc13c3c0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdbfc0b3af0 0x7fdbfc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 --2- 172.21.15.192:0/2207966497 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdbfc06c0b0 0x7fdbfc152090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 >> 172.21.15.192:0/2207966497 conn(0x7fdbfc0b08f0 msgr2=0x7fdbfc0b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 shutdown_connections 2024-09-13T18:40:43.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.453+0000 7fdc02a00640 1 -- 172.21.15.192:0/2207966497 wait complete. 2024-09-13T18:40:43.472 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:40:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.625+0000 7efd99600640 1 Processor -- start 2024-09-13T18:40:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.625+0000 7efd99600640 1 -- start start 2024-09-13T18:40:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd99600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 0x7efd940b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd99600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9406cc40 con 0x7efd940b3bd0 2024-09-13T18:40:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd99600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd9406b480 con 0x7efd941434c0 2024-09-13T18:40:43.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd99600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd940b4060 con 0x7efd9406c800 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd93400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efd940b3bd0 0x7efd9406e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49514/0 (socket says 172.21.15.192:49514) 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.626+0000 7efd93400640 1 -- 172.21.15.192:0/2704102547 learned_addr learned my addr 172.21.15.192:0/2704102547 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd92000640 1 --2- 172.21.15.192:0/2704102547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 0x7efd940b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906621873 0 0) 0x7efd9406cc40 con 0x7efd940b3bd0 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd78003520 con 0x7efd940b3bd0 2024-09-13T18:40:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd92000640 1 -- 172.21.15.192:0/2704102547 >> v1:172.21.15.194:6789/0 conn(0x7efd941434c0 legacy=0x7efd9406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 599511159 0 0) 0x7efd9406b480 con 0x7efd941434c0 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd92000640 1 -- 172.21.15.192:0/2704102547 >> v1:172.21.15.192:6789/0 conn(0x7efd940b3bd0 legacy=0x7efd9406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.627+0000 7efd92000640 1 -- 172.21.15.192:0/2704102547 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd9406b760 con 0x7efd9406c800 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.628+0000 7efd92000640 1 --2- 172.21.15.192:0/2704102547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 0x7efd940b3690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd80009800 tx=0x7efd8002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=462b30b8e26bcd67 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80032440 con 0x7efd9406c800 2024-09-13T18:40:43.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd800325a0 con 0x7efd9406c800 2024-09-13T18:40:43.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd91600640 1 -- 172.21.15.192:0/2704102547 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd80032930 con 0x7efd9406c800 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 -- 172.21.15.192:0/2704102547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 msgr2=0x7efd940b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 --2- 172.21.15.192:0/2704102547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 0x7efd940b3690 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efd80009800 tx=0x7efd8002a230 comp rx=0 tx=0).stop 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 -- 172.21.15.192:0/2704102547 shutdown_connections 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 --2- 172.21.15.192:0/2704102547 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd9406c800 0x7efd940b3690 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 -- 172.21.15.192:0/2704102547 >> 172.21.15.192:0/2704102547 conn(0x7efd940b08f0 msgr2=0x7efd940b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 -- 172.21.15.192:0/2704102547 shutdown_connections 2024-09-13T18:40:43.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.629+0000 7efd99600640 1 -- 172.21.15.192:0/2704102547 wait complete. 2024-09-13T18:40:43.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.631+0000 7efd99600640 1 Processor -- start 2024-09-13T18:40:43.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.631+0000 7efd99600640 1 -- start start 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940b3bd0 0x7efd94155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd941434c0 0x7efd941587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd941560b0 con 0x7efd9406c800 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd94157a20 con 0x7efd940b3bd0 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd99600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd94157d00 con 0x7efd941434c0 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33422/0 (socket says 172.21.15.192:33422) 2024-09-13T18:40:43.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 -- 172.21.15.192:0/3641854108 learned_addr learned my addr 172.21.15.192:0/3641854108 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:43.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 -- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd941434c0 msgr2=0x7efd941587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd941434c0 0x7efd941587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 -- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940b3bd0 msgr2=0x7efd94155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.632+0000 7efd92a00640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940b3bd0 0x7efd94155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd92a00640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd80009400 con 0x7efd9406c800 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd92a00640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7efd8400c410 tx=0x7efd8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd840035f0 con 0x7efd9406c800 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd84003770 con 0x7efd9406c800 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd84003b20 con 0x7efd9406c800 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd94157fe0 con 0x7efd9406c800 2024-09-13T18:40:43.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.633+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd94157660 con 0x7efd9406c800 2024-09-13T18:40:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.634+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd941577f0 con 0x7efd9406c800 2024-09-13T18:40:43.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.635+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd84003c80 con 0x7efd9406c800 2024-09-13T18:40:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.636+0000 7efd8aa00640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 0x7efd7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.636+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7efd84088a50 con 0x7efd9406c800 2024-09-13T18:40:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.636+0000 7efd92000640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 0x7efd7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.636+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7efd740728b0 con 0x7efd9406c800 2024-09-13T18:40:43.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.637+0000 7efd92000640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 0x7efd7406d0c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd80034000 tx=0x7efd8002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.640+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd84017020 con 0x7efd9406c800 2024-09-13T18:40:43.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.810+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd94158500 con 0x7efd9406c800 2024-09-13T18:40:43.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.810+0000 7efd8aa00640 1 -- 172.21.15.192:0/3641854108 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v96) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd94158500 con 0x7efd9406c800 2024-09-13T18:40:43.814 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 msgr2=0x7efd7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 0x7efd7406d0c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efd80034000 tx=0x7efd8002c000 comp rx=0 tx=0).stop 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 msgr2=0x7efd9414a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7efd8400c410 tx=0x7efd8400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 shutdown_connections 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd7406ac00 0x7efd7406d0c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd941434c0 0x7efd941587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd940b3bd0 0x7efd94155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 --2- 172.21.15.192:0/3641854108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd9406c800 0x7efd9414a800 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 >> 172.21.15.192:0/3641854108 conn(0x7efd940b08f0 msgr2=0x7efd940b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 shutdown_connections 2024-09-13T18:40:43.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.813+0000 7efd99600640 1 -- 172.21.15.192:0/3641854108 wait complete. 2024-09-13T18:40:43.832 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:40:43.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.983+0000 7fdaf4e00640 1 Processor -- start 2024-09-13T18:40:43.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.983+0000 7fdaf4e00640 1 -- start start 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaf4e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 0x7fdaf015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaf4e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaf4e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf00b2d70 con 0x7fdaf0071830 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaf4e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf00ce290 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaf4e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf00b3050 con 0x7fdaf0071450 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaee800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaee800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33432/0 (socket says 172.21.15.192:33432) 2024-09-13T18:40:43.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.984+0000 7fdaee800640 1 -- 172.21.15.192:0/866685854 learned_addr learned my addr 172.21.15.192:0/866685854 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:43.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaede00640 1 --2- 172.21.15.192:0/866685854 >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 0x7fdaf015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaee800640 1 -- 172.21.15.192:0/866685854 >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 msgr2=0x7fdaf015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:43.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaee800640 1 --2- 172.21.15.192:0/866685854 >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 0x7fdaf015b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaee800640 1 -- 172.21.15.192:0/866685854 >> v1:172.21.15.194:6789/0 conn(0x7fdaf0071830 legacy=0x7fdaf0070790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaee800640 1 -- 172.21.15.192:0/866685854 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf015b720 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.985+0000 7fdaede00640 1 --2- 172.21.15.192:0/866685854 >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 0x7fdaf015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.986+0000 7fdaee800640 1 --2- 172.21.15.192:0/866685854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0071f70 tx=0x7fdae802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38739bb07a170fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.986+0000 7fdaeca00640 1 -- 172.21.15.192:0/866685854 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8031600 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.986+0000 7fdaeca00640 1 -- 172.21.15.192:0/866685854 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae802d050 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.986+0000 7fdaeca00640 1 -- 172.21.15.192:0/866685854 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8031980 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 -- 172.21.15.192:0/866685854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 msgr2=0x7fdaf00cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/866685854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0071f70 tx=0x7fdae802a730 comp rx=0 tx=0).stop 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 -- 172.21.15.192:0/866685854 shutdown_connections 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/866685854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00cdd50 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/866685854 >> v2:172.21.15.194:3300/0 conn(0x7fdaf0071450 0x7fdaf015b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 -- 172.21.15.192:0/866685854 >> 172.21.15.192:0/866685854 conn(0x7fdaf0073730 msgr2=0x7fdaf00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:43.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 -- 172.21.15.192:0/866685854 shutdown_connections 2024-09-13T18:40:43.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.987+0000 7fdaf4e00640 1 -- 172.21.15.192:0/866685854 wait complete. 2024-09-13T18:40:43.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.989+0000 7fdaf4e00640 1 Processor -- start 2024-09-13T18:40:43.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.989+0000 7fdaf4e00640 1 -- start start 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.989+0000 7fdaf4e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 0x7fdaf01545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.989+0000 7fdaf4e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 0x7fdaf00adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaf4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaf4e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0154b10 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaf4e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf00aa8a0 con 0x7fdaf0071450 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaf4e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf0156920 con 0x7fdaf0071830 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 0x7fdaf01545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33442/0 (socket says 172.21.15.192:33442) 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 0x7fdaf01545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:57656/0 (socket says 172.21.15.192:57656) 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaed400640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 0x7fdaf00adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 -- 172.21.15.192:0/1330296757 learned_addr learned my addr 172.21.15.192:0/1330296757 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:43.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 -- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 msgr2=0x7fdaf00adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 0x7fdaf00adb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 -- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 msgr2=0x7fdaf01545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 0x7fdaf01545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaee800640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae8009b30 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.990+0000 7fdaed400640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 0x7fdaf00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdaee800640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009f40 tx=0x7fdae8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae803d860 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae803d9c0 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf0156c00 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae803dd70 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.991+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf00a96e0 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.992+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf0157120 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.993+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdae803b400 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.994+0000 7fdae6000640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 0x7fdad006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.994+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdae80aa1f0 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.994+0000 7fdaede00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 0x7fdad006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.994+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fdad00728b0 con 0x7fdaf00cd8c0 2024-09-13T18:40:43.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.995+0000 7fdaede00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 0x7fdad006d0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdae000aac0 tx=0x7fdae0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:43.998+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdae8075400 con 0x7fdaf00cd8c0 2024-09-13T18:40:44.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.178+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdaf015b4e0 con 0x7fdaf00cd8c0 2024-09-13T18:40:44.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.178+0000 7fdae6000640 1 -- 172.21.15.192:0/1330296757 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v96) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdae8041020 con 0x7fdaf00cd8c0 2024-09-13T18:40:44.182 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:40:44.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 msgr2=0x7fdad006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 0x7fdad006d0c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fdae000aac0 tx=0x7fdae0008040 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 msgr2=0x7fdaf00abb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009f40 tx=0x7fdae8004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 shutdown_connections 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdad006ac00 0x7fdad006d0c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdaf00cd8c0 0x7fdaf00abb60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdaf0071830 0x7fdaf00adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 --2- 172.21.15.192:0/1330296757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdaf0071450 0x7fdaf01545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.180+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 >> 172.21.15.192:0/1330296757 conn(0x7fdaf0073730 msgr2=0x7fdaf015c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.181+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 shutdown_connections 2024-09-13T18:40:44.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.181+0000 7fdaf4e00640 1 -- 172.21.15.192:0/1330296757 wait complete. 2024-09-13T18:40:44.199 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:40:44.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:44.199 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:40:44.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:40:44.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:40:44.269 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:40:44.306 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:44.306 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:44.342 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:40:44.342 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:44.343 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:44.383 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:40:44.383 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:44.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.530+0000 7fd67d600640 1 Processor -- start 2024-09-13T18:40:44.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.530+0000 7fd67d600640 1 -- start start 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd67d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 0x7fd6780b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd67d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6780b2230 0x7fd6780cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd67d600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd678071dd0 con 0x7fd678150480 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd67d600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6780cb770 con 0x7fd6780b2230 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd67d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6780cba50 con 0x7fd678071810 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd676a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd678150480 0x7fd67815a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49526/0 (socket says 172.21.15.192:49526) 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd676a00640 1 -- 172.21.15.192:0/3419220769 learned_addr learned my addr 172.21.15.192:0/3419220769 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd677400640 1 --2- 172.21.15.192:0/3419220769 >> v2:172.21.15.192:3300/0 conn(0x7fd6780b2230 0x7fd6780cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd676000640 1 --2- 172.21.15.192:0/3419220769 >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 0x7fd6780b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd677400640 1 -- 172.21.15.192:0/3419220769 >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 msgr2=0x7fd6780b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd677400640 1 --2- 172.21.15.192:0/3419220769 >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 0x7fd6780b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd677400640 1 -- 172.21.15.192:0/3419220769 >> v1:172.21.15.192:6789/0 conn(0x7fd678150480 legacy=0x7fd67815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd677400640 1 -- 172.21.15.192:0/3419220769 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6780cbd30 con 0x7fd6780b2230 2024-09-13T18:40:44.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.532+0000 7fd676000640 1 --2- 172.21.15.192:0/3419220769 >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 0x7fd6780b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:44.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.533+0000 7fd677400640 1 --2- 172.21.15.192:0/3419220769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6780b2230 0x7fd6780cc530 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd67806cb50 tx=0x7fd67002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b4234928234750 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd675600640 1 -- 172.21.15.192:0/3419220769 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670007740 con 0x7fd6780b2230 2024-09-13T18:40:44.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd675600640 1 -- 172.21.15.192:0/3419220769 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67002d050 con 0x7fd6780b2230 2024-09-13T18:40:44.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd675600640 1 -- 172.21.15.192:0/3419220769 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670007ac0 con 0x7fd6780b2230 2024-09-13T18:40:44.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 -- 172.21.15.192:0/3419220769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6780b2230 msgr2=0x7fd6780cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 --2- 172.21.15.192:0/3419220769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6780b2230 0x7fd6780cc530 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd67806cb50 tx=0x7fd67002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 -- 172.21.15.192:0/3419220769 shutdown_connections 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 --2- 172.21.15.192:0/3419220769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6780b2230 0x7fd6780cc530 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 --2- 172.21.15.192:0/3419220769 >> v2:172.21.15.194:3300/0 conn(0x7fd678071810 0x7fd6780b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 -- 172.21.15.192:0/3419220769 >> 172.21.15.192:0/3419220769 conn(0x7fd6780ae960 msgr2=0x7fd67806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 -- 172.21.15.192:0/3419220769 shutdown_connections 2024-09-13T18:40:44.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.534+0000 7fd67d600640 1 -- 172.21.15.192:0/3419220769 wait complete. 2024-09-13T18:40:44.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.536+0000 7fd67d600640 1 Processor -- start 2024-09-13T18:40:44.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.536+0000 7fd67d600640 1 -- start start 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 0x7fd67815c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6780b2230 0x7fd67815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd678148740 con 0x7fd678150480 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67806b1e0 con 0x7fd678071810 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd67d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6781481d0 con 0x7fd6780b2230 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd677400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd676a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 0x7fd67815c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd677400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33466/0 (socket says 172.21.15.192:33466) 2024-09-13T18:40:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd677400640 1 -- 172.21.15.192:0/1131631593 learned_addr learned my addr 172.21.15.192:0/1131631593 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:44.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.537+0000 7fd676000640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6780b2230 0x7fd67815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 -- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6780b2230 msgr2=0x7fd67815b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6780b2230 0x7fd67815b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 -- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 msgr2=0x7fd67815c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 0x7fd67815c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd670009a70 con 0x7fd678150480 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd676a00640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 0x7fd67815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd677400640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd67002abe0 tx=0x7fd670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670031890 con 0x7fd678150480 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6700319f0 con 0x7fd678150480 2024-09-13T18:40:44.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670031d60 con 0x7fd678150480 2024-09-13T18:40:44.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67815bdc0 con 0x7fd678150480 2024-09-13T18:40:44.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.538+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67806ab90 con 0x7fd678150480 2024-09-13T18:40:44.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.540+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67806b390 con 0x7fd678150480 2024-09-13T18:40:44.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.540+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd67003c420 con 0x7fd678150480 2024-09-13T18:40:44.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.541+0000 7fd66ea00640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 0x7fd65806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.541+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fd6700aaea0 con 0x7fd678150480 2024-09-13T18:40:44.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.541+0000 7fd676a00640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 0x7fd65806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.542+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7fd6580728e0 con 0x7fd678150480 2024-09-13T18:40:44.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.542+0000 7fd676a00640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 0x7fd65806d0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd668005880 tx=0x7fd668009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.545+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd67806b390 con 0x7fd678150480 2024-09-13T18:40:44.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.745+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6780cb350 con 0x7fd678150480 2024-09-13T18:40:44.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.745+0000 7fd66ea00640 1 -- 172.21.15.192:0/1131631593 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fd67004a070 con 0x7fd678150480 2024-09-13T18:40:44.748 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:44.749 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:44.749 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:44.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 msgr2=0x7fd65806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 0x7fd65806d0f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd668005880 tx=0x7fd668009040 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 msgr2=0x7fd678147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd67002abe0 tx=0x7fd670004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 shutdown_connections 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd65806ac30 0x7fd65806d0f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.747+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd678150480 0x7fd678147c90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.748+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6780b2230 0x7fd67815b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.748+0000 7fd67d600640 1 --2- 172.21.15.192:0/1131631593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd678071810 0x7fd67815c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.748+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 >> 172.21.15.192:0/1131631593 conn(0x7fd6780ae960 msgr2=0x7fd67815d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.748+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 shutdown_connections 2024-09-13T18:40:44.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.748+0000 7fd67d600640 1 -- 172.21.15.192:0/1131631593 wait complete. 2024-09-13T18:40:44.767 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:44.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.916+0000 7f2497400640 1 Processor -- start 2024-09-13T18:40:44.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.916+0000 7f2497400640 1 -- start start 2024-09-13T18:40:44.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.917+0000 7f2497400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f24900afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.917+0000 7f2497400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f249015e2c0 0x7f249015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.917+0000 7f2497400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24900b2f00 con 0x7f24900b3f10 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.917+0000 7f2497400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24900b3150 con 0x7f249015e2c0 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.917+0000 7f2497400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24900b3430 con 0x7f249015dee0 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f248fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f24900b3f10 0x7f249015a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49528/0 (socket says 172.21.15.192:49528) 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f248fe00640 1 -- 172.21.15.192:0/3095334840 learned_addr learned my addr 172.21.15.192:0/3095334840 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2495400640 1 --2- 172.21.15.192:0/3095334840 >> v2:172.21.15.194:3300/0 conn(0x7f249015e2c0 0x7f249015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2494a00640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f24900afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f248f400640 1 -- 172.21.15.192:0/3095334840 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 388745284 0 0) 0x7f24900b2f00 con 0x7f24900b3f10 2024-09-13T18:40:44.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f248f400640 1 -- 172.21.15.192:0/3095334840 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2474003520 con 0x7f24900b3f10 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2495400640 1 -- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 msgr2=0x7f24900afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2495400640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f24900afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2495400640 1 -- 172.21.15.192:0/3095334840 >> v1:172.21.15.192:6789/0 conn(0x7f24900b3f10 legacy=0x7f249015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.918+0000 7f2495400640 1 -- 172.21.15.192:0/3095334840 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24900b3710 con 0x7f249015e2c0 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.919+0000 7f2495400640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249015e2c0 0x7f249015ab50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4685096f764a17aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.919+0000 7f248f400640 1 -- 172.21.15.192:0/3095334840 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488032440 con 0x7f249015e2c0 2024-09-13T18:40:44.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.919+0000 7f248f400640 1 -- 172.21.15.192:0/3095334840 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24880325a0 con 0x7f249015e2c0 2024-09-13T18:40:44.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f248f400640 1 -- 172.21.15.192:0/3095334840 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2488032930 con 0x7f249015e2c0 2024-09-13T18:40:44.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 -- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249015e2c0 msgr2=0x7f249015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249015e2c0 0x7f249015ab50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f24880097a0 tx=0x7f248802a180 comp rx=0 tx=0).stop 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 -- 172.21.15.192:0/3095334840 shutdown_connections 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249015e2c0 0x7f249015ab50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 --2- 172.21.15.192:0/3095334840 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f24900afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 -- 172.21.15.192:0/3095334840 >> 172.21.15.192:0/3095334840 conn(0x7f24900ae960 msgr2=0x7f249006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 -- 172.21.15.192:0/3095334840 shutdown_connections 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.920+0000 7f2497400640 1 -- 172.21.15.192:0/3095334840 wait complete. 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.922+0000 7f2497400640 1 Processor -- start 2024-09-13T18:40:44.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.922+0000 7f2497400640 1 -- start start 2024-09-13T18:40:44.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f249013a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249013c280 0x7f2490156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249013b7d0 con 0x7f249015e2c0 2024-09-13T18:40:44.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249013fee0 con 0x7f249013c280 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2497400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249013c030 con 0x7f249015dee0 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33468/0 (socket says 172.21.15.192:33468) 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 -- 172.21.15.192:0/3796865086 learned_addr learned my addr 172.21.15.192:0/3796865086 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2494a00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f249013a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f2495400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249013c280 0x7f2490156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 -- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 msgr2=0x7f249013a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f249013a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 -- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249013c280 msgr2=0x7f2490156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249013c280 0x7f2490156900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.923+0000 7f248fe00640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2488009400 con 0x7f249015e2c0 2024-09-13T18:40:44.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f248fe00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c500 tx=0x7f247c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c005ce0 con 0x7f249015e2c0 2024-09-13T18:40:44.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f247c005e40 con 0x7f249015e2c0 2024-09-13T18:40:44.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f249013ba70 con 0x7f249015e2c0 2024-09-13T18:40:44.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247c007330 con 0x7f249015e2c0 2024-09-13T18:40:44.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.924+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24901547d0 con 0x7f249015e2c0 2024-09-13T18:40:44.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.925+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24901549c0 con 0x7f249015e2c0 2024-09-13T18:40:44.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.926+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f247c007550 con 0x7f249015e2c0 2024-09-13T18:40:44.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.927+0000 7f248cc00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 0x7f247006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:44.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.927+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f247c088a10 con 0x7f249015e2c0 2024-09-13T18:40:44.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.927+0000 7f2494a00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 0x7f247006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:44.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.927+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=97}) v3 -- 0x7f24700728b0 con 0x7f249015e2c0 2024-09-13T18:40:44.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.928+0000 7f2494a00640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 0x7f247006d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24800113e0 tx=0x7f248000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:44.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:44.931+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f247c017020 con 0x7f249015e2c0 2024-09-13T18:40:45.010 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:40:45.007+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 1 full osd(s) (OSD_FULL) 2024-09-13T18:40:45.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.012+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(97..97 src has 1..97) v4 ==== 296+0+0 (secure 0 0 0) 0x7f247c057990 con 0x7f249015e2c0 2024-09-13T18:40:45.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.012+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f2470073180 con 0x7f249015e2c0 2024-09-13T18:40:45.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.105+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f24900afd80 con 0x7f249015e2c0 2024-09-13T18:40:45.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.106+0000 7f248cc00640 1 -- 172.21.15.192:0/3796865086 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+16842 (secure 0 0 0) 0x7f247c053cd0 con 0x7f249015e2c0 2024-09-13T18:40:45.109 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:45.110 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":97,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:45.008519+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"92","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.5","mappings":[{"from":1,"to":7}]},{"pgid":"11.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 msgr2=0x7f247006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 0x7f247006d0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f24800113e0 tx=0x7f248000b040 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 msgr2=0x7f249013f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f247c00c500 tx=0x7f247c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 shutdown_connections 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f247006ac00 0x7f247006d0c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f249013c280 0x7f2490156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f249015e2c0 0x7f249013f9a0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 --2- 172.21.15.192:0/3796865086 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f249015dee0 0x7f249013a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 >> 172.21.15.192:0/3796865086 conn(0x7f24900ae960 msgr2=0x7f249006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 shutdown_connections 2024-09-13T18:40:45.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.109+0000 7f2497400640 1 -- 172.21.15.192:0/3796865086 wait complete. 2024-09-13T18:40:45.127 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:39:54.526138+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:39:55.272341+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '92', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:45.128 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:45.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.281+0000 7fcd4a200640 1 Processor -- start 2024-09-13T18:40:45.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.281+0000 7fcd4a200640 1 -- start start 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd441434c0 0x7fcd4406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 0x7fcd440b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 0x7fcd4406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440ce770 con 0x7fcd441434c0 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd440b4040 con 0x7fcd4406a8b0 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd4a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4406b480 con 0x7fcd440b3bd0 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd43400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd441434c0 0x7fcd4406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd43400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd441434c0 0x7fcd4406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33474/0 (socket says 172.21.15.192:33474) 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.282+0000 7fcd43400640 1 -- 172.21.15.192:0/2104927065 learned_addr learned my addr 172.21.15.192:0/2104927065 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:45.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43e00640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 0x7fcd4406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd3be00640 1 --2- 172.21.15.192:0/2104927065 >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 0x7fcd440b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43400640 1 -- 172.21.15.192:0/2104927065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 msgr2=0x7fcd4406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43400640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 0x7fcd4406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43400640 1 -- 172.21.15.192:0/2104927065 >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 msgr2=0x7fcd440b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43400640 1 --2- 172.21.15.192:0/2104927065 >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 0x7fcd440b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43400640 1 -- 172.21.15.192:0/2104927065 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4406b760 con 0x7fcd441434c0 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd3be00640 1 --2- 172.21.15.192:0/2104927065 >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 0x7fcd440b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:45.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.283+0000 7fcd43e00640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 0x7fcd4406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:45.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.284+0000 7fcd43400640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd441434c0 0x7fcd4406c800 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcd44071dd0 tx=0x7fcd3402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcedc54448b0e8e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.284+0000 7fcd42a00640 1 -- 172.21.15.192:0/2104927065 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032790 con 0x7fcd441434c0 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.284+0000 7fcd42a00640 1 -- 172.21.15.192:0/2104927065 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd340328f0 con 0x7fcd441434c0 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.284+0000 7fcd42a00640 1 -- 172.21.15.192:0/2104927065 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd34032c80 con 0x7fcd441434c0 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 -- 172.21.15.192:0/2104927065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd441434c0 msgr2=0x7fcd4406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd441434c0 0x7fcd4406c800 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcd44071dd0 tx=0x7fcd3402c890 comp rx=0 tx=0).stop 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 -- 172.21.15.192:0/2104927065 shutdown_connections 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd440b3bd0 0x7fcd4406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 --2- 172.21.15.192:0/2104927065 >> v2:172.21.15.194:3300/0 conn(0x7fcd4406a8b0 0x7fcd440b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 --2- 172.21.15.192:0/2104927065 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd441434c0 0x7fcd4406c800 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 -- 172.21.15.192:0/2104927065 >> 172.21.15.192:0/2104927065 conn(0x7fcd440b08f0 msgr2=0x7fcd440b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 -- 172.21.15.192:0/2104927065 shutdown_connections 2024-09-13T18:40:45.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.285+0000 7fcd4a200640 1 -- 172.21.15.192:0/2104927065 wait complete. 2024-09-13T18:40:45.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.286+0000 7fcd4a200640 1 Processor -- start 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 -- start start 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd4406a8b0 0x7fcd44156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd441434c0 0x7fcd4413fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44155640 con 0x7fcd440b3bd0 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44157520 con 0x7fcd4406a8b0 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.287+0000 7fcd4a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44157800 con 0x7fcd441434c0 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33480/0 (socket says 172.21.15.192:33480) 2024-09-13T18:40:45.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 -- 172.21.15.192:0/1363995736 learned_addr learned my addr 172.21.15.192:0/1363995736 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd43400640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd4406a8b0 0x7fcd44156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd43e00640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd441434c0 0x7fcd4413fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 -- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd441434c0 msgr2=0x7fcd4413fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd441434c0 0x7fcd4413fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 -- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd4406a8b0 msgr2=0x7fcd44156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd4406a8b0 0x7fcd44156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3400b770 con 0x7fcd440b3bd0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.288+0000 7fcd3be00640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c7c0 tx=0x7fcd2c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.289+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c007a30 con 0x7fcd440b3bd0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.289+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c007b90 con 0x7fcd440b3bd0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.289+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd2c00ce70 con 0x7fcd440b3bd0 2024-09-13T18:40:45.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.289+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44157ae0 con 0x7fcd440b3bd0 2024-09-13T18:40:45.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.289+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd441580a0 con 0x7fcd440b3bd0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.290+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd441582c0 con 0x7fcd440b3bd0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.291+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd2c0113f0 con 0x7fcd440b3bd0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.291+0000 7fcd3b400640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 0x7fcd2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.291+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcd2c089450 con 0x7fcd440b3bd0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.292+0000 7fcd43400640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 0x7fcd2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.292+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7fcd200728b0 con 0x7fcd440b3bd0 2024-09-13T18:40:45.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.292+0000 7fcd43400640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 0x7fcd2006d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd34037000 tx=0x7fcd34032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.295+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd2c054650 con 0x7fcd440b3bd0 2024-09-13T18:40:45.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.463+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd4406ad20 con 0x7fcd440b3bd0 2024-09-13T18:40:45.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.464+0000 7fcd3b400640 1 -- 172.21.15.192:0/1363995736 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd2c01f020 con 0x7fcd440b3bd0 2024-09-13T18:40:45.467 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 msgr2=0x7fcd2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 0x7fcd2006d0c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fcd34037000 tx=0x7fcd34032000 comp rx=0 tx=0).stop 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 msgr2=0x7fcd4413f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcd2c00c7c0 tx=0x7fcd2c00cc80 comp rx=0 tx=0).stop 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 shutdown_connections 2024-09-13T18:40:45.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd2006ac00 0x7fcd2006d0c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd441434c0 0x7fcd4413fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd440b3bd0 0x7fcd4413f6c0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 --2- 172.21.15.192:0/1363995736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd4406a8b0 0x7fcd44156eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 >> 172.21.15.192:0/1363995736 conn(0x7fcd440b08f0 msgr2=0x7fcd440afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 shutdown_connections 2024-09-13T18:40:45.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.466+0000 7fcd4a200640 1 -- 172.21.15.192:0/1363995736 wait complete. 2024-09-13T18:40:45.485 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:40:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.638+0000 7f1862000640 1 Processor -- start 2024-09-13T18:40:45.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.638+0000 7f1862000640 1 -- start start 2024-09-13T18:40:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f185c1434c0 0x7f185c06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c06a8b0 0x7f185c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f185c0b3bd0 0x7f185c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0b4060 con 0x7f185c0b3bd0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c0ce770 con 0x7f185c1434c0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f1862000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c06b480 con 0x7f185c06a8b0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f185be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f185c0b3bd0 0x7f185c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f185be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f185c0b3bd0 0x7f185c06e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33486/0 (socket says 172.21.15.192:33486) 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.639+0000 7f185be00640 1 -- 172.21.15.192:0/3089632293 learned_addr learned my addr 172.21.15.192:0/3089632293 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185aa00640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c06a8b0 0x7f185c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185b400640 1 --2- 172.21.15.192:0/3089632293 >> v2:172.21.15.194:3300/0 conn(0x7f185c1434c0 0x7f185c06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185be00640 1 -- 172.21.15.192:0/3089632293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c06a8b0 msgr2=0x7f185c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185be00640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c06a8b0 0x7f185c0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185be00640 1 -- 172.21.15.192:0/3089632293 >> v2:172.21.15.194:3300/0 conn(0x7f185c1434c0 msgr2=0x7f185c06c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185be00640 1 --2- 172.21.15.192:0/3089632293 >> v2:172.21.15.194:3300/0 conn(0x7f185c1434c0 0x7f185c06c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.640+0000 7f185be00640 1 -- 172.21.15.192:0/3089632293 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c06b760 con 0x7f185c0b3bd0 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.641+0000 7f185be00640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0b3bd0 0x7f185c06e920 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e50 tx=0x7f185402a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487741c1f9209902 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.641+0000 7f185a000640 1 -- 172.21.15.192:0/3089632293 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185402aea0 con 0x7f185c0b3bd0 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.641+0000 7f185a000640 1 -- 172.21.15.192:0/3089632293 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185402d050 con 0x7f185c0b3bd0 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.641+0000 7f185a000640 1 -- 172.21.15.192:0/3089632293 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854031820 con 0x7f185c0b3bd0 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 -- 172.21.15.192:0/3089632293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0b3bd0 msgr2=0x7f185c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0b3bd0 0x7f185c06e920 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f1854009e50 tx=0x7f185402a6c0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 -- 172.21.15.192:0/3089632293 shutdown_connections 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c0b3bd0 0x7f185c06e920 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 --2- 172.21.15.192:0/3089632293 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c06a8b0 0x7f185c0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 --2- 172.21.15.192:0/3089632293 >> v2:172.21.15.194:3300/0 conn(0x7f185c1434c0 0x7f185c06c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 -- 172.21.15.192:0/3089632293 >> 172.21.15.192:0/3089632293 conn(0x7f185c0b08f0 msgr2=0x7f185c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:45.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 -- 172.21.15.192:0/3089632293 shutdown_connections 2024-09-13T18:40:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.642+0000 7f1862000640 1 -- 172.21.15.192:0/3089632293 wait complete. 2024-09-13T18:40:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.643+0000 7f1862000640 1 Processor -- start 2024-09-13T18:40:45.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 -- start start 2024-09-13T18:40:45.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c0b3bd0 0x7f185c155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f185c1434c0 0x7f185c070570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c13c3d0 con 0x7f185c06a8b0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c154e60 con 0x7f185c1434c0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.644+0000 7f1862000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c1550b0 con 0x7f185c0b3bd0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33492/0 (socket says 172.21.15.192:33492) 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 -- 172.21.15.192:0/1943012632 learned_addr learned my addr 172.21.15.192:0/1943012632 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185aa00640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c0b3bd0 0x7f185c155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185be00640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f185c1434c0 0x7f185c070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 -- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c0b3bd0 msgr2=0x7f185c155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c0b3bd0 0x7f185c155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 -- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f185c1434c0 msgr2=0x7f185c070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f185c1434c0 0x7f185c070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1854009b30 con 0x7f185c06a8b0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.645+0000 7f185b400640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f184c00d620 tx=0x7f184c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.646+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00b620 con 0x7f185c06a8b0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.646+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f184c00b780 con 0x7f185c06a8b0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.646+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c155390 con 0x7f185c06a8b0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.646+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184c00bb30 con 0x7f185c06a8b0 2024-09-13T18:40:45.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.646+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c155950 con 0x7f185c06a8b0 2024-09-13T18:40:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.647+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c140220 con 0x7f185c06a8b0 2024-09-13T18:40:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.648+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f184c00bc90 con 0x7f185c06a8b0 2024-09-13T18:40:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.649+0000 7f1853400640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 0x7f183c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.649+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f184c089790 con 0x7f185c06a8b0 2024-09-13T18:40:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.649+0000 7f185aa00640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 0x7f183c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.649+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7f183c0728e0 con 0x7f185c06a8b0 2024-09-13T18:40:45.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.650+0000 7f185aa00640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 0x7f183c06d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f185c1f3aa0 tx=0x7f1848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:45.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.653+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f184c054990 con 0x7f185c06a8b0 2024-09-13T18:40:45.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.820+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f185c13ff40 con 0x7f185c06a8b0 2024-09-13T18:40:45.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.821+0000 7f1853400640 1 -- 172.21.15.192:0/1943012632 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v97) v1 ==== 104+0+11 (secure 0 0 0) 0x7f184c057fb0 con 0x7f185c06a8b0 2024-09-13T18:40:45.824 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:40:45.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.822+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 msgr2=0x7f183c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.822+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 0x7f183c06d0f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f185c1f3aa0 tx=0x7f1848008040 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.822+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 msgr2=0x7f185c13be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.822+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f184c00d620 tx=0x7f184c00dae0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 shutdown_connections 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f183c06ac30 0x7f183c06d0f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f185c1434c0 0x7f185c070570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f185c0b3bd0 0x7f185c155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 --2- 172.21.15.192:0/1943012632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f185c06a8b0 0x7f185c13be90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 >> 172.21.15.192:0/1943012632 conn(0x7f185c0b08f0 msgr2=0x7f185c0cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 shutdown_connections 2024-09-13T18:40:45.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.823+0000 7f1862000640 1 -- 172.21.15.192:0/1943012632 wait complete. 2024-09-13T18:40:45.842 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:40:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.994+0000 7fef1ea00640 1 Processor -- start 2024-09-13T18:40:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.994+0000 7fef1ea00640 1 -- start start 2024-09-13T18:40:45.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef180b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fef180b02f0 0x7fef1806fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1ea00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef1806f940 con 0x7fef180b2d90 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef1806f610 con 0x7fef180b02f0 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180b3530 con 0x7fef18142e00 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1cc00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fef180b2d90 0x7fef180afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49534/0 (socket says 172.21.15.192:49534) 2024-09-13T18:40:45.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1cc00640 1 -- 172.21.15.192:0/3467371641 learned_addr learned my addr 172.21.15.192:0/3467371641 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1d600640 1 --2- 172.21.15.192:0/3467371641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef180b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef1e000640 1 --2- 172.21.15.192:0/3467371641 >> v2:172.21.15.194:3300/0 conn(0x7fef180b02f0 0x7fef1806fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.996+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735975378 0 0) 0x7fef1806f940 con 0x7fef180b2d90 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef00003520 con 0x7fef180b2d90 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef1d600640 1 -- 172.21.15.192:0/3467371641 >> v2:172.21.15.194:3300/0 conn(0x7fef180b02f0 msgr2=0x7fef1806fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef1d600640 1 --2- 172.21.15.192:0/3467371641 >> v2:172.21.15.194:3300/0 conn(0x7fef180b02f0 0x7fef1806fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef1d600640 1 -- 172.21.15.192:0/3467371641 >> v1:172.21.15.192:6789/0 conn(0x7fef180b2d90 legacy=0x7fef180afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3914095071 0 0) 0x7fef00003520 con 0x7fef180b2d90 2024-09-13T18:40:46.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.997+0000 7fef1d600640 1 -- 172.21.15.192:0/3467371641 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef180b3810 con 0x7fef18142e00 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.998+0000 7fef1d600640 1 --2- 172.21.15.192:0/3467371641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef180b4910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097a0 tx=0x7fef0c02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b130e87d3f28b35 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.998+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04001670 con 0x7fef18142e00 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.998+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef0c02aba0 con 0x7fef18142e00 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.998+0000 7fef17e00640 1 -- 172.21.15.192:0/3467371641 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c032440 con 0x7fef18142e00 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 -- 172.21.15.192:0/3467371641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 msgr2=0x7fef180b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 --2- 172.21.15.192:0/3467371641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef180b4910 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0097a0 tx=0x7fef0c02a110 comp rx=0 tx=0).stop 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 -- 172.21.15.192:0/3467371641 shutdown_connections 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 --2- 172.21.15.192:0/3467371641 >> v2:172.21.15.194:3300/0 conn(0x7fef180b02f0 0x7fef1806fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 --2- 172.21.15.192:0/3467371641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef180b4910 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 -- 172.21.15.192:0/3467371641 >> 172.21.15.192:0/3467371641 conn(0x7fef180ae7f0 msgr2=0x7fef1806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 -- 172.21.15.192:0/3467371641 shutdown_connections 2024-09-13T18:40:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:45.999+0000 7fef1ea00640 1 -- 172.21.15.192:0/3467371641 wait complete. 2024-09-13T18:40:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.001+0000 7fef1ea00640 1 Processor -- start 2024-09-13T18:40:46.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.001+0000 7fef1ea00640 1 -- start start 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef180b02f0 0x7fef180cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef181ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180aad80 con 0x7fef180b2d90 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef180aa200 con 0x7fef180b02f0 2024-09-13T18:40:46.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef180aa4e0 con 0x7fef18142e00 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33494/0 (socket says 172.21.15.192:33494) 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 -- 172.21.15.192:0/2030026598 learned_addr learned my addr 172.21.15.192:0/2030026598 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1e000640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef181ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1d600640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef180b02f0 0x7fef180cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 -- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 msgr2=0x7fef181ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef181ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 -- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef180b02f0 msgr2=0x7fef180cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef180b02f0 0x7fef180cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.002+0000 7fef1cc00640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c009400 con 0x7fef180b2d90 2024-09-13T18:40:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef1cc00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fef040011e0 tx=0x7fef0400cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04005ad0 con 0x7fef180b2d90 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef04005c50 con 0x7fef180b2d90 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef04007070 con 0x7fef180b2d90 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef18143360 con 0x7fef180b2d90 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.003+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef180aaaa0 con 0x7fef180b2d90 2024-09-13T18:40:46.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.004+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef180b4910 con 0x7fef180b2d90 2024-09-13T18:40:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.005+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef040071d0 con 0x7fef180b2d90 2024-09-13T18:40:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.006+0000 7fef15600640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 0x7feef806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.006+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fef04088aa0 con 0x7fef180b2d90 2024-09-13T18:40:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.006+0000 7fef1d600640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 0x7feef806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.006+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=98}) v3 -- 0x7feef80728b0 con 0x7fef180b2d90 2024-09-13T18:40:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.007+0000 7fef1d600640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 0x7feef806d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034000 tx=0x7fef0c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.010+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef04017020 con 0x7fef180b2d90 2024-09-13T18:40:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.014+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(98..98 src has 1..98) v4 ==== 1468+0+0 (secure 0 0 0) 0x7fef04057960 con 0x7fef180b2d90 2024-09-13T18:40:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.014+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=99}) v3 -- 0x7feef8073b20 con 0x7fef180b2d90 2024-09-13T18:40:46.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.183+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fef1812e3f0 con 0x7fef180b2d90 2024-09-13T18:40:46.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.183+0000 7fef15600640 1 -- 172.21.15.192:0/2030026598 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) v1 ==== 100+0+11 (secure 0 0 0) 0x7fef04053ca0 con 0x7fef180b2d90 2024-09-13T18:40:46.186 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:40:46.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 msgr2=0x7feef806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 0x7feef806d0c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fef0c034000 tx=0x7fef0c02e000 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 msgr2=0x7fef180cc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fef040011e0 tx=0x7fef0400cc00 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 shutdown_connections 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feef806ac00 0x7feef806d0c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef18142e00 0x7fef181ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef180b2d90 0x7fef180cc780 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 --2- 172.21.15.192:0/2030026598 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef180b02f0 0x7fef180cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 >> 172.21.15.192:0/2030026598 conn(0x7fef180ae7f0 msgr2=0x7fef180713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.185+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 shutdown_connections 2024-09-13T18:40:46.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.186+0000 7fef1ea00640 1 -- 172.21.15.192:0/2030026598 wait complete. 2024-09-13T18:40:46.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:46.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.352+0000 7fdd7b000640 1 Processor -- start 2024-09-13T18:40:46.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.352+0000 7fdd7b000640 1 -- start start 2024-09-13T18:40:46.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd7b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 0x7fdd740afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd7b000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd740b3f10 0x7fdd740b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd7b000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd740b2f00 con 0x7fdd7415e2c0 2024-09-13T18:40:46.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd7b000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd740b3150 con 0x7fdd740b3f10 2024-09-13T18:40:46.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd7b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740b3430 con 0x7fdd7415dee0 2024-09-13T18:40:46.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd73e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 0x7fdd740afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd6b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdd740b3f10 0x7fdd740b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd79000640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fdd7415e2c0 0x7fdd7415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:48232/0 (socket says 172.21.15.192:48232) 2024-09-13T18:40:46.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.354+0000 7fdd79000640 1 -- 172.21.15.192:0/3950811964 learned_addr learned my addr 172.21.15.192:0/3950811964 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.355+0000 7fdd6b400640 1 -- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 msgr2=0x7fdd740afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.355+0000 7fdd6b400640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 0x7fdd740afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.355+0000 7fdd6b400640 1 -- 172.21.15.192:0/3950811964 >> v1:172.21.15.194:6789/0 conn(0x7fdd7415e2c0 legacy=0x7fdd7415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.355+0000 7fdd6b400640 1 -- 172.21.15.192:0/3950811964 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd740b3710 con 0x7fdd740b3f10 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.355+0000 7fdd73e00640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 0x7fdd740afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:46.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.356+0000 7fdd6b400640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd740b3f10 0x7fdd740b02c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097a0 tx=0x7fdd5c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e38cc724d3e1ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.356+0000 7fdd73400640 1 -- 172.21.15.192:0/3950811964 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032440 con 0x7fdd740b3f10 2024-09-13T18:40:46.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.356+0000 7fdd73400640 1 -- 172.21.15.192:0/3950811964 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5c0325a0 con 0x7fdd740b3f10 2024-09-13T18:40:46.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.356+0000 7fdd73400640 1 -- 172.21.15.192:0/3950811964 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5c032930 con 0x7fdd740b3f10 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 -- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd740b3f10 msgr2=0x7fdd740b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd740b3f10 0x7fdd740b02c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0097a0 tx=0x7fdd5c02a180 comp rx=0 tx=0).stop 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 -- 172.21.15.192:0/3950811964 shutdown_connections 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd740b3f10 0x7fdd740b02c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 --2- 172.21.15.192:0/3950811964 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd7415dee0 0x7fdd740afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 -- 172.21.15.192:0/3950811964 >> 172.21.15.192:0/3950811964 conn(0x7fdd740ae960 msgr2=0x7fdd7406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 -- 172.21.15.192:0/3950811964 shutdown_connections 2024-09-13T18:40:46.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.357+0000 7fdd7b000640 1 -- 172.21.15.192:0/3950811964 wait complete. 2024-09-13T18:40:46.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.359+0000 7fdd7b000640 1 Processor -- start 2024-09-13T18:40:46.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.359+0000 7fdd7b000640 1 -- start start 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 0x7fdd741500a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd74138d90 0x7fdd740ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74138450 con 0x7fdd7415dee0 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74138730 con 0x7fdd7415e2c0 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd7b000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74138a10 con 0x7fdd74138d90 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33504/0 (socket says 172.21.15.192:33504) 2024-09-13T18:40:46.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd73e00640 1 -- 172.21.15.192:0/1409033134 learned_addr learned my addr 172.21.15.192:0/1409033134 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:46.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd6b400640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 0x7fdd741500a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.360+0000 7fdd79000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd74138d90 0x7fdd740ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 -- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd74138d90 msgr2=0x7fdd740ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd74138d90 0x7fdd740ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 -- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 msgr2=0x7fdd741500a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 0x7fdd741500a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 -- 172.21.15.192:0/1409033134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd64009400 con 0x7fdd7415dee0 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd6b400640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 0x7fdd741500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd73e00640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400ebe0 tx=0x7fdd6400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd64009760 con 0x7fdd7415dee0 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6400cc30 con 0x7fdd7415dee0 2024-09-13T18:40:46.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6400eee0 con 0x7fdd7415dee0 2024-09-13T18:40:46.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c009400 con 0x7fdd7415dee0 2024-09-13T18:40:46.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.361+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7413b6a0 con 0x7fdd7415dee0 2024-09-13T18:40:46.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.362+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7415a750 con 0x7fdd7415dee0 2024-09-13T18:40:46.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.363+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdd64013470 con 0x7fdd7415dee0 2024-09-13T18:40:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.364+0000 7fdd70c00640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 0x7fdd5006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.364+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fdd640896b0 con 0x7fdd7415dee0 2024-09-13T18:40:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.364+0000 7fdd6b400640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 0x7fdd5006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.365+0000 7fdd6b400640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 0x7fdd5006d0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c034000 tx=0x7fdd5c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.368+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdd64054820 con 0x7fdd7415dee0 2024-09-13T18:40:46.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.569+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd7415a440 con 0x7fdd7415dee0 2024-09-13T18:40:46.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.570+0000 7fdd70c00640 1 -- 172.21.15.192:0/1409033134 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7fdd64057e40 con 0x7fdd7415dee0 2024-09-13T18:40:46.573 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:46.573 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:46.573 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 msgr2=0x7fdd5006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 0x7fdd5006d0f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c034000 tx=0x7fdd5c02e000 comp rx=0 tx=0).stop 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 msgr2=0x7fdd7413bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7fdd6400ebe0 tx=0x7fdd6400c520 comp rx=0 tx=0).stop 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 shutdown_connections 2024-09-13T18:40:46.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdd5006ac30 0x7fdd5006d0f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdd74138d90 0x7fdd740ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdd7415e2c0 0x7fdd741500a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 --2- 172.21.15.192:0/1409033134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd7415dee0 0x7fdd7413bea0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 >> 172.21.15.192:0/1409033134 conn(0x7fdd740ae960 msgr2=0x7fdd74070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 shutdown_connections 2024-09-13T18:40:46.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.572+0000 7fdd7b000640 1 -- 172.21.15.192:0/1409033134 wait complete. 2024-09-13T18:40:46.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:46.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.740+0000 7fee22600640 1 Processor -- start 2024-09-13T18:40:46.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.740+0000 7fee22600640 1 -- start start 2024-09-13T18:40:46.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.741+0000 7fee22600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fee1c15dee0 0x7fee1c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.741+0000 7fee22600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1c0b3f10 0x7fee1c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee22600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee1c0b2f00 con 0x7fee1c15e2c0 2024-09-13T18:40:46.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee22600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee1c0b3150 con 0x7fee1c15dee0 2024-09-13T18:40:46.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee22600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0b3430 con 0x7fee1c0b3f10 2024-09-13T18:40:46.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fee1c15e2c0 0x7fee1c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49538/0 (socket says 172.21.15.192:49538) 2024-09-13T18:40:46.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1be00640 1 -- 172.21.15.192:0/877519828 learned_addr learned my addr 172.21.15.192:0/877519828 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:46.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1b400640 1 --2- 172.21.15.192:0/877519828 >> v2:172.21.15.194:3300/0 conn(0x7fee1c15dee0 0x7fee1c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1aa00640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1c0b3f10 0x7fee1c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167788240 0 0) 0x7fee1c0b2f00 con 0x7fee1c15e2c0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee00003520 con 0x7fee1c15e2c0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.742+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2939057715 0 0) 0x7fee00003520 con 0x7fee1c15e2c0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1c0b3f10 msgr2=0x7fee1c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee1c0b3f10 0x7fee1c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 >> v2:172.21.15.194:3300/0 conn(0x7fee1c15dee0 msgr2=0x7fee1c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 --2- 172.21.15.192:0/877519828 >> v2:172.21.15.194:3300/0 conn(0x7fee1c15dee0 0x7fee1c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c0b3710 con 0x7fee1c15e2c0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fee14001670 con 0x7fee1c15e2c0 2024-09-13T18:40:46.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 >> v1:172.21.15.192:6789/0 conn(0x7fee1c15e2c0 legacy=0x7fee1c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee00003970 0x7fee00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee000047c0 0x7fee00004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee00005140 0x7fee0000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0b3150 con 0x7fee00005140 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0b3430 con 0x7fee00003970 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0000e0d0 con 0x7fee000047c0 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1be00640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee00005140 0x7fee0000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee00003970 0x7fee00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1aa00640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee000047c0 0x7fee00004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 -- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee000047c0 msgr2=0x7fee00004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee000047c0 0x7fee00004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 -- 172.21.15.192:0/877519828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee00005140 msgr2=0x7fee0000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee00005140 0x7fee0000db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.743+0000 7fee1b400640 1 -- 172.21.15.192:0/877519828 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee00003520 con 0x7fee00003970 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.744+0000 7fee1be00640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee00005140 0x7fee0000db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.744+0000 7fee1b400640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee00003970 0x7fee00003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009fc0 tx=0x7fee000057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ddd12ebe2d01e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c031670 con 0x7fee00003970 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0c00f040 con 0x7fee00003970 2024-09-13T18:40:46.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee1a000640 1 -- 172.21.15.192:0/877519828 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0c031a10 con 0x7fee00003970 2024-09-13T18:40:46.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 -- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee00003970 msgr2=0x7fee00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 --2- 172.21.15.192:0/877519828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee00003970 0x7fee00003d90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fee0c009fc0 tx=0x7fee000057f0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee1be00640 1 -- 172.21.15.192:0/877519828 reap_dead start 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 -- 172.21.15.192:0/877519828 shutdown_connections 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 -- 172.21.15.192:0/877519828 >> 172.21.15.192:0/877519828 conn(0x7fee1c0ae960 msgr2=0x7fee1c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 -- 172.21.15.192:0/877519828 shutdown_connections 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.745+0000 7fee22600640 1 -- 172.21.15.192:0/877519828 wait complete. 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.747+0000 7fee22600640 1 Processor -- start 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.747+0000 7fee22600640 1 -- start start 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee00003970 0x7fee1c137490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee1c141a40 0x7fee1c13f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c0715b0 con 0x7fee1c1415c0 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c13ff30 con 0x7fee1c141a40 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee22600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee1c13f970 con 0x7fee00003970 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee1aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee1aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33524/0 (socket says 172.21.15.192:33524) 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.748+0000 7fee1aa00640 1 -- 172.21.15.192:0/3463600829 learned_addr learned my addr 172.21.15.192:0/3463600829 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1be00640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee1c141a40 0x7fee1c13f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1b400640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee00003970 0x7fee1c137490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 -- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee00003970 msgr2=0x7fee1c137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee00003970 0x7fee1c137490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 -- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee1c141a40 msgr2=0x7fee1c13f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee1c141a40 0x7fee1c13f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 -- 172.21.15.192:0/3463600829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c13fc50 con 0x7fee1c1415c0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee1aa00640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fee080118e0 tx=0x7fee08011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0800faf0 con 0x7fee1c1415c0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee0800fc50 con 0x7fee1c1415c0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee08014440 con 0x7fee1c1415c0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee1c13d100 con 0x7fee1c1415c0 2024-09-13T18:40:46.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.749+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee1c1379d0 con 0x7fee1c1415c0 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.750+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee1c0b3f10 con 0x7fee1c1415c0 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.751+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fee080145a0 con 0x7fee1c1415c0 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.752+0000 7fee13400640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 0x7fedfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.753+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fee08089d60 con 0x7fee1c1415c0 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.753+0000 7fee1b400640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 0x7fedfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:46.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.753+0000 7fee1b400640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 0x7fedfc06d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fee0c035000 tx=0x7fee0c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:46.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.757+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fee08054e20 con 0x7fee1c1415c0 2024-09-13T18:40:46.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.926+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee1c15d220 con 0x7fee1c1415c0 2024-09-13T18:40:46.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.927+0000 7fee13400640 1 -- 172.21.15.192:0/3463600829 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) v1 ==== 74+0+16868 (secure 0 0 0) 0x7fee08058440 con 0x7fee1c1415c0 2024-09-13T18:40:46.930 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:46.930 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":98,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:46.013353+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["backfillfull","exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["backfillfull","exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.5","mappings":[{"from":1,"to":7}]},{"pgid":"11.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 msgr2=0x7fedfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 0x7fedfc06d0c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fee0c035000 tx=0x7fee0c02f000 comp rx=0 tx=0).stop 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 msgr2=0x7fee1c13ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fee080118e0 tx=0x7fee08011da0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 shutdown_connections 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedfc06ac00 0x7fedfc06d0c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fee1c141a40 0x7fee1c13f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee1c1415c0 0x7fee1c13ee00 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 --2- 172.21.15.192:0/3463600829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fee00003970 0x7fee1c137490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 >> 172.21.15.192:0/3463600829 conn(0x7fee1c0ae960 msgr2=0x7fee1c06fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 shutdown_connections 2024-09-13T18:40:46.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:46.929+0000 7fee22600640 1 -- 172.21.15.192:0/3463600829 wait complete. 2024-09-13T18:40:46.948 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:40:46.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:47.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.101+0000 7f1a50c00640 1 Processor -- start 2024-09-13T18:40:47.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.101+0000 7f1a50c00640 1 -- start start 2024-09-13T18:40:47.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a50c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a4c146610 0x7f1a4c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a50c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a4c0ae770 con 0x7f1a4c0afd80 2024-09-13T18:40:47.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a50c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a4c0cd920 con 0x7f1a4c146610 2024-09-13T18:40:47.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a50c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c0cdb30 con 0x7f1a4c0b2780 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a4c146610 0x7f1a4c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1a4c146610 0x7f1a4c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33532/0 (socket says 172.21.15.192:33532) 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 -- 172.21.15.192:0/614829638 learned_addr learned my addr 172.21.15.192:0/614829638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49400640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 -- 172.21.15.192:0/614829638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 msgr2=0x7f1a4c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 -- 172.21.15.192:0/614829638 >> v1:172.21.15.194:6789/0 conn(0x7f1a4c0afd80 legacy=0x7f1a4c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49e00640 1 -- 172.21.15.192:0/614829638 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0ae1b0 con 0x7f1a4c146610 2024-09-13T18:40:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.103+0000 7f1a49400640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:47.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.104+0000 7f1a49e00640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c146610 0x7f1a4c0ce2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b811cfa0527b2b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a48a00640 1 -- 172.21.15.192:0/614829638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c032440 con 0x7f1a4c146610 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a48a00640 1 -- 172.21.15.192:0/614829638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c0325a0 con 0x7f1a4c146610 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a48a00640 1 -- 172.21.15.192:0/614829638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c032930 con 0x7f1a4c146610 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 -- 172.21.15.192:0/614829638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c146610 msgr2=0x7f1a4c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c146610 0x7f1a4c0ce2f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c02a210 comp rx=0 tx=0).stop 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 -- 172.21.15.192:0/614829638 shutdown_connections 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 --2- 172.21.15.192:0/614829638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c146610 0x7f1a4c0ce2f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 -- 172.21.15.192:0/614829638 >> 172.21.15.192:0/614829638 conn(0x7f1a4c0ae960 msgr2=0x7f1a4c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 -- 172.21.15.192:0/614829638 shutdown_connections 2024-09-13T18:40:47.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.105+0000 7f1a50c00640 1 -- 172.21.15.192:0/614829638 wait complete. 2024-09-13T18:40:47.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.107+0000 7f1a50c00640 1 Processor -- start 2024-09-13T18:40:47.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.107+0000 7f1a50c00640 1 -- start start 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c15c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 0x7f1a4c15ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c15ba40 con 0x7f1a4c0afd80 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c157be0 con 0x7f1a4c146610 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a50c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a4c157ec0 con 0x7f1a4c0b2780 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a49e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a49e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33546/0 (socket says 172.21.15.192:33546) 2024-09-13T18:40:47.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.108+0000 7f1a49e00640 1 -- 172.21.15.192:0/343581118 learned_addr learned my addr 172.21.15.192:0/343581118 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49400640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c15c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 -- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 msgr2=0x7f1a4c15c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a4a800640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 0x7f1a4c15ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c15c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 -- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 msgr2=0x7f1a4c15ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 0x7f1a4c15ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 -- 172.21.15.192:0/343581118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a3c0094d0 con 0x7f1a4c0afd80 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49400640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a4a800640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 0x7f1a4c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a49e00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c030b00 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a3c030c60 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a4c1581a0 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c03d420 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.109+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a4c1f4060 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.110+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a4c0ce2f0 con 0x7f1a4c0afd80 2024-09-13T18:40:47.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.111+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1a3c039040 con 0x7f1a4c0afd80 2024-09-13T18:40:47.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.113+0000 7f1a42000640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 0x7f1a2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.113+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1a3c0aa0f0 con 0x7f1a4c0afd80 2024-09-13T18:40:47.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.113+0000 7f1a49400640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 0x7f1a2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.113+0000 7f1a49400640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 0x7f1a2c06d0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c159f80 tx=0x7f1a38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.117+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1a3c075360 con 0x7f1a4c0afd80 2024-09-13T18:40:47.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.317+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1a4c0b3cd0 con 0x7f1a4c0afd80 2024-09-13T18:40:47.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.317+0000 7f1a42000640 1 -- 172.21.15.192:0/343581118 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f1a3c078980 con 0x7f1a4c0afd80 2024-09-13T18:40:47.320 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:47.320 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:47.321 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 msgr2=0x7f1a2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 0x7f1a2c06d0c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c159f80 tx=0x7f1a38008040 comp rx=0 tx=0).stop 2024-09-13T18:40:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 msgr2=0x7f1a4c1f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c009870 tx=0x7f1a3c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 shutdown_connections 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1a2c06ac00 0x7f1a2c06d0c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1a4c146610 0x7f1a4c15ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1a4c0b2780 0x7f1a4c15c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 --2- 172.21.15.192:0/343581118 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1a4c0afd80 0x7f1a4c1f3b20 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 >> 172.21.15.192:0/343581118 conn(0x7f1a4c0ae960 msgr2=0x7f1a4c15e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 shutdown_connections 2024-09-13T18:40:47.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.319+0000 7f1a50c00640 1 -- 172.21.15.192:0/343581118 wait complete. 2024-09-13T18:40:47.338 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:47.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.487+0000 7f66fd200640 1 Processor -- start 2024-09-13T18:40:47.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.487+0000 7f66fd200640 1 -- start start 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.488+0000 7f66fd200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f66f8146610 0x7f66f80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.488+0000 7f66fd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f80b2780 0x7f66f80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.488+0000 7f66fd200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66f80ae770 con 0x7f66f80afd80 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.488+0000 7f66fd200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66f80cd920 con 0x7f66f8146610 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.488+0000 7f66fd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f80cdb30 con 0x7f66f80b2780 2024-09-13T18:40:47.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f66f8146610 0x7f66f80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f66f8146610 0x7f66f80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33560/0 (socket says 172.21.15.192:33560) 2024-09-13T18:40:47.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 -- 172.21.15.192:0/937888666 learned_addr learned my addr 172.21.15.192:0/937888666 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5400640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f80b2780 0x7f66f80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 -- 172.21.15.192:0/937888666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f80b2780 msgr2=0x7f66f80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f80b2780 0x7f66f80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 -- 172.21.15.192:0/937888666 >> v1:172.21.15.194:6789/0 conn(0x7f66f80afd80 legacy=0x7f66f80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.489+0000 7f66f5e00640 1 -- 172.21.15.192:0/937888666 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66f80ae1b0 con 0x7f66f8146610 2024-09-13T18:40:47.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.490+0000 7f66f5e00640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f8146610 0x7f66f80ce2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009e50 tx=0x7f66e802a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c78b4f9df8299e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.490+0000 7f66f4a00640 1 -- 172.21.15.192:0/937888666 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e802aea0 con 0x7f66f8146610 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.490+0000 7f66f4a00640 1 -- 172.21.15.192:0/937888666 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e802d050 con 0x7f66f8146610 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.490+0000 7f66f4a00640 1 -- 172.21.15.192:0/937888666 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8031820 con 0x7f66f8146610 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 -- 172.21.15.192:0/937888666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f8146610 msgr2=0x7f66f80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f8146610 0x7f66f80ce2f0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009e50 tx=0x7f66e802a6c0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 -- 172.21.15.192:0/937888666 shutdown_connections 2024-09-13T18:40:47.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f80b2780 0x7f66f80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 --2- 172.21.15.192:0/937888666 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f8146610 0x7f66f80ce2f0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 -- 172.21.15.192:0/937888666 >> 172.21.15.192:0/937888666 conn(0x7f66f80ae960 msgr2=0x7f66f806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 -- 172.21.15.192:0/937888666 shutdown_connections 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.491+0000 7f66fd200640 1 -- 172.21.15.192:0/937888666 wait complete. 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.493+0000 7f66fd200640 1 Processor -- start 2024-09-13T18:40:47.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.493+0000 7f66fd200640 1 -- start start 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f80afd80 0x7f66f806f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f8146610 0x7f66f806e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8158d10 con 0x7f66f80b2780 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8140b10 con 0x7f66f80afd80 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66fd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66f8140df0 con 0x7f66f8146610 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33574/0 (socket says 172.21.15.192:33574) 2024-09-13T18:40:47.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 -- 172.21.15.192:0/2313968178 learned_addr learned my addr 172.21.15.192:0/2313968178 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f6800640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f8146610 0x7f66f806e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5e00640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f80afd80 0x7f66f806f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 -- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f8146610 msgr2=0x7f66f806e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f8146610 0x7f66f806e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 -- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f80afd80 msgr2=0x7f66f806f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f80afd80 0x7f66f806f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.494+0000 7f66f5400640 1 -- 172.21.15.192:0/2313968178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e8009b30 con 0x7f66f80b2780 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66f5400640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f66e400d7d0 tx=0x7f66e400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400b6c0 con 0x7f66f80b2780 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e400b820 con 0x7f66f80b2780 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f81410d0 con 0x7f66f80b2780 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400bbb0 con 0x7f66f80b2780 2024-09-13T18:40:47.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.495+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f8141690 con 0x7f66f80b2780 2024-09-13T18:40:47.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.496+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66f80ce2f0 con 0x7f66f80b2780 2024-09-13T18:40:47.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.497+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f66e400bd10 con 0x7f66f80b2780 2024-09-13T18:40:47.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.498+0000 7f66ee000640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 0x7f66d806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.498+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f66e40897d0 con 0x7f66f80b2780 2024-09-13T18:40:47.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.498+0000 7f66f5e00640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 0x7f66d806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.499+0000 7f66f5e00640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 0x7f66d806d0f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f66e8033000 tx=0x7f66e8009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.502+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f66e40549d0 con 0x7f66f80b2780 2024-09-13T18:40:47.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.702+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66f81610f0 con 0x7f66f80b2780 2024-09-13T18:40:47.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.703+0000 7f66ee000640 1 -- 172.21.15.192:0/2313968178 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4742 (secure 0 0 0) 0x7f66e4057ff0 con 0x7f66f80b2780 2024-09-13T18:40:47.706 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:47.706 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:39:56.286918+0000","modified":"2024-09-13T18:39:59.300225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6453},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6453":{"gid":6453,"name":"a","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/887376150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":887376150},{"type":"v1","addr":"172.21.15.192:6837","nonce":887376150}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-09-13T18:40:47.706 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 40 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 msgr2=0x7f66d806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 0x7f66d806d0f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f66e8033000 tx=0x7f66e8009000 comp rx=0 tx=0).stop 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 msgr2=0x7f66f806feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f66e400d7d0 tx=0x7f66e400dc90 comp rx=0 tx=0).stop 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 shutdown_connections 2024-09-13T18:40:47.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f66d806ac30 0x7f66d806d0f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f66f8146610 0x7f66f806e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66f80b2780 0x7f66f806feb0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 --2- 172.21.15.192:0/2313968178 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f66f80afd80 0x7f66f806f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 >> 172.21.15.192:0/2313968178 conn(0x7f66f80ae960 msgr2=0x7f66f80ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 shutdown_connections 2024-09-13T18:40:47.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.705+0000 7f66fd200640 1 -- 172.21.15.192:0/2313968178 wait complete. 2024-09-13T18:40:47.724 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:47.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.874+0000 7fa692200640 1 Processor -- start 2024-09-13T18:40:47.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.874+0000 7fa692200640 1 -- start start 2024-09-13T18:40:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa692200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa68c15e790 0x7fa68c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa692200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa68c15bc20 0x7fa68c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa692200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c15ec00 con 0x7fa68c0cacd0 2024-09-13T18:40:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa692200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c0cb5f0 con 0x7fa68c15e790 2024-09-13T18:40:47.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa692200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c140480 con 0x7fa68c15bc20 2024-09-13T18:40:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa682a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa68c15e790 0x7fa68c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa682a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa68c15e790 0x7fa68c0cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33586/0 (socket says 172.21.15.192:33586) 2024-09-13T18:40:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.875+0000 7fa682a00640 1 -- 172.21.15.192:0/3564104520 learned_addr learned my addr 172.21.15.192:0/3564104520 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.876+0000 7fa68be00640 1 --2- 172.21.15.192:0/3564104520 >> v2:172.21.15.194:3300/0 conn(0x7fa68c15bc20 0x7fa68c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.876+0000 7fa682a00640 1 -- 172.21.15.192:0/3564104520 >> v2:172.21.15.194:3300/0 conn(0x7fa68c15bc20 msgr2=0x7fa68c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.876+0000 7fa682a00640 1 --2- 172.21.15.192:0/3564104520 >> v2:172.21.15.194:3300/0 conn(0x7fa68c15bc20 0x7fa68c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.876+0000 7fa682a00640 1 -- 172.21.15.192:0/3564104520 >> v1:172.21.15.194:6789/0 conn(0x7fa68c0cacd0 legacy=0x7fa68c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:47.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.876+0000 7fa682a00640 1 -- 172.21.15.192:0/3564104520 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c15ee90 con 0x7fa68c15e790 2024-09-13T18:40:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.877+0000 7fa682a00640 1 --2- 172.21.15.192:0/3564104520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15e790 0x7fa68c0cb0b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa68c158ce0 tx=0x7fa67402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6079e19c45b75e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.877+0000 7fa68aa00640 1 -- 172.21.15.192:0/3564104520 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674032440 con 0x7fa68c15e790 2024-09-13T18:40:47.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.877+0000 7fa68aa00640 1 -- 172.21.15.192:0/3564104520 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6740325a0 con 0x7fa68c15e790 2024-09-13T18:40:47.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.877+0000 7fa68aa00640 1 -- 172.21.15.192:0/3564104520 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674032930 con 0x7fa68c15e790 2024-09-13T18:40:47.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 -- 172.21.15.192:0/3564104520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15e790 msgr2=0x7fa68c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 --2- 172.21.15.192:0/3564104520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15e790 0x7fa68c0cb0b0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7fa68c158ce0 tx=0x7fa67402a230 comp rx=0 tx=0).stop 2024-09-13T18:40:47.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 -- 172.21.15.192:0/3564104520 shutdown_connections 2024-09-13T18:40:47.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 --2- 172.21.15.192:0/3564104520 >> v2:172.21.15.194:3300/0 conn(0x7fa68c15bc20 0x7fa68c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 --2- 172.21.15.192:0/3564104520 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15e790 0x7fa68c0cb0b0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 -- 172.21.15.192:0/3564104520 >> 172.21.15.192:0/3564104520 conn(0x7fa68c0ae960 msgr2=0x7fa68c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:47.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 -- 172.21.15.192:0/3564104520 shutdown_connections 2024-09-13T18:40:47.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.878+0000 7fa692200640 1 -- 172.21.15.192:0/3564104520 wait complete. 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.879+0000 7fa692200640 1 Processor -- start 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.879+0000 7fa692200640 1 -- start start 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c0cacd0 0x7fa68c157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c15e790 0x7fa68c13d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c157c80 con 0x7fa68c15bc20 2024-09-13T18:40:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c15b060 con 0x7fa68c0cacd0 2024-09-13T18:40:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.880+0000 7fa692200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c158710 con 0x7fa68c15e790 2024-09-13T18:40:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33592/0 (socket says 172.21.15.192:33592) 2024-09-13T18:40:47.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 -- 172.21.15.192:0/1846225423 learned_addr learned my addr 172.21.15.192:0/1846225423 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa68b400640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c0cacd0 0x7fa68c157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa68be00640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c15e790 0x7fa68c13d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 -- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c15e790 msgr2=0x7fa68c13d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c15e790 0x7fa68c13d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 -- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c0cacd0 msgr2=0x7fa68c157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c0cacd0 0x7fa68c157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 -- 172.21.15.192:0/1846225423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6740094d0 con 0x7fa68c15bc20 2024-09-13T18:40:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.881+0000 7fa682a00640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa67402a270 tx=0x7fa6740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.882+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa674032440 con 0x7fa68c15bc20 2024-09-13T18:40:47.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.882+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa674030b80 con 0x7fa68c15bc20 2024-09-13T18:40:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.882+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67403d420 con 0x7fa68c15bc20 2024-09-13T18:40:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.882+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c069fd0 con 0x7fa68c15bc20 2024-09-13T18:40:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.882+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c158150 con 0x7fa68c15bc20 2024-09-13T18:40:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.883+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c0cb0b0 con 0x7fa68c15bc20 2024-09-13T18:40:47.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.884+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa674039040 con 0x7fa68c15bc20 2024-09-13T18:40:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.885+0000 7fa683e00640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 0x7fa66806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.885+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa6740a9ee0 con 0x7fa68c15bc20 2024-09-13T18:40:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.885+0000 7fa68b400640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 0x7fa66806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:47.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.885+0000 7fa68b400640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 0x7fa66806d0f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa68c15a380 tx=0x7fa67c00d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:47.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:47.889+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa6740750e0 con 0x7fa68c15bc20 2024-09-13T18:40:48.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.060+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa68c06a160 con 0x7fa68c15bc20 2024-09-13T18:40:48.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.061+0000 7fa683e00640 1 -- 172.21.15.192:0/1846225423 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16839 (secure 0 0 0) 0x7fa674078700 con 0x7fa68c15bc20 2024-09-13T18:40:48.066 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:48.066 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":100,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:48.028128+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:39:54.526138+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-13T18:39:55.272341+0000","flags":4097,"flags_names":"hashpspool,backfillfull","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"98","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["backfillfull","exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"10.1b","mappings":[{"from":2,"to":7}]},{"pgid":"11.1","mappings":[{"from":1,"to":4}]},{"pgid":"11.5","mappings":[{"from":1,"to":7}]},{"pgid":"11.13","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.063+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 msgr2=0x7fa66806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.063+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 0x7fa66806d0f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa68c15a380 tx=0x7fa67c00d040 comp rx=0 tx=0).stop 2024-09-13T18:40:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 msgr2=0x7fa68c15ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7fa67402a270 tx=0x7fa6740046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 shutdown_connections 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66806ac30 0x7fa66806d0f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c15e790 0x7fa68c13d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c15bc20 0x7fa68c15ab20 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 --2- 172.21.15.192:0/1846225423 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c0cacd0 0x7fa68c157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 >> 172.21.15.192:0/1846225423 conn(0x7fa68c0ae960 msgr2=0x7fa68c15c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 shutdown_connections 2024-09-13T18:40:48.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.064+0000 7fa692200640 1 -- 172.21.15.192:0/1846225423 wait complete. 2024-09-13T18:40:48.082 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:40:48.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.231+0000 7f0c7d600640 1 Processor -- start 2024-09-13T18:40:48.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.232+0000 7f0c7d600640 1 -- start start 2024-09-13T18:40:48.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0c780cd5b0 0x7f0c780cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c7806b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7d600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7806bf10 con 0x7f0c781598d0 2024-09-13T18:40:48.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780cdf60 con 0x7f0c780cd5b0 2024-09-13T18:40:48.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780b2e10 con 0x7f0c7806b180 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c77e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0c781598d0 0x7f0c780b3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49548/0 (socket says 172.21.15.192:49548) 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c77e00640 1 -- 172.21.15.192:0/4121204551 learned_addr learned my addr 172.21.15.192:0/4121204551 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c77400640 1 --2- 172.21.15.192:0/4121204551 >> v2:172.21.15.194:3300/0 conn(0x7f0c780cd5b0 0x7f0c780cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.233+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/4121204551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c7806b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c76a00640 1 -- 172.21.15.192:0/4121204551 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923844103 0 0) 0x7f0c7806bf10 con 0x7f0c781598d0 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c76a00640 1 -- 172.21.15.192:0/4121204551 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5c003520 con 0x7f0c781598d0 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c7cc00640 1 -- 172.21.15.192:0/4121204551 >> v2:172.21.15.194:3300/0 conn(0x7f0c780cd5b0 msgr2=0x7f0c780cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/4121204551 >> v2:172.21.15.194:3300/0 conn(0x7f0c780cd5b0 0x7f0c780cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c7cc00640 1 -- 172.21.15.192:0/4121204551 >> v1:172.21.15.192:6789/0 conn(0x7f0c781598d0 legacy=0x7f0c780b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.234+0000 7f0c7cc00640 1 -- 172.21.15.192:0/4121204551 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780b30f0 con 0x7f0c7806b180 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.235+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/4121204551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c7806b5e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009d90 tx=0x7f0c7002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e10070ee4412503 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.235+0000 7f0c76a00640 1 -- 172.21.15.192:0/4121204551 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007740 con 0x7f0c7806b180 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.235+0000 7f0c76a00640 1 -- 172.21.15.192:0/4121204551 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7002d050 con 0x7f0c7806b180 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.235+0000 7f0c76a00640 1 -- 172.21.15.192:0/4121204551 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70007aa0 con 0x7f0c7806b180 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 -- 172.21.15.192:0/4121204551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 msgr2=0x7f0c7806b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 --2- 172.21.15.192:0/4121204551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c7806b5e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009d90 tx=0x7f0c7002a660 comp rx=0 tx=0).stop 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 -- 172.21.15.192:0/4121204551 shutdown_connections 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 --2- 172.21.15.192:0/4121204551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c7806b5e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 --2- 172.21.15.192:0/4121204551 >> v2:172.21.15.194:3300/0 conn(0x7f0c780cd5b0 0x7f0c780cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 -- 172.21.15.192:0/4121204551 >> 172.21.15.192:0/4121204551 conn(0x7f0c780736d0 msgr2=0x7f0c780b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 -- 172.21.15.192:0/4121204551 shutdown_connections 2024-09-13T18:40:48.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.236+0000 7f0c7d600640 1 -- 172.21.15.192:0/4121204551 wait complete. 2024-09-13T18:40:48.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.238+0000 7f0c7d600640 1 Processor -- start 2024-09-13T18:40:48.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.238+0000 7f0c7d600640 1 -- start start 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c780aced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 0x7f0c781f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781f7e80 con 0x7f0c781598d0 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781513f0 con 0x7f0c780cd5b0 2024-09-13T18:40:48.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7815b230 con 0x7f0c7806b180 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33602/0 (socket says 172.21.15.192:33602) 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 -- 172.21.15.192:0/3366333001 learned_addr learned my addr 172.21.15.192:0/3366333001 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c77e00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c780aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c77400640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 0x7f0c781f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 -- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 msgr2=0x7f0c780aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c780aced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 -- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 msgr2=0x7f0c781f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 0x7f0c781f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c7cc00640 1 -- 172.21.15.192:0/3366333001 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70009a70 con 0x7f0c781598d0 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.239+0000 7f0c77400640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 0x7f0c781f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:48.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c7cc00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009eb0 tx=0x7f0c70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7003c830 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7003c9b0 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7815b510 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7003cd60 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.240+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7815bad0 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.241+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7806b5e0 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.242+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c70031400 con 0x7f0c781598d0 2024-09-13T18:40:48.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.243+0000 7f0c6fe00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 0x7f0c5806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.243+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0c700aaba0 con 0x7f0c781598d0 2024-09-13T18:40:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.243+0000 7f0c77e00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 0x7f0c5806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.244+0000 7f0c77e00640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 0x7f0c5806d0f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005880 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.247+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c70075c60 con 0x7f0c781598d0 2024-09-13T18:40:48.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.451+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f0c780cd390 con 0x7f0c781598d0 2024-09-13T18:40:48.455 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:40:48.452+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:40:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.462+0000 7f0c6fe00640 1 -- 172.21.15.192:0/3366333001 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0c70079280 con 0x7f0c781598d0 2024-09-13T18:40:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:40:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 msgr2=0x7f0c5806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 0x7f0c5806d0f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0c68005880 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2024-09-13T18:40:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 msgr2=0x7f0c78150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0c70009eb0 tx=0x7f0c70004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:48.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 shutdown_connections 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c5806ac30 0x7f0c5806d0f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c781598d0 0x7f0c78150eb0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c780cd5b0 0x7f0c781f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 --2- 172.21.15.192:0/3366333001 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c7806b180 0x7f0c780aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 >> 172.21.15.192:0/3366333001 conn(0x7f0c780736d0 msgr2=0x7f0c780b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 shutdown_connections 2024-09-13T18:40:48.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.465+0000 7f0c7d600640 1 -- 172.21.15.192:0/3366333001 wait complete. 2024-09-13T18:40:48.485 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:40:48.532 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:40:48.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.640+0000 7f5366800640 1 Processor -- start 2024-09-13T18:40:48.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.640+0000 7f5366800640 1 -- start start 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.641+0000 7f5366800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5360144730 0x7f536015b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.641+0000 7f5366800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 0x7f536006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.641+0000 7f5366800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5360071ab0 con 0x7f53600cd7e0 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.641+0000 7f5366800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600714f0 con 0x7f5360144730 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.641+0000 7f5366800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53600717d0 con 0x7f536006e990 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5360144730 0x7f536015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5360144730 0x7f536015b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33620/0 (socket says 172.21.15.192:33620) 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 -- 172.21.15.192:0/435006091 learned_addr learned my addr 172.21.15.192:0/435006091 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5364a00640 1 --2- 172.21.15.192:0/435006091 >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 0x7f536006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 -- 172.21.15.192:0/435006091 >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 msgr2=0x7f536006ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 --2- 172.21.15.192:0/435006091 >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 0x7f536006ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 -- 172.21.15.192:0/435006091 >> v1:172.21.15.194:6789/0 conn(0x7f53600cd7e0 legacy=0x7f53600cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5365400640 1 -- 172.21.15.192:0/435006091 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536006a510 con 0x7f5360144730 2024-09-13T18:40:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.642+0000 7f5364a00640 1 --2- 172.21.15.192:0/435006091 >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 0x7f536006ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.643+0000 7f5365400640 1 --2- 172.21.15.192:0/435006091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360144730 0x7f536015b100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f536006cdb0 tx=0x7f535402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a99807e3d571dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.643+0000 7f535fe00640 1 -- 172.21.15.192:0/435006091 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354032440 con 0x7f5360144730 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.643+0000 7f535fe00640 1 -- 172.21.15.192:0/435006091 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53540325a0 con 0x7f5360144730 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.643+0000 7f535fe00640 1 -- 172.21.15.192:0/435006091 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354032930 con 0x7f5360144730 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 -- 172.21.15.192:0/435006091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360144730 msgr2=0x7f536015b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 --2- 172.21.15.192:0/435006091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360144730 0x7f536015b100 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f536006cdb0 tx=0x7f535402a270 comp rx=0 tx=0).stop 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 -- 172.21.15.192:0/435006091 shutdown_connections 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 --2- 172.21.15.192:0/435006091 >> v2:172.21.15.194:3300/0 conn(0x7f536006e990 0x7f536006ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 --2- 172.21.15.192:0/435006091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5360144730 0x7f536015b100 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 -- 172.21.15.192:0/435006091 >> 172.21.15.192:0/435006091 conn(0x7f53600736d0 msgr2=0x7f53600b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 -- 172.21.15.192:0/435006091 shutdown_connections 2024-09-13T18:40:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.644+0000 7f5366800640 1 -- 172.21.15.192:0/435006091 wait complete. 2024-09-13T18:40:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.646+0000 7f5366800640 1 Processor -- start 2024-09-13T18:40:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.646+0000 7f5366800640 1 -- start start 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536006e990 0x7f536013af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5360144730 0x7f5360159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53600a9430 con 0x7f53600cd7e0 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53601f4830 con 0x7f536006e990 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5366800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f536013c3b0 con 0x7f5360144730 2024-09-13T18:40:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33622/0 (socket says 172.21.15.192:33622) 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 -- 172.21.15.192:0/3702235515 learned_addr learned my addr 172.21.15.192:0/3702235515 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5365e00640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5360144730 0x7f5360159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5365400640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536006e990 0x7f536013af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 -- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5360144730 msgr2=0x7f5360159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5360144730 0x7f5360159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 -- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536006e990 msgr2=0x7f536013af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536006e990 0x7f536013af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.647+0000 7f5364a00640 1 -- 172.21.15.192:0/3702235515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540094d0 con 0x7f53600cd7e0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f5364a00640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f534c00e7e0 tx=0x7f534c00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c004030 con 0x7f53600cd7e0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f534c004190 con 0x7f53600cd7e0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f536013b600 con 0x7f53600cd7e0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f534c004520 con 0x7f53600cd7e0 2024-09-13T18:40:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.648+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f536013c8e0 con 0x7f53600cd7e0 2024-09-13T18:40:48.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.649+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f536015b100 con 0x7f53600cd7e0 2024-09-13T18:40:48.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.650+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f534c00c6d0 con 0x7f53600cd7e0 2024-09-13T18:40:48.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.651+0000 7f535d600640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 0x7f534006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.651+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f534c089110 con 0x7f53600cd7e0 2024-09-13T18:40:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.651+0000 7f5365400640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 0x7f534006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.652+0000 7f5365400640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 0x7f534006d0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5354034000 tx=0x7f535402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:48.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.655+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f534c054230 con 0x7f53600cd7e0 2024-09-13T18:40:48.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:48.857+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f536015c4f0 con 0x7f53600cd7e0 2024-09-13T18:40:49.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.466+0000 7f535d600640 1 -- 172.21.15.192:0/3702235515 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) v1 ==== 104+0+0 (secure 0 0 0) 0x7f534c057850 con 0x7f53600cd7e0 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 msgr2=0x7f534006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 0x7f534006d0c0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5354034000 tx=0x7f535402e000 comp rx=0 tx=0).stop 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 msgr2=0x7f53601f42f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f534c00e7e0 tx=0x7f534c00eca0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 shutdown_connections 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f534006ac00 0x7f534006d0c0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5360144730 0x7f5360159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53600cd7e0 0x7f53601f42f0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 --2- 172.21.15.192:0/3702235515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f536006e990 0x7f536013af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 >> 172.21.15.192:0/3702235515 conn(0x7f53600736d0 msgr2=0x7f536006bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:49.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 shutdown_connections 2024-09-13T18:40:49.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.470+0000 7f5366800640 1 -- 172.21.15.192:0/3702235515 wait complete. 2024-09-13T18:40:49.491 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:40:49.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.647+0000 7ffb58400640 1 Processor -- start 2024-09-13T18:40:49.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.647+0000 7ffb58400640 1 -- start start 2024-09-13T18:40:49.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb58400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb500b3700 0x7ffb500b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb58400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ffb500cb430 0x7ffb500cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb58400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb500b4020 con 0x7ffb5006bcf0 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb58400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb50159b60 con 0x7ffb500b3700 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb58400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb50159e40 con 0x7ffb500cb430 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb55a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb500b3700 0x7ffb500b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb55a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb500b3700 0x7ffb500b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33628/0 (socket says 172.21.15.192:33628) 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.648+0000 7ffb55a00640 1 -- 172.21.15.192:0/2376368232 learned_addr learned my addr 172.21.15.192:0/2376368232 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.649+0000 7ffb56400640 1 --2- 172.21.15.192:0/2376368232 >> v2:172.21.15.194:3300/0 conn(0x7ffb500cb430 0x7ffb500cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.649+0000 7ffb55a00640 1 -- 172.21.15.192:0/2376368232 >> v2:172.21.15.194:3300/0 conn(0x7ffb500cb430 msgr2=0x7ffb500cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.649+0000 7ffb55a00640 1 --2- 172.21.15.192:0/2376368232 >> v2:172.21.15.194:3300/0 conn(0x7ffb500cb430 0x7ffb500cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.649+0000 7ffb55a00640 1 -- 172.21.15.192:0/2376368232 >> v1:172.21.15.194:6789/0 conn(0x7ffb5006bcf0 legacy=0x7ffb5006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.649+0000 7ffb55a00640 1 -- 172.21.15.192:0/2376368232 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb5015a120 con 0x7ffb500b3700 2024-09-13T18:40:49.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.650+0000 7ffb55a00640 1 --2- 172.21.15.192:0/2376368232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb500b3ae0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400bb00 tx=0x7ffb4402c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900d024b4bf1aba1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.650+0000 7ffb4fe00640 1 -- 172.21.15.192:0/2376368232 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44032480 con 0x7ffb500b3700 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.650+0000 7ffb4fe00640 1 -- 172.21.15.192:0/2376368232 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb4402f030 con 0x7ffb500b3700 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.650+0000 7ffb4fe00640 1 -- 172.21.15.192:0/2376368232 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb44032800 con 0x7ffb500b3700 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 -- 172.21.15.192:0/2376368232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 msgr2=0x7ffb500b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 --2- 172.21.15.192:0/2376368232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb500b3ae0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ffb4400bb00 tx=0x7ffb4402c740 comp rx=0 tx=0).stop 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 -- 172.21.15.192:0/2376368232 shutdown_connections 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 --2- 172.21.15.192:0/2376368232 >> v2:172.21.15.194:3300/0 conn(0x7ffb500cb430 0x7ffb500cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 --2- 172.21.15.192:0/2376368232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb500b3ae0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 -- 172.21.15.192:0/2376368232 >> 172.21.15.192:0/2376368232 conn(0x7ffb500b0c40 msgr2=0x7ffb500b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 -- 172.21.15.192:0/2376368232 shutdown_connections 2024-09-13T18:40:49.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.651+0000 7ffb58400640 1 -- 172.21.15.192:0/2376368232 wait complete. 2024-09-13T18:40:49.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.653+0000 7ffb58400640 1 Processor -- start 2024-09-13T18:40:49.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.653+0000 7ffb58400640 1 -- start start 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5006bcf0 0x7ffb501e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb500cb430 0x7ffb501e9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501e7bd0 con 0x7ffb500b3700 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb50150a10 con 0x7ffb5006bcf0 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb58400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb501e7fc0 con 0x7ffb500cb430 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb55000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb55a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5006bcf0 0x7ffb501e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb55000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33632/0 (socket says 172.21.15.192:33632) 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb55000640 1 -- 172.21.15.192:0/2754669459 learned_addr learned my addr 172.21.15.192:0/2754669459 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb56400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb500cb430 0x7ffb501e9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.654+0000 7ffb55000640 1 -- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb500cb430 msgr2=0x7ffb501e9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb55000640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb500cb430 0x7ffb501e9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb55000640 1 -- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5006bcf0 msgr2=0x7ffb501e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb55000640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5006bcf0 0x7ffb501e7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb55000640 1 -- 172.21.15.192:0/2754669459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb4400b760 con 0x7ffb500b3700 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb55000640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c450 tx=0x7ffb3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c0052d0 con 0x7ffb500b3700 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3c005430 con 0x7ffb500b3700 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3c012870 con 0x7ffb500b3700 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb501e82a0 con 0x7ffb500b3700 2024-09-13T18:40:49.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.655+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb501e8860 con 0x7ffb500b3700 2024-09-13T18:40:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.656+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb501e7d10 con 0x7ffb500b3700 2024-09-13T18:40:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.657+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffb3c0129d0 con 0x7ffb500b3700 2024-09-13T18:40:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.658+0000 7ffb4d600640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:49.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.658+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ffb3c088ec0 con 0x7ffb500b3700 2024-09-13T18:40:49.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.658+0000 7ffb55a00640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:49.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.659+0000 7ffb55a00640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffb44037000 tx=0x7ffb44030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:49.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.662+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffb3c053fe0 con 0x7ffb500b3700 2024-09-13T18:40:49.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:49.830+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ffb500b3ae0 con 0x7ffb500b3700 2024-09-13T18:40:50.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.468+0000 7ffb4d600640 1 -- 172.21.15.192:0/2754669459 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) v1 ==== 181+0+0 (secure 0 0 0) 0x7ffb3c057600 con 0x7ffb500b3700 2024-09-13T18:40:50.472 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:40:50.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 msgr2=0x7ffb3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffb44037000 tx=0x7ffb44030000 comp rx=0 tx=0).stop 2024-09-13T18:40:50.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 msgr2=0x7ffb501e8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ffb3c00c450 tx=0x7ffb3c00c910 comp rx=0 tx=0).stop 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 shutdown_connections 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffb3006ac00 0x7ffb3006d0c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb500cb430 0x7ffb501e9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb500b3700 0x7ffb501e8d80 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 --2- 172.21.15.192:0/2754669459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb5006bcf0 0x7ffb501e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.471+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 >> 172.21.15.192:0/2754669459 conn(0x7ffb500b0c40 msgr2=0x7ffb500cb860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.472+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 shutdown_connections 2024-09-13T18:40:50.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.472+0000 7ffb58400640 1 -- 172.21.15.192:0/2754669459 wait complete. 2024-09-13T18:40:50.491 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:40:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.645+0000 7fceb3e00640 1 Processor -- start 2024-09-13T18:40:50.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.645+0000 7fceb3e00640 1 -- start start 2024-09-13T18:40:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.646+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 0x7fceac0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.646+0000 7fceb3e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac15e110 con 0x7fceac0cca60 2024-09-13T18:40:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.646+0000 7fceb3e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fceac15e3f0 con 0x7fceac0cb730 2024-09-13T18:40:50.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.646+0000 7fceb3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac15df20 con 0x7fceac0b3d90 2024-09-13T18:40:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb1e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fceac0cca60 0x7fceac06fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33512/0 (socket says 172.21.15.192:33512) 2024-09-13T18:40:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb1e00640 1 -- 172.21.15.192:0/1085928975 learned_addr learned my addr 172.21.15.192:0/1085928975 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb0a00640 1 --2- 172.21.15.192:0/1085928975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 0x7fceac0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975564104 0 0) 0x7fceac15e110 con 0x7fceac0cca60 2024-09-13T18:40:50.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce94005730 con 0x7fceac0cca60 2024-09-13T18:40:50.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227082722 0 0) 0x7fceac15e3f0 con 0x7fceac0cb730 2024-09-13T18:40:50.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb0a00640 1 -- 172.21.15.192:0/1085928975 >> v1:172.21.15.194:6789/0 conn(0x7fceac0cb730 legacy=0x7fceac15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb0a00640 1 -- 172.21.15.192:0/1085928975 >> v1:172.21.15.192:6789/0 conn(0x7fceac0cca60 legacy=0x7fceac06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.647+0000 7fceb0a00640 1 -- 172.21.15.192:0/1085928975 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceac15e6d0 con 0x7fceac0b3d90 2024-09-13T18:40:50.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.648+0000 7fceb0a00640 1 --2- 172.21.15.192:0/1085928975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 0x7fceac0cc520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce980097d0 tx=0x7fce9802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a2441d71c638c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98032440 con 0x7fceac0b3d90 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce980325a0 con 0x7fceac0b3d90 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceabe00640 1 -- 172.21.15.192:0/1085928975 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce98032910 con 0x7fceac0b3d90 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 -- 172.21.15.192:0/1085928975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 msgr2=0x7fceac0cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1085928975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 0x7fceac0cc520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce980097d0 tx=0x7fce9802a210 comp rx=0 tx=0).stop 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 -- 172.21.15.192:0/1085928975 shutdown_connections 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1085928975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0b3d90 0x7fceac0cc520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 -- 172.21.15.192:0/1085928975 >> 172.21.15.192:0/1085928975 conn(0x7fceac0b0c40 msgr2=0x7fceac0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.649+0000 7fceb3e00640 1 -- 172.21.15.192:0/1085928975 shutdown_connections 2024-09-13T18:40:50.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.650+0000 7fceb3e00640 1 -- 172.21.15.192:0/1085928975 wait complete. 2024-09-13T18:40:50.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.651+0000 7fceb3e00640 1 Processor -- start 2024-09-13T18:40:50.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.651+0000 7fceb3e00640 1 -- start start 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0cb730 0x7fceac06b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac0cca60 0x7fceac06b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1f3010 con 0x7fceac0b3d90 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1f32f0 con 0x7fceac0cca60 2024-09-13T18:40:50.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fceac1f35d0 con 0x7fceac0cb730 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36248/0 (socket says 172.21.15.192:36248) 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.652+0000 7fceb1400640 1 -- 172.21.15.192:0/1030242321 learned_addr learned my addr 172.21.15.192:0/1030242321 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac0cca60 0x7fceac06b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb0a00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0cb730 0x7fceac06b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 -- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0cb730 msgr2=0x7fceac06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0cb730 0x7fceac06b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 -- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac0cca60 msgr2=0x7fceac06b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac0cca60 0x7fceac06b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:50.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 -- 172.21.15.192:0/1030242321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce98009400 con 0x7fceac0b3d90 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb1400640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c460 tx=0x7fcea000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0005480 con 0x7fceac0b3d90 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea00035f0 con 0x7fceac0b3d90 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea00039a0 con 0x7fceac0b3d90 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.653+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fceac130600 con 0x7fceac0b3d90 2024-09-13T18:40:50.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.654+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fceac133350 con 0x7fceac0b3d90 2024-09-13T18:40:50.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.654+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fceac130b20 con 0x7fceac0b3d90 2024-09-13T18:40:50.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.655+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcea0003b00 con 0x7fceac0b3d90 2024-09-13T18:40:50.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.656+0000 7fcea9600640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 0x7fce8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:50.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.656+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5444+0+0 (secure 0 0 0) 0x7fcea0088d10 con 0x7fceac0b3d90 2024-09-13T18:40:50.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.656+0000 7fceb0a00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 0x7fce8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:50.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.657+0000 7fceb0a00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 0x7fce8c06d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fce98034000 tx=0x7fce9802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:50.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.660+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcea008e020 con 0x7fceac0b3d90 2024-09-13T18:40:50.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:50.831+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fceac133540 con 0x7fceac0b3d90 2024-09-13T18:40:51.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.475+0000 7fcea9600640 1 -- 172.21.15.192:0/1030242321 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcea0054000 con 0x7fceac0b3d90 2024-09-13T18:40:51.478 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 msgr2=0x7fce8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 0x7fce8c06d0c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fce98034000 tx=0x7fce9802e000 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 msgr2=0x7fceac132e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fcea000c460 tx=0x7fcea000c920 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 shutdown_connections 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8c06ac00 0x7fce8c06d0c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fceac0cca60 0x7fceac06b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fceac0cb730 0x7fceac06b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 --2- 172.21.15.192:0/1030242321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fceac0b3d90 0x7fceac132e10 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 >> 172.21.15.192:0/1030242321 conn(0x7fceac0b0c40 msgr2=0x7fceac0ca0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:51.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 shutdown_connections 2024-09-13T18:40:51.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.479+0000 7fceb3e00640 1 -- 172.21.15.192:0/1030242321 wait complete. 2024-09-13T18:40:51.499 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:40:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.651+0000 7f0f3ec00640 1 Processor -- start 2024-09-13T18:40:51.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.651+0000 7f0f3ec00640 1 -- start start 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f3ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 0x7f0f380ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f3ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f380add80 0x7f0f380cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f3ec00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f38161510 con 0x7f0f3815a910 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f3ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f380b21e0 con 0x7f0f380add80 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f3ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f380b1bf0 con 0x7f0f380b2600 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f37e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0f3815a910 0x7f0f38160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33526/0 (socket says 172.21.15.192:33526) 2024-09-13T18:40:51.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.652+0000 7f0f37e00640 1 -- 172.21.15.192:0/2206509324 learned_addr learned my addr 172.21.15.192:0/2206509324 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f37400640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 0x7f0f380ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f3cc00640 1 --2- 172.21.15.192:0/2206509324 >> v2:172.21.15.194:3300/0 conn(0x7f0f380add80 0x7f0f380cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811263888 0 0) 0x7f0f38161510 con 0x7f0f3815a910 2024-09-13T18:40:51.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f1c003520 con 0x7f0f3815a910 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f3cc00640 1 -- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 msgr2=0x7f0f380ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f3cc00640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 0x7f0f380ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3291687915 0 0) 0x7f0f1c003520 con 0x7f0f3815a910 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f3cc00640 1 -- 172.21.15.192:0/2206509324 >> v1:172.21.15.192:6789/0 conn(0x7f0f3815a910 legacy=0x7f0f38160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f3cc00640 1 -- 172.21.15.192:0/2206509324 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f381617f0 con 0x7f0f380add80 2024-09-13T18:40:51.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.653+0000 7f0f37400640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 0x7f0f380ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.654+0000 7f0f3cc00640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380add80 0x7f0f380cc760 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009d90 tx=0x7f0f3002a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14af11ee90c8914f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.654+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30031600 con 0x7f0f380add80 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.654+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3002d050 con 0x7f0f380add80 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.654+0000 7f0f36a00640 1 -- 172.21.15.192:0/2206509324 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f30031980 con 0x7f0f380add80 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 -- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380add80 msgr2=0x7f0f380cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380add80 0x7f0f380cc760 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009d90 tx=0x7f0f3002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 -- 172.21.15.192:0/2206509324 shutdown_connections 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380add80 0x7f0f380cc760 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/2206509324 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f380b2600 0x7f0f380ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 -- 172.21.15.192:0/2206509324 >> 172.21.15.192:0/2206509324 conn(0x7f0f380b08f0 msgr2=0x7f0f380b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 -- 172.21.15.192:0/2206509324 shutdown_connections 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.655+0000 7f0f3ec00640 1 -- 172.21.15.192:0/2206509324 wait complete. 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.657+0000 7f0f3ec00640 1 Processor -- start 2024-09-13T18:40:51.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.657+0000 7f0f3ec00640 1 -- start start 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380b2600 0x7f0f3806f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f3815a910 0x7f0f3806fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38070d20 con 0x7f0f380add80 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38070480 con 0x7f0f380b2600 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f38070760 con 0x7f0f3815a910 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36262/0 (socket says 172.21.15.192:36262) 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 -- 172.21.15.192:0/330139180 learned_addr learned my addr 172.21.15.192:0/330139180 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37400640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380b2600 0x7f0f3806f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f3cc00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f3815a910 0x7f0f3806fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 -- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f3815a910 msgr2=0x7f0f3806fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f3815a910 0x7f0f3806fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 -- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380b2600 msgr2=0x7f0f3806f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380b2600 0x7f0f3806f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.658+0000 7f0f37e00640 1 -- 172.21.15.192:0/330139180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24009400 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f37e00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c480 tx=0x7f0f2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28005ce0 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f28005e40 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f30009a70 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280072b0 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.659+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3815ae20 con 0x7f0f380add80 2024-09-13T18:40:51.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.660+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f380b3ab0 con 0x7f0f380add80 2024-09-13T18:40:51.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.661+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f28007410 con 0x7f0f380add80 2024-09-13T18:40:51.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.662+0000 7f0f2fe00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 0x7f0f1806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:51.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.663+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0f28088a30 con 0x7f0f380add80 2024-09-13T18:40:51.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.663+0000 7f0f37400640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 0x7f0f1806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:51.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.663+0000 7f0f37400640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 0x7f0f1806d0f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0f38071f00 tx=0x7f0f24009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:51.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.667+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f28054050 con 0x7f0f380add80 2024-09-13T18:40:51.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.836+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0f3815f600 con 0x7f0f380add80 2024-09-13T18:40:51.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.840+0000 7f0f2fe00640 1 -- 172.21.15.192:0/330139180 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0f28057670 con 0x7f0f380add80 2024-09-13T18:40:51.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 msgr2=0x7f0f1806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 0x7f0f1806d0f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f0f38071f00 tx=0x7f0f24009190 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 msgr2=0x7f0f38154ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800c480 tx=0x7f0f2800c940 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 shutdown_connections 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f1806ac30 0x7f0f1806d0f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f3815a910 0x7f0f3806fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f380b2600 0x7f0f3806f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 --2- 172.21.15.192:0/330139180 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f380add80 0x7f0f38154ad0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 >> 172.21.15.192:0/330139180 conn(0x7f0f380b08f0 msgr2=0x7f0f3815fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 shutdown_connections 2024-09-13T18:40:51.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:51.843+0000 7f0f3ec00640 1 -- 172.21.15.192:0/330139180 wait complete. 2024-09-13T18:40:51.861 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2024-09-13T18:40:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.012+0000 7fca85000640 1 Processor -- start 2024-09-13T18:40:52.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.012+0000 7fca85000640 1 -- start start 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca85000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca800b7fe0 0x7fca800b8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca85000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fca800cd5f0 0x7fca800cda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca85000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca800b6ce0 con 0x7fca8015ce00 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca85000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca800cdfc0 con 0x7fca800cd5f0 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca85000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca800b6f40 con 0x7fca800b7fe0 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca7fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fca800cd5f0 0x7fca800cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca7f400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fca8015ce00 0x7fca800b65d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33534/0 (socket says 172.21.15.192:33534) 2024-09-13T18:40:52.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.013+0000 7fca7f400640 1 -- 172.21.15.192:0/3039784784 learned_addr learned my addr 172.21.15.192:0/3039784784 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7ea00640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca800b7fe0 0x7fca800b8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7fe00640 1 -- 172.21.15.192:0/3039784784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca800b7fe0 msgr2=0x7fca800b8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7fe00640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca800b7fe0 0x7fca800b8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7fe00640 1 -- 172.21.15.192:0/3039784784 >> v1:172.21.15.192:6789/0 conn(0x7fca8015ce00 legacy=0x7fca800b65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7fe00640 1 -- 172.21.15.192:0/3039784784 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca800b7220 con 0x7fca800cd5f0 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.014+0000 7fca7e000640 1 -- 172.21.15.192:0/3039784784 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715603539 0 0) 0x7fca800b6ce0 con 0x7fca8015ce00 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.015+0000 7fca7fe00640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800cd5f0 0x7fca800cda80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fca78009d90 tx=0x7fca7802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bbc4fefe15956aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.015+0000 7fca7e000640 1 -- 172.21.15.192:0/3039784784 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78007740 con 0x7fca800cd5f0 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.015+0000 7fca7e000640 1 -- 172.21.15.192:0/3039784784 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca7802d050 con 0x7fca800cd5f0 2024-09-13T18:40:52.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.015+0000 7fca7e000640 1 -- 172.21.15.192:0/3039784784 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca78007ac0 con 0x7fca800cd5f0 2024-09-13T18:40:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 -- 172.21.15.192:0/3039784784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800cd5f0 msgr2=0x7fca800cda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800cd5f0 0x7fca800cda80 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fca78009d90 tx=0x7fca7802a660 comp rx=0 tx=0).stop 2024-09-13T18:40:52.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 -- 172.21.15.192:0/3039784784 shutdown_connections 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800cd5f0 0x7fca800cda80 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 --2- 172.21.15.192:0/3039784784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca800b7fe0 0x7fca800b8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 -- 172.21.15.192:0/3039784784 >> 172.21.15.192:0/3039784784 conn(0x7fca800b4860 msgr2=0x7fca800b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 -- 172.21.15.192:0/3039784784 shutdown_connections 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.016+0000 7fca85000640 1 -- 172.21.15.192:0/3039784784 wait complete. 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.017+0000 7fca85000640 1 Processor -- start 2024-09-13T18:40:52.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.018+0000 7fca85000640 1 -- start start 2024-09-13T18:40:52.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.018+0000 7fca85000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.018+0000 7fca85000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca800cd5f0 0x7fca800ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.018+0000 7fca85000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca8015ce00 0x7fca800ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca85000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca801528c0 con 0x7fca800b7fe0 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca85000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca8015df10 con 0x7fca800cd5f0 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca85000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca8015e1f0 con 0x7fca8015ce00 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36288/0 (socket says 172.21.15.192:36288) 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 -- 172.21.15.192:0/3830680593 learned_addr learned my addr 172.21.15.192:0/3830680593 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 -- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca8015ce00 msgr2=0x7fca800ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca8015ce00 0x7fca800ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 -- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca800cd5f0 msgr2=0x7fca800ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca800cd5f0 0x7fca800ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 -- 172.21.15.192:0/3830680593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca78009a70 con 0x7fca800b7fe0 2024-09-13T18:40:52.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.019+0000 7fca7f400640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c4a0 tx=0x7fca7000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.020+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca70005ce0 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.020+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca70005e40 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.020+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca700072b0 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.020+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca8015e4d0 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.020+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca8015ea90 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.021+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca8015ecb0 con 0x7fca800b7fe0 2024-09-13T18:40:52.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.022+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fca70007410 con 0x7fca800b7fe0 2024-09-13T18:40:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.022+0000 7fca77400640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 0x7fca6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.023+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fca700886d0 con 0x7fca800b7fe0 2024-09-13T18:40:52.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.023+0000 7fca7ea00640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 0x7fca6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.023+0000 7fca7ea00640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 0x7fca6006d0c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fca6c006fd0 tx=0x7fca6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.027+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fca70053b10 con 0x7fca800b7fe0 2024-09-13T18:40:52.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.265+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7fca800d1de0 con 0x7fca800b7fe0 2024-09-13T18:40:52.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.477+0000 7fca77400640 1 -- 172.21.15.192:0/3830680593 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v270) v1 ==== 133+0+0 (secure 0 0 0) 0x7fca700170c0 con 0x7fca800b7fe0 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 msgr2=0x7fca6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 0x7fca6006d0c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fca6c006fd0 tx=0x7fca6c008040 comp rx=0 tx=0).stop 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 msgr2=0x7fca80152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fca7000c4a0 tx=0x7fca7000c960 comp rx=0 tx=0).stop 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 shutdown_connections 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fca6006ac00 0x7fca6006d0c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fca8015ce00 0x7fca800ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fca800cd5f0 0x7fca800ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 --2- 172.21.15.192:0/3830680593 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fca800b7fe0 0x7fca80152380 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 >> 172.21.15.192:0/3830680593 conn(0x7fca800b4860 msgr2=0x7fca800ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:52.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 shutdown_connections 2024-09-13T18:40:52.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.480+0000 7fca85000640 1 -- 172.21.15.192:0/3830680593 wait complete. 2024-09-13T18:40:52.500 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-13T18:40:52.500 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2024-09-13T18:40:52.501 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:52.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.650+0000 7f4229000640 1 Processor -- start 2024-09-13T18:40:52.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.650+0000 7f4229000640 1 -- start start 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.651+0000 7f4229000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 0x7f42240ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.651+0000 7f4229000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42240afd80 0x7f42240b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.651+0000 7f4229000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42240b0710 con 0x7f42240b2780 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.651+0000 7f4229000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42240cd920 con 0x7f42240afd80 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.651+0000 7f4229000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42240adf50 con 0x7f4224146610 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42240afd80 0x7f42240b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42240afd80 0x7f42240b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36302/0 (socket says 172.21.15.192:36302) 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 -- 172.21.15.192:0/3551764045 learned_addr learned my addr 172.21.15.192:0/3551764045 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4221e00640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 0x7f42240ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 -- 172.21.15.192:0/3551764045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 msgr2=0x7f42240ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:52.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 0x7f42240ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 -- 172.21.15.192:0/3551764045 >> v1:172.21.15.194:6789/0 conn(0x7f42240b2780 legacy=0x7f42240ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4222800640 1 -- 172.21.15.192:0/3551764045 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42240ae770 con 0x7f42240afd80 2024-09-13T18:40:52.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.652+0000 7f4221e00640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 0x7f42240ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.653+0000 7f4222800640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42240afd80 0x7f42240b01d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f421c009e50 tx=0x7f421c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a229f24a599780 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.653+0000 7f4220a00640 1 -- 172.21.15.192:0/3551764045 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c031600 con 0x7f42240afd80 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.653+0000 7f4220a00640 1 -- 172.21.15.192:0/3551764045 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c02d050 con 0x7f42240afd80 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.653+0000 7f4220a00640 1 -- 172.21.15.192:0/3551764045 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c031980 con 0x7f42240afd80 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 -- 172.21.15.192:0/3551764045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42240afd80 msgr2=0x7f42240b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42240afd80 0x7f42240b01d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f421c009e50 tx=0x7f421c02a710 comp rx=0 tx=0).stop 2024-09-13T18:40:52.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 -- 172.21.15.192:0/3551764045 shutdown_connections 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42240afd80 0x7f42240b01d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 --2- 172.21.15.192:0/3551764045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4224146610 0x7f42240ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 -- 172.21.15.192:0/3551764045 >> 172.21.15.192:0/3551764045 conn(0x7f42240ae960 msgr2=0x7f422406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 -- 172.21.15.192:0/3551764045 shutdown_connections 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.654+0000 7f4229000640 1 -- 172.21.15.192:0/3551764045 wait complete. 2024-09-13T18:40:52.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.656+0000 7f4229000640 1 Processor -- start 2024-09-13T18:40:52.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.656+0000 7f4229000640 1 -- start start 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42240afd80 0x7f422415c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 0x7f422413c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422415cd20 con 0x7f4224146610 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4224070a40 con 0x7f42240afd80 2024-09-13T18:40:52.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4229000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4224070d20 con 0x7f42240b2780 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4222800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4222800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36312/0 (socket says 172.21.15.192:36312) 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.657+0000 7f4222800640 1 -- 172.21.15.192:0/2778247354 learned_addr learned my addr 172.21.15.192:0/2778247354 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4221e00640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42240afd80 0x7f422415c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4221400640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 0x7f422413c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 -- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 msgr2=0x7f422413c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 0x7f422413c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 -- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42240afd80 msgr2=0x7f422415c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42240afd80 0x7f422415c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 -- 172.21.15.192:0/2778247354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009b30 con 0x7f4224146610 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4221400640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 0x7f422413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:40:52.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4222800640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f421c009e50 tx=0x7f421c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c03d860 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f421c03d9e0 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c03dd90 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4224071000 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.658+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240715c0 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.660+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42240717b0 con 0x7f4224146610 2024-09-13T18:40:52.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.660+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f421c03b400 con 0x7f4224146610 2024-09-13T18:40:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.661+0000 7f421a000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 0x7f420406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.661+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f421c0a9ff0 con 0x7f4224146610 2024-09-13T18:40:52.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.661+0000 7f4221e00640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 0x7f420406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:52.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.662+0000 7f4221e00640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 0x7f420406d0c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4214006fd0 tx=0x7f4214008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:52.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.665+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f421c0dd9c0 con 0x7f4224146610 2024-09-13T18:40:52.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.837+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42241469f0 con 0x7f4224146610 2024-09-13T18:40:52.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.838+0000 7f421a000640 1 -- 172.21.15.192:0/2778247354 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+13049 (secure 0 0 0) 0x7f421c07de60 con 0x7f4224146610 2024-09-13T18:40:52.841 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:52.841 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":103,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:51.468746+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/887376150":"2024-09-14T18:40:48.453188+0000","172.21.15.192:6836/887376150":"2024-09-14T18:40:48.453188+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:52.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 msgr2=0x7f420406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 0x7f420406d0c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f4214006fd0 tx=0x7f4214008040 comp rx=0 tx=0).stop 2024-09-13T18:40:52.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 msgr2=0x7f422413c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:52.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f421c009e50 tx=0x7f421c004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:52.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 shutdown_connections 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420406ac00 0x7f420406d0c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4224146610 0x7f422413c720 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42240b2780 0x7f422413c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 --2- 172.21.15.192:0/2778247354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42240afd80 0x7f422415c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 >> 172.21.15.192:0/2778247354 conn(0x7f42240ae960 msgr2=0x7f4224144890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 shutdown_connections 2024-09-13T18:40:52.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:52.840+0000 7f4229000640 1 -- 172.21.15.192:0/2778247354 wait complete. 2024-09-13T18:40:52.859 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:52.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.011+0000 7f2267200640 1 Processor -- start 2024-09-13T18:40:53.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.011+0000 7f2267200640 1 -- start start 2024-09-13T18:40:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.012+0000 7f2267200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.012+0000 7f2267200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.012+0000 7f2267200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226815af60 con 0x7f2268159b00 2024-09-13T18:40:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.012+0000 7f2267200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f226806b7a0 con 0x7f226806bc30 2024-09-13T18:40:53.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.012+0000 7f2267200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226815ac80 con 0x7f22680b3480 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2266800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2266800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:42968/0 (socket says 172.21.15.192:42968) 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:45590/0 (socket says 172.21.15.192:45590) 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2266800640 1 -- 172.21.15.192:0/3450745205 learned_addr learned my addr 172.21.15.192:0/3450745205 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 -- 172.21.15.192:0/3450745205 >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 msgr2=0x7f226815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 --2- 172.21.15.192:0/3450745205 >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 -- 172.21.15.192:0/3450745205 >> v1:172.21.15.194:6789/0 conn(0x7f2268159b00 legacy=0x7f22680b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2265400640 1 -- 172.21.15.192:0/3450745205 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226806b150 con 0x7f22680b3480 2024-09-13T18:40:53.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.013+0000 7f2266800640 1 --2- 172.21.15.192:0/3450745205 >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.014+0000 7f2265400640 1 --2- 172.21.15.192:0/3450745205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22540097a0 tx=0x7f225402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4eac57eef19a73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2264a00640 1 -- 172.21.15.192:0/3450745205 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254032440 con 0x7f22680b3480 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2264a00640 1 -- 172.21.15.192:0/3450745205 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22540325a0 con 0x7f22680b3480 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2264a00640 1 -- 172.21.15.192:0/3450745205 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254032930 con 0x7f22680b3480 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 -- 172.21.15.192:0/3450745205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 msgr2=0x7f2268159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 --2- 172.21.15.192:0/3450745205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f22540097a0 tx=0x7f225402a180 comp rx=0 tx=0).stop 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 -- 172.21.15.192:0/3450745205 shutdown_connections 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 --2- 172.21.15.192:0/3450745205 >> v2:172.21.15.194:3300/0 conn(0x7f226806bc30 0x7f226815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 --2- 172.21.15.192:0/3450745205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22680b3480 0x7f2268159ee0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 -- 172.21.15.192:0/3450745205 >> 172.21.15.192:0/3450745205 conn(0x7f22680736d0 msgr2=0x7f22680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:53.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 -- 172.21.15.192:0/3450745205 shutdown_connections 2024-09-13T18:40:53.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.015+0000 7f2267200640 1 -- 172.21.15.192:0/3450745205 wait complete. 2024-09-13T18:40:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.017+0000 7f2267200640 1 Processor -- start 2024-09-13T18:40:53.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.017+0000 7f2267200640 1 -- start start 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226806bc30 0x7f22680ae690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2268159b00 0x7f2268154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22681534a0 con 0x7f22680b3480 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268152ee0 con 0x7f226806bc30 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2267200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22681531c0 con 0x7f2268159b00 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2265400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2265400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36324/0 (socket says 172.21.15.192:36324) 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2265400640 1 -- 172.21.15.192:0/365448076 learned_addr learned my addr 172.21.15.192:0/365448076 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:53.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2266800640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2268159b00 0x7f2268154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.018+0000 7f2265e00640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226806bc30 0x7f22680ae690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 -- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2268159b00 msgr2=0x7f2268154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2268159b00 0x7f2268154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 -- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226806bc30 msgr2=0x7f22680ae690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226806bc30 0x7f22680ae690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 -- 172.21.15.192:0/365448076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226000bd40 con 0x7f22680b3480 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2265400640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2254035040 tx=0x7f22540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254006e10 con 0x7f22680b3480 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2254032e90 con 0x7f22680b3480 2024-09-13T18:40:53.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2254030be0 con 0x7f22680b3480 2024-09-13T18:40:53.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2254009400 con 0x7f22680b3480 2024-09-13T18:40:53.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.019+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226806f970 con 0x7f22680b3480 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.020+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680b2d70 con 0x7f22680b3480 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.021+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2254039040 con 0x7f22680b3480 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.022+0000 7f225e000640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 0x7f224806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.022+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22540a9870 con 0x7f22680b3480 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.022+0000 7f2265e00640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 0x7f224806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.023+0000 7f2265e00640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 0x7f224806d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2258000f60 tx=0x7f2258009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.026+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2254074e60 con 0x7f22680b3480 2024-09-13T18:40:53.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.193+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22680b3c70 con 0x7f22680b3480 2024-09-13T18:40:53.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.194+0000 7f225e000640 1 -- 172.21.15.192:0/365448076 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2254030d40 con 0x7f22680b3480 2024-09-13T18:40:53.197 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:40:53.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 msgr2=0x7f224806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 0x7f224806d0c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2258000f60 tx=0x7f2258009040 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 msgr2=0x7f226814a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f2254035040 tx=0x7f22540046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 shutdown_connections 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f224806ac00 0x7f224806d0c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2268159b00 0x7f2268154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22680b3480 0x7f226814a550 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 --2- 172.21.15.192:0/365448076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f226806bc30 0x7f22680ae690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 >> 172.21.15.192:0/365448076 conn(0x7f22680736d0 msgr2=0x7f22680b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 shutdown_connections 2024-09-13T18:40:53.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.196+0000 7f2267200640 1 -- 172.21.15.192:0/365448076 wait complete. 2024-09-13T18:40:53.215 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-13T18:40:53.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.366+0000 7fe3a2400640 1 Processor -- start 2024-09-13T18:40:53.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.367+0000 7fe3a2400640 1 -- start start 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe3a2400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe39c0cacd0 0x7fe39c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 0x7fe39c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe3a2400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39c140480 con 0x7fe39c140980 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe3a2400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe39c15c160 con 0x7fe39c0cacd0 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe3a2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c15ee90 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe39be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe39c140980 0x7fe39c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33538/0 (socket says 172.21.15.192:33538) 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe39be00640 1 -- 172.21.15.192:0/377556792 learned_addr learned my addr 172.21.15.192:0/377556792 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe39aa00640 1 --2- 172.21.15.192:0/377556792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 0x7fe39c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.368+0000 7fe39b400640 1 --2- 172.21.15.192:0/377556792 >> v2:172.21.15.194:3300/0 conn(0x7fe39c0cacd0 0x7fe39c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39a000640 1 -- 172.21.15.192:0/377556792 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3401218250 0 0) 0x7fe39c140480 con 0x7fe39c140980 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39a000640 1 -- 172.21.15.192:0/377556792 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe380003520 con 0x7fe39c140980 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39aa00640 1 -- 172.21.15.192:0/377556792 >> v2:172.21.15.194:3300/0 conn(0x7fe39c0cacd0 msgr2=0x7fe39c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39aa00640 1 --2- 172.21.15.192:0/377556792 >> v2:172.21.15.194:3300/0 conn(0x7fe39c0cacd0 0x7fe39c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39aa00640 1 -- 172.21.15.192:0/377556792 >> v1:172.21.15.192:6789/0 conn(0x7fe39c140980 legacy=0x7fe39c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.369+0000 7fe39aa00640 1 -- 172.21.15.192:0/377556792 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39c15f170 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.370+0000 7fe39aa00640 1 --2- 172.21.15.192:0/377556792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 0x7fe39c15bc20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac486aaadb8797b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.370+0000 7fe39a000640 1 -- 172.21.15.192:0/377556792 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388032440 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.370+0000 7fe39a000640 1 -- 172.21.15.192:0/377556792 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3880325a0 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.370+0000 7fe39a000640 1 -- 172.21.15.192:0/377556792 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388032930 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 -- 172.21.15.192:0/377556792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 msgr2=0x7fe39c15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 --2- 172.21.15.192:0/377556792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 0x7fe39c15bc20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe3880097a0 tx=0x7fe38802a180 comp rx=0 tx=0).stop 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 -- 172.21.15.192:0/377556792 shutdown_connections 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 --2- 172.21.15.192:0/377556792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cb0b0 0x7fe39c15bc20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 --2- 172.21.15.192:0/377556792 >> v2:172.21.15.194:3300/0 conn(0x7fe39c0cacd0 0x7fe39c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 -- 172.21.15.192:0/377556792 >> 172.21.15.192:0/377556792 conn(0x7fe39c0ae960 msgr2=0x7fe39c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 -- 172.21.15.192:0/377556792 shutdown_connections 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.371+0000 7fe3a2400640 1 -- 172.21.15.192:0/377556792 wait complete. 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.372+0000 7fe3a2400640 1 Processor -- start 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.372+0000 7fe3a2400640 1 -- start start 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cacd0 0x7fe39c13ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c0cb0b0 0x7fe39c155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c13f2e0 con 0x7fe39c140980 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c13d730 con 0x7fe39c0cb0b0 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.373+0000 7fe3a2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39c13e660 con 0x7fe39c0cacd0 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36332/0 (socket says 172.21.15.192:36332) 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 -- 172.21.15.192:0/1477590158 learned_addr learned my addr 172.21.15.192:0/1477590158 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39b400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cacd0 0x7fe39c13ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39aa00640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c0cb0b0 0x7fe39c155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 -- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cacd0 msgr2=0x7fe39c13ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cacd0 0x7fe39c13ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 -- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c0cb0b0 msgr2=0x7fe39c155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c0cb0b0 0x7fe39c155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:53.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 -- 172.21.15.192:0/1477590158 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe388009400 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.374+0000 7fe39be00640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe39400cb40 tx=0x7fe39400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.375+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39400aca0 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.375+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39400ae00 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.375+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39c13e940 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.375+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe394012620 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.375+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39c13ef00 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.376+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39c15bc20 con 0x7fe39c140980 2024-09-13T18:40:53.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.377+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe394007070 con 0x7fe39c140980 2024-09-13T18:40:53.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.378+0000 7fe393400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 0x7fe37c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:53.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.378+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe394088ff0 con 0x7fe39c140980 2024-09-13T18:40:53.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.378+0000 7fe39b400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 0x7fe37c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:53.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.379+0000 7fe39b400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 0x7fe37c06d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe39c071da0 tx=0x7fe38c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:53.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.382+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe3940bc9c0 con 0x7fe39c140980 2024-09-13T18:40:53.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:53.616+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7fe39c06c6c0 con 0x7fe39c140980 2024-09-13T18:40:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.489+0000 7fe393400640 1 -- 172.21.15.192:0/1477590158 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v272) v1 ==== 140+0+0 (secure 0 0 0) 0x7fe3940170d0 con 0x7fe39c140980 2024-09-13T18:40:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 msgr2=0x7fe37c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 0x7fe37c06d0c0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe39c071da0 tx=0x7fe38c009190 comp rx=0 tx=0).stop 2024-09-13T18:40:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 msgr2=0x7fe39c13c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe39400cb40 tx=0x7fe39400a060 comp rx=0 tx=0).stop 2024-09-13T18:40:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 shutdown_connections 2024-09-13T18:40:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37c06ac00 0x7fe37c06d0c0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39c140980 0x7fe39c13c550 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39c0cb0b0 0x7fe39c155a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 --2- 172.21.15.192:0/1477590158 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe39c0cacd0 0x7fe39c13ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 >> 172.21.15.192:0/1477590158 conn(0x7fe39c0ae960 msgr2=0x7fe39c0ce0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 shutdown_connections 2024-09-13T18:40:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.492+0000 7fe3a2400640 1 -- 172.21.15.192:0/1477590158 wait complete. 2024-09-13T18:40:54.515 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2024-09-13T18:40:54.686 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_objectstore":"memstore"} 2024-09-13T18:40:54.687 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2024-09-13T18:40:54.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:40:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.839+0000 7f22dd600640 1 Processor -- start 2024-09-13T18:40:54.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.839+0000 7f22dd600640 1 -- start start 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22dd600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f22d81589f0 0x7f22d80b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22dd600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d80b2000 con 0x7f22d806c0b0 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22dd600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d815b970 con 0x7f22d80b3af0 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22dd600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d815bbd0 con 0x7f22d81589f0 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22d7400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f22d806c0b0 0x7f22d80cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33546/0 (socket says 172.21.15.192:33546) 2024-09-13T18:40:54.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.840+0000 7f22d7400640 1 -- 172.21.15.192:0/774054618 learned_addr learned my addr 172.21.15.192:0/774054618 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d6a00640 1 --2- 172.21.15.192:0/774054618 >> v2:172.21.15.194:3300/0 conn(0x7f22d81589f0 0x7f22d80b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3247722095 0 0) 0x7f22d80b2000 con 0x7f22d806c0b0 2024-09-13T18:40:54.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22bc003520 con 0x7f22d806c0b0 2024-09-13T18:40:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d6a00640 1 -- 172.21.15.192:0/774054618 >> v1:172.21.15.194:6789/0 conn(0x7f22d80b3af0 legacy=0x7f22d815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3434245864 0 0) 0x7f22bc003520 con 0x7f22d806c0b0 2024-09-13T18:40:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d6a00640 1 -- 172.21.15.192:0/774054618 >> v1:172.21.15.192:6789/0 conn(0x7f22d806c0b0 legacy=0x7f22d80cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.841+0000 7f22d6a00640 1 -- 172.21.15.192:0/774054618 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d815beb0 con 0x7f22d81589f0 2024-09-13T18:40:54.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.842+0000 7f22d6a00640 1 --2- 172.21.15.192:0/774054618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d81589f0 0x7f22d80b2490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097a0 tx=0x7f22c802a130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59829741b327e17e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:54.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.842+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d00019f0 con 0x7f22d81589f0 2024-09-13T18:40:54.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.842+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c802abc0 con 0x7f22d81589f0 2024-09-13T18:40:54.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.842+0000 7f22d5600640 1 -- 172.21.15.192:0/774054618 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8032440 con 0x7f22d81589f0 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 -- 172.21.15.192:0/774054618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d81589f0 msgr2=0x7f22d80b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 --2- 172.21.15.192:0/774054618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d81589f0 0x7f22d80b2490 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f22c80097a0 tx=0x7f22c802a130 comp rx=0 tx=0).stop 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 -- 172.21.15.192:0/774054618 shutdown_connections 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 --2- 172.21.15.192:0/774054618 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d81589f0 0x7f22d80b2490 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 -- 172.21.15.192:0/774054618 >> 172.21.15.192:0/774054618 conn(0x7f22d80b08f0 msgr2=0x7f22d80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 -- 172.21.15.192:0/774054618 shutdown_connections 2024-09-13T18:40:54.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.843+0000 7f22dd600640 1 -- 172.21.15.192:0/774054618 wait complete. 2024-09-13T18:40:54.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.845+0000 7f22dd600640 1 Processor -- start 2024-09-13T18:40:54.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.845+0000 7f22dd600640 1 -- start start 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d806c0b0 0x7f22d8148330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22d80b3af0 0x7f22d81e3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8148870 con 0x7f22d81589f0 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81e4570 con 0x7f22d806c0b0 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22dd600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81e4820 con 0x7f22d80b3af0 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36338/0 (socket says 172.21.15.192:36338) 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 -- 172.21.15.192:0/2689544515 learned_addr learned my addr 172.21.15.192:0/2689544515 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d6a00640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d806c0b0 0x7f22d8148330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:54.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d6000640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22d80b3af0 0x7f22d81e3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 -- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22d80b3af0 msgr2=0x7f22d81e3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22d80b3af0 0x7f22d81e3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 -- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d806c0b0 msgr2=0x7f22d8148330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d806c0b0 0x7f22d8148330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.846+0000 7f22d7400640 1 -- 172.21.15.192:0/2689544515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009400 con 0x7f22d81589f0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22d7400640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001560 tx=0x7f22d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0012400 con 0x7f22d81589f0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d0012580 con 0x7f22d81589f0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d0012970 con 0x7f22d81589f0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d81e4b00 con 0x7f22d81589f0 2024-09-13T18:40:54.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.847+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d81e50c0 con 0x7f22d81589f0 2024-09-13T18:40:54.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.848+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d80cb8f0 con 0x7f22d81589f0 2024-09-13T18:40:54.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.849+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f22d0007070 con 0x7f22d81589f0 2024-09-13T18:40:54.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.850+0000 7f22cea00640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 0x7f22b806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:54.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.850+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22d00891f0 con 0x7f22d81589f0 2024-09-13T18:40:54.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.850+0000 7f22d6a00640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 0x7f22b806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:54.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.851+0000 7f22d6a00640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 0x7f22b806d0f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f22c8034000 tx=0x7f22c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:54.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:54.854+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f22d00546e0 con 0x7f22d81589f0 2024-09-13T18:40:55.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.019+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f22d80b2470 con 0x7f22d81589f0 2024-09-13T18:40:55.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.024+0000 7f22cea00640 1 -- 172.21.15.192:0/2689544515 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22d0057d00 con 0x7f22d81589f0 2024-09-13T18:40:55.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 msgr2=0x7f22b806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 0x7f22b806d0f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f22c8034000 tx=0x7f22c802e000 comp rx=0 tx=0).stop 2024-09-13T18:40:55.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 msgr2=0x7f22d81e4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001560 tx=0x7f22d000a430 comp rx=0 tx=0).stop 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 shutdown_connections 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f22b806ac30 0x7f22b806d0f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22d81589f0 0x7f22d81e4030 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22d80b3af0 0x7f22d81e3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 --2- 172.21.15.192:0/2689544515 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22d806c0b0 0x7f22d8148330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 >> 172.21.15.192:0/2689544515 conn(0x7f22d80b08f0 msgr2=0x7f22d80b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 shutdown_connections 2024-09-13T18:40:55.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.026+0000 7f22dd600640 1 -- 172.21.15.192:0/2689544515 wait complete. 2024-09-13T18:40:55.045 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:40:55.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:40:55.133 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:40:55.221 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:40:55.221 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:55.221 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:55.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:40:55.256 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:55.256 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:55.293 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:40:55.293 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:40:55.293 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:55.330 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:40:55.331 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:40:55.331 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:40:55.369 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:40:55.370 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:40:55.370 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:40:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.520+0000 7fc4e6c00640 1 Processor -- start 2024-09-13T18:40:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.520+0000 7fc4e6c00640 1 -- start start 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e00b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4e6c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e0071dd0 con 0x7fc4e0150480 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4e6c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e00cb770 con 0x7fc4e00b2230 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e00cba50 con 0x7fc4e0071810 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4dfe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc4e0150480 0x7fc4e015a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33554/0 (socket says 172.21.15.192:33554) 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.521+0000 7fc4dfe00640 1 -- 172.21.15.192:0/4051199154 learned_addr learned my addr 172.21.15.192:0/4051199154 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:55.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4df400640 1 --2- 172.21.15.192:0/4051199154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e00b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986158988 0 0) 0x7fc4e0071dd0 con 0x7fc4e0150480 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c4003520 con 0x7fc4e0150480 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4df400640 1 -- 172.21.15.192:0/4051199154 >> v1:172.21.15.194:6789/0 conn(0x7fc4e00b2230 legacy=0x7fc4e00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 545134760 0 0) 0x7fc4e00cb770 con 0x7fc4e00b2230 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4df400640 1 -- 172.21.15.192:0/4051199154 >> v1:172.21.15.192:6789/0 conn(0x7fc4e0150480 legacy=0x7fc4e015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.522+0000 7fc4df400640 1 -- 172.21.15.192:0/4051199154 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00cbd30 con 0x7fc4e0071810 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.523+0000 7fc4df400640 1 --2- 172.21.15.192:0/4051199154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e00b1cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0097d0 tx=0x7fc4cc02a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b72d956346b395 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.523+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc032440 con 0x7fc4e0071810 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.523+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc0325a0 con 0x7fc4e0071810 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.523+0000 7fc4dea00640 1 -- 172.21.15.192:0/4051199154 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc032930 con 0x7fc4e0071810 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 -- 172.21.15.192:0/4051199154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 msgr2=0x7fc4e00b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/4051199154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e00b1cf0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc0097d0 tx=0x7fc4cc02a180 comp rx=0 tx=0).stop 2024-09-13T18:40:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 -- 172.21.15.192:0/4051199154 shutdown_connections 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/4051199154 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e00b1cf0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 -- 172.21.15.192:0/4051199154 >> 172.21.15.192:0/4051199154 conn(0x7fc4e00ae960 msgr2=0x7fc4e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 -- 172.21.15.192:0/4051199154 shutdown_connections 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.524+0000 7fc4e6c00640 1 -- 172.21.15.192:0/4051199154 wait complete. 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.526+0000 7fc4e6c00640 1 Processor -- start 2024-09-13T18:40:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.526+0000 7fc4e6c00640 1 -- start start 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.526+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e01566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0150480 0x7fc4e01432d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0144ff0 con 0x7fc4e00b2230 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0144370 con 0x7fc4e0150480 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e0144650 con 0x7fc4e0071810 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36346/0 (socket says 172.21.15.192:36346) 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 -- 172.21.15.192:0/1337146775 learned_addr learned my addr 172.21.15.192:0/1337146775 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4dfe00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e01566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4e4c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0150480 0x7fc4e01432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 -- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 msgr2=0x7fc4e01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e01566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 -- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0150480 msgr2=0x7fc4e01432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0150480 0x7fc4e01432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.527+0000 7fc4df400640 1 -- 172.21.15.192:0/1337146775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc009400 con 0x7fc4e00b2230 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4df400640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc035040 tx=0x7fc4cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc032440 con 0x7fc4e00b2230 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4cc004230 con 0x7fc4e00b2230 2024-09-13T18:40:55.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc006e10 con 0x7fc4e00b2230 2024-09-13T18:40:55.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e0144930 con 0x7fc4e00b2230 2024-09-13T18:40:55.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.528+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e01559b0 con 0x7fc4e00b2230 2024-09-13T18:40:55.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.529+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e0155b40 con 0x7fc4e00b2230 2024-09-13T18:40:55.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.530+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc4cc039040 con 0x7fc4e00b2230 2024-09-13T18:40:55.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.531+0000 7fc4d7e00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 0x7fc4c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.531+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc4cc0a99b0 con 0x7fc4e00b2230 2024-09-13T18:40:55.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.531+0000 7fc4dfe00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 0x7fc4c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.531+0000 7fc4dfe00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 0x7fc4c006d0c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005880 tx=0x7fc4d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.535+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc4e0155b40 con 0x7fc4e00b2230 2024-09-13T18:40:55.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.738+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4e0145130 con 0x7fc4e00b2230 2024-09-13T18:40:55.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.739+0000 7fc4d7e00640 1 -- 172.21.15.192:0/1337146775 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fc4cc037df0 con 0x7fc4e00b2230 2024-09-13T18:40:55.742 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:55.742 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":42,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5624,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1057194524","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1057194524},{"type":"v1","addr":"172.21.15.194:6835","nonce":1057194524}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6193,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4046714820","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4046714820},{"type":"v1","addr":"172.21.15.194:6834","nonce":4046714820}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6199,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/877294538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":877294538},{"type":"v1","addr":"172.21.15.192:6835","nonce":877294538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6741,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/4197579092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":4197579092},{"type":"v1","addr":"172.21.15.192:6837","nonce":4197579092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[]} 2024-09-13T18:40:55.742 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 42 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 msgr2=0x7fc4c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 0x7fc4c006d0c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0005880 tx=0x7fc4d0009040 comp rx=0 tx=0).stop 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 msgr2=0x7fc4e0158e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc035040 tx=0x7fc4cc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 shutdown_connections 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc4c006ac00 0x7fc4c006d0c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc4e0150480 0x7fc4e01432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc4e00b2230 0x7fc4e0158e00 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 --2- 172.21.15.192:0/1337146775 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc4e0071810 0x7fc4e01566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 >> 172.21.15.192:0/1337146775 conn(0x7fc4e00ae960 msgr2=0x7fc4e006c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 shutdown_connections 2024-09-13T18:40:55.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.741+0000 7fc4e6c00640 1 -- 172.21.15.192:0/1337146775 wait complete. 2024-09-13T18:40:55.759 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:40:55.760 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:40:55.760 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:40:55.760 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:40:55.760 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:40:55.760 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:40:55.760 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:40:55.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:40:55.761 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:40:55.761 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:40:55.761 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:40:55.761 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:40:55.761 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:40:55.761 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:40:55.762 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:40:55.762 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:40:55.776 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:40:55.776 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:40:55.777 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:40:55.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:40:55.778 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:40:55.778 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:40:55.779 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:40:55.779 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:40:55.821 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:40:55.821 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:55.823 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:40:55.823 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:55.824 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:40:55.824 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:55.825 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:40:55.825 DEBUG:teuthology.parallel:result is None 2024-09-13T18:40:55.825 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:40:55.953 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:40:55.953 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:40:55.954 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:40:55.955 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:40:55.956 INFO:tasks.ceph.mds.b.smithi194.stderr:2024-09-13T18:40:55.953+0000 7f91cd000640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-13T18:40:55.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.988+0000 7f199a000640 1 Processor -- start 2024-09-13T18:40:55.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.988+0000 7f199a000640 1 -- start start 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f199a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19940b3f10 0x7f199415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f199a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19940b0490 0x7f199415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f199a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19940b2f00 con 0x7f199415dee0 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f199a000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199415aec0 con 0x7f19940b3f10 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f199a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19940b3150 con 0x7f19940b0490 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19940b3f10 0x7f199415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1993400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f199415dee0 0x7f19940afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33578/0 (socket says 172.21.15.192:33578) 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1993400640 1 -- 172.21.15.192:0/2826676808 learned_addr learned my addr 172.21.15.192:0/2826676808 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19940b3f10 0x7f199415a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36386/0 (socket says 172.21.15.192:36386) 2024-09-13T18:40:55.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1993e00640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19940b0490 0x7f199415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 -- 172.21.15.192:0/2826676808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19940b0490 msgr2=0x7f199415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:55.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19940b0490 0x7f199415a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 -- 172.21.15.192:0/2826676808 >> v1:172.21.15.192:6789/0 conn(0x7f199415dee0 legacy=0x7f19940afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992a00640 1 -- 172.21.15.192:0/2826676808 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19940b3430 con 0x7f19940b3f10 2024-09-13T18:40:55.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.990+0000 7f1992000640 1 -- 172.21.15.192:0/2826676808 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283425801 0 0) 0x7f19940b2f00 con 0x7f199415dee0 2024-09-13T18:40:55.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.991+0000 7f1992a00640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b3f10 0x7f199415a440 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f19800097a0 tx=0x7f198002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95235be934437285 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:55.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f1992000640 1 -- 172.21.15.192:0/2826676808 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980032440 con 0x7f19940b3f10 2024-09-13T18:40:55.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f1992000640 1 -- 172.21.15.192:0/2826676808 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19800325a0 con 0x7f19940b3f10 2024-09-13T18:40:55.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f1992000640 1 -- 172.21.15.192:0/2826676808 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980032930 con 0x7f19940b3f10 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 -- 172.21.15.192:0/2826676808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b3f10 msgr2=0x7f199415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b3f10 0x7f199415a440 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f19800097a0 tx=0x7f198002a180 comp rx=0 tx=0).stop 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 -- 172.21.15.192:0/2826676808 shutdown_connections 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19940b0490 0x7f199415a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 --2- 172.21.15.192:0/2826676808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b3f10 0x7f199415a440 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 -- 172.21.15.192:0/2826676808 >> 172.21.15.192:0/2826676808 conn(0x7f19940ae960 msgr2=0x7f199406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 -- 172.21.15.192:0/2826676808 shutdown_connections 2024-09-13T18:40:55.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.992+0000 7f199a000640 1 -- 172.21.15.192:0/2826676808 wait complete. 2024-09-13T18:40:55.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.994+0000 7f199a000640 1 Processor -- start 2024-09-13T18:40:55.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.994+0000 7f199a000640 1 -- start start 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 0x7f199413d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 0x7f1994134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1994156020 con 0x7f19940b0490 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199414fda0 con 0x7f199415dee0 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f199a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19941565a0 con 0x7f199413fc50 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f1993400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:55.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f1993400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36392/0 (socket says 172.21.15.192:36392) 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f1993400640 1 -- 172.21.15.192:0/418263384 learned_addr learned my addr 172.21.15.192:0/418263384 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f1993e00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 0x7f1994134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.995+0000 7f1992a00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 0x7f199413d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 -- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 msgr2=0x7f1994134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 0x7f1994134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 -- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 msgr2=0x7f199413d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 0x7f199413d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 -- 172.21.15.192:0/418263384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980009400 con 0x7f19940b0490 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1992a00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 0x7f199413d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993e00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 0x7f1994134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f1993400640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f198400c460 tx=0x7f198400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19840074e0 con 0x7f19940b0490 2024-09-13T18:40:56.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1984007660 con 0x7f19940b0490 2024-09-13T18:40:56.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199414f820 con 0x7f19940b0490 2024-09-13T18:40:56.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1984004a20 con 0x7f19940b0490 2024-09-13T18:40:56.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.996+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1994156230 con 0x7f19940b0490 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.997+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19940afd80 con 0x7f19940b0490 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.998+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1984004b80 con 0x7f19940b0490 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.999+0000 7f198b400640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 0x7f197406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.999+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1984088ef0 con 0x7f19940b0490 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:55.999+0000 7f1992a00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 0x7f197406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:56.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:56.000+0000 7f1992a00640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 0x7f197406d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1980034000 tx=0x7f198002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:56.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:56.003+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1984054330 con 0x7f19940b0490 2024-09-13T18:40:56.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:56.186+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f19940ce0c0 con 0x7f19940b0490 2024-09-13T18:40:57.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.000+0000 7f198b400640 1 -- 172.21.15.192:0/418263384 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v108) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1984057950 con 0x7f19940b0490 2024-09-13T18:40:57.003 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:40:57.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.002+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 msgr2=0x7f197406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.002+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 0x7f197406d0c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1980034000 tx=0x7f198002e000 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.002+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 msgr2=0x7f1994139e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.002+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f198400c460 tx=0x7f198400c920 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 shutdown_connections 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f197406ac00 0x7f197406d0c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f199413fc50 0x7f1994134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f199415dee0 0x7f199413d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 --2- 172.21.15.192:0/418263384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19940b0490 0x7f1994139e80 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 >> 172.21.15.192:0/418263384 conn(0x7f19940ae960 msgr2=0x7f199406fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 shutdown_connections 2024-09-13T18:40:57.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.003+0000 7f199a000640 1 -- 172.21.15.192:0/418263384 wait complete. 2024-09-13T18:40:57.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:40:57.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.176+0000 7f8074e00640 1 Processor -- start 2024-09-13T18:40:57.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.176+0000 7f8074e00640 1 -- start start 2024-09-13T18:40:57.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.177+0000 7f8074e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8070150480 0x7f807015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f8074e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8070071dd0 con 0x7f8070071810 2024-09-13T18:40:57.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f8074e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80700cb770 con 0x7f80700cc530 2024-09-13T18:40:57.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f8074e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80700cba50 con 0x7f8070150480 2024-09-13T18:40:57.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f806d400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8070071810 0x7f80700b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33580/0 (socket says 172.21.15.192:33580) 2024-09-13T18:40:57.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f806d400640 1 -- 172.21.15.192:0/4250187346 learned_addr learned my addr 172.21.15.192:0/4250187346 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:57.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f806de00640 1 --2- 172.21.15.192:0/4250187346 >> v2:172.21.15.194:3300/0 conn(0x7f8070150480 0x7f807015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f806ca00640 1 -- 172.21.15.192:0/4250187346 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1123483934 0 0) 0x7f8070071dd0 con 0x7f8070071810 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.178+0000 7f806ca00640 1 -- 172.21.15.192:0/4250187346 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8054003520 con 0x7f8070071810 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.179+0000 7f806de00640 1 -- 172.21.15.192:0/4250187346 >> v1:172.21.15.194:6789/0 conn(0x7f80700cc530 legacy=0x7f80700cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.179+0000 7f806de00640 1 -- 172.21.15.192:0/4250187346 >> v1:172.21.15.192:6789/0 conn(0x7f8070071810 legacy=0x7f80700b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.179+0000 7f806de00640 1 -- 172.21.15.192:0/4250187346 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80700cbd30 con 0x7f8070150480 2024-09-13T18:40:57.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.180+0000 7f806de00640 1 --2- 172.21.15.192:0/4250187346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8070150480 0x7f807015a3e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f806000a940 tx=0x7f806002c660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c67b54227bd86a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.180+0000 7f806ca00640 1 -- 172.21.15.192:0/4250187346 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031710 con 0x7f8070150480 2024-09-13T18:40:57.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.180+0000 7f806ca00640 1 -- 172.21.15.192:0/4250187346 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f806002f050 con 0x7f8070150480 2024-09-13T18:40:57.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.180+0000 7f806ca00640 1 -- 172.21.15.192:0/4250187346 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031a70 con 0x7f8070150480 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 -- 172.21.15.192:0/4250187346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8070150480 msgr2=0x7f807015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 --2- 172.21.15.192:0/4250187346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8070150480 0x7f807015a3e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f806000a940 tx=0x7f806002c660 comp rx=0 tx=0).stop 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 -- 172.21.15.192:0/4250187346 shutdown_connections 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 --2- 172.21.15.192:0/4250187346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8070150480 0x7f807015a3e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 -- 172.21.15.192:0/4250187346 >> 172.21.15.192:0/4250187346 conn(0x7f80700ae960 msgr2=0x7f807006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 -- 172.21.15.192:0/4250187346 shutdown_connections 2024-09-13T18:40:57.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.181+0000 7f8074e00640 1 -- 172.21.15.192:0/4250187346 wait complete. 2024-09-13T18:40:57.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.182+0000 7f8074e00640 1 Processor -- start 2024-09-13T18:40:57.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.182+0000 7f8074e00640 1 -- start start 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80700cc530 0x7f80700adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 0x7f807006adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8070154b70 con 0x7f8070071810 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807006aba0 con 0x7f80700cc530 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f8074e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807006fb70 con 0x7f8070150480 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.183+0000 7f806de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36394/0 (socket says 172.21.15.192:36394) 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 -- 172.21.15.192:0/1399997467 learned_addr learned my addr 172.21.15.192:0/1399997467 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:57.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806d400640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80700cc530 0x7f80700adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806e800640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 0x7f807006adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 -- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 msgr2=0x7f807006adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 0x7f807006adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 -- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80700cc530 msgr2=0x7f80700adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80700cc530 0x7f80700adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 -- 172.21.15.192:0/1399997467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f806000a5a0 con 0x7f8070071810 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806e800640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 0x7f807006adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:57.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.184+0000 7f806de00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f80600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.185+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031710 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.185+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8060031870 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.185+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807006fe50 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.185+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060031be0 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.185+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8070070410 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.186+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807015a3e0 con 0x7f8070071810 2024-09-13T18:40:57.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.187+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8060031d40 con 0x7f8070071810 2024-09-13T18:40:57.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.187+0000 7f8066000640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 0x7f805006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.188+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80600aa2e0 con 0x7f8070071810 2024-09-13T18:40:57.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.188+0000 7f806d400640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 0x7f805006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.188+0000 7f806d400640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 0x7f805006d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f807006c7f0 tx=0x7f805c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.192+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f80600756f0 con 0x7f8070071810 2024-09-13T18:40:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.422+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8070070630 con 0x7f8070071810 2024-09-13T18:40:57.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.423+0000 7f8066000640 1 -- 172.21.15.192:0/1399997467 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8060006e10 con 0x7f8070071810 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:40:57.426 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:40:57.428 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.429 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.430 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.431 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.432 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:40:57.433 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.434 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:40:57.435 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.436 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:40:57.437 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:40:57.438 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:40:57.439 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:40:57.440 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.440 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:57.440 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:40:57.440 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 msgr2=0x7f805006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 0x7f805006d0c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f807006c7f0 tx=0x7f805c009040 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 msgr2=0x7f8070154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f8060000c00 tx=0x7f80600046c0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 shutdown_connections 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f805006ac00 0x7f805006d0c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8070150480 0x7f807006adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80700cc530 0x7f80700adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 --2- 172.21.15.192:0/1399997467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8070071810 0x7f8070154630 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 >> 172.21.15.192:0/1399997467 conn(0x7f80700ae960 msgr2=0x7f80700b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 shutdown_connections 2024-09-13T18:40:57.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.425+0000 7f8074e00640 1 -- 172.21.15.192:0/1399997467 wait complete. 2024-09-13T18:40:57.444 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:40:57.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.593+0000 7f85bc800640 1 Processor -- start 2024-09-13T18:40:57.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.593+0000 7f85bc800640 1 -- start start 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85bc800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 0x7f85b40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85bc800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85b40b2230 0x7f85b40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85bc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b4071dd0 con 0x7f85b4150480 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85bc800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40cb770 con 0x7f85b40b2230 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85bc800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b40cba50 con 0x7f85b4071810 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.594+0000 7f85b9e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f85b4150480 0x7f85b415a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33590/0 (socket says 172.21.15.192:33590) 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85b9e00640 1 -- 172.21.15.192:0/1157609952 learned_addr learned my addr 172.21.15.192:0/1157609952 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85ba800640 1 --2- 172.21.15.192:0/1157609952 >> v2:172.21.15.192:3300/0 conn(0x7f85b40b2230 0x7f85b40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85b9400640 1 --2- 172.21.15.192:0/1157609952 >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 0x7f85b40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85b8a00640 1 -- 172.21.15.192:0/1157609952 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3062404183 0 0) 0x7f85b4071dd0 con 0x7f85b4150480 2024-09-13T18:40:57.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85b8a00640 1 -- 172.21.15.192:0/1157609952 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f859c003520 con 0x7f85b4150480 2024-09-13T18:40:57.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85ba800640 1 -- 172.21.15.192:0/1157609952 >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 msgr2=0x7f85b40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:57.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85ba800640 1 --2- 172.21.15.192:0/1157609952 >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 0x7f85b40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85ba800640 1 -- 172.21.15.192:0/1157609952 >> v1:172.21.15.192:6789/0 conn(0x7f85b4150480 legacy=0x7f85b415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85ba800640 1 -- 172.21.15.192:0/1157609952 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b40cbd30 con 0x7f85b40b2230 2024-09-13T18:40:57.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.595+0000 7f85b9400640 1 --2- 172.21.15.192:0/1157609952 >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 0x7f85b40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.596+0000 7f85ba800640 1 --2- 172.21.15.192:0/1157609952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b40b2230 0x7f85b40cc530 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f85b406cb50 tx=0x7f85b002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9895596807ee781e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.596+0000 7f85b8a00640 1 -- 172.21.15.192:0/1157609952 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0007740 con 0x7f85b40b2230 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.596+0000 7f85b8a00640 1 -- 172.21.15.192:0/1157609952 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b002d050 con 0x7f85b40b2230 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.596+0000 7f85b8a00640 1 -- 172.21.15.192:0/1157609952 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0007aa0 con 0x7f85b40b2230 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 -- 172.21.15.192:0/1157609952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b40b2230 msgr2=0x7f85b40cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 --2- 172.21.15.192:0/1157609952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b40b2230 0x7f85b40cc530 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f85b406cb50 tx=0x7f85b002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 -- 172.21.15.192:0/1157609952 shutdown_connections 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 --2- 172.21.15.192:0/1157609952 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b40b2230 0x7f85b40cc530 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 --2- 172.21.15.192:0/1157609952 >> v2:172.21.15.194:3300/0 conn(0x7f85b4071810 0x7f85b40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 -- 172.21.15.192:0/1157609952 >> 172.21.15.192:0/1157609952 conn(0x7f85b40ae960 msgr2=0x7f85b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 -- 172.21.15.192:0/1157609952 shutdown_connections 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.597+0000 7f85bc800640 1 -- 172.21.15.192:0/1157609952 wait complete. 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.599+0000 7f85bc800640 1 Processor -- start 2024-09-13T18:40:57.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.599+0000 7f85bc800640 1 -- start start 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b4071810 0x7f85b415b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b40b2230 0x7f85b41435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b41572d0 con 0x7f85b4150480 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b41575b0 con 0x7f85b4071810 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85bc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b4157890 con 0x7f85b40b2230 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36424/0 (socket says 172.21.15.192:36424) 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 -- 172.21.15.192:0/528122726 learned_addr learned my addr 172.21.15.192:0/528122726 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:57.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85b9400640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b40b2230 0x7f85b41435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85b9e00640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b4071810 0x7f85b415b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 -- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b40b2230 msgr2=0x7f85b41435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b40b2230 0x7f85b41435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 -- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b4071810 msgr2=0x7f85b415b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b4071810 0x7f85b415b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.600+0000 7f85ba800640 1 -- 172.21.15.192:0/528122726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009a70 con 0x7f85b4150480 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85ba800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f85b002abe0 tx=0x7f85b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b003c830 con 0x7f85b4150480 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b003c990 con 0x7f85b4150480 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b4157b70 con 0x7f85b4150480 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b003cd20 con 0x7f85b4150480 2024-09-13T18:40:57.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.601+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b406c170 con 0x7f85b4150480 2024-09-13T18:40:57.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.602+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b4071dd0 con 0x7f85b4150480 2024-09-13T18:40:57.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.603+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85b0031400 con 0x7f85b4150480 2024-09-13T18:40:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.604+0000 7f85ae000640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.604+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f85b00aacd0 con 0x7f85b4150480 2024-09-13T18:40:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.604+0000 7f85b9e00640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.605+0000 7f85b9e00640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 0x7f859806d0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005880 tx=0x7f85a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.608+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85b0076330 con 0x7f85b4150480 2024-09-13T18:40:57.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.777+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85b4157410 con 0x7f85b4150480 2024-09-13T18:40:57.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.778+0000 7f85ae000640 1 -- 172.21.15.192:0/528122726 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v108) v1 ==== 74+0+12920 (secure 0 0 0) 0x7f85b4157410 con 0x7f85b4150480 2024-09-13T18:40:57.781 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:57.781 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":108,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:40:56.993628+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":95,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:40:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 msgr2=0x7f859806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 0x7f859806d0c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f85a8005880 tx=0x7f85a8009040 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 msgr2=0x7f85b4143af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f85b002abe0 tx=0x7f85b0004a40 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 shutdown_connections 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac00 0x7f859806d0c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b4150480 0x7f85b4143af0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b40b2230 0x7f85b41435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 --2- 172.21.15.192:0/528122726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b4071810 0x7f85b415b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.780+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 >> 172.21.15.192:0/528122726 conn(0x7f85b40ae960 msgr2=0x7f85b4148630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.781+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 shutdown_connections 2024-09-13T18:40:57.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.781+0000 7f85bc800640 1 -- 172.21.15.192:0/528122726 wait complete. 2024-09-13T18:40:57.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:40:57.799 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:40:57.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.951+0000 7f73bc800640 1 Processor -- start 2024-09-13T18:40:57.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.951+0000 7f73bc800640 1 -- start start 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.952+0000 7f73bc800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73b415a910 0x7f73b40b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.952+0000 7f73bc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b40b2b40 con 0x7f73b4160ac0 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.952+0000 7f73bc800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73b4161510 con 0x7f73b40adf50 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.952+0000 7f73bc800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73b40b21e0 con 0x7f73b415a910 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.952+0000 7f73b9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73b415a910 0x7f73b40b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73b415a910 0x7f73b40b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36428/0 (socket says 172.21.15.192:36428) 2024-09-13T18:40:57.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9e00640 1 -- 172.21.15.192:0/3250619086 learned_addr learned my addr 172.21.15.192:0/3250619086 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:57.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f73b4160ac0 0x7f73b40ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33600/0 (socket says 172.21.15.192:33600) 2024-09-13T18:40:57.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9e00640 1 -- 172.21.15.192:0/3250619086 >> v1:172.21.15.194:6789/0 conn(0x7f73b40adf50 legacy=0x7f73b40cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:57.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9e00640 1 -- 172.21.15.192:0/3250619086 >> v1:172.21.15.192:6789/0 conn(0x7f73b4160ac0 legacy=0x7f73b40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.953+0000 7f73b9e00640 1 -- 172.21.15.192:0/3250619086 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b41617f0 con 0x7f73b415a910 2024-09-13T18:40:57.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.954+0000 7f73b9e00640 1 --2- 172.21.15.192:0/3250619086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b415a910 0x7f73b40b2600 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009870 tx=0x7f73a802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d4884f0f31879c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.954+0000 7f73b8a00640 1 -- 172.21.15.192:0/3250619086 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8032440 con 0x7f73b415a910 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.954+0000 7f73b8a00640 1 -- 172.21.15.192:0/3250619086 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73a80325a0 con 0x7f73b415a910 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.954+0000 7f73b8a00640 1 -- 172.21.15.192:0/3250619086 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a8032930 con 0x7f73b415a910 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 -- 172.21.15.192:0/3250619086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b415a910 msgr2=0x7f73b40b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 --2- 172.21.15.192:0/3250619086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b415a910 0x7f73b40b2600 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f73a8009870 tx=0x7f73a802a210 comp rx=0 tx=0).stop 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 -- 172.21.15.192:0/3250619086 shutdown_connections 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 --2- 172.21.15.192:0/3250619086 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b415a910 0x7f73b40b2600 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 -- 172.21.15.192:0/3250619086 >> 172.21.15.192:0/3250619086 conn(0x7f73b40b08f0 msgr2=0x7f73b40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 -- 172.21.15.192:0/3250619086 shutdown_connections 2024-09-13T18:40:57.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.955+0000 7f73bc800640 1 -- 172.21.15.192:0/3250619086 wait complete. 2024-09-13T18:40:57.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.956+0000 7f73bc800640 1 Processor -- start 2024-09-13T18:40:57.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.956+0000 7f73bc800640 1 -- start start 2024-09-13T18:40:57.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73b40adf50 0x7f73b4071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 0x7f73b414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b41f67b0 con 0x7f73b4160ac0 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73b4071670 con 0x7f73b40adf50 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.957+0000 7f73bc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73b40718a0 con 0x7f73b415a910 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36432/0 (socket says 172.21.15.192:36432) 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 -- 172.21.15.192:0/3314723600 learned_addr learned my addr 172.21.15.192:0/3314723600 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73b9e00640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73b40adf50 0x7f73b4071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73b9400640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 0x7f73b414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 -- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 msgr2=0x7f73b414b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 0x7f73b414b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 -- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73b40adf50 msgr2=0x7f73b4071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73b40adf50 0x7f73b4071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 -- 172.21.15.192:0/3314723600 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a80094d0 con 0x7f73b4160ac0 2024-09-13T18:40:57.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73b9400640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 0x7f73b414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ba800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c780 tx=0x7f73b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.958+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0003d80 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.959+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b000ce30 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.959+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73b41f5e10 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.959+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0005290 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.959+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73b41f63d0 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.960+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73b41f68f0 con 0x7f73b4160ac0 2024-09-13T18:40:57.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.960+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73b00053f0 con 0x7f73b4160ac0 2024-09-13T18:40:57.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.961+0000 7f73ae000640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 0x7f739806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:57.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.961+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f73b00887f0 con 0x7f73b4160ac0 2024-09-13T18:40:57.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.962+0000 7f73b9e00640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 0x7f739806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:57.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.962+0000 7f73b9e00640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 0x7f739806d0c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f73a8034000 tx=0x7f73a802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:57.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:57.966+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73b41f68f0 con 0x7f73b4160ac0 2024-09-13T18:40:58.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.133+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73b41f68f0 con 0x7f73b4160ac0 2024-09-13T18:40:58.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.134+0000 7f73ae000640 1 -- 172.21.15.192:0/3314723600 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v108) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73b41f68f0 con 0x7f73b4160ac0 2024-09-13T18:40:58.137 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 msgr2=0x7f739806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 0x7f739806d0c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f73a8034000 tx=0x7f73a802e000 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 msgr2=0x7f73b406f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f73b000c780 tx=0x7f73b000cc40 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 shutdown_connections 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f739806ac00 0x7f739806d0c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73b4160ac0 0x7f73b406f1a0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73b415a910 0x7f73b414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 --2- 172.21.15.192:0/3314723600 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73b40adf50 0x7f73b4071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 >> 172.21.15.192:0/3314723600 conn(0x7f73b40b08f0 msgr2=0x7f73b40ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 shutdown_connections 2024-09-13T18:40:58.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.136+0000 7f73bc800640 1 -- 172.21.15.192:0/3314723600 wait complete. 2024-09-13T18:40:58.155 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:40:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.305+0000 7fa692c00640 1 Processor -- start 2024-09-13T18:40:58.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.305+0000 7fa692c00640 1 -- start start 2024-09-13T18:40:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa692c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa68c0b3f10 0x7fa68c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa692c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 0x7fa68c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa692c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa68c0b2f00 con 0x7fa68c15dee0 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa692c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa68c15aec0 con 0x7fa68c0b3f10 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa692c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0b3150 con 0x7fa68c0b0490 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa68be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa68c15dee0 0x7fa68c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33610/0 (socket says 172.21.15.192:33610) 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.306+0000 7fa68be00640 1 -- 172.21.15.192:0/1586464443 learned_addr learned my addr 172.21.15.192:0/1586464443 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa690c00640 1 --2- 172.21.15.192:0/1586464443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 0x7fa68c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa68b400640 1 --2- 172.21.15.192:0/1586464443 >> v2:172.21.15.194:3300/0 conn(0x7fa68c0b3f10 0x7fa68c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa68aa00640 1 -- 172.21.15.192:0/1586464443 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 98449749 0 0) 0x7fa68c0b2f00 con 0x7fa68c15dee0 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa68aa00640 1 -- 172.21.15.192:0/1586464443 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa670003520 con 0x7fa68c15dee0 2024-09-13T18:40:58.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa690c00640 1 -- 172.21.15.192:0/1586464443 >> v2:172.21.15.194:3300/0 conn(0x7fa68c0b3f10 msgr2=0x7fa68c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:58.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa690c00640 1 --2- 172.21.15.192:0/1586464443 >> v2:172.21.15.194:3300/0 conn(0x7fa68c0b3f10 0x7fa68c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa690c00640 1 -- 172.21.15.192:0/1586464443 >> v1:172.21.15.192:6789/0 conn(0x7fa68c15dee0 legacy=0x7fa68c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.307+0000 7fa690c00640 1 -- 172.21.15.192:0/1586464443 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0b3430 con 0x7fa68c0b0490 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.308+0000 7fa690c00640 1 --2- 172.21.15.192:0/1586464443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 0x7fa68c15a980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae8ed1b08a98aec3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.308+0000 7fa68aa00640 1 -- 172.21.15.192:0/1586464443 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684007740 con 0x7fa68c0b0490 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.308+0000 7fa68aa00640 1 -- 172.21.15.192:0/1586464443 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68402d050 con 0x7fa68c0b0490 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.308+0000 7fa68aa00640 1 -- 172.21.15.192:0/1586464443 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa684007ac0 con 0x7fa68c0b0490 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 -- 172.21.15.192:0/1586464443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 msgr2=0x7fa68c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 --2- 172.21.15.192:0/1586464443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 0x7fa68c15a980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa684009d90 tx=0x7fa68402a660 comp rx=0 tx=0).stop 2024-09-13T18:40:58.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 -- 172.21.15.192:0/1586464443 shutdown_connections 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 --2- 172.21.15.192:0/1586464443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0b0490 0x7fa68c15a980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 --2- 172.21.15.192:0/1586464443 >> v2:172.21.15.194:3300/0 conn(0x7fa68c0b3f10 0x7fa68c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 -- 172.21.15.192:0/1586464443 >> 172.21.15.192:0/1586464443 conn(0x7fa68c0ae960 msgr2=0x7fa68c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 -- 172.21.15.192:0/1586464443 shutdown_connections 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.309+0000 7fa692c00640 1 -- 172.21.15.192:0/1586464443 wait complete. 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.311+0000 7fa692c00640 1 Processor -- start 2024-09-13T18:40:58.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.311+0000 7fa692c00640 1 -- start start 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c15dee0 0x7fa68c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0add80 0x7fa68c15c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c0ae230 con 0x7fa68c0b0490 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1f3260 con 0x7fa68c15dee0 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa692c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa68c1f3540 con 0x7fa68c0add80 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36448/0 (socket says 172.21.15.192:36448) 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 -- 172.21.15.192:0/2775236902 learned_addr learned my addr 172.21.15.192:0/2775236902 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa690c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0add80 0x7fa68c15c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68b400640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c15dee0 0x7fa68c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 -- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0add80 msgr2=0x7fa68c15c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0add80 0x7fa68c15c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 -- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c15dee0 msgr2=0x7fa68c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c15dee0 0x7fa68c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.312+0000 7fa68be00640 1 -- 172.21.15.192:0/2775236902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa684009a70 con 0x7fa68c0b0490 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa68be00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c500 tx=0x7fa67c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c005ce0 con 0x7fa68c0b0490 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c005e40 con 0x7fa68c0b0490 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68c1f3820 con 0x7fa68c0b0490 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c007330 con 0x7fa68c0b0490 2024-09-13T18:40:58.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.313+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68c1f2f70 con 0x7fa68c0b0490 2024-09-13T18:40:58.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.314+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa68c1f3d40 con 0x7fa68c0b0490 2024-09-13T18:40:58.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.315+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa67c007550 con 0x7fa68c0b0490 2024-09-13T18:40:58.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.316+0000 7fa683e00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 0x7fa66c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.316+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa67c088670 con 0x7fa68c0b0490 2024-09-13T18:40:58.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.316+0000 7fa68b400640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 0x7fa66c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.317+0000 7fa68b400640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 0x7fa66c06d0c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa68c15c430 tx=0x7fa678009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.320+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa67c053d00 con 0x7fa68c0b0490 2024-09-13T18:40:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.490+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa68c06f130 con 0x7fa68c0b0490 2024-09-13T18:40:58.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.491+0000 7fa683e00640 1 -- 172.21.15.192:0/2775236902 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v108) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa67c017090 con 0x7fa68c0b0490 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:40:58.494 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 msgr2=0x7fa66c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 0x7fa66c06d0c0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fa68c15c430 tx=0x7fa678009190 comp rx=0 tx=0).stop 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 msgr2=0x7fa68c136410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c500 tx=0x7fa67c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 shutdown_connections 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa66c06ac00 0x7fa66c06d0c0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa68c0add80 0x7fa68c15c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa68c15dee0 0x7fa68c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 --2- 172.21.15.192:0/2775236902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa68c0b0490 0x7fa68c136410 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 >> 172.21.15.192:0/2775236902 conn(0x7fa68c0ae960 msgr2=0x7fa68c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 shutdown_connections 2024-09-13T18:40:58.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.493+0000 7fa692c00640 1 -- 172.21.15.192:0/2775236902 wait complete. 2024-09-13T18:40:58.511 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:40:58.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:40:58.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.664+0000 7f53e9c00640 1 Processor -- start 2024-09-13T18:40:58.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.664+0000 7f53e9c00640 1 -- start start 2024-09-13T18:40:58.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e9c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f53e4071b80 0x7f53e415f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e9c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e41403e0 0x7f53e4070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e9c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e406a330 con 0x7f53e4071100 2024-09-13T18:40:58.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e9c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e413e0f0 con 0x7f53e41403e0 2024-09-13T18:40:58.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e9c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e415f840 con 0x7f53e4071b80 2024-09-13T18:40:58.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e41403e0 0x7f53e4070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53e41403e0 0x7f53e4070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36456/0 (socket says 172.21.15.192:36456) 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 -- 172.21.15.192:0/2712870596 learned_addr learned my addr 172.21.15.192:0/2712870596 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f53e4071100 0x7f53e40cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33612/0 (socket says 172.21.15.192:33612) 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2a00640 1 --2- 172.21.15.192:0/2712870596 >> v2:172.21.15.194:3300/0 conn(0x7f53e4071b80 0x7f53e415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 -- 172.21.15.192:0/2712870596 >> v2:172.21.15.194:3300/0 conn(0x7f53e4071b80 msgr2=0x7f53e415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 --2- 172.21.15.192:0/2712870596 >> v2:172.21.15.194:3300/0 conn(0x7f53e4071b80 0x7f53e415f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 -- 172.21.15.192:0/2712870596 >> v1:172.21.15.192:6789/0 conn(0x7f53e4071100 legacy=0x7f53e40cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.666+0000 7f53e2000640 1 -- 172.21.15.192:0/2712870596 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e415b300 con 0x7f53e41403e0 2024-09-13T18:40:58.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.667+0000 7f53e2000640 1 --2- 172.21.15.192:0/2712870596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e4070bc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f53e406cdb0 tx=0x7f53d002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c71d4cbf8ce52fc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e1600640 1 -- 172.21.15.192:0/2712870596 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0032440 con 0x7f53e41403e0 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e1600640 1 -- 172.21.15.192:0/2712870596 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d00325a0 con 0x7f53e41403e0 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e1600640 1 -- 172.21.15.192:0/2712870596 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0032930 con 0x7f53e41403e0 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 -- 172.21.15.192:0/2712870596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 msgr2=0x7f53e4070bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 --2- 172.21.15.192:0/2712870596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e4070bc0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f53e406cdb0 tx=0x7f53d002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 -- 172.21.15.192:0/2712870596 shutdown_connections 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 --2- 172.21.15.192:0/2712870596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e4070bc0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 --2- 172.21.15.192:0/2712870596 >> v2:172.21.15.194:3300/0 conn(0x7f53e4071b80 0x7f53e415f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 -- 172.21.15.192:0/2712870596 >> 172.21.15.192:0/2712870596 conn(0x7f53e40b0c40 msgr2=0x7f53e40b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 -- 172.21.15.192:0/2712870596 shutdown_connections 2024-09-13T18:40:58.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.668+0000 7f53e9c00640 1 -- 172.21.15.192:0/2712870596 wait complete. 2024-09-13T18:40:58.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.670+0000 7f53e9c00640 1 Processor -- start 2024-09-13T18:40:58.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.670+0000 7f53e9c00640 1 -- start start 2024-09-13T18:40:58.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e4071100 0x7f53e41f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e4071b80 0x7f53e413c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e41f2730 con 0x7f53e41403e0 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e41f2a10 con 0x7f53e4071100 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e9c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e41f2cf0 con 0x7f53e4071b80 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36468/0 (socket says 172.21.15.192:36468) 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e3400640 1 -- 172.21.15.192:0/58380214 learned_addr learned my addr 172.21.15.192:0/58380214 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.671+0000 7f53e2a00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e4071100 0x7f53e41f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e2000640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e4071b80 0x7f53e413c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 -- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e4071b80 msgr2=0x7f53e413c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e4071b80 0x7f53e413c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 -- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e4071100 msgr2=0x7f53e41f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:58.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e4071100 0x7f53e41f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:58.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 -- 172.21.15.192:0/58380214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d00094d0 con 0x7f53e41403e0 2024-09-13T18:40:58.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e3400640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00c400 tx=0x7f53dc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0074e0 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53dc007640 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e41f2fd0 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53dc0049e0 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.672+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e415ced0 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.673+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e41f34f0 con 0x7f53e41403e0 2024-09-13T18:40:58.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.674+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f53dc004b40 con 0x7f53e41403e0 2024-09-13T18:40:58.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.675+0000 7f53daa00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 0x7f53c406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:58.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.675+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53dc0887e0 con 0x7f53e41403e0 2024-09-13T18:40:58.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.675+0000 7f53e2a00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 0x7f53c406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:58.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.676+0000 7f53e2a00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 0x7f53c406d0c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f53e406aec0 tx=0x7f53d40098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:58.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.679+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53e41f34f0 con 0x7f53e41403e0 2024-09-13T18:40:58.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:58.847+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f53e406a330 con 0x7f53e41403e0 2024-09-13T18:40:59.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.517+0000 7f53daa00640 1 -- 172.21.15.192:0/58380214 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v109) v1 ==== 138+0+0 (secure 0 0 0) 0x7f53e406a330 con 0x7f53e41403e0 2024-09-13T18:40:59.520 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:40:59.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 msgr2=0x7f53c406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 0x7f53c406d0c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f53e406aec0 tx=0x7f53d40098d0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 msgr2=0x7f53e413cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f53dc00c400 tx=0x7f53dc00c8c0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 shutdown_connections 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f53c406ac00 0x7f53c406d0c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53e41403e0 0x7f53e413cb40 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53e4071b80 0x7f53e413c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 --2- 172.21.15.192:0/58380214 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53e4071100 0x7f53e41f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 >> 172.21.15.192:0/58380214 conn(0x7f53e40b0c40 msgr2=0x7f53e40cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 shutdown_connections 2024-09-13T18:40:59.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.522+0000 7f53e9c00640 1 -- 172.21.15.192:0/58380214 wait complete. 2024-09-13T18:40:59.542 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:40:59.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.698+0000 7fe6e0400640 1 Processor -- start 2024-09-13T18:40:59.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.698+0000 7fe6e0400640 1 -- start start 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6e0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6e0400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d806cc40 con 0x7fe6d81434c0 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6e0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6d806b480 con 0x7fe6d80b3bd0 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6e0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d80b4060 con 0x7fe6d806c800 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6dda00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe6d81434c0 0x7fe6d806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33618/0 (socket says 172.21.15.192:33618) 2024-09-13T18:40:59.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.699+0000 7fe6dda00640 1 -- 172.21.15.192:0/1574352066 learned_addr learned my addr 172.21.15.192:0/1574352066 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6dd000640 1 --2- 172.21.15.192:0/1574352066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913962589 0 0) 0x7fe6d806cc40 con 0x7fe6d81434c0 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6c0003520 con 0x7fe6d81434c0 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2757826970 0 0) 0x7fe6c0003520 con 0x7fe6d81434c0 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6dd000640 1 -- 172.21.15.192:0/1574352066 >> v1:172.21.15.194:6789/0 conn(0x7fe6d80b3bd0 legacy=0x7fe6d806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6dd000640 1 -- 172.21.15.192:0/1574352066 >> v1:172.21.15.192:6789/0 conn(0x7fe6d81434c0 legacy=0x7fe6d806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.700+0000 7fe6dd000640 1 -- 172.21.15.192:0/1574352066 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6d806b760 con 0x7fe6d806c800 2024-09-13T18:40:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.701+0000 7fe6dd000640 1 --2- 172.21.15.192:0/1574352066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d80b3690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009800 tx=0x7fe6c402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7deceb2ea30c6a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.701+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6cc0019f0 con 0x7fe6d806c800 2024-09-13T18:40:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6c402ab90 con 0x7fe6d806c800 2024-09-13T18:40:59.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6d7e00640 1 -- 172.21.15.192:0/1574352066 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6c4032440 con 0x7fe6d806c800 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 -- 172.21.15.192:0/1574352066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 msgr2=0x7fe6d80b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 --2- 172.21.15.192:0/1574352066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d80b3690 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe6c4009800 tx=0x7fe6c402a100 comp rx=0 tx=0).stop 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 -- 172.21.15.192:0/1574352066 shutdown_connections 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 --2- 172.21.15.192:0/1574352066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d80b3690 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 -- 172.21.15.192:0/1574352066 >> 172.21.15.192:0/1574352066 conn(0x7fe6d80b08f0 msgr2=0x7fe6d80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:40:59.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 -- 172.21.15.192:0/1574352066 shutdown_connections 2024-09-13T18:40:59.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.702+0000 7fe6e0400640 1 -- 172.21.15.192:0/1574352066 wait complete. 2024-09-13T18:40:59.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.704+0000 7fe6e0400640 1 Processor -- start 2024-09-13T18:40:59.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.704+0000 7fe6e0400640 1 -- start start 2024-09-13T18:40:59.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d8139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b3bd0 0x7fe6d813e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d813d880 con 0x7fe6d81434c0 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d813db60 con 0x7fe6d80b3bd0 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6e0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6d813de40 con 0x7fe6d806c800 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6de400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6de400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36476/0 (socket says 172.21.15.192:36476) 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.705+0000 7fe6de400640 1 -- 172.21.15.192:0/3220949971 learned_addr learned my addr 172.21.15.192:0/3220949971 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6dda00640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d8139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6dd000640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b3bd0 0x7fe6d813e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 -- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 msgr2=0x7fe6d8139120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d8139120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 -- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b3bd0 msgr2=0x7fe6d813e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:40:59.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b3bd0 0x7fe6d813e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:40:59.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 -- 172.21.15.192:0/3220949971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c4009400 con 0x7fe6d81434c0 2024-09-13T18:40:59.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6de400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c4e0 tx=0x7fe6d000c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d0005480 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6d00035f0 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6d813e120 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6d00039a0 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.706+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6d813d530 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.707+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6d813e640 con 0x7fe6d81434c0 2024-09-13T18:40:59.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.708+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe6d0003b00 con 0x7fe6d81434c0 2024-09-13T18:40:59.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.709+0000 7fe6d5600640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:40:59.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.709+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe6d0088e00 con 0x7fe6d81434c0 2024-09-13T18:40:59.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.709+0000 7fe6dda00640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:40:59.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.710+0000 7fe6dda00640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005fd0 tx=0x7fe6cc0018f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:40:59.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.714+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe6d813e640 con 0x7fe6d81434c0 2024-09-13T18:40:59.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:40:59.886+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe6d813e640 con 0x7fe6d81434c0 2024-09-13T18:41:00.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.530+0000 7fe6d5600640 1 -- 172.21.15.192:0/3220949971 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v110) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe6d813e640 con 0x7fe6d81434c0 2024-09-13T18:41:00.534 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 msgr2=0x7fe6b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe6cc005fd0 tx=0x7fe6cc0018f0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 msgr2=0x7fe6d813fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fe6d000c4e0 tx=0x7fe6d000c9a0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 shutdown_connections 2024-09-13T18:41:00.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe6b806ac00 0x7fe6b806d0c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6d81434c0 0x7fe6d813fb40 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe6d80b3bd0 0x7fe6d813e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.537+0000 7fe6e0400640 1 --2- 172.21.15.192:0/3220949971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe6d806c800 0x7fe6d8139120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.538+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 >> 172.21.15.192:0/3220949971 conn(0x7fe6d80b08f0 msgr2=0x7fe6d80cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.538+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 shutdown_connections 2024-09-13T18:41:00.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.538+0000 7fe6e0400640 1 -- 172.21.15.192:0/3220949971 wait complete. 2024-09-13T18:41:00.559 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:41:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.711+0000 7f079f400640 1 Processor -- start 2024-09-13T18:41:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.711+0000 7f079f400640 1 -- start start 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f07980b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079f400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079806cc40 con 0x7f07981434c0 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079f400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f079806b480 con 0x7f07980b3bd0 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07980b4060 con 0x7f079806c800 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079ca00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f07981434c0 0x7f079806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45598/0 (socket says 172.21.15.192:45598) 2024-09-13T18:41:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.712+0000 7f079ca00640 1 -- 172.21.15.192:0/227121542 learned_addr learned my addr 172.21.15.192:0/227121542 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797e00640 1 --2- 172.21.15.192:0/227121542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f07980b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3984122867 0 0) 0x7f079806cc40 con 0x7f07981434c0 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0780005730 con 0x7f07981434c0 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192746725 0 0) 0x7f079806b480 con 0x7f07980b3bd0 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f079806cc40 con 0x7f07980b3bd0 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797e00640 1 -- 172.21.15.192:0/227121542 >> v1:172.21.15.194:6789/0 conn(0x7f07980b3bd0 legacy=0x7f079806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797e00640 1 -- 172.21.15.192:0/227121542 >> v1:172.21.15.192:6789/0 conn(0x7f07981434c0 legacy=0x7f079806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.713+0000 7f0797e00640 1 -- 172.21.15.192:0/227121542 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079806b760 con 0x7f079806c800 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.714+0000 7f0797e00640 1 --2- 172.21.15.192:0/227121542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f07980b3690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0784009800 tx=0x7f078402a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8b24fd30267ccd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.714+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784032440 con 0x7f079806c800 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.714+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07840325a0 con 0x7f079806c800 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f0797400640 1 -- 172.21.15.192:0/227121542 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0784032910 con 0x7f079806c800 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 -- 172.21.15.192:0/227121542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 msgr2=0x7f07980b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 --2- 172.21.15.192:0/227121542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f07980b3690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0784009800 tx=0x7f078402a250 comp rx=0 tx=0).stop 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 -- 172.21.15.192:0/227121542 shutdown_connections 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 --2- 172.21.15.192:0/227121542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f07980b3690 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 -- 172.21.15.192:0/227121542 >> 172.21.15.192:0/227121542 conn(0x7f07980b08f0 msgr2=0x7f07980b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 -- 172.21.15.192:0/227121542 shutdown_connections 2024-09-13T18:41:00.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.715+0000 7f079f400640 1 -- 172.21.15.192:0/227121542 wait complete. 2024-09-13T18:41:00.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.717+0000 7f079f400640 1 Processor -- start 2024-09-13T18:41:00.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.717+0000 7f079f400640 1 -- start start 2024-09-13T18:41:00.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f079806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07981434c0 0x7f07981f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07981580f0 con 0x7f07980b3bd0 2024-09-13T18:41:00.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0798158c70 con 0x7f07981434c0 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079806f5c0 con 0x7f079806c800 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35844/0 (socket says 172.21.15.192:35844) 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 -- 172.21.15.192:0/209322930 learned_addr learned my addr 172.21.15.192:0/209322930 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079ca00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f079806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f079d400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07981434c0 0x7f07981f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 -- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 msgr2=0x7f079806f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f079806f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.718+0000 7f0797e00640 1 -- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07981434c0 msgr2=0x7f07981f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0797e00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07981434c0 0x7f07981f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0797e00640 1 -- 172.21.15.192:0/209322930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0784009400 con 0x7f07980b3bd0 2024-09-13T18:41:00.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0797e00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f078402a840 tx=0x7f07840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078403e860 con 0x7f07980b3bd0 2024-09-13T18:41:00.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f078403e9c0 con 0x7f07980b3bd0 2024-09-13T18:41:00.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f078403ed30 con 0x7f07980b3bd0 2024-09-13T18:41:00.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0798158340 con 0x7f07980b3bd0 2024-09-13T18:41:00.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.719+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0798158900 con 0x7f07980b3bd0 2024-09-13T18:41:00.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.720+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07980cc7d0 con 0x7f07980b3bd0 2024-09-13T18:41:00.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.721+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f078403c400 con 0x7f07980b3bd0 2024-09-13T18:41:00.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.722+0000 7f0794c00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 0x7f077806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:00.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.723+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f07840aa030 con 0x7f07980b3bd0 2024-09-13T18:41:00.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.723+0000 7f079ca00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 0x7f077806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:00.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.723+0000 7f079ca00640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 0x7f077806d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f078c000f60 tx=0x7f078c007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:00.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.728+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0784075440 con 0x7f07980b3bd0 2024-09-13T18:41:00.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.928+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f07980b22f0 con 0x7f07980b3bd0 2024-09-13T18:41:00.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.935+0000 7f0794c00640 1 -- 172.21.15.192:0/209322930 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0784078a60 con 0x7f07980b3bd0 2024-09-13T18:41:00.941 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 12 and data pool 13 2024-09-13T18:41:00.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.942+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 msgr2=0x7f077806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.942+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 0x7f077806d0c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f078c000f60 tx=0x7f078c007d70 comp rx=0 tx=0).stop 2024-09-13T18:41:00.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.942+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 msgr2=0x7f07980ccc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:00.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.942+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f078402a840 tx=0x7f07840046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 shutdown_connections 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f077806ac00 0x7f077806d0c0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f07981434c0 0x7f07981f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07980b3bd0 0x7f07980ccc50 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 --2- 172.21.15.192:0/209322930 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f079806c800 0x7f079806f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:00.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.943+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 >> 172.21.15.192:0/209322930 conn(0x7f07980b08f0 msgr2=0x7f07980ae960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:00.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.945+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 shutdown_connections 2024-09-13T18:41:00.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:00.950+0000 7f079f400640 1 -- 172.21.15.192:0/209322930 wait complete. 2024-09-13T18:41:00.974 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:01.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.125+0000 7fdb02a00640 1 Processor -- start 2024-09-13T18:41:01.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.125+0000 7fdb02a00640 1 -- start start 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb02a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdafc071810 0x7fdafc0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc0b2230 0x7fdafc0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb02a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdafc071dd0 con 0x7fdafc150480 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb02a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc0cb770 con 0x7fdafc071810 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb02a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0cba50 con 0x7fdafc0b2230 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdafc071810 0x7fdafc0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdafc071810 0x7fdafc0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35860/0 (socket says 172.21.15.192:35860) 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 -- 172.21.15.192:0/2273755408 learned_addr learned my addr 172.21.15.192:0/2273755408 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:01.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdb00a00640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc0b2230 0x7fdafc0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 -- 172.21.15.192:0/2273755408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc0b2230 msgr2=0x7fdafc0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:01.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc0b2230 0x7fdafc0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 -- 172.21.15.192:0/2273755408 >> v1:172.21.15.194:6789/0 conn(0x7fdafc150480 legacy=0x7fdafc15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.127+0000 7fdafb400640 1 -- 172.21.15.192:0/2273755408 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0cbd30 con 0x7fdafc071810 2024-09-13T18:41:01.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.128+0000 7fdafb400640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc071810 0x7fdafc0b1cf0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009870 tx=0x7fdae802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343badca232f5344 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdafaa00640 1 -- 172.21.15.192:0/2273755408 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8032440 con 0x7fdafc071810 2024-09-13T18:41:01.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdafaa00640 1 -- 172.21.15.192:0/2273755408 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae80325a0 con 0x7fdafc071810 2024-09-13T18:41:01.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdafaa00640 1 -- 172.21.15.192:0/2273755408 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8032930 con 0x7fdafc071810 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 -- 172.21.15.192:0/2273755408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc071810 msgr2=0x7fdafc0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc071810 0x7fdafc0b1cf0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009870 tx=0x7fdae802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 -- 172.21.15.192:0/2273755408 shutdown_connections 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc0b2230 0x7fdafc0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2273755408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc071810 0x7fdafc0b1cf0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 -- 172.21.15.192:0/2273755408 >> 172.21.15.192:0/2273755408 conn(0x7fdafc0ae960 msgr2=0x7fdafc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 -- 172.21.15.192:0/2273755408 shutdown_connections 2024-09-13T18:41:01.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.129+0000 7fdb02a00640 1 -- 172.21.15.192:0/2273755408 wait complete. 2024-09-13T18:41:01.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.131+0000 7fdb02a00640 1 Processor -- start 2024-09-13T18:41:01.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.131+0000 7fdb02a00640 1 -- start start 2024-09-13T18:41:01.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 0x7fdafc14c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 0x7fdafc14e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc14bca0 con 0x7fdafc0b2230 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc14e850 con 0x7fdafc150480 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdb02a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc14ea80 con 0x7fdafc071810 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdafb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdafb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35868/0 (socket says 172.21.15.192:35868) 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.132+0000 7fdafb400640 1 -- 172.21.15.192:0/2026080640 learned_addr learned my addr 172.21.15.192:0/2026080640 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 -- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 msgr2=0x7fdafc14c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafbe00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 0x7fdafc14c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdb00a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 0x7fdafc14e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 0x7fdafc14c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 -- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 msgr2=0x7fdafc14e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 0x7fdafc14e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 -- 172.21.15.192:0/2026080640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae80094d0 con 0x7fdafc0b2230 2024-09-13T18:41:01.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafbe00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 0x7fdafc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:01.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdb00a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 0x7fdafc14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:01.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdafb400640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8032440 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae8030980 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc14b5e0 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.133+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae8030d30 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.134+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc14ed60 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.134+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc14b440 con 0x7fdafc0b2230 2024-09-13T18:41:01.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.135+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdae8039040 con 0x7fdafc0b2230 2024-09-13T18:41:01.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.136+0000 7fdaf3e00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 0x7fdadc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.136+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdae80a9d10 con 0x7fdafc0b2230 2024-09-13T18:41:01.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.136+0000 7fdafbe00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 0x7fdadc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.137+0000 7fdafbe00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 0x7fdadc06d0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f60 tx=0x7fdaec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.141+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdafc14b440 con 0x7fdafc0b2230 2024-09-13T18:41:01.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.309+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdafc14b440 con 0x7fdafc0b2230 2024-09-13T18:41:01.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.310+0000 7fdaf3e00640 1 -- 172.21.15.192:0/2026080640 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16657 (secure 0 0 0) 0x7fdafc14b440 con 0x7fdafc0b2230 2024-09-13T18:41:01.313 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:01.313 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":111,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:00.929991+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:01.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 msgr2=0x7fdadc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 0x7fdadc06d0c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdaec000f60 tx=0x7fdaec009040 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 msgr2=0x7fdafc0adf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fdae8000c00 tx=0x7fdae80046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 shutdown_connections 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdadc06ac00 0x7fdadc06d0c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdafc150480 0x7fdafc14e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdafc0b2230 0x7fdafc0adf70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 --2- 172.21.15.192:0/2026080640 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdafc071810 0x7fdafc14c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 >> 172.21.15.192:0/2026080640 conn(0x7fdafc0ae960 msgr2=0x7fdafc157560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.312+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 shutdown_connections 2024-09-13T18:41:01.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.313+0000 7fdb02a00640 1 -- 172.21.15.192:0/2026080640 wait complete. 2024-09-13T18:41:01.332 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:01.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.482+0000 7f4e97e00640 1 Processor -- start 2024-09-13T18:41:01.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.482+0000 7f4e97e00640 1 -- start start 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e9806bc30 0x7f4e9815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9815af60 con 0x7f4e98159b00 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e9806b7a0 con 0x7f4e980b3480 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e9815ac80 con 0x7f4e9806bc30 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e9806bc30 0x7f4e9815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4e9806bc30 0x7f4e9815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35880/0 (socket says 172.21.15.192:35880) 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e96a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4e98159b00 0x7f4e980b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45614/0 (socket says 172.21.15.192:45614) 2024-09-13T18:41:01.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.483+0000 7f4e97400640 1 -- 172.21.15.192:0/1982981772 learned_addr learned my addr 172.21.15.192:0/1982981772 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.484+0000 7f4e97400640 1 -- 172.21.15.192:0/1982981772 >> v1:172.21.15.194:6789/0 conn(0x7f4e980b3480 legacy=0x7f4e98159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.484+0000 7f4e97400640 1 -- 172.21.15.192:0/1982981772 >> v1:172.21.15.192:6789/0 conn(0x7f4e98159b00 legacy=0x7f4e980b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.484+0000 7f4e97400640 1 -- 172.21.15.192:0/1982981772 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9806b150 con 0x7f4e9806bc30 2024-09-13T18:41:01.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e97400640 1 --2- 172.21.15.192:0/1982981772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e9806bc30 0x7f4e9815a5f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d150 tx=0x7f4e9002c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b306ae402b1df09 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e95600640 1 -- 172.21.15.192:0/1982981772 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b2e0 con 0x7f4e9806bc30 2024-09-13T18:41:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e95600640 1 -- 172.21.15.192:0/1982981772 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9000b440 con 0x7f4e9806bc30 2024-09-13T18:41:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e95600640 1 -- 172.21.15.192:0/1982981772 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90009820 con 0x7f4e9806bc30 2024-09-13T18:41:01.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e97e00640 1 -- 172.21.15.192:0/1982981772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e9806bc30 msgr2=0x7f4e9815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.485+0000 7f4e97e00640 1 --2- 172.21.15.192:0/1982981772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e9806bc30 0x7f4e9815a5f0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000d150 tx=0x7f4e9002c940 comp rx=0 tx=0).stop 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.486+0000 7f4e97e00640 1 -- 172.21.15.192:0/1982981772 shutdown_connections 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.486+0000 7f4e97e00640 1 --2- 172.21.15.192:0/1982981772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e9806bc30 0x7f4e9815a5f0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.486+0000 7f4e97e00640 1 -- 172.21.15.192:0/1982981772 >> 172.21.15.192:0/1982981772 conn(0x7f4e980736d0 msgr2=0x7f4e980b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.486+0000 7f4e97e00640 1 -- 172.21.15.192:0/1982981772 shutdown_connections 2024-09-13T18:41:01.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.486+0000 7f4e97e00640 1 -- 172.21.15.192:0/1982981772 wait complete. 2024-09-13T18:41:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.487+0000 7f4e97e00640 1 Processor -- start 2024-09-13T18:41:01.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.487+0000 7f4e97e00640 1 -- start start 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e9806bc30 0x7f4e98154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e980b3480 0x7f4e9815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806fbb0 con 0x7f4e98159b00 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9806f580 con 0x7f4e980b3480 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98154f70 con 0x7f4e9806bc30 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.488+0000 7f4e97400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35892/0 (socket says 172.21.15.192:35892) 2024-09-13T18:41:01.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 -- 172.21.15.192:0/2492076202 learned_addr learned my addr 172.21.15.192:0/2492076202 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e96a00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e9806bc30 0x7f4e98154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e96000640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e980b3480 0x7f4e9815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 -- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e9806bc30 msgr2=0x7f4e98154670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e9806bc30 0x7f4e98154670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 -- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e980b3480 msgr2=0x7f4e9815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e980b3480 0x7f4e9815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 -- 172.21.15.192:0/2492076202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9000bd40 con 0x7f4e98159b00 2024-09-13T18:41:01.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e97400640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4e90034040 tx=0x7f4e90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.489+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b2e0 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.490+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e90032bf0 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.490+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e98155250 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.490+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9000b720 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.490+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e98154bb0 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.491+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e98156d10 con 0x7f4e98159b00 2024-09-13T18:41:01.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.492+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e9003b3f0 con 0x7f4e98159b00 2024-09-13T18:41:01.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.492+0000 7f4e8f400640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 0x7f4e7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.492+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e900aa930 con 0x7f4e98159b00 2024-09-13T18:41:01.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.493+0000 7f4e96a00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 0x7f4e7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.493+0000 7f4e96a00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 0x7f4e7806d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000f60 tx=0x7f4e88000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.496+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e90075bb0 con 0x7f4e98159b00 2024-09-13T18:41:01.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.666+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e980b2d70 con 0x7f4e98159b00 2024-09-13T18:41:01.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.668+0000 7f4e8f400640 1 -- 172.21.15.192:0/2492076202 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v111) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f4e9004a090 con 0x7f4e98159b00 2024-09-13T18:41:01.671 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:01.671 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":111,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:00.929991+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 msgr2=0x7f4e7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 0x7f4e7806d0c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000f60 tx=0x7f4e88000ed0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 msgr2=0x7f4e9814e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f4e90034040 tx=0x7f4e90004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 shutdown_connections 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e7806ac00 0x7f4e7806d0c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e98159b00 0x7f4e9814e450 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e980b3480 0x7f4e9815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 --2- 172.21.15.192:0/2492076202 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e9806bc30 0x7f4e98154670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 >> 172.21.15.192:0/2492076202 conn(0x7f4e980736d0 msgr2=0x7f4e980ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 shutdown_connections 2024-09-13T18:41:01.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.670+0000 7f4e97e00640 1 -- 172.21.15.192:0/2492076202 wait complete. 2024-09-13T18:41:01.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:41:01.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.843+0000 7f0aaa200640 1 Processor -- start 2024-09-13T18:41:01.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.843+0000 7f0aaa200640 1 -- start start 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aaa200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0aa40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aaa200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0aa406c0b0 0x7f0aa406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aaa200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa40b2000 con 0x7f0aa40b3af0 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aaa200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa406ca80 con 0x7f0aa406c0b0 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aaa200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415b970 con 0x7f0aa41589f0 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aa2a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0aa40b3af0 0x7f0aa415b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45624/0 (socket says 172.21.15.192:45624) 2024-09-13T18:41:01.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.844+0000 7f0aa2a00640 1 -- 172.21.15.192:0/1283321553 learned_addr learned my addr 172.21.15.192:0/1283321553 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa3400640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0aa40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1283321553 >> v2:172.21.15.194:3300/0 conn(0x7f0aa406c0b0 0x7f0aa406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4004492118 0 0) 0x7f0aa40b2000 con 0x7f0aa40b3af0 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a88003520 con 0x7f0aa40b3af0 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 906939950 0 0) 0x7f0a88003520 con 0x7f0aa40b3af0 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 msgr2=0x7f0aa40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:01.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0aa40b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 >> v2:172.21.15.194:3300/0 conn(0x7f0aa406c0b0 msgr2=0x7f0aa406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 --2- 172.21.15.192:0/1283321553 >> v2:172.21.15.194:3300/0 conn(0x7f0aa406c0b0 0x7f0aa406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa415bbd0 con 0x7f0aa40b3af0 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f0a90001670 con 0x7f0aa40b3af0 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 >> v1:172.21.15.192:6789/0 conn(0x7f0aa40b3af0 legacy=0x7f0aa415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0a88003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a88003ef0 0x7f0a880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a88004d00 0x7f0a88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa406ca80 con 0x7f0a88004d00 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415b970 con 0x7f0a88003ef0 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.845+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8800b980 con 0x7f0aa41589f0 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a88004d00 0x7f0a88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3400640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0a88003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa2a00640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a88003ef0 0x7f0a880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 -- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 msgr2=0x7f0a88003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0aa41589f0 0x7f0a88003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 -- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a88003ef0 msgr2=0x7f0a880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0a88003ef0 0x7f0a880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.846+0000 7f0aa3e00640 1 -- 172.21.15.192:0/1283321553 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a88003520 con 0x7f0a88004d00 2024-09-13T18:41:01.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.847+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a88004d00 0x7f0a88005180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009fc0 tx=0x7f0a880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41a417cdf1d5f99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.847+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c031670 con 0x7f0a88004d00 2024-09-13T18:41:01.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.847+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c00f040 con 0x7f0a88004d00 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.847+0000 7f0aa2000640 1 -- 172.21.15.192:0/1283321553 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c031a10 con 0x7f0a88004d00 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 -- 172.21.15.192:0/1283321553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a88004d00 msgr2=0x7f0a88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1283321553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a88004d00 0x7f0a88005180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009fc0 tx=0x7f0a880057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aa3e00640 1 -- 172.21.15.192:0/1283321553 reap_dead start 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 -- 172.21.15.192:0/1283321553 shutdown_connections 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 -- 172.21.15.192:0/1283321553 >> 172.21.15.192:0/1283321553 conn(0x7f0aa40b08f0 msgr2=0x7f0aa40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 -- 172.21.15.192:0/1283321553 shutdown_connections 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.848+0000 7f0aaa200640 1 -- 172.21.15.192:0/1283321553 wait complete. 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.849+0000 7f0aaa200640 1 Processor -- start 2024-09-13T18:41:01.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.850+0000 7f0aaa200640 1 -- start start 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.850+0000 7f0aaa200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a88004d00 0x7f0aa40c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.850+0000 7f0aaa200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aaa200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 0x7f0aa415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aaa200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa415df40 con 0x7f0aa40aafb0 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aaa200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40abd70 con 0x7f0aa415d580 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aaa200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa40c44e0 con 0x7f0a88004d00 2024-09-13T18:41:01.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35914/0 (socket says 172.21.15.192:35914) 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 -- 172.21.15.192:0/1099073861 learned_addr learned my addr 172.21.15.192:0/1099073861 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa3400640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a88004d00 0x7f0aa40c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 0x7f0aa415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 -- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a88004d00 msgr2=0x7f0aa40c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a88004d00 0x7f0aa40c3e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 -- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 msgr2=0x7f0aa415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 0x7f0aa415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 -- 172.21.15.192:0/1099073861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa40c47c0 con 0x7f0aa40aafb0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa3e00640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 0x7f0aa415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.851+0000 7f0aa2a00640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007340 tx=0x7f0a90007740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.852+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000f8e0 con 0x7f0aa40aafb0 2024-09-13T18:41:01.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.852+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9000fa40 con 0x7f0aa40aafb0 2024-09-13T18:41:01.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.852+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa40abfc0 con 0x7f0aa40aafb0 2024-09-13T18:41:01.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.852+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000fdf0 con 0x7f0aa40aafb0 2024-09-13T18:41:01.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.852+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa40ab430 con 0x7f0aa40aafb0 2024-09-13T18:41:01.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.853+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa40ac4e0 con 0x7f0aa40aafb0 2024-09-13T18:41:01.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.854+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0a9001d460 con 0x7f0aa40aafb0 2024-09-13T18:41:01.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.854+0000 7f0a9b400640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 0x7f0a8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:01.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.854+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a90089550 con 0x7f0aa40aafb0 2024-09-13T18:41:01.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.855+0000 7f0aa3400640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 0x7f0a8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:01.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.855+0000 7f0aa3400640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 0x7f0a8406d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009bc0 tx=0x7f0a94009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:01.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:01.859+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0aa40ac4e0 con 0x7f0aa40aafb0 2024-09-13T18:41:02.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.064+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0aa40ac4e0 con 0x7f0aa40aafb0 2024-09-13T18:41:02.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.938+0000 7f0a9b400640 1 -- 172.21.15.192:0/1099073861 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v46) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0a90054690 con 0x7f0aa40aafb0 2024-09-13T18:41:02.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.940+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 msgr2=0x7f0a8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.940+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 0x7f0a8406d0c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009bc0 tx=0x7f0a94009190 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.940+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 msgr2=0x7f0aa41575b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.940+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0a90007340 tx=0x7f0a90007740 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 shutdown_connections 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0a8406ac00 0x7f0a8406d0c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0aa415d580 0x7f0aa415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0aa40aafb0 0x7f0aa41575b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 --2- 172.21.15.192:0/1099073861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0a88004d00 0x7f0aa40c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 >> 172.21.15.192:0/1099073861 conn(0x7f0aa40b08f0 msgr2=0x7f0aa4159870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 shutdown_connections 2024-09-13T18:41:02.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:02.941+0000 7f0aaa200640 1 -- 172.21.15.192:0/1099073861 wait complete. 2024-09-13T18:41:02.964 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:41:02.964 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:41:03.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.119+0000 7f88a6600640 1 Processor -- start 2024-09-13T18:41:03.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.120+0000 7f88a6600640 1 -- start start 2024-09-13T18:41:03.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a01402c0 0x7f88a015e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a6600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88a00b02f0 0x7f88a015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a6600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a015b070 con 0x7f88a015b810 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a6600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a015eba0 con 0x7f88a00b02f0 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a015ee20 con 0x7f88a01402c0 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88a00b02f0 0x7f88a015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a5c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88a00b02f0 0x7f88a015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35930/0 (socket says 172.21.15.192:35930) 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a5c00640 1 -- 172.21.15.192:0/586217570 learned_addr learned my addr 172.21.15.192:0/586217570 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.121+0000 7f88a5200640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a01402c0 0x7f88a015e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.122+0000 7f88a5c00640 1 -- 172.21.15.192:0/586217570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a01402c0 msgr2=0x7f88a015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:03.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.122+0000 7f88a5c00640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a01402c0 0x7f88a015e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.122+0000 7f88a5c00640 1 -- 172.21.15.192:0/586217570 >> v1:172.21.15.194:6789/0 conn(0x7f88a015b810 legacy=0x7f88a00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.122+0000 7f88a5c00640 1 -- 172.21.15.192:0/586217570 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a015f100 con 0x7f88a00b02f0 2024-09-13T18:41:03.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f88a5c00640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a015bc50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8898009e50 tx=0x7f889802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca22c448389a163 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f889fe00640 1 -- 172.21.15.192:0/586217570 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898031600 con 0x7f88a00b02f0 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f889fe00640 1 -- 172.21.15.192:0/586217570 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889802d050 con 0x7f88a00b02f0 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f889fe00640 1 -- 172.21.15.192:0/586217570 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898031980 con 0x7f88a00b02f0 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f88a6600640 1 -- 172.21.15.192:0/586217570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 msgr2=0x7f88a015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.123+0000 7f88a6600640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a015bc50 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f8898009e50 tx=0x7f889802a710 comp rx=0 tx=0).stop 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 -- 172.21.15.192:0/586217570 shutdown_connections 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a015bc50 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 --2- 172.21.15.192:0/586217570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a01402c0 0x7f88a015e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 -- 172.21.15.192:0/586217570 >> 172.21.15.192:0/586217570 conn(0x7f88a00ae7f0 msgr2=0x7f88a006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 -- 172.21.15.192:0/586217570 shutdown_connections 2024-09-13T18:41:03.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.124+0000 7f88a6600640 1 -- 172.21.15.192:0/586217570 wait complete. 2024-09-13T18:41:03.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.125+0000 7f88a6600640 1 Processor -- start 2024-09-13T18:41:03.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.125+0000 7f88a6600640 1 -- start start 2024-09-13T18:41:03.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 0x7f88a0152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a015b810 0x7f88a00cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01f33d0 con 0x7f88a00b02f0 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a0140e20 con 0x7f88a01402c0 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a6600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a01f2850 con 0x7f88a015b810 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a5200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35936/0 (socket says 172.21.15.192:35936) 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.126+0000 7f88a5200640 1 -- 172.21.15.192:0/644645005 learned_addr learned my addr 172.21.15.192:0/644645005 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f8897e00640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 0x7f88a0152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5c00640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a015b810 0x7f88a00cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 -- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a015b810 msgr2=0x7f88a00cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a015b810 0x7f88a00cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 -- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 msgr2=0x7f88a0152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 0x7f88a0152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 -- 172.21.15.192:0/644645005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8898009b30 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f8897e00640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 0x7f88a0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a5200640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f889000e930 tx=0x7f889000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8890009690 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000c9a0 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a01f2b30 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.127+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000cd50 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.128+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a01f30f0 con 0x7f88a00b02f0 2024-09-13T18:41:03.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.129+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a015bc50 con 0x7f88a00b02f0 2024-09-13T18:41:03.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.129+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8890013470 con 0x7f88a00b02f0 2024-09-13T18:41:03.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.131+0000 7f889d600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 0x7f887c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:03.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.131+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8890089650 con 0x7f88a00b02f0 2024-09-13T18:41:03.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.131+0000 7f8897e00640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 0x7f887c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:03.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.132+0000 7f8897e00640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 0x7f887c06d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8888007fd0 tx=0x7f8888009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:03.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.135+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8890054850 con 0x7f88a00b02f0 2024-09-13T18:41:03.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.335+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f88a0151d50 con 0x7f88a00b02f0 2024-09-13T18:41:03.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.943+0000 7f889d600640 1 -- 172.21.15.192:0/644645005 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v47) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8890057e70 con 0x7f88a00b02f0 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.945+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 msgr2=0x7f887c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.945+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 0x7f887c06d0c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8888007fd0 tx=0x7f8888009040 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.945+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 msgr2=0x7f88a0153c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f889000e930 tx=0x7f889000edf0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 shutdown_connections 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f887c06ac00 0x7f887c06d0c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88a015b810 0x7f88a00cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88a01402c0 0x7f88a0152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 --2- 172.21.15.192:0/644645005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88a00b02f0 0x7f88a0153c30 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 >> 172.21.15.192:0/644645005 conn(0x7f88a00ae7f0 msgr2=0x7f88a013fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 shutdown_connections 2024-09-13T18:41:03.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:03.946+0000 7f88a6600640 1 -- 172.21.15.192:0/644645005 wait complete. 2024-09-13T18:41:03.965 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:41:03.965 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:04.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.115+0000 7fc77fe00640 1 Processor -- start 2024-09-13T18:41:04.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.115+0000 7fc77fe00640 1 -- start start 2024-09-13T18:41:04.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.116+0000 7fc77fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc77815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.116+0000 7fc77fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7780cb0b0 0x7fc77815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.116+0000 7fc77fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc778140480 con 0x7fc778140980 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.116+0000 7fc77fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77815c160 con 0x7fc7780cb0b0 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.116+0000 7fc77fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77815ee90 con 0x7fc7780cacd0 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7780cb0b0 0x7fc77815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc7780cb0b0 0x7fc77815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35950/0 (socket says 172.21.15.192:35950) 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 -- 172.21.15.192:0/1373282652 learned_addr learned my addr 172.21.15.192:0/1373282652 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:04.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77d400640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc77815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 -- 172.21.15.192:0/1373282652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 msgr2=0x7fc77815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc77815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 -- 172.21.15.192:0/1373282652 >> v1:172.21.15.194:6789/0 conn(0x7fc778140980 legacy=0x7fc7780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.117+0000 7fc77ca00640 1 -- 172.21.15.192:0/1373282652 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77815f170 con 0x7fc7780cb0b0 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.118+0000 7fc77ca00640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7780cb0b0 0x7fc77815bc20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc764009870 tx=0x7fc76402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ebae342c452c49b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.118+0000 7fc777e00640 1 -- 172.21.15.192:0/1373282652 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764032440 con 0x7fc7780cb0b0 2024-09-13T18:41:04.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.118+0000 7fc777e00640 1 -- 172.21.15.192:0/1373282652 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7640325a0 con 0x7fc7780cb0b0 2024-09-13T18:41:04.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.118+0000 7fc777e00640 1 -- 172.21.15.192:0/1373282652 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764032930 con 0x7fc7780cb0b0 2024-09-13T18:41:04.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 -- 172.21.15.192:0/1373282652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7780cb0b0 msgr2=0x7fc77815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7780cb0b0 0x7fc77815bc20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fc764009870 tx=0x7fc76402a270 comp rx=0 tx=0).stop 2024-09-13T18:41:04.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 -- 172.21.15.192:0/1373282652 shutdown_connections 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc7780cb0b0 0x7fc77815bc20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 --2- 172.21.15.192:0/1373282652 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc77815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 -- 172.21.15.192:0/1373282652 >> 172.21.15.192:0/1373282652 conn(0x7fc7780ae960 msgr2=0x7fc77806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 -- 172.21.15.192:0/1373282652 shutdown_connections 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.119+0000 7fc77fe00640 1 -- 172.21.15.192:0/1373282652 wait complete. 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.121+0000 7fc77fe00640 1 Processor -- start 2024-09-13T18:41:04.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.121+0000 7fc77fe00640 1 -- start start 2024-09-13T18:41:04.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7780cb0b0 0x7fc77813c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 0x7fc7781374b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780b42e0 con 0x7fc778140980 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780b45c0 con 0x7fc7780cb0b0 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7780b48a0 con 0x7fc7780cacd0 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 0x7fc7781374b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:46464/0 (socket says 172.21.15.192:46464) 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77d400640 1 -- 172.21.15.192:0/420214796 learned_addr learned my addr 172.21.15.192:0/420214796 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.122+0000 7fc77ca00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7780cb0b0 0x7fc77813c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 -- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 msgr2=0x7fc7780b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 -- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7780cb0b0 msgr2=0x7fc77813c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7780cb0b0 0x7fc77813c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 -- 172.21.15.192:0/420214796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7640094d0 con 0x7fc778140980 2024-09-13T18:41:04.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77d400640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:04.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77de00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 0x7fc7781374b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc77000c690 tx=0x7fc77000cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770003b70 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc770003cd0 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc770005310 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7780b4b80 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.123+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7781379f0 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.124+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77815bc20 con 0x7fc778140980 2024-09-13T18:41:04.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.125+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc770005470 con 0x7fc778140980 2024-09-13T18:41:04.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.126+0000 7fc775600640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.126+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc770088fd0 con 0x7fc778140980 2024-09-13T18:41:04.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.126+0000 7fc77d400640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.127+0000 7fc77d400640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 0x7fc75806d0c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009f50 tx=0x7fc76c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.130+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc770054260 con 0x7fc778140980 2024-09-13T18:41:04.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.332+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc77806c6c0 con 0x7fc778140980 2024-09-13T18:41:04.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.333+0000 7fc775600640 1 -- 172.21.15.192:0/420214796 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fc770057880 con 0x7fc778140980 2024-09-13T18:41:04.336 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:04.336 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:04.337 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 msgr2=0x7fc75806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 0x7fc75806d0c0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009f50 tx=0x7fc76c009190 comp rx=0 tx=0).stop 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 msgr2=0x7fc7781374b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 0x7fc7781374b0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc77000c690 tx=0x7fc77000cb50 comp rx=0 tx=0).stop 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 shutdown_connections 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc75806ac00 0x7fc75806d0c0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc778140980 0x7fc7781374b0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc7780cb0b0 0x7fc77813c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 --2- 172.21.15.192:0/420214796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc7780cacd0 0x7fc7780b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 >> 172.21.15.192:0/420214796 conn(0x7fc7780ae960 msgr2=0x7fc7780afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 shutdown_connections 2024-09-13T18:41:04.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.335+0000 7fc77fe00640 1 -- 172.21.15.192:0/420214796 wait complete. 2024-09-13T18:41:04.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:04.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.504+0000 7f5441a00640 1 Processor -- start 2024-09-13T18:41:04.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.504+0000 7f5441a00640 1 -- start start 2024-09-13T18:41:04.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5441a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f543c06ca80 0x7f543c159210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5441a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5441a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f543c15a430 con 0x7f543c142660 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5441a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f543c0cccb0 con 0x7f543c06ca80 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5441a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c159820 con 0x7f543c15a8c0 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5433e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f543c142660 0x7f543c0cd0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45630/0 (socket says 172.21.15.192:45630) 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.505+0000 7f5433e00640 1 -- 172.21.15.192:0/3927250912 learned_addr learned my addr 172.21.15.192:0/3927250912 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f5441000640 1 --2- 172.21.15.192:0/3927250912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f543be00640 1 --2- 172.21.15.192:0/3927250912 >> v2:172.21.15.194:3300/0 conn(0x7f543c06ca80 0x7f543c159210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f543b400640 1 -- 172.21.15.192:0/3927250912 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 266157852 0 0) 0x7f543c15a430 con 0x7f543c142660 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f543b400640 1 -- 172.21.15.192:0/3927250912 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5420003520 con 0x7f543c142660 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f5441000640 1 -- 172.21.15.192:0/3927250912 >> v2:172.21.15.194:3300/0 conn(0x7f543c06ca80 msgr2=0x7f543c159210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:04.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f5441000640 1 --2- 172.21.15.192:0/3927250912 >> v2:172.21.15.194:3300/0 conn(0x7f543c06ca80 0x7f543c159210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f5441000640 1 -- 172.21.15.192:0/3927250912 >> v1:172.21.15.192:6789/0 conn(0x7f543c142660 legacy=0x7f543c0cd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.506+0000 7f5441000640 1 -- 172.21.15.192:0/3927250912 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543c159b00 con 0x7f543c15a8c0 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.507+0000 7f5441000640 1 --2- 172.21.15.192:0/3927250912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c15ad50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f543400bfa0 tx=0x7f543402c7e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bee3560d82ff61 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.507+0000 7f543b400640 1 -- 172.21.15.192:0/3927250912 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434032480 con 0x7f543c15a8c0 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.507+0000 7f543b400640 1 -- 172.21.15.192:0/3927250912 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543402f030 con 0x7f543c15a8c0 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.507+0000 7f543b400640 1 -- 172.21.15.192:0/3927250912 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5434032800 con 0x7f543c15a8c0 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 -- 172.21.15.192:0/3927250912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 msgr2=0x7f543c15ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 --2- 172.21.15.192:0/3927250912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c15ad50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f543400bfa0 tx=0x7f543402c7e0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 -- 172.21.15.192:0/3927250912 shutdown_connections 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 --2- 172.21.15.192:0/3927250912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c15ad50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 --2- 172.21.15.192:0/3927250912 >> v2:172.21.15.194:3300/0 conn(0x7f543c06ca80 0x7f543c159210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 -- 172.21.15.192:0/3927250912 >> 172.21.15.192:0/3927250912 conn(0x7f543c0736d0 msgr2=0x7f543c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 -- 172.21.15.192:0/3927250912 shutdown_connections 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.508+0000 7f5441a00640 1 -- 172.21.15.192:0/3927250912 wait complete. 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.510+0000 7f5441a00640 1 Processor -- start 2024-09-13T18:41:04.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.510+0000 7f5441a00640 1 -- start start 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f543c06ca80 0x7f543c130e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c12e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c134180 con 0x7f543c142660 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543c12f630 con 0x7f543c06ca80 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543c12e780 con 0x7f543c15a8c0 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35960/0 (socket says 172.21.15.192:35960) 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 -- 172.21.15.192:0/41131902 learned_addr learned my addr 172.21.15.192:0/41131902 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5441000640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c12e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f543be00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f543c06ca80 0x7f543c130e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 -- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 msgr2=0x7f543c12e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c12e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 -- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f543c06ca80 msgr2=0x7f543c130e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f543c06ca80 0x7f543c130e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.511+0000 7f5433e00640 1 -- 172.21.15.192:0/41131902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f543400bc80 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5433e00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f542400c500 tx=0x7f542400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424005ce0 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5424005e40 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543c12ea20 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5424007330 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.512+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543c12efe0 con 0x7f543c142660 2024-09-13T18:41:04.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.513+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f543c15b860 con 0x7f543c142660 2024-09-13T18:41:04.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.514+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5424007550 con 0x7f543c142660 2024-09-13T18:41:04.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.515+0000 7f5438c00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 0x7f541806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.515+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54240889f0 con 0x7f543c142660 2024-09-13T18:41:04.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.515+0000 7f543be00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 0x7f541806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.516+0000 7f543be00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 0x7f541806d0c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f542c009b40 tx=0x7f542c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.519+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5424053ca0 con 0x7f543c142660 2024-09-13T18:41:04.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.688+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f543c06c480 con 0x7f543c142660 2024-09-13T18:41:04.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.689+0000 7f5438c00640 1 -- 172.21.15.192:0/41131902 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f5424017020 con 0x7f543c142660 2024-09-13T18:41:04.692 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:04.692 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":112,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:01.933417+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"111","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 msgr2=0x7f541806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 0x7f541806d0c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f542c009b40 tx=0x7f542c009190 comp rx=0 tx=0).stop 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 msgr2=0x7f543c133c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f542400c500 tx=0x7f542400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 shutdown_connections 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f541806ac00 0x7f541806d0c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f543c15a8c0 0x7f543c12e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f543c142660 0x7f543c133c40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 --2- 172.21.15.192:0/41131902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f543c06ca80 0x7f543c130e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 >> 172.21.15.192:0/41131902 conn(0x7f543c0736d0 msgr2=0x7f543c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 shutdown_connections 2024-09-13T18:41:04.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.692+0000 7f5441a00640 1 -- 172.21.15.192:0/41131902 wait complete. 2024-09-13T18:41:04.711 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:41:04.712 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:41:04.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.862+0000 7f0b1a800640 1 Processor -- start 2024-09-13T18:41:04.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.862+0000 7f0b1a800640 1 -- start start 2024-09-13T18:41:04.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.863+0000 7f0b1a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b1415cfb0 0x7f0b140b3030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.863+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.863+0000 7f0b1a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b140b4320 con 0x7f0b140b3570 2024-09-13T18:41:04.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.863+0000 7f0b1a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b140d2c50 con 0x7f0b1415cfb0 2024-09-13T18:41:04.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.863+0000 7f0b1a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140b6060 con 0x7f0b140d2260 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0b1415cfb0 0x7f0b140b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:46486/0 (socket says 172.21.15.192:46486) 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 -- 172.21.15.192:0/4260866819 learned_addr learned my addr 172.21.15.192:0/4260866819 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 -- 172.21.15.192:0/4260866819 >> v2:172.21.15.194:3300/0 conn(0x7f0b1415cfb0 msgr2=0x7f0b140b3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 --2- 172.21.15.192:0/4260866819 >> v2:172.21.15.194:3300/0 conn(0x7f0b1415cfb0 0x7f0b140b3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 -- 172.21.15.192:0/4260866819 >> v1:172.21.15.194:6789/0 conn(0x7f0b140b3570 legacy=0x7f0b140b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.864+0000 7f0b13e00640 1 -- 172.21.15.192:0/4260866819 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b140b3a80 con 0x7f0b140d2260 2024-09-13T18:41:04.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.865+0000 7f0b13e00640 1 --2- 172.21.15.192:0/4260866819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009e50 tx=0x7f0b0c02a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca67b17e91d06a2c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.865+0000 7f0b12000640 1 -- 172.21.15.192:0/4260866819 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c031600 con 0x7f0b140d2260 2024-09-13T18:41:04.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.865+0000 7f0b12000640 1 -- 172.21.15.192:0/4260866819 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0c02d050 con 0x7f0b140d2260 2024-09-13T18:41:04.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.865+0000 7f0b12000640 1 -- 172.21.15.192:0/4260866819 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0c031980 con 0x7f0b140d2260 2024-09-13T18:41:04.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 -- 172.21.15.192:0/4260866819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 msgr2=0x7f0b140d2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 --2- 172.21.15.192:0/4260866819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009e50 tx=0x7f0b0c02a710 comp rx=0 tx=0).stop 2024-09-13T18:41:04.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 -- 172.21.15.192:0/4260866819 shutdown_connections 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 --2- 172.21.15.192:0/4260866819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b140d2260 0x7f0b140d2710 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 --2- 172.21.15.192:0/4260866819 >> v2:172.21.15.194:3300/0 conn(0x7f0b1415cfb0 0x7f0b140b3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 -- 172.21.15.192:0/4260866819 >> 172.21.15.192:0/4260866819 conn(0x7f0b140b49b0 msgr2=0x7f0b140b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 -- 172.21.15.192:0/4260866819 shutdown_connections 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.866+0000 7f0b1a800640 1 -- 172.21.15.192:0/4260866819 wait complete. 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.868+0000 7f0b1a800640 1 Processor -- start 2024-09-13T18:41:04.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.868+0000 7f0b1a800640 1 -- start start 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b140d2260 0x7f0b1415f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b1415cfb0 0x7f0b14156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140cae30 con 0x7f0b140b3570 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140cab20 con 0x7f0b140d2260 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b1a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b140c93b0 con 0x7f0b1415cfb0 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35962/0 (socket says 172.21.15.192:35962) 2024-09-13T18:41:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 -- 172.21.15.192:0/716841549 learned_addr learned my addr 172.21.15.192:0/716841549 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13e00640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b1415cfb0 0x7f0b14156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b12a00640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b140d2260 0x7f0b1415f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 -- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b1415cfb0 msgr2=0x7f0b14156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b1415cfb0 0x7f0b14156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 -- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b140d2260 msgr2=0x7f0b1415f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b140d2260 0x7f0b1415f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.869+0000 7f0b13400640 1 -- 172.21.15.192:0/716841549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b0c009b30 con 0x7f0b140b3570 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b13400640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e8a0 tx=0x7f0b0400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b040094f0 con 0x7f0b140b3570 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0400c940 con 0x7f0b140b3570 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1415f540 con 0x7f0b140b3570 2024-09-13T18:41:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b0400ccf0 con 0x7f0b140b3570 2024-09-13T18:41:04.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.870+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b1415faa0 con 0x7f0b140b3570 2024-09-13T18:41:04.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.871+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b140cb0a0 con 0x7f0b140b3570 2024-09-13T18:41:04.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.872+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0b04013470 con 0x7f0b140b3570 2024-09-13T18:41:04.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.873+0000 7f0b0b400640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 0x7f0af406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:04.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.873+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b04089290 con 0x7f0b140b3570 2024-09-13T18:41:04.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.873+0000 7f0b12a00640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 0x7f0af406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:04.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.874+0000 7f0b12a00640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 0x7f0af406d0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0b140b73c0 tx=0x7f0b00009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:04.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:04.877+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0b040545b0 con 0x7f0b140b3570 2024-09-13T18:41:05.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.044+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0b140b6270 con 0x7f0af406ac00 2024-09-13T18:41:05.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.052+0000 7f0b0b400640 1 -- 172.21.15.192:0/716841549 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285146 (secure 0 0 0) 0x7f0b000014a0 con 0x7f0af406ac00 2024-09-13T18:41:05.058 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:05.060 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 msgr2=0x7f0af406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 0x7f0af406d0c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0b140b73c0 tx=0x7f0b00009040 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 msgr2=0x7f0b140c8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0b0400e8a0 tx=0x7f0b0400ed60 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 shutdown_connections 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0af406ac00 0x7f0af406d0c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0b1415cfb0 0x7f0b14156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0b140d2260 0x7f0b1415f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 --2- 172.21.15.192:0/716841549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b140b3570 0x7f0b140c8e70 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 >> 172.21.15.192:0/716841549 conn(0x7f0b140b49b0 msgr2=0x7f0b140cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 shutdown_connections 2024-09-13T18:41:05.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.056+0000 7f0b1a800640 1 -- 172.21.15.192:0/716841549 wait complete. 2024-09-13T18:41:05.074 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-13T18:41:04.805923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556547,"statfs":{"total":1600000000,"available":1593904652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.288742"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493033+0000","last_change":"2024-09-13T18:41:00.943561+0000","last_active":"2024-09-13T18:41:02.493033+0000","last_peered":"2024-09-13T18:41:02.493033+0000","last_clean":"2024-09-13T18:41:02.493033+0000","last_became_active":"2024-09-13T18:41:00.943306+0000","last_became_peered":"2024-09-13T18:41:00.943306+0000","last_unstale":"2024-09-13T18:41:02.493033+0000","last_undegraded":"2024-09-13T18:41:02.493033+0000","last_fullsized":"2024-09-13T18:41:02.493033+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:45.609461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936543+0000","last_change":"2024-09-13T18:41:00.942423+0000","last_active":"2024-09-13T18:41:01.936543+0000","last_peered":"2024-09-13T18:41:01.936543+0000","last_clean":"2024-09-13T18:41:01.936543+0000","last_became_active":"2024-09-13T18:41:00.942181+0000","last_became_peered":"2024-09-13T18:41:00.942181+0000","last_unstale":"2024-09-13T18:41:01.936543+0000","last_undegraded":"2024-09-13T18:41:01.936543+0000","last_fullsized":"2024-09-13T18:41:01.936543+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493068+0000","last_change":"2024-09-13T18:41:00.948444+0000","last_active":"2024-09-13T18:41:02.493068+0000","last_peered":"2024-09-13T18:41:02.493068+0000","last_clean":"2024-09-13T18:41:02.493068+0000","last_became_active":"2024-09-13T18:41:00.946989+0000","last_became_peered":"2024-09-13T18:41:00.946989+0000","last_unstale":"2024-09-13T18:41:02.493068+0000","last_undegraded":"2024-09-13T18:41:02.493068+0000","last_fullsized":"2024-09-13T18:41:02.493068+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937901+0000","last_change":"2024-09-13T18:41:00.950468+0000","last_active":"2024-09-13T18:41:01.937901+0000","last_peered":"2024-09-13T18:41:01.937901+0000","last_clean":"2024-09-13T18:41:01.937901+0000","last_became_active":"2024-09-13T18:41:00.949143+0000","last_became_peered":"2024-09-13T18:41:00.949143+0000","last_unstale":"2024-09-13T18:41:01.937901+0000","last_undegraded":"2024-09-13T18:41:01.937901+0000","last_fullsized":"2024-09-13T18:41:01.937901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:19.609454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493947+0000","last_change":"2024-09-13T18:41:00.948043+0000","last_active":"2024-09-13T18:41:02.493947+0000","last_peered":"2024-09-13T18:41:02.493947+0000","last_clean":"2024-09-13T18:41:02.493947+0000","last_became_active":"2024-09-13T18:41:00.947837+0000","last_became_peered":"2024-09-13T18:41:00.947837+0000","last_unstale":"2024-09-13T18:41:02.493947+0000","last_undegraded":"2024-09-13T18:41:02.493947+0000","last_fullsized":"2024-09-13T18:41:02.493947+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:39.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494128+0000","last_change":"2024-09-13T18:41:00.953141+0000","last_active":"2024-09-13T18:41:02.494128+0000","last_peered":"2024-09-13T18:41:02.494128+0000","last_clean":"2024-09-13T18:41:02.494128+0000","last_became_active":"2024-09-13T18:41:00.952610+0000","last_became_peered":"2024-09-13T18:41:00.952610+0000","last_unstale":"2024-09-13T18:41:02.494128+0000","last_undegraded":"2024-09-13T18:41:02.494128+0000","last_fullsized":"2024-09-13T18:41:02.494128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:45.101360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936735+0000","last_change":"2024-09-13T18:41:00.947747+0000","last_active":"2024-09-13T18:41:01.936735+0000","last_peered":"2024-09-13T18:41:01.936735+0000","last_clean":"2024-09-13T18:41:01.936735+0000","last_became_active":"2024-09-13T18:41:00.946838+0000","last_became_peered":"2024-09-13T18:41:00.946838+0000","last_unstale":"2024-09-13T18:41:01.936735+0000","last_undegraded":"2024-09-13T18:41:01.936735+0000","last_fullsized":"2024-09-13T18:41:01.936735+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:08.827745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938255+0000","last_change":"2024-09-13T18:41:00.952752+0000","last_active":"2024-09-13T18:41:01.938255+0000","last_peered":"2024-09-13T18:41:01.938255+0000","last_clean":"2024-09-13T18:41:01.938255+0000","last_became_active":"2024-09-13T18:41:00.952000+0000","last_became_peered":"2024-09-13T18:41:00.952000+0000","last_unstale":"2024-09-13T18:41:01.938255+0000","last_undegraded":"2024-09-13T18:41:01.938255+0000","last_fullsized":"2024-09-13T18:41:01.938255+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:39.658509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.492859+0000","last_change":"2024-09-13T18:41:00.942054+0000","last_active":"2024-09-13T18:41:02.492859+0000","last_peered":"2024-09-13T18:41:02.492859+0000","last_clean":"2024-09-13T18:41:02.492859+0000","last_became_active":"2024-09-13T18:41:00.941786+0000","last_became_peered":"2024-09-13T18:41:00.941786+0000","last_unstale":"2024-09-13T18:41:02.492859+0000","last_undegraded":"2024-09-13T18:41:02.492859+0000","last_fullsized":"2024-09-13T18:41:02.492859+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:13.858339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493842+0000","last_change":"2024-09-13T18:41:00.945288+0000","last_active":"2024-09-13T18:41:02.493842+0000","last_peered":"2024-09-13T18:41:02.493842+0000","last_clean":"2024-09-13T18:41:02.493842+0000","last_became_active":"2024-09-13T18:41:00.945079+0000","last_became_peered":"2024-09-13T18:41:00.945079+0000","last_unstale":"2024-09-13T18:41:02.493842+0000","last_undegraded":"2024-09-13T18:41:02.493842+0000","last_fullsized":"2024-09-13T18:41:02.493842+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:47.937450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493621+0000","last_change":"2024-09-13T18:41:00.947026+0000","last_active":"2024-09-13T18:41:02.493621+0000","last_peered":"2024-09-13T18:41:02.493621+0000","last_clean":"2024-09-13T18:41:02.493621+0000","last_became_active":"2024-09-13T18:41:00.946111+0000","last_became_peered":"2024-09-13T18:41:00.946111+0000","last_unstale":"2024-09-13T18:41:02.493621+0000","last_undegraded":"2024-09-13T18:41:02.493621+0000","last_fullsized":"2024-09-13T18:41:02.493621+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:22.282633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938273+0000","last_change":"2024-09-13T18:41:00.951879+0000","last_active":"2024-09-13T18:41:01.938273+0000","last_peered":"2024-09-13T18:41:01.938273+0000","last_clean":"2024-09-13T18:41:01.938273+0000","last_became_active":"2024-09-13T18:41:00.951615+0000","last_became_peered":"2024-09-13T18:41:00.951615+0000","last_unstale":"2024-09-13T18:41:01.938273+0000","last_undegraded":"2024-09-13T18:41:01.938273+0000","last_fullsized":"2024-09-13T18:41:01.938273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:24.208527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493638+0000","last_change":"2024-09-13T18:41:00.946684+0000","last_active":"2024-09-13T18:41:02.493638+0000","last_peered":"2024-09-13T18:41:02.493638+0000","last_clean":"2024-09-13T18:41:02.493638+0000","last_became_active":"2024-09-13T18:41:00.946347+0000","last_became_peered":"2024-09-13T18:41:00.946347+0000","last_unstale":"2024-09-13T18:41:02.493638+0000","last_undegraded":"2024-09-13T18:41:02.493638+0000","last_fullsized":"2024-09-13T18:41:02.493638+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:20.507082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493408+0000","last_change":"2024-09-13T18:41:00.951592+0000","last_active":"2024-09-13T18:41:02.493408+0000","last_peered":"2024-09-13T18:41:02.493408+0000","last_clean":"2024-09-13T18:41:02.493408+0000","last_became_active":"2024-09-13T18:41:00.950818+0000","last_became_peered":"2024-09-13T18:41:00.950818+0000","last_unstale":"2024-09-13T18:41:02.493408+0000","last_undegraded":"2024-09-13T18:41:02.493408+0000","last_fullsized":"2024-09-13T18:41:02.493408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.643620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936610+0000","last_change":"2024-09-13T18:41:00.953248+0000","last_active":"2024-09-13T18:41:01.936610+0000","last_peered":"2024-09-13T18:41:01.936610+0000","last_clean":"2024-09-13T18:41:01.936610+0000","last_became_active":"2024-09-13T18:41:00.952891+0000","last_became_peered":"2024-09-13T18:41:00.952891+0000","last_unstale":"2024-09-13T18:41:01.936610+0000","last_undegraded":"2024-09-13T18:41:01.936610+0000","last_fullsized":"2024-09-13T18:41:01.936610+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:52.391358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494305+0000","last_change":"2024-09-13T18:41:00.944990+0000","last_active":"2024-09-13T18:41:02.494305+0000","last_peered":"2024-09-13T18:41:02.494305+0000","last_clean":"2024-09-13T18:41:02.494305+0000","last_became_active":"2024-09-13T18:41:00.944784+0000","last_became_peered":"2024-09-13T18:41:00.944784+0000","last_unstale":"2024-09-13T18:41:02.494305+0000","last_undegraded":"2024-09-13T18:41:02.494305+0000","last_fullsized":"2024-09-13T18:41:02.494305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:36.776781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938386+0000","last_change":"2024-09-13T18:41:00.947289+0000","last_active":"2024-09-13T18:41:01.938386+0000","last_peered":"2024-09-13T18:41:01.938386+0000","last_clean":"2024-09-13T18:41:01.938386+0000","last_became_active":"2024-09-13T18:41:00.947075+0000","last_became_peered":"2024-09-13T18:41:00.947075+0000","last_unstale":"2024-09-13T18:41:01.938386+0000","last_undegraded":"2024-09-13T18:41:01.938386+0000","last_fullsized":"2024-09-13T18:41:01.938386+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:47.937450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493700+0000","last_change":"2024-09-13T18:41:00.947758+0000","last_active":"2024-09-13T18:41:02.493700+0000","last_peered":"2024-09-13T18:41:02.493700+0000","last_clean":"2024-09-13T18:41:02.493700+0000","last_became_active":"2024-09-13T18:41:00.946359+0000","last_became_peered":"2024-09-13T18:41:00.946359+0000","last_unstale":"2024-09-13T18:41:02.493700+0000","last_undegraded":"2024-09-13T18:41:02.493700+0000","last_fullsized":"2024-09-13T18:41:02.493700+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:45.609461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493510+0000","last_change":"2024-09-13T18:41:00.951823+0000","last_active":"2024-09-13T18:41:02.493510+0000","last_peered":"2024-09-13T18:41:02.493510+0000","last_clean":"2024-09-13T18:41:02.493510+0000","last_became_active":"2024-09-13T18:41:00.951230+0000","last_became_peered":"2024-09-13T18:41:00.951230+0000","last_unstale":"2024-09-13T18:41:02.493510+0000","last_undegraded":"2024-09-13T18:41:02.493510+0000","last_fullsized":"2024-09-13T18:41:02.493510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:39.624390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493716+0000","last_change":"2024-09-13T18:41:00.950613+0000","last_active":"2024-09-13T18:41:02.493716+0000","last_peered":"2024-09-13T18:41:02.493716+0000","last_clean":"2024-09-13T18:41:02.493716+0000","last_became_active":"2024-09-13T18:41:00.950392+0000","last_became_peered":"2024-09-13T18:41:00.950392+0000","last_unstale":"2024-09-13T18:41:02.493716+0000","last_undegraded":"2024-09-13T18:41:02.493716+0000","last_fullsized":"2024-09-13T18:41:02.493716+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:01.370670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937945+0000","last_change":"2024-09-13T18:41:00.950158+0000","last_active":"2024-09-13T18:41:01.937945+0000","last_peered":"2024-09-13T18:41:01.937945+0000","last_clean":"2024-09-13T18:41:01.937945+0000","last_became_active":"2024-09-13T18:41:00.949511+0000","last_became_peered":"2024-09-13T18:41:00.949511+0000","last_unstale":"2024-09-13T18:41:01.937945+0000","last_undegraded":"2024-09-13T18:41:01.937945+0000","last_fullsized":"2024-09-13T18:41:01.937945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:50.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493866+0000","last_change":"2024-09-13T18:41:00.941324+0000","last_active":"2024-09-13T18:41:02.493866+0000","last_peered":"2024-09-13T18:41:02.493866+0000","last_clean":"2024-09-13T18:41:02.493866+0000","last_became_active":"2024-09-13T18:41:00.940950+0000","last_became_peered":"2024-09-13T18:41:00.940950+0000","last_unstale":"2024-09-13T18:41:02.493866+0000","last_undegraded":"2024-09-13T18:41:02.493866+0000","last_fullsized":"2024-09-13T18:41:02.493866+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:05.499289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938352+0000","last_change":"2024-09-13T18:41:00.947702+0000","last_active":"2024-09-13T18:41:01.938352+0000","last_peered":"2024-09-13T18:41:01.938352+0000","last_clean":"2024-09-13T18:41:01.938352+0000","last_became_active":"2024-09-13T18:41:00.946095+0000","last_became_peered":"2024-09-13T18:41:00.946095+0000","last_unstale":"2024-09-13T18:41:01.938352+0000","last_undegraded":"2024-09-13T18:41:01.938352+0000","last_fullsized":"2024-09-13T18:41:01.938352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:37.630207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493267+0000","last_change":"2024-09-13T18:41:00.943101+0000","last_active":"2024-09-13T18:41:02.493267+0000","last_peered":"2024-09-13T18:41:02.493267+0000","last_clean":"2024-09-13T18:41:02.493267+0000","last_became_active":"2024-09-13T18:41:00.942785+0000","last_became_peered":"2024-09-13T18:41:00.942785+0000","last_unstale":"2024-09-13T18:41:02.493267+0000","last_undegraded":"2024-09-13T18:41:02.493267+0000","last_fullsized":"2024-09-13T18:41:02.493267+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.332683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493570+0000","last_change":"2024-09-13T18:41:00.950821+0000","last_active":"2024-09-13T18:41:02.493570+0000","last_peered":"2024-09-13T18:41:02.493570+0000","last_clean":"2024-09-13T18:41:02.493570+0000","last_became_active":"2024-09-13T18:41:00.950265+0000","last_became_peered":"2024-09-13T18:41:00.950265+0000","last_unstale":"2024-09-13T18:41:02.493570+0000","last_undegraded":"2024-09-13T18:41:02.493570+0000","last_fullsized":"2024-09-13T18:41:02.493570+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:00.982874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493501+0000","last_change":"2024-09-13T18:41:00.949234+0000","last_active":"2024-09-13T18:41:02.493501+0000","last_peered":"2024-09-13T18:41:02.493501+0000","last_clean":"2024-09-13T18:41:02.493501+0000","last_became_active":"2024-09-13T18:41:00.949016+0000","last_became_peered":"2024-09-13T18:41:00.949016+0000","last_unstale":"2024-09-13T18:41:02.493501+0000","last_undegraded":"2024-09-13T18:41:02.493501+0000","last_fullsized":"2024-09-13T18:41:02.493501+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.566596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493698+0000","last_change":"2024-09-13T18:41:00.954704+0000","last_active":"2024-09-13T18:41:02.493698+0000","last_peered":"2024-09-13T18:41:02.493698+0000","last_clean":"2024-09-13T18:41:02.493698+0000","last_became_active":"2024-09-13T18:41:00.954406+0000","last_became_peered":"2024-09-13T18:41:00.954406+0000","last_unstale":"2024-09-13T18:41:02.493698+0000","last_undegraded":"2024-09-13T18:41:02.493698+0000","last_fullsized":"2024-09-13T18:41:02.493698+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:31.602204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493231+0000","last_change":"2024-09-13T18:41:00.950907+0000","last_active":"2024-09-13T18:41:02.493231+0000","last_peered":"2024-09-13T18:41:02.493231+0000","last_clean":"2024-09-13T18:41:02.493231+0000","last_became_active":"2024-09-13T18:41:00.950524+0000","last_became_peered":"2024-09-13T18:41:00.950524+0000","last_unstale":"2024-09-13T18:41:02.493231+0000","last_undegraded":"2024-09-13T18:41:02.493231+0000","last_fullsized":"2024-09-13T18:41:02.493231+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:46.363040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937979+0000","last_change":"2024-09-13T18:41:00.949527+0000","last_active":"2024-09-13T18:41:01.937979+0000","last_peered":"2024-09-13T18:41:01.937979+0000","last_clean":"2024-09-13T18:41:01.937979+0000","last_became_active":"2024-09-13T18:41:00.948841+0000","last_became_peered":"2024-09-13T18:41:00.948841+0000","last_unstale":"2024-09-13T18:41:01.937979+0000","last_undegraded":"2024-09-13T18:41:01.937979+0000","last_fullsized":"2024-09-13T18:41:01.937979+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.063827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493607+0000","last_change":"2024-09-13T18:41:00.949854+0000","last_active":"2024-09-13T18:41:02.493607+0000","last_peered":"2024-09-13T18:41:02.493607+0000","last_clean":"2024-09-13T18:41:02.493607+0000","last_became_active":"2024-09-13T18:41:00.949638+0000","last_became_peered":"2024-09-13T18:41:00.949638+0000","last_unstale":"2024-09-13T18:41:02.493607+0000","last_undegraded":"2024-09-13T18:41:02.493607+0000","last_fullsized":"2024-09-13T18:41:02.493607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:22.651866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494221+0000","last_change":"2024-09-13T18:41:00.953276+0000","last_active":"2024-09-13T18:41:02.494221+0000","last_peered":"2024-09-13T18:41:02.494221+0000","last_clean":"2024-09-13T18:41:02.494221+0000","last_became_active":"2024-09-13T18:41:00.952899+0000","last_became_peered":"2024-09-13T18:41:00.952899+0000","last_unstale":"2024-09-13T18:41:02.494221+0000","last_undegraded":"2024-09-13T18:41:02.494221+0000","last_fullsized":"2024-09-13T18:41:02.494221+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:25.802827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493662+0000","last_change":"2024-09-13T18:41:00.953473+0000","last_active":"2024-09-13T18:41:02.493662+0000","last_peered":"2024-09-13T18:41:02.493662+0000","last_clean":"2024-09-13T18:41:02.493662+0000","last_became_active":"2024-09-13T18:41:00.951919+0000","last_became_peered":"2024-09-13T18:41:00.951919+0000","last_unstale":"2024-09-13T18:41:02.493662+0000","last_undegraded":"2024-09-13T18:41:02.493662+0000","last_fullsized":"2024-09-13T18:41:02.493662+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:33.983911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938276+0000","last_change":"2024-09-13T18:41:00.946419+0000","last_active":"2024-09-13T18:41:01.938276+0000","last_peered":"2024-09-13T18:41:01.938276+0000","last_clean":"2024-09-13T18:41:01.938276+0000","last_became_active":"2024-09-13T18:41:00.946212+0000","last_became_peered":"2024-09-13T18:41:00.946212+0000","last_unstale":"2024-09-13T18:41:01.938276+0000","last_undegraded":"2024-09-13T18:41:01.938276+0000","last_fullsized":"2024-09-13T18:41:01.938276+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:19.609454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"111'4","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493961+0000","last_change":"2024-09-13T18:41:00.536850+0000","last_active":"2024-09-13T18:41:02.493961+0000","last_peered":"2024-09-13T18:41:02.493961+0000","last_clean":"2024-09-13T18:41:02.493961+0000","last_became_active":"2024-09-13T18:41:00.536585+0000","last_became_peered":"2024-09-13T18:41:00.536585+0000","last_unstale":"2024-09-13T18:41:02.493961+0000","last_undegraded":"2024-09-13T18:41:02.493961+0000","last_fullsized":"2024-09-13T18:41:02.493961+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.916955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493320+0000","last_change":"2024-09-13T18:41:00.945611+0000","last_active":"2024-09-13T18:41:02.493320+0000","last_peered":"2024-09-13T18:41:02.493320+0000","last_clean":"2024-09-13T18:41:02.493320+0000","last_became_active":"2024-09-13T18:41:00.945011+0000","last_became_peered":"2024-09-13T18:41:00.945011+0000","last_unstale":"2024-09-13T18:41:02.493320+0000","last_undegraded":"2024-09-13T18:41:02.493320+0000","last_fullsized":"2024-09-13T18:41:02.493320+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:01.370670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493420+0000","last_change":"2024-09-13T18:41:00.541103+0000","last_active":"2024-09-13T18:41:02.493420+0000","last_peered":"2024-09-13T18:41:02.493420+0000","last_clean":"2024-09-13T18:41:02.493420+0000","last_became_active":"2024-09-13T18:41:00.540640+0000","last_became_peered":"2024-09-13T18:41:00.540640+0000","last_unstale":"2024-09-13T18:41:02.493420+0000","last_undegraded":"2024-09-13T18:41:02.493420+0000","last_fullsized":"2024-09-13T18:41:02.493420+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:52.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938327+0000","last_change":"2024-09-13T18:41:00.951582+0000","last_active":"2024-09-13T18:41:01.938327+0000","last_peered":"2024-09-13T18:41:01.938327+0000","last_clean":"2024-09-13T18:41:01.938327+0000","last_became_active":"2024-09-13T18:41:00.950878+0000","last_became_peered":"2024-09-13T18:41:00.950878+0000","last_unstale":"2024-09-13T18:41:01.938327+0000","last_undegraded":"2024-09-13T18:41:01.938327+0000","last_fullsized":"2024-09-13T18:41:01.938327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.063827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493751+0000","last_change":"2024-09-13T18:41:00.539184+0000","last_active":"2024-09-13T18:41:02.493751+0000","last_peered":"2024-09-13T18:41:02.493751+0000","last_clean":"2024-09-13T18:41:02.493751+0000","last_became_active":"2024-09-13T18:41:00.538938+0000","last_became_peered":"2024-09-13T18:41:00.538938+0000","last_unstale":"2024-09-13T18:41:02.493751+0000","last_undegraded":"2024-09-13T18:41:02.493751+0000","last_fullsized":"2024-09-13T18:41:02.493751+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:21.645383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493555+0000","last_change":"2024-09-13T18:41:00.950270+0000","last_active":"2024-09-13T18:41:02.493555+0000","last_peered":"2024-09-13T18:41:02.493555+0000","last_clean":"2024-09-13T18:41:02.493555+0000","last_became_active":"2024-09-13T18:41:00.947983+0000","last_became_peered":"2024-09-13T18:41:00.947983+0000","last_unstale":"2024-09-13T18:41:02.493555+0000","last_undegraded":"2024-09-13T18:41:02.493555+0000","last_fullsized":"2024-09-13T18:41:02.493555+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:19.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"111'2","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.958984+0000","last_change":"2024-09-13T18:41:00.538294+0000","last_active":"2024-09-13T18:41:00.958984+0000","last_peered":"2024-09-13T18:41:00.958984+0000","last_clean":"2024-09-13T18:41:00.958984+0000","last_became_active":"2024-09-13T18:41:00.537941+0000","last_became_peered":"2024-09-13T18:41:00.537941+0000","last_unstale":"2024-09-13T18:41:00.958984+0000","last_undegraded":"2024-09-13T18:41:00.958984+0000","last_fullsized":"2024-09-13T18:41:00.958984+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:20.554006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937794+0000","last_change":"2024-09-13T18:41:00.952981+0000","last_active":"2024-09-13T18:41:01.937794+0000","last_peered":"2024-09-13T18:41:01.937794+0000","last_clean":"2024-09-13T18:41:01.937794+0000","last_became_active":"2024-09-13T18:41:00.952348+0000","last_became_peered":"2024-09-13T18:41:00.952348+0000","last_unstale":"2024-09-13T18:41:01.937794+0000","last_undegraded":"2024-09-13T18:41:01.937794+0000","last_fullsized":"2024-09-13T18:41:01.937794+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:39.658509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938538+0000","last_change":"2024-09-13T18:41:00.532200+0000","last_active":"2024-09-13T18:41:01.938538+0000","last_peered":"2024-09-13T18:41:01.938538+0000","last_clean":"2024-09-13T18:41:01.938538+0000","last_became_active":"2024-09-13T18:41:00.531987+0000","last_became_peered":"2024-09-13T18:41:00.531987+0000","last_unstale":"2024-09-13T18:41:01.938538+0000","last_undegraded":"2024-09-13T18:41:01.938538+0000","last_fullsized":"2024-09-13T18:41:01.938538+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:55.102407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493213+0000","last_change":"2024-09-13T18:41:00.946673+0000","last_active":"2024-09-13T18:41:02.493213+0000","last_peered":"2024-09-13T18:41:02.493213+0000","last_clean":"2024-09-13T18:41:02.493213+0000","last_became_active":"2024-09-13T18:41:00.946479+0000","last_became_peered":"2024-09-13T18:41:00.946479+0000","last_unstale":"2024-09-13T18:41:02.493213+0000","last_undegraded":"2024-09-13T18:41:02.493213+0000","last_fullsized":"2024-09-13T18:41:02.493213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:13.748134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493166+0000","last_change":"2024-09-13T18:41:00.540811+0000","last_active":"2024-09-13T18:41:02.493166+0000","last_peered":"2024-09-13T18:41:02.493166+0000","last_clean":"2024-09-13T18:41:02.493166+0000","last_became_active":"2024-09-13T18:41:00.540583+0000","last_became_peered":"2024-09-13T18:41:00.540583+0000","last_unstale":"2024-09-13T18:41:02.493166+0000","last_undegraded":"2024-09-13T18:41:02.493166+0000","last_fullsized":"2024-09-13T18:41:02.493166+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:45.356556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493282+0000","last_change":"2024-09-13T18:41:00.950514+0000","last_active":"2024-09-13T18:41:02.493282+0000","last_peered":"2024-09-13T18:41:02.493282+0000","last_clean":"2024-09-13T18:41:02.493282+0000","last_became_active":"2024-09-13T18:41:00.948279+0000","last_became_peered":"2024-09-13T18:41:00.948279+0000","last_unstale":"2024-09-13T18:41:02.493282+0000","last_undegraded":"2024-09-13T18:41:02.493282+0000","last_fullsized":"2024-09-13T18:41:02.493282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:15.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493772+0000","last_change":"2024-09-13T18:41:00.534012+0000","last_active":"2024-09-13T18:41:02.493772+0000","last_peered":"2024-09-13T18:41:02.493772+0000","last_clean":"2024-09-13T18:41:02.493772+0000","last_became_active":"2024-09-13T18:41:00.533777+0000","last_became_peered":"2024-09-13T18:41:00.533777+0000","last_unstale":"2024-09-13T18:41:02.493772+0000","last_undegraded":"2024-09-13T18:41:02.493772+0000","last_fullsized":"2024-09-13T18:41:02.493772+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:50.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493615+0000","last_change":"2024-09-13T18:41:00.945996+0000","last_active":"2024-09-13T18:41:02.493615+0000","last_peered":"2024-09-13T18:41:02.493615+0000","last_clean":"2024-09-13T18:41:02.493615+0000","last_became_active":"2024-09-13T18:41:00.945574+0000","last_became_peered":"2024-09-13T18:41:00.945574+0000","last_unstale":"2024-09-13T18:41:02.493615+0000","last_undegraded":"2024-09-13T18:41:02.493615+0000","last_fullsized":"2024-09-13T18:41:02.493615+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:13.858339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493821+0000","last_change":"2024-09-13T18:41:00.541734+0000","last_active":"2024-09-13T18:41:02.493821+0000","last_peered":"2024-09-13T18:41:02.493821+0000","last_clean":"2024-09-13T18:41:02.493821+0000","last_became_active":"2024-09-13T18:41:00.541540+0000","last_became_peered":"2024-09-13T18:41:00.541540+0000","last_unstale":"2024-09-13T18:41:02.493821+0000","last_undegraded":"2024-09-13T18:41:02.493821+0000","last_fullsized":"2024-09-13T18:41:02.493821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.875712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493761+0000","last_change":"2024-09-13T18:41:00.941188+0000","last_active":"2024-09-13T18:41:02.493761+0000","last_peered":"2024-09-13T18:41:02.493761+0000","last_clean":"2024-09-13T18:41:02.493761+0000","last_became_active":"2024-09-13T18:41:00.940654+0000","last_became_peered":"2024-09-13T18:41:00.940654+0000","last_unstale":"2024-09-13T18:41:02.493761+0000","last_undegraded":"2024-09-13T18:41:02.493761+0000","last_fullsized":"2024-09-13T18:41:02.493761+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:19.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493298+0000","last_change":"2024-09-13T18:41:00.537481+0000","last_active":"2024-09-13T18:41:02.493298+0000","last_peered":"2024-09-13T18:41:02.493298+0000","last_clean":"2024-09-13T18:41:02.493298+0000","last_became_active":"2024-09-13T18:41:00.537272+0000","last_became_peered":"2024-09-13T18:41:00.537272+0000","last_unstale":"2024-09-13T18:41:02.493298+0000","last_undegraded":"2024-09-13T18:41:02.493298+0000","last_fullsized":"2024-09-13T18:41:02.493298+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.810518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493210+0000","last_change":"2024-09-13T18:41:00.952132+0000","last_active":"2024-09-13T18:41:02.493210+0000","last_peered":"2024-09-13T18:41:02.493210+0000","last_clean":"2024-09-13T18:41:02.493210+0000","last_became_active":"2024-09-13T18:41:00.951442+0000","last_became_peered":"2024-09-13T18:41:00.951442+0000","last_unstale":"2024-09-13T18:41:02.493210+0000","last_undegraded":"2024-09-13T18:41:02.493210+0000","last_fullsized":"2024-09-13T18:41:02.493210+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:39.624390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493751+0000","last_change":"2024-09-13T18:41:00.541841+0000","last_active":"2024-09-13T18:41:02.493751+0000","last_peered":"2024-09-13T18:41:02.493751+0000","last_clean":"2024-09-13T18:41:02.493751+0000","last_became_active":"2024-09-13T18:41:00.541297+0000","last_became_peered":"2024-09-13T18:41:00.541297+0000","last_unstale":"2024-09-13T18:41:02.493751+0000","last_undegraded":"2024-09-13T18:41:02.493751+0000","last_fullsized":"2024-09-13T18:41:02.493751+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:48.895594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493369+0000","last_change":"2024-09-13T18:41:00.949303+0000","last_active":"2024-09-13T18:41:02.493369+0000","last_peered":"2024-09-13T18:41:02.493369+0000","last_clean":"2024-09-13T18:41:02.493369+0000","last_became_active":"2024-09-13T18:41:00.948912+0000","last_became_peered":"2024-09-13T18:41:00.948912+0000","last_unstale":"2024-09-13T18:41:02.493369+0000","last_undegraded":"2024-09-13T18:41:02.493369+0000","last_fullsized":"2024-09-13T18:41:02.493369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:56.108890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"111'3","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493479+0000","last_change":"2024-09-13T18:41:00.536314+0000","last_active":"2024-09-13T18:41:02.493479+0000","last_peered":"2024-09-13T18:41:02.493479+0000","last_clean":"2024-09-13T18:41:02.493479+0000","last_became_active":"2024-09-13T18:41:00.535571+0000","last_became_peered":"2024-09-13T18:41:00.535571+0000","last_unstale":"2024-09-13T18:41:02.493479+0000","last_undegraded":"2024-09-13T18:41:02.493479+0000","last_fullsized":"2024-09-13T18:41:02.493479+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:50.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493729+0000","last_change":"2024-09-13T18:41:00.949157+0000","last_active":"2024-09-13T18:41:02.493729+0000","last_peered":"2024-09-13T18:41:02.493729+0000","last_clean":"2024-09-13T18:41:02.493729+0000","last_became_active":"2024-09-13T18:41:00.948820+0000","last_became_peered":"2024-09-13T18:41:00.948820+0000","last_unstale":"2024-09-13T18:41:02.493729+0000","last_undegraded":"2024-09-13T18:41:02.493729+0000","last_fullsized":"2024-09-13T18:41:02.493729+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.931119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"111'6","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938361+0000","last_change":"2024-09-13T18:41:00.531901+0000","last_active":"2024-09-13T18:41:01.938361+0000","last_peered":"2024-09-13T18:41:01.938361+0000","last_clean":"2024-09-13T18:41:01.938361+0000","last_became_active":"2024-09-13T18:41:00.531656+0000","last_became_peered":"2024-09-13T18:41:00.531656+0000","last_unstale":"2024-09-13T18:41:01.938361+0000","last_undegraded":"2024-09-13T18:41:01.938361+0000","last_fullsized":"2024-09-13T18:41:01.938361+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:59.976390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493306+0000","last_change":"2024-09-13T18:41:00.949054+0000","last_active":"2024-09-13T18:41:02.493306+0000","last_peered":"2024-09-13T18:41:02.493306+0000","last_clean":"2024-09-13T18:41:02.493306+0000","last_became_active":"2024-09-13T18:41:00.948594+0000","last_became_peered":"2024-09-13T18:41:00.948594+0000","last_unstale":"2024-09-13T18:41:02.493306+0000","last_undegraded":"2024-09-13T18:41:02.493306+0000","last_fullsized":"2024-09-13T18:41:02.493306+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:01.366944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"111'2","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.958744+0000","last_change":"2024-09-13T18:41:00.536964+0000","last_active":"2024-09-13T18:41:00.958744+0000","last_peered":"2024-09-13T18:41:00.958744+0000","last_clean":"2024-09-13T18:41:00.958744+0000","last_became_active":"2024-09-13T18:41:00.536754+0000","last_became_peered":"2024-09-13T18:41:00.536754+0000","last_unstale":"2024-09-13T18:41:00.958744+0000","last_undegraded":"2024-09-13T18:41:00.958744+0000","last_fullsized":"2024-09-13T18:41:00.958744+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:50.088507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493426+0000","last_change":"2024-09-13T18:41:00.949845+0000","last_active":"2024-09-13T18:41:02.493426+0000","last_peered":"2024-09-13T18:41:02.493426+0000","last_clean":"2024-09-13T18:41:02.493426+0000","last_became_active":"2024-09-13T18:41:00.947705+0000","last_became_peered":"2024-09-13T18:41:00.947705+0000","last_unstale":"2024-09-13T18:41:02.493426+0000","last_undegraded":"2024-09-13T18:41:02.493426+0000","last_fullsized":"2024-09-13T18:41:02.493426+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.643620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936617+0000","last_change":"2024-09-13T18:41:00.535485+0000","last_active":"2024-09-13T18:41:01.936617+0000","last_peered":"2024-09-13T18:41:01.936617+0000","last_clean":"2024-09-13T18:41:01.936617+0000","last_became_active":"2024-09-13T18:41:00.535139+0000","last_became_peered":"2024-09-13T18:41:00.535139+0000","last_unstale":"2024-09-13T18:41:01.936617+0000","last_undegraded":"2024-09-13T18:41:01.936617+0000","last_fullsized":"2024-09-13T18:41:01.936617+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:48.895594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494234+0000","last_change":"2024-09-13T18:41:00.943766+0000","last_active":"2024-09-13T18:41:02.494234+0000","last_peered":"2024-09-13T18:41:02.494234+0000","last_clean":"2024-09-13T18:41:02.494234+0000","last_became_active":"2024-09-13T18:41:00.943086+0000","last_became_peered":"2024-09-13T18:41:00.943086+0000","last_unstale":"2024-09-13T18:41:02.494234+0000","last_undegraded":"2024-09-13T18:41:02.494234+0000","last_fullsized":"2024-09-13T18:41:02.494234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:15.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493830+0000","last_change":"2024-09-13T18:41:00.541696+0000","last_active":"2024-09-13T18:41:02.493830+0000","last_peered":"2024-09-13T18:41:02.493830+0000","last_clean":"2024-09-13T18:41:02.493830+0000","last_became_active":"2024-09-13T18:41:00.541048+0000","last_became_peered":"2024-09-13T18:41:00.541048+0000","last_unstale":"2024-09-13T18:41:02.493830+0000","last_undegraded":"2024-09-13T18:41:02.493830+0000","last_fullsized":"2024-09-13T18:41:02.493830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:18.056386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493226+0000","last_change":"2024-09-13T18:41:00.951311+0000","last_active":"2024-09-13T18:41:02.493226+0000","last_peered":"2024-09-13T18:41:02.493226+0000","last_clean":"2024-09-13T18:41:02.493226+0000","last_became_active":"2024-09-13T18:41:00.951068+0000","last_became_peered":"2024-09-13T18:41:00.951068+0000","last_unstale":"2024-09-13T18:41:02.493226+0000","last_undegraded":"2024-09-13T18:41:02.493226+0000","last_fullsized":"2024-09-13T18:41:02.493226+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:49.902077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"111'8","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493858+0000","last_change":"2024-09-13T18:41:00.537800+0000","last_active":"2024-09-13T18:41:02.493858+0000","last_peered":"2024-09-13T18:41:02.493858+0000","last_clean":"2024-09-13T18:41:02.493858+0000","last_became_active":"2024-09-13T18:41:00.537358+0000","last_became_peered":"2024-09-13T18:41:00.537358+0000","last_unstale":"2024-09-13T18:41:02.493858+0000","last_undegraded":"2024-09-13T18:41:02.493858+0000","last_fullsized":"2024-09-13T18:41:02.493858+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:30.882618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938254+0000","last_change":"2024-09-13T18:41:00.954372+0000","last_active":"2024-09-13T18:41:01.938254+0000","last_peered":"2024-09-13T18:41:01.938254+0000","last_clean":"2024-09-13T18:41:01.938254+0000","last_became_active":"2024-09-13T18:41:00.954163+0000","last_became_peered":"2024-09-13T18:41:00.954163+0000","last_unstale":"2024-09-13T18:41:01.938254+0000","last_undegraded":"2024-09-13T18:41:01.938254+0000","last_fullsized":"2024-09-13T18:41:01.938254+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:36.776781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493701+0000","last_change":"2024-09-13T18:41:00.538288+0000","last_active":"2024-09-13T18:41:02.493701+0000","last_peered":"2024-09-13T18:41:02.493701+0000","last_clean":"2024-09-13T18:41:02.493701+0000","last_became_active":"2024-09-13T18:41:00.538056+0000","last_became_peered":"2024-09-13T18:41:00.538056+0000","last_unstale":"2024-09-13T18:41:02.493701+0000","last_undegraded":"2024-09-13T18:41:02.493701+0000","last_fullsized":"2024-09-13T18:41:02.493701+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:13.077816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493256+0000","last_change":"2024-09-13T18:41:00.946017+0000","last_active":"2024-09-13T18:41:02.493256+0000","last_peered":"2024-09-13T18:41:02.493256+0000","last_clean":"2024-09-13T18:41:02.493256+0000","last_became_active":"2024-09-13T18:41:00.945820+0000","last_became_peered":"2024-09-13T18:41:00.945820+0000","last_unstale":"2024-09-13T18:41:02.493256+0000","last_undegraded":"2024-09-13T18:41:02.493256+0000","last_fullsized":"2024-09-13T18:41:02.493256+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:02.409791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493998+0000","last_change":"2024-09-13T18:41:00.539251+0000","last_active":"2024-09-13T18:41:02.493998+0000","last_peered":"2024-09-13T18:41:02.493998+0000","last_clean":"2024-09-13T18:41:02.493998+0000","last_became_active":"2024-09-13T18:41:00.539013+0000","last_became_peered":"2024-09-13T18:41:00.539013+0000","last_unstale":"2024-09-13T18:41:02.493998+0000","last_undegraded":"2024-09-13T18:41:02.493998+0000","last_fullsized":"2024-09-13T18:41:02.493998+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.160950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938396+0000","last_change":"2024-09-13T18:41:00.954851+0000","last_active":"2024-09-13T18:41:01.938396+0000","last_peered":"2024-09-13T18:41:01.938396+0000","last_clean":"2024-09-13T18:41:01.938396+0000","last_became_active":"2024-09-13T18:41:00.954593+0000","last_became_peered":"2024-09-13T18:41:00.954593+0000","last_unstale":"2024-09-13T18:41:01.938396+0000","last_undegraded":"2024-09-13T18:41:01.938396+0000","last_fullsized":"2024-09-13T18:41:01.938396+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:45.101360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493958+0000","last_change":"2024-09-13T18:41:00.537590+0000","last_active":"2024-09-13T18:41:02.493958+0000","last_peered":"2024-09-13T18:41:02.493958+0000","last_clean":"2024-09-13T18:41:02.493958+0000","last_became_active":"2024-09-13T18:41:00.537380+0000","last_became_peered":"2024-09-13T18:41:00.537380+0000","last_unstale":"2024-09-13T18:41:02.493958+0000","last_undegraded":"2024-09-13T18:41:02.493958+0000","last_fullsized":"2024-09-13T18:41:02.493958+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:15.947166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936766+0000","last_change":"2024-09-13T18:41:00.946219+0000","last_active":"2024-09-13T18:41:01.936766+0000","last_peered":"2024-09-13T18:41:01.936766+0000","last_clean":"2024-09-13T18:41:01.936766+0000","last_became_active":"2024-09-13T18:41:00.945767+0000","last_became_peered":"2024-09-13T18:41:00.945767+0000","last_unstale":"2024-09-13T18:41:01.936766+0000","last_undegraded":"2024-09-13T18:41:01.936766+0000","last_fullsized":"2024-09-13T18:41:01.936766+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:22.282633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494329+0000","last_change":"2024-09-13T18:41:00.539989+0000","last_active":"2024-09-13T18:41:02.494329+0000","last_peered":"2024-09-13T18:41:02.494329+0000","last_clean":"2024-09-13T18:41:02.494329+0000","last_became_active":"2024-09-13T18:41:00.539722+0000","last_became_peered":"2024-09-13T18:41:00.539722+0000","last_unstale":"2024-09-13T18:41:02.494329+0000","last_undegraded":"2024-09-13T18:41:02.494329+0000","last_fullsized":"2024-09-13T18:41:02.494329+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:27.799994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493885+0000","last_change":"2024-09-13T18:41:00.945793+0000","last_active":"2024-09-13T18:41:02.493885+0000","last_peered":"2024-09-13T18:41:02.493885+0000","last_clean":"2024-09-13T18:41:02.493885+0000","last_became_active":"2024-09-13T18:41:00.945407+0000","last_became_peered":"2024-09-13T18:41:00.945407+0000","last_unstale":"2024-09-13T18:41:02.493885+0000","last_undegraded":"2024-09-13T18:41:02.493885+0000","last_fullsized":"2024-09-13T18:41:02.493885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:27.038311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936853+0000","last_change":"2024-09-13T18:41:00.536684+0000","last_active":"2024-09-13T18:41:01.936853+0000","last_peered":"2024-09-13T18:41:01.936853+0000","last_clean":"2024-09-13T18:41:01.936853+0000","last_became_active":"2024-09-13T18:41:00.536405+0000","last_became_peered":"2024-09-13T18:41:00.536405+0000","last_unstale":"2024-09-13T18:41:01.936853+0000","last_undegraded":"2024-09-13T18:41:01.936853+0000","last_fullsized":"2024-09-13T18:41:01.936853+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:52.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938139+0000","last_change":"2024-09-13T18:41:00.950905+0000","last_active":"2024-09-13T18:41:01.938139+0000","last_peered":"2024-09-13T18:41:01.938139+0000","last_clean":"2024-09-13T18:41:01.938139+0000","last_became_active":"2024-09-13T18:41:00.949815+0000","last_became_peered":"2024-09-13T18:41:00.949815+0000","last_unstale":"2024-09-13T18:41:01.938139+0000","last_undegraded":"2024-09-13T18:41:01.938139+0000","last_fullsized":"2024-09-13T18:41:01.938139+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:24.208527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493848+0000","last_change":"2024-09-13T18:41:00.542972+0000","last_active":"2024-09-13T18:41:02.493848+0000","last_peered":"2024-09-13T18:41:02.493848+0000","last_clean":"2024-09-13T18:41:02.493848+0000","last_became_active":"2024-09-13T18:41:00.542758+0000","last_became_peered":"2024-09-13T18:41:00.542758+0000","last_unstale":"2024-09-13T18:41:02.493848+0000","last_undegraded":"2024-09-13T18:41:02.493848+0000","last_fullsized":"2024-09-13T18:41:02.493848+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.192549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938366+0000","last_change":"2024-09-13T18:41:00.950665+0000","last_active":"2024-09-13T18:41:01.938366+0000","last_peered":"2024-09-13T18:41:01.938366+0000","last_clean":"2024-09-13T18:41:01.938366+0000","last_became_active":"2024-09-13T18:41:00.950465+0000","last_became_peered":"2024-09-13T18:41:00.950465+0000","last_unstale":"2024-09-13T18:41:01.938366+0000","last_undegraded":"2024-09-13T18:41:01.938366+0000","last_fullsized":"2024-09-13T18:41:01.938366+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:50.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494055+0000","last_change":"2024-09-13T18:41:00.537485+0000","last_active":"2024-09-13T18:41:02.494055+0000","last_peered":"2024-09-13T18:41:02.494055+0000","last_clean":"2024-09-13T18:41:02.494055+0000","last_became_active":"2024-09-13T18:41:00.537245+0000","last_became_peered":"2024-09-13T18:41:00.537245+0000","last_unstale":"2024-09-13T18:41:02.494055+0000","last_undegraded":"2024-09-13T18:41:02.494055+0000","last_fullsized":"2024-09-13T18:41:02.494055+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:10.975646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493806+0000","last_change":"2024-09-13T18:41:00.949016+0000","last_active":"2024-09-13T18:41:02.493806+0000","last_peered":"2024-09-13T18:41:02.493806+0000","last_clean":"2024-09-13T18:41:02.493806+0000","last_became_active":"2024-09-13T18:41:00.948492+0000","last_became_peered":"2024-09-13T18:41:00.948492+0000","last_unstale":"2024-09-13T18:41:02.493806+0000","last_undegraded":"2024-09-13T18:41:02.493806+0000","last_fullsized":"2024-09-13T18:41:02.493806+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:51.227341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494056+0000","last_change":"2024-09-13T18:41:00.542496+0000","last_active":"2024-09-13T18:41:02.494056+0000","last_peered":"2024-09-13T18:41:02.494056+0000","last_clean":"2024-09-13T18:41:02.494056+0000","last_became_active":"2024-09-13T18:41:00.542266+0000","last_became_peered":"2024-09-13T18:41:00.542266+0000","last_unstale":"2024-09-13T18:41:02.494056+0000","last_undegraded":"2024-09-13T18:41:02.494056+0000","last_fullsized":"2024-09-13T18:41:02.494056+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.810518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493784+0000","last_change":"2024-09-13T18:41:00.945927+0000","last_active":"2024-09-13T18:41:02.493784+0000","last_peered":"2024-09-13T18:41:02.493784+0000","last_clean":"2024-09-13T18:41:02.493784+0000","last_became_active":"2024-09-13T18:41:00.945691+0000","last_became_peered":"2024-09-13T18:41:00.945691+0000","last_unstale":"2024-09-13T18:41:02.493784+0000","last_undegraded":"2024-09-13T18:41:02.493784+0000","last_fullsized":"2024-09-13T18:41:02.493784+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:27.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494014+0000","last_change":"2024-09-13T18:41:00.537616+0000","last_active":"2024-09-13T18:41:02.494014+0000","last_peered":"2024-09-13T18:41:02.494014+0000","last_clean":"2024-09-13T18:41:02.494014+0000","last_became_active":"2024-09-13T18:41:00.537001+0000","last_became_peered":"2024-09-13T18:41:00.537001+0000","last_unstale":"2024-09-13T18:41:02.494014+0000","last_undegraded":"2024-09-13T18:41:02.494014+0000","last_fullsized":"2024-09-13T18:41:02.494014+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.753097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493606+0000","last_change":"2024-09-13T18:41:00.949474+0000","last_active":"2024-09-13T18:41:02.493606+0000","last_peered":"2024-09-13T18:41:02.493606+0000","last_clean":"2024-09-13T18:41:02.493606+0000","last_became_active":"2024-09-13T18:41:00.949257+0000","last_became_peered":"2024-09-13T18:41:00.949257+0000","last_unstale":"2024-09-13T18:41:02.493606+0000","last_undegraded":"2024-09-13T18:41:02.493606+0000","last_fullsized":"2024-09-13T18:41:02.493606+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:41.148144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938422+0000","last_change":"2024-09-13T18:41:00.535427+0000","last_active":"2024-09-13T18:41:01.938422+0000","last_peered":"2024-09-13T18:41:01.938422+0000","last_clean":"2024-09-13T18:41:01.938422+0000","last_became_active":"2024-09-13T18:41:00.535222+0000","last_became_peered":"2024-09-13T18:41:00.535222+0000","last_unstale":"2024-09-13T18:41:01.938422+0000","last_undegraded":"2024-09-13T18:41:01.938422+0000","last_fullsized":"2024-09-13T18:41:01.938422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:00.360461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493338+0000","last_change":"2024-09-13T18:41:00.939932+0000","last_active":"2024-09-13T18:41:02.493338+0000","last_peered":"2024-09-13T18:41:02.493338+0000","last_clean":"2024-09-13T18:41:02.493338+0000","last_became_active":"2024-09-13T18:41:00.939723+0000","last_became_peered":"2024-09-13T18:41:00.939723+0000","last_unstale":"2024-09-13T18:41:02.493338+0000","last_undegraded":"2024-09-13T18:41:02.493338+0000","last_fullsized":"2024-09-13T18:41:02.493338+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:21.791718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493917+0000","last_change":"2024-09-13T18:41:00.541712+0000","last_active":"2024-09-13T18:41:02.493917+0000","last_peered":"2024-09-13T18:41:02.493917+0000","last_clean":"2024-09-13T18:41:02.493917+0000","last_became_active":"2024-09-13T18:41:00.541380+0000","last_became_peered":"2024-09-13T18:41:00.541380+0000","last_unstale":"2024-09-13T18:41:02.493917+0000","last_undegraded":"2024-09-13T18:41:02.493917+0000","last_fullsized":"2024-09-13T18:41:02.493917+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493232+0000","last_change":"2024-09-13T18:41:00.941977+0000","last_active":"2024-09-13T18:41:02.493232+0000","last_peered":"2024-09-13T18:41:02.493232+0000","last_clean":"2024-09-13T18:41:02.493232+0000","last_became_active":"2024-09-13T18:41:00.941752+0000","last_became_peered":"2024-09-13T18:41:00.941752+0000","last_unstale":"2024-09-13T18:41:02.493232+0000","last_undegraded":"2024-09-13T18:41:02.493232+0000","last_fullsized":"2024-09-13T18:41:02.493232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:53.053099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936693+0000","last_change":"2024-09-13T18:41:00.543471+0000","last_active":"2024-09-13T18:41:01.936693+0000","last_peered":"2024-09-13T18:41:01.936693+0000","last_clean":"2024-09-13T18:41:01.936693+0000","last_became_active":"2024-09-13T18:41:00.543197+0000","last_became_peered":"2024-09-13T18:41:00.543197+0000","last_unstale":"2024-09-13T18:41:01.936693+0000","last_undegraded":"2024-09-13T18:41:01.936693+0000","last_fullsized":"2024-09-13T18:41:01.936693+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493445+0000","last_change":"2024-09-13T18:41:00.948863+0000","last_active":"2024-09-13T18:41:02.493445+0000","last_peered":"2024-09-13T18:41:02.493445+0000","last_clean":"2024-09-13T18:41:02.493445+0000","last_became_active":"2024-09-13T18:41:00.946805+0000","last_became_peered":"2024-09-13T18:41:00.946805+0000","last_unstale":"2024-09-13T18:41:02.493445+0000","last_undegraded":"2024-09-13T18:41:02.493445+0000","last_fullsized":"2024-09-13T18:41:02.493445+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493902+0000","last_change":"2024-09-13T18:41:00.541560+0000","last_active":"2024-09-13T18:41:02.493902+0000","last_peered":"2024-09-13T18:41:02.493902+0000","last_clean":"2024-09-13T18:41:02.493902+0000","last_became_active":"2024-09-13T18:41:00.540805+0000","last_became_peered":"2024-09-13T18:41:00.540805+0000","last_unstale":"2024-09-13T18:41:02.493902+0000","last_undegraded":"2024-09-13T18:41:02.493902+0000","last_fullsized":"2024-09-13T18:41:02.493902+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.492806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.492952+0000","last_change":"2024-09-13T18:41:00.940646+0000","last_active":"2024-09-13T18:41:02.492952+0000","last_peered":"2024-09-13T18:41:02.492952+0000","last_clean":"2024-09-13T18:41:02.492952+0000","last_became_active":"2024-09-13T18:41:00.939807+0000","last_became_peered":"2024-09-13T18:41:00.939807+0000","last_unstale":"2024-09-13T18:41:02.492952+0000","last_undegraded":"2024-09-13T18:41:02.492952+0000","last_fullsized":"2024-09-13T18:41:02.492952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:22.651866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493548+0000","last_change":"2024-09-13T18:41:00.535784+0000","last_active":"2024-09-13T18:41:02.493548+0000","last_peered":"2024-09-13T18:41:02.493548+0000","last_clean":"2024-09-13T18:41:02.493548+0000","last_became_active":"2024-09-13T18:41:00.535274+0000","last_became_peered":"2024-09-13T18:41:00.535274+0000","last_unstale":"2024-09-13T18:41:02.493548+0000","last_undegraded":"2024-09-13T18:41:02.493548+0000","last_fullsized":"2024-09-13T18:41:02.493548+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.875712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493400+0000","last_change":"2024-09-13T18:41:00.940674+0000","last_active":"2024-09-13T18:41:02.493400+0000","last_peered":"2024-09-13T18:41:02.493400+0000","last_clean":"2024-09-13T18:41:02.493400+0000","last_became_active":"2024-09-13T18:41:00.940455+0000","last_became_peered":"2024-09-13T18:41:00.940455+0000","last_unstale":"2024-09-13T18:41:02.493400+0000","last_undegraded":"2024-09-13T18:41:02.493400+0000","last_fullsized":"2024-09-13T18:41:02.493400+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:05.499289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938463+0000","last_change":"2024-09-13T18:41:00.538446+0000","last_active":"2024-09-13T18:41:01.938463+0000","last_peered":"2024-09-13T18:41:01.938463+0000","last_clean":"2024-09-13T18:41:01.938463+0000","last_became_active":"2024-09-13T18:41:00.538186+0000","last_became_peered":"2024-09-13T18:41:00.538186+0000","last_unstale":"2024-09-13T18:41:01.938463+0000","last_undegraded":"2024-09-13T18:41:01.938463+0000","last_fullsized":"2024-09-13T18:41:01.938463+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.384875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493352+0000","last_change":"2024-09-13T18:41:00.948977+0000","last_active":"2024-09-13T18:41:02.493352+0000","last_peered":"2024-09-13T18:41:02.493352+0000","last_clean":"2024-09-13T18:41:02.493352+0000","last_became_active":"2024-09-13T18:41:00.948731+0000","last_became_peered":"2024-09-13T18:41:00.948731+0000","last_unstale":"2024-09-13T18:41:02.493352+0000","last_undegraded":"2024-09-13T18:41:02.493352+0000","last_fullsized":"2024-09-13T18:41:02.493352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:52.391358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493691+0000","last_change":"2024-09-13T18:41:00.540527+0000","last_active":"2024-09-13T18:41:02.493691+0000","last_peered":"2024-09-13T18:41:02.493691+0000","last_clean":"2024-09-13T18:41:02.493691+0000","last_became_active":"2024-09-13T18:41:00.540248+0000","last_became_peered":"2024-09-13T18:41:00.540248+0000","last_unstale":"2024-09-13T18:41:02.493691+0000","last_undegraded":"2024-09-13T18:41:02.493691+0000","last_fullsized":"2024-09-13T18:41:02.493691+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:45.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.936910+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:41:00.936910+0000","last_peered":"2024-09-13T18:41:00.936910+0000","last_clean":"2024-09-13T18:41:00.936910+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:41:00.936910+0000","last_undegraded":"2024-09-13T18:41:00.936910+0000","last_fullsized":"2024-09-13T18:41:00.936910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542215,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1177,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194135,"statfs":{"total":200000000,"available":198794298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46700000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.63},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.054,"15min":1.054},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.85099999999999998},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.86099999999999999},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.81200000000000006,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.79800000000000004,"5min":1.036,"15min":1.036},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83299999999999996,"5min":1.371,"15min":1.371},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0349999999999999,"5min":1.143,"15min":1.143},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.997,"5min":1.125,"15min":1.125},"last":0.501}]}]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.64000000000000001},"min":{"1min":0.38800000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":1.665,"15min":1.665},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66500000000000004,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.873,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85799999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67100000000000004,"15min":0.64500000000000002},"min":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.591,"15min":1.591},"last":0.748}]},{"osd":2,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72999999999999998,"15min":0.67800000000000005},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83699999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.91500000000000004,"5min":2.169,"15min":2.169},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71699999999999997,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93000000000000005,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.48099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95599999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":1.115,"15min":1.115},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97699999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194712,"statfs":{"total":200000000,"available":199385592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.73799999999999999,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97999999999999998,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.999,"15min":0.999},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.85899999999999999},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.92700000000000005,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73099999999999998,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94299999999999995,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95999999999999996,"5min":1.032,"15min":1.032},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.753,"15min":0.89300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90500000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.752,"15min":0.83099999999999996},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.004,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.65100000000000002},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.624},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.59799999999999998},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84299999999999997,"5min":1.403,"15min":1.403},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84499999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.875}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.64700000000000002},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91800000000000004,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.69999999999999996},"min":{"1min":0.498,"5min":0.497,"15min":0.497},"max":{"1min":0.90500000000000003,"5min":3.706,"15min":3.706},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.68200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":3.742,"15min":3.742},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.552,"15min":1.552},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96799999999999997,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92400000000000004,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.60999999999999999},"min":{"1min":0.47699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88100000000000001,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.68700000000000006},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194712,"statfs":{"total":200000000,"available":199385590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42299999999999999,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.623,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56000000000000005,"15min":0.77800000000000002},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73499999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73099999999999998,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.62},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76600000000000001,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.56399999999999995,"15min":0.72499999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":7.798,"15min":7.798},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.048,"5min":3.093,"15min":3.093},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2869999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79600000000000004,"15min":0.80700000000000005},"min":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1519999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76200000000000001,"15min":0.72199999999999998},"min":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":1.004},"min":{"1min":0.58899999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2649999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80200000000000005,"15min":0.93400000000000005},"min":{"1min":0.51500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2430000000000001,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82299999999999995,"15min":0.85499999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.82899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.255,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67500000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.74299999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59699999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.45500000000000002,"15min":0.48499999999999999},"min":{"1min":0.33100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57199999999999995,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61799999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.47899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93700000000000006,"5min":1.02,"15min":1.02},"last":0.505}]},{"osd":5,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76500000000000001,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.02,"5min":1.079,"15min":1.079},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98099999999999998,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.621,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.097,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1175,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194136,"statfs":{"total":200000000,"available":198795806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.45100000000000001,"15min":0.438},"min":{"1min":0.374,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":1.036,"15min":1.036},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.51700000000000002,"15min":0.47799999999999998},"min":{"1min":0.44900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.504,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93600000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78900000000000003,"15min":0.76000000000000001},"min":{"1min":0.66000000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.747},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.59599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.69199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.73799999999999999,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81399999999999995,"15min":0.77800000000000002},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78000000000000003,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.149,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.46200000000000002},"min":{"1min":0.29199999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":1.669,"15min":1.669},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.27900000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67200000000000004,"5min":0.874,"15min":0.874},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76600000000000001,"5min":1.591,"15min":1.591},"last":0.374},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.47799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.46100000000000002},"min":{"1min":0.318,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":1.03,"15min":1.03},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97099999999999997,"5min":1.2,"15min":1.2},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71399999999999997,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.006,"5min":1.698,"15min":1.698},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":1.204},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.121,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.085}]},{"osd":6,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1519999999999999,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.044},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.68700000000000006},"min":{"1min":0.52200000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0349999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.95599999999999996}]}]}],"pool_statfs":[]}} 2024-09-13T18:41:05.080 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:41:05.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.264+0000 7f05ad800640 1 Processor -- start 2024-09-13T18:41:05.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.264+0000 7f05ad800640 1 -- start start 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05ad800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05ad800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05a80cb0b0 0x7f05a815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05ad800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05a8140480 con 0x7f05a8140980 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05ad800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05a815c160 con 0x7f05a80cb0b0 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05ad800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a815ee90 con 0x7f05a80cacd0 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05a80cb0b0 0x7f05a815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f05a80cb0b0 0x7f05a815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35974/0 (socket says 172.21.15.192:35974) 2024-09-13T18:41:05.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 -- 172.21.15.192:0/3197001977 learned_addr learned my addr 172.21.15.192:0/3197001977 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:05.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f05a6a00640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 -- 172.21.15.192:0/3197001977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 msgr2=0x7f05a815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:05.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 -- 172.21.15.192:0/3197001977 >> v1:172.21.15.194:6789/0 conn(0x7f05a8140980 legacy=0x7f05a80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:05.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.266+0000 7f059e000640 1 -- 172.21.15.192:0/3197001977 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a815f170 con 0x7f05a80cb0b0 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.267+0000 7f059e000640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a815bc20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0590009870 tx=0x7f059002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8f82cbdb6c8fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05a6000640 1 -- 172.21.15.192:0/3197001977 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590032440 con 0x7f05a80cb0b0 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05a6000640 1 -- 172.21.15.192:0/3197001977 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05900325a0 con 0x7f05a80cb0b0 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05a6000640 1 -- 172.21.15.192:0/3197001977 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590032930 con 0x7f05a80cb0b0 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 -- 172.21.15.192:0/3197001977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 msgr2=0x7f05a815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a815bc20 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0590009870 tx=0x7f059002a210 comp rx=0 tx=0).stop 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 -- 172.21.15.192:0/3197001977 shutdown_connections 2024-09-13T18:41:05.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a815bc20 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 --2- 172.21.15.192:0/3197001977 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 -- 172.21.15.192:0/3197001977 >> 172.21.15.192:0/3197001977 conn(0x7f05a80ae960 msgr2=0x7f05a806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 -- 172.21.15.192:0/3197001977 shutdown_connections 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.268+0000 7f05ad800640 1 -- 172.21.15.192:0/3197001977 wait complete. 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.270+0000 7f05ad800640 1 Processor -- start 2024-09-13T18:41:05.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.270+0000 7f05ad800640 1 -- start start 2024-09-13T18:41:05.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a813c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 0x7f05a80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a813cd60 con 0x7f05a80cb0b0 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a815a030 con 0x7f05a8140980 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05ad800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a80b3540 con 0x7f05a80cacd0 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35976/0 (socket says 172.21.15.192:35976) 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 -- 172.21.15.192:0/2483488425 learned_addr learned my addr 172.21.15.192:0/2483488425 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05a6a00640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a813c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05a7400640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 0x7f05a80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 -- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 msgr2=0x7f05a813c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a813c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 -- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 msgr2=0x7f05a80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 0x7f05a80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f059e000640 1 -- 172.21.15.192:0/2483488425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900094d0 con 0x7f05a80cb0b0 2024-09-13T18:41:05.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.271+0000 7f05a7400640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 0x7f05a80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:05.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f059e000640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0590009870 tx=0x7f05900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590032440 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0590030b80 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a815a280 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059003d420 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.272+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a80b37e0 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.273+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05a815bc20 con 0x7f05a80cb0b0 2024-09-13T18:41:05.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.274+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0590039040 con 0x7f05a80cb0b0 2024-09-13T18:41:05.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.275+0000 7f059f400640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 0x7f058406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.275+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05900a9ea0 con 0x7f05a80cb0b0 2024-09-13T18:41:05.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.275+0000 7f05a6a00640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 0x7f058406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.276+0000 7f05a6a00640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 0x7f058406d0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05a81e4b40 tx=0x7f0598008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.279+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05900751b0 con 0x7f05a80cb0b0 2024-09-13T18:41:05.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.444+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f05a815a7a0 con 0x7f058406ac00 2024-09-13T18:41:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.451+0000 7f059f400640 1 -- 172.21.15.192:0/2483488425 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285146 (secure 0 0 0) 0x7f05980108d0 con 0x7f058406ac00 2024-09-13T18:41:05.457 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 msgr2=0x7f058406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 0x7f058406d0c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f05a81e4b40 tx=0x7f0598008040 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 msgr2=0x7f05a80b3d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0590009870 tx=0x7f05900046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 shutdown_connections 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f058406ac00 0x7f058406d0c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05a8140980 0x7f05a80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05a80cb0b0 0x7f05a80b3d00 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 --2- 172.21.15.192:0/2483488425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05a80cacd0 0x7f05a813c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 >> 172.21.15.192:0/2483488425 conn(0x7f05a80ae960 msgr2=0x7f05a8071760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 shutdown_connections 2024-09-13T18:41:05.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.455+0000 7f05ad800640 1 -- 172.21.15.192:0/2483488425 wait complete. 2024-09-13T18:41:05.473 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":272,"stamp":"2024-09-13T18:41:04.805923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5952,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556547,"statfs":{"total":1600000000,"available":1593904652,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.288742"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493033+0000","last_change":"2024-09-13T18:41:00.943561+0000","last_active":"2024-09-13T18:41:02.493033+0000","last_peered":"2024-09-13T18:41:02.493033+0000","last_clean":"2024-09-13T18:41:02.493033+0000","last_became_active":"2024-09-13T18:41:00.943306+0000","last_became_peered":"2024-09-13T18:41:00.943306+0000","last_unstale":"2024-09-13T18:41:02.493033+0000","last_undegraded":"2024-09-13T18:41:02.493033+0000","last_fullsized":"2024-09-13T18:41:02.493033+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:45.609461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936543+0000","last_change":"2024-09-13T18:41:00.942423+0000","last_active":"2024-09-13T18:41:01.936543+0000","last_peered":"2024-09-13T18:41:01.936543+0000","last_clean":"2024-09-13T18:41:01.936543+0000","last_became_active":"2024-09-13T18:41:00.942181+0000","last_became_peered":"2024-09-13T18:41:00.942181+0000","last_unstale":"2024-09-13T18:41:01.936543+0000","last_undegraded":"2024-09-13T18:41:01.936543+0000","last_fullsized":"2024-09-13T18:41:01.936543+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493068+0000","last_change":"2024-09-13T18:41:00.948444+0000","last_active":"2024-09-13T18:41:02.493068+0000","last_peered":"2024-09-13T18:41:02.493068+0000","last_clean":"2024-09-13T18:41:02.493068+0000","last_became_active":"2024-09-13T18:41:00.946989+0000","last_became_peered":"2024-09-13T18:41:00.946989+0000","last_unstale":"2024-09-13T18:41:02.493068+0000","last_undegraded":"2024-09-13T18:41:02.493068+0000","last_fullsized":"2024-09-13T18:41:02.493068+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937901+0000","last_change":"2024-09-13T18:41:00.950468+0000","last_active":"2024-09-13T18:41:01.937901+0000","last_peered":"2024-09-13T18:41:01.937901+0000","last_clean":"2024-09-13T18:41:01.937901+0000","last_became_active":"2024-09-13T18:41:00.949143+0000","last_became_peered":"2024-09-13T18:41:00.949143+0000","last_unstale":"2024-09-13T18:41:01.937901+0000","last_undegraded":"2024-09-13T18:41:01.937901+0000","last_fullsized":"2024-09-13T18:41:01.937901+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:19.609454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493947+0000","last_change":"2024-09-13T18:41:00.948043+0000","last_active":"2024-09-13T18:41:02.493947+0000","last_peered":"2024-09-13T18:41:02.493947+0000","last_clean":"2024-09-13T18:41:02.493947+0000","last_became_active":"2024-09-13T18:41:00.947837+0000","last_became_peered":"2024-09-13T18:41:00.947837+0000","last_unstale":"2024-09-13T18:41:02.493947+0000","last_undegraded":"2024-09-13T18:41:02.493947+0000","last_fullsized":"2024-09-13T18:41:02.493947+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:39.599273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494128+0000","last_change":"2024-09-13T18:41:00.953141+0000","last_active":"2024-09-13T18:41:02.494128+0000","last_peered":"2024-09-13T18:41:02.494128+0000","last_clean":"2024-09-13T18:41:02.494128+0000","last_became_active":"2024-09-13T18:41:00.952610+0000","last_became_peered":"2024-09-13T18:41:00.952610+0000","last_unstale":"2024-09-13T18:41:02.494128+0000","last_undegraded":"2024-09-13T18:41:02.494128+0000","last_fullsized":"2024-09-13T18:41:02.494128+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:45.101360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936735+0000","last_change":"2024-09-13T18:41:00.947747+0000","last_active":"2024-09-13T18:41:01.936735+0000","last_peered":"2024-09-13T18:41:01.936735+0000","last_clean":"2024-09-13T18:41:01.936735+0000","last_became_active":"2024-09-13T18:41:00.946838+0000","last_became_peered":"2024-09-13T18:41:00.946838+0000","last_unstale":"2024-09-13T18:41:01.936735+0000","last_undegraded":"2024-09-13T18:41:01.936735+0000","last_fullsized":"2024-09-13T18:41:01.936735+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:08.827745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938255+0000","last_change":"2024-09-13T18:41:00.952752+0000","last_active":"2024-09-13T18:41:01.938255+0000","last_peered":"2024-09-13T18:41:01.938255+0000","last_clean":"2024-09-13T18:41:01.938255+0000","last_became_active":"2024-09-13T18:41:00.952000+0000","last_became_peered":"2024-09-13T18:41:00.952000+0000","last_unstale":"2024-09-13T18:41:01.938255+0000","last_undegraded":"2024-09-13T18:41:01.938255+0000","last_fullsized":"2024-09-13T18:41:01.938255+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:39.658509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.492859+0000","last_change":"2024-09-13T18:41:00.942054+0000","last_active":"2024-09-13T18:41:02.492859+0000","last_peered":"2024-09-13T18:41:02.492859+0000","last_clean":"2024-09-13T18:41:02.492859+0000","last_became_active":"2024-09-13T18:41:00.941786+0000","last_became_peered":"2024-09-13T18:41:00.941786+0000","last_unstale":"2024-09-13T18:41:02.492859+0000","last_undegraded":"2024-09-13T18:41:02.492859+0000","last_fullsized":"2024-09-13T18:41:02.492859+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:13.858339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493842+0000","last_change":"2024-09-13T18:41:00.945288+0000","last_active":"2024-09-13T18:41:02.493842+0000","last_peered":"2024-09-13T18:41:02.493842+0000","last_clean":"2024-09-13T18:41:02.493842+0000","last_became_active":"2024-09-13T18:41:00.945079+0000","last_became_peered":"2024-09-13T18:41:00.945079+0000","last_unstale":"2024-09-13T18:41:02.493842+0000","last_undegraded":"2024-09-13T18:41:02.493842+0000","last_fullsized":"2024-09-13T18:41:02.493842+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:47.937450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493621+0000","last_change":"2024-09-13T18:41:00.947026+0000","last_active":"2024-09-13T18:41:02.493621+0000","last_peered":"2024-09-13T18:41:02.493621+0000","last_clean":"2024-09-13T18:41:02.493621+0000","last_became_active":"2024-09-13T18:41:00.946111+0000","last_became_peered":"2024-09-13T18:41:00.946111+0000","last_unstale":"2024-09-13T18:41:02.493621+0000","last_undegraded":"2024-09-13T18:41:02.493621+0000","last_fullsized":"2024-09-13T18:41:02.493621+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:22.282633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938273+0000","last_change":"2024-09-13T18:41:00.951879+0000","last_active":"2024-09-13T18:41:01.938273+0000","last_peered":"2024-09-13T18:41:01.938273+0000","last_clean":"2024-09-13T18:41:01.938273+0000","last_became_active":"2024-09-13T18:41:00.951615+0000","last_became_peered":"2024-09-13T18:41:00.951615+0000","last_unstale":"2024-09-13T18:41:01.938273+0000","last_undegraded":"2024-09-13T18:41:01.938273+0000","last_fullsized":"2024-09-13T18:41:01.938273+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:24.208527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493638+0000","last_change":"2024-09-13T18:41:00.946684+0000","last_active":"2024-09-13T18:41:02.493638+0000","last_peered":"2024-09-13T18:41:02.493638+0000","last_clean":"2024-09-13T18:41:02.493638+0000","last_became_active":"2024-09-13T18:41:00.946347+0000","last_became_peered":"2024-09-13T18:41:00.946347+0000","last_unstale":"2024-09-13T18:41:02.493638+0000","last_undegraded":"2024-09-13T18:41:02.493638+0000","last_fullsized":"2024-09-13T18:41:02.493638+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:03:20.507082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493408+0000","last_change":"2024-09-13T18:41:00.951592+0000","last_active":"2024-09-13T18:41:02.493408+0000","last_peered":"2024-09-13T18:41:02.493408+0000","last_clean":"2024-09-13T18:41:02.493408+0000","last_became_active":"2024-09-13T18:41:00.950818+0000","last_became_peered":"2024-09-13T18:41:00.950818+0000","last_unstale":"2024-09-13T18:41:02.493408+0000","last_undegraded":"2024-09-13T18:41:02.493408+0000","last_fullsized":"2024-09-13T18:41:02.493408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.643620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936610+0000","last_change":"2024-09-13T18:41:00.953248+0000","last_active":"2024-09-13T18:41:01.936610+0000","last_peered":"2024-09-13T18:41:01.936610+0000","last_clean":"2024-09-13T18:41:01.936610+0000","last_became_active":"2024-09-13T18:41:00.952891+0000","last_became_peered":"2024-09-13T18:41:00.952891+0000","last_unstale":"2024-09-13T18:41:01.936610+0000","last_undegraded":"2024-09-13T18:41:01.936610+0000","last_fullsized":"2024-09-13T18:41:01.936610+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:52.391358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494305+0000","last_change":"2024-09-13T18:41:00.944990+0000","last_active":"2024-09-13T18:41:02.494305+0000","last_peered":"2024-09-13T18:41:02.494305+0000","last_clean":"2024-09-13T18:41:02.494305+0000","last_became_active":"2024-09-13T18:41:00.944784+0000","last_became_peered":"2024-09-13T18:41:00.944784+0000","last_unstale":"2024-09-13T18:41:02.494305+0000","last_undegraded":"2024-09-13T18:41:02.494305+0000","last_fullsized":"2024-09-13T18:41:02.494305+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:36.776781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938386+0000","last_change":"2024-09-13T18:41:00.947289+0000","last_active":"2024-09-13T18:41:01.938386+0000","last_peered":"2024-09-13T18:41:01.938386+0000","last_clean":"2024-09-13T18:41:01.938386+0000","last_became_active":"2024-09-13T18:41:00.947075+0000","last_became_peered":"2024-09-13T18:41:00.947075+0000","last_unstale":"2024-09-13T18:41:01.938386+0000","last_undegraded":"2024-09-13T18:41:01.938386+0000","last_fullsized":"2024-09-13T18:41:01.938386+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:10:47.937450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493700+0000","last_change":"2024-09-13T18:41:00.947758+0000","last_active":"2024-09-13T18:41:02.493700+0000","last_peered":"2024-09-13T18:41:02.493700+0000","last_clean":"2024-09-13T18:41:02.493700+0000","last_became_active":"2024-09-13T18:41:00.946359+0000","last_became_peered":"2024-09-13T18:41:00.946359+0000","last_unstale":"2024-09-13T18:41:02.493700+0000","last_undegraded":"2024-09-13T18:41:02.493700+0000","last_fullsized":"2024-09-13T18:41:02.493700+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:45.609461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493510+0000","last_change":"2024-09-13T18:41:00.951823+0000","last_active":"2024-09-13T18:41:02.493510+0000","last_peered":"2024-09-13T18:41:02.493510+0000","last_clean":"2024-09-13T18:41:02.493510+0000","last_became_active":"2024-09-13T18:41:00.951230+0000","last_became_peered":"2024-09-13T18:41:00.951230+0000","last_unstale":"2024-09-13T18:41:02.493510+0000","last_undegraded":"2024-09-13T18:41:02.493510+0000","last_fullsized":"2024-09-13T18:41:02.493510+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:39.624390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493716+0000","last_change":"2024-09-13T18:41:00.950613+0000","last_active":"2024-09-13T18:41:02.493716+0000","last_peered":"2024-09-13T18:41:02.493716+0000","last_clean":"2024-09-13T18:41:02.493716+0000","last_became_active":"2024-09-13T18:41:00.950392+0000","last_became_peered":"2024-09-13T18:41:00.950392+0000","last_unstale":"2024-09-13T18:41:02.493716+0000","last_undegraded":"2024-09-13T18:41:02.493716+0000","last_fullsized":"2024-09-13T18:41:02.493716+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:01.370670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937945+0000","last_change":"2024-09-13T18:41:00.950158+0000","last_active":"2024-09-13T18:41:01.937945+0000","last_peered":"2024-09-13T18:41:01.937945+0000","last_clean":"2024-09-13T18:41:01.937945+0000","last_became_active":"2024-09-13T18:41:00.949511+0000","last_became_peered":"2024-09-13T18:41:00.949511+0000","last_unstale":"2024-09-13T18:41:01.937945+0000","last_undegraded":"2024-09-13T18:41:01.937945+0000","last_fullsized":"2024-09-13T18:41:01.937945+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:50.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493866+0000","last_change":"2024-09-13T18:41:00.941324+0000","last_active":"2024-09-13T18:41:02.493866+0000","last_peered":"2024-09-13T18:41:02.493866+0000","last_clean":"2024-09-13T18:41:02.493866+0000","last_became_active":"2024-09-13T18:41:00.940950+0000","last_became_peered":"2024-09-13T18:41:00.940950+0000","last_unstale":"2024-09-13T18:41:02.493866+0000","last_undegraded":"2024-09-13T18:41:02.493866+0000","last_fullsized":"2024-09-13T18:41:02.493866+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:05.499289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938352+0000","last_change":"2024-09-13T18:41:00.947702+0000","last_active":"2024-09-13T18:41:01.938352+0000","last_peered":"2024-09-13T18:41:01.938352+0000","last_clean":"2024-09-13T18:41:01.938352+0000","last_became_active":"2024-09-13T18:41:00.946095+0000","last_became_peered":"2024-09-13T18:41:00.946095+0000","last_unstale":"2024-09-13T18:41:01.938352+0000","last_undegraded":"2024-09-13T18:41:01.938352+0000","last_fullsized":"2024-09-13T18:41:01.938352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:37.630207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493267+0000","last_change":"2024-09-13T18:41:00.943101+0000","last_active":"2024-09-13T18:41:02.493267+0000","last_peered":"2024-09-13T18:41:02.493267+0000","last_clean":"2024-09-13T18:41:02.493267+0000","last_became_active":"2024-09-13T18:41:00.942785+0000","last_became_peered":"2024-09-13T18:41:00.942785+0000","last_unstale":"2024-09-13T18:41:02.493267+0000","last_undegraded":"2024-09-13T18:41:02.493267+0000","last_fullsized":"2024-09-13T18:41:02.493267+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:42:38.332683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493570+0000","last_change":"2024-09-13T18:41:00.950821+0000","last_active":"2024-09-13T18:41:02.493570+0000","last_peered":"2024-09-13T18:41:02.493570+0000","last_clean":"2024-09-13T18:41:02.493570+0000","last_became_active":"2024-09-13T18:41:00.950265+0000","last_became_peered":"2024-09-13T18:41:00.950265+0000","last_unstale":"2024-09-13T18:41:02.493570+0000","last_undegraded":"2024-09-13T18:41:02.493570+0000","last_fullsized":"2024-09-13T18:41:02.493570+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:00.982874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493501+0000","last_change":"2024-09-13T18:41:00.949234+0000","last_active":"2024-09-13T18:41:02.493501+0000","last_peered":"2024-09-13T18:41:02.493501+0000","last_clean":"2024-09-13T18:41:02.493501+0000","last_became_active":"2024-09-13T18:41:00.949016+0000","last_became_peered":"2024-09-13T18:41:00.949016+0000","last_unstale":"2024-09-13T18:41:02.493501+0000","last_undegraded":"2024-09-13T18:41:02.493501+0000","last_fullsized":"2024-09-13T18:41:02.493501+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:07.566596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493698+0000","last_change":"2024-09-13T18:41:00.954704+0000","last_active":"2024-09-13T18:41:02.493698+0000","last_peered":"2024-09-13T18:41:02.493698+0000","last_clean":"2024-09-13T18:41:02.493698+0000","last_became_active":"2024-09-13T18:41:00.954406+0000","last_became_peered":"2024-09-13T18:41:00.954406+0000","last_unstale":"2024-09-13T18:41:02.493698+0000","last_undegraded":"2024-09-13T18:41:02.493698+0000","last_fullsized":"2024-09-13T18:41:02.493698+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:31.602204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493231+0000","last_change":"2024-09-13T18:41:00.950907+0000","last_active":"2024-09-13T18:41:02.493231+0000","last_peered":"2024-09-13T18:41:02.493231+0000","last_clean":"2024-09-13T18:41:02.493231+0000","last_became_active":"2024-09-13T18:41:00.950524+0000","last_became_peered":"2024-09-13T18:41:00.950524+0000","last_unstale":"2024-09-13T18:41:02.493231+0000","last_undegraded":"2024-09-13T18:41:02.493231+0000","last_fullsized":"2024-09-13T18:41:02.493231+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:46.363040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937979+0000","last_change":"2024-09-13T18:41:00.949527+0000","last_active":"2024-09-13T18:41:01.937979+0000","last_peered":"2024-09-13T18:41:01.937979+0000","last_clean":"2024-09-13T18:41:01.937979+0000","last_became_active":"2024-09-13T18:41:00.948841+0000","last_became_peered":"2024-09-13T18:41:00.948841+0000","last_unstale":"2024-09-13T18:41:01.937979+0000","last_undegraded":"2024-09-13T18:41:01.937979+0000","last_fullsized":"2024-09-13T18:41:01.937979+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.063827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493607+0000","last_change":"2024-09-13T18:41:00.949854+0000","last_active":"2024-09-13T18:41:02.493607+0000","last_peered":"2024-09-13T18:41:02.493607+0000","last_clean":"2024-09-13T18:41:02.493607+0000","last_became_active":"2024-09-13T18:41:00.949638+0000","last_became_peered":"2024-09-13T18:41:00.949638+0000","last_unstale":"2024-09-13T18:41:02.493607+0000","last_undegraded":"2024-09-13T18:41:02.493607+0000","last_fullsized":"2024-09-13T18:41:02.493607+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:22.651866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494221+0000","last_change":"2024-09-13T18:41:00.953276+0000","last_active":"2024-09-13T18:41:02.494221+0000","last_peered":"2024-09-13T18:41:02.494221+0000","last_clean":"2024-09-13T18:41:02.494221+0000","last_became_active":"2024-09-13T18:41:00.952899+0000","last_became_peered":"2024-09-13T18:41:00.952899+0000","last_unstale":"2024-09-13T18:41:02.494221+0000","last_undegraded":"2024-09-13T18:41:02.494221+0000","last_fullsized":"2024-09-13T18:41:02.494221+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:20:25.802827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493662+0000","last_change":"2024-09-13T18:41:00.953473+0000","last_active":"2024-09-13T18:41:02.493662+0000","last_peered":"2024-09-13T18:41:02.493662+0000","last_clean":"2024-09-13T18:41:02.493662+0000","last_became_active":"2024-09-13T18:41:00.951919+0000","last_became_peered":"2024-09-13T18:41:00.951919+0000","last_unstale":"2024-09-13T18:41:02.493662+0000","last_undegraded":"2024-09-13T18:41:02.493662+0000","last_fullsized":"2024-09-13T18:41:02.493662+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:33.983911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938276+0000","last_change":"2024-09-13T18:41:00.946419+0000","last_active":"2024-09-13T18:41:01.938276+0000","last_peered":"2024-09-13T18:41:01.938276+0000","last_clean":"2024-09-13T18:41:01.938276+0000","last_became_active":"2024-09-13T18:41:00.946212+0000","last_became_peered":"2024-09-13T18:41:00.946212+0000","last_unstale":"2024-09-13T18:41:01.938276+0000","last_undegraded":"2024-09-13T18:41:01.938276+0000","last_fullsized":"2024-09-13T18:41:01.938276+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:36:19.609454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"111'4","reported_seq":15,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493961+0000","last_change":"2024-09-13T18:41:00.536850+0000","last_active":"2024-09-13T18:41:02.493961+0000","last_peered":"2024-09-13T18:41:02.493961+0000","last_clean":"2024-09-13T18:41:02.493961+0000","last_became_active":"2024-09-13T18:41:00.536585+0000","last_became_peered":"2024-09-13T18:41:00.536585+0000","last_unstale":"2024-09-13T18:41:02.493961+0000","last_undegraded":"2024-09-13T18:41:02.493961+0000","last_fullsized":"2024-09-13T18:41:02.493961+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:25:14.916955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493320+0000","last_change":"2024-09-13T18:41:00.945611+0000","last_active":"2024-09-13T18:41:02.493320+0000","last_peered":"2024-09-13T18:41:02.493320+0000","last_clean":"2024-09-13T18:41:02.493320+0000","last_became_active":"2024-09-13T18:41:00.945011+0000","last_became_peered":"2024-09-13T18:41:00.945011+0000","last_unstale":"2024-09-13T18:41:02.493320+0000","last_undegraded":"2024-09-13T18:41:02.493320+0000","last_fullsized":"2024-09-13T18:41:02.493320+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:01.370670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1e","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493420+0000","last_change":"2024-09-13T18:41:00.541103+0000","last_active":"2024-09-13T18:41:02.493420+0000","last_peered":"2024-09-13T18:41:02.493420+0000","last_clean":"2024-09-13T18:41:02.493420+0000","last_became_active":"2024-09-13T18:41:00.540640+0000","last_became_peered":"2024-09-13T18:41:00.540640+0000","last_unstale":"2024-09-13T18:41:02.493420+0000","last_undegraded":"2024-09-13T18:41:02.493420+0000","last_fullsized":"2024-09-13T18:41:02.493420+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:52.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938327+0000","last_change":"2024-09-13T18:41:00.951582+0000","last_active":"2024-09-13T18:41:01.938327+0000","last_peered":"2024-09-13T18:41:01.938327+0000","last_clean":"2024-09-13T18:41:01.938327+0000","last_became_active":"2024-09-13T18:41:00.950878+0000","last_became_peered":"2024-09-13T18:41:00.950878+0000","last_unstale":"2024-09-13T18:41:01.938327+0000","last_undegraded":"2024-09-13T18:41:01.938327+0000","last_fullsized":"2024-09-13T18:41:01.938327+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.063827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1d","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493751+0000","last_change":"2024-09-13T18:41:00.539184+0000","last_active":"2024-09-13T18:41:02.493751+0000","last_peered":"2024-09-13T18:41:02.493751+0000","last_clean":"2024-09-13T18:41:02.493751+0000","last_became_active":"2024-09-13T18:41:00.538938+0000","last_became_peered":"2024-09-13T18:41:00.538938+0000","last_unstale":"2024-09-13T18:41:02.493751+0000","last_undegraded":"2024-09-13T18:41:02.493751+0000","last_fullsized":"2024-09-13T18:41:02.493751+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:21.645383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493555+0000","last_change":"2024-09-13T18:41:00.950270+0000","last_active":"2024-09-13T18:41:02.493555+0000","last_peered":"2024-09-13T18:41:02.493555+0000","last_clean":"2024-09-13T18:41:02.493555+0000","last_became_active":"2024-09-13T18:41:00.947983+0000","last_became_peered":"2024-09-13T18:41:00.947983+0000","last_unstale":"2024-09-13T18:41:02.493555+0000","last_undegraded":"2024-09-13T18:41:02.493555+0000","last_fullsized":"2024-09-13T18:41:02.493555+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:19.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1c","version":"111'2","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.958984+0000","last_change":"2024-09-13T18:41:00.538294+0000","last_active":"2024-09-13T18:41:00.958984+0000","last_peered":"2024-09-13T18:41:00.958984+0000","last_clean":"2024-09-13T18:41:00.958984+0000","last_became_active":"2024-09-13T18:41:00.537941+0000","last_became_peered":"2024-09-13T18:41:00.537941+0000","last_unstale":"2024-09-13T18:41:00.958984+0000","last_undegraded":"2024-09-13T18:41:00.958984+0000","last_fullsized":"2024-09-13T18:41:00.958984+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:20.554006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.937794+0000","last_change":"2024-09-13T18:41:00.952981+0000","last_active":"2024-09-13T18:41:01.937794+0000","last_peered":"2024-09-13T18:41:01.937794+0000","last_clean":"2024-09-13T18:41:01.937794+0000","last_became_active":"2024-09-13T18:41:00.952348+0000","last_became_peered":"2024-09-13T18:41:00.952348+0000","last_unstale":"2024-09-13T18:41:01.937794+0000","last_undegraded":"2024-09-13T18:41:01.937794+0000","last_fullsized":"2024-09-13T18:41:01.937794+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:03:39.658509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1b","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938538+0000","last_change":"2024-09-13T18:41:00.532200+0000","last_active":"2024-09-13T18:41:01.938538+0000","last_peered":"2024-09-13T18:41:01.938538+0000","last_clean":"2024-09-13T18:41:01.938538+0000","last_became_active":"2024-09-13T18:41:00.531987+0000","last_became_peered":"2024-09-13T18:41:00.531987+0000","last_unstale":"2024-09-13T18:41:01.938538+0000","last_undegraded":"2024-09-13T18:41:01.938538+0000","last_fullsized":"2024-09-13T18:41:01.938538+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:55.102407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493213+0000","last_change":"2024-09-13T18:41:00.946673+0000","last_active":"2024-09-13T18:41:02.493213+0000","last_peered":"2024-09-13T18:41:02.493213+0000","last_clean":"2024-09-13T18:41:02.493213+0000","last_became_active":"2024-09-13T18:41:00.946479+0000","last_became_peered":"2024-09-13T18:41:00.946479+0000","last_unstale":"2024-09-13T18:41:02.493213+0000","last_undegraded":"2024-09-13T18:41:02.493213+0000","last_fullsized":"2024-09-13T18:41:02.493213+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:13.748134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.1a","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493166+0000","last_change":"2024-09-13T18:41:00.540811+0000","last_active":"2024-09-13T18:41:02.493166+0000","last_peered":"2024-09-13T18:41:02.493166+0000","last_clean":"2024-09-13T18:41:02.493166+0000","last_became_active":"2024-09-13T18:41:00.540583+0000","last_became_peered":"2024-09-13T18:41:00.540583+0000","last_unstale":"2024-09-13T18:41:02.493166+0000","last_undegraded":"2024-09-13T18:41:02.493166+0000","last_fullsized":"2024-09-13T18:41:02.493166+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:05:45.356556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493282+0000","last_change":"2024-09-13T18:41:00.950514+0000","last_active":"2024-09-13T18:41:02.493282+0000","last_peered":"2024-09-13T18:41:02.493282+0000","last_clean":"2024-09-13T18:41:02.493282+0000","last_became_active":"2024-09-13T18:41:00.948279+0000","last_became_peered":"2024-09-13T18:41:00.948279+0000","last_unstale":"2024-09-13T18:41:02.493282+0000","last_undegraded":"2024-09-13T18:41:02.493282+0000","last_fullsized":"2024-09-13T18:41:02.493282+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:15.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493772+0000","last_change":"2024-09-13T18:41:00.534012+0000","last_active":"2024-09-13T18:41:02.493772+0000","last_peered":"2024-09-13T18:41:02.493772+0000","last_clean":"2024-09-13T18:41:02.493772+0000","last_became_active":"2024-09-13T18:41:00.533777+0000","last_became_peered":"2024-09-13T18:41:00.533777+0000","last_unstale":"2024-09-13T18:41:02.493772+0000","last_undegraded":"2024-09-13T18:41:02.493772+0000","last_fullsized":"2024-09-13T18:41:02.493772+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:50.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493615+0000","last_change":"2024-09-13T18:41:00.945996+0000","last_active":"2024-09-13T18:41:02.493615+0000","last_peered":"2024-09-13T18:41:02.493615+0000","last_clean":"2024-09-13T18:41:02.493615+0000","last_became_active":"2024-09-13T18:41:00.945574+0000","last_became_peered":"2024-09-13T18:41:00.945574+0000","last_unstale":"2024-09-13T18:41:02.493615+0000","last_undegraded":"2024-09-13T18:41:02.493615+0000","last_fullsized":"2024-09-13T18:41:02.493615+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:52:13.858339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493821+0000","last_change":"2024-09-13T18:41:00.541734+0000","last_active":"2024-09-13T18:41:02.493821+0000","last_peered":"2024-09-13T18:41:02.493821+0000","last_clean":"2024-09-13T18:41:02.493821+0000","last_became_active":"2024-09-13T18:41:00.541540+0000","last_became_peered":"2024-09-13T18:41:00.541540+0000","last_unstale":"2024-09-13T18:41:02.493821+0000","last_undegraded":"2024-09-13T18:41:02.493821+0000","last_fullsized":"2024-09-13T18:41:02.493821+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.875712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493761+0000","last_change":"2024-09-13T18:41:00.941188+0000","last_active":"2024-09-13T18:41:02.493761+0000","last_peered":"2024-09-13T18:41:02.493761+0000","last_clean":"2024-09-13T18:41:02.493761+0000","last_became_active":"2024-09-13T18:41:00.940654+0000","last_became_peered":"2024-09-13T18:41:00.940654+0000","last_unstale":"2024-09-13T18:41:02.493761+0000","last_undegraded":"2024-09-13T18:41:02.493761+0000","last_fullsized":"2024-09-13T18:41:02.493761+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:19.062870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493298+0000","last_change":"2024-09-13T18:41:00.537481+0000","last_active":"2024-09-13T18:41:02.493298+0000","last_peered":"2024-09-13T18:41:02.493298+0000","last_clean":"2024-09-13T18:41:02.493298+0000","last_became_active":"2024-09-13T18:41:00.537272+0000","last_became_peered":"2024-09-13T18:41:00.537272+0000","last_unstale":"2024-09-13T18:41:02.493298+0000","last_undegraded":"2024-09-13T18:41:02.493298+0000","last_fullsized":"2024-09-13T18:41:02.493298+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.810518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493210+0000","last_change":"2024-09-13T18:41:00.952132+0000","last_active":"2024-09-13T18:41:02.493210+0000","last_peered":"2024-09-13T18:41:02.493210+0000","last_clean":"2024-09-13T18:41:02.493210+0000","last_became_active":"2024-09-13T18:41:00.951442+0000","last_became_peered":"2024-09-13T18:41:00.951442+0000","last_unstale":"2024-09-13T18:41:02.493210+0000","last_undegraded":"2024-09-13T18:41:02.493210+0000","last_fullsized":"2024-09-13T18:41:02.493210+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:15:39.624390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493751+0000","last_change":"2024-09-13T18:41:00.541841+0000","last_active":"2024-09-13T18:41:02.493751+0000","last_peered":"2024-09-13T18:41:02.493751+0000","last_clean":"2024-09-13T18:41:02.493751+0000","last_became_active":"2024-09-13T18:41:00.541297+0000","last_became_peered":"2024-09-13T18:41:00.541297+0000","last_unstale":"2024-09-13T18:41:02.493751+0000","last_undegraded":"2024-09-13T18:41:02.493751+0000","last_fullsized":"2024-09-13T18:41:02.493751+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:48.895594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493369+0000","last_change":"2024-09-13T18:41:00.949303+0000","last_active":"2024-09-13T18:41:02.493369+0000","last_peered":"2024-09-13T18:41:02.493369+0000","last_clean":"2024-09-13T18:41:02.493369+0000","last_became_active":"2024-09-13T18:41:00.948912+0000","last_became_peered":"2024-09-13T18:41:00.948912+0000","last_unstale":"2024-09-13T18:41:02.493369+0000","last_undegraded":"2024-09-13T18:41:02.493369+0000","last_fullsized":"2024-09-13T18:41:02.493369+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:56.108890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.15","version":"111'3","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493479+0000","last_change":"2024-09-13T18:41:00.536314+0000","last_active":"2024-09-13T18:41:02.493479+0000","last_peered":"2024-09-13T18:41:02.493479+0000","last_clean":"2024-09-13T18:41:02.493479+0000","last_became_active":"2024-09-13T18:41:00.535571+0000","last_became_peered":"2024-09-13T18:41:00.535571+0000","last_unstale":"2024-09-13T18:41:02.493479+0000","last_undegraded":"2024-09-13T18:41:02.493479+0000","last_fullsized":"2024-09-13T18:41:02.493479+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:45:50.535173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493729+0000","last_change":"2024-09-13T18:41:00.949157+0000","last_active":"2024-09-13T18:41:02.493729+0000","last_peered":"2024-09-13T18:41:02.493729+0000","last_clean":"2024-09-13T18:41:02.493729+0000","last_became_active":"2024-09-13T18:41:00.948820+0000","last_became_peered":"2024-09-13T18:41:00.948820+0000","last_unstale":"2024-09-13T18:41:02.493729+0000","last_undegraded":"2024-09-13T18:41:02.493729+0000","last_fullsized":"2024-09-13T18:41:02.493729+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:59:52.931119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.14","version":"111'6","reported_seq":17,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938361+0000","last_change":"2024-09-13T18:41:00.531901+0000","last_active":"2024-09-13T18:41:01.938361+0000","last_peered":"2024-09-13T18:41:01.938361+0000","last_clean":"2024-09-13T18:41:01.938361+0000","last_became_active":"2024-09-13T18:41:00.531656+0000","last_became_peered":"2024-09-13T18:41:00.531656+0000","last_unstale":"2024-09-13T18:41:01.938361+0000","last_undegraded":"2024-09-13T18:41:01.938361+0000","last_fullsized":"2024-09-13T18:41:01.938361+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:59.976390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493306+0000","last_change":"2024-09-13T18:41:00.949054+0000","last_active":"2024-09-13T18:41:02.493306+0000","last_peered":"2024-09-13T18:41:02.493306+0000","last_clean":"2024-09-13T18:41:02.493306+0000","last_became_active":"2024-09-13T18:41:00.948594+0000","last_became_peered":"2024-09-13T18:41:00.948594+0000","last_unstale":"2024-09-13T18:41:02.493306+0000","last_undegraded":"2024-09-13T18:41:02.493306+0000","last_fullsized":"2024-09-13T18:41:02.493306+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:01.366944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.13","version":"111'2","reported_seq":13,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.958744+0000","last_change":"2024-09-13T18:41:00.536964+0000","last_active":"2024-09-13T18:41:00.958744+0000","last_peered":"2024-09-13T18:41:00.958744+0000","last_clean":"2024-09-13T18:41:00.958744+0000","last_became_active":"2024-09-13T18:41:00.536754+0000","last_became_peered":"2024-09-13T18:41:00.536754+0000","last_unstale":"2024-09-13T18:41:00.958744+0000","last_undegraded":"2024-09-13T18:41:00.958744+0000","last_fullsized":"2024-09-13T18:41:00.958744+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:25:50.088507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493426+0000","last_change":"2024-09-13T18:41:00.949845+0000","last_active":"2024-09-13T18:41:02.493426+0000","last_peered":"2024-09-13T18:41:02.493426+0000","last_clean":"2024-09-13T18:41:02.493426+0000","last_became_active":"2024-09-13T18:41:00.947705+0000","last_became_peered":"2024-09-13T18:41:00.947705+0000","last_unstale":"2024-09-13T18:41:02.493426+0000","last_undegraded":"2024-09-13T18:41:02.493426+0000","last_fullsized":"2024-09-13T18:41:02.493426+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:01:13.643620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936617+0000","last_change":"2024-09-13T18:41:00.535485+0000","last_active":"2024-09-13T18:41:01.936617+0000","last_peered":"2024-09-13T18:41:01.936617+0000","last_clean":"2024-09-13T18:41:01.936617+0000","last_became_active":"2024-09-13T18:41:00.535139+0000","last_became_peered":"2024-09-13T18:41:00.535139+0000","last_unstale":"2024-09-13T18:41:01.936617+0000","last_undegraded":"2024-09-13T18:41:01.936617+0000","last_fullsized":"2024-09-13T18:41:01.936617+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:48.895594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494234+0000","last_change":"2024-09-13T18:41:00.943766+0000","last_active":"2024-09-13T18:41:02.494234+0000","last_peered":"2024-09-13T18:41:02.494234+0000","last_clean":"2024-09-13T18:41:02.494234+0000","last_became_active":"2024-09-13T18:41:00.943086+0000","last_became_peered":"2024-09-13T18:41:00.943086+0000","last_unstale":"2024-09-13T18:41:02.494234+0000","last_undegraded":"2024-09-13T18:41:02.494234+0000","last_fullsized":"2024-09-13T18:41:02.494234+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:15.967224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493830+0000","last_change":"2024-09-13T18:41:00.541696+0000","last_active":"2024-09-13T18:41:02.493830+0000","last_peered":"2024-09-13T18:41:02.493830+0000","last_clean":"2024-09-13T18:41:02.493830+0000","last_became_active":"2024-09-13T18:41:00.541048+0000","last_became_peered":"2024-09-13T18:41:00.541048+0000","last_unstale":"2024-09-13T18:41:02.493830+0000","last_undegraded":"2024-09-13T18:41:02.493830+0000","last_fullsized":"2024-09-13T18:41:02.493830+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:18.056386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493226+0000","last_change":"2024-09-13T18:41:00.951311+0000","last_active":"2024-09-13T18:41:02.493226+0000","last_peered":"2024-09-13T18:41:02.493226+0000","last_clean":"2024-09-13T18:41:02.493226+0000","last_became_active":"2024-09-13T18:41:00.951068+0000","last_became_peered":"2024-09-13T18:41:00.951068+0000","last_unstale":"2024-09-13T18:41:02.493226+0000","last_undegraded":"2024-09-13T18:41:02.493226+0000","last_fullsized":"2024-09-13T18:41:02.493226+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:49.902077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.10","version":"111'8","reported_seq":19,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493858+0000","last_change":"2024-09-13T18:41:00.537800+0000","last_active":"2024-09-13T18:41:02.493858+0000","last_peered":"2024-09-13T18:41:02.493858+0000","last_clean":"2024-09-13T18:41:02.493858+0000","last_became_active":"2024-09-13T18:41:00.537358+0000","last_became_peered":"2024-09-13T18:41:00.537358+0000","last_unstale":"2024-09-13T18:41:02.493858+0000","last_undegraded":"2024-09-13T18:41:02.493858+0000","last_fullsized":"2024-09-13T18:41:02.493858+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:11:30.882618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938254+0000","last_change":"2024-09-13T18:41:00.954372+0000","last_active":"2024-09-13T18:41:01.938254+0000","last_peered":"2024-09-13T18:41:01.938254+0000","last_clean":"2024-09-13T18:41:01.938254+0000","last_became_active":"2024-09-13T18:41:00.954163+0000","last_became_peered":"2024-09-13T18:41:00.954163+0000","last_unstale":"2024-09-13T18:41:01.938254+0000","last_undegraded":"2024-09-13T18:41:01.938254+0000","last_fullsized":"2024-09-13T18:41:01.938254+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:43:36.776781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.f","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493701+0000","last_change":"2024-09-13T18:41:00.538288+0000","last_active":"2024-09-13T18:41:02.493701+0000","last_peered":"2024-09-13T18:41:02.493701+0000","last_clean":"2024-09-13T18:41:02.493701+0000","last_became_active":"2024-09-13T18:41:00.538056+0000","last_became_peered":"2024-09-13T18:41:00.538056+0000","last_unstale":"2024-09-13T18:41:02.493701+0000","last_undegraded":"2024-09-13T18:41:02.493701+0000","last_fullsized":"2024-09-13T18:41:02.493701+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:54:13.077816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493256+0000","last_change":"2024-09-13T18:41:00.946017+0000","last_active":"2024-09-13T18:41:02.493256+0000","last_peered":"2024-09-13T18:41:02.493256+0000","last_clean":"2024-09-13T18:41:02.493256+0000","last_became_active":"2024-09-13T18:41:00.945820+0000","last_became_peered":"2024-09-13T18:41:00.945820+0000","last_unstale":"2024-09-13T18:41:02.493256+0000","last_undegraded":"2024-09-13T18:41:02.493256+0000","last_fullsized":"2024-09-13T18:41:02.493256+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:02.409791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.e","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493998+0000","last_change":"2024-09-13T18:41:00.539251+0000","last_active":"2024-09-13T18:41:02.493998+0000","last_peered":"2024-09-13T18:41:02.493998+0000","last_clean":"2024-09-13T18:41:02.493998+0000","last_became_active":"2024-09-13T18:41:00.539013+0000","last_became_peered":"2024-09-13T18:41:00.539013+0000","last_unstale":"2024-09-13T18:41:02.493998+0000","last_undegraded":"2024-09-13T18:41:02.493998+0000","last_fullsized":"2024-09-13T18:41:02.493998+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:22.160950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938396+0000","last_change":"2024-09-13T18:41:00.954851+0000","last_active":"2024-09-13T18:41:01.938396+0000","last_peered":"2024-09-13T18:41:01.938396+0000","last_clean":"2024-09-13T18:41:01.938396+0000","last_became_active":"2024-09-13T18:41:00.954593+0000","last_became_peered":"2024-09-13T18:41:00.954593+0000","last_unstale":"2024-09-13T18:41:01.938396+0000","last_undegraded":"2024-09-13T18:41:01.938396+0000","last_fullsized":"2024-09-13T18:41:01.938396+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:26:45.101360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493958+0000","last_change":"2024-09-13T18:41:00.537590+0000","last_active":"2024-09-13T18:41:02.493958+0000","last_peered":"2024-09-13T18:41:02.493958+0000","last_clean":"2024-09-13T18:41:02.493958+0000","last_became_active":"2024-09-13T18:41:00.537380+0000","last_became_peered":"2024-09-13T18:41:00.537380+0000","last_unstale":"2024-09-13T18:41:02.493958+0000","last_undegraded":"2024-09-13T18:41:02.493958+0000","last_fullsized":"2024-09-13T18:41:02.493958+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:15.947166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936766+0000","last_change":"2024-09-13T18:41:00.946219+0000","last_active":"2024-09-13T18:41:01.936766+0000","last_peered":"2024-09-13T18:41:01.936766+0000","last_clean":"2024-09-13T18:41:01.936766+0000","last_became_active":"2024-09-13T18:41:00.945767+0000","last_became_peered":"2024-09-13T18:41:00.945767+0000","last_unstale":"2024-09-13T18:41:01.936766+0000","last_undegraded":"2024-09-13T18:41:01.936766+0000","last_fullsized":"2024-09-13T18:41:01.936766+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:00:22.282633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.b","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494329+0000","last_change":"2024-09-13T18:41:00.539989+0000","last_active":"2024-09-13T18:41:02.494329+0000","last_peered":"2024-09-13T18:41:02.494329+0000","last_clean":"2024-09-13T18:41:02.494329+0000","last_became_active":"2024-09-13T18:41:00.539722+0000","last_became_peered":"2024-09-13T18:41:00.539722+0000","last_unstale":"2024-09-13T18:41:02.494329+0000","last_undegraded":"2024-09-13T18:41:02.494329+0000","last_fullsized":"2024-09-13T18:41:02.494329+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:18:27.799994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493885+0000","last_change":"2024-09-13T18:41:00.945793+0000","last_active":"2024-09-13T18:41:02.493885+0000","last_peered":"2024-09-13T18:41:02.493885+0000","last_clean":"2024-09-13T18:41:02.493885+0000","last_became_active":"2024-09-13T18:41:00.945407+0000","last_became_peered":"2024-09-13T18:41:00.945407+0000","last_unstale":"2024-09-13T18:41:02.493885+0000","last_undegraded":"2024-09-13T18:41:02.493885+0000","last_fullsized":"2024-09-13T18:41:02.493885+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:11:27.038311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936853+0000","last_change":"2024-09-13T18:41:00.536684+0000","last_active":"2024-09-13T18:41:01.936853+0000","last_peered":"2024-09-13T18:41:01.936853+0000","last_clean":"2024-09-13T18:41:01.936853+0000","last_became_active":"2024-09-13T18:41:00.536405+0000","last_became_peered":"2024-09-13T18:41:00.536405+0000","last_unstale":"2024-09-13T18:41:01.936853+0000","last_undegraded":"2024-09-13T18:41:01.936853+0000","last_fullsized":"2024-09-13T18:41:01.936853+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:52.046616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938139+0000","last_change":"2024-09-13T18:41:00.950905+0000","last_active":"2024-09-13T18:41:01.938139+0000","last_peered":"2024-09-13T18:41:01.938139+0000","last_clean":"2024-09-13T18:41:01.938139+0000","last_became_active":"2024-09-13T18:41:00.949815+0000","last_became_peered":"2024-09-13T18:41:00.949815+0000","last_unstale":"2024-09-13T18:41:01.938139+0000","last_undegraded":"2024-09-13T18:41:01.938139+0000","last_fullsized":"2024-09-13T18:41:01.938139+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:24.208527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493848+0000","last_change":"2024-09-13T18:41:00.542972+0000","last_active":"2024-09-13T18:41:02.493848+0000","last_peered":"2024-09-13T18:41:02.493848+0000","last_clean":"2024-09-13T18:41:02.493848+0000","last_became_active":"2024-09-13T18:41:00.542758+0000","last_became_peered":"2024-09-13T18:41:00.542758+0000","last_unstale":"2024-09-13T18:41:02.493848+0000","last_undegraded":"2024-09-13T18:41:02.493848+0000","last_fullsized":"2024-09-13T18:41:02.493848+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:58:45.192549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938366+0000","last_change":"2024-09-13T18:41:00.950665+0000","last_active":"2024-09-13T18:41:01.938366+0000","last_peered":"2024-09-13T18:41:01.938366+0000","last_clean":"2024-09-13T18:41:01.938366+0000","last_became_active":"2024-09-13T18:41:00.950465+0000","last_became_peered":"2024-09-13T18:41:00.950465+0000","last_unstale":"2024-09-13T18:41:01.938366+0000","last_undegraded":"2024-09-13T18:41:01.938366+0000","last_fullsized":"2024-09-13T18:41:01.938366+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:50.971303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494055+0000","last_change":"2024-09-13T18:41:00.537485+0000","last_active":"2024-09-13T18:41:02.494055+0000","last_peered":"2024-09-13T18:41:02.494055+0000","last_clean":"2024-09-13T18:41:02.494055+0000","last_became_active":"2024-09-13T18:41:00.537245+0000","last_became_peered":"2024-09-13T18:41:00.537245+0000","last_unstale":"2024-09-13T18:41:02.494055+0000","last_undegraded":"2024-09-13T18:41:02.494055+0000","last_fullsized":"2024-09-13T18:41:02.494055+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:03:10.975646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493806+0000","last_change":"2024-09-13T18:41:00.949016+0000","last_active":"2024-09-13T18:41:02.493806+0000","last_peered":"2024-09-13T18:41:02.493806+0000","last_clean":"2024-09-13T18:41:02.493806+0000","last_became_active":"2024-09-13T18:41:00.948492+0000","last_became_peered":"2024-09-13T18:41:00.948492+0000","last_unstale":"2024-09-13T18:41:02.493806+0000","last_undegraded":"2024-09-13T18:41:02.493806+0000","last_fullsized":"2024-09-13T18:41:02.493806+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:02:51.227341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.7","version":"111'2","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494056+0000","last_change":"2024-09-13T18:41:00.542496+0000","last_active":"2024-09-13T18:41:02.494056+0000","last_peered":"2024-09-13T18:41:02.494056+0000","last_clean":"2024-09-13T18:41:02.494056+0000","last_became_active":"2024-09-13T18:41:00.542266+0000","last_became_peered":"2024-09-13T18:41:00.542266+0000","last_unstale":"2024-09-13T18:41:02.494056+0000","last_undegraded":"2024-09-13T18:41:02.494056+0000","last_fullsized":"2024-09-13T18:41:02.494056+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:05:20.810518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493784+0000","last_change":"2024-09-13T18:41:00.945927+0000","last_active":"2024-09-13T18:41:02.493784+0000","last_peered":"2024-09-13T18:41:02.493784+0000","last_clean":"2024-09-13T18:41:02.493784+0000","last_became_active":"2024-09-13T18:41:00.945691+0000","last_became_peered":"2024-09-13T18:41:00.945691+0000","last_unstale":"2024-09-13T18:41:02.493784+0000","last_undegraded":"2024-09-13T18:41:02.493784+0000","last_fullsized":"2024-09-13T18:41:02.493784+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:12:27.944096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.494014+0000","last_change":"2024-09-13T18:41:00.537616+0000","last_active":"2024-09-13T18:41:02.494014+0000","last_peered":"2024-09-13T18:41:02.494014+0000","last_clean":"2024-09-13T18:41:02.494014+0000","last_became_active":"2024-09-13T18:41:00.537001+0000","last_became_peered":"2024-09-13T18:41:00.537001+0000","last_unstale":"2024-09-13T18:41:02.494014+0000","last_undegraded":"2024-09-13T18:41:02.494014+0000","last_fullsized":"2024-09-13T18:41:02.494014+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:03.753097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493606+0000","last_change":"2024-09-13T18:41:00.949474+0000","last_active":"2024-09-13T18:41:02.493606+0000","last_peered":"2024-09-13T18:41:02.493606+0000","last_clean":"2024-09-13T18:41:02.493606+0000","last_became_active":"2024-09-13T18:41:00.949257+0000","last_became_peered":"2024-09-13T18:41:00.949257+0000","last_unstale":"2024-09-13T18:41:02.493606+0000","last_undegraded":"2024-09-13T18:41:02.493606+0000","last_fullsized":"2024-09-13T18:41:02.493606+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:41.148144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938422+0000","last_change":"2024-09-13T18:41:00.535427+0000","last_active":"2024-09-13T18:41:01.938422+0000","last_peered":"2024-09-13T18:41:01.938422+0000","last_clean":"2024-09-13T18:41:01.938422+0000","last_became_active":"2024-09-13T18:41:00.535222+0000","last_became_peered":"2024-09-13T18:41:00.535222+0000","last_unstale":"2024-09-13T18:41:01.938422+0000","last_undegraded":"2024-09-13T18:41:01.938422+0000","last_fullsized":"2024-09-13T18:41:01.938422+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:53:00.360461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493338+0000","last_change":"2024-09-13T18:41:00.939932+0000","last_active":"2024-09-13T18:41:02.493338+0000","last_peered":"2024-09-13T18:41:02.493338+0000","last_clean":"2024-09-13T18:41:02.493338+0000","last_became_active":"2024-09-13T18:41:00.939723+0000","last_became_peered":"2024-09-13T18:41:00.939723+0000","last_unstale":"2024-09-13T18:41:02.493338+0000","last_undegraded":"2024-09-13T18:41:02.493338+0000","last_fullsized":"2024-09-13T18:41:02.493338+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:19:21.791718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493917+0000","last_change":"2024-09-13T18:41:00.541712+0000","last_active":"2024-09-13T18:41:02.493917+0000","last_peered":"2024-09-13T18:41:02.493917+0000","last_clean":"2024-09-13T18:41:02.493917+0000","last_became_active":"2024-09-13T18:41:00.541380+0000","last_became_peered":"2024-09-13T18:41:00.541380+0000","last_unstale":"2024-09-13T18:41:02.493917+0000","last_undegraded":"2024-09-13T18:41:02.493917+0000","last_fullsized":"2024-09-13T18:41:02.493917+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493232+0000","last_change":"2024-09-13T18:41:00.941977+0000","last_active":"2024-09-13T18:41:02.493232+0000","last_peered":"2024-09-13T18:41:02.493232+0000","last_clean":"2024-09-13T18:41:02.493232+0000","last_became_active":"2024-09-13T18:41:00.941752+0000","last_became_peered":"2024-09-13T18:41:00.941752+0000","last_unstale":"2024-09-13T18:41:02.493232+0000","last_undegraded":"2024-09-13T18:41:02.493232+0000","last_fullsized":"2024-09-13T18:41:02.493232+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:49:53.053099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.936693+0000","last_change":"2024-09-13T18:41:00.543471+0000","last_active":"2024-09-13T18:41:01.936693+0000","last_peered":"2024-09-13T18:41:01.936693+0000","last_clean":"2024-09-13T18:41:01.936693+0000","last_became_active":"2024-09-13T18:41:00.543197+0000","last_became_peered":"2024-09-13T18:41:00.543197+0000","last_unstale":"2024-09-13T18:41:01.936693+0000","last_undegraded":"2024-09-13T18:41:01.936693+0000","last_fullsized":"2024-09-13T18:41:01.936693+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.602978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493445+0000","last_change":"2024-09-13T18:41:00.948863+0000","last_active":"2024-09-13T18:41:02.493445+0000","last_peered":"2024-09-13T18:41:02.493445+0000","last_clean":"2024-09-13T18:41:02.493445+0000","last_became_active":"2024-09-13T18:41:00.946805+0000","last_became_peered":"2024-09-13T18:41:00.946805+0000","last_unstale":"2024-09-13T18:41:02.493445+0000","last_undegraded":"2024-09-13T18:41:02.493445+0000","last_fullsized":"2024-09-13T18:41:02.493445+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:24.398125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493902+0000","last_change":"2024-09-13T18:41:00.541560+0000","last_active":"2024-09-13T18:41:02.493902+0000","last_peered":"2024-09-13T18:41:02.493902+0000","last_clean":"2024-09-13T18:41:02.493902+0000","last_became_active":"2024-09-13T18:41:00.540805+0000","last_became_peered":"2024-09-13T18:41:00.540805+0000","last_unstale":"2024-09-13T18:41:02.493902+0000","last_undegraded":"2024-09-13T18:41:02.493902+0000","last_fullsized":"2024-09-13T18:41:02.493902+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:04.492806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.492952+0000","last_change":"2024-09-13T18:41:00.940646+0000","last_active":"2024-09-13T18:41:02.492952+0000","last_peered":"2024-09-13T18:41:02.492952+0000","last_clean":"2024-09-13T18:41:02.492952+0000","last_became_active":"2024-09-13T18:41:00.939807+0000","last_became_peered":"2024-09-13T18:41:00.939807+0000","last_unstale":"2024-09-13T18:41:02.492952+0000","last_undegraded":"2024-09-13T18:41:02.492952+0000","last_fullsized":"2024-09-13T18:41:02.492952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:22.651866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493548+0000","last_change":"2024-09-13T18:41:00.535784+0000","last_active":"2024-09-13T18:41:02.493548+0000","last_peered":"2024-09-13T18:41:02.493548+0000","last_clean":"2024-09-13T18:41:02.493548+0000","last_became_active":"2024-09-13T18:41:00.535274+0000","last_became_peered":"2024-09-13T18:41:00.535274+0000","last_unstale":"2024-09-13T18:41:02.493548+0000","last_undegraded":"2024-09-13T18:41:02.493548+0000","last_fullsized":"2024-09-13T18:41:02.493548+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:41:42.875712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493400+0000","last_change":"2024-09-13T18:41:00.940674+0000","last_active":"2024-09-13T18:41:02.493400+0000","last_peered":"2024-09-13T18:41:02.493400+0000","last_clean":"2024-09-13T18:41:02.493400+0000","last_became_active":"2024-09-13T18:41:00.940455+0000","last_became_peered":"2024-09-13T18:41:00.940455+0000","last_unstale":"2024-09-13T18:41:02.493400+0000","last_undegraded":"2024-09-13T18:41:02.493400+0000","last_fullsized":"2024-09-13T18:41:02.493400+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:46:05.499289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:01.938463+0000","last_change":"2024-09-13T18:41:00.538446+0000","last_active":"2024-09-13T18:41:01.938463+0000","last_peered":"2024-09-13T18:41:01.938463+0000","last_clean":"2024-09-13T18:41:01.938463+0000","last_became_active":"2024-09-13T18:41:00.538186+0000","last_became_peered":"2024-09-13T18:41:00.538186+0000","last_unstale":"2024-09-13T18:41:01.938463+0000","last_undegraded":"2024-09-13T18:41:01.938463+0000","last_fullsized":"2024-09-13T18:41:01.938463+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:51.384875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493352+0000","last_change":"2024-09-13T18:41:00.948977+0000","last_active":"2024-09-13T18:41:02.493352+0000","last_peered":"2024-09-13T18:41:02.493352+0000","last_clean":"2024-09-13T18:41:02.493352+0000","last_became_active":"2024-09-13T18:41:00.948731+0000","last_became_peered":"2024-09-13T18:41:00.948731+0000","last_unstale":"2024-09-13T18:41:02.493352+0000","last_undegraded":"2024-09-13T18:41:02.493352+0000","last_fullsized":"2024-09-13T18:41:02.493352+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:00.517243+0000","last_clean_scrub_stamp":"2024-09-13T18:41:00.517243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:57:52.391358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.d","version":"111'1","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-13T18:41:02.493691+0000","last_change":"2024-09-13T18:41:00.540527+0000","last_active":"2024-09-13T18:41:02.493691+0000","last_peered":"2024-09-13T18:41:02.493691+0000","last_clean":"2024-09-13T18:41:02.493691+0000","last_became_active":"2024-09-13T18:41:00.540248+0000","last_became_peered":"2024-09-13T18:41:00.540248+0000","last_unstale":"2024-09-13T18:41:02.493691+0000","last_undegraded":"2024-09-13T18:41:02.493691+0000","last_fullsized":"2024-09-13T18:41:02.493691+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":109,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:40:59.510759+0000","last_clean_scrub_stamp":"2024-09-13T18:40:59.510759+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:26:45.204976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":249,"reported_epoch":111,"state":"active+clean","last_fresh":"2024-09-13T18:41:00.936910+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:41:00.936910+0000","last_peered":"2024-09-13T18:41:00.936910+0000","last_clean":"2024-09-13T18:41:00.936910+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:41:00.936910+0000","last_undegraded":"2024-09-13T18:41:00.936910+0000","last_fullsized":"2024-09-13T18:41:00.936910+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542215,"num_pgs":14,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1177,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194135,"statfs":{"total":200000000,"available":198794298,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.64700000000000002,"15min":0.625},"min":{"1min":0.46700000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.84499999999999997,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67400000000000004,"15min":0.63},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.47899999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.86499999999999999,"5min":1.054,"15min":1.054},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.48199999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.51100000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83799999999999997,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.52400000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.88700000000000001,"5min":0.999,"15min":0.999},"last":0.56999999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.753,"15min":0.85099999999999998},"min":{"1min":0.56699999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.93400000000000005,"5min":6.1040000000000001,"15min":6.1040000000000001},"last":0.628},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.749,"15min":0.86099999999999999},"min":{"1min":0.54800000000000004,"5min":0.44,"15min":0.44},"max":{"1min":0.81200000000000006,"5min":6.0890000000000004,"15min":6.0890000000000004},"last":0.69499999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.56100000000000005,"15min":0.56699999999999995},"min":{"1min":0.36699999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.79800000000000004,"5min":1.036,"15min":1.036},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.60699999999999998,"15min":0.61299999999999999},"min":{"1min":0.40899999999999997,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.94699999999999995,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.46700000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65700000000000003,"15min":0.64000000000000001},"min":{"1min":0.39100000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.90100000000000002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.69599999999999995,"15min":0.71799999999999997},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.83299999999999996,"5min":1.371,"15min":1.371},"last":0.61299999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:40:37 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.67800000000000005,"15min":0.66500000000000004},"min":{"1min":0.46000000000000002,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0349999999999999,"5min":1.143,"15min":1.143},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.68100000000000005,"15min":0.67700000000000005},"min":{"1min":0.42699999999999999,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.997,"5min":1.125,"15min":1.125},"last":0.501}]}]},{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386194,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.68899999999999995,"15min":0.64000000000000001},"min":{"1min":0.38800000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92600000000000005,"5min":1.665,"15min":1.665},"last":0.93100000000000005},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.66500000000000004,"15min":0.63200000000000001},"min":{"1min":0.49299999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.873,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.77300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.69599999999999995,"15min":0.64300000000000002},"min":{"1min":0.51600000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.85799999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67100000000000004,"15min":0.64500000000000002},"min":{"1min":0.47599999999999998,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91500000000000004,"5min":1.591,"15min":1.591},"last":0.748}]},{"osd":2,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72999999999999998,"15min":0.67800000000000005},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83699999999999997,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.51100000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.91500000000000004,"5min":2.169,"15min":2.169},"last":0.82899999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.71699999999999997,"15min":0.66600000000000004},"min":{"1min":0.52700000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.93000000000000005,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67400000000000004,"15min":0.64200000000000002},"min":{"1min":0.48399999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.878,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.81100000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57399999999999995,"15min":0.58999999999999997},"min":{"1min":0.41499999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.624,"15min":0.64800000000000002},"min":{"1min":0.48099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.89200000000000002,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68600000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69299999999999995,"15min":0.67300000000000004},"min":{"1min":0.52200000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95599999999999996,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64800000000000002,"15min":0.64900000000000002},"min":{"1min":0.47699999999999998,"5min":0.372,"15min":0.372},"max":{"1min":0.90500000000000003,"5min":1.115,"15min":1.115},"last":0.59499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:40:36 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.70099999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.94599999999999995,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.73199999999999998,"15min":0.73299999999999998},"min":{"1min":0.54900000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.97699999999999998,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.90500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194712,"statfs":{"total":200000000,"available":199385592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.73799999999999999,"15min":0.83599999999999997},"min":{"1min":0.443,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97999999999999998,"5min":6.4539999999999997,"15min":6.4539999999999997},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.65600000000000003,"15min":0.63300000000000001},"min":{"1min":0.41099999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94599999999999995,"5min":0.999,"15min":0.999},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.74099999999999999,"15min":0.85899999999999999},"min":{"1min":0.45400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.92700000000000005,"5min":6.3890000000000002,"15min":6.3890000000000002},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.73099999999999998,"15min":0.84099999999999997},"min":{"1min":0.48599999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94299999999999995,"5min":6.5019999999999998,"15min":6.5019999999999998},"last":0.73799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.64400000000000002},"min":{"1min":0.48199999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.95999999999999996,"5min":1.032,"15min":1.032},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.753,"15min":0.89300000000000002},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.90500000000000003,"5min":6.3310000000000004,"15min":6.3310000000000004},"last":0.75900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.752,"15min":0.83099999999999996},"min":{"1min":0.45000000000000001,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.004,"5min":6.2039999999999997,"15min":6.2039999999999997},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.65100000000000002},"min":{"1min":0.53900000000000003,"5min":0.44,"15min":0.44},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.64600000000000002,"15min":0.624},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.69099999999999995,"15min":0.68500000000000005},"min":{"1min":0.38800000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91000000000000003,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70799999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.624,"15min":0.59799999999999998},"min":{"1min":0.39800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.79200000000000004,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.64700000000000002,"15min":0.61899999999999999},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84299999999999997,"5min":1.403,"15min":1.403},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:40:34 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.68999999999999995,"15min":0.67800000000000005},"min":{"1min":0.45300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.84499999999999997,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.72099999999999997,"15min":0.68700000000000006},"min":{"1min":0.51300000000000001,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.871,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.875}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386230,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.435,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.92400000000000004,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.69199999999999995,"15min":0.64700000000000002},"min":{"1min":0.55600000000000005,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86599999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.67500000000000004},"min":{"1min":0.52900000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.91800000000000004,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71599999999999997,"15min":0.68500000000000005},"min":{"1min":0.46600000000000003,"5min":0.436,"15min":0.436},"max":{"1min":0.91600000000000004,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.53200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.745,"15min":0.69999999999999996},"min":{"1min":0.498,"5min":0.497,"15min":0.497},"max":{"1min":0.90500000000000003,"5min":3.706,"15min":3.706},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.73599999999999999,"15min":0.68200000000000005},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.93899999999999995,"5min":3.742,"15min":3.742},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.753,"15min":0.70899999999999996},"min":{"1min":0.47599999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.872,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71599999999999997,"15min":0.66900000000000004},"min":{"1min":0.51100000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.90800000000000003,"5min":1.552,"15min":1.552},"last":0.67900000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61799999999999999,"15min":0.60399999999999998},"min":{"1min":0.372,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.89100000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.81000000000000005,"15min":0.72999999999999998},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96799999999999997,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.71699999999999997,"15min":0.68799999999999994},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92400000000000004,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.67000000000000004,"15min":0.60999999999999999},"min":{"1min":0.47699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.88100000000000001,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.72099999999999997,"15min":0.68700000000000006},"min":{"1min":0.501,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.94499999999999995,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.66600000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194712,"statfs":{"total":200000000,"available":199385590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.42299999999999999,"15min":0.44700000000000001},"min":{"1min":0.28399999999999997,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.623,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.25600000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.66300000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46999999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.56000000000000005,"15min":0.77800000000000002},"min":{"1min":0.29099999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.73499999999999999,"5min":8.1059999999999999,"15min":8.1059999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.73099999999999998,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55100000000000005,"15min":0.62},"min":{"1min":0.39800000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.76600000000000001,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.504,"5min":0.56399999999999995,"15min":0.72499999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.73499999999999999,"5min":7.798,"15min":7.798},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.79400000000000004,"15min":0.80700000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.048,"5min":3.093,"15min":3.093},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.76500000000000001,"15min":0.74099999999999999},"min":{"1min":0.53300000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2869999999999999,"5min":1.4039999999999999,"15min":1.4039999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79600000000000004,"15min":0.80700000000000005},"min":{"1min":0.56000000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1519999999999999,"5min":3.0299999999999998,"15min":3.0299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76200000000000001,"15min":0.72199999999999998},"min":{"1min":0.55800000000000005,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.77000000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.85799999999999998,"15min":1.004},"min":{"1min":0.58899999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2649999999999999,"5min":7.9199999999999999,"15min":7.9199999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.80200000000000005,"15min":0.93400000000000005},"min":{"1min":0.51500000000000001,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.2430000000000001,"5min":8.0519999999999996,"15min":8.0519999999999996},"last":0.75}]},{"osd":7,"last update":"Fri Sep 13 18:40:47 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.76000000000000001,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.206,"5min":1.206,"15min":1.206},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82299999999999995,"15min":0.85499999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.218,"5min":2.9900000000000002,"15min":2.9900000000000002},"last":0.82899999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":599,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194713,"statfs":{"total":200000000,"available":199386264,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.255,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.67500000000000004,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.45200000000000001,"15min":0.45600000000000002},"min":{"1min":0.29799999999999999,"5min":0.253,"15min":0.253},"max":{"1min":0.74299999999999999,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.29899999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.39500000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.59699999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.45500000000000002,"15min":0.48499999999999999},"min":{"1min":0.33100000000000002,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.57199999999999995,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.34999999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.496,"15min":0.51100000000000001},"min":{"1min":0.33900000000000002,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.61799999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.57799999999999996},"min":{"1min":0.47899999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.68200000000000005,"5min":1.7030000000000001,"15min":1.7030000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.73399999999999999,"15min":0.71799999999999997},"min":{"1min":0.53500000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.075,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72499999999999998,"15min":0.70299999999999996},"min":{"1min":0.51800000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.93700000000000006,"5min":1.02,"15min":1.02},"last":0.505}]},{"osd":5,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.78600000000000003,"15min":0.76400000000000001},"min":{"1min":0.58399999999999996,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.76500000000000001,"15min":0.72399999999999998},"min":{"1min":0.53000000000000003,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.02,"5min":1.079,"15min":1.079},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.749,"15min":0.72699999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.0409999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.73099999999999998,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.98099999999999998,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.72999999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:40:40 2024","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.74399999999999999},"min":{"1min":0.621,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.097,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.79800000000000004,"15min":0.77200000000000002},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.55900000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1175,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194136,"statfs":{"total":200000000,"available":198795806,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.45100000000000001,"15min":0.438},"min":{"1min":0.374,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.71999999999999997,"5min":1.6000000000000001,"15min":1.6000000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.48399999999999999,"15min":0.47899999999999998},"min":{"1min":0.32500000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.47299999999999998,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.78400000000000003,"5min":1.036,"15min":1.036},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.51700000000000002,"15min":0.47799999999999998},"min":{"1min":0.44900000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.52800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.55700000000000005,"15min":0.51500000000000001},"min":{"1min":0.504,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.51900000000000002,"15min":0.50800000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.93600000000000005,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.46899999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.78900000000000003,"15min":0.76000000000000001},"min":{"1min":0.66000000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.747},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.78400000000000003,"15min":0.76600000000000001},"min":{"1min":0.59599999999999997,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.66500000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.76300000000000001,"15min":0.73299999999999998},"min":{"1min":0.69199999999999995,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.73799999999999999,"15min":0.71699999999999997},"min":{"1min":0.504,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.242,"5min":1.242,"15min":1.242},"last":0.70099999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.79600000000000004,"15min":0.78100000000000003},"min":{"1min":0.59599999999999997,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.81399999999999995,"15min":0.77800000000000002},"min":{"1min":0.58199999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:40:35 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":0.78000000000000003,"15min":0.77000000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.149,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.65100000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":600,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194711,"statfs":{"total":200000000,"available":199384678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.437,"15min":0.46200000000000002},"min":{"1min":0.29199999999999998,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.60799999999999998,"5min":1.669,"15min":1.669},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.27900000000000003,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.67200000000000004,"5min":0.874,"15min":0.874},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.48899999999999999,"15min":0.50800000000000001},"min":{"1min":0.33000000000000002,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.76600000000000001,"5min":1.591,"15min":1.591},"last":0.374},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.47799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.72099999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.47199999999999998,"15min":0.46100000000000002},"min":{"1min":0.318,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":1.03,"15min":1.03},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.35899999999999999,"5min":0.315,"15min":0.315},"max":{"1min":0.85899999999999999,"5min":1.637,"15min":1.637},"last":0.499}]},{"osd":4,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.72399999999999998,"15min":0.69899999999999995},"min":{"1min":0.53600000000000003,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.97099999999999997,"5min":1.2,"15min":1.2},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71399999999999997,"15min":0.70499999999999996},"min":{"1min":0.48899999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.006,"5min":1.698,"15min":1.698},"last":0.82599999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:40:42 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.73799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.1120000000000001,"5min":1.204,"15min":1.204},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77400000000000002,"15min":0.78400000000000003},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.121,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.085}]},{"osd":6,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.746,"15min":0.75600000000000001},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1519999999999999,"5min":2.3010000000000002,"15min":2.3010000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.74099999999999999,"15min":0.70699999999999996},"min":{"1min":0.52700000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.91100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:40:39 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.749,"15min":0.76300000000000001},"min":{"1min":0.54300000000000004,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.0780000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":1.044},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72899999999999998,"15min":0.68700000000000006},"min":{"1min":0.52200000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0349999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.95599999999999996}]}]}],"pool_statfs":[]}} 2024-09-13T18:41:05.478 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:41:05.478 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:41:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.669+0000 7f7e3a000640 1 Processor -- start 2024-09-13T18:41:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.670+0000 7f7e3a000640 1 -- start start 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e3a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 0x7f7e340b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e3a000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e3415a5f0 0x7f7e340b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e3a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3415af60 con 0x7f7e3406bc30 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e3a000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3415aaa0 con 0x7f7e3415a5f0 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e3a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3406b7a0 con 0x7f7e34159b00 2024-09-13T18:41:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e33e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7e3406bc30 0x7f7e34159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45642/0 (socket says 172.21.15.192:45642) 2024-09-13T18:41:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e33e00640 1 -- 172.21.15.192:0/766049131 learned_addr learned my addr 172.21.15.192:0/766049131 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e38c00640 1 --2- 172.21.15.192:0/766049131 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 0x7f7e340b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.671+0000 7f7e39600640 1 --2- 172.21.15.192:0/766049131 >> v2:172.21.15.194:3300/0 conn(0x7f7e3415a5f0 0x7f7e340b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.672+0000 7f7e38c00640 1 -- 172.21.15.192:0/766049131 >> v2:172.21.15.194:3300/0 conn(0x7f7e3415a5f0 msgr2=0x7f7e340b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.672+0000 7f7e38c00640 1 --2- 172.21.15.192:0/766049131 >> v2:172.21.15.194:3300/0 conn(0x7f7e3415a5f0 0x7f7e340b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.672+0000 7f7e38c00640 1 -- 172.21.15.192:0/766049131 >> v1:172.21.15.192:6789/0 conn(0x7f7e3406bc30 legacy=0x7f7e34159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.672+0000 7f7e33400640 1 -- 172.21.15.192:0/766049131 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3812418112 0 0) 0x7f7e3415af60 con 0x7f7e3406bc30 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.672+0000 7f7e38c00640 1 -- 172.21.15.192:0/766049131 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3415ac80 con 0x7f7e34159b00 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.673+0000 7f7e38c00640 1 --2- 172.21.15.192:0/766049131 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 0x7f7e340b2d70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e240097a0 tx=0x7f7e2402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ff5109cc45e422 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.673+0000 7f7e33400640 1 -- 172.21.15.192:0/766049131 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24032440 con 0x7f7e34159b00 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.673+0000 7f7e33400640 1 -- 172.21.15.192:0/766049131 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e240325a0 con 0x7f7e34159b00 2024-09-13T18:41:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.673+0000 7f7e33400640 1 -- 172.21.15.192:0/766049131 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24032930 con 0x7f7e34159b00 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 -- 172.21.15.192:0/766049131 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 msgr2=0x7f7e340b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 --2- 172.21.15.192:0/766049131 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 0x7f7e340b2d70 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7e240097a0 tx=0x7f7e2402a180 comp rx=0 tx=0).stop 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 -- 172.21.15.192:0/766049131 shutdown_connections 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 --2- 172.21.15.192:0/766049131 >> v2:172.21.15.194:3300/0 conn(0x7f7e3415a5f0 0x7f7e340b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 --2- 172.21.15.192:0/766049131 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e34159b00 0x7f7e340b2d70 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 -- 172.21.15.192:0/766049131 >> 172.21.15.192:0/766049131 conn(0x7f7e340736d0 msgr2=0x7f7e340b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 -- 172.21.15.192:0/766049131 shutdown_connections 2024-09-13T18:41:05.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.674+0000 7f7e3a000640 1 -- 172.21.15.192:0/766049131 wait complete. 2024-09-13T18:41:05.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.675+0000 7f7e3a000640 1 Processor -- start 2024-09-13T18:41:05.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.675+0000 7f7e3a000640 1 -- start start 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e34159b00 0x7f7e34154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e3415a5f0 0x7f7e34155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e34154d30 con 0x7f7e3406bc30 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3415cb00 con 0x7f7e34159b00 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e3a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3415bef0 con 0x7f7e3415a5f0 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.676+0000 7f7e38c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35986/0 (socket says 172.21.15.192:35986) 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 -- 172.21.15.192:0/1483642539 learned_addr learned my addr 172.21.15.192:0/1483642539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e33e00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e34159b00 0x7f7e34154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e39600640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e3415a5f0 0x7f7e34155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 -- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e3415a5f0 msgr2=0x7f7e34155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e3415a5f0 0x7f7e34155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 -- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e34159b00 msgr2=0x7f7e34154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e34159b00 0x7f7e34154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 -- 172.21.15.192:0/1483642539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24009400 con 0x7f7e3406bc30 2024-09-13T18:41:05.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.677+0000 7f7e38c00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.678+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24032440 con 0x7f7e3406bc30 2024-09-13T18:41:05.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.678+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e24004230 con 0x7f7e3406bc30 2024-09-13T18:41:05.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.678+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24006e10 con 0x7f7e3406bc30 2024-09-13T18:41:05.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.678+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3415c1d0 con 0x7f7e3406bc30 2024-09-13T18:41:05.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.678+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3415c790 con 0x7f7e3406bc30 2024-09-13T18:41:05.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.679+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3415c950 con 0x7f7e3406bc30 2024-09-13T18:41:05.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.680+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e24039050 con 0x7f7e3406bc30 2024-09-13T18:41:05.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.680+0000 7f7e30c00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 0x7f7e1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:05.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.681+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e240a9b20 con 0x7f7e3406bc30 2024-09-13T18:41:05.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.681+0000 7f7e33e00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 0x7f7e1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:05.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.681+0000 7f7e33e00640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 0x7f7e1406d0c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7e340ca030 tx=0x7f7e20007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:05.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.685+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e24074f40 con 0x7f7e3406bc30 2024-09-13T18:41:05.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.915+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7e34159ee0 con 0x7f7e3406bc30 2024-09-13T18:41:05.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.919+0000 7f7e30c00640 1 -- 172.21.15.192:0/1483642539 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7e2404b020 con 0x7f7e3406bc30 2024-09-13T18:41:05.922 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 msgr2=0x7f7e1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 0x7f7e1406d0c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f7e340ca030 tx=0x7f7e20007d50 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 msgr2=0x7f7e341547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7e24000c00 tx=0x7f7e240046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 shutdown_connections 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e1406ac00 0x7f7e1406d0c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e3415a5f0 0x7f7e34155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e34159b00 0x7f7e34154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 --2- 172.21.15.192:0/1483642539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e3406bc30 0x7f7e341547f0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 >> 172.21.15.192:0/1483642539 conn(0x7f7e340736d0 msgr2=0x7f7e340cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 shutdown_connections 2024-09-13T18:41:05.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:05.922+0000 7f7e3a000640 1 -- 172.21.15.192:0/1483642539 wait complete. 2024-09-13T18:41:05.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:06.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.091+0000 7fd525000640 1 Processor -- start 2024-09-13T18:41:06.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.092+0000 7fd525000640 1 -- start start 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd525000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200b3480 0x7fd520159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd525000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52015af60 con 0x7fd52006bc30 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd525000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd52006b7a0 con 0x7fd520159b00 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd525000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52015ac80 con 0x7fd5200b3480 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd51fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd52006bc30 0x7fd52015a420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45656/0 (socket says 172.21.15.192:45656) 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd51fe00640 1 -- 172.21.15.192:0/2820598255 learned_addr learned my addr 172.21.15.192:0/2820598255 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:06.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.093+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200b3480 0x7fd520159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4110257625 0 0) 0x7fd52015af60 con 0x7fd52006bc30 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd504003520 con 0x7fd52006bc30 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098444544 0 0) 0x7fd52006b7a0 con 0x7fd520159b00 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd52015af60 con 0x7fd520159b00 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922980496 0 0) 0x7fd504003520 con 0x7fd52006bc30 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200b3480 msgr2=0x7fd520159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200b3480 0x7fd520159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 >> v1:172.21.15.194:6789/0 conn(0x7fd520159b00 legacy=0x7fd5200b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52006b150 con 0x7fd52006bc30 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fd518001670 con 0x7fd52006bc30 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 >> v1:172.21.15.192:6789/0 conn(0x7fd52006bc30 legacy=0x7fd52015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd504003b30 0x7fd504003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040047c0 0x7fd504004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504005180 0x7fd50400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52015ac80 con 0x7fd5040047c0 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50400e180 con 0x7fd504003b30 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040059d0 con 0x7fd504005180 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200b3480 0x7fd520159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51f400640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd504003b30 0x7fd504003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51fe00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504005180 0x7fd50400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.094+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040047c0 0x7fd504004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51ea00640 1 -- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504005180 msgr2=0x7fd50400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504005180 0x7fd50400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51ea00640 1 -- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd504003b30 msgr2=0x7fd504003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd504003b30 0x7fd504003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51ea00640 1 -- 172.21.15.192:0/2820598255 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd504003520 con 0x7fd5040047c0 2024-09-13T18:41:06.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.095+0000 7fd51fe00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd504005180 0x7fd50400db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:06.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.096+0000 7fd51ea00640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040047c0 0x7fd504004c40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cca90 tx=0x7fd5040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48a3b34cc689f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.096+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c004030 con 0x7fd5040047c0 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.096+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c02d050 con 0x7fd5040047c0 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.096+0000 7fd51e000640 1 -- 172.21.15.192:0/2820598255 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0043b0 con 0x7fd5040047c0 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 -- 172.21.15.192:0/2820598255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040047c0 msgr2=0x7fd504004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 --2- 172.21.15.192:0/2820598255 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5040047c0 0x7fd504004c40 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fd5200cca90 tx=0x7fd5040057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd51fe00640 1 -- 172.21.15.192:0/2820598255 reap_dead start 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 -- 172.21.15.192:0/2820598255 shutdown_connections 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 -- 172.21.15.192:0/2820598255 >> 172.21.15.192:0/2820598255 conn(0x7fd5200736d0 msgr2=0x7fd5200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 -- 172.21.15.192:0/2820598255 shutdown_connections 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.097+0000 7fd525000640 1 -- 172.21.15.192:0/2820598255 wait complete. 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.098+0000 7fd525000640 1 Processor -- start 2024-09-13T18:41:06.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.098+0000 7fd525000640 1 -- start start 2024-09-13T18:41:06.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040047c0 0x7fd5201455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200a9890 0x7fd5200a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52006fa20 con 0x7fd5200a9430 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520145b20 con 0x7fd5040047c0 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.099+0000 7fd525000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52006fc70 con 0x7fd5200a9890 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35998/0 (socket says 172.21.15.192:35998) 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 -- 172.21.15.192:0/4118752655 learned_addr learned my addr 172.21.15.192:0/4118752655 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51f400640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040047c0 0x7fd5201455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51fe00640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200a9890 0x7fd5200a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 -- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200a9890 msgr2=0x7fd5200a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200a9890 0x7fd5200a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 -- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040047c0 msgr2=0x7fd5201455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040047c0 0x7fd5201455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 -- 172.21.15.192:0/4118752655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52006ff50 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.100+0000 7fd51ea00640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009bc0 tx=0x7fd50c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.101+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00f080 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.101+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c003bd0 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.101+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520070230 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.101+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c03c420 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.101+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200707f0 con 0x7fd5200a9430 2024-09-13T18:41:06.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.102+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5200709b0 con 0x7fd5200a9430 2024-09-13T18:41:06.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.103+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd50c03c580 con 0x7fd5200a9430 2024-09-13T18:41:06.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.104+0000 7fd517400640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 0x7fd50006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.104+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd50c0a98f0 con 0x7fd5200a9430 2024-09-13T18:41:06.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.104+0000 7fd51f400640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 0x7fd50006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.105+0000 7fd51f400640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 0x7fd50006d0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd510001fe0 tx=0x7fd510009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.108+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd50c074b80 con 0x7fd5200a9430 2024-09-13T18:41:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.308+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd52015a420 con 0x7fd5200a9430 2024-09-13T18:41:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.309+0000 7fd517400640 1 -- 172.21.15.192:0/4118752655 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fd50c040090 con 0x7fd5200a9430 2024-09-13T18:41:06.312 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:06.312 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 msgr2=0x7fd50006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 0x7fd50006d0f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd510001fe0 tx=0x7fd510009040 comp rx=0 tx=0).stop 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 msgr2=0x7fd5200abdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009bc0 tx=0x7fd50c004730 comp rx=0 tx=0).stop 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 shutdown_connections 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd50006ac30 0x7fd50006d0f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5200a9890 0x7fd5200a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5200a9430 0x7fd5200abdf0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 --2- 172.21.15.192:0/4118752655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5040047c0 0x7fd5201455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 >> 172.21.15.192:0/4118752655 conn(0x7fd5200736d0 msgr2=0x7fd5200b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 shutdown_connections 2024-09-13T18:41:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.311+0000 7fd525000640 1 -- 172.21.15.192:0/4118752655 wait complete. 2024-09-13T18:41:06.505 INFO:tasks.ceph.mds.a.smithi192.stderr:2024-09-13T18:41:06.503+0000 7fe7d9000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:41:06.733 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:41:00.930313+0000', 'modified': '2024-09-13T18:41:03.937688+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6550}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6550': {'gid': 6550, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/2916846477', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 2916846477}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 2916846477}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:41:06.734 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:41:06.734 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:41:06.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.886+0000 7f4232800640 1 Processor -- start 2024-09-13T18:41:06.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.886+0000 7f4232800640 1 -- start start 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4232800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 0x7f422c0cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4232800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c06bf10 con 0x7f422c06b180 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4232800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f422c0b2e10 con 0x7f422c1598d0 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4232800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c06bd20 con 0x7f422c0cd5b0 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4231e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f422c06b180 0x7f422c06b610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45664/0 (socket says 172.21.15.192:45664) 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4231e00640 1 -- 172.21.15.192:0/1154377175 learned_addr learned my addr 172.21.15.192:0/1154377175 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:06.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.887+0000 7f4230a00640 1 --2- 172.21.15.192:0/1154377175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 0x7f422c0cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976362797 0 0) 0x7f422c06bf10 con 0x7f422c06b180 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4214005730 con 0x7f422c06b180 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638268421 0 0) 0x7f422c0b2e10 con 0x7f422c1598d0 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f4230a00640 1 -- 172.21.15.192:0/1154377175 >> v1:172.21.15.194:6789/0 conn(0x7f422c1598d0 legacy=0x7f422c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f4230a00640 1 -- 172.21.15.192:0/1154377175 >> v1:172.21.15.192:6789/0 conn(0x7f422c06b180 legacy=0x7f422c06b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.888+0000 7f4230a00640 1 -- 172.21.15.192:0/1154377175 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0b30f0 con 0x7f422c0cd5b0 2024-09-13T18:41:06.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.889+0000 7f4230a00640 1 --2- 172.21.15.192:0/1154377175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 0x7f422c0cda20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42180097d0 tx=0x7f421802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8fd0f7af815357f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.889+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218032440 con 0x7f422c0cd5b0 2024-09-13T18:41:06.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.889+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42180325a0 con 0x7f422c0cd5b0 2024-09-13T18:41:06.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.889+0000 7f422be00640 1 -- 172.21.15.192:0/1154377175 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218032930 con 0x7f422c0cd5b0 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 -- 172.21.15.192:0/1154377175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 msgr2=0x7f422c0cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 --2- 172.21.15.192:0/1154377175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 0x7f422c0cda20 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42180097d0 tx=0x7f421802a210 comp rx=0 tx=0).stop 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 -- 172.21.15.192:0/1154377175 shutdown_connections 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 --2- 172.21.15.192:0/1154377175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c0cd5b0 0x7f422c0cda20 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 -- 172.21.15.192:0/1154377175 >> 172.21.15.192:0/1154377175 conn(0x7f422c0736d0 msgr2=0x7f422c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 -- 172.21.15.192:0/1154377175 shutdown_connections 2024-09-13T18:41:06.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.890+0000 7f4232800640 1 -- 172.21.15.192:0/1154377175 wait complete. 2024-09-13T18:41:06.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.892+0000 7f4232800640 1 Processor -- start 2024-09-13T18:41:06.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.892+0000 7f4232800640 1 -- start start 2024-09-13T18:41:06.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.892+0000 7f4232800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 0x7f422c0a9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4232800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f422c0cd5b0 0x7f422c157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4232800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4232800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c1580e0 con 0x7f422c1598d0 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4232800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0ae320 con 0x7f422c0cd5b0 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4232800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f422c0ad560 con 0x7f422c06b180 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36006/0 (socket says 172.21.15.192:36006) 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 -- 172.21.15.192:0/966409215 learned_addr learned my addr 172.21.15.192:0/966409215 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4230a00640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f422c0cd5b0 0x7f422c157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231400640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 0x7f422c0a9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 -- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 msgr2=0x7f422c0a9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 0x7f422c0a9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 -- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f422c0cd5b0 msgr2=0x7f422c157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f422c0cd5b0 0x7f422c157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 -- 172.21.15.192:0/966409215 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4218009400 con 0x7f422c1598d0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231400640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 0x7f422c0a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.893+0000 7f4231e00640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f422400cb40 tx=0x7f422400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.894+0000 7f4229600640 1 -- 172.21.15.192:0/966409215 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400aca0 con 0x7f422c1598d0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.894+0000 7f4229600640 1 -- 172.21.15.192:0/966409215 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422400ae00 con 0x7f422c1598d0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.894+0000 7f4229600640 1 -- 172.21.15.192:0/966409215 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224012620 con 0x7f422c1598d0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.894+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f422c0ad840 con 0x7f422c1598d0 2024-09-13T18:41:06.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.894+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f422c0ade00 con 0x7f422c1598d0 2024-09-13T18:41:06.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.896+0000 7f4229600640 1 -- 172.21.15.192:0/966409215 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4224007070 con 0x7f422c1598d0 2024-09-13T18:41:06.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.896+0000 7f4229600640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 0x7f420c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.897+0000 7f4229600640 1 -- 172.21.15.192:0/966409215 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4224089400 con 0x7f422c1598d0 2024-09-13T18:41:06.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.897+0000 7f4231400640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 0x7f420c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.897+0000 7f4236bbe740 1 Processor -- start 2024-09-13T18:41:06.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.897+0000 7f4236bbe740 1 -- start start 2024-09-13T18:41:06.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.897+0000 7f4231400640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 0x7f420c06d0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4220000f60 tx=0x7f4220009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7960420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b7960960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b789fab0 con 0x5583b79322e0 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b789d240 con 0x5583b797a800 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583b7898b30 con 0x5583b7936f10 2024-09-13T18:41:06.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4231400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4231400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36008/0 (socket says 172.21.15.192:36008) 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.898+0000 7f4231400640 1 -- 172.21.15.192:0/4059730426 learned_addr learned my addr 172.21.15.192:0/4059730426 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4230a00640 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7960420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231e00640 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b7960960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 -- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 msgr2=0x5583b7960420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7960420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 -- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 msgr2=0x5583b7960960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b7960960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 -- 172.21.15.192:0/4059730426 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583b7863bd0 con 0x5583b79322e0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f4231400640 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4220005360 tx=0x7f4220010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88de20a23aeaacc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f421e000640 1 -- 172.21.15.192:0/4059730426 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220003a20 con 0x5583b79322e0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f421e000640 1 -- 172.21.15.192:0/4059730426 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220003b80 con 0x5583b79322e0 2024-09-13T18:41:06.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.899+0000 7f421e000640 1 -- 172.21.15.192:0/4059730426 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220020450 con 0x5583b79322e0 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 -- 172.21.15.192:0/4059730426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 msgr2=0x5583b79369d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4220005360 tx=0x7f4220010000 comp rx=0 tx=0).stop 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 -- 172.21.15.192:0/4059730426 shutdown_connections 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b7960960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7960420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 --2- 172.21.15.192:0/4059730426 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b79322e0 0x5583b79369d0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 -- 172.21.15.192:0/4059730426 >> 172.21.15.192:0/4059730426 conn(0x5583b7932f70 msgr2=0x5583b797b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 -- 172.21.15.192:0/4059730426 shutdown_connections 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.900+0000 7f4236bbe740 1 -- 172.21.15.192:0/4059730426 wait complete. 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.901+0000 7f4236bbe740 1 -- start start 2024-09-13T18:41:06.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.901+0000 7f4236bbe740 1 Processor -- start 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7952c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b79536a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b783a260 con 0x5583b7953be0 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b7839f00 con 0x5583b797a800 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583b75fff20 con 0x5583b7936f10 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4236bbe740 10 client.0 _ll_register_callbacks cb 0x5583b78921a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4231e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4231e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36010/0 (socket says 172.21.15.192:36010) 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4231e00640 1 -- 172.21.15.192:0/490978478 learned_addr learned my addr 172.21.15.192:0/490978478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4230a00640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b79536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.902+0000 7f4231400640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7952c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 -- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 msgr2=0x5583b7952c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7952c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 -- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 msgr2=0x5583b79536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b79536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 -- 172.21.15.192:0/490978478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200050d0 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4230a00640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b79536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4231e00640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f42240012e0 tx=0x7f422405c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8feaeaa4d0287bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4212a00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224056660 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4224082e40 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583b78c2cd0 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42240576f0 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4236bbe740 10 client.6960 fetch_fsmap learned FSMap version 47 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5583b78971b0 con 0x5583b7953be0 2024-09-13T18:41:06.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.903+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583b78c2cd0 con 0x5583b7953be0 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f422405b070 con 0x5583b7953be0 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 10 client.6960 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 10 client.6960 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 20 client.6960 populate_metadata read hostname 'smithi192' 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b799a8e0 0x5583b799ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 4 client.6960 mds_command: new command op to 6550 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 --> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5583b758c3c0 con 0x5583b799a8e0 2024-09-13T18:41:06.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4231400640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b799a8e0 0x5583b799ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4231400640 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b799a8e0 0x5583b799ccd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ff25d2721bc4178 server_cookie=f7b3746b6e7679ca in_seq=0 out_seq=0 2024-09-13T18:41:06.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.904+0000 7f4212a00640 10 client.6960 ms_handle_connect on v2:172.21.15.192:6835/2916846477 2024-09-13T18:41:06.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.905+0000 7f4212a00640 1 -- 172.21.15.192:0/490978478 <== mds.0 v2:172.21.15.192:6835/2916846477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5583b758c3c0 con 0x5583b799a8e0 2024-09-13T18:41:06.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.905+0000 7f4212a00640 10 client.6960 handle_command_reply: tid=0 2024-09-13T18:41:06.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.905+0000 7f4236bbe740 1 client.6960 shutdown 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.905+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 msgr2=0x5583b7931120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.905+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f42240012e0 tx=0x7f422405c0f0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 shutdown_connections 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b799a8e0 0x5583b799ccd0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b7931120 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b79536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4212a00640 0 client.6960 ms_handle_reset on v2:172.21.15.192:6835/2916846477 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 --2- 172.21.15.192:0/490978478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7952c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 >> 172.21.15.192:0/490978478 conn(0x5583b79322e0 msgr2=0x5583b7979a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 shutdown_connections 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 1 -- 172.21.15.192:0/490978478 wait complete. 2024-09-13T18:41:06.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.906+0000 7f4236bbe740 20 client.6960 trim_cache size 0 max 16384 2024-09-13T18:41:06.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.921+0000 7f4236bbe740 1 Processor -- start 2024-09-13T18:41:06.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.921+0000 7f4236bbe740 1 -- start start 2024-09-13T18:41:06.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b7953be0 0x5583b79a1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b797a800 0x5583b7935520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b797ddf0 con 0x5583b7936f10 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b797d0f0 con 0x5583b7953be0 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583b7979360 con 0x5583b797a800 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4231400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4231400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36012/0 (socket says 172.21.15.192:36012) 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.922+0000 7f4231400640 1 -- 172.21.15.192:0/3428750483 learned_addr learned my addr 172.21.15.192:0/3428750483 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 -- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b797a800 msgr2=0x5583b7935520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b797a800 0x5583b7935520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 -- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b7953be0 msgr2=0x5583b79a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b7953be0 0x5583b79a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 -- 172.21.15.192:0/3428750483 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5583b78cc170 con 0x5583b7936f10 2024-09-13T18:41:06.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f4231400640 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4220007e20 tx=0x7f4220005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32b3fb42c1c6be server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f421ea00640 1 -- 172.21.15.192:0/3428750483 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4220003a20 con 0x5583b7936f10 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f421ea00640 1 -- 172.21.15.192:0/3428750483 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4220018030 con 0x5583b7936f10 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.923+0000 7f421ea00640 1 -- 172.21.15.192:0/3428750483 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422002d670 con 0x5583b7936f10 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- 172.21.15.192:0/3428750483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 msgr2=0x5583b79a0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4220007e20 tx=0x7f4220005000 comp rx=0 tx=0).stop 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- 172.21.15.192:0/3428750483 shutdown_connections 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b797a800 0x5583b7935520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b7953be0 0x5583b79a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 --2- 172.21.15.192:0/3428750483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7936f10 0x5583b79a0cf0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- 172.21.15.192:0/3428750483 >> 172.21.15.192:0/3428750483 conn(0x5583b79322e0 msgr2=0x5583b79799a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- 172.21.15.192:0/3428750483 shutdown_connections 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- 172.21.15.192:0/3428750483 wait complete. 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 -- start start 2024-09-13T18:41:06.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.924+0000 7f4236bbe740 1 Processor -- start 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7962d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b792ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b796bd10 con 0x5583b7953be0 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5583b79566c0 con 0x5583b797a800 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5583b7955b60 con 0x5583b7936f10 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.925+0000 7f4236bbe740 10 client.0 _ll_register_callbacks cb 0x7f4224058200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36028/0 (socket says 172.21.15.192:36028) 2024-09-13T18:41:06.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 -- 172.21.15.192:0/213698185 learned_addr learned my addr 172.21.15.192:0/213698185 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4231e00640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b792ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4231400640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7962d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 -- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 msgr2=0x5583b7962d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7962d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 -- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 msgr2=0x5583b792ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b792ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 -- 172.21.15.192:0/213698185 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5583b7863bd0 con 0x5583b7953be0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4230a00640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4218035040 tx=0x7f42180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d0e099a7503258 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4212a00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.926+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4218032b20 con 0x5583b7953be0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4218032c80 con 0x5583b7953be0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5583b79643e0 con 0x5583b7953be0 2024-09-13T18:41:06.933 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4218032e40 con 0x5583b7953be0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 10 client.6966 fetch_fsmap learned FSMap version 47 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=2+}) v3 -- 0x5583b7839470 con 0x5583b7953be0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5583b79643e0 con 0x5583b7953be0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 47) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f4218003610 con 0x5583b7953be0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 10 client.6966 fetch_fsmap finished waiting for FSMap version 47 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 10 client.6966 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 20 client.6966 populate_metadata read hostname 'smithi192' 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b7991210 0x5583b79915f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 4 client.6966 mds_command: new command op to 6550 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 --> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f4220003b80 con 0x5583b7991210 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.927+0000 7f4231400640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b7991210 0x5583b79915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4231400640 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b7991210 0x5583b79915f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43a901798a9ce59f server_cookie=a14aa827d3a3848d in_seq=0 out_seq=0 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4212a00640 10 client.6966 ms_handle_connect on v2:172.21.15.192:6835/2916846477 2024-09-13T18:41:06.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4212a00640 1 -- 172.21.15.192:0/213698185 <== mds.0 v2:172.21.15.192:6835/2916846477 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x7f4220003b80 con 0x5583b7991210 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4212a00640 10 client.6966 handle_command_reply: tid=0 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 client.6966 shutdown 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 msgr2=0x5583b79ec890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4218035040 tx=0x7f42180046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 shutdown_connections 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:6835/2916846477,v1:172.21.15.192:6837/2916846477] conn(0x5583b7991210 0x5583b79915f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5583b797a800 0x5583b792ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5583b7953be0 0x5583b79ec890 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 --2- 172.21.15.192:0/213698185 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x5583b7936f10 0x5583b7962d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4212a00640 0 client.6966 ms_handle_reset on v2:172.21.15.192:6835/2916846477 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.928+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 >> 172.21.15.192:0/213698185 conn(0x5583b79322e0 msgr2=0x5583b79a0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 shutdown_connections 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4236bbe740 1 -- 172.21.15.192:0/213698185 wait complete. 2024-09-13T18:41:06.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4236bbe740 20 client.6966 trim_cache size 0 max 16384 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 6550, 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 5.9946653120000004, 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 47, 2024-09-13T18:41:06.936 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 112, 2024-09-13T18:41:06.937 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 112, 2024-09-13T18:41:06.937 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 10.97353116 2024-09-13T18:41:06.937 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:06.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 msgr2=0x7f420c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 0x7f420c06d0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4220000f60 tx=0x7f4220009040 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 msgr2=0x7f422c147220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f422400cb40 tx=0x7f422400a060 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 shutdown_connections 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f420c06ac30 0x7f420c06d0f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f422c1598d0 0x7f422c147220 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f422c0cd5b0 0x7f422c157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 --2- 172.21.15.192:0/966409215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f422c06b180 0x7f422c0a9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 >> 172.21.15.192:0/966409215 conn(0x7f422c0736d0 msgr2=0x7f422c15a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.929+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 shutdown_connections 2024-09-13T18:41:06.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:06.930+0000 7f4232800640 1 -- 172.21.15.192:0/966409215 wait complete. 2024-09-13T18:41:06.947 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:41:07.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.098+0000 7ff72b800640 1 Processor -- start 2024-09-13T18:41:07.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.098+0000 7ff72b800640 1 -- start start 2024-09-13T18:41:07.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff72b800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff72415dee0 0x7ff7240afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff72b800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff72415e2c0 0x7ff72415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff72b800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7240b2f00 con 0x7ff7240b3f10 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff72b800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240b3150 con 0x7ff72415dee0 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff72b800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7240b3430 con 0x7ff72415e2c0 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.099+0000 7ff728e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff72415dee0 0x7ff7240afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff72415dee0 0x7ff7240afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36040/0 (socket says 172.21.15.192:36040) 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 -- 172.21.15.192:0/1501791345 learned_addr learned my addr 172.21.15.192:0/1501791345 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff729800640 1 --2- 172.21.15.192:0/1501791345 >> v2:172.21.15.194:3300/0 conn(0x7ff72415e2c0 0x7ff72415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 -- 172.21.15.192:0/1501791345 >> v2:172.21.15.194:3300/0 conn(0x7ff72415e2c0 msgr2=0x7ff72415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 --2- 172.21.15.192:0/1501791345 >> v2:172.21.15.194:3300/0 conn(0x7ff72415e2c0 0x7ff72415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 -- 172.21.15.192:0/1501791345 >> v1:172.21.15.194:6789/0 conn(0x7ff7240b3f10 legacy=0x7ff72415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:07.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.100+0000 7ff728e00640 1 -- 172.21.15.192:0/1501791345 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7240b3710 con 0x7ff72415dee0 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.101+0000 7ff728e00640 1 --2- 172.21.15.192:0/1501791345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff72415dee0 0x7ff7240afd80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff7240cec10 tx=0x7ff71802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af0e16d0cfe5afb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.101+0000 7ff723400640 1 -- 172.21.15.192:0/1501791345 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718032440 con 0x7ff72415dee0 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.101+0000 7ff723400640 1 -- 172.21.15.192:0/1501791345 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7180325a0 con 0x7ff72415dee0 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.101+0000 7ff723400640 1 -- 172.21.15.192:0/1501791345 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718032930 con 0x7ff72415dee0 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 -- 172.21.15.192:0/1501791345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff72415dee0 msgr2=0x7ff7240afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 --2- 172.21.15.192:0/1501791345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff72415dee0 0x7ff7240afd80 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7ff7240cec10 tx=0x7ff71802a230 comp rx=0 tx=0).stop 2024-09-13T18:41:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 -- 172.21.15.192:0/1501791345 shutdown_connections 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 --2- 172.21.15.192:0/1501791345 >> v2:172.21.15.194:3300/0 conn(0x7ff72415e2c0 0x7ff72415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 --2- 172.21.15.192:0/1501791345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff72415dee0 0x7ff7240afd80 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 -- 172.21.15.192:0/1501791345 >> 172.21.15.192:0/1501791345 conn(0x7ff7240ae960 msgr2=0x7ff72406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 -- 172.21.15.192:0/1501791345 shutdown_connections 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.102+0000 7ff72b800640 1 -- 172.21.15.192:0/1501791345 wait complete. 2024-09-13T18:41:07.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.103+0000 7ff72b800640 1 Processor -- start 2024-09-13T18:41:07.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 -- start start 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff72415dee0 0x7ff72406a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff72415e2c0 0x7ff72414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7241517f0 con 0x7ff724150e00 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff724141010 con 0x7ff72415dee0 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.104+0000 7ff72b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7241412b0 con 0x7ff72415e2c0 2024-09-13T18:41:07.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36046/0 (socket says 172.21.15.192:36046) 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 -- 172.21.15.192:0/3285570090 learned_addr learned my addr 172.21.15.192:0/3285570090 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff728e00640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff72415dee0 0x7ff72406a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff723e00640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff72415e2c0 0x7ff72414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 -- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff72415e2c0 msgr2=0x7ff72414fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff72415e2c0 0x7ff72414fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 -- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff72415dee0 msgr2=0x7ff72406a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff72415dee0 0x7ff72406a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 -- 172.21.15.192:0/3285570090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7180094d0 con 0x7ff724150e00 2024-09-13T18:41:07.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.105+0000 7ff729800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff71c007e60 tx=0x7ff71c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.106+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c014420 con 0x7ff724150e00 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.106+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c0145a0 con 0x7ff724150e00 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.106+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c014950 con 0x7ff724150e00 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.106+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72406ada0 con 0x7ff724150e00 2024-09-13T18:41:07.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.106+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72406b070 con 0x7ff724150e00 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.107+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7240afd80 con 0x7ff724150e00 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.108+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff71c014ab0 con 0x7ff724150e00 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.108+0000 7ff720c00640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 0x7ff70406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.109+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff71c089c60 con 0x7ff724150e00 2024-09-13T18:41:07.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.109+0000 7ff728e00640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 0x7ff70406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:07.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.109+0000 7ff728e00640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 0x7ff70406d0c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff718034000 tx=0x7ff71802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:07.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.113+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff71c054e30 con 0x7ff724150e00 2024-09-13T18:41:07.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.316+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7241413f0 con 0x7ff724150e00 2024-09-13T18:41:07.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.316+0000 7ff720c00640 1 -- 172.21.15.192:0/3285570090 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff71c058450 con 0x7ff724150e00 2024-09-13T18:41:07.319 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 msgr2=0x7ff70406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 0x7ff70406d0c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7ff718034000 tx=0x7ff71802e000 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 msgr2=0x7ff7241512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7ff71c007e60 tx=0x7ff71c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 shutdown_connections 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff70406ac00 0x7ff70406d0c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff724150e00 0x7ff7241512b0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff72415e2c0 0x7ff72414fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 --2- 172.21.15.192:0/3285570090 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff72415dee0 0x7ff72406a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.318+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 >> 172.21.15.192:0/3285570090 conn(0x7ff7240ae960 msgr2=0x7ff7240ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.319+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 shutdown_connections 2024-09-13T18:41:07.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:07.319+0000 7ff72b800640 1 -- 172.21.15.192:0/3285570090 wait complete. 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:41:07.337 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:07.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.337 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:41:07.372 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:41:07.372 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:41:07.373 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42442sec preferred_lft 42442sec 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.374 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:07.375 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:41:07.375 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:41:07.375 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:07.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.376 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:41:07.469 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:41:07.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.472 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:41:07.507 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:41:07.507 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:41:07.507 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:41:07.507 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:41:07.507 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:41:07.508 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:41:07.508 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:41:07.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:41:07.596 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:41:07.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.654 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:41:07.689 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:41:07.689 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:41:07.690 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:07.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:07.690 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:41:07.815 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:07.816 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:07.851 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:07.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:07.852 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:07.927 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:41:08.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.074 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:08.164 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:08.164 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:08.190 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:08.191 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:08.191 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:41:08.191 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:41:08.191 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:41:08.193 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:41:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:41:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:41:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:41:08.193 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:41:08.196 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:41:08.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.196 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:08.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.253 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:41:08.296 INFO:teuthology.orchestra.run.smithi192.stdout:client6682 2024-09-13T18:41:08.296 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:08.296 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:08.372 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:41:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.562+0000 7f8fe4a00640 1 Processor -- start 2024-09-13T18:41:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.562+0000 7f8fe4a00640 1 -- start start 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.563+0000 7f8fe4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fe0146610 0x7f8fe00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.563+0000 7f8fe4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.563+0000 7f8fe4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fe00ae770 con 0x7f8fe00afd80 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.563+0000 7f8fe4a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fe00cd920 con 0x7f8fe0146610 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.563+0000 7f8fe4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe00cdb30 con 0x7f8fe00b2780 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fe0146610 0x7f8fe00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8fe0146610 0x7f8fe00ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36058/0 (socket says 172.21.15.192:36058) 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 -- 172.21.15.192:0/1877081146 learned_addr learned my addr 172.21.15.192:0/1877081146 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:08.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fd5400640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 -- 172.21.15.192:0/1877081146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 msgr2=0x7f8fe00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 -- 172.21.15.192:0/1877081146 >> v1:172.21.15.194:6789/0 conn(0x7f8fe00afd80 legacy=0x7f8fe00b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.564+0000 7f8fdde00640 1 -- 172.21.15.192:0/1877081146 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe00ae1b0 con 0x7f8fe0146610 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.565+0000 7f8fdde00640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe0146610 0x7f8fe00ce2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6af0c5ae1eff27a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.565+0000 7f8fdd400640 1 -- 172.21.15.192:0/1877081146 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0032440 con 0x7f8fe0146610 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.565+0000 7f8fdd400640 1 -- 172.21.15.192:0/1877081146 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd00325a0 con 0x7f8fe0146610 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.565+0000 7f8fdd400640 1 -- 172.21.15.192:0/1877081146 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0032930 con 0x7f8fe0146610 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 -- 172.21.15.192:0/1877081146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe0146610 msgr2=0x7f8fe00ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe0146610 0x7f8fe00ce2f0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0009870 tx=0x7f8fd002a250 comp rx=0 tx=0).stop 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 -- 172.21.15.192:0/1877081146 shutdown_connections 2024-09-13T18:41:08.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/1877081146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe0146610 0x7f8fe00ce2f0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 -- 172.21.15.192:0/1877081146 >> 172.21.15.192:0/1877081146 conn(0x7f8fe00ae960 msgr2=0x7f8fe006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 -- 172.21.15.192:0/1877081146 shutdown_connections 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.566+0000 7f8fe4a00640 1 -- 172.21.15.192:0/1877081146 wait complete. 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.568+0000 7f8fe4a00640 1 Processor -- start 2024-09-13T18:41:08.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.568+0000 7f8fe4a00640 1 -- start start 2024-09-13T18:41:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 0x7f8fe015ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f6000 con 0x7f8fe00afd80 2024-09-13T18:41:08.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f62a0 con 0x7f8fe0146610 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fe4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fe01f6580 con 0x7f8fe00b2780 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fdde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fdde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36072/0 (socket says 172.21.15.192:36072) 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fdde00640 1 -- 172.21.15.192:0/3336113667 learned_addr learned my addr 172.21.15.192:0/3336113667 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fde800640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 0x7f8fe015ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.569+0000 7f8fd5400640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 -- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 msgr2=0x7f8fe015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 -- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 msgr2=0x7f8fe015ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 0x7f8fe015ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 -- 172.21.15.192:0/3336113667 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fd00094d0 con 0x7f8fe00afd80 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fde800640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 0x7f8fe015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:08.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fdde00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000c00 tx=0x7f8fd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0032440 con 0x7f8fe00afd80 2024-09-13T18:41:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fd0030b80 con 0x7f8fe00afd80 2024-09-13T18:41:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fd003d440 con 0x7f8fe00afd80 2024-09-13T18:41:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fe01f6860 con 0x7f8fe00afd80 2024-09-13T18:41:08.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.570+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fe015cac0 con 0x7f8fe00afd80 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.571+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fe00ce2f0 con 0x7f8fe00afd80 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.572+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8fd0039040 con 0x7f8fe00afd80 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.573+0000 7f8fd6a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.573+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8fd00a9e00 con 0x7f8fe00afd80 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.573+0000 7f8fd5400640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:08.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.574+0000 7f8fd5400640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8006fd0 tx=0x7f8fc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:08.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.577+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8fd0074fd0 con 0x7f8fe00afd80 2024-09-13T18:41:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.779+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8fe00af950 con 0x7f8fe00afd80 2024-09-13T18:41:08.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.780+0000 7f8fd6a00640 1 -- 172.21.15.192:0/3336113667 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v47) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8fd00785f0 con 0x7f8fe00afd80 2024-09-13T18:41:08.783 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 msgr2=0x7f8fbc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f8fc8006fd0 tx=0x7f8fc8008040 comp rx=0 tx=0).stop 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 msgr2=0x7f8fe01f35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0000c00 tx=0x7f8fd00046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 shutdown_connections 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8fbc06ac00 0x7f8fbc06d0c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8fe0146610 0x7f8fe015ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8fe00b2780 0x7f8fe015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 --2- 172.21.15.192:0/3336113667 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8fe00afd80 0x7f8fe01f35d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 >> 172.21.15.192:0/3336113667 conn(0x7f8fe00ae960 msgr2=0x7f8fe0156f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 shutdown_connections 2024-09-13T18:41:08.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:08.782+0000 7f8fe4a00640 1 -- 172.21.15.192:0/3336113667 wait complete. 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:41:08.801 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:08.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.802 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:08.842 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42445sec preferred_lft 42445sec 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.843 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:41:08.844 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:08.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.845 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:41:08.942 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:41:08.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.946 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:41:08.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:08.986 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:41:08.986 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:41:08.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:41:08.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:41:08.987 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:41:08.987 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:41:09.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:09.133 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:41:09.168 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:41:09.168 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:41:09.168 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:09.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:09.169 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:41:09.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:09.264 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:09.299 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:09.299 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:09.299 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:09.374 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:41:09.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:09.374 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:09.502 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:09.502 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:09.528 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:09.528 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:09.528 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:41:09.528 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:41:09.528 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:41:09.531 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:41:09.531 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:41:09.531 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:41:09.531 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:41:09.531 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:41:09.533 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:41:09.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:09.534 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:09.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:09.589 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:41:09.626 INFO:teuthology.orchestra.run.smithi194.stdout:client6688 2024-09-13T18:41:09.627 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:09.627 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:09.701 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:09.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.853+0000 7fd5fea00640 1 Processor -- start 2024-09-13T18:41:09.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.853+0000 7fd5fea00640 1 -- start start 2024-09-13T18:41:09.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.854+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f8146610 0x7fd5f80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.854+0000 7fd5fea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5f80b2780 0x7fd5f80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.854+0000 7fd5fea00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5f80ae770 con 0x7fd5f80afd80 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.854+0000 7fd5fea00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5f80cd920 con 0x7fd5f80b2780 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.854+0000 7fd5fea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f80cdb30 con 0x7fd5f8146610 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5f80b2780 0x7fd5f80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5fca00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd5f80afd80 0x7fd5f80b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45666/0 (socket says 172.21.15.192:45666) 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5fca00640 1 -- 172.21.15.192:0/3867312402 learned_addr learned my addr 172.21.15.192:0/3867312402 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7e00640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f8146610 0x7fd5f80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7400640 1 -- 172.21.15.192:0/3867312402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f8146610 msgr2=0x7fd5f80ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:09.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7400640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f8146610 0x7fd5f80ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7400640 1 -- 172.21.15.192:0/3867312402 >> v1:172.21.15.192:6789/0 conn(0x7fd5f80afd80 legacy=0x7fd5f80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.855+0000 7fd5f7400640 1 -- 172.21.15.192:0/3867312402 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5f80ae1b0 con 0x7fd5f80b2780 2024-09-13T18:41:09.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.856+0000 7fd5f7400640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80b2780 0x7fd5f80ad840 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40097a0 tx=0x7fd5e402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf38c256921798e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.856+0000 7fd5f6a00640 1 -- 172.21.15.192:0/3867312402 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4032440 con 0x7fd5f80b2780 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.856+0000 7fd5f6a00640 1 -- 172.21.15.192:0/3867312402 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e40325a0 con 0x7fd5f80b2780 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.856+0000 7fd5f6a00640 1 -- 172.21.15.192:0/3867312402 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e4032930 con 0x7fd5f80b2780 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 -- 172.21.15.192:0/3867312402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80b2780 msgr2=0x7fd5f80ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80b2780 0x7fd5f80ad840 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fd5e40097a0 tx=0x7fd5e402a180 comp rx=0 tx=0).stop 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 -- 172.21.15.192:0/3867312402 shutdown_connections 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80b2780 0x7fd5f80ad840 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 --2- 172.21.15.192:0/3867312402 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f8146610 0x7fd5f80ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 -- 172.21.15.192:0/3867312402 >> 172.21.15.192:0/3867312402 conn(0x7fd5f80ae960 msgr2=0x7fd5f806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:09.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 -- 172.21.15.192:0/3867312402 shutdown_connections 2024-09-13T18:41:09.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.857+0000 7fd5fea00640 1 -- 172.21.15.192:0/3867312402 wait complete. 2024-09-13T18:41:09.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.859+0000 7fd5fea00640 1 Processor -- start 2024-09-13T18:41:09.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.859+0000 7fd5fea00640 1 -- start start 2024-09-13T18:41:09.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f80b2780 0x7fd5f813ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f8146610 0x7fd5f81404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f8140ad0 con 0x7fd5f80afd80 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f806ea90 con 0x7fd5f8146610 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5f806ed70 con 0x7fd5f80b2780 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36094/0 (socket says 172.21.15.192:36094) 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 -- 172.21.15.192:0/2782468888 learned_addr learned my addr 172.21.15.192:0/2782468888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7400640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f80b2780 0x7fd5f813ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5fca00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f8146610 0x7fd5f81404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 -- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f80b2780 msgr2=0x7fd5f813ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f80b2780 0x7fd5f813ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 -- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f8146610 msgr2=0x7fd5f81404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f8146610 0x7fd5f81404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.860+0000 7fd5f7e00640 1 -- 172.21.15.192:0/2782468888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e4009400 con 0x7fd5f80afd80 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5f7e00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800e870 tx=0x7fd5e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e80094f0 con 0x7fd5f80afd80 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e800c940 con 0x7fd5f80afd80 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e800ccf0 con 0x7fd5f80afd80 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5f806f050 con 0x7fd5f80afd80 2024-09-13T18:41:09.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.861+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5f80719a0 con 0x7fd5f80afd80 2024-09-13T18:41:09.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.862+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5f80ce2f0 con 0x7fd5f80afd80 2024-09-13T18:41:09.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.863+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5e8013470 con 0x7fd5f80afd80 2024-09-13T18:41:09.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.864+0000 7fd5efe00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 0x7fd5d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:09.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.864+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5e80893e0 con 0x7fd5f80afd80 2024-09-13T18:41:09.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.864+0000 7fd5f7400640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 0x7fd5d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:09.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.865+0000 7fd5f7400640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 0x7fd5d806d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4034000 tx=0x7fd5e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:09.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:09.868+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5e8054670 con 0x7fd5f80afd80 2024-09-13T18:41:10.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.074+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5f8145470 con 0x7fd5f80afd80 2024-09-13T18:41:10.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.075+0000 7fd5efe00640 1 -- 172.21.15.192:0/2782468888 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fd5e8057c90 con 0x7fd5f80afd80 2024-09-13T18:41:10.078 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:10.078 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:10.078 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:10.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 msgr2=0x7fd5d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 0x7fd5d806d0c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd5e4034000 tx=0x7fd5e402e000 comp rx=0 tx=0).stop 2024-09-13T18:41:10.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 msgr2=0x7fd5f813e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:10.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd5e800e870 tx=0x7fd5e800ed30 comp rx=0 tx=0).stop 2024-09-13T18:41:10.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 shutdown_connections 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5d806ac00 0x7fd5d806d0c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5f8146610 0x7fd5f81404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5f80b2780 0x7fd5f813ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 --2- 172.21.15.192:0/2782468888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5f80afd80 0x7fd5f813e650 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 >> 172.21.15.192:0/2782468888 conn(0x7fd5f80ae960 msgr2=0x7fd5f815f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 shutdown_connections 2024-09-13T18:41:10.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:10.077+0000 7fd5fea00640 1 -- 172.21.15.192:0/2782468888 wait complete. 2024-09-13T18:41:10.096 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-13T18:41:10.268 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":6550,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.3179215909999993,"mdsmap_epoch":47,"osdmap_epoch":112,"osdmap_epoch_barrier":112,"uptime":14.296789211} 2024-09-13T18:41:10.269 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 6550, "mdsmap_epoch": 47, "osdmap_epoch": 112, "osdmap_epoch_barrier": 112, "rank_uptime": 9.317921591, "state": "up:active", "uptime": 14.296789211, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:41:10.269 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:41:10.436 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:41:10.437 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:41:10.437 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2024-09-13T18:41:10.437 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:10.437 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:10.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:10.473 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2024-09-13T18:41:12.436 INFO:teuthology.orchestra.run.smithi192.stderr:265+0 records in 2024-09-13T18:41:12.436 INFO:teuthology.orchestra.run.smithi192.stderr:265+0 records out 2024-09-13T18:41:12.436 INFO:teuthology.orchestra.run.smithi192.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.88449 s, 147 MB/s 2024-09-13T18:41:12.437 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:12.437 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:12.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:12.473 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2024-09-13T18:41:14.614 INFO:teuthology.orchestra.run.smithi192.stderr:292+0 records in 2024-09-13T18:41:14.615 INFO:teuthology.orchestra.run.smithi192.stderr:292+0 records out 2024-09-13T18:41:14.615 INFO:teuthology.orchestra.run.smithi192.stderr:306184192 bytes (306 MB, 292 MiB) copied, 2.06525 s, 148 MB/s 2024-09-13T18:41:14.616 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-13T18:41:14.616 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:14.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.767+0000 7f8070400640 1 Processor -- start 2024-09-13T18:41:14.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.767+0000 7f8070400640 1 -- start start 2024-09-13T18:41:14.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8070400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80680b0490 0x7f806815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8070400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b2f00 con 0x7f80680b3f10 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8070400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80680b3150 con 0x7f806815dee0 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8070400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80680b3430 con 0x7f80680b0490 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f806d000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f80680b3f10 0x7f806815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60766/0 (socket says 172.21.15.192:60766) 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f806d000640 1 -- 172.21.15.192:0/1511776039 learned_addr learned my addr 172.21.15.192:0/1511776039 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:14.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f806e400640 1 --2- 172.21.15.192:0/1511776039 >> v2:172.21.15.194:3300/0 conn(0x7f80680b0490 0x7f806815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8067e00640 1 -- 172.21.15.192:0/1511776039 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 222360591 0 0) 0x7f80680b2f00 con 0x7f80680b3f10 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.769+0000 7f8067e00640 1 -- 172.21.15.192:0/1511776039 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8050003520 con 0x7f80680b3f10 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.770+0000 7f806e400640 1 -- 172.21.15.192:0/1511776039 >> v1:172.21.15.194:6789/0 conn(0x7f806815dee0 legacy=0x7f80680afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.770+0000 7f806e400640 1 -- 172.21.15.192:0/1511776039 >> v1:172.21.15.192:6789/0 conn(0x7f80680b3f10 legacy=0x7f806815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.770+0000 7f806e400640 1 -- 172.21.15.192:0/1511776039 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80680b3710 con 0x7f80680b0490 2024-09-13T18:41:14.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f806e400640 1 --2- 172.21.15.192:0/1511776039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f806815ab50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f806002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b008a2914dc9071 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8067e00640 1 -- 172.21.15.192:0/1511776039 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060032440 con 0x7f80680b0490 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8067e00640 1 -- 172.21.15.192:0/1511776039 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80600325a0 con 0x7f80680b0490 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8067e00640 1 -- 172.21.15.192:0/1511776039 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060032910 con 0x7f80680b0490 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8070400640 1 -- 172.21.15.192:0/1511776039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 msgr2=0x7f806815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8070400640 1 --2- 172.21.15.192:0/1511776039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f806815ab50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f806002a230 comp rx=0 tx=0).stop 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8070400640 1 -- 172.21.15.192:0/1511776039 shutdown_connections 2024-09-13T18:41:14.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8070400640 1 --2- 172.21.15.192:0/1511776039 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f806815ab50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.771+0000 7f8070400640 1 -- 172.21.15.192:0/1511776039 >> 172.21.15.192:0/1511776039 conn(0x7f80680ae960 msgr2=0x7f806806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.772+0000 7f8070400640 1 -- 172.21.15.192:0/1511776039 shutdown_connections 2024-09-13T18:41:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.772+0000 7f8070400640 1 -- 172.21.15.192:0/1511776039 wait complete. 2024-09-13T18:41:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.773+0000 7f8070400640 1 Processor -- start 2024-09-13T18:41:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.773+0000 7f8070400640 1 -- start start 2024-09-13T18:41:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f80681425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f806815dee0 0x7f80680adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806813ddc0 con 0x7f806815b210 2024-09-13T18:41:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806815b710 con 0x7f80680b0490 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f8070400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f806815b9f0 con 0x7f806815dee0 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f806e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.774+0000 7f806e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:47326/0 (socket says 172.21.15.192:47326) 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 -- 172.21.15.192:0/3128565008 learned_addr learned my addr 172.21.15.192:0/3128565008 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806da00640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f80681425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806d000640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f806815dee0 0x7f80680adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 -- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f806815dee0 msgr2=0x7f80680adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f806815dee0 0x7f80680adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 -- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 msgr2=0x7f80681425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f80681425a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 -- 172.21.15.192:0/3128565008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8060009400 con 0x7f806815b210 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f806e400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f80600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060032440 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8060004230 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8060033ea0 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.775+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f806815bcd0 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.776+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8068142ae0 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.777+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8068067490 con 0x7f806815b210 2024-09-13T18:41:14.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.777+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8060039050 con 0x7f806815b210 2024-09-13T18:41:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.779+0000 7f8065600640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 0x7f804806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.779+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80600a9c10 con 0x7f806815b210 2024-09-13T18:41:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.779+0000 7f806da00640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 0x7f804806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.780+0000 7f806da00640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 0x7f804806d0f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f805c001e70 tx=0x7f805c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.783+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8060074e00 con 0x7f806815b210 2024-09-13T18:41:14.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.953+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f806813df00 con 0x7f806815b210 2024-09-13T18:41:14.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.954+0000 7f8065600640 1 -- 172.21.15.192:0/3128565008 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v112) v1 ==== 81+0+34079 (secure 0 0 0) 0x7f806004b090 con 0x7f806815b210 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 112, 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:01.933417+0000", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:14.958 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:14.959 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:14.960 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:14.961 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "101", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:14.962 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:14.963 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:14.964 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.965 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:14.966 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:14.967 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "111", 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:14.968 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:14.969 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:14.970 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.971 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:14.972 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:14.973 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:14.974 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "112", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:14.975 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:14.976 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:14.977 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:14.978 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:14.979 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:14.980 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.981 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.982 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.983 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.984 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.985 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:14.986 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.987 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.988 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.989 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.990 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:14.991 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.992 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:14.993 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.994 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.995 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:14.996 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:14.997 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:14.998 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:14.999 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:15.000 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:15.001 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:15.002 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:15.003 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.004 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:15.005 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:15.006 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.007 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.008 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:15.009 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.010 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.011 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:15.012 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:15.013 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.014 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:15.015 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.016 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.017 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.018 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:15.020 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:15.034 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:15.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.956+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 msgr2=0x7f804806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:15.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.956+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 0x7f804806d0f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f805c001e70 tx=0x7f805c009040 comp rx=0 tx=0).stop 2024-09-13T18:41:15.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.956+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 msgr2=0x7f806813c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:15.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.956+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f80600097a0 tx=0x7f80600046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:15.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 shutdown_connections 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f804806ac30 0x7f804806d0f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f806815b210 0x7f806813c0f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f806815dee0 0x7f80680adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 --2- 172.21.15.192:0/3128565008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80680b0490 0x7f80681425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 >> 172.21.15.192:0/3128565008 conn(0x7f80680ae960 msgr2=0x7f80680b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 shutdown_connections 2024-09-13T18:41:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:14.957+0000 7f8070400640 1 -- 172.21.15.192:0/3128565008 wait complete. 2024-09-13T18:41:15.037 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:41:16.985 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:41:16.982+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2024-09-13T18:41:20.038 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:20.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.202+0000 7f67a1a00640 1 Processor -- start 2024-09-13T18:41:20.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.202+0000 7f67a1a00640 1 -- start start 2024-09-13T18:41:20.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f679c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c13e0a0 con 0x7f679c154cc0 2024-09-13T18:41:20.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f679c0d0590 con 0x7f679c140a10 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c15c160 con 0x7f679c140630 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f679c154cc0 0x7f679c155150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60774/0 (socket says 172.21.15.192:60774) 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.203+0000 7f67a1000640 1 -- 172.21.15.192:0/2851746987 learned_addr learned my addr 172.21.15.192:0/2851746987 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679be00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f679c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204585486 0 0) 0x7f679c13e0a0 con 0x7f679c154cc0 2024-09-13T18:41:20.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6780003520 con 0x7f679c154cc0 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1952868910 0 0) 0x7f6780003520 con 0x7f679c154cc0 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 msgr2=0x7f679c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f679c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 >> v1:172.21.15.194:6789/0 conn(0x7f679c140a10 legacy=0x7f679c0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c0cede0 con 0x7f679c154cc0 2024-09-13T18:41:20.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f67940019f0 con 0x7f679c154cc0 2024-09-13T18:41:20.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 >> v1:172.21.15.192:6789/0 conn(0x7f679c154cc0 legacy=0x7f679c155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67800039a0 0x7f6780003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f67800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6780004d00 0x7f6780005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c15c160 con 0x7f67800039a0 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678000b980 con 0x7f6780004d00 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.204+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678000bb40 con 0x7f679c140630 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67800039a0 0x7f6780003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679b400640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f67800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f67a1000640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6780004d00 0x7f6780005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 -- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 msgr2=0x7f67800047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c140630 0x7f67800047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 -- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6780004d00 msgr2=0x7f6780005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6780004d00 0x7f6780005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.205+0000 7f679be00640 1 -- 172.21.15.192:0/2851746987 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6780003520 con 0x7f67800039a0 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.206+0000 7f679be00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67800039a0 0x7f6780003d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f678c009ac0 tx=0x7f67800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c79e74dbcd2a08 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.206+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c031400 con 0x7f67800039a0 2024-09-13T18:41:20.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.206+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f678c02d050 con 0x7f67800039a0 2024-09-13T18:41:20.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.206+0000 7f679aa00640 1 -- 172.21.15.192:0/2851746987 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678c031780 con 0x7f67800039a0 2024-09-13T18:41:20.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 -- 172.21.15.192:0/2851746987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67800039a0 msgr2=0x7f6780003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 --2- 172.21.15.192:0/2851746987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67800039a0 0x7f6780003d80 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f678c009ac0 tx=0x7f67800057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1000640 1 -- 172.21.15.192:0/2851746987 reap_dead start 2024-09-13T18:41:20.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 -- 172.21.15.192:0/2851746987 shutdown_connections 2024-09-13T18:41:20.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 -- 172.21.15.192:0/2851746987 >> 172.21.15.192:0/2851746987 conn(0x7f679c0cd660 msgr2=0x7f679c0cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:20.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 -- 172.21.15.192:0/2851746987 shutdown_connections 2024-09-13T18:41:20.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.207+0000 7f67a1a00640 1 -- 172.21.15.192:0/2851746987 wait complete. 2024-09-13T18:41:20.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.209+0000 7f67a1a00640 1 Processor -- start 2024-09-13T18:41:20.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.209+0000 7f67a1a00640 1 -- start start 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 0x7f679c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 0x7f679c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c13f4c0 con 0x7f679c153f50 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f679c0b4820 con 0x7f67800039a0 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f679c1543d0 con 0x7f679c13f040 2024-09-13T18:41:20.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:47336/0 (socket says 172.21.15.192:47336) 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 -- 172.21.15.192:0/853019815 learned_addr learned my addr 172.21.15.192:0/853019815 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1000640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 0x7f679c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679be00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 0x7f679c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 -- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 msgr2=0x7f679c0b58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 0x7f679c0b58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 -- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 msgr2=0x7f679c0b4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 0x7f679c0b4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679b400640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c0b3c10 con 0x7f679c153f50 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f67a1000640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 0x7f679c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.210+0000 7f679be00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 0x7f679c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:20.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f679b400640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f678800f7a0 tx=0x7f678800fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800feb0 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67880052e0 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f678800d730 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f679c0b3ef0 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.211+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f679c0b44b0 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.212+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f679c0b4670 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.213+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f678800d890 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.213+0000 7f6793e00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 0x7f677c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.214+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67880892e0 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.214+0000 7f679be00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 0x7f677c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.214+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=117}) v3 -- 0x7f677c072760 con 0x7f679c153f50 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.214+0000 7f679be00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 0x7f677c06d0f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f678c033000 tx=0x7f678c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:20.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.218+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6788054420 con 0x7f679c153f50 2024-09-13T18:41:20.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.386+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f679c0d0590 con 0x7f679c153f50 2024-09-13T18:41:20.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.388+0000 7f6793e00640 1 -- 172.21.15.192:0/853019815 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v116) v1 ==== 81+0+34222 (secure 0 0 0) 0x7f679c0d0590 con 0x7f679c153f50 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 116, 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:20.050803+0000", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:20.392 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:20.393 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:20.394 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:20.395 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:20.396 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:20.397 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:20.398 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.399 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:20.400 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:20.401 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:20.402 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:20.403 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.404 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:20.405 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:20.406 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:20.407 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:20.408 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:20.409 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:20.410 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.411 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:20.412 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:20.413 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.414 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.415 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.416 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.417 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.418 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.419 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.420 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.421 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:20.422 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:20.423 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:20.424 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.425 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.426 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.427 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.428 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.429 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.430 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:20.431 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.432 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.433 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.434 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.435 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.436 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.437 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:20.438 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.439 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.440 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.441 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:20.442 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.443 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.444 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.445 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.446 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.447 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:20.448 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.449 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.450 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.451 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.452 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.453 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:20.454 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:20.455 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.456 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.457 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.458 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.459 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:20.460 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.461 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.462 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.463 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.464 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.465 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:20.466 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:20.467 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:20.468 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:20.469 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 msgr2=0x7f677c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 0x7f677c06d0f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f678c033000 tx=0x7f678c008030 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 msgr2=0x7f679c13eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f678800f7a0 tx=0x7f678800fc60 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 shutdown_connections 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f677c06ac30 0x7f677c06d0f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f679c13f040 0x7f679c0b58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f679c153f50 0x7f679c13eb00 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 --2- 172.21.15.192:0/853019815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67800039a0 0x7f679c0b4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 >> 172.21.15.192:0/853019815 conn(0x7f679c0cd660 msgr2=0x7f679c15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:20.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 shutdown_connections 2024-09-13T18:41:20.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:20.390+0000 7f67a1a00640 1 -- 172.21.15.192:0/853019815 wait complete. 2024-09-13T18:41:20.472 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-13T18:41:20.472 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:20.472 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:20.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:20.508 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2024-09-13T18:41:20.912 INFO:teuthology.orchestra.run.smithi192.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-13T18:41:20.912 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:41:20.912 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:41:20.912 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.314205 s, 167 MB/s 2024-09-13T18:41:20.913 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:41:20.913 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:21.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.063+0000 7f6824a00640 1 Processor -- start 2024-09-13T18:41:21.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.063+0000 7f6824a00640 1 -- start start 2024-09-13T18:41:21.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f6824a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f682015b740 0x7f6820162690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f6824a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015bbd0 0x7f6820164be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f6824a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f682006ddd0 con 0x7f682015b360 2024-09-13T18:41:21.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f6824a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68200cfa50 con 0x7f682015b740 2024-09-13T18:41:21.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f6824a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6820152030 con 0x7f682015bbd0 2024-09-13T18:41:21.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f681f400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f682015b360 0x7f682006c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45508/0 (socket says 172.21.15.192:45508) 2024-09-13T18:41:21.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f681f400640 1 -- 172.21.15.192:0/2047492835 learned_addr learned my addr 172.21.15.192:0/2047492835 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:21.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f681ea00640 1 --2- 172.21.15.192:0/2047492835 >> v2:172.21.15.194:3300/0 conn(0x7f682015b740 0x7f6820162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.065+0000 7f681fe00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015bbd0 0x7f6820164be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.066+0000 7f681ea00640 1 -- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015bbd0 msgr2=0x7f6820164be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.066+0000 7f681ea00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015bbd0 0x7f6820164be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.066+0000 7f681ea00640 1 -- 172.21.15.192:0/2047492835 >> v1:172.21.15.192:6789/0 conn(0x7f682015b360 legacy=0x7f682006c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.066+0000 7f681ea00640 1 -- 172.21.15.192:0/2047492835 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682006f530 con 0x7f682015b740 2024-09-13T18:41:21.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.067+0000 7f681ea00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b740 0x7f6820162690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f680c0097a0 tx=0x7f680c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fcafb672f531518 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.073+0000 7f681e000640 1 -- 172.21.15.192:0/2047492835 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c032440 con 0x7f682015b740 2024-09-13T18:41:21.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.073+0000 7f681e000640 1 -- 172.21.15.192:0/2047492835 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c0325a0 con 0x7f682015b740 2024-09-13T18:41:21.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.073+0000 7f681e000640 1 -- 172.21.15.192:0/2047492835 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c032930 con 0x7f682015b740 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.073+0000 7f6824a00640 1 -- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b740 msgr2=0x7f6820162690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.073+0000 7f6824a00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b740 0x7f6820162690 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f680c0097a0 tx=0x7f680c02a180 comp rx=0 tx=0).stop 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 -- 172.21.15.192:0/2047492835 shutdown_connections 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015bbd0 0x7f6820164be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 --2- 172.21.15.192:0/2047492835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b740 0x7f6820162690 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 -- 172.21.15.192:0/2047492835 >> 172.21.15.192:0/2047492835 conn(0x7f68200b2e30 msgr2=0x7f68200b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 -- 172.21.15.192:0/2047492835 shutdown_connections 2024-09-13T18:41:21.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.074+0000 7f6824a00640 1 -- 172.21.15.192:0/2047492835 wait complete. 2024-09-13T18:41:21.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.075+0000 7f6824a00640 1 Processor -- start 2024-09-13T18:41:21.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.075+0000 7f6824a00640 1 -- start start 2024-09-13T18:41:21.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b360 0x7f682014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015b740 0x7f6820154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68201f3d60 con 0x7f682015bbd0 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820150ae0 con 0x7f682015b360 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.076+0000 7f6824a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68201f2e20 con 0x7f682015b740 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59324/0 (socket says 172.21.15.192:59324) 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 -- 172.21.15.192:0/4005957013 learned_addr learned my addr 172.21.15.192:0/4005957013 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681ea00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015b740 0x7f6820154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681f400640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b360 0x7f682014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 -- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015b740 msgr2=0x7f6820154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015b740 0x7f6820154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 -- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b360 msgr2=0x7f682014d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b360 0x7f682014d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c009400 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.077+0000 7f681fe00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6818009dd0 tx=0x7f681800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.078+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818014480 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.078+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681800f040 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.078+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818014840 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.078+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68201f30e0 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.078+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68201f36a0 con 0x7f682015bbd0 2024-09-13T18:41:21.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.079+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68200cf770 con 0x7f682015bbd0 2024-09-13T18:41:21.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.080+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f68180149a0 con 0x7f682015bbd0 2024-09-13T18:41:21.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.081+0000 7f6817400640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 0x7f680006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.081+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6818089dd0 con 0x7f682015bbd0 2024-09-13T18:41:21.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.081+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=118}) v3 -- 0x7f6800072730 con 0x7f682015bbd0 2024-09-13T18:41:21.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.081+0000 7f681f400640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 0x7f680006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.081+0000 7f681f400640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 0x7f680006d0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f682015a7b0 tx=0x7f6810007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.085+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6818055050 con 0x7f682015bbd0 2024-09-13T18:41:21.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.252+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6820067070 con 0x7f682015bbd0 2024-09-13T18:41:21.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.254+0000 7f6817400640 1 -- 172.21.15.192:0/4005957013 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v117) v1 ==== 81+0+34254 (secure 0 0 0) 0x7f6818058670 con 0x7f682015bbd0 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 117, 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:21.061033+0000", 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:21.257 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:21.258 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:21.259 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:21.260 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:21.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:21.262 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:21.263 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.264 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.265 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:21.266 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:21.267 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:21.268 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:21.269 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:21.270 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:21.271 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:21.272 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:21.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:21.274 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:21.275 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:21.276 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:21.277 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:21.278 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.279 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:21.280 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.281 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.282 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:21.283 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:21.284 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.285 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.286 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.287 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.288 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:21.289 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:21.290 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.291 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.292 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.293 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.294 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.295 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:21.296 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.297 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.298 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:21.299 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.300 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.301 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:21.302 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.303 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.304 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.305 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.307 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.308 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.309 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.310 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.311 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.312 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.313 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:21.314 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.315 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.317 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.318 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:21.319 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:21.320 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.321 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:21.323 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:21.325 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.326 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.327 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.328 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:21.329 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.330 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:21.331 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:21.332 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:21.333 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:21.334 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:21.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 msgr2=0x7f680006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 0x7f680006d0c0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f682015a7b0 tx=0x7f6810007e80 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 msgr2=0x7f68200af6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6818009dd0 tx=0x7f681800c490 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 shutdown_connections 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f680006ac00 0x7f680006d0c0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f682015bbd0 0x7f68200af6d0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f682015b740 0x7f6820154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 --2- 172.21.15.192:0/4005957013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f682015b360 0x7f682014d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 >> 172.21.15.192:0/4005957013 conn(0x7f68200b2e30 msgr2=0x7f68200b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 shutdown_connections 2024-09-13T18:41:21.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.256+0000 7f6824a00640 1 -- 172.21.15.192:0/4005957013 wait complete. 2024-09-13T18:41:21.337 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:21.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.486+0000 7f9e5f200640 1 Processor -- start 2024-09-13T18:41:21.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.486+0000 7f9e5f200640 1 -- start start 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9e600b3480 0x7f9e60159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5f200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e6015af60 con 0x7f9e60159b00 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6006b7a0 con 0x7f9e600b3480 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015ac80 con 0x7f9e6006bc30 2024-09-13T18:41:21.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9e600b3480 0x7f9e60159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5de00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9e60159b00 0x7f9e600b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45510/0 (socket says 172.21.15.192:45510) 2024-09-13T18:41:21.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5de00640 1 -- 172.21.15.192:0/341454152 learned_addr learned my addr 172.21.15.192:0/341454152 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:21.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.487+0000 7f9e5d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9e600b3480 0x7f9e60159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59338/0 (socket says 172.21.15.192:59338) 2024-09-13T18:41:21.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5e800640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5d400640 1 -- 172.21.15.192:0/341454152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 msgr2=0x7f9e6015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5d400640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5d400640 1 -- 172.21.15.192:0/341454152 >> v1:172.21.15.192:6789/0 conn(0x7f9e60159b00 legacy=0x7f9e600b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5d400640 1 -- 172.21.15.192:0/341454152 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e6006b150 con 0x7f9e600b3480 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5ca00640 1 -- 172.21.15.192:0/341454152 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2823587223 0 0) 0x7f9e6015af60 con 0x7f9e60159b00 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.488+0000 7f9e5e800640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.489+0000 7f9e5d400640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60159ee0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0097a0 tx=0x7f9e4c02a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4d04ae0ba9bb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.489+0000 7f9e5ca00640 1 -- 172.21.15.192:0/341454152 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c032440 con 0x7f9e600b3480 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.489+0000 7f9e5ca00640 1 -- 172.21.15.192:0/341454152 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c0325a0 con 0x7f9e600b3480 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.489+0000 7f9e5ca00640 1 -- 172.21.15.192:0/341454152 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c032930 con 0x7f9e600b3480 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 -- 172.21.15.192:0/341454152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 msgr2=0x7f9e60159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60159ee0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c0097a0 tx=0x7f9e4c02a180 comp rx=0 tx=0).stop 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 -- 172.21.15.192:0/341454152 shutdown_connections 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 --2- 172.21.15.192:0/341454152 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60159ee0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 -- 172.21.15.192:0/341454152 >> 172.21.15.192:0/341454152 conn(0x7f9e600736d0 msgr2=0x7f9e600b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 -- 172.21.15.192:0/341454152 shutdown_connections 2024-09-13T18:41:21.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.490+0000 7f9e5f200640 1 -- 172.21.15.192:0/341454152 wait complete. 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.491+0000 7f9e5f200640 1 Processor -- start 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.491+0000 7f9e5f200640 1 -- start start 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e60159b00 0x7f9e6015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015c800 con 0x7f9e600b3480 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015ae60 con 0x7f9e60159b00 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.492+0000 7f9e5f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6015ca80 con 0x7f9e6006bc30 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59346/0 (socket says 172.21.15.192:59346) 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 -- 172.21.15.192:0/1533137249 learned_addr learned my addr 172.21.15.192:0/1533137249 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5de00640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5e800640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e60159b00 0x7f9e6015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 -- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 msgr2=0x7f9e6015c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 -- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e60159b00 msgr2=0x7f9e6015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e60159b00 0x7f9e6015b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e4c009400 con 0x7f9e600b3480 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.493+0000 7f9e5d400640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c000c00 tx=0x7f9e4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.494+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c004230 con 0x7f9e600b3480 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.494+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4c004390 con 0x7f9e600b3480 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.494+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4c030ba0 con 0x7f9e600b3480 2024-09-13T18:41:21.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.494+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e6015cd60 con 0x7f9e600b3480 2024-09-13T18:41:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.494+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e6015d040 con 0x7f9e600b3480 2024-09-13T18:41:21.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.495+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e600b2d70 con 0x7f9e600b3480 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.496+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9e4c039050 con 0x7f9e600b3480 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.497+0000 7f9e56000640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 0x7f9e4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.497+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e4c0a9d10 con 0x7f9e600b3480 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.497+0000 7f9e5de00640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 0x7f9e4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.497+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=118}) v3 -- 0x7f9e40072730 con 0x7f9e600b3480 2024-09-13T18:41:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.497+0000 7f9e5de00640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 0x7f9e4006d0c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9e50007fd0 tx=0x7f9e50007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:21.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.501+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9e4c04b020 con 0x7f9e600b3480 2024-09-13T18:41:21.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.701+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e600b3c70 con 0x7f9e600b3480 2024-09-13T18:41:21.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.702+0000 7f9e56000640 1 -- 172.21.15.192:0/1533137249 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f9e4c037070 con 0x7f9e600b3480 2024-09-13T18:41:21.705 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:21.705 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:21.706 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:21.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 msgr2=0x7f9e4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 0x7f9e4006d0c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9e50007fd0 tx=0x7f9e50007de0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 msgr2=0x7f9e60149310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c000c00 tx=0x7f9e4c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 shutdown_connections 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9e4006ac00 0x7f9e4006d0c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9e60159b00 0x7f9e6015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9e600b3480 0x7f9e60149310 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 --2- 172.21.15.192:0/1533137249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9e6006bc30 0x7f9e6015c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 >> 172.21.15.192:0/1533137249 conn(0x7f9e600736d0 msgr2=0x7f9e6015de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:21.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 shutdown_connections 2024-09-13T18:41:21.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:21.704+0000 7f9e5f200640 1 -- 172.21.15.192:0/1533137249 wait complete. 2024-09-13T18:41:21.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-13T18:41:21.892 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":6550,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":20.943132746,"mdsmap_epoch":47,"osdmap_epoch":117,"osdmap_epoch_barrier":116,"uptime":25.922001659999999} 2024-09-13T18:41:21.892 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 6550, "mdsmap_epoch": 47, "osdmap_epoch": 117, "osdmap_epoch_barrier": 116, "rank_uptime": 20.943132746, "state": "up:active", "uptime": 25.92200166, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:41:21.892 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:41:21.893 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:21.893 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:21.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:21.928 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2024-09-13T18:41:22.003 INFO:teuthology.orchestra.run.smithi192.stderr:dd: failed to open 'small_file_1': Permission denied 2024-09-13T18:41:22.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:41:22.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:22.005 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-13T18:41:22.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:22.084 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-13T18:41:22.229 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:22.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.383+0000 7f9125a00640 1 Processor -- start 2024-09-13T18:41:22.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.383+0000 7f9125a00640 1 -- start start 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.384+0000 7f9125a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91200b0490 0x7f91200cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.384+0000 7f9125a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912015ec00 con 0x7f91200cacd0 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f9125a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9120140480 con 0x7f912015e790 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f9125a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91200cb5f0 con 0x7f91200b0490 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f91200cacd0 0x7f9120140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45520/0 (socket says 172.21.15.192:45520) 2024-09-13T18:41:22.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911ea00640 1 -- 172.21.15.192:0/1994229997 learned_addr learned my addr 172.21.15.192:0/1994229997 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911f400640 1 --2- 172.21.15.192:0/1994229997 >> v2:172.21.15.194:3300/0 conn(0x7f91200b0490 0x7f91200cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911e000640 1 -- 172.21.15.192:0/1994229997 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250280997 0 0) 0x7f912015ec00 con 0x7f91200cacd0 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911e000640 1 -- 172.21.15.192:0/1994229997 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9104003520 con 0x7f91200cacd0 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911f400640 1 -- 172.21.15.192:0/1994229997 >> v1:172.21.15.194:6789/0 conn(0x7f912015e790 legacy=0x7f91200afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911f400640 1 -- 172.21.15.192:0/1994229997 >> v1:172.21.15.192:6789/0 conn(0x7f91200cacd0 legacy=0x7f9120140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.385+0000 7f911f400640 1 -- 172.21.15.192:0/1994229997 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912015ee90 con 0x7f91200b0490 2024-09-13T18:41:22.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.386+0000 7f911f400640 1 --2- 172.21.15.192:0/1994229997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200b0490 0x7f91200cb0b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9118009d90 tx=0x7f911802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6048b8388b4bd4d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:22.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.387+0000 7f911e000640 1 -- 172.21.15.192:0/1994229997 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118007740 con 0x7f91200b0490 2024-09-13T18:41:22.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.387+0000 7f911e000640 1 -- 172.21.15.192:0/1994229997 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911802d050 con 0x7f91200b0490 2024-09-13T18:41:22.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.387+0000 7f911e000640 1 -- 172.21.15.192:0/1994229997 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9118007ac0 con 0x7f91200b0490 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 -- 172.21.15.192:0/1994229997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200b0490 msgr2=0x7f91200cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 --2- 172.21.15.192:0/1994229997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200b0490 0x7f91200cb0b0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9118009d90 tx=0x7f911802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 -- 172.21.15.192:0/1994229997 shutdown_connections 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 --2- 172.21.15.192:0/1994229997 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200b0490 0x7f91200cb0b0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 -- 172.21.15.192:0/1994229997 >> 172.21.15.192:0/1994229997 conn(0x7f91200ae960 msgr2=0x7f912006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 -- 172.21.15.192:0/1994229997 shutdown_connections 2024-09-13T18:41:22.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.388+0000 7f9125a00640 1 -- 172.21.15.192:0/1994229997 wait complete. 2024-09-13T18:41:22.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.389+0000 7f9125a00640 1 Processor -- start 2024-09-13T18:41:22.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 -- start start 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 0x7f9120156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e790 0x7f912015a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9120157b80 con 0x7f91200b0490 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f912013d600 con 0x7f91200cacd0 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.390+0000 7f9125a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9120156cb0 con 0x7f912015e790 2024-09-13T18:41:22.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59360/0 (socket says 172.21.15.192:59360) 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 -- 172.21.15.192:0/1842824289 learned_addr learned my addr 172.21.15.192:0/1842824289 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911f400640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e790 0x7f912015a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f9116000640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 0x7f9120156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 -- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e790 msgr2=0x7f912015a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e790 0x7f912015a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 -- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 msgr2=0x7f9120156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 0x7f9120156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9118009a70 con 0x7f91200b0490 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f9116000640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 0x7f9120156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.391+0000 7f911ea00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f911000c500 tx=0x7f911000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.392+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110005ce0 con 0x7f91200b0490 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.392+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9110005e40 con 0x7f91200b0490 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.392+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9120156f00 con 0x7f91200b0490 2024-09-13T18:41:22.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.392+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9110007330 con 0x7f91200b0490 2024-09-13T18:41:22.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.392+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91201574c0 con 0x7f91200b0490 2024-09-13T18:41:22.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.393+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91200cb0b0 con 0x7f91200b0490 2024-09-13T18:41:22.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.394+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9110007550 con 0x7f91200b0490 2024-09-13T18:41:22.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.394+0000 7f9117400640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 0x7f90fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:22.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.395+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91100889c0 con 0x7f91200b0490 2024-09-13T18:41:22.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.395+0000 7f9116000640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 0x7f90fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:22.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.395+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=119}) v3 -- 0x7f90fc072730 con 0x7f91200b0490 2024-09-13T18:41:22.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.395+0000 7f9116000640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 0x7f90fc06d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9108007fd0 tx=0x7f9108009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:22.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.399+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9110017020 con 0x7f91200b0490 2024-09-13T18:41:22.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.569+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f912006c6c0 con 0x7f91200b0490 2024-09-13T18:41:22.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.571+0000 7f9117400640 1 -- 172.21.15.192:0/1842824289 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v118) v1 ==== 81+0+34222 (secure 0 0 0) 0x7f9110053d00 con 0x7f91200b0490 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 118, 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:22.066240+0000", 2024-09-13T18:41:22.574 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:22.575 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:22.576 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:22.577 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.578 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:22.579 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:22.580 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:22.581 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:22.582 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:22.583 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:22.584 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:22.585 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:22.586 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:22.587 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.588 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:22.589 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 3, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full", 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:22.590 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:22.591 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "113", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:22.592 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:22.593 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:22.594 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:22.595 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:22.596 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.597 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.598 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.599 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.600 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:22.601 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:22.602 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.603 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.604 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.605 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.606 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.607 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.608 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:22.609 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.610 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.611 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.612 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.613 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.614 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.615 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:22.616 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:22.617 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:22.618 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.619 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:22.620 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.621 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.622 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:22.624 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:22.625 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.626 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:22.627 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:22.628 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.629 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.630 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.631 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.632 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.638 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:22.639 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.643 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.644 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "full", 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:22.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.646 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.647 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.648 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:22.649 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.650 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:22.651 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:22.652 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:22.653 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:22.654 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:22.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 msgr2=0x7f90fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 0x7f90fc06d0c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9108007fd0 tx=0x7f9108009040 comp rx=0 tx=0).stop 2024-09-13T18:41:22.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 msgr2=0x7f912013d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:22.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f911000c500 tx=0x7f911000c9c0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 shutdown_connections 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f90fc06ac00 0x7f90fc06d0c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f912015e790 0x7f912015a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91200cacd0 0x7f9120156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 --2- 172.21.15.192:0/1842824289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91200b0490 0x7f912013d0c0 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 >> 172.21.15.192:0/1842824289 conn(0x7f91200ae960 msgr2=0x7f91200afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 shutdown_connections 2024-09-13T18:41:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:22.573+0000 7f9125a00640 1 -- 172.21.15.192:0/1842824289 wait complete. 2024-09-13T18:41:22.658 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:41:25.141 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:41:25.140+0000 7f90a9800640 -1 log_channel(cluster) log [ERR] : Health check update: 2 full osd(s) (OSD_FULL) 2024-09-13T18:41:27.659 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:27.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.819+0000 7f612d200640 1 Processor -- start 2024-09-13T18:41:27.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.820+0000 7f612d200640 1 -- start start 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f612d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6128159b00 0x7f61280b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f612d200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612806bc30 0x7f61280b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f612d200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612815af60 con 0x7f6128159ee0 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f612d200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612815aaa0 con 0x7f612806bc30 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f612d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612806b7a0 con 0x7f6128159b00 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f6126a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612806bc30 0x7f61280b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f6126a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f612806bc30 0x7f61280b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59370/0 (socket says 172.21.15.192:59370) 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.821+0000 7f6126a00640 1 -- 172.21.15.192:0/213734993 learned_addr learned my addr 172.21.15.192:0/213734993 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:27.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.822+0000 7f6127400640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6128159b00 0x7f61280b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.822+0000 7f6126a00640 1 -- 172.21.15.192:0/213734993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6128159b00 msgr2=0x7f61280b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:27.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.822+0000 7f6126a00640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6128159b00 0x7f61280b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:27.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.822+0000 7f6126a00640 1 -- 172.21.15.192:0/213734993 >> v1:172.21.15.194:6789/0 conn(0x7f6128159ee0 legacy=0x7f612815a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:27.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.822+0000 7f6126a00640 1 -- 172.21.15.192:0/213734993 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612815ac80 con 0x7f612806bc30 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f6126a00640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612806bc30 0x7f61280b32b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6114009870 tx=0x7f611402c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7ce62775e0eb8d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f6126000640 1 -- 172.21.15.192:0/213734993 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114031710 con 0x7f612806bc30 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f6126000640 1 -- 172.21.15.192:0/213734993 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611402f050 con 0x7f612806bc30 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f6126000640 1 -- 172.21.15.192:0/213734993 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6114031a90 con 0x7f612806bc30 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f612d200640 1 -- 172.21.15.192:0/213734993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612806bc30 msgr2=0x7f61280b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:27.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.823+0000 7f612d200640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612806bc30 0x7f61280b32b0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f6114009870 tx=0x7f611402c420 comp rx=0 tx=0).stop 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 -- 172.21.15.192:0/213734993 shutdown_connections 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612806bc30 0x7f61280b32b0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 --2- 172.21.15.192:0/213734993 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6128159b00 0x7f61280b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 -- 172.21.15.192:0/213734993 >> 172.21.15.192:0/213734993 conn(0x7f61280736d0 msgr2=0x7f61280b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 -- 172.21.15.192:0/213734993 shutdown_connections 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.824+0000 7f612d200640 1 -- 172.21.15.192:0/213734993 wait complete. 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.825+0000 7f612d200640 1 Processor -- start 2024-09-13T18:41:27.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.825+0000 7f612d200640 1 -- start start 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612806bc30 0x7f61281ef2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6128159ee0 0x7f61281586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128151f80 con 0x7f6128159b00 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6128151770 con 0x7f6128159ee0 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f612d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61281ef810 con 0x7f612806bc30 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.826+0000 7f6126a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59378/0 (socket says 172.21.15.192:59378) 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 -- 172.21.15.192:0/644627361 learned_addr learned my addr 172.21.15.192:0/644627361 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6127400640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612806bc30 0x7f61281ef2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6127e00640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6128159ee0 0x7f61281586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 -- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612806bc30 msgr2=0x7f61281ef2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612806bc30 0x7f61281ef2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 -- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6128159ee0 msgr2=0x7f61281586e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6128159ee0 0x7f61281586e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 -- 172.21.15.192:0/644627361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61140094d0 con 0x7f6128159b00 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f6126a00640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6114000c00 tx=0x7f61140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:27.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.827+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611403c810 con 0x7f6128159b00 2024-09-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.828+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611403c970 con 0x7f6128159b00 2024-09-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.828+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611403cd20 con 0x7f6128159b00 2024-09-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.828+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61281519c0 con 0x7f6128159b00 2024-09-13T18:41:27.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.828+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61281eead0 con 0x7f6128159b00 2024-09-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.829+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612815a390 con 0x7f6128159b00 2024-09-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.829+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f611403a040 con 0x7f6128159b00 2024-09-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.831+0000 7f611f400640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.831+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61140abb60 con 0x7f6128159b00 2024-09-13T18:41:27.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.831+0000 7f6127400640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:27.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.831+0000 7f6127400640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6118003b80 tx=0x7f61180098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:27.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:27.835+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6114076e80 con 0x7f6128159b00 2024-09-13T18:41:28.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.004+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f61280b3c70 con 0x7f6128159b00 2024-09-13T18:41:28.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.005+0000 7f611f400640 1 -- 172.21.15.192:0/644627361 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v122) v1 ==== 81+0+34079 (secure 0 0 0) 0x7f6114038090 con 0x7f6128159b00 2024-09-13T18:41:28.007 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 122, 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:27.153667+0000", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:28.008 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:28.009 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.010 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:28.011 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.012 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.013 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.014 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.015 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.016 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.016 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.016 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.016 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.017 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.018 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.019 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.020 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.021 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.022 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.023 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.024 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.025 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:28.026 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.027 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.028 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.029 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.031 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:28.032 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:28.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.033 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.033 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:28.033 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:28.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.034 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.035 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.036 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.037 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.038 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.039 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.040 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.041 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.043 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.044 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.045 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.046 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.047 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.048 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:28.049 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:28.050 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.051 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.052 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:28.053 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:28.054 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:28.055 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.056 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.057 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.058 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.059 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.060 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.061 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:28.062 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.063 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.068 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.070 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.072 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.074 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.075 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.076 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.077 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.078 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.079 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:28.080 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.081 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:28.082 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:28.083 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.084 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.085 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:28.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:28.087 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.088 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 msgr2=0x7f610806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6118003b80 tx=0x7f61180098d0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 msgr2=0x7f6128153370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f6114000c00 tx=0x7f61140046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 shutdown_connections 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f610806ac00 0x7f610806d0c0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6128159ee0 0x7f61281586e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6128159b00 0x7f6128153370 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 --2- 172.21.15.192:0/644627361 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f612806bc30 0x7f61281ef2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.007+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 >> 172.21.15.192:0/644627361 conn(0x7f61280736d0 msgr2=0x7f61280cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:28.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.008+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 shutdown_connections 2024-09-13T18:41:28.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.008+0000 7f612d200640 1 -- 172.21.15.192:0/644627361 wait complete. 2024-09-13T18:41:28.091 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-13T18:41:28.091 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:41:28.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.241+0000 7f2587000640 1 Processor -- start 2024-09-13T18:41:28.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.242+0000 7f2587000640 1 -- start start 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2587000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2580159b00 0x7f25800b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2587000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f25800b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2587000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258015af60 con 0x7f258006bc30 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2587000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f258015aa80 con 0x7f2580159b00 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2587000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258006b7a0 con 0x7f258015a5f0 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2585200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f258006bc30 0x7f2580159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45522/0 (socket says 172.21.15.192:45522) 2024-09-13T18:41:28.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.243+0000 7f2585200640 1 -- 172.21.15.192:0/1175452466 learned_addr learned my addr 172.21.15.192:0/1175452466 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:28.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f2585c00640 1 --2- 172.21.15.192:0/1175452466 >> v2:172.21.15.194:3300/0 conn(0x7f2580159b00 0x7f25800b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f2586600640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f25800b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440429272 0 0) 0x7f258015af60 con 0x7f258006bc30 2024-09-13T18:41:28.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2568003520 con 0x7f258006bc30 2024-09-13T18:41:28.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2761106774 0 0) 0x7f2568003520 con 0x7f258006bc30 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 msgr2=0x7f25800b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f25800b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 >> v2:172.21.15.194:3300/0 conn(0x7f2580159b00 msgr2=0x7f25800b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 --2- 172.21.15.192:0/1175452466 >> v2:172.21.15.194:3300/0 conn(0x7f2580159b00 0x7f25800b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258015ac80 con 0x7f258006bc30 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f256c001670 con 0x7f258006bc30 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 >> v1:172.21.15.192:6789/0 conn(0x7f258006bc30 legacy=0x7f2580159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2568003970 0x7f2568003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25680047c0 0x7f2568004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f2568005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258015aa80 con 0x7f25680047c0 2024-09-13T18:41:28.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258006b7a0 con 0x7f2568003970 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256800db90 con 0x7f258015a5f0 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f2585200640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25680047c0 0x7f2568004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.244+0000 7f2585c00640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2568003970 0x7f2568003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2586600640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f2568005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2585200640 1 -- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 msgr2=0x7f2568005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2585200640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f258015a5f0 0x7f2568005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2585200640 1 -- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2568003970 msgr2=0x7f2568003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2585200640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2568003970 0x7f2568003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.245+0000 7f2585200640 1 -- 172.21.15.192:0/1175452466 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2568003520 con 0x7f25680047c0 2024-09-13T18:41:28.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f2585200640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25680047c0 0x7f2568004c40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c210 tx=0x7f25680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93b7f253d4660a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c02e070 con 0x7f25680047c0 2024-09-13T18:41:28.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c0058d0 con 0x7f25680047c0 2024-09-13T18:41:28.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f257fe00640 1 -- 172.21.15.192:0/1175452466 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c005c80 con 0x7f25680047c0 2024-09-13T18:41:28.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f2587000640 1 -- 172.21.15.192:0/1175452466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25680047c0 msgr2=0x7f2568004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.246+0000 7f2587000640 1 --2- 172.21.15.192:0/1175452466 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25680047c0 0x7f2568004c40 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f256c00c210 tx=0x7f25680057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.247+0000 7f2586600640 1 -- 172.21.15.192:0/1175452466 reap_dead start 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.247+0000 7f2587000640 1 -- 172.21.15.192:0/1175452466 shutdown_connections 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.247+0000 7f2587000640 1 -- 172.21.15.192:0/1175452466 >> 172.21.15.192:0/1175452466 conn(0x7f25800736d0 msgr2=0x7f25800b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.247+0000 7f2587000640 1 -- 172.21.15.192:0/1175452466 shutdown_connections 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.247+0000 7f2587000640 1 -- 172.21.15.192:0/1175452466 wait complete. 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.248+0000 7f2587000640 1 Processor -- start 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.248+0000 7f2587000640 1 -- start start 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680047c0 0x7f258014d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2580158470 0x7f25801588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2580158e30 con 0x7f258015bae0 2024-09-13T18:41:28.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25801515e0 con 0x7f25680047c0 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2587000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2580151830 con 0x7f2580158470 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.249+0000 7f2585200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59390/0 (socket says 172.21.15.192:59390) 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 -- 172.21.15.192:0/3834687883 learned_addr learned my addr 172.21.15.192:0/3834687883 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2586600640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2580158470 0x7f25801588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585c00640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680047c0 0x7f258014d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 -- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2580158470 msgr2=0x7f25801588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2580158470 0x7f25801588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 -- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680047c0 msgr2=0x7f258014d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680047c0 0x7f258014d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 -- 172.21.15.192:0/3834687883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258015b000 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.250+0000 7f2585200640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f256c02adf0 tx=0x7f258006b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.251+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c005e70 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.251+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256c001c70 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.251+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256c007480 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.251+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258015b2e0 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.251+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2580151b10 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.252+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2580151ca0 con 0x7f258015bae0 2024-09-13T18:41:28.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.253+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f256c0075e0 con 0x7f258015bae0 2024-09-13T18:41:28.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.253+0000 7f257d600640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 0x7f256006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.254+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f256c0a9200 con 0x7f258015bae0 2024-09-13T18:41:28.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.254+0000 7f2585c00640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 0x7f256006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.254+0000 7f2585c00640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 0x7f256006d0f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2574009b40 tx=0x7f2574009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.258+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f256c074510 con 0x7f258015bae0 2024-09-13T18:41:28.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.430+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2580151ca0 con 0x7f258015bae0 2024-09-13T18:41:28.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.431+0000 7f257d600640 1 -- 172.21.15.192:0/3834687883 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v122) v1 ==== 81+0+34079 (secure 0 0 0) 0x7f256c077b30 con 0x7f258015bae0 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 122, 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:41:27.153667+0000", 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:41:28.435 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:41:28.436 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 13, 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.437 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.438 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.439 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.440 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.441 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.442 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.443 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 12, 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:41:28.444 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:58.888332+0000", 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.445 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.446 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.447 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.448 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.449 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.75, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.75, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.75, 2024-09-13T18:41:28.450 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.75, 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 13, 2024-09-13T18:41:28.451 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:40:59.927636+0000", 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:41:28.452 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:41:28.453 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:41:28.454 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:41:28.455 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:41:28.456 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:41:28.457 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.458 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.459 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:41:28.460 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.461 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.462 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.463 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.464 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.465 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.466 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.467 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.468 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.469 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.470 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.471 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.472 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.473 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.474 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.475 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.476 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.477 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.478 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.479 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.480 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.481 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.482 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.483 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.484 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.485 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.486 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.487 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.488 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.489 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.490 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.491 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.492 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.493 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.494 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.495 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.496 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.497 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.498 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.499 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.500 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:41:28.501 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 110, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.502 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.503 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.504 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:41:28.505 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.506 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.507 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.508 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:41:28.509 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.510 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.511 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.512 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:41:28.513 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:41:28.514 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:41:28.515 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:41:28.516 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:41:28.516 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:41:28.516 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:41:28.516 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:28.516 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 msgr2=0x7f256006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 0x7f256006d0f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2574009b40 tx=0x7f2574009190 comp rx=0 tx=0).stop 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 msgr2=0x7f2580153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f256c02adf0 tx=0x7f258006b710 comp rx=0 tx=0).stop 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 shutdown_connections 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f256006ac30 0x7f256006d0f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2580158470 0x7f25801588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f258015bae0 0x7f2580153100 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 --2- 172.21.15.192:0/3834687883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25680047c0 0x7f258014d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 >> 172.21.15.192:0/3834687883 conn(0x7f25800736d0 msgr2=0x7f2580155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:28.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 shutdown_connections 2024-09-13T18:41:28.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.434+0000 7f2587000640 1 -- 172.21.15.192:0/3834687883 wait complete. 2024-09-13T18:41:28.519 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:28.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.670+0000 7f1e9a000640 1 Processor -- start 2024-09-13T18:41:28.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.670+0000 7f1e9a000640 1 -- start start 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.671+0000 7f1e9a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e940cacd0 0x7f1e9415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.671+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e9a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e94140480 con 0x7f1e94140980 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e9a000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e9415c160 con 0x7f1e940cacd0 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e9a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9415ee90 con 0x7f1e940cb0b0 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e940cacd0 0x7f1e9415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1e94140980 0x7f1e940afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45530/0 (socket says 172.21.15.192:45530) 2024-09-13T18:41:28.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93e00640 1 -- 172.21.15.192:0/654998316 learned_addr learned my addr 172.21.15.192:0/654998316 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e8aa00640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93400640 1 -- 172.21.15.192:0/654998316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 msgr2=0x7f1e9415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93400640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93400640 1 -- 172.21.15.192:0/654998316 >> v1:172.21.15.192:6789/0 conn(0x7f1e94140980 legacy=0x7f1e940afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e93400640 1 -- 172.21.15.192:0/654998316 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e9415f170 con 0x7f1e940cacd0 2024-09-13T18:41:28.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.672+0000 7f1e92a00640 1 -- 172.21.15.192:0/654998316 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275547488 0 0) 0x7f1e94140480 con 0x7f1e94140980 2024-09-13T18:41:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.673+0000 7f1e93400640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e9415e790 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097a0 tx=0x7f1e8402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be8e450c62782bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e92a00640 1 -- 172.21.15.192:0/654998316 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84032440 con 0x7f1e940cacd0 2024-09-13T18:41:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e92a00640 1 -- 172.21.15.192:0/654998316 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e840325a0 con 0x7f1e940cacd0 2024-09-13T18:41:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e92a00640 1 -- 172.21.15.192:0/654998316 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84032930 con 0x7f1e940cacd0 2024-09-13T18:41:28.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 -- 172.21.15.192:0/654998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 msgr2=0x7f1e9415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e9415e790 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1e840097a0 tx=0x7f1e8402a180 comp rx=0 tx=0).stop 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 -- 172.21.15.192:0/654998316 shutdown_connections 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 --2- 172.21.15.192:0/654998316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e9415e790 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 -- 172.21.15.192:0/654998316 >> 172.21.15.192:0/654998316 conn(0x7f1e940ae960 msgr2=0x7f1e9406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 -- 172.21.15.192:0/654998316 shutdown_connections 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.674+0000 7f1e9a000640 1 -- 172.21.15.192:0/654998316 wait complete. 2024-09-13T18:41:28.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.676+0000 7f1e9a000640 1 Processor -- start 2024-09-13T18:41:28.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.676+0000 7f1e9a000640 1 -- start start 2024-09-13T18:41:28.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9406a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 0x7f1e9412edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9412fd40 con 0x7f1e940cacd0 2024-09-13T18:41:28.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94071d30 con 0x7f1e94140980 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e9a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e9406a710 con 0x7f1e940cb0b0 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e93400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e93400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59402/0 (socket says 172.21.15.192:59402) 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.677+0000 7f1e93400640 1 -- 172.21.15.192:0/42755718 learned_addr learned my addr 172.21.15.192:0/42755718 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 -- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 msgr2=0x7f1e9406a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9406a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 -- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 msgr2=0x7f1e9412edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93e00640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 0x7f1e9412edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 0x7f1e9412edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 -- 172.21.15.192:0/42755718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e84009400 con 0x7f1e940cacd0 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93e00640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 0x7f1e9412edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e93400640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1e84035040 tx=0x7f1e840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84006e10 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e84032e90 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e84030be0 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.678+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e94071f20 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.679+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e9412f960 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.680+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e9412fe80 con 0x7f1e940cacd0 2024-09-13T18:41:28.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.680+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e84039040 con 0x7f1e940cacd0 2024-09-13T18:41:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.681+0000 7f1e8be00640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 0x7f1e7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.681+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e840a9c40 con 0x7f1e940cacd0 2024-09-13T18:41:28.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.682+0000 7f1e8aa00640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 0x7f1e7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:28.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.682+0000 7f1e8aa00640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 0x7f1e7006d0c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e940ae5e0 tx=0x7f1e7c009500 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:28.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.685+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e9412fe80 con 0x7f1e940cacd0 2024-09-13T18:41:28.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.886+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e9412fe80 con 0x7f1e940cacd0 2024-09-13T18:41:28.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.886+0000 7f1e8be00640 1 -- 172.21.15.192:0/42755718 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f1e9412fe80 con 0x7f1e940cacd0 2024-09-13T18:41:28.889 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:28.889 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:28.889 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:28.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 msgr2=0x7f1e7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 0x7f1e7006d0c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1e940ae5e0 tx=0x7f1e7c009500 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 msgr2=0x7f1e940717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f1e84035040 tx=0x7f1e840046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 shutdown_connections 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e7006ac00 0x7f1e7006d0c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e94140980 0x7f1e9412edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e940cb0b0 0x7f1e9406a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 --2- 172.21.15.192:0/42755718 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e940cacd0 0x7f1e940717f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.888+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 >> 172.21.15.192:0/42755718 conn(0x7f1e940ae960 msgr2=0x7f1e9415caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.889+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 shutdown_connections 2024-09-13T18:41:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:28.889+0000 7f1e9a000640 1 -- 172.21.15.192:0/42755718 wait complete. 2024-09-13T18:41:28.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-13T18:41:29.078 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":6550,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":28.129156638000001,"mdsmap_epoch":47,"osdmap_epoch":122,"osdmap_epoch_barrier":116,"uptime":33.108024554000004} 2024-09-13T18:41:29.078 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 6550, "mdsmap_epoch": 47, "osdmap_epoch": 122, "osdmap_epoch_barrier": 116, "rank_uptime": 28.129156638, "state": "up:active", "uptime": 33.108024554, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:41:29.078 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:41:29.078 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:29.078 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:29.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:29.114 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-13T18:41:29.543 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:41:29.543 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:41:29.543 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.351721 s, 149 MB/s 2024-09-13T18:41:29.544 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:41:29.544 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:41:29.620 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:41:29.709 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:41:29.710 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:29.710 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:29.745 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:29.745 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:29.821 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:30.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.011+0000 7fa2a6800640 1 Processor -- start 2024-09-13T18:41:30.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.011+0000 7fa2a6800640 1 -- start start 2024-09-13T18:41:30.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2a00b6160 0x7fa2a00cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa2a00adf00 0x7fa2a00ae390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2a00ada70 con 0x7fa2a00af890 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a6800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00d0560 con 0x7fa2a00b6160 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2a00cfcc0 con 0x7fa2a00adf00 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa2a00b6160 0x7fa2a00cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a5400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa2a00af890 0x7fa2a00afc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45534/0 (socket says 172.21.15.192:45534) 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.012+0000 7fa2a5400640 1 -- 172.21.15.192:0/854938628 learned_addr learned my addr 172.21.15.192:0/854938628 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa2a5e00640 1 --2- 172.21.15.192:0/854938628 >> v2:172.21.15.194:3300/0 conn(0x7fa2a00adf00 0x7fa2a00ae390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa2a4a00640 1 -- 172.21.15.192:0/854938628 >> v2:172.21.15.194:3300/0 conn(0x7fa2a00adf00 msgr2=0x7fa2a00ae390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa2a4a00640 1 --2- 172.21.15.192:0/854938628 >> v2:172.21.15.194:3300/0 conn(0x7fa2a00adf00 0x7fa2a00ae390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa2a4a00640 1 -- 172.21.15.192:0/854938628 >> v1:172.21.15.192:6789/0 conn(0x7fa2a00af890 legacy=0x7fa2a00afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa2a4a00640 1 -- 172.21.15.192:0/854938628 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2a00cffa0 con 0x7fa2a00b6160 2024-09-13T18:41:30.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.013+0000 7fa29fe00640 1 -- 172.21.15.192:0/854938628 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972328592 0 0) 0x7fa2a00ada70 con 0x7fa2a00af890 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.014+0000 7fa2a4a00640 1 --2- 172.21.15.192:0/854938628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00cf470 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0070a50 tx=0x7fa28c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c1039176a14849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.014+0000 7fa29fe00640 1 -- 172.21.15.192:0/854938628 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c032440 con 0x7fa2a00b6160 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.014+0000 7fa29fe00640 1 -- 172.21.15.192:0/854938628 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c0325a0 con 0x7fa2a00b6160 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.014+0000 7fa29fe00640 1 -- 172.21.15.192:0/854938628 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c032930 con 0x7fa2a00b6160 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.014+0000 7fa2a6800640 1 -- 172.21.15.192:0/854938628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 msgr2=0x7fa2a00cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 --2- 172.21.15.192:0/854938628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00cf470 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fa2a0070a50 tx=0x7fa28c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 -- 172.21.15.192:0/854938628 shutdown_connections 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 --2- 172.21.15.192:0/854938628 >> v2:172.21.15.194:3300/0 conn(0x7fa2a00adf00 0x7fa2a00ae390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 --2- 172.21.15.192:0/854938628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00cf470 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 -- 172.21.15.192:0/854938628 >> 172.21.15.192:0/854938628 conn(0x7fa2a00cd660 msgr2=0x7fa2a00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 -- 172.21.15.192:0/854938628 shutdown_connections 2024-09-13T18:41:30.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.015+0000 7fa2a6800640 1 -- 172.21.15.192:0/854938628 wait complete. 2024-09-13T18:41:30.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.016+0000 7fa2a6800640 1 Processor -- start 2024-09-13T18:41:30.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.016+0000 7fa2a6800640 1 -- start start 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a00adf00 0x7fa2a0137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2a00af890 0x7fa2a00b1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0137fa0 con 0x7fa2a00b6160 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a006ae00 con 0x7fa2a00adf00 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.017+0000 7fa2a6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2a0135120 con 0x7fa2a00af890 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59418/0 (socket says 172.21.15.192:59418) 2024-09-13T18:41:30.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 -- 172.21.15.192:0/4199853128 learned_addr learned my addr 172.21.15.192:0/4199853128 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5400640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a00adf00 0x7fa2a0137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a4a00640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2a00af890 0x7fa2a00b1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 -- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2a00af890 msgr2=0x7fa2a00b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2a00af890 0x7fa2a00b1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 -- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a00adf00 msgr2=0x7fa2a0137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a00adf00 0x7fa2a0137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 -- 172.21.15.192:0/4199853128 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c009400 con 0x7fa2a00b6160 2024-09-13T18:41:30.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.018+0000 7fa2a5e00640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa298007e40 tx=0x7fa29800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.019+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa298014620 con 0x7fa2a00b6160 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.019+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa29800ee90 con 0x7fa2a00b6160 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.019+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2980149e0 con 0x7fa2a00b6160 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.019+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2a0135400 con 0x7fa2a00b6160 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.019+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2a01359c0 con 0x7fa2a00b6160 2024-09-13T18:41:30.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.020+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2a0135bb0 con 0x7fa2a00b6160 2024-09-13T18:41:30.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.021+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa298014b40 con 0x7fa2a00b6160 2024-09-13T18:41:30.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.022+0000 7fa29d600640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 0x7fa28006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.022+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa298089ca0 con 0x7fa2a00b6160 2024-09-13T18:41:30.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.022+0000 7fa2a5400640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 0x7fa28006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.022+0000 7fa2a5400640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 0x7fa28006d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa294000f60 tx=0x7fa294007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.026+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa298054e90 con 0x7fa2a00b6160 2024-09-13T18:41:30.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.196+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2a00cf470 con 0x7fa2a00b6160 2024-09-13T18:41:30.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.197+0000 7fa29d600640 1 -- 172.21.15.192:0/4199853128 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16644 (secure 0 0 0) 0x7fa2980584b0 con 0x7fa2a00b6160 2024-09-13T18:41:30.200 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:30.201 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":122,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:27.153667+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 msgr2=0x7fa28006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 0x7fa28006d0c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa294000f60 tx=0x7fa294007d50 comp rx=0 tx=0).stop 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 msgr2=0x7fa2a00b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fa298007e40 tx=0x7fa29800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 shutdown_connections 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa28006ac00 0x7fa28006d0c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa2a00b6160 0x7fa2a00b18b0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa2a00af890 0x7fa2a00b1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 --2- 172.21.15.192:0/4199853128 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa2a00adf00 0x7fa2a0137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 >> 172.21.15.192:0/4199853128 conn(0x7fa2a00cd660 msgr2=0x7fa2a00cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 shutdown_connections 2024-09-13T18:41:30.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.200+0000 7fa2a6800640 1 -- 172.21.15.192:0/4199853128 wait complete. 2024-09-13T18:41:30.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:40:58.888332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:40:59.927636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:30.220 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:30.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.373+0000 7f8436000640 1 Processor -- start 2024-09-13T18:41:30.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.373+0000 7f8436000640 1 -- start start 2024-09-13T18:41:30.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8436000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f84300b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8436000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84300b3af0 0x7f843015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8436000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84300b2000 con 0x7f843006c0b0 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8436000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843015bbd0 con 0x7f84300b3af0 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8436000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843015beb0 con 0x7f84301589f0 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8427e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84300b3af0 0x7f843015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8427e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f84300b3af0 0x7f843015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38644/0 (socket says 172.21.15.192:38644) 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f8427e00640 1 -- 172.21.15.192:0/1660618642 learned_addr learned my addr 172.21.15.192:0/1660618642 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f842fe00640 1 --1- 172.21.15.192:0/1660618642 >> v1:172.21.15.192:6789/0 conn(0x7f843006c0b0 0x7f84300cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48472/0 (socket says 172.21.15.192:48472) 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.374+0000 7f842f400640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f84300b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.375+0000 7f8427e00640 1 -- 172.21.15.192:0/1660618642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 msgr2=0x7f84300b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.375+0000 7f8427e00640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f84300b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.375+0000 7f8427e00640 1 -- 172.21.15.192:0/1660618642 >> v1:172.21.15.192:6789/0 conn(0x7f843006c0b0 legacy=0x7f84300cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.375+0000 7f8427e00640 1 -- 172.21.15.192:0/1660618642 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843015c190 con 0x7f84300b3af0 2024-09-13T18:41:30.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.376+0000 7f8427e00640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f843015b260 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba2e3d317acdcb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.376+0000 7f842ea00640 1 -- 172.21.15.192:0/1660618642 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418032440 con 0x7f84300b3af0 2024-09-13T18:41:30.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.376+0000 7f842ea00640 1 -- 172.21.15.192:0/1660618642 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180325a0 con 0x7f84300b3af0 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.376+0000 7f842ea00640 1 -- 172.21.15.192:0/1660618642 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418032930 con 0x7f84300b3af0 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 -- 172.21.15.192:0/1660618642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 msgr2=0x7f843015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f843015b260 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f8418009870 tx=0x7f841802a250 comp rx=0 tx=0).stop 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 -- 172.21.15.192:0/1660618642 shutdown_connections 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f843015b260 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 --2- 172.21.15.192:0/1660618642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f84300b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 -- 172.21.15.192:0/1660618642 >> 172.21.15.192:0/1660618642 conn(0x7f84300b08f0 msgr2=0x7f84300b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 -- 172.21.15.192:0/1660618642 shutdown_connections 2024-09-13T18:41:30.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.377+0000 7f8436000640 1 -- 172.21.15.192:0/1660618642 wait complete. 2024-09-13T18:41:30.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.378+0000 7f8436000640 1 Processor -- start 2024-09-13T18:41:30.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.378+0000 7f8436000640 1 -- start start 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843006c0b0 0x7f84301520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f843014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843014e300 con 0x7f84300b3af0 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843006a3e0 con 0x7f843006c0b0 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.379+0000 7f8436000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843006a640 con 0x7f84301589f0 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38650/0 (socket says 172.21.15.192:38650) 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 -- 172.21.15.192:0/3741456139 learned_addr learned my addr 172.21.15.192:0/3741456139 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f842f400640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843006c0b0 0x7f84301520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f842fe00640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f843014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 -- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 msgr2=0x7f843014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f843014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 -- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843006c0b0 msgr2=0x7f84301520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843006c0b0 0x7f84301520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 -- 172.21.15.192:0/3741456139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84180094d0 con 0x7f84300b3af0 2024-09-13T18:41:30.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.380+0000 7f8427e00640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f84180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.381+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418032440 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.381+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8418030b80 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.381+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841803d440 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.381+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843006a920 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.381+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843006aee0 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.382+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843015b260 con 0x7f84300b3af0 2024-09-13T18:41:30.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.383+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8418039040 con 0x7f84300b3af0 2024-09-13T18:41:30.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.384+0000 7f8427400640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 0x7f840c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.384+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84180a9cb0 con 0x7f84300b3af0 2024-09-13T18:41:30.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.384+0000 7f842f400640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 0x7f840c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.384+0000 7f842f400640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 0x7f840c06d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f84200079a0 tx=0x7f8420008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.388+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8418074fd0 con 0x7f84300b3af0 2024-09-13T18:41:30.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.554+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8430158170 con 0x7f84300b3af0 2024-09-13T18:41:30.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.555+0000 7f8427400640 1 -- 172.21.15.192:0/3741456139 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84180785f0 con 0x7f84300b3af0 2024-09-13T18:41:30.558 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 msgr2=0x7f840c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 0x7f840c06d0c0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f84200079a0 tx=0x7f8420008040 comp rx=0 tx=0).stop 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 msgr2=0x7f8430069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8418000c00 tx=0x7f84180046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 shutdown_connections 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f840c06ac00 0x7f840c06d0c0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f84301589f0 0x7f843014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84300b3af0 0x7f8430069ea0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 --2- 172.21.15.192:0/3741456139 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843006c0b0 0x7f84301520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 >> 172.21.15.192:0/3741456139 conn(0x7f84300b08f0 msgr2=0x7f8430159c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 shutdown_connections 2024-09-13T18:41:30.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.557+0000 7f8436000640 1 -- 172.21.15.192:0/3741456139 wait complete. 2024-09-13T18:41:30.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:41:30.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.727+0000 7fd975a00640 1 Processor -- start 2024-09-13T18:41:30.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.727+0000 7fd975a00640 1 -- start start 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.728+0000 7fd975a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9700b3af0 0x7fd97015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.728+0000 7fd975a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd97006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.728+0000 7fd975a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9700b2000 con 0x7fd9701589f0 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd975a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97006ca80 con 0x7fd9700b3af0 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd975a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b2ba0 con 0x7fd97006c0b0 2024-09-13T18:41:30.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd9701589f0 0x7fd9700b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48478/0 (socket says 172.21.15.192:48478) 2024-09-13T18:41:30.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96ea00640 1 -- 172.21.15.192:0/2030087208 learned_addr learned my addr 172.21.15.192:0/2030087208 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:30.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96f400640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd97006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2751740182 0 0) 0x7fd9700b2000 con 0x7fd9701589f0 2024-09-13T18:41:30.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd966000640 1 --2- 172.21.15.192:0/2030087208 >> v2:172.21.15.194:3300/0 conn(0x7fd9700b3af0 0x7fd97015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd954003520 con 0x7fd9701589f0 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1228909652 0 0) 0x7fd954003520 con 0x7fd9701589f0 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 msgr2=0x7fd97006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.729+0000 7fd96e000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd97006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 >> v2:172.21.15.194:3300/0 conn(0x7fd9700b3af0 msgr2=0x7fd97015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 --2- 172.21.15.192:0/2030087208 >> v2:172.21.15.194:3300/0 conn(0x7fd9700b3af0 0x7fd97015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97015bbd0 con 0x7fd9701589f0 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fd960001670 con 0x7fd9701589f0 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 >> v1:172.21.15.192:6789/0 conn(0x7fd9701589f0 legacy=0x7fd9700b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd954003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd954003ef0 0x7fd9540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd954005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97006ca80 con 0x7fd954004d00 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9700b2ba0 con 0x7fd954003ef0 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd95400b980 con 0x7fd97006c0b0 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd954005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd966000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd954003ef0 0x7fd9540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96ea00640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd954003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 -- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 msgr2=0x7fd954003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd97006c0b0 0x7fd954003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 -- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd954003ef0 msgr2=0x7fd9540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd954003ef0 0x7fd9540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd96f400640 1 -- 172.21.15.192:0/2030087208 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97015bbd0 con 0x7fd954004d00 2024-09-13T18:41:30.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.730+0000 7fd966000640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd954003ef0 0x7fd9540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.731+0000 7fd96f400640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd954005180 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd968009fa0 tx=0x7fd9540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e58f48aaadae67f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968030630 con 0x7fd954004d00 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800f040 con 0x7fd954004d00 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd96e000640 1 -- 172.21.15.192:0/2030087208 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9680309b0 con 0x7fd954004d00 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 -- 172.21.15.192:0/2030087208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 msgr2=0x7fd954005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 --2- 172.21.15.192:0/2030087208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd954005180 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fd968009fa0 tx=0x7fd9540057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd96f400640 1 -- 172.21.15.192:0/2030087208 reap_dead start 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 -- 172.21.15.192:0/2030087208 shutdown_connections 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 -- 172.21.15.192:0/2030087208 >> 172.21.15.192:0/2030087208 conn(0x7fd9700b08f0 msgr2=0x7fd9700b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 -- 172.21.15.192:0/2030087208 shutdown_connections 2024-09-13T18:41:30.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.732+0000 7fd975a00640 1 -- 172.21.15.192:0/2030087208 wait complete. 2024-09-13T18:41:30.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.734+0000 7fd975a00640 1 Processor -- start 2024-09-13T18:41:30.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.734+0000 7fd975a00640 1 -- start start 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd970156170 0x7fd970154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd97015cd20 0x7fd97015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97015d6f0 con 0x7fd954004d00 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd970148d10 con 0x7fd97015cd20 2024-09-13T18:41:30.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd975a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9701550d0 con 0x7fd970156170 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd96ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd96ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38664/0 (socket says 172.21.15.192:38664) 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd96ea00640 1 -- 172.21.15.192:0/2853581026 learned_addr learned my addr 172.21.15.192:0/2853581026 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd96f400640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd97015cd20 0x7fd97015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.735+0000 7fd966000640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd970156170 0x7fd970154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 -- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd970156170 msgr2=0x7fd970154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd970156170 0x7fd970154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 -- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd97015cd20 msgr2=0x7fd97015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd97015cd20 0x7fd97015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 -- 172.21.15.192:0/2853581026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9701553b0 con 0x7fd954004d00 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd96ea00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd960001200 tx=0x7fd960007730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd96000fa80 con 0x7fd954004d00 2024-09-13T18:41:30.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96000fc00 con 0x7fd954004d00 2024-09-13T18:41:30.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd970155690 con 0x7fd954004d00 2024-09-13T18:41:30.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9600133f0 con 0x7fd954004d00 2024-09-13T18:41:30.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.736+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd970155c50 con 0x7fd954004d00 2024-09-13T18:41:30.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.737+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970155e70 con 0x7fd954004d00 2024-09-13T18:41:30.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.738+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd960013550 con 0x7fd954004d00 2024-09-13T18:41:30.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.739+0000 7fd967400640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 0x7fd94c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:30.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.739+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd960089560 con 0x7fd954004d00 2024-09-13T18:41:30.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.739+0000 7fd966000640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 0x7fd94c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:30.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.740+0000 7fd966000640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 0x7fd94c06d0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd970156550 tx=0x7fd958009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:30.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.743+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd960054730 con 0x7fd954004d00 2024-09-13T18:41:30.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.913+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd97015b260 con 0x7fd954004d00 2024-09-13T18:41:30.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.913+0000 7fd967400640 1 -- 172.21.15.192:0/2853581026 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd960057d50 con 0x7fd954004d00 2024-09-13T18:41:30.916 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:41:30.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 msgr2=0x7fd94c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 0x7fd94c06d0c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd970156550 tx=0x7fd958009190 comp rx=0 tx=0).stop 2024-09-13T18:41:30.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 msgr2=0x7fd9701487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:30.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd960001200 tx=0x7fd960007730 comp rx=0 tx=0).stop 2024-09-13T18:41:30.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 shutdown_connections 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd94c06ac00 0x7fd94c06d0c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd97015cd20 0x7fd97015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd970156170 0x7fd970154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 --2- 172.21.15.192:0/2853581026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd954004d00 0x7fd9701487d0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 >> 172.21.15.192:0/2853581026 conn(0x7fd9700b08f0 msgr2=0x7fd9700cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 shutdown_connections 2024-09-13T18:41:30.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:30.915+0000 7fd975a00640 1 -- 172.21.15.192:0/2853581026 wait complete. 2024-09-13T18:41:30.934 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:41:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.085+0000 7f2163200640 1 Processor -- start 2024-09-13T18:41:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.085+0000 7f2163200640 1 -- start start 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.086+0000 7f2163200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f215c1589f0 0x7f215c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f2163200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c06c0b0 0x7f215c06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f2163200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c0b2000 con 0x7f215c0b3af0 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f2163200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c06ca80 con 0x7f215c1589f0 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f2163200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c15b970 con 0x7f215c06c0b0 2024-09-13T18:41:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f215c1589f0 0x7f215c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f215c1589f0 0x7f215c0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38668/0 (socket says 172.21.15.192:38668) 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 -- 172.21.15.192:0/1466880898 learned_addr learned my addr 172.21.15.192:0/1466880898 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215b400640 1 --1- 172.21.15.192:0/1466880898 >> v1:172.21.15.192:6789/0 conn(0x7f215c0b3af0 0x7f215c15b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48490/0 (socket says 172.21.15.192:48490) 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f2161200640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c06c0b0 0x7f215c06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 -- 172.21.15.192:0/1466880898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c06c0b0 msgr2=0x7f215c06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c06c0b0 0x7f215c06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 -- 172.21.15.192:0/1466880898 >> v1:172.21.15.192:6789/0 conn(0x7f215c0b3af0 legacy=0x7f215c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215aa00640 1 -- 172.21.15.192:0/1466880898 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938723702 0 0) 0x7f215c0b2000 con 0x7f215c0b3af0 2024-09-13T18:41:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.087+0000 7f215be00640 1 -- 172.21.15.192:0/1466880898 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c15bbd0 con 0x7f215c1589f0 2024-09-13T18:41:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.088+0000 7f215be00640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c1589f0 0x7f215c0b2490 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f214c009870 tx=0x7f214c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fd68457d9e7b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.088+0000 7f215aa00640 1 -- 172.21.15.192:0/1466880898 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c032440 con 0x7f215c1589f0 2024-09-13T18:41:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f215aa00640 1 -- 172.21.15.192:0/1466880898 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f214c0325a0 con 0x7f215c1589f0 2024-09-13T18:41:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f215aa00640 1 -- 172.21.15.192:0/1466880898 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f214c032930 con 0x7f215c1589f0 2024-09-13T18:41:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 -- 172.21.15.192:0/1466880898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c1589f0 msgr2=0x7f215c0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c1589f0 0x7f215c0b2490 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f214c009870 tx=0x7f214c02a270 comp rx=0 tx=0).stop 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 -- 172.21.15.192:0/1466880898 shutdown_connections 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c06c0b0 0x7f215c06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 --2- 172.21.15.192:0/1466880898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c1589f0 0x7f215c0b2490 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 -- 172.21.15.192:0/1466880898 >> 172.21.15.192:0/1466880898 conn(0x7f215c0b08f0 msgr2=0x7f215c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 -- 172.21.15.192:0/1466880898 shutdown_connections 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.089+0000 7f2163200640 1 -- 172.21.15.192:0/1466880898 wait complete. 2024-09-13T18:41:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.091+0000 7f2163200640 1 Processor -- start 2024-09-13T18:41:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.091+0000 7f2163200640 1 -- start start 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f215c06c0b0 0x7f215c070620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c1589f0 0x7f215c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c0716f0 con 0x7f215c0b3af0 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1513b0 con 0x7f215c06c0b0 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2163200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c070e50 con 0x7f215c1589f0 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38680/0 (socket says 172.21.15.192:38680) 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 -- 172.21.15.192:0/2097136248 learned_addr learned my addr 172.21.15.192:0/2097136248 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f2161200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c1589f0 0x7f215c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215be00640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f215c06c0b0 0x7f215c070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 -- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c1589f0 msgr2=0x7f215c14cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c1589f0 0x7f215c14cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 -- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f215c06c0b0 msgr2=0x7f215c070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f215c06c0b0 0x7f215c070620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.092+0000 7f215b400640 1 -- 172.21.15.192:0/2097136248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0094d0 con 0x7f215c0b3af0 2024-09-13T18:41:31.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f215b400640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f214800c500 tx=0x7f214800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148007560 con 0x7f215c0b3af0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21480047e0 con 0x7f215c0b3af0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2148004b90 con 0x7f215c0b3af0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f215c071130 con 0x7f215c0b3af0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.093+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c070b60 con 0x7f215c0b3af0 2024-09-13T18:41:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.094+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c151180 con 0x7f215c0b3af0 2024-09-13T18:41:31.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.095+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2148004cf0 con 0x7f215c0b3af0 2024-09-13T18:41:31.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.096+0000 7f2153e00640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 0x7f213c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.096+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21480883e0 con 0x7f215c0b3af0 2024-09-13T18:41:31.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.096+0000 7f215be00640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 0x7f213c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.096+0000 7f215be00640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 0x7f213c06d0f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f214c034000 tx=0x7f214c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.100+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f215c151180 con 0x7f215c0b3af0 2024-09-13T18:41:31.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.270+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f215c151180 con 0x7f215c0b3af0 2024-09-13T18:41:31.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.270+0000 7f2153e00640 1 -- 172.21.15.192:0/2097136248 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2148053670 con 0x7f215c0b3af0 2024-09-13T18:41:31.273 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 msgr2=0x7f213c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 0x7f213c06d0f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f214c034000 tx=0x7f214c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 msgr2=0x7f215c14c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f214800c500 tx=0x7f214800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 shutdown_connections 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f213c06ac30 0x7f213c06d0f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f215c1589f0 0x7f215c14cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f215c0b3af0 0x7f215c14c020 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 --2- 172.21.15.192:0/2097136248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f215c06c0b0 0x7f215c070620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 >> 172.21.15.192:0/2097136248 conn(0x7f215c0b08f0 msgr2=0x7f215c0ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:31.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 shutdown_connections 2024-09-13T18:41:31.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.273+0000 7f2163200640 1 -- 172.21.15.192:0/2097136248 wait complete. 2024-09-13T18:41:31.292 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:41:31.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.441+0000 7fa3dee00640 1 Processor -- start 2024-09-13T18:41:31.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.441+0000 7fa3dee00640 1 -- start start 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.442+0000 7fa3dee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 0x7fa3d815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3dee00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80b2f00 con 0x7fa3d80b0490 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3dee00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d80b3150 con 0x7fa3d815dee0 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3dee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d80b3430 con 0x7fa3d80b3f10 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3dce00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa3d80b0490 0x7fa3d815a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48500/0 (socket says 172.21.15.192:48500) 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3dce00640 1 -- 172.21.15.192:0/1879805845 learned_addr learned my addr 172.21.15.192:0/1879805845 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3d7400640 1 --2- 172.21.15.192:0/1879805845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 0x7fa3d815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 409209226 0 0) 0x7fa3d80b2f00 con 0x7fa3d80b0490 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.443+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3bc003520 con 0x7fa3d80b0490 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.444+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656815378 0 0) 0x7fa3d80b3150 con 0x7fa3d815dee0 2024-09-13T18:41:31.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.444+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d80b2f00 con 0x7fa3d815dee0 2024-09-13T18:41:31.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.444+0000 7fa3d7400640 1 -- 172.21.15.192:0/1879805845 >> v1:172.21.15.194:6789/0 conn(0x7fa3d815dee0 legacy=0x7fa3d80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.444+0000 7fa3d7400640 1 -- 172.21.15.192:0/1879805845 >> v1:172.21.15.192:6789/0 conn(0x7fa3d80b0490 legacy=0x7fa3d815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.444+0000 7fa3d7400640 1 -- 172.21.15.192:0/1879805845 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d80b3710 con 0x7fa3d80b3f10 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.445+0000 7fa3d7400640 1 --2- 172.21.15.192:0/1879805845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 0x7fa3d815a440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40097d0 tx=0x7fa3c402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be34438039a914f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.445+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4032440 con 0x7fa3d80b3f10 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.445+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c40325a0 con 0x7fa3d80b3f10 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.445+0000 7fa3d6a00640 1 -- 172.21.15.192:0/1879805845 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4032930 con 0x7fa3d80b3f10 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 -- 172.21.15.192:0/1879805845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 msgr2=0x7fa3d815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1879805845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 0x7fa3d815a440 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40097d0 tx=0x7fa3c402a210 comp rx=0 tx=0).stop 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 -- 172.21.15.192:0/1879805845 shutdown_connections 2024-09-13T18:41:31.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1879805845 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d80b3f10 0x7fa3d815a440 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 -- 172.21.15.192:0/1879805845 >> 172.21.15.192:0/1879805845 conn(0x7fa3d80ae960 msgr2=0x7fa3d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:31.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 -- 172.21.15.192:0/1879805845 shutdown_connections 2024-09-13T18:41:31.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.446+0000 7fa3dee00640 1 -- 172.21.15.192:0/1879805845 wait complete. 2024-09-13T18:41:31.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.447+0000 7fa3dee00640 1 Processor -- start 2024-09-13T18:41:31.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.447+0000 7fa3dee00640 1 -- start start 2024-09-13T18:41:31.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3d80b0490 0x7fa3d8135e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d815dee0 0x7fa3d81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d81564a0 con 0x7fa3d8156e00 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8136340 con 0x7fa3d80b0490 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.448+0000 7fa3dee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d8136d20 con 0x7fa3d815dee0 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38690/0 (socket says 172.21.15.192:38690) 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 -- 172.21.15.192:0/1329890395 learned_addr learned my addr 172.21.15.192:0/1329890395 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3d7e00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3d80b0490 0x7fa3d8135e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3d7400640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d815dee0 0x7fa3d81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 -- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d815dee0 msgr2=0x7fa3d81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d815dee0 0x7fa3d81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 -- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3d80b0490 msgr2=0x7fa3d8135e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3d80b0490 0x7fa3d8135e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 -- 172.21.15.192:0/1329890395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009400 con 0x7fa3d8156e00 2024-09-13T18:41:31.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3dce00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000cba0 tx=0x7fa3d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.449+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d000ace0 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.450+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d000ae40 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.450+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d8155820 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.450+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d0012620 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.450+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d8155de0 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.451+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d81565e0 con 0x7fa3d8156e00 2024-09-13T18:41:31.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.452+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3d0007070 con 0x7fa3d8156e00 2024-09-13T18:41:31.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.453+0000 7fa3cfe00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 0x7fa3b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:31.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.453+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3d0089450 con 0x7fa3d8156e00 2024-09-13T18:41:31.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.453+0000 7fa3d7e00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 0x7fa3b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:31.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.454+0000 7fa3d7e00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 0x7fa3b806d0c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80011e0 tx=0x7fa3c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:31.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.457+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa3d81565e0 con 0x7fa3d8156e00 2024-09-13T18:41:31.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.636+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3d81565e0 con 0x7fa3d8156e00 2024-09-13T18:41:31.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.637+0000 7fa3cfe00640 1 -- 172.21.15.192:0/1329890395 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3d81565e0 con 0x7fa3d8156e00 2024-09-13T18:41:31.640 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:41:31.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 msgr2=0x7fa3b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 0x7fa3b806d0c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80011e0 tx=0x7fa3c8009040 comp rx=0 tx=0).stop 2024-09-13T18:41:31.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 msgr2=0x7fa3d806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:31.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fa3d000cba0 tx=0x7fa3d000a430 comp rx=0 tx=0).stop 2024-09-13T18:41:31.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 shutdown_connections 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3b806ac00 0x7fa3b806d0c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8156e00 0x7fa3d806b6a0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3d815dee0 0x7fa3d81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 --2- 172.21.15.192:0/1329890395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3d80b0490 0x7fa3d8135e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 >> 172.21.15.192:0/1329890395 conn(0x7fa3d80ae960 msgr2=0x7fa3d813f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 shutdown_connections 2024-09-13T18:41:31.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:31.639+0000 7fa3dee00640 1 -- 172.21.15.192:0/1329890395 wait complete. 2024-09-13T18:41:31.658 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:41:31.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:31.659 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:31.754 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:41:31.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:31.754 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:41:31.798 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:31.798 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:31.836 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:31.837 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:31.914 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:32.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.062+0000 7f7612e00640 1 Processor -- start 2024-09-13T18:41:32.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.062+0000 7f7612e00640 1 -- start start 2024-09-13T18:41:32.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.063+0000 7f7612e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f760c15dee0 0x7f760c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.063+0000 7f7612e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c0b3f10 0x7f760c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f7612e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c0b2f00 con 0x7f760c15e2c0 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f7612e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0b3150 con 0x7f760c15dee0 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f7612e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0b3430 con 0x7f760c0b3f10 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f760c15dee0 0x7f760c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f760c15dee0 0x7f760c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38694/0 (socket says 172.21.15.192:38694) 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 -- 172.21.15.192:0/649788319 learned_addr learned my addr 172.21.15.192:0/649788319 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:32.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f7603400640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c0b3f10 0x7f760c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 -- 172.21.15.192:0/649788319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c0b3f10 msgr2=0x7f760c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:32.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c0b3f10 0x7f760c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 -- 172.21.15.192:0/649788319 >> v1:172.21.15.194:6789/0 conn(0x7f760c15e2c0 legacy=0x7f760c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.064+0000 7f760be00640 1 -- 172.21.15.192:0/649788319 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c0b3710 con 0x7f760c15dee0 2024-09-13T18:41:32.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.065+0000 7f760be00640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15dee0 0x7f760c0afd80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009870 tx=0x7f75fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8060dc76acd5c0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.065+0000 7f760b400640 1 -- 172.21.15.192:0/649788319 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc032440 con 0x7f760c15dee0 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.065+0000 7f760b400640 1 -- 172.21.15.192:0/649788319 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc0325a0 con 0x7f760c15dee0 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.065+0000 7f760b400640 1 -- 172.21.15.192:0/649788319 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc032930 con 0x7f760c15dee0 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 -- 172.21.15.192:0/649788319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15dee0 msgr2=0x7f760c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15dee0 0x7f760c0afd80 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f75fc009870 tx=0x7f75fc02a270 comp rx=0 tx=0).stop 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 -- 172.21.15.192:0/649788319 shutdown_connections 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c0b3f10 0x7f760c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 --2- 172.21.15.192:0/649788319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15dee0 0x7f760c0afd80 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 -- 172.21.15.192:0/649788319 >> 172.21.15.192:0/649788319 conn(0x7f760c0ae960 msgr2=0x7f760c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 -- 172.21.15.192:0/649788319 shutdown_connections 2024-09-13T18:41:32.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.066+0000 7f7612e00640 1 -- 172.21.15.192:0/649788319 wait complete. 2024-09-13T18:41:32.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.068+0000 7f7612e00640 1 Processor -- start 2024-09-13T18:41:32.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.068+0000 7f7612e00640 1 -- start start 2024-09-13T18:41:32.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f760c15dee0 0x7f760c142000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 0x7f760c13c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0ac370 con 0x7f760c15e2c0 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0ac610 con 0x7f760c15dee0 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7612e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c0ac8f0 con 0x7f760c1f0960 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38702/0 (socket says 172.21.15.192:38702) 2024-09-13T18:41:32.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 -- 172.21.15.192:0/1819620408 learned_addr learned my addr 172.21.15.192:0/1819620408 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:32.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7610e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 0x7f760c13c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f760be00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f760c15dee0 0x7f760c142000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 -- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 msgr2=0x7f760c13c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 0x7f760c13c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 -- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f760c15dee0 msgr2=0x7f760c142000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f760c15dee0 0x7f760c142000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7603400640 1 -- 172.21.15.192:0/1819620408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75fc0094d0 con 0x7f760c15e2c0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.069+0000 7f7610e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 0x7f760c13c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7603400640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f75f400e9b0 tx=0x7f75f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f4009670 con 0x7f760c15e2c0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75f400c9a0 con 0x7f760c15e2c0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75f400cd50 con 0x7f760c15e2c0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0acbd0 con 0x7f760c15e2c0 2024-09-13T18:41:32.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.070+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c142540 con 0x7f760c15e2c0 2024-09-13T18:41:32.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.071+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c067490 con 0x7f760c15e2c0 2024-09-13T18:41:32.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.072+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75f4013470 con 0x7f760c15e2c0 2024-09-13T18:41:32.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.073+0000 7f7608c00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 0x7f75e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.073+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75f4089660 con 0x7f760c15e2c0 2024-09-13T18:41:32.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.073+0000 7f760be00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 0x7f75e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.074+0000 7f760be00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 0x7f75e806d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f75fc034000 tx=0x7f75fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.077+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75f4054830 con 0x7f760c15e2c0 2024-09-13T18:41:32.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.247+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f760c15a440 con 0x7f760c15e2c0 2024-09-13T18:41:32.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.248+0000 7f7608c00640 1 -- 172.21.15.192:0/1819620408 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f75f4057e50 con 0x7f760c15e2c0 2024-09-13T18:41:32.251 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:32.252 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":122,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:27.153667+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:32.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 msgr2=0x7f75e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 0x7f75e806d0c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f75fc034000 tx=0x7f75fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 msgr2=0x7f760c13c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f75f400e9b0 tx=0x7f75f400ee70 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 shutdown_connections 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75e806ac00 0x7f75e806d0c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f760c1f0960 0x7f760c13c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f760c15e2c0 0x7f760c13c140 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 --2- 172.21.15.192:0/1819620408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f760c15dee0 0x7f760c142000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.250+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 >> 172.21.15.192:0/1819620408 conn(0x7f760c0ae960 msgr2=0x7f760c06b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.251+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 shutdown_connections 2024-09-13T18:41:32.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.251+0000 7f7612e00640 1 -- 172.21.15.192:0/1819620408 wait complete. 2024-09-13T18:41:32.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:40:58.888332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:40:59.927636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:32.271 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.424+0000 7f55f7c00640 1 Processor -- start 2024-09-13T18:41:32.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.424+0000 7f55f7c00640 1 -- start start 2024-09-13T18:41:32.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.425+0000 7f55f7c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f00adf50 0x7f55f00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f7c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f0161510 con 0x7f55f015a910 2024-09-13T18:41:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f7c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f01617f0 con 0x7f55f00b2600 2024-09-13T18:41:32.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f7c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00b21e0 con 0x7f55f00adf50 2024-09-13T18:41:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f5200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f55f015a910 0x7f55f0160ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48512/0 (socket says 172.21.15.192:48512) 2024-09-13T18:41:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f5200640 1 -- 172.21.15.192:0/746208646 learned_addr learned my addr 172.21.15.192:0/746208646 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55f5c00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f00adf50 0x7f55f00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363430934 0 0) 0x7f55f0161510 con 0x7f55f015a910 2024-09-13T18:41:32.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d4003520 con 0x7f55f015a910 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742891539 0 0) 0x7f55f01617f0 con 0x7f55f00b2600 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f0161510 con 0x7f55f00b2600 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3188827358 0 0) 0x7f55d4003520 con 0x7f55f015a910 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f00adf50 msgr2=0x7f55f00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f00adf50 0x7f55f00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 >> v1:172.21.15.194:6789/0 conn(0x7f55f00b2600 legacy=0x7f55f00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f00b1e00 con 0x7f55f015a910 2024-09-13T18:41:32.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.426+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f55e0001670 con 0x7f55f015a910 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 >> v1:172.21.15.192:6789/0 conn(0x7f55f015a910 legacy=0x7f55f0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55d4003b30 0x7f55d4003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55d40047c0 0x7f55d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d4005180 0x7f55d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00b21e0 con 0x7f55d40047c0 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d400c050 con 0x7f55d4005180 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d400c210 con 0x7f55d4003b30 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55f5c00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f00adf50 0x7f55f00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55d40047c0 0x7f55d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55f5200640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55d4003b30 0x7f55d4003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55f5c00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d4005180 0x7f55d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 -- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55d4003b30 msgr2=0x7f55d4003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:32.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55d4003b30 0x7f55d4003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 -- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d4005180 msgr2=0x7f55d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d4005180 0x7f55d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.427+0000 7f55e7e00640 1 -- 172.21.15.192:0/746208646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4003520 con 0x7f55d40047c0 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.428+0000 7f55e7e00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55d40047c0 0x7f55d4004c40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f55d80018d0 tx=0x7f55d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870f434dd9dc72fb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.428+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80052d0 con 0x7f55d40047c0 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.428+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8005430 con 0x7f55d40047c0 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.428+0000 7f55efe00640 1 -- 172.21.15.192:0/746208646 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d802aca0 con 0x7f55d40047c0 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 -- 172.21.15.192:0/746208646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55d40047c0 msgr2=0x7f55d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 --2- 172.21.15.192:0/746208646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55d40047c0 0x7f55d4004c40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f55d80018d0 tx=0x7f55d40057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f5c00640 1 -- 172.21.15.192:0/746208646 reap_dead start 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 -- 172.21.15.192:0/746208646 shutdown_connections 2024-09-13T18:41:32.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 -- 172.21.15.192:0/746208646 >> 172.21.15.192:0/746208646 conn(0x7f55f00b08f0 msgr2=0x7f55f00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 -- 172.21.15.192:0/746208646 shutdown_connections 2024-09-13T18:41:32.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.429+0000 7f55f7c00640 1 -- 172.21.15.192:0/746208646 wait complete. 2024-09-13T18:41:32.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.431+0000 7f55f7c00640 1 Processor -- start 2024-09-13T18:41:32.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.431+0000 7f55f7c00640 1 -- start start 2024-09-13T18:41:32.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d40047c0 0x7f55f0149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f01f1ed0 0x7f55f01f5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0070a30 con 0x7f55f015fc20 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01604c0 con 0x7f55d40047c0 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f7c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f015c8a0 con 0x7f55f01f1ed0 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55e7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38708/0 (socket says 172.21.15.192:38708) 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55e7e00640 1 -- 172.21.15.192:0/1304645467 learned_addr learned my addr 172.21.15.192:0/1304645467 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f5200640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d40047c0 0x7f55f0149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.432+0000 7f55f5c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f01f1ed0 0x7f55f01f5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 -- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f01f1ed0 msgr2=0x7f55f01f5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f01f1ed0 0x7f55f01f5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 -- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d40047c0 msgr2=0x7f55f0149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d40047c0 0x7f55f0149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 -- 172.21.15.192:0/1304645467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f01601e0 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55e7e00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d802a660 tx=0x7f55d80012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8006e00 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d8007040 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d80073b0 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0070c20 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.433+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00711e0 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.434+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f0071370 con 0x7f55f015fc20 2024-09-13T18:41:32.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.435+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55d8007510 con 0x7f55f015fc20 2024-09-13T18:41:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.436+0000 7f55ed600640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.436+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55d80a8d60 con 0x7f55f015fc20 2024-09-13T18:41:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.436+0000 7f55f5200640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.437+0000 7f55f5200640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f55e0001eb0 tx=0x7f55e0007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.440+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55d8073f50 con 0x7f55f015fc20 2024-09-13T18:41:32.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.609+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55f0071370 con 0x7f55f015fc20 2024-09-13T18:41:32.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.609+0000 7f55ed600640 1 -- 172.21.15.192:0/1304645467 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7f55d8042020 con 0x7f55f015fc20 2024-09-13T18:41:32.612 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:41:32.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 msgr2=0x7f55cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f55e0001eb0 tx=0x7f55e0007040 comp rx=0 tx=0).stop 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 msgr2=0x7f55f01f1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f55d802a660 tx=0x7f55d80012d0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 shutdown_connections 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f55cc06ac00 0x7f55cc06d0c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55f01f1ed0 0x7f55f01f5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.611+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55f015fc20 0x7f55f01f1990 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.612+0000 7f55f7c00640 1 --2- 172.21.15.192:0/1304645467 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55d40047c0 0x7f55f0149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.612+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 >> 172.21.15.192:0/1304645467 conn(0x7f55f00b08f0 msgr2=0x7f55f0157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.612+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 shutdown_connections 2024-09-13T18:41:32.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.612+0000 7f55f7c00640 1 -- 172.21.15.192:0/1304645467 wait complete. 2024-09-13T18:41:32.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:41:32.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.783+0000 7f74b5c00640 1 Processor -- start 2024-09-13T18:41:32.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.783+0000 7f74b5c00640 1 -- start start 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.784+0000 7f74b5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b01589f0 0x7f74b00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.784+0000 7f74b5c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f74b006c0b0 0x7f74b006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.784+0000 7f74b5c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b00b2000 con 0x7f74b00b3af0 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.784+0000 7f74b5c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b006ca80 con 0x7f74b006c0b0 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.784+0000 7f74b5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b015b970 con 0x7f74b01589f0 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74ae000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f74b00b3af0 0x7f74b015b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48528/0 (socket says 172.21.15.192:48528) 2024-09-13T18:41:32.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74ae000640 1 -- 172.21.15.192:0/489198132 learned_addr learned my addr 172.21.15.192:0/489198132 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:32.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74af400640 1 --2- 172.21.15.192:0/489198132 >> v2:172.21.15.194:3300/0 conn(0x7f74b006c0b0 0x7f74b006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74aea00640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b01589f0 0x7f74b00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788596172 0 0) 0x7f74b00b2000 con 0x7f74b00b3af0 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7494003520 con 0x7f74b00b3af0 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74af400640 1 -- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b01589f0 msgr2=0x7f74b00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74af400640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b01589f0 0x7f74b00b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74af400640 1 -- 172.21.15.192:0/489198132 >> v1:172.21.15.192:6789/0 conn(0x7f74b00b3af0 legacy=0x7f74b015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 410610238 0 0) 0x7f7494003520 con 0x7f74b00b3af0 2024-09-13T18:41:32.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.785+0000 7f74af400640 1 -- 172.21.15.192:0/489198132 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b015bbd0 con 0x7f74b006c0b0 2024-09-13T18:41:32.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.786+0000 7f74af400640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b006c0b0 0x7f74b006c540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a802a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32167585f8a24169 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f749c001670 con 0x7f74b006c0b0 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a802d050 con 0x7f74b006c0b0 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74ad600640 1 -- 172.21.15.192:0/489198132 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007760 con 0x7f74b006c0b0 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 -- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b006c0b0 msgr2=0x7f74b006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b006c0b0 0x7f74b006c540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 -- 172.21.15.192:0/489198132 shutdown_connections 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b006c0b0 0x7f74b006c540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 --2- 172.21.15.192:0/489198132 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b01589f0 0x7f74b00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 -- 172.21.15.192:0/489198132 >> 172.21.15.192:0/489198132 conn(0x7f74b00b08f0 msgr2=0x7f74b00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 -- 172.21.15.192:0/489198132 shutdown_connections 2024-09-13T18:41:32.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.787+0000 7f74b5c00640 1 -- 172.21.15.192:0/489198132 wait complete. 2024-09-13T18:41:32.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.789+0000 7f74b5c00640 1 Processor -- start 2024-09-13T18:41:32.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.789+0000 7f74b5c00640 1 -- start start 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b006c0b0 0x7f74b0151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b00b3af0 0x7f74b00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b01518b0 con 0x7f74b01589f0 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b00ae290 con 0x7f74b00b3af0 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74b5c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b0151b00 con 0x7f74b006c0b0 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74af400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74af400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38722/0 (socket says 172.21.15.192:38722) 2024-09-13T18:41:32.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74af400640 1 -- 172.21.15.192:0/2843696146 learned_addr learned my addr 172.21.15.192:0/2843696146 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74aea00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b006c0b0 0x7f74b0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.790+0000 7f74ae000640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b00b3af0 0x7f74b00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 -- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b006c0b0 msgr2=0x7f74b0151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b006c0b0 0x7f74b0151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 -- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b00b3af0 msgr2=0x7f74b00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b00b3af0 0x7f74b00add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 -- 172.21.15.192:0/2843696146 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a8009a70 con 0x7f74b01589f0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74af400640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a803c830 con 0x7f74b01589f0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a803c990 con 0x7f74b01589f0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a803cd00 con 0x7f74b01589f0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b0151de0 con 0x7f74b01589f0 2024-09-13T18:41:32.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.791+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b0154e20 con 0x7f74b01589f0 2024-09-13T18:41:32.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.792+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b006c540 con 0x7f74b01589f0 2024-09-13T18:41:32.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.793+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f74a802ad50 con 0x7f74b01589f0 2024-09-13T18:41:32.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.794+0000 7f74a6a00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:32.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.794+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74a80aa6d0 con 0x7f74b01589f0 2024-09-13T18:41:32.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.794+0000 7f74aea00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:32.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.795+0000 7f74aea00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 0x7f749006d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009aa0 tx=0x7f74a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:32.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.798+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f74a8075970 con 0x7f74b01589f0 2024-09-13T18:41:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.970+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f74b0158210 con 0x7f74b01589f0 2024-09-13T18:41:32.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.971+0000 7f74a6a00640 1 -- 172.21.15.192:0/2843696146 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7f74a803ce60 con 0x7f74b01589f0 2024-09-13T18:41:32.974 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:41:32.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 msgr2=0x7f749006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 0x7f749006d0c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f74a0009aa0 tx=0x7f74a0009190 comp rx=0 tx=0).stop 2024-09-13T18:41:32.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 msgr2=0x7f74b014e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:32.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f74a8009d90 tx=0x7f74a8004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:32.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 shutdown_connections 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f749006ac00 0x7f749006d0c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f74b01589f0 0x7f74b014e6c0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f74b00b3af0 0x7f74b00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 --2- 172.21.15.192:0/2843696146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74b006c0b0 0x7f74b0151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 >> 172.21.15.192:0/2843696146 conn(0x7f74b00b08f0 msgr2=0x7f74b015c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 shutdown_connections 2024-09-13T18:41:32.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:32.973+0000 7f74b5c00640 1 -- 172.21.15.192:0/2843696146 wait complete. 2024-09-13T18:41:32.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:41:33.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.144+0000 7f35a8e00640 1 Processor -- start 2024-09-13T18:41:33.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.144+0000 7f35a8e00640 1 -- start start 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a8e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f35a40b3af0 0x7f35a415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a8e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a40b2000 con 0x7f35a406c0b0 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a8e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a415bbd0 con 0x7f35a40b3af0 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a8e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a415beb0 con 0x7f35a41589f0 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a2800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f35a406c0b0 0x7f35a40cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48534/0 (socket says 172.21.15.192:48534) 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a2800640 1 -- 172.21.15.192:0/2336441149 learned_addr learned my addr 172.21.15.192:0/2336441149 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f359be00640 1 --2- 172.21.15.192:0/2336441149 >> v2:172.21.15.194:3300/0 conn(0x7f35a40b3af0 0x7f35a415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.145+0000 7f35a1e00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f35a1400640 1 -- 172.21.15.192:0/2336441149 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 299212710 0 0) 0x7f35a40b2000 con 0x7f35a406c0b0 2024-09-13T18:41:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f35a1400640 1 -- 172.21.15.192:0/2336441149 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3588003520 con 0x7f35a406c0b0 2024-09-13T18:41:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f359be00640 1 -- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 msgr2=0x7f35a40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f359be00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f359be00640 1 -- 172.21.15.192:0/2336441149 >> v1:172.21.15.192:6789/0 conn(0x7f35a406c0b0 legacy=0x7f35a40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f359be00640 1 -- 172.21.15.192:0/2336441149 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a415c190 con 0x7f35a40b3af0 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.146+0000 7f35a1e00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.147+0000 7f359be00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a40b3af0 0x7f35a415b260 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f358c0097a0 tx=0x7f358c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7df80f9059d7cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.147+0000 7f35a1400640 1 -- 172.21.15.192:0/2336441149 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c032440 con 0x7f35a40b3af0 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.147+0000 7f35a1400640 1 -- 172.21.15.192:0/2336441149 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c0325a0 con 0x7f35a40b3af0 2024-09-13T18:41:33.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.147+0000 7f35a1400640 1 -- 172.21.15.192:0/2336441149 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c032930 con 0x7f35a40b3af0 2024-09-13T18:41:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 -- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a40b3af0 msgr2=0x7f35a415b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a40b3af0 0x7f35a415b260 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f358c0097a0 tx=0x7f358c02a180 comp rx=0 tx=0).stop 2024-09-13T18:41:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 -- 172.21.15.192:0/2336441149 shutdown_connections 2024-09-13T18:41:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a40b3af0 0x7f35a415b260 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 --2- 172.21.15.192:0/2336441149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 -- 172.21.15.192:0/2336441149 >> 172.21.15.192:0/2336441149 conn(0x7f35a40b08f0 msgr2=0x7f35a40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 -- 172.21.15.192:0/2336441149 shutdown_connections 2024-09-13T18:41:33.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.148+0000 7f35a8e00640 1 -- 172.21.15.192:0/2336441149 wait complete. 2024-09-13T18:41:33.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.150+0000 7f35a8e00640 1 Processor -- start 2024-09-13T18:41:33.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.150+0000 7f35a8e00640 1 -- start start 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a406c0b0 0x7f35a4150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4147a60 con 0x7f35a40b3af0 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4151540 con 0x7f35a406c0b0 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a8e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a4151820 con 0x7f35a41589f0 2024-09-13T18:41:33.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f359be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f359be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38724/0 (socket says 172.21.15.192:38724) 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f359be00640 1 -- 172.21.15.192:0/1816339098 learned_addr learned my addr 172.21.15.192:0/1816339098 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a1e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a406c0b0 0x7f35a4150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.151+0000 7f35a2800640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 -- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 msgr2=0x7f35a40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 -- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a406c0b0 msgr2=0x7f35a4150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a406c0b0 0x7f35a4150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 -- 172.21.15.192:0/1816339098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009400 con 0x7f35a40b3af0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f35a2800640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359be00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f358c035040 tx=0x7f358c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c03d8f0 con 0x7f35a40b3af0 2024-09-13T18:41:33.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c03da70 con 0x7f35a40b3af0 2024-09-13T18:41:33.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c03de20 con 0x7f35a40b3af0 2024-09-13T18:41:33.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c009400 con 0x7f35a40b3af0 2024-09-13T18:41:33.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.152+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a4151de0 con 0x7f35a40b3af0 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.153+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a415b260 con 0x7f35a40b3af0 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.154+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f358c039040 con 0x7f35a40b3af0 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.155+0000 7f359a000640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 0x7f358006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.155+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f358c0a9dc0 con 0x7f35a40b3af0 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.155+0000 7f35a1e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 0x7f358006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.156+0000 7f35a1e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 0x7f358006d0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3594009c30 tx=0x7f3594009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.159+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f358c0750d0 con 0x7f35a40b3af0 2024-09-13T18:41:33.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.329+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35a40cb8f0 con 0x7f35a40b3af0 2024-09-13T18:41:33.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.329+0000 7f359a000640 1 -- 172.21.15.192:0/1816339098 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7f358c0786f0 con 0x7f35a40b3af0 2024-09-13T18:41:33.332 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:41:33.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 msgr2=0x7f358006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 0x7f358006d0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3594009c30 tx=0x7f3594009190 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 msgr2=0x7f35a4147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f358c035040 tx=0x7f358c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 shutdown_connections 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f358006ac00 0x7f358006d0c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35a41589f0 0x7f35a40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35a40b3af0 0x7f35a4147520 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 --2- 172.21.15.192:0/1816339098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35a406c0b0 0x7f35a4150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.331+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 >> 172.21.15.192:0/1816339098 conn(0x7f35a40b08f0 msgr2=0x7f35a40afb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.332+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 shutdown_connections 2024-09-13T18:41:33.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.332+0000 7f35a8e00640 1 -- 172.21.15.192:0/1816339098 wait complete. 2024-09-13T18:41:33.350 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:41:33.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.500+0000 7f7c17600640 1 Processor -- start 2024-09-13T18:41:33.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.500+0000 7f7c17600640 1 -- start start 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c17600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c17600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c17600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c100b2f00 con 0x7f7c1015e2c0 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c17600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b3150 con 0x7f7c1015dee0 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c17600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c100b3430 con 0x7f7c100b3f10 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38734/0 (socket says 172.21.15.192:38734) 2024-09-13T18:41:33.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 -- 172.21.15.192:0/271368327 learned_addr learned my addr 172.21.15.192:0/271368327 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/271368327 >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 -- 172.21.15.192:0/271368327 >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 msgr2=0x7f7c100b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 --2- 172.21.15.192:0/271368327 >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 -- 172.21.15.192:0/271368327 >> v1:172.21.15.194:6789/0 conn(0x7f7c1015e2c0 legacy=0x7f7c1015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c14c00640 1 -- 172.21.15.192:0/271368327 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c100b3710 con 0x7f7c1015dee0 2024-09-13T18:41:33.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.502+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/271368327 >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.503+0000 7f7c14c00640 1 --2- 172.21.15.192:0/271368327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b4700 tx=0x7f7c0402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71dc6081af17e6f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c0f400640 1 -- 172.21.15.192:0/271368327 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04032440 con 0x7f7c1015dee0 2024-09-13T18:41:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c0f400640 1 -- 172.21.15.192:0/271368327 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c040325a0 con 0x7f7c1015dee0 2024-09-13T18:41:33.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c0f400640 1 -- 172.21.15.192:0/271368327 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04032930 con 0x7f7c1015dee0 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 -- 172.21.15.192:0/271368327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 msgr2=0x7f7c100afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 --2- 172.21.15.192:0/271368327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f7c100b4700 tx=0x7f7c0402a230 comp rx=0 tx=0).stop 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 -- 172.21.15.192:0/271368327 shutdown_connections 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 --2- 172.21.15.192:0/271368327 >> v2:172.21.15.194:3300/0 conn(0x7f7c100b3f10 0x7f7c100b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 --2- 172.21.15.192:0/271368327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c1015dee0 0x7f7c100afd80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 -- 172.21.15.192:0/271368327 >> 172.21.15.192:0/271368327 conn(0x7f7c100ae960 msgr2=0x7f7c1006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 -- 172.21.15.192:0/271368327 shutdown_connections 2024-09-13T18:41:33.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.504+0000 7f7c17600640 1 -- 172.21.15.192:0/271368327 wait complete. 2024-09-13T18:41:33.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.506+0000 7f7c17600640 1 Processor -- start 2024-09-13T18:41:33.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.506+0000 7f7c17600640 1 -- start start 2024-09-13T18:41:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015dee0 0x7f7c10138770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015e2c0 0x7f7c10151150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1013a830 con 0x7f7c10139de0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10138cb0 con 0x7f7c1015dee0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c17600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c10141c30 con 0x7f7c1015e2c0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c15600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c15600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38750/0 (socket says 172.21.15.192:38750) 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c15600640 1 -- 172.21.15.192:0/1337302927 learned_addr learned my addr 172.21.15.192:0/1337302927 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c14c00640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015dee0 0x7f7c10138770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.507+0000 7f7c0fe00640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015e2c0 0x7f7c10151150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 -- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015e2c0 msgr2=0x7f7c10151150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015e2c0 0x7f7c10151150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 -- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015dee0 msgr2=0x7f7c10138770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015dee0 0x7f7c10138770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 -- 172.21.15.192:0/1337302927 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c040094d0 con 0x7f7c10139de0 2024-09-13T18:41:33.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c15600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800b9a0 tx=0x7f7c0800be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0800cba0 con 0x7f7c10139de0 2024-09-13T18:41:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0800cd00 con 0x7f7c10139de0 2024-09-13T18:41:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c08014680 con 0x7f7c10139de0 2024-09-13T18:41:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c10141f10 con 0x7f7c10139de0 2024-09-13T18:41:33.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.508+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c101424d0 con 0x7f7c10139de0 2024-09-13T18:41:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.509+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c101426f0 con 0x7f7c10139de0 2024-09-13T18:41:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.510+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c0801d3b0 con 0x7f7c10139de0 2024-09-13T18:41:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.511+0000 7f7c0cc00640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 0x7f7bf006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.511+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c08089240 con 0x7f7c10139de0 2024-09-13T18:41:33.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.511+0000 7f7c14c00640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 0x7f7bf006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:33.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.512+0000 7f7c14c00640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 0x7f7bf006d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7c04034000 tx=0x7f7c0402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:33.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.515+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c08054380 con 0x7f7c10139de0 2024-09-13T18:41:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.693+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c1015a440 con 0x7f7c10139de0 2024-09-13T18:41:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.693+0000 7f7c0cc00640 1 -- 172.21.15.192:0/1337302927 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v122) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c080579a0 con 0x7f7c10139de0 2024-09-13T18:41:33.696 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.695+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 msgr2=0x7f7bf006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.695+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 0x7f7bf006d0c0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7c04034000 tx=0x7f7c0402e000 comp rx=0 tx=0).stop 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.695+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 msgr2=0x7f7c1013f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.695+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7c0800b9a0 tx=0x7f7c0800be60 comp rx=0 tx=0).stop 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 shutdown_connections 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bf006ac00 0x7f7bf006d0c0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c10139de0 0x7f7c1013f230 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c1015e2c0 0x7f7c10151150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 --2- 172.21.15.192:0/1337302927 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c1015dee0 0x7f7c10138770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:33.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 >> 172.21.15.192:0/1337302927 conn(0x7f7c100ae960 msgr2=0x7f7c1006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:33.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 shutdown_connections 2024-09-13T18:41:33.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:33.696+0000 7f7c17600640 1 -- 172.21.15.192:0/1337302927 wait complete. 2024-09-13T18:41:33.714 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:41:33.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:33.714 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:33.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:41:33.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:33.783 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:41:33.820 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:33.821 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:33.856 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:41:33.856 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:33.856 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:33.896 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:41:33.896 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:34.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.045+0000 7f5180a00640 1 Processor -- start 2024-09-13T18:41:34.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.045+0000 7f5180a00640 1 -- start start 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f5180a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 0x7f517c157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f5180a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c0b3c90 con 0x7f517c0adf50 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f5180a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f517c0b3110 con 0x7f517c161210 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f5180a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c157750 con 0x7f517c156e30 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f517be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f517c0adf50 0x7f517c15d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48544/0 (socket says 172.21.15.192:48544) 2024-09-13T18:41:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.046+0000 7f517be00640 1 -- 172.21.15.192:0/2487272585 learned_addr learned my addr 172.21.15.192:0/2487272585 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:34.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517b400640 1 --2- 172.21.15.192:0/2487272585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 0x7f517c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 285657179 0 0) 0x7f517c0b3c90 con 0x7f517c0adf50 2024-09-13T18:41:34.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5160003520 con 0x7f517c0adf50 2024-09-13T18:41:34.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3807759765 0 0) 0x7f517c0b3110 con 0x7f517c161210 2024-09-13T18:41:34.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f517c0b3c90 con 0x7f517c161210 2024-09-13T18:41:34.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517b400640 1 -- 172.21.15.192:0/2487272585 >> v1:172.21.15.194:6789/0 conn(0x7f517c161210 legacy=0x7f517c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517b400640 1 -- 172.21.15.192:0/2487272585 >> v1:172.21.15.192:6789/0 conn(0x7f517c0adf50 legacy=0x7f517c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.047+0000 7f517b400640 1 -- 172.21.15.192:0/2487272585 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f517c0b33f0 con 0x7f517c156e30 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.048+0000 7f517b400640 1 --2- 172.21.15.192:0/2487272585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 0x7f517c157210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f516c0097d0 tx=0x7f516c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe332ed12bc493f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.048+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c032440 con 0x7f517c156e30 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f516c0325a0 con 0x7f517c156e30 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f517aa00640 1 -- 172.21.15.192:0/2487272585 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f516c032930 con 0x7f517c156e30 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 -- 172.21.15.192:0/2487272585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 msgr2=0x7f517c157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 --2- 172.21.15.192:0/2487272585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 0x7f517c157210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f516c0097d0 tx=0x7f516c02a210 comp rx=0 tx=0).stop 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 -- 172.21.15.192:0/2487272585 shutdown_connections 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 --2- 172.21.15.192:0/2487272585 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c156e30 0x7f517c157210 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 -- 172.21.15.192:0/2487272585 >> 172.21.15.192:0/2487272585 conn(0x7f517c0736d0 msgr2=0x7f517c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 -- 172.21.15.192:0/2487272585 shutdown_connections 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.049+0000 7f5180a00640 1 -- 172.21.15.192:0/2487272585 wait complete. 2024-09-13T18:41:34.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.051+0000 7f5180a00640 1 Processor -- start 2024-09-13T18:41:34.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.051+0000 7f5180a00640 1 -- start start 2024-09-13T18:41:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 0x7f517c1393c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 0x7f517c1e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1e6d50 con 0x7f517c156e30 2024-09-13T18:41:34.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1e7030 con 0x7f517c161210 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5180a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517c1e7310 con 0x7f517c0adf50 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5173e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5173e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38762/0 (socket says 172.21.15.192:38762) 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.052+0000 7f5173e00640 1 -- 172.21.15.192:0/1474378345 learned_addr learned my addr 172.21.15.192:0/1474378345 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f517be00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 0x7f517c1e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f517b400640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 0x7f517c1393c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 -- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 msgr2=0x7f517c1393c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 0x7f517c1393c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 -- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 msgr2=0x7f517c1e6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 0x7f517c1e6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 -- 172.21.15.192:0/1474378345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f516c009400 con 0x7f517c156e30 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f517be00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 0x7f517c1e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:34.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f517b400640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 0x7f517c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173e00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f516400c430 tx=0x7f516400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51640052d0 con 0x7f517c156e30 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5164005450 con 0x7f517c156e30 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5164003830 con 0x7f517c156e30 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f517c1e75f0 con 0x7f517c156e30 2024-09-13T18:41:34.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.053+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f517c1e6a40 con 0x7f517c156e30 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.054+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f517c0b2d70 con 0x7f517c156e30 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.055+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5164003990 con 0x7f517c156e30 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.056+0000 7f5173400640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 0x7f515806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.056+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51640889b0 con 0x7f517c156e30 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.056+0000 7f517b400640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 0x7f515806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.057+0000 7f517b400640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 0x7f515806d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f516c034000 tx=0x7f516c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.060+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5164053b90 con 0x7f517c156e30 2024-09-13T18:41:34.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.263+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f517c1600a0 con 0x7f517c156e30 2024-09-13T18:41:34.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.263+0000 7f5173400640 1 -- 172.21.15.192:0/1474378345 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f5164017090 con 0x7f517c156e30 2024-09-13T18:41:34.266 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:34.266 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:34.267 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:34.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 msgr2=0x7f515806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 0x7f515806d0c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f516c034000 tx=0x7f516c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 msgr2=0x7f517c138dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f516400c430 tx=0x7f516400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 shutdown_connections 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f515806ac00 0x7f515806d0c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f517c161210 0x7f517c1e6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f517c156e30 0x7f517c138dc0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.265+0000 7f5180a00640 1 --2- 172.21.15.192:0/1474378345 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f517c0adf50 0x7f517c1393c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.266+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 >> 172.21.15.192:0/1474378345 conn(0x7f517c0736d0 msgr2=0x7f517c0ae6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.266+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 shutdown_connections 2024-09-13T18:41:34.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.266+0000 7f5180a00640 1 -- 172.21.15.192:0/1474378345 wait complete. 2024-09-13T18:41:34.285 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.434+0000 7fef8fe00640 1 Processor -- start 2024-09-13T18:41:34.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.435+0000 7fef8fe00640 1 -- start start 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef90159b00 0x7fef900b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef900b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8fe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9015af60 con 0x7fef90159ee0 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8fe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9015aaa0 con 0x7fef90159b00 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef9006b7a0 con 0x7fef9006bc30 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef90159b00 0x7fef900b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef90159b00 0x7fef900b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38766/0 (socket says 172.21.15.192:38766) 2024-09-13T18:41:34.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 -- 172.21.15.192:0/977096539 learned_addr learned my addr 172.21.15.192:0/977096539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:34.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 -- 172.21.15.192:0/977096539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 msgr2=0x7fef900b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:34.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 --2- 172.21.15.192:0/977096539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef900b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 -- 172.21.15.192:0/977096539 >> v1:172.21.15.194:6789/0 conn(0x7fef90159ee0 legacy=0x7fef9015a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.436+0000 7fef8ea00640 1 -- 172.21.15.192:0/977096539 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9015ac80 con 0x7fef90159b00 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.437+0000 7fef8ea00640 1 --2- 172.21.15.192:0/977096539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159b00 0x7fef900b2d70 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fef80009e50 tx=0x7fef8002a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5de503bf58b1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8d600640 1 -- 172.21.15.192:0/977096539 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80031600 con 0x7fef90159b00 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8d600640 1 -- 172.21.15.192:0/977096539 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8002d050 con 0x7fef90159b00 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8d600640 1 -- 172.21.15.192:0/977096539 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef80031980 con 0x7fef90159b00 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 -- 172.21.15.192:0/977096539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159b00 msgr2=0x7fef900b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 --2- 172.21.15.192:0/977096539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159b00 0x7fef900b2d70 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fef80009e50 tx=0x7fef8002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 -- 172.21.15.192:0/977096539 shutdown_connections 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 --2- 172.21.15.192:0/977096539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef900b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 --2- 172.21.15.192:0/977096539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159b00 0x7fef900b2d70 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 -- 172.21.15.192:0/977096539 >> 172.21.15.192:0/977096539 conn(0x7fef900736d0 msgr2=0x7fef900b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 -- 172.21.15.192:0/977096539 shutdown_connections 2024-09-13T18:41:34.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.438+0000 7fef8fe00640 1 -- 172.21.15.192:0/977096539 wait complete. 2024-09-13T18:41:34.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.440+0000 7fef8fe00640 1 Processor -- start 2024-09-13T18:41:34.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.440+0000 7fef8fe00640 1 -- start start 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef90157420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef90159b00 0x7fef90070e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9014f310 con 0x7fef90159ee0 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef900709f0 con 0x7fef90159b00 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8fe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef900b0710 con 0x7fef9006bc30 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38780/0 (socket says 172.21.15.192:38780) 2024-09-13T18:41:34.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8f400640 1 -- 172.21.15.192:0/3555236938 learned_addr learned my addr 172.21.15.192:0/3555236938 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8ea00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef90157420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.441+0000 7fef8e000640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef90159b00 0x7fef90070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 -- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 msgr2=0x7fef90157420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef90157420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 -- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef90159b00 msgr2=0x7fef90070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef90159b00 0x7fef90070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 -- 172.21.15.192:0/3555236938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80009b30 con 0x7fef90159ee0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8f400640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fef8800b490 tx=0x7fef8800b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88011830 con 0x7fef90159ee0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef880119b0 con 0x7fef90159ee0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef900b0150 con 0x7fef90159ee0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef88011d60 con 0x7fef90159ee0 2024-09-13T18:41:34.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.442+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef90142d60 con 0x7fef90159ee0 2024-09-13T18:41:34.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.443+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9015a390 con 0x7fef90159ee0 2024-09-13T18:41:34.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.444+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef8801a400 con 0x7fef90159ee0 2024-09-13T18:41:34.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.445+0000 7fef86a00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 0x7fef7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.445+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef88089280 con 0x7fef90159ee0 2024-09-13T18:41:34.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.445+0000 7fef8ea00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 0x7fef7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.446+0000 7fef8ea00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 0x7fef7006d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef80033000 tx=0x7fef80009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.449+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef88054450 con 0x7fef90159ee0 2024-09-13T18:41:34.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.620+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef900b3c70 con 0x7fef90159ee0 2024-09-13T18:41:34.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.621+0000 7fef86a00640 1 -- 172.21.15.192:0/3555236938 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16644 (secure 0 0 0) 0x7fef8805ce60 con 0x7fef90159ee0 2024-09-13T18:41:34.624 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:34.624 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":122,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:27.153667+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 msgr2=0x7fef7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 0x7fef7006d0c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fef80033000 tx=0x7fef80009000 comp rx=0 tx=0).stop 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 msgr2=0x7fef900713c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fef8800b490 tx=0x7fef8800b890 comp rx=0 tx=0).stop 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 shutdown_connections 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7006ac00 0x7fef7006d0c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef90159ee0 0x7fef900713c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef90159b00 0x7fef90070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 --2- 172.21.15.192:0/3555236938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9006bc30 0x7fef90157420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 >> 172.21.15.192:0/3555236938 conn(0x7fef900736d0 msgr2=0x7fef9006a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 shutdown_connections 2024-09-13T18:41:34.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.623+0000 7fef8fe00640 1 -- 172.21.15.192:0/3555236938 wait complete. 2024-09-13T18:41:34.643 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:40:58.888332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:40:59.927636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:34.643 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:34.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.795+0000 7f4d5bc00640 1 Processor -- start 2024-09-13T18:41:34.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.795+0000 7f4d5bc00640 1 -- start start 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d5bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 0x7f4d540ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d5bc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5415a8e0 con 0x7f4d540b3470 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d5bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d540b2fe0 con 0x7f4d540cb330 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d5bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d540b26b0 con 0x7f4d540cdf60 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d59c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4d540b3470 0x7f4d540b38a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48548/0 (socket says 172.21.15.192:48548) 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d59c00640 1 -- 172.21.15.192:0/3774297780 learned_addr learned my addr 172.21.15.192:0/3774297780 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:34.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.796+0000 7f4d53e00640 1 --2- 172.21.15.192:0/3774297780 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 0x7f4d540ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516638476 0 0) 0x7f4d5415a8e0 con 0x7f4d540b3470 2024-09-13T18:41:34.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d38003520 con 0x7f4d540b3470 2024-09-13T18:41:34.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326803141 0 0) 0x7f4d540b2fe0 con 0x7f4d540cb330 2024-09-13T18:41:34.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d5415a8e0 con 0x7f4d540cb330 2024-09-13T18:41:34.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53e00640 1 -- 172.21.15.192:0/3774297780 >> v1:172.21.15.194:6789/0 conn(0x7f4d540cb330 legacy=0x7f4d5406ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53e00640 1 -- 172.21.15.192:0/3774297780 >> v1:172.21.15.192:6789/0 conn(0x7f4d540b3470 legacy=0x7f4d540b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.797+0000 7f4d53e00640 1 -- 172.21.15.192:0/3774297780 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d540b2990 con 0x7f4d540cdf60 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.798+0000 7f4d53e00640 1 --2- 172.21.15.192:0/3774297780 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 0x7f4d540ce3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d400097d0 tx=0x7f4d4002a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e2001a116167dbd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.798+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4002ae50 con 0x7f4d540cdf60 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.798+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d40032440 con 0x7f4d540cdf60 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.798+0000 7f4d53400640 1 -- 172.21.15.192:0/3774297780 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d400327b0 con 0x7f4d540cdf60 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 -- 172.21.15.192:0/3774297780 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 msgr2=0x7f4d540ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/3774297780 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 0x7f4d540ce3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4d400097d0 tx=0x7f4d4002a100 comp rx=0 tx=0).stop 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 -- 172.21.15.192:0/3774297780 shutdown_connections 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/3774297780 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540cdf60 0x7f4d540ce3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 -- 172.21.15.192:0/3774297780 >> 172.21.15.192:0/3774297780 conn(0x7f4d540b08f0 msgr2=0x7f4d540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 -- 172.21.15.192:0/3774297780 shutdown_connections 2024-09-13T18:41:34.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.799+0000 7f4d5bc00640 1 -- 172.21.15.192:0/3774297780 wait complete. 2024-09-13T18:41:34.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.801+0000 7f4d5bc00640 1 Processor -- start 2024-09-13T18:41:34.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.801+0000 7f4d5bc00640 1 -- start start 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540b3470 0x7f4d5414a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d540cdf60 0x7f4d54158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d54158700 con 0x7f4d540cb330 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5414f0f0 con 0x7f4d540cdf60 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d5bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5414f900 con 0x7f4d540b3470 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38786/0 (socket says 172.21.15.192:38786) 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 -- 172.21.15.192:0/1777389287 learned_addr learned my addr 172.21.15.192:0/1777389287 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d59c00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d540cdf60 0x7f4d54158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d59200640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540b3470 0x7f4d5414a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 -- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540b3470 msgr2=0x7f4d5414a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540b3470 0x7f4d5414a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 -- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d540cdf60 msgr2=0x7f4d54158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d540cdf60 0x7f4d54158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.802+0000 7f4d53e00640 1 -- 172.21.15.192:0/1777389287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d40009400 con 0x7f4d540cb330 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d53e00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000c00 tx=0x7f4d400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4003c810 con 0x7f4d540cb330 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4003c970 con 0x7f4d540cb330 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4003cd00 con 0x7f4d540cb330 2024-09-13T18:41:34.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5414f340 con 0x7f4d540cb330 2024-09-13T18:41:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.803+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d54158320 con 0x7f4d540cb330 2024-09-13T18:41:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.804+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d54158840 con 0x7f4d540cb330 2024-09-13T18:41:34.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.805+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4d4003b3a0 con 0x7f4d540cb330 2024-09-13T18:41:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.806+0000 7f4d50c00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 0x7f4d3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.806+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d400a9fc0 con 0x7f4d540cb330 2024-09-13T18:41:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.806+0000 7f4d59200640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 0x7f4d3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:34.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.807+0000 7f4d59200640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 0x7f4d3406d0c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d541e6080 tx=0x7f4d44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:34.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.810+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4d54158840 con 0x7f4d540cb330 2024-09-13T18:41:34.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.977+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4d54158840 con 0x7f4d540cb330 2024-09-13T18:41:34.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.977+0000 7f4d50c00640 1 -- 172.21.15.192:0/1777389287 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4d4004a020 con 0x7f4d540cb330 2024-09-13T18:41:34.980 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:41:34.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 msgr2=0x7f4d3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 0x7f4d3406d0c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f4d541e6080 tx=0x7f4d44009040 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 msgr2=0x7f4d5414fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f4d40000c00 tx=0x7f4d400046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 shutdown_connections 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4d3406ac00 0x7f4d3406d0c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4d540cdf60 0x7f4d54158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d540cb330 0x7f4d5414fff0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 --2- 172.21.15.192:0/1777389287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4d540b3470 0x7f4d5414a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.979+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 >> 172.21.15.192:0/1777389287 conn(0x7f4d540b08f0 msgr2=0x7f4d540b0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.980+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 shutdown_connections 2024-09-13T18:41:34.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:34.980+0000 7f4d5bc00640 1 -- 172.21.15.192:0/1777389287 wait complete. 2024-09-13T18:41:34.998 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:41:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.151+0000 7fc6a5400640 1 Processor -- start 2024-09-13T18:41:35.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.151+0000 7fc6a5400640 1 -- start start 2024-09-13T18:41:35.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc6a5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6a00b2600 0x7fc6a00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc6a5400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 0x7fc6a00cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc6a5400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a00ae1d0 con 0x7fc6a015a910 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc6a5400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a00b21e0 con 0x7fc6a00b2600 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc6a5400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a00b1bf0 con 0x7fc6a00add80 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.152+0000 7fc69de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6a00b2600 0x7fc6a00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc6a00b2600 0x7fc6a00ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38800/0 (socket says 172.21.15.192:38800) 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 -- 172.21.15.192:0/1200125070 learned_addr learned my addr 172.21.15.192:0/1200125070 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69f200640 1 --2- 172.21.15.192:0/1200125070 >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 0x7fc6a00cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 -- 172.21.15.192:0/1200125070 >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 msgr2=0x7fc6a00cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 --2- 172.21.15.192:0/1200125070 >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 0x7fc6a00cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 -- 172.21.15.192:0/1200125070 >> v1:172.21.15.194:6789/0 conn(0x7fc6a015a910 legacy=0x7fc6a0160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69de00640 1 -- 172.21.15.192:0/1200125070 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0161510 con 0x7fc6a00b2600 2024-09-13T18:41:35.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.153+0000 7fc69f200640 1 --2- 172.21.15.192:0/1200125070 >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 0x7fc6a00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.154+0000 7fc69de00640 1 --2- 172.21.15.192:0/1200125070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ad840 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00ce2e0 tx=0x7fc68c02a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfaaaa30fc97bc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.154+0000 7fc69d400640 1 -- 172.21.15.192:0/1200125070 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c032440 con 0x7fc6a00b2600 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.154+0000 7fc69d400640 1 -- 172.21.15.192:0/1200125070 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c0325a0 con 0x7fc6a00b2600 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.154+0000 7fc69d400640 1 -- 172.21.15.192:0/1200125070 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c032930 con 0x7fc6a00b2600 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 -- 172.21.15.192:0/1200125070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 msgr2=0x7fc6a00ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 --2- 172.21.15.192:0/1200125070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ad840 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00ce2e0 tx=0x7fc68c02a1f0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 -- 172.21.15.192:0/1200125070 shutdown_connections 2024-09-13T18:41:35.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 --2- 172.21.15.192:0/1200125070 >> v2:172.21.15.194:3300/0 conn(0x7fc6a00add80 0x7fc6a00cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 --2- 172.21.15.192:0/1200125070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ad840 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 -- 172.21.15.192:0/1200125070 >> 172.21.15.192:0/1200125070 conn(0x7fc6a00b08f0 msgr2=0x7fc6a00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:35.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 -- 172.21.15.192:0/1200125070 shutdown_connections 2024-09-13T18:41:35.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.155+0000 7fc6a5400640 1 -- 172.21.15.192:0/1200125070 wait complete. 2024-09-13T18:41:35.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.156+0000 7fc6a5400640 1 Processor -- start 2024-09-13T18:41:35.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 -- start start 2024-09-13T18:41:35.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6a00add80 0x7fc6a015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 0x7fc6a006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015d2e0 con 0x7fc6a00b2600 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015c240 con 0x7fc6a015a910 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.157+0000 7fc6a5400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015c520 con 0x7fc6a00add80 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38802/0 (socket says 172.21.15.192:38802) 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 -- 172.21.15.192:0/3989180607 learned_addr learned my addr 172.21.15.192:0/3989180607 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69e800640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6a00add80 0x7fc6a015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69f200640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 0x7fc6a006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 -- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6a00add80 msgr2=0x7fc6a015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6a00add80 0x7fc6a015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 -- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 msgr2=0x7fc6a006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 0x7fc6a006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 -- 172.21.15.192:0/3989180607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc68c0094d0 con 0x7fc6a00b2600 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69f200640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 0x7fc6a006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.158+0000 7fc69de00640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc68c02a230 tx=0x7fc68c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.159+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c032440 con 0x7fc6a00b2600 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.159+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc68c030b80 con 0x7fc6a00b2600 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.159+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc68c03d440 con 0x7fc6a00b2600 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.159+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a015c800 con 0x7fc6a00b2600 2024-09-13T18:41:35.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.159+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a015cdc0 con 0x7fc6a00b2600 2024-09-13T18:41:35.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.160+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a015cfb0 con 0x7fc6a00b2600 2024-09-13T18:41:35.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.161+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc68c039040 con 0x7fc6a00b2600 2024-09-13T18:41:35.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.161+0000 7fc696a00640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 0x7fc68006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.162+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc68c0a9fe0 con 0x7fc6a00b2600 2024-09-13T18:41:35.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.162+0000 7fc69e800640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 0x7fc68006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.162+0000 7fc69e800640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 0x7fc68006d0c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc690007fd0 tx=0x7fc690009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.165+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc68c075140 con 0x7fc6a00b2600 2024-09-13T18:41:35.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.334+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6a00b3ab0 con 0x7fc6a00b2600 2024-09-13T18:41:35.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.335+0000 7fc696a00640 1 -- 172.21.15.192:0/3989180607 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc68c078760 con 0x7fc6a00b2600 2024-09-13T18:41:35.338 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 msgr2=0x7fc68006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 0x7fc68006d0c0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc690007fd0 tx=0x7fc690009040 comp rx=0 tx=0).stop 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 msgr2=0x7fc6a00ccf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fc68c02a230 tx=0x7fc68c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 shutdown_connections 2024-09-13T18:41:35.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc68006ac00 0x7fc68006d0c0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6a015a910 0x7fc6a006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6a00b2600 0x7fc6a00ccf30 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 --2- 172.21.15.192:0/3989180607 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6a00add80 0x7fc6a015b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 >> 172.21.15.192:0/3989180607 conn(0x7fc6a00b08f0 msgr2=0x7fc6a00ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 shutdown_connections 2024-09-13T18:41:35.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.337+0000 7fc6a5400640 1 -- 172.21.15.192:0/3989180607 wait complete. 2024-09-13T18:41:35.356 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:41:35.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.509+0000 7fdeac400640 1 Processor -- start 2024-09-13T18:41:35.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.509+0000 7fdeac400640 1 -- start start 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.510+0000 7fdeac400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 0x7fdea406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.510+0000 7fdeac400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdea40b3da0 0x7fdea406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.510+0000 7fdeac400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdea406b480 con 0x7fdea406a8b0 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.510+0000 7fdeac400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdea40ce770 con 0x7fdea40b3da0 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.510+0000 7fdeac400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea406b760 con 0x7fdea41434c0 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdea406a8b0 0x7fdea40b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48564/0 (socket says 172.21.15.192:48564) 2024-09-13T18:41:35.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9000640 1 -- 172.21.15.192:0/4091731759 learned_addr learned my addr 172.21.15.192:0/4091731759 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9a00640 1 --2- 172.21.15.192:0/4091731759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 0x7fdea406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdeaa400640 1 --2- 172.21.15.192:0/4091731759 >> v2:172.21.15.194:3300/0 conn(0x7fdea40b3da0 0x7fdea406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832083345 0 0) 0x7fdea406b480 con 0x7fdea406a8b0 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde8c003520 con 0x7fdea406a8b0 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9a00640 1 -- 172.21.15.192:0/4091731759 >> v2:172.21.15.194:3300/0 conn(0x7fdea40b3da0 msgr2=0x7fdea406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9a00640 1 --2- 172.21.15.192:0/4091731759 >> v2:172.21.15.194:3300/0 conn(0x7fdea40b3da0 0x7fdea406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9a00640 1 -- 172.21.15.192:0/4091731759 >> v1:172.21.15.192:6789/0 conn(0x7fdea406a8b0 legacy=0x7fdea40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 971409547 0 0) 0x7fde8c003520 con 0x7fdea406a8b0 2024-09-13T18:41:35.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.511+0000 7fdea9a00640 1 -- 172.21.15.192:0/4091731759 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdea406ba40 con 0x7fdea41434c0 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.512+0000 7fdea9a00640 1 --2- 172.21.15.192:0/4091731759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 0x7fdea406c800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde980097d0 tx=0x7fde9802a0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5e7208f5a7ca65a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90001670 con 0x7fdea41434c0 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9802ab40 con 0x7fdea41434c0 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdea3e00640 1 -- 172.21.15.192:0/4091731759 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98032440 con 0x7fdea41434c0 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 -- 172.21.15.192:0/4091731759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 msgr2=0x7fdea406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 --2- 172.21.15.192:0/4091731759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 0x7fdea406c800 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fde980097d0 tx=0x7fde9802a0b0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 -- 172.21.15.192:0/4091731759 shutdown_connections 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 --2- 172.21.15.192:0/4091731759 >> v2:172.21.15.194:3300/0 conn(0x7fdea40b3da0 0x7fdea406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 --2- 172.21.15.192:0/4091731759 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea41434c0 0x7fdea406c800 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.513+0000 7fdeac400640 1 -- 172.21.15.192:0/4091731759 >> 172.21.15.192:0/4091731759 conn(0x7fdea40b08f0 msgr2=0x7fdea40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:35.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.514+0000 7fdeac400640 1 -- 172.21.15.192:0/4091731759 shutdown_connections 2024-09-13T18:41:35.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.514+0000 7fdeac400640 1 -- 172.21.15.192:0/4091731759 wait complete. 2024-09-13T18:41:35.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.515+0000 7fdeac400640 1 Processor -- start 2024-09-13T18:41:35.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.515+0000 7fdeac400640 1 -- start start 2024-09-13T18:41:35.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 0x7fdea4159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 0x7fdea4157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea4140570 con 0x7fdea406a8b0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea415a5c0 con 0x7fdea41434c0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdeac400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdea415a8a0 con 0x7fdea40b3da0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdea9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdea9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38810/0 (socket says 172.21.15.192:38810) 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.516+0000 7fdea9a00640 1 -- 172.21.15.192:0/1179204743 learned_addr learned my addr 172.21.15.192:0/1179204743 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9000640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 0x7fdea4159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdeaa400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 0x7fdea4157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 -- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 msgr2=0x7fdea4159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 0x7fdea4159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 -- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 msgr2=0x7fdea4157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 0x7fdea4157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 -- 172.21.15.192:0/1179204743 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde98009400 con 0x7fdea406a8b0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9000640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 0x7fdea4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdeaa400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 0x7fdea4157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea9a00640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fde9802a0f0 tx=0x7fde980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98006e10 con 0x7fdea406a8b0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde980044c0 con 0x7fdea406a8b0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde98003e90 con 0x7fdea406a8b0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.517+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea415ab80 con 0x7fdea406a8b0 2024-09-13T18:41:35.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.518+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea413ff30 con 0x7fdea406a8b0 2024-09-13T18:41:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.519+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea406acd0 con 0x7fdea406a8b0 2024-09-13T18:41:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.519+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fde98032440 con 0x7fdea406a8b0 2024-09-13T18:41:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.521+0000 7fdea1600640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 0x7fde8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.521+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde980a9b80 con 0x7fdea406a8b0 2024-09-13T18:41:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.521+0000 7fdea9000640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 0x7fde8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.521+0000 7fdea9000640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 0x7fde8406d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdea4142c00 tx=0x7fde90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.525+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdea406acd0 con 0x7fdea406a8b0 2024-09-13T18:41:35.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.693+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdea406acd0 con 0x7fdea406a8b0 2024-09-13T18:41:35.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.694+0000 7fdea1600640 1 -- 172.21.15.192:0/1179204743 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdea406acd0 con 0x7fdea406a8b0 2024-09-13T18:41:35.697 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 msgr2=0x7fde8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 0x7fde8406d0c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fdea4142c00 tx=0x7fde90009040 comp rx=0 tx=0).stop 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 msgr2=0x7fdea413f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fde9802a0f0 tx=0x7fde980046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 shutdown_connections 2024-09-13T18:41:35.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fde8406ac00 0x7fde8406d0c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdea41434c0 0x7fdea4157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdea40b3da0 0x7fdea4159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 --2- 172.21.15.192:0/1179204743 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdea406a8b0 0x7fdea413f9f0 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.696+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 >> 172.21.15.192:0/1179204743 conn(0x7fdea40b08f0 msgr2=0x7fdea40af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.697+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 shutdown_connections 2024-09-13T18:41:35.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.697+0000 7fdeac400640 1 -- 172.21.15.192:0/1179204743 wait complete. 2024-09-13T18:41:35.715 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:35.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.864+0000 7f73eba00640 1 Processor -- start 2024-09-13T18:41:35.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.865+0000 7f73eba00640 1 -- start start 2024-09-13T18:41:35.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73eba00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73e40afd80 0x7f73e40b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73eba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 0x7f73e4161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73eba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e41586f0 con 0x7f73e40b2b00 2024-09-13T18:41:35.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73eba00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e41627f0 con 0x7f73e40afd80 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73eba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e40b06a0 con 0x7f73e40b2690 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73e9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73e40afd80 0x7f73e40b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73e9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f73e40afd80 0x7f73e40b0160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38818/0 (socket says 172.21.15.192:38818) 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73e9000640 1 -- 172.21.15.192:0/1587570784 learned_addr learned my addr 172.21.15.192:0/1587570784 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.866+0000 7f73e3e00640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 0x7f73e4161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.867+0000 7f73e9000640 1 -- 172.21.15.192:0/1587570784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 msgr2=0x7f73e4161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.867+0000 7f73e9000640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 0x7f73e4161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.867+0000 7f73e9000640 1 -- 172.21.15.192:0/1587570784 >> v1:172.21.15.194:6789/0 conn(0x7f73e40b2b00 legacy=0x7f73e4162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.867+0000 7f73e9000640 1 -- 172.21.15.192:0/1587570784 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4162230 con 0x7f73e40afd80 2024-09-13T18:41:35.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.867+0000 7f73e3e00640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 0x7f73e4161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:35.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73e9000640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e40b0160 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009870 tx=0x7f73d402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9430428087fd5e31 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73e3400640 1 -- 172.21.15.192:0/1587570784 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4032440 con 0x7f73e40afd80 2024-09-13T18:41:35.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73e3400640 1 -- 172.21.15.192:0/1587570784 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d40325a0 con 0x7f73e40afd80 2024-09-13T18:41:35.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73e3400640 1 -- 172.21.15.192:0/1587570784 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4032930 con 0x7f73e40afd80 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 -- 172.21.15.192:0/1587570784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 msgr2=0x7f73e40b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e40b0160 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009870 tx=0x7f73d402a250 comp rx=0 tx=0).stop 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 -- 172.21.15.192:0/1587570784 shutdown_connections 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2690 0x7f73e4161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 --2- 172.21.15.192:0/1587570784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e40b0160 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.868+0000 7f73eba00640 1 -- 172.21.15.192:0/1587570784 >> 172.21.15.192:0/1587570784 conn(0x7f73e40ae960 msgr2=0x7f73e406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.869+0000 7f73eba00640 1 -- 172.21.15.192:0/1587570784 shutdown_connections 2024-09-13T18:41:35.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.869+0000 7f73eba00640 1 -- 172.21.15.192:0/1587570784 wait complete. 2024-09-13T18:41:35.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.870+0000 7f73eba00640 1 Processor -- start 2024-09-13T18:41:35.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.870+0000 7f73eba00640 1 -- start start 2024-09-13T18:41:35.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e40b2690 0x7f73e41eb3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2b00 0x7f73e4146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4143da0 con 0x7f73e40afd80 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4144080 con 0x7f73e40b2690 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73eba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e4144360 con 0x7f73e40b2b00 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73e9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73e9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38834/0 (socket says 172.21.15.192:38834) 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.871+0000 7f73e9000640 1 -- 172.21.15.192:0/2664019739 learned_addr learned my addr 172.21.15.192:0/2664019739 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e3e00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e40b2690 0x7f73e41eb3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9a00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2b00 0x7f73e4146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 -- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2b00 msgr2=0x7f73e4146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2b00 0x7f73e4146e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 -- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e40b2690 msgr2=0x7f73e41eb3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:35.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e40b2690 0x7f73e41eb3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:35.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 -- 172.21.15.192:0/2664019739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d40094d0 con 0x7f73e40afd80 2024-09-13T18:41:35.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e9000640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f73d4000c00 tx=0x7f73d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4032440 con 0x7f73e40afd80 2024-09-13T18:41:35.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d4030b80 con 0x7f73e40afd80 2024-09-13T18:41:35.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e4144640 con 0x7f73e40afd80 2024-09-13T18:41:35.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.872+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d403d440 con 0x7f73e40afd80 2024-09-13T18:41:35.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.873+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e4160c10 con 0x7f73e40afd80 2024-09-13T18:41:35.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.874+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e4144b00 con 0x7f73e40afd80 2024-09-13T18:41:35.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.874+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73d4039040 con 0x7f73e40afd80 2024-09-13T18:41:35.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.875+0000 7f73e0c00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 0x7f73c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:35.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.875+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73d40a9fc0 con 0x7f73e40afd80 2024-09-13T18:41:35.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.875+0000 7f73e3e00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 0x7f73c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:35.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.876+0000 7f73e3e00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 0x7f73c406d0f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f73e41e9380 tx=0x7f73d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:35.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:35.879+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73d4075070 con 0x7f73e40afd80 2024-09-13T18:41:36.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.081+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73e40b37d0 con 0x7f73e40afd80 2024-09-13T18:41:36.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.082+0000 7f73e0c00640 1 -- 172.21.15.192:0/2664019739 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f73d4041090 con 0x7f73e40afd80 2024-09-13T18:41:36.085 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:36.085 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 msgr2=0x7f73c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 0x7f73c406d0f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f73e41e9380 tx=0x7f73d0008040 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 msgr2=0x7f73e41606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f73d4000c00 tx=0x7f73d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 shutdown_connections 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73c406ac30 0x7f73c406d0f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73e40b2b00 0x7f73e4146e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73e40b2690 0x7f73e41eb3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 --2- 172.21.15.192:0/2664019739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e40afd80 0x7f73e41606d0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 >> 172.21.15.192:0/2664019739 conn(0x7f73e40ae960 msgr2=0x7f73e4065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 shutdown_connections 2024-09-13T18:41:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.084+0000 7f73eba00640 1 -- 172.21.15.192:0/2664019739 wait complete. 2024-09-13T18:41:36.103 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:36.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.252+0000 7f3110e00640 1 Processor -- start 2024-09-13T18:41:36.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.252+0000 7f3110e00640 1 -- start start 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.253+0000 7f3110e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310c150480 0x7f310c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3110e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f310c071810 0x7f310c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3110e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f310c071dd0 con 0x7f310c0b2230 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3110e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c0cb770 con 0x7f310c150480 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3110e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f310c0cba50 con 0x7f310c071810 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310c150480 0x7f310c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f310c150480 0x7f310c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38844/0 (socket says 172.21.15.192:38844) 2024-09-13T18:41:36.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 -- 172.21.15.192:0/995464498 learned_addr learned my addr 172.21.15.192:0/995464498 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:36.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3101400640 1 --2- 172.21.15.192:0/995464498 >> v2:172.21.15.194:3300/0 conn(0x7f310c071810 0x7f310c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 -- 172.21.15.192:0/995464498 >> v2:172.21.15.194:3300/0 conn(0x7f310c071810 msgr2=0x7f310c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:36.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 --2- 172.21.15.192:0/995464498 >> v2:172.21.15.194:3300/0 conn(0x7f310c071810 0x7f310c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 -- 172.21.15.192:0/995464498 >> v1:172.21.15.194:6789/0 conn(0x7f310c0b2230 legacy=0x7f310c0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:36.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.254+0000 7f3109e00640 1 -- 172.21.15.192:0/995464498 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f310c0cbd30 con 0x7f310c150480 2024-09-13T18:41:36.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.255+0000 7f3109e00640 1 --2- 172.21.15.192:0/995464498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c15a3e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f310c06cb50 tx=0x7f30fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a99c1981e82fa0bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3109400640 1 -- 172.21.15.192:0/995464498 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc032440 con 0x7f310c150480 2024-09-13T18:41:36.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3109400640 1 -- 172.21.15.192:0/995464498 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30fc0325a0 con 0x7f310c150480 2024-09-13T18:41:36.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3109400640 1 -- 172.21.15.192:0/995464498 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30fc032930 con 0x7f310c150480 2024-09-13T18:41:36.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 -- 172.21.15.192:0/995464498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 msgr2=0x7f310c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 --2- 172.21.15.192:0/995464498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c15a3e0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f310c06cb50 tx=0x7f30fc02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 -- 172.21.15.192:0/995464498 shutdown_connections 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 --2- 172.21.15.192:0/995464498 >> v2:172.21.15.194:3300/0 conn(0x7f310c071810 0x7f310c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 --2- 172.21.15.192:0/995464498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c15a3e0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 -- 172.21.15.192:0/995464498 >> 172.21.15.192:0/995464498 conn(0x7f310c0ae960 msgr2=0x7f310c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 -- 172.21.15.192:0/995464498 shutdown_connections 2024-09-13T18:41:36.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.256+0000 7f3110e00640 1 -- 172.21.15.192:0/995464498 wait complete. 2024-09-13T18:41:36.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.258+0000 7f3110e00640 1 Processor -- start 2024-09-13T18:41:36.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.258+0000 7f3110e00640 1 -- start start 2024-09-13T18:41:36.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f310c071810 0x7f310c06c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f310c0b2230 0x7f310c148840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c147760 con 0x7f310c150480 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310c1493b0 con 0x7f310c071810 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3110e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310c149690 con 0x7f310c0b2230 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f310a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f310a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38848/0 (socket says 172.21.15.192:38848) 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f310a800640 1 -- 172.21.15.192:0/1270146796 learned_addr learned my addr 172.21.15.192:0/1270146796 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3109e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f310c071810 0x7f310c06c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.259+0000 7f3101400640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f310c0b2230 0x7f310c148840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 -- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f310c0b2230 msgr2=0x7f310c148840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f310c0b2230 0x7f310c148840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 -- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f310c071810 msgr2=0x7f310c06c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f310c071810 0x7f310c06c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 -- 172.21.15.192:0/1270146796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc0094d0 con 0x7f310c150480 2024-09-13T18:41:36.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f310a800640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f310400c700 tx=0x7f310400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400aa50 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310400abb0 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f310c147d60 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310400ce10 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.260+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c148320 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.261+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f310c148540 con 0x7f310c150480 2024-09-13T18:41:36.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.262+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3104012420 con 0x7f310c150480 2024-09-13T18:41:36.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.263+0000 7f3102a00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 0x7f30e806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.263+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3104089710 con 0x7f310c150480 2024-09-13T18:41:36.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.263+0000 7f3109e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 0x7f30e806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.264+0000 7f3109e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 0x7f30e806d0f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f30fc034000 tx=0x7f30fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.267+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3104054900 con 0x7f310c150480 2024-09-13T18:41:36.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.437+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f310c0b1cf0 con 0x7f310c150480 2024-09-13T18:41:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.438+0000 7f3102a00640 1 -- 172.21.15.192:0/1270146796 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f3104003eb0 con 0x7f310c150480 2024-09-13T18:41:36.441 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:36.441 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":122,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:27.153667+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 msgr2=0x7f30e806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 0x7f30e806d0f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f30fc034000 tx=0x7f30fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 msgr2=0x7f310c070030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f310400c700 tx=0x7f310400cbc0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 shutdown_connections 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30e806ac30 0x7f30e806d0f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f310c150480 0x7f310c070030 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f310c0b2230 0x7f310c148840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 --2- 172.21.15.192:0/1270146796 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f310c071810 0x7f310c06c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.440+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 >> 172.21.15.192:0/1270146796 conn(0x7f310c0ae960 msgr2=0x7f310c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.441+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 shutdown_connections 2024-09-13T18:41:36.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.441+0000 7f3110e00640 1 -- 172.21.15.192:0/1270146796 wait complete. 2024-09-13T18:41:36.459 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:41:36.459 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:36.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.607+0000 7f23ef200640 1 Processor -- start 2024-09-13T18:41:36.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.608+0000 7f23ef200640 1 -- start start 2024-09-13T18:41:36.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ef200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f23f015a9e0 0x7f23f006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ef200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 0x7f23f00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ef200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23f006c5d0 con 0x7f23f006e990 2024-09-13T18:41:36.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ef200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23f00b3730 con 0x7f23f015a9e0 2024-09-13T18:41:36.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ef200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00b3920 con 0x7f23f006b3d0 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ee800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f23f006e990 0x7f23f0070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48578/0 (socket says 172.21.15.192:48578) 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ee800640 1 -- 172.21.15.192:0/1141017835 learned_addr learned my addr 172.21.15.192:0/1141017835 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ede00640 1 --2- 172.21.15.192:0/1141017835 >> v2:172.21.15.194:3300/0 conn(0x7f23f015a9e0 0x7f23f006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.609+0000 7f23ed400640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 0x7f23f00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23eca00640 1 -- 172.21.15.192:0/1141017835 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961619163 0 0) 0x7f23f006c5d0 con 0x7f23f006e990 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23eca00640 1 -- 172.21.15.192:0/1141017835 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d4003520 con 0x7f23f006e990 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23ede00640 1 -- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 msgr2=0x7f23f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:36.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23ede00640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 0x7f23f00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23ede00640 1 -- 172.21.15.192:0/1141017835 >> v1:172.21.15.192:6789/0 conn(0x7f23f006e990 legacy=0x7f23f0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23ede00640 1 -- 172.21.15.192:0/1141017835 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23f00b3c00 con 0x7f23f015a9e0 2024-09-13T18:41:36.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.610+0000 7f23ed400640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 0x7f23f00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.611+0000 7f23ede00640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f015a9e0 0x7f23f006ae90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f23e00097a0 tx=0x7f23e002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f77935010f2ca545 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.611+0000 7f23eca00640 1 -- 172.21.15.192:0/1141017835 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0032440 con 0x7f23f015a9e0 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.611+0000 7f23eca00640 1 -- 172.21.15.192:0/1141017835 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e00325a0 con 0x7f23f015a9e0 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.611+0000 7f23eca00640 1 -- 172.21.15.192:0/1141017835 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0032930 con 0x7f23f015a9e0 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 -- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f015a9e0 msgr2=0x7f23f006ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f015a9e0 0x7f23f006ae90 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f23e00097a0 tx=0x7f23e002a180 comp rx=0 tx=0).stop 2024-09-13T18:41:36.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 -- 172.21.15.192:0/1141017835 shutdown_connections 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f006b3d0 0x7f23f00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 --2- 172.21.15.192:0/1141017835 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f015a9e0 0x7f23f006ae90 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 -- 172.21.15.192:0/1141017835 >> 172.21.15.192:0/1141017835 conn(0x7f23f00736d0 msgr2=0x7f23f00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 -- 172.21.15.192:0/1141017835 shutdown_connections 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.612+0000 7f23ef200640 1 -- 172.21.15.192:0/1141017835 wait complete. 2024-09-13T18:41:36.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.614+0000 7f23ef200640 1 Processor -- start 2024-09-13T18:41:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.614+0000 7f23ef200640 1 -- start start 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f006e990 0x7f23f00cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 0x7f23f0143290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f00cd720 con 0x7f23f006b3d0 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23f01437d0 con 0x7f23f006e990 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ef200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23f014cd00 con 0x7f23f015a9e0 2024-09-13T18:41:36.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38856/0 (socket says 172.21.15.192:38856) 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 -- 172.21.15.192:0/3390099923 learned_addr learned my addr 172.21.15.192:0/3390099923 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ed400640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f006e990 0x7f23f00cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ee800640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 0x7f23f0143290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 -- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 msgr2=0x7f23f0143290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 0x7f23f0143290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 -- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f006e990 msgr2=0x7f23f00cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f006e990 0x7f23f00cd1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ede00640 1 -- 172.21.15.192:0/3390099923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc009400 con 0x7f23f006b3d0 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.615+0000 7f23ee800640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 0x7f23f0143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23ede00640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f23e0035040 tx=0x7f23e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e003d8f0 con 0x7f23f006b3d0 2024-09-13T18:41:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e003da70 con 0x7f23f006b3d0 2024-09-13T18:41:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e0009400 con 0x7f23f006b3d0 2024-09-13T18:41:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e003de20 con 0x7f23f006b3d0 2024-09-13T18:41:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.616+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23f014d2c0 con 0x7f23f006b3d0 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.617+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23f00ce6c0 con 0x7f23f006b3d0 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.618+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f23e0039040 con 0x7f23f006b3d0 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.619+0000 7f23e6000640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 0x7f23d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.619+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23e00a9d20 con 0x7f23f006b3d0 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.619+0000 7f23ed400640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 0x7f23d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.620+0000 7f23ed400640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 0x7f23d006d0c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23f0156f40 tx=0x7f23dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:36.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.623+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f23e00750d0 con 0x7f23f006b3d0 2024-09-13T18:41:36.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.824+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23f00716f0 con 0x7f23f006b3d0 2024-09-13T18:41:36.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.825+0000 7f23e6000640 1 -- 172.21.15.192:0/3390099923 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f23e00786f0 con 0x7f23f006b3d0 2024-09-13T18:41:36.828 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:36.828 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:36.828 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 msgr2=0x7f23d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 0x7f23d006d0c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f23f0156f40 tx=0x7f23dc009190 comp rx=0 tx=0).stop 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 msgr2=0x7f23f014c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f23e0035040 tx=0x7f23e00046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 shutdown_connections 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f23d006ac00 0x7f23d006d0c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f23f015a9e0 0x7f23f0143290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f23f006e990 0x7f23f00cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 --2- 172.21.15.192:0/3390099923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23f006b3d0 0x7f23f014c620 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:36.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 >> 172.21.15.192:0/3390099923 conn(0x7f23f00736d0 msgr2=0x7f23f00b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:36.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 shutdown_connections 2024-09-13T18:41:36.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.827+0000 7f23ef200640 1 -- 172.21.15.192:0/3390099923 wait complete. 2024-09-13T18:41:36.846 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:36.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.996+0000 7f30dcc00640 1 Processor -- start 2024-09-13T18:41:36.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.996+0000 7f30dcc00640 1 -- start start 2024-09-13T18:41:37.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30dcc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f30d80cc530 0x7f30d80cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30dcc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d80ccec0 con 0x7f30d8071810 2024-09-13T18:41:37.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30dcc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30d8071dd0 con 0x7f30d8150480 2024-09-13T18:41:37.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30dcc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30d80cb770 con 0x7f30d80cc530 2024-09-13T18:41:37.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30cfe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f30d8071810 0x7f30d80b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48580/0 (socket says 172.21.15.192:48580) 2024-09-13T18:41:37.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.997+0000 7f30cfe00640 1 -- 172.21.15.192:0/2230547865 learned_addr learned my addr 172.21.15.192:0/2230547865 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:37.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d6800640 1 --2- 172.21.15.192:0/2230547865 >> v2:172.21.15.194:3300/0 conn(0x7f30d80cc530 0x7f30d80cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 488537530 0 0) 0x7f30d80ccec0 con 0x7f30d8071810 2024-09-13T18:41:37.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30bc003520 con 0x7f30d8071810 2024-09-13T18:41:37.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189022728 0 0) 0x7f30bc003520 con 0x7f30d8071810 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 >> v2:172.21.15.194:3300/0 conn(0x7f30d80cc530 msgr2=0x7f30d80cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 --2- 172.21.15.192:0/2230547865 >> v2:172.21.15.194:3300/0 conn(0x7f30d80cc530 0x7f30d80cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 >> v1:172.21.15.194:6789/0 conn(0x7f30d8150480 legacy=0x7f30d815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d80cba50 con 0x7f30d8071810 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f30c0001670 con 0x7f30d8071810 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d6800640 1 --2- 172.21.15.192:0/2230547865 >> v2:172.21.15.194:3300/0 conn(0x7f30d80cc530 0x7f30d80cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 >> v1:172.21.15.192:6789/0 conn(0x7f30d8071810 legacy=0x7f30d80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc003970 0x7f30bc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 0x7f30bc004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30bc0050e0 0x7f30bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d80cb770 con 0x7f30bc004370 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc00c020 con 0x7f30bc0050e0 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.998+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30bc00c1e0 con 0x7f30bc003970 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 0x7f30bc004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30d5e00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc003970 0x7f30bc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30d6800640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30bc0050e0 0x7f30bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 -- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc003970 msgr2=0x7f30bc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc003970 0x7f30bc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 -- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30bc0050e0 msgr2=0x7f30bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30bc0050e0 0x7f30bc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30cfe00640 1 -- 172.21.15.192:0/2230547865 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30bc003520 con 0x7f30bc004370 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:36.999+0000 7f30d6800640 1 -- 172.21.15.192:0/2230547865 reap_dead start 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.000+0000 7f30cfe00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 0x7f30bc004840 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c210 tx=0x7f30bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8400dd4e99ab858 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.000+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0005ad0 con 0x7f30bc004370 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.000+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c002d070 con 0x7f30bc004370 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.000+0000 7f30d5400640 1 -- 172.21.15.192:0/2230547865 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0007070 con 0x7f30bc004370 2024-09-13T18:41:37.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 -- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 msgr2=0x7f30bc004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 0x7f30bc004840 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f30c000c210 tx=0x7f30bc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 -- 172.21.15.192:0/2230547865 shutdown_connections 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 --2- 172.21.15.192:0/2230547865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30bc004370 0x7f30bc004840 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 -- 172.21.15.192:0/2230547865 >> 172.21.15.192:0/2230547865 conn(0x7f30d80ae960 msgr2=0x7f30d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 -- 172.21.15.192:0/2230547865 shutdown_connections 2024-09-13T18:41:37.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.001+0000 7f30dcc00640 1 -- 172.21.15.192:0/2230547865 wait complete. 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.003+0000 7f30dcc00640 1 Processor -- start 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.003+0000 7f30dcc00640 1 -- start start 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 0x7f30d8156aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 0x7f30d8150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8146150 con 0x7f30d81e4070 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d81e4a30 con 0x7f30d8150ac0 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30dcc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30d8146330 con 0x7f30bc004370 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38880/0 (socket says 172.21.15.192:38880) 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 -- 172.21.15.192:0/4065422629 learned_addr learned my addr 172.21.15.192:0/4065422629 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30d6800640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 0x7f30d8150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30d5e00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 0x7f30d8156aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 -- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 msgr2=0x7f30d8156aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 0x7f30d8156aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 -- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 msgr2=0x7f30d8150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 0x7f30d8150f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30cfe00640 1 -- 172.21.15.192:0/4065422629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30d8146610 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30d6800640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 0x7f30d8150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.004+0000 7f30d5e00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 0x7f30d8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30cfe00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f30c002ad00 tx=0x7f30c0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c00049e0 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c0004b40 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d81468f0 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c0001060 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.005+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d8146eb0 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.006+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30d8067490 con 0x7f30d81e4070 2024-09-13T18:41:37.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.007+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f30c002f030 con 0x7f30d81e4070 2024-09-13T18:41:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.008+0000 7f30ce000640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 0x7f30b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.008+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30c00a8aa0 con 0x7f30d81e4070 2024-09-13T18:41:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.008+0000 7f30d5e00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 0x7f30b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.009+0000 7f30d5e00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 0x7f30b406d0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f30d804f480 tx=0x7f30c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.013+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f30c0073c70 con 0x7f30d81e4070 2024-09-13T18:41:37.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.217+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30d8067490 con 0x7f30d81e4070 2024-09-13T18:41:37.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.217+0000 7f30ce000640 1 -- 172.21.15.192:0/4065422629 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f30c0077290 con 0x7f30d81e4070 2024-09-13T18:41:37.220 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:37.221 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":47,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:00.930313+0000","modified":"2024-09-13T18:41:03.937688+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6550},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6550":{"gid":6550,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2916846477","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2916846477},{"type":"v1","addr":"172.21.15.192:6837","nonce":2916846477}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-09-13T18:41:37.221 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 47 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 msgr2=0x7f30b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 0x7f30b406d0c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f30d804f480 tx=0x7f30c8009040 comp rx=0 tx=0).stop 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 msgr2=0x7f30d81e44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f30c002ad00 tx=0x7f30c0001a00 comp rx=0 tx=0).stop 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 shutdown_connections 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30b406ac00 0x7f30b406d0c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30d8150ac0 0x7f30d8150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30d81e4070 0x7f30d81e44f0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 --2- 172.21.15.192:0/4065422629 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30bc004370 0x7f30d8156aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 >> 172.21.15.192:0/4065422629 conn(0x7f30d80ae960 msgr2=0x7f30d80afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 shutdown_connections 2024-09-13T18:41:37.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.220+0000 7f30dcc00640 1 -- 172.21.15.192:0/4065422629 wait complete. 2024-09-13T18:41:37.238 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:37.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.391+0000 7f2719a00640 1 Processor -- start 2024-09-13T18:41:37.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.391+0000 7f2719a00640 1 -- start start 2024-09-13T18:41:37.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140b3f10 0x7f271415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2719a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f27140b0490 0x7f271415a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2719a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27140b2f00 con 0x7f271415dee0 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2719a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f271415aec0 con 0x7f27140b0490 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b3150 con 0x7f27140b3f10 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2712a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f271415dee0 0x7f27140afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48592/0 (socket says 172.21.15.192:48592) 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2712a00640 1 -- 172.21.15.192:0/175606071 learned_addr learned my addr 172.21.15.192:0/175606071 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2713400640 1 --2- 172.21.15.192:0/175606071 >> v2:172.21.15.192:3300/0 conn(0x7f27140b0490 0x7f271415a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f270a000640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140b3f10 0x7f271415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2712000640 1 -- 172.21.15.192:0/175606071 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 312857441 0 0) 0x7f27140b2f00 con 0x7f271415dee0 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2712000640 1 -- 172.21.15.192:0/175606071 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26f8003520 con 0x7f271415dee0 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.393+0000 7f2713400640 1 -- 172.21.15.192:0/175606071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140b3f10 msgr2=0x7f271415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:37.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.394+0000 7f2713400640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140b3f10 0x7f271415a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.394+0000 7f2713400640 1 -- 172.21.15.192:0/175606071 >> v1:172.21.15.192:6789/0 conn(0x7f271415dee0 legacy=0x7f27140afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.394+0000 7f2713400640 1 -- 172.21.15.192:0/175606071 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140b3430 con 0x7f27140b0490 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.394+0000 7f2713400640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27140b0490 0x7f271415a980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f270c009d90 tx=0x7f270c02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4341e3ed28af7518 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2712000640 1 -- 172.21.15.192:0/175606071 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c007740 con 0x7f27140b0490 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2712000640 1 -- 172.21.15.192:0/175606071 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270c02d050 con 0x7f27140b0490 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2712000640 1 -- 172.21.15.192:0/175606071 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f270c007ac0 con 0x7f27140b0490 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 -- 172.21.15.192:0/175606071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27140b0490 msgr2=0x7f271415a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27140b0490 0x7f271415a980 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f270c009d90 tx=0x7f270c02a660 comp rx=0 tx=0).stop 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 -- 172.21.15.192:0/175606071 shutdown_connections 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27140b0490 0x7f271415a980 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 --2- 172.21.15.192:0/175606071 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27140b3f10 0x7f271415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 -- 172.21.15.192:0/175606071 >> 172.21.15.192:0/175606071 conn(0x7f27140ae960 msgr2=0x7f271406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 -- 172.21.15.192:0/175606071 shutdown_connections 2024-09-13T18:41:37.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.395+0000 7f2719a00640 1 -- 172.21.15.192:0/175606071 wait complete. 2024-09-13T18:41:37.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.397+0000 7f2719a00640 1 Processor -- start 2024-09-13T18:41:37.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.397+0000 7f2719a00640 1 -- start start 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 0x7f2714137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 0x7f2714141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2714137c70 con 0x7f271415dee0 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27141418c0 con 0x7f27140b0490 2024-09-13T18:41:37.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f2719a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2714141ba0 con 0x7f2714140db0 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f270a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f270a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38900/0 (socket says 172.21.15.192:38900) 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.398+0000 7f270a000640 1 -- 172.21.15.192:0/2890831331 learned_addr learned my addr 172.21.15.192:0/2890831331 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f2713400640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 0x7f2714141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f2712a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 0x7f2714137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 -- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 msgr2=0x7f2714141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 0x7f2714141260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 -- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 msgr2=0x7f2714137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 0x7f2714137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 -- 172.21.15.192:0/2890831331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c009a70 con 0x7f271415dee0 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f2713400640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 0x7f2714141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:37.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f2712a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 0x7f2714137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270a000640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d800 tx=0x7f26fc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00b6c0 con 0x7f271415dee0 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc00b820 con 0x7f271415dee0 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2714136c50 con 0x7f271415dee0 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.399+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc00bbb0 con 0x7f271415dee0 2024-09-13T18:41:37.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.400+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2714137210 con 0x7f271415dee0 2024-09-13T18:41:37.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.401+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140afd80 con 0x7f271415dee0 2024-09-13T18:41:37.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.401+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f26fc00bd10 con 0x7f271415dee0 2024-09-13T18:41:37.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.402+0000 7f270b400640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 0x7f26f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.402+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26fc089940 con 0x7f271415dee0 2024-09-13T18:41:37.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.402+0000 7f2712a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 0x7f26f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.403+0000 7f2712a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 0x7f26f006d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f27040011e0 tx=0x7f2704009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.407+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26fc054a80 con 0x7f271415dee0 2024-09-13T18:41:37.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.575+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27140670a0 con 0x7f271415dee0 2024-09-13T18:41:37.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.577+0000 7f270b400640 1 -- 172.21.15.192:0/2890831331 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16644 (secure 0 0 0) 0x7f26fc0580a0 con 0x7f271415dee0 2024-09-13T18:41:37.580 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:37.580 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":122,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:27.153667+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:40:58.888332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-13T18:40:59.927636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 msgr2=0x7f26f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 0x7f26f006d0c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f27040011e0 tx=0x7f2704009040 comp rx=0 tx=0).stop 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 msgr2=0x7f27141364a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f26fc00d800 tx=0x7f26fc00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 shutdown_connections 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f26f006ac00 0x7f26f006d0c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2714140db0 0x7f2714141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f271415dee0 0x7f27141364a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 --2- 172.21.15.192:0/2890831331 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27140b0490 0x7f2714137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 >> 172.21.15.192:0/2890831331 conn(0x7f27140ae960 msgr2=0x7f271406a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 shutdown_connections 2024-09-13T18:41:37.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.579+0000 7f2719a00640 1 -- 172.21.15.192:0/2890831331 wait complete. 2024-09-13T18:41:37.598 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:41:37.722 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:41:37.726 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:41:37.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.750+0000 7fa74d800640 1 Processor -- start 2024-09-13T18:41:37.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.750+0000 7fa74d800640 1 -- start start 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.751+0000 7fa74d800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7480cf1b0 0x7fa7480aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.751+0000 7fa74d800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa7480af2a0 0x7fa7480730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.751+0000 7fa74d800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa748161490 con 0x7fa7480735e0 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.751+0000 7fa74d800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480af820 con 0x7fa7480af2a0 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.751+0000 7fa74d800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7480739f0 con 0x7fa7480cf1b0 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa7480af2a0 0x7fa7480730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa7480af2a0 0x7fa7480730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38916/0 (socket says 172.21.15.192:38916) 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 -- 172.21.15.192:0/1645764555 learned_addr learned my addr 172.21.15.192:0/1645764555 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa747400640 1 --1- 172.21.15.192:0/1645764555 >> v1:172.21.15.194:6789/0 conn(0x7fa7480735e0 0x7fa7480ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:57240/0 (socket says 172.21.15.192:57240) 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa746a00640 1 --2- 172.21.15.192:0/1645764555 >> v2:172.21.15.194:3300/0 conn(0x7fa7480cf1b0 0x7fa7480aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 -- 172.21.15.192:0/1645764555 >> v2:172.21.15.194:3300/0 conn(0x7fa7480cf1b0 msgr2=0x7fa7480aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 --2- 172.21.15.192:0/1645764555 >> v2:172.21.15.194:3300/0 conn(0x7fa7480cf1b0 0x7fa7480aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 -- 172.21.15.192:0/1645764555 >> v1:172.21.15.194:6789/0 conn(0x7fa7480735e0 legacy=0x7fa7480ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa73fe00640 1 -- 172.21.15.192:0/1645764555 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748160b60 con 0x7fa7480af2a0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.752+0000 7fa746000640 1 -- 172.21.15.192:0/1645764555 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2900276720 0 0) 0x7fa748161490 con 0x7fa7480735e0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.753+0000 7fa73fe00640 1 --2- 172.21.15.192:0/1645764555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7480730a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa748073dd0 tx=0x7fa73002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4f20a4ea9743d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa746000640 1 -- 172.21.15.192:0/1645764555 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730032440 con 0x7fa7480af2a0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa746000640 1 -- 172.21.15.192:0/1645764555 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300325a0 con 0x7fa7480af2a0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa746000640 1 -- 172.21.15.192:0/1645764555 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730032930 con 0x7fa7480af2a0 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 -- 172.21.15.192:0/1645764555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 msgr2=0x7fa7480730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 --2- 172.21.15.192:0/1645764555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7480730a0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa748073dd0 tx=0x7fa73002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 -- 172.21.15.192:0/1645764555 shutdown_connections 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 --2- 172.21.15.192:0/1645764555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7480730a0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 --2- 172.21.15.192:0/1645764555 >> v2:172.21.15.194:3300/0 conn(0x7fa7480cf1b0 0x7fa7480aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.754+0000 7fa74d800640 1 -- 172.21.15.192:0/1645764555 >> 172.21.15.192:0/1645764555 conn(0x7fa7480b2030 msgr2=0x7fa748069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.755+0000 7fa74d800640 1 -- 172.21.15.192:0/1645764555 shutdown_connections 2024-09-13T18:41:37.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.755+0000 7fa74d800640 1 -- 172.21.15.192:0/1645764555 wait complete. 2024-09-13T18:41:37.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.756+0000 7fa74d800640 1 Processor -- start 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.756+0000 7fa74d800640 1 -- start start 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7480735e0 0x7fa748157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7480cf1b0 0x7fa748153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748157a00 con 0x7fa7480af2a0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481f6310 con 0x7fa7480735e0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa74d800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481f6520 con 0x7fa7480cf1b0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa73fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38920/0 (socket says 172.21.15.192:38920) 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa73fe00640 1 -- 172.21.15.192:0/128664060 learned_addr learned my addr 172.21.15.192:0/128664060 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.757+0000 7fa746a00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7480735e0 0x7fa748157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa747400640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7480cf1b0 0x7fa748153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 -- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7480cf1b0 msgr2=0x7fa748153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7480cf1b0 0x7fa748153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 -- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7480735e0 msgr2=0x7fa748157470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7480735e0 0x7fa748157470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 -- 172.21.15.192:0/128664060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7300094d0 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.758+0000 7fa73fe00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa73002a220 tx=0x7fa7300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.759+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730032440 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.759+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa730030980 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.759+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa730030d10 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.759+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7481f6800 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.759+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa748157c10 con 0x7fa7480af2a0 2024-09-13T18:41:37.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.760+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7481f6cc0 con 0x7fa7480af2a0 2024-09-13T18:41:37.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.761+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa730039040 con 0x7fa7480af2a0 2024-09-13T18:41:37.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.762+0000 7fa73ea00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:37.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.762+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7300a9c80 con 0x7fa7480af2a0 2024-09-13T18:41:37.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.762+0000 7fa746a00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:37.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.763+0000 7fa746a00640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa738009b40 tx=0x7fa738009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:37.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.766+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa730074e70 con 0x7fa7480af2a0 2024-09-13T18:41:37.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.974+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa7480cf590 con 0x7fa7480af2a0 2024-09-13T18:41:37.977 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:41:37.975+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:41:37.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.984+0000 7fa73ea00640 1 -- 172.21.15.192:0/128664060 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v48) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa730041090 con 0x7fa7480af2a0 2024-09-13T18:41:37.986 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 msgr2=0x7fa72406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fa738009b40 tx=0x7fa738009190 comp rx=0 tx=0).stop 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 msgr2=0x7fa7481f5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fa73002a220 tx=0x7fa7300046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 shutdown_connections 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa72406ac00 0x7fa72406d0c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7480cf1b0 0x7fa748153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7480af2a0 0x7fa7481f5dd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 --2- 172.21.15.192:0/128664060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa7480735e0 0x7fa748157470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:37.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 >> 172.21.15.192:0/128664060 conn(0x7fa7480b2030 msgr2=0x7fa7480afe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:37.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 shutdown_connections 2024-09-13T18:41:37.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:37.987+0000 7fa74d800640 1 -- 172.21.15.192:0/128664060 wait complete. 2024-09-13T18:41:38.011 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:41:38.059 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:41:38.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.165+0000 7f13d9a00640 1 Processor -- start 2024-09-13T18:41:38.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.165+0000 7f13d9a00640 1 -- start start 2024-09-13T18:41:38.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.166+0000 7f13d9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d40b3220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.166+0000 7f13d9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f13d40ce2c0 0x7f13d406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.166+0000 7f13d9a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d40ce9f0 con 0x7f13d406beb0 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.166+0000 7f13d9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d4069fb0 con 0x7f13d40ce2c0 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.166+0000 7f13d9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d406a290 con 0x7f13d4159b40 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13d3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f13d406beb0 0x7f13d406ad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48616/0 (socket says 172.21.15.192:48616) 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13d3400640 1 -- 172.21.15.192:0/1042732092 learned_addr learned my addr 172.21.15.192:0/1042732092 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13ca000640 1 --2- 172.21.15.192:0/1042732092 >> v2:172.21.15.194:3300/0 conn(0x7f13d40ce2c0 0x7f13d406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13d2a00640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d40b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13d2000640 1 -- 172.21.15.192:0/1042732092 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 83807068 0 0) 0x7f13d40ce9f0 con 0x7f13d406beb0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13d2000640 1 -- 172.21.15.192:0/1042732092 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13b8003520 con 0x7f13d406beb0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13ca000640 1 -- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 msgr2=0x7f13d40b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13ca000640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d40b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13ca000640 1 -- 172.21.15.192:0/1042732092 >> v1:172.21.15.192:6789/0 conn(0x7f13d406beb0 legacy=0x7f13d406ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.167+0000 7f13ca000640 1 -- 172.21.15.192:0/1042732092 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d406a570 con 0x7f13d40ce2c0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.168+0000 7f13ca000640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d406e920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097a0 tx=0x7f13bc02a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57c9c0199dd9a77 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d2000640 1 -- 172.21.15.192:0/1042732092 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc02ae50 con 0x7f13d40ce2c0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d2000640 1 -- 172.21.15.192:0/1042732092 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13bc032440 con 0x7f13d40ce2c0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d2000640 1 -- 172.21.15.192:0/1042732092 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0327d0 con 0x7f13d40ce2c0 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 -- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 msgr2=0x7f13d406e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d406e920 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f13bc0097a0 tx=0x7f13bc02a100 comp rx=0 tx=0).stop 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 -- 172.21.15.192:0/1042732092 shutdown_connections 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d406e920 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1042732092 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d40b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 -- 172.21.15.192:0/1042732092 >> 172.21.15.192:0/1042732092 conn(0x7f13d40cebc0 msgr2=0x7f13d40cefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 -- 172.21.15.192:0/1042732092 shutdown_connections 2024-09-13T18:41:38.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.169+0000 7f13d9a00640 1 -- 172.21.15.192:0/1042732092 wait complete. 2024-09-13T18:41:38.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.171+0000 7f13d9a00640 1 Processor -- start 2024-09-13T18:41:38.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.171+0000 7f13d9a00640 1 -- start start 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d413e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d4154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d414d7c0 con 0x7f13d406beb0 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d414ebf0 con 0x7f13d40ce2c0 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d4141270 con 0x7f13d4159b40 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38944/0 (socket says 172.21.15.192:38944) 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.172+0000 7f13d2a00640 1 -- 172.21.15.192:0/1680852226 learned_addr learned my addr 172.21.15.192:0/1680852226 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d3400640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d4154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13ca000640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d413e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 -- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 msgr2=0x7f13d4154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d4154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 -- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 msgr2=0x7f13d413e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d413e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 -- 172.21.15.192:0/1680852226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13bc009400 con 0x7f13d406beb0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d3400640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13ca000640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d2a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f13c400e8a0 tx=0x7f13c400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c40094f0 con 0x7f13d406beb0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c400c940 con 0x7f13d406beb0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c400ccf0 con 0x7f13d406beb0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d414d4e0 con 0x7f13d406beb0 2024-09-13T18:41:38.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.173+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d414f150 con 0x7f13d406beb0 2024-09-13T18:41:38.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.174+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d406e920 con 0x7f13d406beb0 2024-09-13T18:41:38.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.175+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13c4013470 con 0x7f13d406beb0 2024-09-13T18:41:38.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.176+0000 7f13cb400640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 0x7f13b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:38.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.176+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f13c4089580 con 0x7f13d406beb0 2024-09-13T18:41:38.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.176+0000 7f13ca000640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 0x7f13b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:38.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.177+0000 7f13ca000640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 0x7f13b006d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f13bc034000 tx=0x7f13bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:38.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.181+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13c4054660 con 0x7f13d406beb0 2024-09-13T18:41:38.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.384+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f13d4151d70 con 0x7f13d406beb0 2024-09-13T18:41:38.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.986+0000 7f13cb400640 1 -- 172.21.15.192:0/1680852226 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v49) v1 ==== 104+0+0 (secure 0 0 0) 0x7f13c4057c80 con 0x7f13d406beb0 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 msgr2=0x7f13b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 0x7f13b006d0c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f13bc034000 tx=0x7f13bc02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 msgr2=0x7f13d4140d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f13c400e8a0 tx=0x7f13c400ed60 comp rx=0 tx=0).stop 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 shutdown_connections 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13b006ac00 0x7f13b006d0c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13d4159b40 0x7f13d4154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13d40ce2c0 0x7f13d413e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 --2- 172.21.15.192:0/1680852226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13d406beb0 0x7f13d4140d30 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:38.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 >> 172.21.15.192:0/1680852226 conn(0x7f13d40cebc0 msgr2=0x7f13d40713d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:38.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 shutdown_connections 2024-09-13T18:41:38.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:38.990+0000 7f13d9a00640 1 -- 172.21.15.192:0/1680852226 wait complete. 2024-09-13T18:41:39.011 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:41:39.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.167+0000 7fb717200640 1 Processor -- start 2024-09-13T18:41:39.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.168+0000 7fb717200640 1 -- start start 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb717200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7100b3d90 0x7fb7100cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb717200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 0x7fb71006fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb717200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7100cce60 con 0x7fb7100cb730 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb717200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71015df20 con 0x7fb7100b3d90 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb717200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71015e110 con 0x7fb7100cca60 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7100b3d90 0x7fb7100cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7100b3d90 0x7fb7100cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38948/0 (socket says 172.21.15.192:38948) 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 -- 172.21.15.192:0/3553386990 learned_addr learned my addr 172.21.15.192:0/3553386990 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb70fe00640 1 --1- 172.21.15.192:0/3553386990 >> v1:172.21.15.192:6789/0 conn(0x7fb7100cb730 0x7fb71015d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48624/0 (socket says 172.21.15.192:48624) 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb715200640 1 --2- 172.21.15.192:0/3553386990 >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 0x7fb71006fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 -- 172.21.15.192:0/3553386990 >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 msgr2=0x7fb71006fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 --2- 172.21.15.192:0/3553386990 >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 0x7fb71006fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 -- 172.21.15.192:0/3553386990 >> v1:172.21.15.192:6789/0 conn(0x7fb7100cb730 legacy=0x7fb71015d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb707400640 1 -- 172.21.15.192:0/3553386990 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71015e3f0 con 0x7fb7100b3d90 2024-09-13T18:41:39.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.169+0000 7fb715200640 1 --2- 172.21.15.192:0/3553386990 >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 0x7fb71006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:39.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.170+0000 7fb707400640 1 --2- 172.21.15.192:0/3553386990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100b3d90 0x7fb7100cc520 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b3c50 tx=0x7fb6f802c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a0b5725d4e20c8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:39.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb70f400640 1 -- 172.21.15.192:0/3553386990 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8032640 con 0x7fb7100b3d90 2024-09-13T18:41:39.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb70f400640 1 -- 172.21.15.192:0/3553386990 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6f80327a0 con 0x7fb7100b3d90 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb70f400640 1 -- 172.21.15.192:0/3553386990 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f8032b30 con 0x7fb7100b3d90 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 -- 172.21.15.192:0/3553386990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100b3d90 msgr2=0x7fb7100cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 --2- 172.21.15.192:0/3553386990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100b3d90 0x7fb7100cc520 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fb7100b3c50 tx=0x7fb6f802c940 comp rx=0 tx=0).stop 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 -- 172.21.15.192:0/3553386990 shutdown_connections 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 --2- 172.21.15.192:0/3553386990 >> v2:172.21.15.194:3300/0 conn(0x7fb7100cca60 0x7fb71006fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 --2- 172.21.15.192:0/3553386990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100b3d90 0x7fb7100cc520 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 -- 172.21.15.192:0/3553386990 >> 172.21.15.192:0/3553386990 conn(0x7fb7100b0c40 msgr2=0x7fb7100b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 -- 172.21.15.192:0/3553386990 shutdown_connections 2024-09-13T18:41:39.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.171+0000 7fb717200640 1 -- 172.21.15.192:0/3553386990 wait complete. 2024-09-13T18:41:39.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.173+0000 7fb717200640 1 Processor -- start 2024-09-13T18:41:39.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.173+0000 7fb717200640 1 -- start start 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7100b3d90 0x7fb710141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7100cb730 0x7fb710137400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101419d0 con 0x7fb7100cca60 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7101423a0 con 0x7fb7100b3d90 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb717200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb710140dc0 con 0x7fb7100cb730 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb715200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb715200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38950/0 (socket says 172.21.15.192:38950) 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb715200640 1 -- 172.21.15.192:0/114050499 learned_addr learned my addr 172.21.15.192:0/114050499 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb70fe00640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7100b3d90 0x7fb710141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.174+0000 7fb707400640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7100cb730 0x7fb710137400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 -- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7100cb730 msgr2=0x7fb710137400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7100cb730 0x7fb710137400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 -- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7100b3d90 msgr2=0x7fb710141e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7100b3d90 0x7fb710141e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 -- 172.21.15.192:0/114050499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f800b770 con 0x7fb7100cca60 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb715200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb70800cd50 tx=0x7fb70800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800f680 con 0x7fb7100cca60 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70800f800 con 0x7fb7100cca60 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb70800fbb0 con 0x7fb7100cca60 2024-09-13T18:41:39.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7101410a0 con 0x7fb7100cca60 2024-09-13T18:41:39.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.175+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb710141660 con 0x7fb7100cca60 2024-09-13T18:41:39.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.176+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb710141b80 con 0x7fb7100cca60 2024-09-13T18:41:39.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.177+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb70800b040 con 0x7fb7100cca60 2024-09-13T18:41:39.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.178+0000 7fb70cc00640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 0x7fb6ec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:39.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.178+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb708089db0 con 0x7fb7100cca60 2024-09-13T18:41:39.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.178+0000 7fb70fe00640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 0x7fb6ec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:39.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.179+0000 7fb70fe00640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 0x7fb6ec06d0f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb700000f60 tx=0x7fb700007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:39.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.182+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb710141b80 con 0x7fb7100cca60 2024-09-13T18:41:39.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:39.350+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb710141b80 con 0x7fb7100cca60 2024-09-13T18:41:40.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.295+0000 7fb70cc00640 1 -- 172.21.15.192:0/114050499 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v124) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb710141b80 con 0x7fb7100cca60 2024-09-13T18:41:40.299 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:41:40.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 msgr2=0x7fb6ec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:40.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 0x7fb6ec06d0f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fb700000f60 tx=0x7fb700007e20 comp rx=0 tx=0).stop 2024-09-13T18:41:40.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 msgr2=0x7fb710140250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fb70800cd50 tx=0x7fb70800a650 comp rx=0 tx=0).stop 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 shutdown_connections 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb6ec06ac30 0x7fb6ec06d0f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7100cca60 0x7fb710140250 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7100cb730 0x7fb710137400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 --2- 172.21.15.192:0/114050499 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7100b3d90 0x7fb710141e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 >> 172.21.15.192:0/114050499 conn(0x7fb7100b0c40 msgr2=0x7fb7100b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:40.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 shutdown_connections 2024-09-13T18:41:40.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.299+0000 7fb717200640 1 -- 172.21.15.192:0/114050499 wait complete. 2024-09-13T18:41:40.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:41:40.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.482+0000 7fb76be00640 1 Processor -- start 2024-09-13T18:41:40.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.482+0000 7fb76be00640 1 -- start start 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.483+0000 7fb76be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb764071b80 0x7fb76415f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb76be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb764070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb76be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb76406a330 con 0x7fb764071100 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb76be00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb76413e0f0 con 0x7fb764071b80 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb76be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76415f840 con 0x7fb7641403e0 2024-09-13T18:41:40.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb764071b80 0x7fb76415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb764071b80 0x7fb76415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55686/0 (socket says 172.21.15.192:55686) 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 -- 172.21.15.192:0/2979127193 learned_addr learned my addr 172.21.15.192:0/2979127193 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb768a00640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb764070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 -- 172.21.15.192:0/2979127193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 msgr2=0x7fb764070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb764070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 -- 172.21.15.192:0/2979127193 >> v1:172.21.15.194:6789/0 conn(0x7fb764071100 legacy=0x7fb7640cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb769400640 1 -- 172.21.15.192:0/2979127193 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb76415b300 con 0x7fb764071b80 2024-09-13T18:41:40.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.484+0000 7fb768a00640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb764070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:40.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.485+0000 7fb769400640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415f300 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb758009870 tx=0x7fb75802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fed5390345d31d0b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:40.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb763e00640 1 -- 172.21.15.192:0/2979127193 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758032440 con 0x7fb764071b80 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb763e00640 1 -- 172.21.15.192:0/2979127193 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7580325a0 con 0x7fb764071b80 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb763e00640 1 -- 172.21.15.192:0/2979127193 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb758032930 con 0x7fb764071b80 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 -- 172.21.15.192:0/2979127193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 msgr2=0x7fb76415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415f300 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb758009870 tx=0x7fb75802a210 comp rx=0 tx=0).stop 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 -- 172.21.15.192:0/2979127193 shutdown_connections 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb764070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 --2- 172.21.15.192:0/2979127193 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415f300 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 -- 172.21.15.192:0/2979127193 >> 172.21.15.192:0/2979127193 conn(0x7fb7640b0c40 msgr2=0x7fb7640b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 -- 172.21.15.192:0/2979127193 shutdown_connections 2024-09-13T18:41:40.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.486+0000 7fb76be00640 1 -- 172.21.15.192:0/2979127193 wait complete. 2024-09-13T18:41:40.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.488+0000 7fb76be00640 1 Processor -- start 2024-09-13T18:41:40.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.488+0000 7fb76be00640 1 -- start start 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb764071100 0x7fb7641396d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb76415cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb764139c10 con 0x7fb764071b80 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640ccf40 con 0x7fb764071100 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb76be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7640cd440 con 0x7fb7641403e0 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb768a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb768a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55700/0 (socket says 172.21.15.192:55700) 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb768a00640 1 -- 172.21.15.192:0/1083037526 learned_addr learned my addr 172.21.15.192:0/1083037526 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb769e00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb76415cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.489+0000 7fb769400640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb764071100 0x7fb7641396d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 -- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 msgr2=0x7fb76415cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb76415cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 -- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb764071100 msgr2=0x7fb7641396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb764071100 0x7fb7641396d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 -- 172.21.15.192:0/1083037526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7580094d0 con 0x7fb764071b80 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb769e00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb76415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb768a00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c7f0 tx=0x7fb75000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:40.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750007820 con 0x7fb764071b80 2024-09-13T18:41:40.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb750007980 con 0x7fb764071b80 2024-09-13T18:41:40.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb750007cf0 con 0x7fb764071b80 2024-09-13T18:41:40.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb764159e70 con 0x7fb764071b80 2024-09-13T18:41:40.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.490+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb76415a430 con 0x7fb764071b80 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.491+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7641521c0 con 0x7fb764071b80 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.492+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7500113f0 con 0x7fb764071b80 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.493+0000 7fb761600640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 0x7fb74406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.493+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fb750089500 con 0x7fb764071b80 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.493+0000 7fb769400640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 0x7fb74406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:40.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.494+0000 7fb769400640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 0x7fb74406d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb758034000 tx=0x7fb75802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:40.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.497+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb750054850 con 0x7fb764071b80 2024-09-13T18:41:40.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:40.666+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb76415f2e0 con 0x7fb764071b80 2024-09-13T18:41:41.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.305+0000 7fb761600640 1 -- 172.21.15.192:0/1083037526 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v125) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb750057e70 con 0x7fb764071b80 2024-09-13T18:41:41.308 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:41:41.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 msgr2=0x7fb74406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 0x7fb74406d0c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fb758034000 tx=0x7fb75802e000 comp rx=0 tx=0).stop 2024-09-13T18:41:41.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 msgr2=0x7fb76415c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb75000c7f0 tx=0x7fb75000ccb0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 shutdown_connections 2024-09-13T18:41:41.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb74406ac00 0x7fb74406d0c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7641403e0 0x7fb76415cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb764071b80 0x7fb76415c880 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 --2- 172.21.15.192:0/1083037526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb764071100 0x7fb7641396d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.309+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 >> 172.21.15.192:0/1083037526 conn(0x7fb7640b0c40 msgr2=0x7fb76406a8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.310+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 shutdown_connections 2024-09-13T18:41:41.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.310+0000 7fb76be00640 1 -- 172.21.15.192:0/1083037526 wait complete. 2024-09-13T18:41:41.330 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:41:41.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.484+0000 7f4076400640 1 Processor -- start 2024-09-13T18:41:41.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.484+0000 7f4076400640 1 -- start start 2024-09-13T18:41:41.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.485+0000 7f4076400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40700cdf60 0x7f40700ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.485+0000 7f4076400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f407015a8e0 con 0x7f40700b3470 2024-09-13T18:41:41.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f4076400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40700b2fe0 con 0x7f40700cb330 2024-09-13T18:41:41.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f4076400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40700b26b0 con 0x7f40700cdf60 2024-09-13T18:41:41.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40700cdf60 0x7f40700ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f40700b3470 0x7f40700b3870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53598/0 (socket says 172.21.15.192:53598) 2024-09-13T18:41:41.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406fe00640 1 -- 172.21.15.192:0/1174042558 learned_addr learned my addr 172.21.15.192:0/1174042558 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406ea00640 1 -- 172.21.15.192:0/1174042558 >> v1:172.21.15.194:6789/0 conn(0x7f40700cb330 legacy=0x7f407006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406ea00640 1 -- 172.21.15.192:0/1174042558 >> v1:172.21.15.192:6789/0 conn(0x7f40700b3470 legacy=0x7f40700b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406e000640 1 -- 172.21.15.192:0/1174042558 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965382057 0 0) 0x7f407015a8e0 con 0x7f40700b3470 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.486+0000 7f406ea00640 1 -- 172.21.15.192:0/1174042558 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700b2990 con 0x7f40700cdf60 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.487+0000 7f406ea00640 1 --2- 172.21.15.192:0/1174042558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700cdf60 0x7f40700ce3f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f405c0097a0 tx=0x7f405c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b158dcf5bcc48437 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.487+0000 7f406e000640 1 -- 172.21.15.192:0/1174042558 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c02ae60 con 0x7f40700cdf60 2024-09-13T18:41:41.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f406e000640 1 -- 172.21.15.192:0/1174042558 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f405c032440 con 0x7f40700cdf60 2024-09-13T18:41:41.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f406e000640 1 -- 172.21.15.192:0/1174042558 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405c0327d0 con 0x7f40700cdf60 2024-09-13T18:41:41.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 -- 172.21.15.192:0/1174042558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700cdf60 msgr2=0x7f40700ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 --2- 172.21.15.192:0/1174042558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700cdf60 0x7f40700ce3f0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f405c0097a0 tx=0x7f405c02a110 comp rx=0 tx=0).stop 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 -- 172.21.15.192:0/1174042558 shutdown_connections 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 --2- 172.21.15.192:0/1174042558 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700cdf60 0x7f40700ce3f0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 -- 172.21.15.192:0/1174042558 >> 172.21.15.192:0/1174042558 conn(0x7f40700b08f0 msgr2=0x7f40700b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 -- 172.21.15.192:0/1174042558 shutdown_connections 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.488+0000 7f4076400640 1 -- 172.21.15.192:0/1174042558 wait complete. 2024-09-13T18:41:41.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.490+0000 7f4076400640 1 Processor -- start 2024-09-13T18:41:41.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.490+0000 7f4076400640 1 -- start start 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40700cb330 0x7f4070142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 0x7f4070141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40701430f0 con 0x7f40700b3470 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407014b700 con 0x7f40700cb330 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f4076400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f407014bcc0 con 0x7f40700cdf60 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55720/0 (socket says 172.21.15.192:55720) 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 -- 172.21.15.192:0/1615375354 learned_addr learned my addr 172.21.15.192:0/1615375354 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406ea00640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40700cb330 0x7f4070142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406fe00640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 0x7f4070141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 -- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 msgr2=0x7f4070141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 0x7f4070141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 -- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40700cb330 msgr2=0x7f4070142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40700cb330 0x7f4070142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406f400640 1 -- 172.21.15.192:0/1615375354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c009400 con 0x7f40700b3470 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.491+0000 7f406fe00640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 0x7f4070141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f406f400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f406000c8a0 tx=0x7f406000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4060003b70 con 0x7f40700b3470 2024-09-13T18:41:41.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4060003cf0 con 0x7f40700b3470 2024-09-13T18:41:41.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406000aa90 con 0x7f40700b3470 2024-09-13T18:41:41.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4070144bd0 con 0x7f40700b3470 2024-09-13T18:41:41.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.492+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407014b950 con 0x7f40700b3470 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.493+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40700b2080 con 0x7f40700b3470 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.494+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f406000abf0 con 0x7f40700b3470 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.495+0000 7f4067400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 0x7f405006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.495+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4060088ff0 con 0x7f40700b3470 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.495+0000 7f406ea00640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 0x7f405006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.496+0000 7f406ea00640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 0x7f405006d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.499+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40600bc9c0 con 0x7f40700b3470 2024-09-13T18:41:41.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.673+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4070150030 con 0x7f40700b3470 2024-09-13T18:41:41.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.679+0000 7f4067400640 1 -- 172.21.15.192:0/1615375354 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4060003e60 con 0x7f40700b3470 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 msgr2=0x7f405006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 0x7f405006d0c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f405c034000 tx=0x7f405c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 msgr2=0x7f40700701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f406000c8a0 tx=0x7f406000cd60 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 shutdown_connections 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f405006ac00 0x7f405006d0c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40700cdf60 0x7f4070141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40700cb330 0x7f4070142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 --2- 172.21.15.192:0/1615375354 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40700b3470 0x7f40700701a0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 >> 172.21.15.192:0/1615375354 conn(0x7f40700b08f0 msgr2=0x7f40700ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:41.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 shutdown_connections 2024-09-13T18:41:41.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.682+0000 7f4076400640 1 -- 172.21.15.192:0/1615375354 wait complete. 2024-09-13T18:41:41.702 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.852+0000 7f7132200640 1 Processor -- start 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.852+0000 7f7132200640 1 -- start start 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.853+0000 7f7132200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 0x7f712c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.853+0000 7f7132200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c071dd0 con 0x7f712c0cc530 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.853+0000 7f7132200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c0cb770 con 0x7f712c071810 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.853+0000 7f7132200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0cba50 con 0x7f712c150480 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f712c0cc530 0x7f712c0cd0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53614/0 (socket says 172.21.15.192:53614) 2024-09-13T18:41:41.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712be00640 1 -- 172.21.15.192:0/347227046 learned_addr learned my addr 172.21.15.192:0/347227046 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712b400640 1 --2- 172.21.15.192:0/347227046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 0x7f712c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3217786072 0 0) 0x7f712c071dd0 con 0x7f712c0cc530 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7110003520 con 0x7f712c0cc530 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436900246 0 0) 0x7f712c0cb770 con 0x7f712c071810 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c071dd0 con 0x7f712c071810 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712b400640 1 -- 172.21.15.192:0/347227046 >> v1:172.21.15.194:6789/0 conn(0x7f712c071810 legacy=0x7f712c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712b400640 1 -- 172.21.15.192:0/347227046 >> v1:172.21.15.192:6789/0 conn(0x7f712c0cc530 legacy=0x7f712c0cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.854+0000 7f712b400640 1 -- 172.21.15.192:0/347227046 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c0cbd30 con 0x7f712c150480 2024-09-13T18:41:41.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.855+0000 7f712b400640 1 --2- 172.21.15.192:0/347227046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 0x7f712c15a3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f711c0097d0 tx=0x7f711c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838bd21f12f2ec70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c032440 con 0x7f712c150480 2024-09-13T18:41:41.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c0325a0 con 0x7f712c150480 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f712a000640 1 -- 172.21.15.192:0/347227046 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c032930 con 0x7f712c150480 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 -- 172.21.15.192:0/347227046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 msgr2=0x7f712c15a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 --2- 172.21.15.192:0/347227046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 0x7f712c15a3e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f711c0097d0 tx=0x7f711c02a210 comp rx=0 tx=0).stop 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 -- 172.21.15.192:0/347227046 shutdown_connections 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 --2- 172.21.15.192:0/347227046 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c150480 0x7f712c15a3e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 -- 172.21.15.192:0/347227046 >> 172.21.15.192:0/347227046 conn(0x7f712c0ae960 msgr2=0x7f712c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 -- 172.21.15.192:0/347227046 shutdown_connections 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.856+0000 7f7132200640 1 -- 172.21.15.192:0/347227046 wait complete. 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.858+0000 7f7132200640 1 Processor -- start 2024-09-13T18:41:41.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.858+0000 7f7132200640 1 -- start start 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c0cc530 0x7f712c1545b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c150480 0x7f712c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c144550 con 0x7f712c071810 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c1439a0 con 0x7f712c150480 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f7132200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c143bb0 con 0x7f712c0cc530 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55722/0 (socket says 172.21.15.192:55722) 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 -- 172.21.15.192:0/359084452 learned_addr learned my addr 172.21.15.192:0/359084452 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712be00640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c150480 0x7f712c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712aa00640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c0cc530 0x7f712c1545b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 -- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c0cc530 msgr2=0x7f712c1545b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c0cc530 0x7f712c1545b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 -- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c150480 msgr2=0x7f712c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c150480 0x7f712c1563f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.859+0000 7f712b400640 1 -- 172.21.15.192:0/359084452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c009400 con 0x7f712c071810 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f712b400640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f711c035040 tx=0x7f711c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c03d8f0 con 0x7f712c071810 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c03da70 con 0x7f712c071810 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c03de20 con 0x7f712c071810 2024-09-13T18:41:41.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c143e90 con 0x7f712c071810 2024-09-13T18:41:41.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.860+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c156930 con 0x7f712c071810 2024-09-13T18:41:41.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.861+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c144690 con 0x7f712c071810 2024-09-13T18:41:41.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.862+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f711c039040 con 0x7f712c071810 2024-09-13T18:41:41.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.863+0000 7f7123400640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 0x7f710c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:41.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.863+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f711c0a9a20 con 0x7f712c071810 2024-09-13T18:41:41.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.863+0000 7f712aa00640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 0x7f710c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:41.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.864+0000 7f712aa00640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 0x7f710c06d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f712c14f8b0 tx=0x7f7118009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:41.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:41.867+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f712c144690 con 0x7f712c071810 2024-09-13T18:41:42.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.096+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f712c0b23b0 con 0x7f712c071810 2024-09-13T18:41:42.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.305+0000 7f7123400640 1 -- 172.21.15.192:0/359084452 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v318) v1 ==== 137+0+0 (secure 0 0 0) 0x7f711c074f90 con 0x7f712c071810 2024-09-13T18:41:42.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.307+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 msgr2=0x7f710c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.307+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 0x7f710c06d0c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f712c14f8b0 tx=0x7f7118009040 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 msgr2=0x7f712c154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f711c035040 tx=0x7f711c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 shutdown_connections 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f710c06ac00 0x7f710c06d0c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f712c150480 0x7f712c1563f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f712c0cc530 0x7f712c1545b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 --2- 172.21.15.192:0/359084452 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f712c071810 0x7f712c154070 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 >> 172.21.15.192:0/359084452 conn(0x7f712c0ae960 msgr2=0x7f712c157a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 shutdown_connections 2024-09-13T18:41:42.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.308+0000 7f7132200640 1 -- 172.21.15.192:0/359084452 wait complete. 2024-09-13T18:41:42.327 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2024-09-13T18:41:42.328 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2024-09-13T18:41:42.328 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2024-09-13T18:41:42.328 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:42.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.477+0000 7f2f42600640 1 Processor -- start 2024-09-13T18:41:42.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.477+0000 7f2f42600640 1 -- start start 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.478+0000 7f2f42600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.478+0000 7f2f42600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c0adf50 con 0x7f2f3c0afd80 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.478+0000 7f2f42600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3c0ae770 con 0x7f2f3c0b2780 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.478+0000 7f2f42600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0cd920 con 0x7f2f3c146610 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2f3c0afd80 0x7f2f3c0b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53620/0 (socket says 172.21.15.192:53620) 2024-09-13T18:41:42.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3be00640 1 -- 172.21.15.192:0/303078638 learned_addr learned my addr 172.21.15.192:0/303078638 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:42.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3b400640 1 --2- 172.21.15.192:0/303078638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175153268 0 0) 0x7f2f3c0adf50 con 0x7f2f3c0afd80 2024-09-13T18:41:42.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f20003520 con 0x7f2f3c0afd80 2024-09-13T18:41:42.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3b400640 1 -- 172.21.15.192:0/303078638 >> v1:172.21.15.194:6789/0 conn(0x7f2f3c0b2780 legacy=0x7f2f3c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3b400640 1 -- 172.21.15.192:0/303078638 >> v1:172.21.15.192:6789/0 conn(0x7f2f3c0afd80 legacy=0x7f2f3c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3992658689 0 0) 0x7f2f3c0ae770 con 0x7f2f3c0b2780 2024-09-13T18:41:42.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.479+0000 7f2f3b400640 1 -- 172.21.15.192:0/303078638 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c0cdb30 con 0x7f2f3c146610 2024-09-13T18:41:42.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.480+0000 7f2f3b400640 1 --2- 172.21.15.192:0/303078638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0ce2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0097d0 tx=0x7f2f2c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ae574aa11091128 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c032440 con 0x7f2f3c146610 2024-09-13T18:41:42.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c0325a0 con 0x7f2f3c146610 2024-09-13T18:41:42.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f3a000640 1 -- 172.21.15.192:0/303078638 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c032930 con 0x7f2f3c146610 2024-09-13T18:41:42.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 -- 172.21.15.192:0/303078638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 msgr2=0x7f2f3c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 --2- 172.21.15.192:0/303078638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0ce2f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0097d0 tx=0x7f2f2c02a210 comp rx=0 tx=0).stop 2024-09-13T18:41:42.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 -- 172.21.15.192:0/303078638 shutdown_connections 2024-09-13T18:41:42.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 --2- 172.21.15.192:0/303078638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0ce2f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 -- 172.21.15.192:0/303078638 >> 172.21.15.192:0/303078638 conn(0x7f2f3c0ae960 msgr2=0x7f2f3c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:42.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.481+0000 7f2f42600640 1 -- 172.21.15.192:0/303078638 shutdown_connections 2024-09-13T18:41:42.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.482+0000 7f2f42600640 1 -- 172.21.15.192:0/303078638 wait complete. 2024-09-13T18:41:42.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.483+0000 7f2f42600640 1 Processor -- start 2024-09-13T18:41:42.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.483+0000 7f2f42600640 1 -- start start 2024-09-13T18:41:42.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3c0afd80 0x7f2f3c15f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c06ffd0 con 0x7f2f3c0b2780 2024-09-13T18:41:42.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c0718e0 con 0x7f2f3c0afd80 2024-09-13T18:41:42.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f42600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3c15a540 con 0x7f2f3c146610 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f3aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f3aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55728/0 (socket says 172.21.15.192:55728) 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.484+0000 7f2f3aa00640 1 -- 172.21.15.192:0/2873220027 learned_addr learned my addr 172.21.15.192:0/2873220027 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3b400640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3c0afd80 0x7f2f3c15f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3be00640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 -- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 msgr2=0x7f2f3c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0703c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 -- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3c0afd80 msgr2=0x7f2f3c15f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3c0afd80 0x7f2f3c15f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 -- 172.21.15.192:0/2873220027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c009400 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f3aa00640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c450 tx=0x7f2f2800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28005480 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.485+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f280035f0 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.486+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280039a0 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.486+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3c071040 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.486+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3c071600 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.487+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3c0b2b90 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.487+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f28003b00 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.488+0000 7f2f33400640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 0x7f2f1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.488+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2f28088520 con 0x7f2f3c0b2780 2024-09-13T18:41:42.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.489+0000 7f2f3b400640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 0x7f2f1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.489+0000 7f2f3b400640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 0x7f2f1c06d0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c034000 tx=0x7f2f2c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.493+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f28053aa0 con 0x7f2f3c0b2780 2024-09-13T18:41:42.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.663+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f3c0b01d0 con 0x7f2f3c0b2780 2024-09-13T18:41:42.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.664+0000 7f2f33400640 1 -- 172.21.15.192:0/2873220027 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+13059 (secure 0 0 0) 0x7f2f28017020 con 0x7f2f3c0b2780 2024-09-13T18:41:42.667 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":125,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:41.294698+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/2916846477":"2024-09-14T18:41:37.975719+0000","172.21.15.192:6835/2916846477":"2024-09-14T18:41:37.975719+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:42.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.666+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 msgr2=0x7f2f1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.666+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 0x7f2f1c06d0c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c034000 tx=0x7f2f2c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.666+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 msgr2=0x7f2f3c15f930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.666+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c450 tx=0x7f2f2800c910 comp rx=0 tx=0).stop 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 shutdown_connections 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2f1c06ac00 0x7f2f1c06d0c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f3c146610 0x7f2f3c0703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f3c0b2780 0x7f2f3c15f930 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 --2- 172.21.15.192:0/2873220027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f3c0afd80 0x7f2f3c15f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 >> 172.21.15.192:0/2873220027 conn(0x7f2f3c0ae960 msgr2=0x7f2f3c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:42.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 shutdown_connections 2024-09-13T18:41:42.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.667+0000 7f2f42600640 1 -- 172.21.15.192:0/2873220027 wait complete. 2024-09-13T18:41:42.685 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:42.685 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.837+0000 7f1ff0c00640 1 Processor -- start 2024-09-13T18:41:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.837+0000 7f1ff0c00640 1 -- start start 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1ff0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 0x7f1fec06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1ff0c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 0x7f1fec0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1ff0c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fec06b480 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1ff0c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fec0b4060 con 0x7f1fec06a8b0 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1ff0c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec0ce770 con 0x7f1fec1434c0 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1fea800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1fec0b3bd0 0x7f1fec06e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53626/0 (socket says 172.21.15.192:53626) 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.838+0000 7f1fea800640 1 -- 172.21.15.192:0/2962062448 learned_addr learned my addr 172.21.15.192:0/2962062448 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9400640 1 --2- 172.21.15.192:0/2962062448 >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 0x7f1fec0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/2962062448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 0x7f1fec06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312902017 0 0) 0x7f1fec06b480 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1fd0003520 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9e00640 1 -- 172.21.15.192:0/2962062448 >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 msgr2=0x7f1fec0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/2962062448 >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 0x7f1fec0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018309156 0 0) 0x7f1fd0003520 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9e00640 1 -- 172.21.15.192:0/2962062448 >> v1:172.21.15.192:6789/0 conn(0x7f1fec0b3bd0 legacy=0x7f1fec06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9e00640 1 -- 172.21.15.192:0/2962062448 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fec06b760 con 0x7f1fec1434c0 2024-09-13T18:41:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.839+0000 7f1fe9400640 1 --2- 172.21.15.192:0/2962062448 >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 0x7f1fec0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.840+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/2962062448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 0x7f1fec06c800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0097d0 tx=0x7f1fdc02a140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a205565590d655b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.840+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe40019f0 con 0x7f1fec1434c0 2024-09-13T18:41:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fdc02abd0 con 0x7f1fec1434c0 2024-09-13T18:41:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1fe8a00640 1 -- 172.21.15.192:0/2962062448 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fdc032440 con 0x7f1fec1434c0 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 -- 172.21.15.192:0/2962062448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 msgr2=0x7f1fec06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/2962062448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 0x7f1fec06c800 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0097d0 tx=0x7f1fdc02a140 comp rx=0 tx=0).stop 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 -- 172.21.15.192:0/2962062448 shutdown_connections 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/2962062448 >> v2:172.21.15.194:3300/0 conn(0x7f1fec06a8b0 0x7f1fec0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/2962062448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec1434c0 0x7f1fec06c800 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 -- 172.21.15.192:0/2962062448 >> 172.21.15.192:0/2962062448 conn(0x7f1fec0b08f0 msgr2=0x7f1fec0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 -- 172.21.15.192:0/2962062448 shutdown_connections 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.841+0000 7f1ff0c00640 1 -- 172.21.15.192:0/2962062448 wait complete. 2024-09-13T18:41:42.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.843+0000 7f1ff0c00640 1 Processor -- start 2024-09-13T18:41:42.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.843+0000 7f1ff0c00640 1 -- start start 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 0x7f1fec0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 0x7f1fec1377b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec157230 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec1584c0 con 0x7f1fec1434c0 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1ff0c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fec137cf0 con 0x7f1fec06a8b0 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1fe9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1fe9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55740/0 (socket says 172.21.15.192:55740) 2024-09-13T18:41:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.844+0000 7f1fe9400640 1 -- 172.21.15.192:0/3971163113 learned_addr learned my addr 172.21.15.192:0/3971163113 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 0x7f1fec0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fea800640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 0x7f1fec1377b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 -- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 msgr2=0x7f1fec0704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 0x7f1fec0704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 -- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 msgr2=0x7f1fec1377b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 0x7f1fec1377b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 -- 172.21.15.192:0/3971163113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009400 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 0x7f1fec0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fea800640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 0x7f1fec1377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe9400640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800ebe0 tx=0x7f1fd800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd8009760 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd800cc30 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc009400 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd800eee0 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.845+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fec157700 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.846+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fec06acf0 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.847+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1fd8013470 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.849+0000 7f1fe2000640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:42.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.849+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1fd8089490 con 0x7f1fec0b3bd0 2024-09-13T18:41:42.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.849+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:42.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.850+0000 7f1fe9e00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc034000 tx=0x7f1fdc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:42.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:42.853+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1fd80548d0 con 0x7f1fec0b3bd0 2024-09-13T18:41:43.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.020+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fec13f6f0 con 0x7f1fec0b3bd0 2024-09-13T18:41:43.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.021+0000 7f1fe2000640 1 -- 172.21.15.192:0/3971163113 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1fd8057ef0 con 0x7f1fec0b3bd0 2024-09-13T18:41:43.024 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 msgr2=0x7f1fcc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc034000 tx=0x7f1fdc02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 msgr2=0x7f1fec156cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f1fd800ebe0 tx=0x7f1fd800c520 comp rx=0 tx=0).stop 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 shutdown_connections 2024-09-13T18:41:43.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1fcc06ac00 0x7f1fcc06d0c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1fec1434c0 0x7f1fec1377b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fec0b3bd0 0x7f1fec156cf0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 --2- 172.21.15.192:0/3971163113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1fec06a8b0 0x7f1fec0704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 >> 172.21.15.192:0/3971163113 conn(0x7f1fec0b08f0 msgr2=0x7f1fec15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 shutdown_connections 2024-09-13T18:41:43.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.023+0000 7f1ff0c00640 1 -- 172.21.15.192:0/3971163113 wait complete. 2024-09-13T18:41:43.042 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-13T18:41:43.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.191+0000 7ff37cc00640 1 Processor -- start 2024-09-13T18:41:43.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.191+0000 7ff37cc00640 1 -- start start 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff37cc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff3780b2690 0x7ff378161790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff37cc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3780b2b00 0x7ff378162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff37cc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3781586f0 con 0x7ff3780afd80 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff37cc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3781627f0 con 0x7ff3780b2b00 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff37cc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff378162230 con 0x7ff3780b2690 2024-09-13T18:41:43.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3780b2b00 0x7ff378162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff3780b2b00 0x7ff378162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55752/0 (socket says 172.21.15.192:55752) 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff375e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff3780afd80 0x7ff3780b0160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53642/0 (socket says 172.21.15.192:53642) 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 -- 172.21.15.192:0/2640096792 learned_addr learned my addr 172.21.15.192:0/2640096792 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff375400640 1 --2- 172.21.15.192:0/2640096792 >> v2:172.21.15.194:3300/0 conn(0x7ff3780b2690 0x7ff378161790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 -- 172.21.15.192:0/2640096792 >> v2:172.21.15.194:3300/0 conn(0x7ff3780b2690 msgr2=0x7ff378161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 --2- 172.21.15.192:0/2640096792 >> v2:172.21.15.194:3300/0 conn(0x7ff3780b2690 0x7ff378161790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 -- 172.21.15.192:0/2640096792 >> v1:172.21.15.192:6789/0 conn(0x7ff3780afd80 legacy=0x7ff3780b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.193+0000 7ff376800640 1 -- 172.21.15.192:0/2640096792 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378162510 con 0x7ff3780b2b00 2024-09-13T18:41:43.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.194+0000 7ff376800640 1 --2- 172.21.15.192:0/2640096792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2b00 0x7ff378162950 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff3780cc760 tx=0x7ff37002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df0b98ed68b374b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:43.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff374a00640 1 -- 172.21.15.192:0/2640096792 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370031600 con 0x7ff3780b2b00 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff374a00640 1 -- 172.21.15.192:0/2640096792 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37002d050 con 0x7ff3780b2b00 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff374a00640 1 -- 172.21.15.192:0/2640096792 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370031980 con 0x7ff3780b2b00 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 -- 172.21.15.192:0/2640096792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2b00 msgr2=0x7ff378162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 --2- 172.21.15.192:0/2640096792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2b00 0x7ff378162950 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7ff3780cc760 tx=0x7ff37002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 -- 172.21.15.192:0/2640096792 shutdown_connections 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 --2- 172.21.15.192:0/2640096792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2b00 0x7ff378162950 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 --2- 172.21.15.192:0/2640096792 >> v2:172.21.15.194:3300/0 conn(0x7ff3780b2690 0x7ff378161790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 -- 172.21.15.192:0/2640096792 >> 172.21.15.192:0/2640096792 conn(0x7ff3780ae960 msgr2=0x7ff37806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 -- 172.21.15.192:0/2640096792 shutdown_connections 2024-09-13T18:41:43.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.195+0000 7ff37cc00640 1 -- 172.21.15.192:0/2640096792 wait complete. 2024-09-13T18:41:43.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.197+0000 7ff37cc00640 1 Processor -- start 2024-09-13T18:41:43.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.197+0000 7ff37cc00640 1 -- start start 2024-09-13T18:41:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 0x7ff37814aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 0x7ff378159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781ec040 con 0x7ff3780b2690 2024-09-13T18:41:43.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781eb3c0 con 0x7ff3780afd80 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff37cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3781eb6a0 con 0x7ff3780b2b00 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff375400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff375400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55764/0 (socket says 172.21.15.192:55764) 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff375400640 1 -- 172.21.15.192:0/1313404627 learned_addr learned my addr 172.21.15.192:0/1313404627 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.198+0000 7ff375e00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 0x7ff37814aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff376800640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 0x7ff378159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 -- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 msgr2=0x7ff378159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 0x7ff378159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 -- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 msgr2=0x7ff37814aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 0x7ff37814aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 -- 172.21.15.192:0/1313404627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009b30 con 0x7ff3780b2690 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375e00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 0x7ff37814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:43.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff376800640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 0x7ff378159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff375400640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e9b0 tx=0x7ff36400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff364009670 con 0x7ff3780b2690 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36400c9a0 con 0x7ff3780b2690 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36400cd50 con 0x7ff3780b2690 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3781eb980 con 0x7ff3780b2690 2024-09-13T18:41:43.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.199+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff37814b1e0 con 0x7ff3780b2690 2024-09-13T18:41:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.200+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff378067490 con 0x7ff3780b2690 2024-09-13T18:41:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.201+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff364013470 con 0x7ff3780b2690 2024-09-13T18:41:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.202+0000 7ff36e000640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 0x7ff35806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.202+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff364089360 con 0x7ff3780b2690 2024-09-13T18:41:43.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.202+0000 7ff375e00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 0x7ff35806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:43.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.203+0000 7ff375e00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 0x7ff35806d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff368000f60 tx=0x7ff368009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:43.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.206+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff364054830 con 0x7ff3780b2690 2024-09-13T18:41:43.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:43.441+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7ff3780cd490 con 0x7ff3780b2690 2024-09-13T18:41:44.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.317+0000 7ff36e000640 1 -- 172.21.15.192:0/1313404627 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v320) v1 ==== 131+0+0 (secure 0 0 0) 0x7ff364057e50 con 0x7ff3780b2690 2024-09-13T18:41:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 msgr2=0x7ff35806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 0x7ff35806d0c0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7ff368000f60 tx=0x7ff368009040 comp rx=0 tx=0).stop 2024-09-13T18:41:44.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 msgr2=0x7ff3781ea900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff36400e9b0 tx=0x7ff36400ee70 comp rx=0 tx=0).stop 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 shutdown_connections 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff35806ac00 0x7ff35806d0c0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff3780b2b00 0x7ff378159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff3780b2690 0x7ff3781ea900 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 --2- 172.21.15.192:0/1313404627 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3780afd80 0x7ff37814aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.319+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 >> 172.21.15.192:0/1313404627 conn(0x7ff3780ae960 msgr2=0x7ff378070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.320+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 shutdown_connections 2024-09-13T18:41:44.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.320+0000 7ff37cc00640 1 -- 172.21.15.192:0/1313404627 wait complete. 2024-09-13T18:41:44.341 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:41:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.495+0000 7f43ad000640 1 Processor -- start 2024-09-13T18:41:44.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.495+0000 7f43ad000640 1 -- start start 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f43a81434c0 0x7f43a806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43a806a8b0 0x7f43a80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a80b3bd0 0x7f43a806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80ce770 con 0x7f43a806a8b0 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80b4040 con 0x7f43a81434c0 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.496+0000 7f43ad000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a806b480 con 0x7f43a80b3bd0 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43a806a8b0 0x7f43a80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43a806a8b0 0x7f43a80b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55778/0 (socket says 172.21.15.192:55778) 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 -- 172.21.15.192:0/697887528 learned_addr learned my addr 172.21.15.192:0/697887528 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5e00640 1 --2- 172.21.15.192:0/697887528 >> v2:172.21.15.194:3300/0 conn(0x7f43a81434c0 0x7f43a806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a6800640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a80b3bd0 0x7f43a806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 -- 172.21.15.192:0/697887528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a80b3bd0 msgr2=0x7f43a806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a80b3bd0 0x7f43a806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 -- 172.21.15.192:0/697887528 >> v2:172.21.15.194:3300/0 conn(0x7f43a81434c0 msgr2=0x7f43a806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 --2- 172.21.15.192:0/697887528 >> v2:172.21.15.194:3300/0 conn(0x7f43a81434c0 0x7f43a806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.497+0000 7f43a5400640 1 -- 172.21.15.192:0/697887528 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a806b760 con 0x7f43a806a8b0 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.498+0000 7f43a5400640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a806a8b0 0x7f43a80b3690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b4250 tx=0x7f439402c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=469190ac631d24b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.498+0000 7f43a4a00640 1 -- 172.21.15.192:0/697887528 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394031710 con 0x7f43a806a8b0 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.498+0000 7f43a4a00640 1 -- 172.21.15.192:0/697887528 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439402f050 con 0x7f43a806a8b0 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.498+0000 7f43a4a00640 1 -- 172.21.15.192:0/697887528 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394031a90 con 0x7f43a806a8b0 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 -- 172.21.15.192:0/697887528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a806a8b0 msgr2=0x7f43a80b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a806a8b0 0x7f43a80b3690 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f43a80b4250 tx=0x7f439402c3f0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 -- 172.21.15.192:0/697887528 shutdown_connections 2024-09-13T18:41:44.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a80b3bd0 0x7f43a806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 --2- 172.21.15.192:0/697887528 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a806a8b0 0x7f43a80b3690 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 --2- 172.21.15.192:0/697887528 >> v2:172.21.15.194:3300/0 conn(0x7f43a81434c0 0x7f43a806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 -- 172.21.15.192:0/697887528 >> 172.21.15.192:0/697887528 conn(0x7f43a80b08f0 msgr2=0x7f43a80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 -- 172.21.15.192:0/697887528 shutdown_connections 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.499+0000 7f43ad000640 1 -- 172.21.15.192:0/697887528 wait complete. 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.501+0000 7f43ad000640 1 Processor -- start 2024-09-13T18:41:44.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.501+0000 7f43ad000640 1 -- start start 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43a806a8b0 0x7f43a8141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 0x7f43a80ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8141c90 con 0x7f43a80b3bd0 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815c170 con 0x7f43a806a8b0 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43ad000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8155c80 con 0x7f43a81434c0 2024-09-13T18:41:44.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55790/0 (socket says 172.21.15.192:55790) 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 -- 172.21.15.192:0/3494956805 learned_addr learned my addr 172.21.15.192:0/3494956805 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5e00640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43a806a8b0 0x7f43a8141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a6800640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 0x7f43a80ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 -- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 msgr2=0x7f43a80ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 0x7f43a80ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 -- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43a806a8b0 msgr2=0x7f43a8141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43a806a8b0 0x7f43a8141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a5400640 1 -- 172.21.15.192:0/3494956805 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43940094d0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.502+0000 7f43a6800640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 0x7f43a80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:44.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f43a5400640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f439402c430 tx=0x7f43940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:44.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439403c830 con 0x7f43a80b3bd0 2024-09-13T18:41:44.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439403c990 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439403cd40 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a8155f60 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.503+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a815c450 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.504+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a8155dc0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.505+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f439403a070 con 0x7f43a80b3bd0 2024-09-13T18:41:44.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.506+0000 7f439e000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 0x7f438806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:44.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.506+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43940aa0f0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.506+0000 7f43a5e00640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 0x7f438806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:44.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.507+0000 7f43a5e00640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 0x7f438806d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:44.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.510+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f43a8155dc0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.676+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f43a8155dc0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.682+0000 7f439e000640 1 -- 172.21.15.192:0/3494956805 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f43a8155dc0 con 0x7f43a80b3bd0 2024-09-13T18:41:44.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 msgr2=0x7f438806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 0x7f438806d0c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4398006fd0 tx=0x7f4398008040 comp rx=0 tx=0).stop 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 msgr2=0x7f43a8156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f439402c430 tx=0x7f43940046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 shutdown_connections 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f438806ac00 0x7f438806d0c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43a81434c0 0x7f43a80ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43a80b3bd0 0x7f43a8156760 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 --2- 172.21.15.192:0/3494956805 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43a806a8b0 0x7f43a8141750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:44.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 >> 172.21.15.192:0/3494956805 conn(0x7f43a80b08f0 msgr2=0x7f43a80afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:44.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 shutdown_connections 2024-09-13T18:41:44.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:44.685+0000 7f43ad000640 1 -- 172.21.15.192:0/3494956805 wait complete. 2024-09-13T18:41:44.704 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:41:44.704 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:41:44.792 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:41:44.883 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:41:44.883 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:44.883 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:44.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:41:44.919 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:44.919 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:44.956 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:41:44.956 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:44.956 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:44.993 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:41:44.993 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:44.994 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:45.032 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:41:45.032 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:41:45.032 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.182+0000 7f5240600640 1 Processor -- start 2024-09-13T18:41:45.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.182+0000 7f5240600640 1 -- start start 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.183+0000 7f5240600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f52380b0490 0x7f523815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.183+0000 7f5240600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380b2f00 con 0x7f52380b3f10 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.183+0000 7f5240600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52380b3150 con 0x7f523815dee0 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.183+0000 7f5240600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52380b3430 con 0x7f52380b0490 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523e600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f52380b0490 0x7f523815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523d200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f52380b3f10 0x7f523815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53648/0 (socket says 172.21.15.192:53648) 2024-09-13T18:41:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523d200640 1 -- 172.21.15.192:0/427668051 learned_addr learned my addr 172.21.15.192:0/427668051 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523e600640 1 -- 172.21.15.192:0/427668051 >> v1:172.21.15.194:6789/0 conn(0x7f523815dee0 legacy=0x7f52380afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f5237e00640 1 -- 172.21.15.192:0/427668051 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654855937 0 0) 0x7f52380b2f00 con 0x7f52380b3f10 2024-09-13T18:41:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523e600640 1 -- 172.21.15.192:0/427668051 >> v1:172.21.15.192:6789/0 conn(0x7f52380b3f10 legacy=0x7f523815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.184+0000 7f523e600640 1 -- 172.21.15.192:0/427668051 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52380b3710 con 0x7f52380b0490 2024-09-13T18:41:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.185+0000 7f523e600640 1 --2- 172.21.15.192:0/427668051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523815ab50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f973f14e701534f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.185+0000 7f5237e00640 1 -- 172.21.15.192:0/427668051 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230007740 con 0x7f52380b0490 2024-09-13T18:41:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.185+0000 7f5237e00640 1 -- 172.21.15.192:0/427668051 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523002d050 con 0x7f52380b0490 2024-09-13T18:41:45.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.185+0000 7f5237e00640 1 -- 172.21.15.192:0/427668051 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5230007ac0 con 0x7f52380b0490 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 -- 172.21.15.192:0/427668051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 msgr2=0x7f523815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 --2- 172.21.15.192:0/427668051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523815ab50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f5230009d90 tx=0x7f523002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 -- 172.21.15.192:0/427668051 shutdown_connections 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 --2- 172.21.15.192:0/427668051 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523815ab50 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 -- 172.21.15.192:0/427668051 >> 172.21.15.192:0/427668051 conn(0x7f52380ae960 msgr2=0x7f523806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 -- 172.21.15.192:0/427668051 shutdown_connections 2024-09-13T18:41:45.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.186+0000 7f5240600640 1 -- 172.21.15.192:0/427668051 wait complete. 2024-09-13T18:41:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.188+0000 7f5240600640 1 Processor -- start 2024-09-13T18:41:45.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.188+0000 7f5240600640 1 -- start start 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 0x7f52381428f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 0x7f523815cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523813bb10 con 0x7f52380b0490 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5238159290 con 0x7f5238142e30 2024-09-13T18:41:45.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f5240600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5238140d40 con 0x7f523815dee0 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55812/0 (socket says 172.21.15.192:55812) 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 -- 172.21.15.192:0/1482515972 learned_addr learned my addr 172.21.15.192:0/1482515972 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523e600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 0x7f523815cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523d200640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 0x7f52381428f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 -- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 msgr2=0x7f52381428f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 0x7f52381428f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 -- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 msgr2=0x7f523815cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 0x7f523815cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523dc00640 1 -- 172.21.15.192:0/1482515972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009a70 con 0x7f52380b0490 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523e600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 0x7f523815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.189+0000 7f523d200640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 0x7f52381428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:45.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f523dc00640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c3f0 tx=0x7f522c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c0052d0 con 0x7f52380b0490 2024-09-13T18:41:45.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f522c005450 con 0x7f52380b0490 2024-09-13T18:41:45.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f522c007260 con 0x7f52380b0490 2024-09-13T18:41:45.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5238141020 con 0x7f52380b0490 2024-09-13T18:41:45.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.190+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5238141300 con 0x7f52380b0490 2024-09-13T18:41:45.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.191+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5238067490 con 0x7f52380b0490 2024-09-13T18:41:45.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.192+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f522c0073c0 con 0x7f52380b0490 2024-09-13T18:41:45.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.193+0000 7f5235600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 0x7f521806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.193+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f522c088440 con 0x7f52380b0490 2024-09-13T18:41:45.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.193+0000 7f523d200640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 0x7f521806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.194+0000 7f523d200640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 0x7f521806d0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52381f6e60 tx=0x7f5224009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.197+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f522c053880 con 0x7f52380b0490 2024-09-13T18:41:45.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.401+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f52381414c0 con 0x7f52380b0490 2024-09-13T18:41:45.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.401+0000 7f5235600640 1 -- 172.21.15.192:0/1482515972 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f522c056ea0 con 0x7f52380b0490 2024-09-13T18:41:45.404 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:45.404 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":49,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5894,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/1671240843","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1671240843},{"type":"v1","addr":"172.21.15.194:6834","nonce":1671240843}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":5897,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1568577057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1568577057},{"type":"v1","addr":"172.21.15.194:6835","nonce":1568577057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":6547,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3373877481","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3373877481},{"type":"v1","addr":"172.21.15.192:6836","nonce":3373877481}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43},{"gid":7185,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/751435866","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":751435866},{"type":"v1","addr":"172.21.15.192:6837","nonce":751435866}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":49}],"filesystems":[]} 2024-09-13T18:41:45.404 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 49 2024-09-13T18:41:45.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.403+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 msgr2=0x7f521806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.403+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 0x7f521806d0c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f52381f6e60 tx=0x7f5224009040 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.403+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 msgr2=0x7f523813b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.403+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f522c00c3f0 tx=0x7f522c00c8b0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 shutdown_connections 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f521806ac00 0x7f521806d0c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5238142e30 0x7f523815cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f523815dee0 0x7f52381428f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 --2- 172.21.15.192:0/1482515972 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f52380b0490 0x7f523813b5d0 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 >> 172.21.15.192:0/1482515972 conn(0x7f52380ae960 msgr2=0x7f523815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 shutdown_connections 2024-09-13T18:41:45.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.404+0000 7f5240600640 1 -- 172.21.15.192:0/1482515972 wait complete. 2024-09-13T18:41:45.422 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:41:45.423 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:41:45.423 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:41:45.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:41:45.423 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:41:45.423 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:41:45.423 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:41:45.423 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:41:45.424 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:41:45.424 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:41:45.424 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:41:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:41:45.424 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:41:45.424 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:41:45.424 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:41:45.424 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:41:45.438 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:41:45.438 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:41:45.439 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:41:45.439 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:41:45.440 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:41:45.440 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:41:45.441 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:41:45.441 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:41:45.484 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:41:45.485 DEBUG:teuthology.parallel:result is None 2024-09-13T18:41:45.485 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:41:45.485 DEBUG:teuthology.parallel:result is None 2024-09-13T18:41:45.486 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:41:45.486 DEBUG:teuthology.parallel:result is None 2024-09-13T18:41:45.488 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:41:45.488 DEBUG:teuthology.parallel:result is None 2024-09-13T18:41:45.489 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:41:45.613 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:41:45.613 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:41:45.614 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:41:45.615 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:41:45.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.651+0000 7f9c9dc00640 1 Processor -- start 2024-09-13T18:41:45.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.651+0000 7f9c9dc00640 1 -- start start 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.652+0000 7f9c9dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c9815dee0 0x7f9c980afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.652+0000 7f9c9dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 0x7f9c9815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.652+0000 7f9c9dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980b2f00 con 0x7f9c980b3f10 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.652+0000 7f9c9dc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980b3150 con 0x7f9c9815e2c0 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.652+0000 7f9c9dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980b3430 con 0x7f9c9815dee0 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c9815dee0 0x7f9c980afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c97400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 0x7f9c9815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9c9815dee0 0x7f9c980afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:56628/0 (socket says 172.21.15.192:56628) 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 -- 172.21.15.192:0/2555675452 learned_addr learned my addr 172.21.15.192:0/2555675452 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:45.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96000640 1 --1- 172.21.15.192:0/2555675452 >> v1:172.21.15.194:6789/0 conn(0x7f9c980b3f10 0x7f9c9815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:38688/0 (socket says 172.21.15.192:38688) 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 -- 172.21.15.192:0/2555675452 >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 msgr2=0x7f9c9815ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 --2- 172.21.15.192:0/2555675452 >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 0x7f9c9815ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 -- 172.21.15.192:0/2555675452 >> v1:172.21.15.194:6789/0 conn(0x7f9c980b3f10 legacy=0x7f9c9815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c96a00640 1 -- 172.21.15.192:0/2555675452 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980b3710 con 0x7f9c9815dee0 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.653+0000 7f9c97400640 1 --2- 172.21.15.192:0/2555675452 >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 0x7f9c9815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:45.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.654+0000 7f9c96a00640 1 --2- 172.21.15.192:0/2555675452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9815dee0 0x7f9c980afd80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806cd20 tx=0x7f9c8802c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe233f78ffe808c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.655+0000 7f9c95600640 1 -- 172.21.15.192:0/2555675452 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88032640 con 0x7f9c9815dee0 2024-09-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.655+0000 7f9c95600640 1 -- 172.21.15.192:0/2555675452 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c880327a0 con 0x7f9c9815dee0 2024-09-13T18:41:45.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.655+0000 7f9c95600640 1 -- 172.21.15.192:0/2555675452 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88032b30 con 0x7f9c9815dee0 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 -- 172.21.15.192:0/2555675452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9815dee0 msgr2=0x7f9c980afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/2555675452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9815dee0 0x7f9c980afd80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9c9806cd20 tx=0x7f9c8802c940 comp rx=0 tx=0).stop 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 -- 172.21.15.192:0/2555675452 shutdown_connections 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/2555675452 >> v2:172.21.15.192:3300/0 conn(0x7f9c9815e2c0 0x7f9c9815ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/2555675452 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9815dee0 0x7f9c980afd80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 -- 172.21.15.192:0/2555675452 >> 172.21.15.192:0/2555675452 conn(0x7f9c980ae960 msgr2=0x7f9c9806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:45.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 -- 172.21.15.192:0/2555675452 shutdown_connections 2024-09-13T18:41:45.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.656+0000 7f9c9dc00640 1 -- 172.21.15.192:0/2555675452 wait complete. 2024-09-13T18:41:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.658+0000 7f9c9dc00640 1 Processor -- start 2024-09-13T18:41:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.658+0000 7f9c9dc00640 1 -- start start 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 0x7f9c981344f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 0x7f9c981399b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98135f20 con 0x7f9c9815e2c0 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98134a30 con 0x7f9c9813d310 2024-09-13T18:41:45.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c9dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98137870 con 0x7f9c9815dee0 2024-09-13T18:41:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c96000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c97400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 0x7f9c981399b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c96000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55850/0 (socket says 172.21.15.192:55850) 2024-09-13T18:41:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c96a00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 0x7f9c981344f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.659+0000 7f9c96000640 1 -- 172.21.15.192:0/145129541 learned_addr learned my addr 172.21.15.192:0/145129541 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 -- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 msgr2=0x7f9c981344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 0x7f9c981344f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 -- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 msgr2=0x7f9c981399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 0x7f9c981399b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 -- 172.21.15.192:0/145129541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009a70 con 0x7f9c9815e2c0 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96a00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 0x7f9c981344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c97400640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 0x7f9c981399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c96000640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c4d0 tx=0x7f9c8400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840074e0 con 0x7f9c9815e2c0 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84007640 con 0x7f9c9815e2c0 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840049e0 con 0x7f9c9815e2c0 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.660+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8800b770 con 0x7f9c9815e2c0 2024-09-13T18:41:45.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.661+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98137e30 con 0x7f9c9815e2c0 2024-09-13T18:41:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.662+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c98136090 con 0x7f9c9815e2c0 2024-09-13T18:41:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.662+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c84004c00 con 0x7f9c9815e2c0 2024-09-13T18:41:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.663+0000 7f9c8ea00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 0x7f9c7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.663+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9c84088950 con 0x7f9c9815e2c0 2024-09-13T18:41:45.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.664+0000 7f9c96a00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 0x7f9c7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:45.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.665+0000 7f9c96a00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 0x7f9c7806d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9c88037000 tx=0x7f9c88032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:45.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.668+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9c84053e30 con 0x7f9c9815e2c0 2024-09-13T18:41:45.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:45.847+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f9c980afd80 con 0x7f9c9815e2c0 2024-09-13T18:41:46.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.686+0000 7f9c8ea00640 1 -- 172.21.15.192:0/145129541 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v130) v1 ==== 97+0+0 (secure 0 0 0) 0x7f9c84057450 con 0x7f9c9815e2c0 2024-09-13T18:41:46.689 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:41:46.691 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.688+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 msgr2=0x7f9c7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.688+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 0x7f9c7806d0c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9c88037000 tx=0x7f9c88032000 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.688+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 msgr2=0x7f9c9813d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.688+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400c4d0 tx=0x7f9c8400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 shutdown_connections 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c7806ac00 0x7f9c7806d0c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c9813d310 0x7f9c981399b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c9815e2c0 0x7f9c9813d870 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 --2- 172.21.15.192:0/145129541 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c9815dee0 0x7f9c981344f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 >> 172.21.15.192:0/145129541 conn(0x7f9c980ae960 msgr2=0x7f9c980b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 shutdown_connections 2024-09-13T18:41:46.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.689+0000 7f9c9dc00640 1 -- 172.21.15.192:0/145129541 wait complete. 2024-09-13T18:41:46.709 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:41:46.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.861+0000 7fc621200640 1 Processor -- start 2024-09-13T18:41:46.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.862+0000 7fc621200640 1 -- start start 2024-09-13T18:41:46.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc621200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 0x7fc61c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc621200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc61c0ce6c0 0x7fc61c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc621200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c06c5d0 con 0x7fc61c15a9e0 2024-09-13T18:41:46.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc621200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0b3730 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc621200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c0b3920 con 0x7fc61c06e990 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc61c0ce6c0 0x7fc61c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc61c0ce6c0 0x7fc61c0cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55860/0 (socket says 172.21.15.192:55860) 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 -- 172.21.15.192:0/1591188175 learned_addr learned my addr 172.21.15.192:0/1591188175 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61aa00640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 0x7fc61c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 -- 172.21.15.192:0/1591188175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 msgr2=0x7fc61c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 0x7fc61c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.863+0000 7fc61be00640 1 -- 172.21.15.192:0/1591188175 >> v1:172.21.15.194:6789/0 conn(0x7fc61c15a9e0 legacy=0x7fc61c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.864+0000 7fc61be00640 1 -- 172.21.15.192:0/1591188175 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c0b3c00 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.867 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.864+0000 7fc61aa00640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 0x7fc61c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:46.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.864+0000 7fc61be00640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c0cde00 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d8d08eef673569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:46.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc61a000640 1 -- 172.21.15.192:0/1591188175 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614032440 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc61a000640 1 -- 172.21.15.192:0/1591188175 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6140325a0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc61a000640 1 -- 172.21.15.192:0/1591188175 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc614032930 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 -- 172.21.15.192:0/1591188175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 msgr2=0x7fc61c0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c0cde00 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fc614009870 tx=0x7fc61402a210 comp rx=0 tx=0).stop 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 -- 172.21.15.192:0/1591188175 shutdown_connections 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c0cde00 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 --2- 172.21.15.192:0/1591188175 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c06e990 0x7fc61c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 -- 172.21.15.192:0/1591188175 >> 172.21.15.192:0/1591188175 conn(0x7fc61c0736d0 msgr2=0x7fc61c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 -- 172.21.15.192:0/1591188175 shutdown_connections 2024-09-13T18:41:46.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.865+0000 7fc621200640 1 -- 172.21.15.192:0/1591188175 wait complete. 2024-09-13T18:41:46.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.867+0000 7fc621200640 1 Processor -- start 2024-09-13T18:41:46.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.867+0000 7fc621200640 1 -- start start 2024-09-13T18:41:46.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 0x7fc61c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c15a9e0 0x7fc61c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c15bcd0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c14d280 con 0x7fc61c06e990 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc621200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c14d520 con 0x7fc61c15a9e0 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc61aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc61aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55876/0 (socket says 172.21.15.192:55876) 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc61aa00640 1 -- 172.21.15.192:0/2384071888 learned_addr learned my addr 172.21.15.192:0/2384071888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc61be00640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c15a9e0 0x7fc61c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.868+0000 7fc61b400640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 0x7fc61c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 -- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c15a9e0 msgr2=0x7fc61c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c15a9e0 0x7fc61c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 -- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 msgr2=0x7fc61c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:46.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 0x7fc61c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:46.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 -- 172.21.15.192:0/2384071888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6140094d0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61b400640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 0x7fc61c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:46.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc61aa00640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c7f0 tx=0x7fc60800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:46.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007820 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608007980 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007cf0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c158520 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.869+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c14fa70 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.871+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c06fe90 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.871+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6080113f0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.872+0000 7fc613400640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 0x7fc5fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:46.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.872+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6080891e0 con 0x7fc61c0ce6c0 2024-09-13T18:41:46.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.873+0000 7fc61b400640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 0x7fc5fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:46.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.873+0000 7fc61b400640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 0x7fc5fc06d0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc61c14cad0 tx=0x7fc60c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:46.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:46.877+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc608054850 con 0x7fc61c0ce6c0 2024-09-13T18:41:47.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.105+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc61c15adc0 con 0x7fc61c0ce6c0 2024-09-13T18:41:47.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.105+0000 7fc613400640 1 -- 172.21.15.192:0/2384071888 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc608057e70 con 0x7fc61c0ce6c0 2024-09-13T18:41:47.108 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:47.108 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:47.108 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.109 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.110 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:41:47.111 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.112 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.113 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.114 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.115 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:41:47.116 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:41:47.117 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:41:47.118 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.119 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:41:47.120 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.121 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:41:47.122 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:41:47.123 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:47.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 msgr2=0x7fc5fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 0x7fc5fc06d0c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fc61c14cad0 tx=0x7fc60c009040 comp rx=0 tx=0).stop 2024-09-13T18:41:47.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 msgr2=0x7fc61c152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fc60800c7f0 tx=0x7fc60800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 shutdown_connections 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5fc06ac00 0x7fc5fc06d0c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc61c15a9e0 0x7fc61c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc61c0ce6c0 0x7fc61c152c20 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 --2- 172.21.15.192:0/2384071888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61c06e990 0x7fc61c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 >> 172.21.15.192:0/2384071888 conn(0x7fc61c0736d0 msgr2=0x7fc61c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 shutdown_connections 2024-09-13T18:41:47.125 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.107+0000 7fc621200640 1 -- 172.21.15.192:0/2384071888 wait complete. 2024-09-13T18:41:47.127 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:47.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.275+0000 7fdf17400640 1 Processor -- start 2024-09-13T18:41:47.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.275+0000 7fdf17400640 1 -- start start 2024-09-13T18:41:47.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.276+0000 7fdf17400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 0x7fdf100ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.276+0000 7fdf17400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf100afd80 0x7fdf100b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf17400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100b0710 con 0x7fdf100b2780 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf17400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf100cd920 con 0x7fdf100afd80 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf17400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100adf50 con 0x7fdf10146610 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf100afd80 0x7fdf100b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf100afd80 0x7fdf100b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55892/0 (socket says 172.21.15.192:55892) 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 -- 172.21.15.192:0/1148988879 learned_addr learned my addr 172.21.15.192:0/1148988879 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf14a00640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 0x7fdf100ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 -- 172.21.15.192:0/1148988879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 msgr2=0x7fdf100ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 0x7fdf100ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 -- 172.21.15.192:0/1148988879 >> v1:172.21.15.194:6789/0 conn(0x7fdf100b2780 legacy=0x7fdf100ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf15400640 1 -- 172.21.15.192:0/1148988879 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100ae770 con 0x7fdf100afd80 2024-09-13T18:41:47.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.277+0000 7fdf14a00640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 0x7fdf100ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.278+0000 7fdf15400640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100afd80 0x7fdf100b01d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009e50 tx=0x7fdf0802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af0c636df08c45e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf0f400640 1 -- 172.21.15.192:0/1148988879 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08031600 con 0x7fdf100afd80 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf0f400640 1 -- 172.21.15.192:0/1148988879 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0802d050 con 0x7fdf100afd80 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf0f400640 1 -- 172.21.15.192:0/1148988879 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08031980 con 0x7fdf100afd80 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 -- 172.21.15.192:0/1148988879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100afd80 msgr2=0x7fdf100b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100afd80 0x7fdf100b01d0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009e50 tx=0x7fdf0802a730 comp rx=0 tx=0).stop 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 -- 172.21.15.192:0/1148988879 shutdown_connections 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf100afd80 0x7fdf100b01d0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 --2- 172.21.15.192:0/1148988879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf10146610 0x7fdf100ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 -- 172.21.15.192:0/1148988879 >> 172.21.15.192:0/1148988879 conn(0x7fdf100ae960 msgr2=0x7fdf1006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:47.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 -- 172.21.15.192:0/1148988879 shutdown_connections 2024-09-13T18:41:47.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.279+0000 7fdf17400640 1 -- 172.21.15.192:0/1148988879 wait complete. 2024-09-13T18:41:47.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.281+0000 7fdf17400640 1 Processor -- start 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.281+0000 7fdf17400640 1 -- start start 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf100afd80 0x7fdf1015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf100b2780 0x7fdf1013c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1015cd20 con 0x7fdf10146610 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10070a40 con 0x7fdf100b2780 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf17400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf10070d20 con 0x7fdf100afd80 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf15400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf15400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55896/0 (socket says 172.21.15.192:55896) 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf15400640 1 -- 172.21.15.192:0/3873301381 learned_addr learned my addr 172.21.15.192:0/3873301381 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf14a00640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf100afd80 0x7fdf1015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.282+0000 7fdf0fe00640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf100b2780 0x7fdf1013c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 -- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf100afd80 msgr2=0x7fdf1015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf100afd80 0x7fdf1015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 -- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf100b2780 msgr2=0x7fdf1013c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf100b2780 0x7fdf1013c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 -- 172.21.15.192:0/3873301381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08009b30 con 0x7fdf10146610 2024-09-13T18:41:47.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf15400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009e50 tx=0x7fdf08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0803d860 con 0x7fdf10146610 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0803d9c0 con 0x7fdf10146610 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0803dd70 con 0x7fdf10146610 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.283+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf10071000 con 0x7fdf10146610 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.284+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf100715c0 con 0x7fdf10146610 2024-09-13T18:41:47.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.284+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf101469f0 con 0x7fdf10146610 2024-09-13T18:41:47.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.285+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf0803b400 con 0x7fdf10146610 2024-09-13T18:41:47.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.286+0000 7fdf0cc00640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 0x7fdef006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.286+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdf080a9e00 con 0x7fdf10146610 2024-09-13T18:41:47.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.286+0000 7fdf14a00640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 0x7fdef006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.287+0000 7fdf14a00640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 0x7fdef006d0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdf00006fd0 tx=0x7fdf00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.290+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf08075340 con 0x7fdf10146610 2024-09-13T18:41:47.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.460+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf101604f0 con 0x7fdf10146610 2024-09-13T18:41:47.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.461+0000 7fdf0cc00640 1 -- 172.21.15.192:0/3873301381 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+12928 (secure 0 0 0) 0x7fdf08009510 con 0x7fdf10146610 2024-09-13T18:41:47.464 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:47.464 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":130,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:46.683326+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":110,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:47.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 msgr2=0x7fdef006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 0x7fdef006d0c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fdf00006fd0 tx=0x7fdf00008040 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 msgr2=0x7fdf1013c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fdf08009e50 tx=0x7fdf08004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 shutdown_connections 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdef006ac00 0x7fdef006d0c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf10146610 0x7fdf1013c720 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf100b2780 0x7fdf1013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 --2- 172.21.15.192:0/3873301381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf100afd80 0x7fdf1015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 >> 172.21.15.192:0/3873301381 conn(0x7fdf100ae960 msgr2=0x7fdf10144890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 shutdown_connections 2024-09-13T18:41:47.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.463+0000 7fdf17400640 1 -- 172.21.15.192:0/3873301381 wait complete. 2024-09-13T18:41:47.482 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:41:47.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:41:47.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.636+0000 7f5926000640 1 Processor -- start 2024-09-13T18:41:47.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.636+0000 7f5926000640 1 -- start start 2024-09-13T18:41:47.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.637+0000 7f5926000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59201589f0 0x7f59200b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.637+0000 7f5926000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200b2000 con 0x7f59200b3af0 2024-09-13T18:41:47.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.637+0000 7f5926000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f592015b970 con 0x7f592006c0b0 2024-09-13T18:41:47.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.637+0000 7f5926000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592015bbd0 con 0x7f59201589f0 2024-09-13T18:41:47.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591f400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f59201589f0 0x7f59200b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f59200b3af0 0x7f592015b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53672/0 (socket says 172.21.15.192:53672) 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591ea00640 1 -- 172.21.15.192:0/2730242940 learned_addr learned my addr 172.21.15.192:0/2730242940 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591f400640 1 -- 172.21.15.192:0/2730242940 >> v1:172.21.15.194:6789/0 conn(0x7f592006c0b0 legacy=0x7f59200cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591f400640 1 -- 172.21.15.192:0/2730242940 >> v1:172.21.15.192:6789/0 conn(0x7f59200b3af0 legacy=0x7f592015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591e000640 1 -- 172.21.15.192:0/2730242940 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2861131810 0 0) 0x7f59200b2000 con 0x7f59200b3af0 2024-09-13T18:41:47.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.638+0000 7f591f400640 1 -- 172.21.15.192:0/2730242940 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592015beb0 con 0x7f59201589f0 2024-09-13T18:41:47.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.639+0000 7f591f400640 1 --2- 172.21.15.192:0/2730242940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59201589f0 0x7f59200b2490 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f59100097a0 tx=0x7f591002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daafd6e331cdf912 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.639+0000 7f591e000640 1 -- 172.21.15.192:0/2730242940 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910032440 con 0x7f59201589f0 2024-09-13T18:41:47.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.639+0000 7f591e000640 1 -- 172.21.15.192:0/2730242940 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59100325a0 con 0x7f59201589f0 2024-09-13T18:41:47.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.639+0000 7f591e000640 1 -- 172.21.15.192:0/2730242940 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910032930 con 0x7f59201589f0 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 -- 172.21.15.192:0/2730242940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59201589f0 msgr2=0x7f59200b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 --2- 172.21.15.192:0/2730242940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59201589f0 0x7f59200b2490 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f59100097a0 tx=0x7f591002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 -- 172.21.15.192:0/2730242940 shutdown_connections 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 --2- 172.21.15.192:0/2730242940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59201589f0 0x7f59200b2490 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 -- 172.21.15.192:0/2730242940 >> 172.21.15.192:0/2730242940 conn(0x7f59200b08f0 msgr2=0x7f59200b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:47.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 -- 172.21.15.192:0/2730242940 shutdown_connections 2024-09-13T18:41:47.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.640+0000 7f5926000640 1 -- 172.21.15.192:0/2730242940 wait complete. 2024-09-13T18:41:47.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.642+0000 7f5926000640 1 Processor -- start 2024-09-13T18:41:47.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.642+0000 7f5926000640 1 -- start start 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f592006c0b0 0x7f592014a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 0x7f59201e20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201e3940 con 0x7f59200b3af0 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59201e2e00 con 0x7f59201589f0 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f5926000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592014ac30 con 0x7f592006c0b0 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55920/0 (socket says 172.21.15.192:55920) 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 -- 172.21.15.192:0/2324863232 learned_addr learned my addr 172.21.15.192:0/2324863232 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:47.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591f400640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f592006c0b0 0x7f592014a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 -- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f592006c0b0 msgr2=0x7f592014a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f592006c0b0 0x7f592014a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591fe00640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 0x7f59201e20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 -- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 msgr2=0x7f59201e20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 0x7f59201e20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591ea00640 1 -- 172.21.15.192:0/2324863232 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5910009400 con 0x7f59200b3af0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.643+0000 7f591fe00640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 0x7f59201e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f591ea00640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c4a0 tx=0x7f590c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c0074e0 con 0x7f59200b3af0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f590c007640 con 0x7f59200b3af0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59201e30a0 con 0x7f59200b3af0 2024-09-13T18:41:47.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f590c004a00 con 0x7f59200b3af0 2024-09-13T18:41:47.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.644+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59201e3660 con 0x7f59200b3af0 2024-09-13T18:41:47.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.645+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59200cb8f0 con 0x7f59200b3af0 2024-09-13T18:41:47.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.646+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f590c004b60 con 0x7f59200b3af0 2024-09-13T18:41:47.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.647+0000 7f5917400640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 0x7f590006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.647+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f590c0885e0 con 0x7f59200b3af0 2024-09-13T18:41:47.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.647+0000 7f591f400640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 0x7f590006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.648+0000 7f591f400640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 0x7f590006d0c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f591002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:47.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.651+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f590c053a70 con 0x7f59200b3af0 2024-09-13T18:41:47.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.819+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f59200cd3d0 con 0x7f59200b3af0 2024-09-13T18:41:47.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.820+0000 7f5917400640 1 -- 172.21.15.192:0/2324863232 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f590c0180a0 con 0x7f59200b3af0 2024-09-13T18:41:47.823 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 msgr2=0x7f590006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 0x7f590006d0c0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5910034000 tx=0x7f591002e000 comp rx=0 tx=0).stop 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 msgr2=0x7f59201e1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f590c00c4a0 tx=0x7f590c00c960 comp rx=0 tx=0).stop 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 shutdown_connections 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f590006ac00 0x7f590006d0c0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f59201589f0 0x7f59201e20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59200b3af0 0x7f59201e1bb0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 --2- 172.21.15.192:0/2324863232 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f592006c0b0 0x7f592014a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 >> 172.21.15.192:0/2324863232 conn(0x7f59200b08f0 msgr2=0x7f592006a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 shutdown_connections 2024-09-13T18:41:47.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.822+0000 7f5926000640 1 -- 172.21.15.192:0/2324863232 wait complete. 2024-09-13T18:41:47.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:41:47.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.991+0000 7f0f52e00640 1 Processor -- start 2024-09-13T18:41:47.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.991+0000 7f0f52e00640 1 -- start start 2024-09-13T18:41:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f52e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0f4c06b8d0 0x7f0f4c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f52e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c0b2100 con 0x7f0f4c15ad10 2024-09-13T18:41:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f52e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f4c06c250 con 0x7f0f4c0b2590 2024-09-13T18:41:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f52e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f4c150f10 con 0x7f0f4c06b8d0 2024-09-13T18:41:47.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f51a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0f4c15ad10 0x7f0f4c069ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53682/0 (socket says 172.21.15.192:53682) 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.992+0000 7f0f51a00640 1 -- 172.21.15.192:0/2118056025 learned_addr learned my addr 172.21.15.192:0/2118056025 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f51000640 1 --2- 172.21.15.192:0/2118056025 >> v2:172.21.15.194:3300/0 conn(0x7f0f4c06b8d0 0x7f0f4c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4010134986 0 0) 0x7f0f4c0b2100 con 0x7f0f4c15ad10 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f34005730 con 0x7f0f4c15ad10 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460753030 0 0) 0x7f0f34005730 con 0x7f0f4c15ad10 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 >> v2:172.21.15.194:3300/0 conn(0x7f0f4c06b8d0 msgr2=0x7f0f4c06bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 --2- 172.21.15.192:0/2118056025 >> v2:172.21.15.194:3300/0 conn(0x7f0f4c06b8d0 0x7f0f4c06bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 >> v1:172.21.15.194:6789/0 conn(0x7f0f4c0b2590 legacy=0x7f0f4c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c15a2c0 con 0x7f0f4c15ad10 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f0f40001670 con 0x7f0f4c15ad10 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 >> v1:172.21.15.192:6789/0 conn(0x7f0f4c15ad10 legacy=0x7f0f4c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 0x7f0f34005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f340069d0 0x7f0f34006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34007390 0x7f0f3400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c150f10 con 0x7f0f34005b80 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3400e230 con 0x7f0f340069d0 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.993+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3400e3f0 con 0x7f0f34007390 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 0x7f0f34005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51000640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f340069d0 0x7f0f34006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f52400640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34007390 0x7f0f3400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 -- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34007390 msgr2=0x7f0f3400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34007390 0x7f0f3400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 -- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f340069d0 msgr2=0x7f0f34006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f340069d0 0x7f0f34006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51a00640 1 -- 172.21.15.192:0/2118056025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f34005730 con 0x7f0f34005b80 2024-09-13T18:41:47.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f52400640 1 -- 172.21.15.192:0/2118056025 reap_dead start 2024-09-13T18:41:48.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.994+0000 7f0f51000640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f340069d0 0x7f0f34006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.995+0000 7f0f51a00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 0x7f0f34005fa0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c210 tx=0x7f0f34007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fac0b64f190bece server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.995+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005ad0 con 0x7f0f34005b80 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.995+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4002d070 con 0x7f0f34005b80 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.995+0000 7f0f4be00640 1 -- 172.21.15.192:0/2118056025 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f40005e70 con 0x7f0f34005b80 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 -- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 msgr2=0x7f0f34005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 0x7f0f34005fa0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f0f4000c210 tx=0x7f0f34007a00 comp rx=0 tx=0).stop 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 -- 172.21.15.192:0/2118056025 shutdown_connections 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 --2- 172.21.15.192:0/2118056025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f34005b80 0x7f0f34005fa0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 -- 172.21.15.192:0/2118056025 >> 172.21.15.192:0/2118056025 conn(0x7f0f4c0b09f0 msgr2=0x7f0f4c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:48.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 -- 172.21.15.192:0/2118056025 shutdown_connections 2024-09-13T18:41:48.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.996+0000 7f0f52e00640 1 -- 172.21.15.192:0/2118056025 wait complete. 2024-09-13T18:41:48.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.998+0000 7f0f52e00640 1 Processor -- start 2024-09-13T18:41:48.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.998+0000 7f0f52e00640 1 -- start start 2024-09-13T18:41:48.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34005b80 0x7f0f4c1f6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c13ec40 0x7f0f4c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1e6110 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1e5500 con 0x7f0f4c13ec40 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4c1e57e0 con 0x7f0f34005b80 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55940/0 (socket says 172.21.15.192:55940) 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 -- 172.21.15.192:0/1127748278 learned_addr learned my addr 172.21.15.192:0/1127748278 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f52400640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c13ec40 0x7f0f4c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51a00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34005b80 0x7f0f4c1f6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 -- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34005b80 msgr2=0x7f0f4c1f6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34005b80 0x7f0f4c1f6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 -- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c13ec40 msgr2=0x7f0f4c13f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c13ec40 0x7f0f4c13f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:47.999+0000 7f0f51000640 1 -- 172.21.15.192:0/1127748278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c1e5ac0 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f51000640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f380114e0 tx=0x7f0f380119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38015870 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f380159d0 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f38015d80 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4c1e5da0 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.000+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4c13f610 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.001+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f4c1e6280 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.002+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0f3801d400 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.003+0000 7f0f49600640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 0x7f0f2c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.003+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0f38089600 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.003+0000 7f0f51a00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 0x7f0f2c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.004+0000 7f0f51a00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 0x7f0f2c06d0f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0f40032000 tx=0x7f0f40009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.007+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0f38054b20 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.180+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0f4c06bd10 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.181+0000 7f0f49600640 1 -- 172.21.15.192:0/1127748278 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v130) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0f38022090 con 0x7f0f4c1f5b80 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:41:48.184 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:41:48.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 msgr2=0x7f0f2c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 0x7f0f2c06d0f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0f40032000 tx=0x7f0f40009030 comp rx=0 tx=0).stop 2024-09-13T18:41:48.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 msgr2=0x7f0f4c1f6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f0f380114e0 tx=0x7f0f380119a0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 shutdown_connections 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0f2c06ac30 0x7f0f2c06d0f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0f4c13ec40 0x7f0f4c13f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0f4c1f5b80 0x7f0f4c1f6550 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 --2- 172.21.15.192:0/1127748278 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0f34005b80 0x7f0f4c1f6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 >> 172.21.15.192:0/1127748278 conn(0x7f0f4c0b09f0 msgr2=0x7f0f4c0b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 shutdown_connections 2024-09-13T18:41:48.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.183+0000 7f0f52e00640 1 -- 172.21.15.192:0/1127748278 wait complete. 2024-09-13T18:41:48.202 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:41:48.202 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:41:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.359+0000 7f5091a00640 1 Processor -- start 2024-09-13T18:41:48.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.359+0000 7f5091a00640 1 -- start start 2024-09-13T18:41:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.360+0000 7f5091a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f508c071b80 0x7f508c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.360+0000 7f5091a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c0cd9c0 0x7f508c0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.360+0000 7f5091a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f508c06a330 con 0x7f508c1403e0 2024-09-13T18:41:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.360+0000 7f5091a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f508c13e0f0 con 0x7f508c071b80 2024-09-13T18:41:48.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.360+0000 7f5091a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c0ce370 con 0x7f508c0cd9c0 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f508c071b80 0x7f508c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c0cd9c0 0x7f508c0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f508c071b80 0x7f508c15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:56700/0 (socket says 172.21.15.192:56700) 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 -- 172.21.15.192:0/1413036678 learned_addr learned my addr 172.21.15.192:0/1413036678 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 -- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c0cd9c0 msgr2=0x7f508c0cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:48.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 --2- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c0cd9c0 0x7f508c0cde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 -- 172.21.15.192:0/1413036678 >> v1:172.21.15.194:6789/0 conn(0x7f508c1403e0 legacy=0x7f508c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.361+0000 7f508aa00640 1 -- 172.21.15.192:0/1413036678 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f508c15f840 con 0x7f508c071b80 2024-09-13T18:41:48.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.362+0000 7f508aa00640 1 --2- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c071b80 0x7f508c15f300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f507c0098a0 tx=0x7f507c02a290 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe65d9efa7fbeec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.362+0000 7f508a000640 1 -- 172.21.15.192:0/1413036678 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c032440 con 0x7f508c071b80 2024-09-13T18:41:48.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f508a000640 1 -- 172.21.15.192:0/1413036678 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c0325a0 con 0x7f508c071b80 2024-09-13T18:41:48.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f508a000640 1 -- 172.21.15.192:0/1413036678 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c032930 con 0x7f508c071b80 2024-09-13T18:41:48.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 -- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c071b80 msgr2=0x7f508c15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 --2- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c071b80 0x7f508c15f300 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f507c0098a0 tx=0x7f507c02a290 comp rx=0 tx=0).stop 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 -- 172.21.15.192:0/1413036678 shutdown_connections 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 --2- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c0cd9c0 0x7f508c0cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 --2- 172.21.15.192:0/1413036678 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c071b80 0x7f508c15f300 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 -- 172.21.15.192:0/1413036678 >> 172.21.15.192:0/1413036678 conn(0x7f508c0b0c40 msgr2=0x7f508c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 -- 172.21.15.192:0/1413036678 shutdown_connections 2024-09-13T18:41:48.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.363+0000 7f5091a00640 1 -- 172.21.15.192:0/1413036678 wait complete. 2024-09-13T18:41:48.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.365+0000 7f5091a00640 1 Processor -- start 2024-09-13T18:41:48.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.365+0000 7f5091a00640 1 -- start start 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c071b80 0x7f508c15a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c0cd9c0 0x7f508c13c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1562d0 con 0x7f508c1403e0 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508c153a20 con 0x7f508c0cd9c0 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5091a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f508c1564e0 con 0x7f508c071b80 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f508b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f508b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55948/0 (socket says 172.21.15.192:55948) 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f508b400640 1 -- 172.21.15.192:0/1507162445 learned_addr learned my addr 172.21.15.192:0/1507162445 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f508aa00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c071b80 0x7f508c15a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.366+0000 7f5083e00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c0cd9c0 0x7f508c13c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 -- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c071b80 msgr2=0x7f508c15a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c071b80 0x7f508c15a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 -- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c0cd9c0 msgr2=0x7f508c13c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c0cd9c0 0x7f508c13c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 -- 172.21.15.192:0/1507162445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0094d0 con 0x7f508c1403e0 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f508b400640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f508400efc0 tx=0x7f508400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084014480 con 0x7f508c1403e0 2024-09-13T18:41:48.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f508400f040 con 0x7f508c1403e0 2024-09-13T18:41:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508c1567c0 con 0x7f508c1403e0 2024-09-13T18:41:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084014820 con 0x7f508c1403e0 2024-09-13T18:41:48.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.367+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508c15aca0 con 0x7f508c1403e0 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.368+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f508c141140 con 0x7f508c1403e0 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.369+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5084014980 con 0x7f508c1403e0 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.370+0000 7f5082a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 0x7f506806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.370+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5084089eb0 con 0x7f508c1403e0 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.370+0000 7f508aa00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 0x7f506806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:48.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.371+0000 7f508aa00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 0x7f506806d0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f507c034000 tx=0x7f507c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:48.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.374+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5084055370 con 0x7f508c1403e0 2024-09-13T18:41:48.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:48.543+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f508c13da80 con 0x7f508c1403e0 2024-09-13T18:41:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.334+0000 7f5082a00640 1 -- 172.21.15.192:0/1507162445 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v131) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5084058990 con 0x7f508c1403e0 2024-09-13T18:41:49.337 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:41:49.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.338+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 msgr2=0x7f506806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.338+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 0x7f506806d0c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f507c034000 tx=0x7f507c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.338+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 msgr2=0x7f508c1544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.338+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f508400efc0 tx=0x7f508400c490 comp rx=0 tx=0).stop 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 shutdown_connections 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f506806ac00 0x7f506806d0c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f508c1403e0 0x7f508c1544c0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f508c0cd9c0 0x7f508c13c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 --2- 172.21.15.192:0/1507162445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f508c071b80 0x7f508c15a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 >> 172.21.15.192:0/1507162445 conn(0x7f508c0b0c40 msgr2=0x7f508c15d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:49.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 shutdown_connections 2024-09-13T18:41:49.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.339+0000 7f5091a00640 1 -- 172.21.15.192:0/1507162445 wait complete. 2024-09-13T18:41:49.362 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:41:49.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.522+0000 7f2ec9800640 1 Processor -- start 2024-09-13T18:41:49.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.522+0000 7f2ec9800640 1 -- start start 2024-09-13T18:41:49.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec9800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ec406c0b0 0x7f2ec406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec9800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ec40b2000 con 0x7f2ec40b3af0 2024-09-13T18:41:49.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec9800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ec406ca80 con 0x7f2ec406c0b0 2024-09-13T18:41:49.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec415b970 con 0x7f2ec41589f0 2024-09-13T18:41:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2ec406c0b0 0x7f2ec406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.523+0000 7f2ec2000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2ec40b3af0 0x7f2ec415b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:53694/0 (socket says 172.21.15.192:53694) 2024-09-13T18:41:49.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec2000640 1 -- 172.21.15.192:0/3139888676 learned_addr learned my addr 172.21.15.192:0/3139888676 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec2a00640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec3400640 1 -- 172.21.15.192:0/3139888676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 msgr2=0x7f2ec40b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec3400640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec40b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec3400640 1 -- 172.21.15.192:0/3139888676 >> v1:172.21.15.192:6789/0 conn(0x7f2ec40b3af0 legacy=0x7f2ec415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec3400640 1 -- 172.21.15.192:0/3139888676 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec415bbd0 con 0x7f2ec406c0b0 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec2a00640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec40b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.524+0000 7f2ec1600640 1 -- 172.21.15.192:0/3139888676 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3218923570 0 0) 0x7f2ec40b2000 con 0x7f2ec40b3af0 2024-09-13T18:41:49.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.525+0000 7f2ec3400640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec406c0b0 0x7f2ec406c540 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009d90 tx=0x7f2ebc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4592a3fa2676aa0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:49.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.525+0000 7f2ec1600640 1 -- 172.21.15.192:0/3139888676 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc007740 con 0x7f2ec406c0b0 2024-09-13T18:41:49.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.525+0000 7f2ec1600640 1 -- 172.21.15.192:0/3139888676 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ebc02d050 con 0x7f2ec406c0b0 2024-09-13T18:41:49.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.525+0000 7f2ec1600640 1 -- 172.21.15.192:0/3139888676 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc007ac0 con 0x7f2ec406c0b0 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 -- 172.21.15.192:0/3139888676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec406c0b0 msgr2=0x7f2ec406c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec406c0b0 0x7f2ec406c540 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc009d90 tx=0x7f2ebc02a660 comp rx=0 tx=0).stop 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 -- 172.21.15.192:0/3139888676 shutdown_connections 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec406c0b0 0x7f2ec406c540 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 --2- 172.21.15.192:0/3139888676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec40b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 -- 172.21.15.192:0/3139888676 >> 172.21.15.192:0/3139888676 conn(0x7f2ec40b08f0 msgr2=0x7f2ec40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 -- 172.21.15.192:0/3139888676 shutdown_connections 2024-09-13T18:41:49.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.526+0000 7f2ec9800640 1 -- 172.21.15.192:0/3139888676 wait complete. 2024-09-13T18:41:49.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.528+0000 7f2ec9800640 1 Processor -- start 2024-09-13T18:41:49.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.528+0000 7f2ec9800640 1 -- start start 2024-09-13T18:41:49.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec406c0b0 0x7f2ec41456c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec41575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec4145c00 con 0x7f2ec40b3af0 2024-09-13T18:41:49.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40cc2d0 con 0x7f2ec406c0b0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec40cc520 con 0x7f2ec41589f0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55962/0 (socket says 172.21.15.192:55962) 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 -- 172.21.15.192:0/851002757 learned_addr learned my addr 172.21.15.192:0/851002757 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2a00640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec406c0b0 0x7f2ec41456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec3400640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec41575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 -- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 msgr2=0x7f2ec41575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec41575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 -- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec406c0b0 msgr2=0x7f2ec41456c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec406c0b0 0x7f2ec41456c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec2000640 1 -- 172.21.15.192:0/851002757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc009a70 con 0x7f2ec40b3af0 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.529+0000 7f2ec3400640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:49.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ec2000640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c4a0 tx=0x7f2eb000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:49.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb00074e0 con 0x7f2ec40b3af0 2024-09-13T18:41:49.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb0007640 con 0x7f2ec40b3af0 2024-09-13T18:41:49.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0004a20 con 0x7f2ec40b3af0 2024-09-13T18:41:49.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec40cc800 con 0x7f2ec40b3af0 2024-09-13T18:41:49.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.530+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec40ccdc0 con 0x7f2ec40b3af0 2024-09-13T18:41:49.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.531+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec40ccfe0 con 0x7f2ec40b3af0 2024-09-13T18:41:49.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.532+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2eb0004b80 con 0x7f2ec40b3af0 2024-09-13T18:41:49.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.533+0000 7f2ebaa00640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 0x7f2ea406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:49.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.533+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2eb00881f0 con 0x7f2ec40b3af0 2024-09-13T18:41:49.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.534+0000 7f2ec2a00640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 0x7f2ea406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:49.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.534+0000 7f2ec2a00640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 0x7f2ea406d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2ec41581f0 tx=0x7f2eb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:49.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.538+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2eb0053650 con 0x7f2ec40b3af0 2024-09-13T18:41:49.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:49.708+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2ec406c540 con 0x7f2ec40b3af0 2024-09-13T18:41:50.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.343+0000 7f2ebaa00640 1 -- 172.21.15.192:0/851002757 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v132) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2eb0056c70 con 0x7f2ec40b3af0 2024-09-13T18:41:50.346 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:41:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.348+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 msgr2=0x7f2ea406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.348+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 0x7f2ea406d0c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f2ec41581f0 tx=0x7f2eb4008040 comp rx=0 tx=0).stop 2024-09-13T18:41:50.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.348+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 msgr2=0x7f2ec414fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.348+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000c4a0 tx=0x7f2eb000c960 comp rx=0 tx=0).stop 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 shutdown_connections 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ea406ac00 0x7f2ea406d0c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ec41589f0 0x7f2ec41575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ec40b3af0 0x7f2ec414fd30 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 --2- 172.21.15.192:0/851002757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ec406c0b0 0x7f2ec41456c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.349+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 >> 172.21.15.192:0/851002757 conn(0x7f2ec40b08f0 msgr2=0x7f2ec40ae860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:50.355 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.352+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 shutdown_connections 2024-09-13T18:41:50.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.353+0000 7f2ec9800640 1 -- 172.21.15.192:0/851002757 wait complete. 2024-09-13T18:41:50.377 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:41:50.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.532+0000 7f042e600640 1 Processor -- start 2024-09-13T18:41:50.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.532+0000 7f042e600640 1 -- start start 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.533+0000 7f042e600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f042815a910 0x7f04280b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.533+0000 7f042e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0428160ac0 0x7f0428160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.533+0000 7f042e600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280b2b40 con 0x7f04280ad840 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.533+0000 7f042e600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280b21e0 con 0x7f042815a910 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.533+0000 7f042e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280b1bf0 con 0x7f0428160ac0 2024-09-13T18:41:50.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f042815a910 0x7f04280b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f042815a910 0x7f04280b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37098/0 (socket says 172.21.15.192:37098) 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 -- 172.21.15.192:0/1516731176 learned_addr learned my addr 172.21.15.192:0/1516731176 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0426a00640 1 --2- 172.21.15.192:0/1516731176 >> v2:172.21.15.194:3300/0 conn(0x7f0428160ac0 0x7f0428160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 -- 172.21.15.192:0/1516731176 >> v2:172.21.15.194:3300/0 conn(0x7f0428160ac0 msgr2=0x7f0428160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 --2- 172.21.15.192:0/1516731176 >> v2:172.21.15.194:3300/0 conn(0x7f0428160ac0 0x7f0428160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 -- 172.21.15.192:0/1516731176 >> v1:172.21.15.194:6789/0 conn(0x7f04280ad840 legacy=0x7f04280cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.534+0000 7f0427400640 1 -- 172.21.15.192:0/1516731176 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0428161510 con 0x7f042815a910 2024-09-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.535+0000 7f0427400640 1 --2- 172.21.15.192:0/1516731176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f042815a910 0x7f04280b2600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f04280ce530 tx=0x7f041802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6640f7024d2f1db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.535+0000 7f0426000640 1 -- 172.21.15.192:0/1516731176 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418032440 con 0x7f042815a910 2024-09-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.535+0000 7f0426000640 1 -- 172.21.15.192:0/1516731176 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04180325a0 con 0x7f042815a910 2024-09-13T18:41:50.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.535+0000 7f0426000640 1 -- 172.21.15.192:0/1516731176 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0418032930 con 0x7f042815a910 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 -- 172.21.15.192:0/1516731176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f042815a910 msgr2=0x7f04280b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 --2- 172.21.15.192:0/1516731176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f042815a910 0x7f04280b2600 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f04280ce530 tx=0x7f041802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 -- 172.21.15.192:0/1516731176 shutdown_connections 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 --2- 172.21.15.192:0/1516731176 >> v2:172.21.15.194:3300/0 conn(0x7f0428160ac0 0x7f0428160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 --2- 172.21.15.192:0/1516731176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f042815a910 0x7f04280b2600 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 -- 172.21.15.192:0/1516731176 >> 172.21.15.192:0/1516731176 conn(0x7f04280b08f0 msgr2=0x7f04280b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 -- 172.21.15.192:0/1516731176 shutdown_connections 2024-09-13T18:41:50.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.536+0000 7f042e600640 1 -- 172.21.15.192:0/1516731176 wait complete. 2024-09-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.538+0000 7f042e600640 1 Processor -- start 2024-09-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.538+0000 7f042e600640 1 -- start start 2024-09-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04280ad840 0x7f042806b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042815a910 0x7f04281f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042815e2f0 con 0x7f0428160ac0 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042815d670 con 0x7f04280ad840 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f042e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042815d950 con 0x7f042815a910 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37112/0 (socket says 172.21.15.192:37112) 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 -- 172.21.15.192:0/1412863182 learned_addr learned my addr 172.21.15.192:0/1412863182 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427400640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04280ad840 0x7f042806b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0426a00640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042815a910 0x7f04281f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 -- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042815a910 msgr2=0x7f04281f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042815a910 0x7f04281f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 -- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04280ad840 msgr2=0x7f042806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04280ad840 0x7f042806b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.539+0000 7f0427e00640 1 -- 172.21.15.192:0/1412863182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04180094d0 con 0x7f0428160ac0 2024-09-13T18:41:50.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f0427e00640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f042000c6b0 tx=0x7f042000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003b70 con 0x7f0428160ac0 2024-09-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0420003cf0 con 0x7f0428160ac0 2024-09-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f042815dc30 con 0x7f0428160ac0 2024-09-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420003ea0 con 0x7f0428160ac0 2024-09-13T18:41:50.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.540+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f042806bab0 con 0x7f0428160ac0 2024-09-13T18:41:50.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.541+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042815acf0 con 0x7f0428160ac0 2024-09-13T18:41:50.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.543+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0420005310 con 0x7f0428160ac0 2024-09-13T18:41:50.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.543+0000 7f041f400640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 0x7f040806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.543+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f04200899e0 con 0x7f0428160ac0 2024-09-13T18:41:50.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.544+0000 7f0427400640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 0x7f040806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.544+0000 7f0427400640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 0x7f040806d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0418034000 tx=0x7f041802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.547+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0420054d40 con 0x7f0428160ac0 2024-09-13T18:41:50.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.748+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f042815cce0 con 0x7f0428160ac0 2024-09-13T18:41:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.756+0000 7f041f400640 1 -- 172.21.15.192:0/1412863182 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v51) v1 ==== 174+0+0 (secure 0 0 0) 0x7f0420058360 con 0x7f0428160ac0 2024-09-13T18:41:50.759 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 14 and data pool 15 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.761+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 msgr2=0x7f040806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.761+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 0x7f040806d0c0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0418034000 tx=0x7f041802e000 comp rx=0 tx=0).stop 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.761+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 msgr2=0x7f04281f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.761+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f042000c6b0 tx=0x7f042000cb70 comp rx=0 tx=0).stop 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 shutdown_connections 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f040806ac00 0x7f040806d0c0 secure :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0418034000 tx=0x7f041802e000 comp rx=0 tx=0).stop 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0428160ac0 0x7f04281f6560 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f042815a910 0x7f04281f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 --2- 172.21.15.192:0/1412863182 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04280ad840 0x7f042806b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.762+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 >> 172.21.15.192:0/1412863182 conn(0x7f04280b08f0 msgr2=0x7f04280cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:50.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.763+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 shutdown_connections 2024-09-13T18:41:50.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.763+0000 7f042e600640 1 -- 172.21.15.192:0/1412863182 wait complete. 2024-09-13T18:41:50.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:50.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.939+0000 7fc08b200640 1 Processor -- start 2024-09-13T18:41:50.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.939+0000 7fc08b200640 1 -- start start 2024-09-13T18:41:50.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc08b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc08c0b3480 0x7fc08c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc08b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c15af60 con 0x7fc08c159b00 2024-09-13T18:41:50.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc08b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c06b7a0 con 0x7fc08c06bc30 2024-09-13T18:41:50.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc08b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc08c15ac80 con 0x7fc08c0b3480 2024-09-13T18:41:50.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc089e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc08c159b00 0x7fc08c0b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60662/0 (socket says 172.21.15.192:60662) 2024-09-13T18:41:50.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.940+0000 7fc089e00640 1 -- 172.21.15.192:0/2971015165 learned_addr learned my addr 172.21.15.192:0/2971015165 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:50.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc083e00640 1 --2- 172.21.15.192:0/2971015165 >> v2:172.21.15.194:3300/0 conn(0x7fc08c0b3480 0x7fc08c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc089400640 1 -- 172.21.15.192:0/2971015165 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 652636002 0 0) 0x7fc08c15af60 con 0x7fc08c159b00 2024-09-13T18:41:50.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc089400640 1 -- 172.21.15.192:0/2971015165 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc070003520 con 0x7fc08c159b00 2024-09-13T18:41:50.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc083e00640 1 -- 172.21.15.192:0/2971015165 >> v1:172.21.15.194:6789/0 conn(0x7fc08c06bc30 legacy=0x7fc08c15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc083e00640 1 -- 172.21.15.192:0/2971015165 >> v1:172.21.15.192:6789/0 conn(0x7fc08c159b00 legacy=0x7fc08c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.941+0000 7fc083e00640 1 -- 172.21.15.192:0/2971015165 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c06b150 con 0x7fc08c0b3480 2024-09-13T18:41:50.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.942+0000 7fc083e00640 1 --2- 172.21.15.192:0/2971015165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c0b3480 0x7fc08c159ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc0740097a0 tx=0x7fc07402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd4c61274dcf21e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.942+0000 7fc089400640 1 -- 172.21.15.192:0/2971015165 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074032440 con 0x7fc08c0b3480 2024-09-13T18:41:50.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.942+0000 7fc089400640 1 -- 172.21.15.192:0/2971015165 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0740325a0 con 0x7fc08c0b3480 2024-09-13T18:41:50.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc089400640 1 -- 172.21.15.192:0/2971015165 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074032930 con 0x7fc08c0b3480 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 -- 172.21.15.192:0/2971015165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c0b3480 msgr2=0x7fc08c159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 --2- 172.21.15.192:0/2971015165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c0b3480 0x7fc08c159ee0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc0740097a0 tx=0x7fc07402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 -- 172.21.15.192:0/2971015165 shutdown_connections 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 --2- 172.21.15.192:0/2971015165 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c0b3480 0x7fc08c159ee0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 -- 172.21.15.192:0/2971015165 >> 172.21.15.192:0/2971015165 conn(0x7fc08c0736d0 msgr2=0x7fc08c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 -- 172.21.15.192:0/2971015165 shutdown_connections 2024-09-13T18:41:50.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.943+0000 7fc08b200640 1 -- 172.21.15.192:0/2971015165 wait complete. 2024-09-13T18:41:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.945+0000 7fc08b200640 1 Processor -- start 2024-09-13T18:41:50.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.945+0000 7fc08b200640 1 -- start start 2024-09-13T18:41:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c06bc30 0x7fc08c15c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc08c159b00 0x7fc08c14f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1f1bc0 con 0x7fc08c0b3480 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1e3490 con 0x7fc08c06bc30 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1502b0 con 0x7fc08c159b00 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37128/0 (socket says 172.21.15.192:37128) 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 -- 172.21.15.192:0/4190411103 learned_addr learned my addr 172.21.15.192:0/4190411103 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc089e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c06bc30 0x7fc08c15c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc08a800640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc08c159b00 0x7fc08c14f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 -- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc08c159b00 msgr2=0x7fc08c14f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc08c159b00 0x7fc08c14f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 -- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c06bc30 msgr2=0x7fc08c15c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.946+0000 7fc083e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c06bc30 0x7fc08c15c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc083e00640 1 -- 172.21.15.192:0/4190411103 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc074009400 con 0x7fc08c0b3480 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc083e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc074000c00 tx=0x7fc0740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074032440 con 0x7fc08c0b3480 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc074004230 con 0x7fc08c0b3480 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c15c5e0 con 0x7fc08c0b3480 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc074006e10 con 0x7fc08c0b3480 2024-09-13T18:41:50.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.947+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c15cba0 con 0x7fc08c0b3480 2024-09-13T18:41:50.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.948+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c150460 con 0x7fc08c0b3480 2024-09-13T18:41:50.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.949+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc074039050 con 0x7fc08c0b3480 2024-09-13T18:41:50.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.950+0000 7fc082000640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 0x7fc06806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:50.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.950+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0740a9cc0 con 0x7fc08c0b3480 2024-09-13T18:41:50.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.950+0000 7fc089e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 0x7fc06806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:50.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.951+0000 7fc089e00640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 0x7fc06806d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0011e0 tx=0x7fc07c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:50.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:50.954+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc08c150460 con 0x7fc08c0b3480 2024-09-13T18:41:51.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.126+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc08c15cdc0 con 0x7fc08c0b3480 2024-09-13T18:41:51.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.127+0000 7fc082000640 1 -- 172.21.15.192:0/4190411103 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fc07404b070 con 0x7fc08c0b3480 2024-09-13T18:41:51.131 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:51.131 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":133,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:50.750218+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 msgr2=0x7fc06806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 0x7fc06806d0c0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fc07c0011e0 tx=0x7fc07c007d30 comp rx=0 tx=0).stop 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 msgr2=0x7fc08c1f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc074000c00 tx=0x7fc0740046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 shutdown_connections 2024-09-13T18:41:51.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc06806ac00 0x7fc06806d0c0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc08c159b00 0x7fc08c14f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc08c0b3480 0x7fc08c1f1680 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 --2- 172.21.15.192:0/4190411103 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc08c06bc30 0x7fc08c15c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 >> 172.21.15.192:0/4190411103 conn(0x7fc08c0736d0 msgr2=0x7fc08c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 shutdown_connections 2024-09-13T18:41:51.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.130+0000 7fc08b200640 1 -- 172.21.15.192:0/4190411103 wait complete. 2024-09-13T18:41:51.149 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.298+0000 7fdfe8c00640 1 Processor -- start 2024-09-13T18:41:51.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.298+0000 7fdfe8c00640 1 -- start start 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.299+0000 7fdfe8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfe40cb0b0 0x7fdfe415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdfe4140980 0x7fdfe4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe8c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe415c160 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfe4140480 con 0x7fdfe4140980 2024-09-13T18:41:51.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe415ee90 con 0x7fdfe40cacd0 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfe40cb0b0 0x7fdfe415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdfe40cb0b0 0x7fdfe415bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37138/0 (socket says 172.21.15.192:37138) 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 -- 172.21.15.192:0/2042522066 learned_addr learned my addr 172.21.15.192:0/2042522066 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe2800640 1 --2- 172.21.15.192:0/2042522066 >> v2:172.21.15.194:3300/0 conn(0x7fdfe4140980 0x7fdfe4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1e00640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 -- 172.21.15.192:0/2042522066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 msgr2=0x7fdfe415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:51.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 -- 172.21.15.192:0/2042522066 >> v2:172.21.15.194:3300/0 conn(0x7fdfe4140980 msgr2=0x7fdfe4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 --2- 172.21.15.192:0/2042522066 >> v2:172.21.15.194:3300/0 conn(0x7fdfe4140980 0x7fdfe4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.300+0000 7fdfe1400640 1 -- 172.21.15.192:0/2042522066 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe415f170 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.301+0000 7fdfe1400640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe415bc20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdfe406e7b0 tx=0x7fdfd002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1917fb6086c7410 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe0a00640 1 -- 172.21.15.192:0/2042522066 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd002ae90 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe0a00640 1 -- 172.21.15.192:0/2042522066 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd0032440 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe0a00640 1 -- 172.21.15.192:0/2042522066 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd00327d0 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2042522066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 msgr2=0x7fdfe415bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe415bc20 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fdfe406e7b0 tx=0x7fdfd002a140 comp rx=0 tx=0).stop 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2042522066 shutdown_connections 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2042522066 >> v2:172.21.15.194:3300/0 conn(0x7fdfe4140980 0x7fdfe4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe415bc20 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2042522066 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2042522066 >> 172.21.15.192:0/2042522066 conn(0x7fdfe40ae960 msgr2=0x7fdfe406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2042522066 shutdown_connections 2024-09-13T18:41:51.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.302+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2042522066 wait complete. 2024-09-13T18:41:51.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.304+0000 7fdfe8c00640 1 Processor -- start 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.304+0000 7fdfe8c00640 1 -- start start 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe4159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 0x7fdfe40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe406ae90 con 0x7fdfe40cb0b0 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe413d7b0 con 0x7fdfe4140980 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe406a210 con 0x7fdfe40cacd0 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.305+0000 7fdfe1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37144/0 (socket says 172.21.15.192:37144) 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe1400640 1 -- 172.21.15.192:0/2655928296 learned_addr learned my addr 172.21.15.192:0/2655928296 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 0x7fdfe40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe1e00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe4159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 -- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 msgr2=0x7fdfe4159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe4159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 -- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 msgr2=0x7fdfe413d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 -- 172.21.15.192:0/2655928296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd00094d0 con 0x7fdfe4140980 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe1400640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.306+0000 7fdfe2800640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 0x7fdfe40cc8c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc007d90 tx=0x7fdfdc00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.307+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc018070 con 0x7fdfe4140980 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.307+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfdc00edd0 con 0x7fdfe4140980 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.307+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfdc003bb0 con 0x7fdfe4140980 2024-09-13T18:41:51.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.307+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe406a4f0 con 0x7fdfe4140980 2024-09-13T18:41:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.307+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe406aab0 con 0x7fdfe4140980 2024-09-13T18:41:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.308+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe406afd0 con 0x7fdfe4140980 2024-09-13T18:41:51.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.309+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdfdc014420 con 0x7fdfe4140980 2024-09-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.310+0000 7fdfda000640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 0x7fdfc406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.310+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdfdc089500 con 0x7fdfe4140980 2024-09-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.310+0000 7fdfe1e00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 0x7fdfc406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.313 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.310+0000 7fdfe1e00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 0x7fdfc406d0f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdfe41401a0 tx=0x7fdfd4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.315+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdfe406afd0 con 0x7fdfe4140980 2024-09-13T18:41:51.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.488+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfe406afd0 con 0x7fdfe4140980 2024-09-13T18:41:51.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.489+0000 7fdfda000640 1 -- 172.21.15.192:0/2655928296 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+16593 (secure 0 0 0) 0x7fdfe406afd0 con 0x7fdfe4140980 2024-09-13T18:41:51.492 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:51.493 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":133,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:50.750218+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 msgr2=0x7fdfc406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 0x7fdfc406d0f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fdfe41401a0 tx=0x7fdfd4008040 comp rx=0 tx=0).stop 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 msgr2=0x7fdfe40cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 0x7fdfe40cc8c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc007d90 tx=0x7fdfdc00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 shutdown_connections 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdfc406ac30 0x7fdfc406d0f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdfe4140980 0x7fdfe40cc8c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdfe40cb0b0 0x7fdfe413d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 --2- 172.21.15.192:0/2655928296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdfe40cacd0 0x7fdfe4159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 >> 172.21.15.192:0/2655928296 conn(0x7fdfe40ae960 msgr2=0x7fdfe40aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:51.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 shutdown_connections 2024-09-13T18:41:51.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.492+0000 7fdfe8c00640 1 -- 172.21.15.192:0/2655928296 wait complete. 2024-09-13T18:41:51.510 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:41:51.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.663+0000 7f2a5c800640 1 Processor -- start 2024-09-13T18:41:51.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.663+0000 7f2a5c800640 1 -- start start 2024-09-13T18:41:51.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a5c800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2a541434c0 0x7f2a5406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a5c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 0x7f2a540b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a5c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5406b480 con 0x7f2a540b3bd0 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a5c800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a540b4060 con 0x7f2a541434c0 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a5c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540ce770 con 0x7f2a5406a8b0 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.664+0000 7f2a59e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2a541434c0 0x7f2a5406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2a541434c0 0x7f2a5406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37156/0 (socket says 172.21.15.192:37156) 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 -- 172.21.15.192:0/1480289957 learned_addr learned my addr 172.21.15.192:0/1480289957 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59400640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 0x7f2a540b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 -- 172.21.15.192:0/1480289957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 msgr2=0x7f2a540b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:51.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 0x7f2a540b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 -- 172.21.15.192:0/1480289957 >> v1:172.21.15.194:6789/0 conn(0x7f2a540b3bd0 legacy=0x7f2a5406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59e00640 1 -- 172.21.15.192:0/1480289957 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5406b760 con 0x7f2a541434c0 2024-09-13T18:41:51.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.665+0000 7f2a59400640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 0x7f2a540b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.666+0000 7f2a59e00640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a541434c0 0x7f2a5406c800 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a4802a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e519ed72fe043961 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.666+0000 7f2a58a00640 1 -- 172.21.15.192:0/1480289957 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48032440 con 0x7f2a541434c0 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.666+0000 7f2a58a00640 1 -- 172.21.15.192:0/1480289957 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480325a0 con 0x7f2a541434c0 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.666+0000 7f2a58a00640 1 -- 172.21.15.192:0/1480289957 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48032930 con 0x7f2a541434c0 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 -- 172.21.15.192:0/1480289957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a541434c0 msgr2=0x7f2a5406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a541434c0 0x7f2a5406c800 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f2a480098a0 tx=0x7f2a4802a290 comp rx=0 tx=0).stop 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 -- 172.21.15.192:0/1480289957 shutdown_connections 2024-09-13T18:41:51.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a5406a8b0 0x7f2a540b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1480289957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a541434c0 0x7f2a5406c800 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 -- 172.21.15.192:0/1480289957 >> 172.21.15.192:0/1480289957 conn(0x7f2a540b08f0 msgr2=0x7f2a540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 -- 172.21.15.192:0/1480289957 shutdown_connections 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.667+0000 7f2a5c800640 1 -- 172.21.15.192:0/1480289957 wait complete. 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.669+0000 7f2a5c800640 1 Processor -- start 2024-09-13T18:41:51.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.669+0000 7f2a5c800640 1 -- start start 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a540b3bd0 0x7f2a54166ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a541434c0 0x7f2a540aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540ab660 con 0x7f2a5406a8b0 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540aa9e0 con 0x7f2a541434c0 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a540aacc0 con 0x7f2a540b3bd0 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37168/0 (socket says 172.21.15.192:37168) 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59e00640 1 -- 172.21.15.192:0/1724929736 learned_addr learned my addr 172.21.15.192:0/1724929736 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59400640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a540b3bd0 0x7f2a54166ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a5a800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a541434c0 0x7f2a540aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59e00640 1 -- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a540b3bd0 msgr2=0x7f2a54166ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.670+0000 7f2a59e00640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a540b3bd0 0x7f2a54166ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a59e00640 1 -- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a541434c0 msgr2=0x7f2a540aba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a59e00640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a541434c0 0x7f2a540aba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a59e00640 1 -- 172.21.15.192:0/1724929736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a480094d0 con 0x7f2a5406a8b0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a59e00640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48032440 con 0x7f2a5406a8b0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a48030b80 con 0x7f2a5406a8b0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4803d440 con 0x7f2a5406a8b0 2024-09-13T18:41:51.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a540aafa0 con 0x7f2a5406a8b0 2024-09-13T18:41:51.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.671+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a54167410 con 0x7f2a5406a8b0 2024-09-13T18:41:51.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.672+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a540ab8d0 con 0x7f2a5406a8b0 2024-09-13T18:41:51.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.673+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2a48039040 con 0x7f2a5406a8b0 2024-09-13T18:41:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.674+0000 7f2a4e000640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 0x7f2a3806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.675+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a480a9dd0 con 0x7f2a5406a8b0 2024-09-13T18:41:51.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.675+0000 7f2a59400640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 0x7f2a3806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:51.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.675+0000 7f2a59400640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 0x7f2a3806d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a54141ee0 tx=0x7f2a44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:51.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.679+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2a48075050 con 0x7f2a5406a8b0 2024-09-13T18:41:51.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:51.884+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a5406acf0 con 0x7f2a5406a8b0 2024-09-13T18:41:52.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.768+0000 7f2a4e000640 1 -- 172.21.15.192:0/1724929736 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v54) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a48078670 con 0x7f2a5406a8b0 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 msgr2=0x7f2a3806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 0x7f2a3806d0c0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2a54141ee0 tx=0x7f2a44008040 comp rx=0 tx=0).stop 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 msgr2=0x7f2a540aa3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f2a48000c00 tx=0x7f2a480046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 shutdown_connections 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2a3806ac00 0x7f2a3806d0c0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2a541434c0 0x7f2a540aba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2a540b3bd0 0x7f2a54166ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 --2- 172.21.15.192:0/1724929736 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a5406a8b0 0x7f2a540aa3c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 >> 172.21.15.192:0/1724929736 conn(0x7f2a540b08f0 msgr2=0x7f2a541427c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:52.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 shutdown_connections 2024-09-13T18:41:52.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.771+0000 7f2a5c800640 1 -- 172.21.15.192:0/1724929736 wait complete. 2024-09-13T18:41:52.792 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:41:52.792 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:41:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.948+0000 7f2681000640 1 Processor -- start 2024-09-13T18:41:52.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.948+0000 7f2681000640 1 -- start start 2024-09-13T18:41:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.949+0000 7f2681000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 0x7f267c06ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.949+0000 7f2681000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 0x7f267c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.949+0000 7f2681000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267c15a8e0 con 0x7f267c0cdf60 2024-09-13T18:41:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.949+0000 7f2681000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f267c0b2fe0 con 0x7f267c0b3470 2024-09-13T18:41:52.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.949+0000 7f2681000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c0b26b0 con 0x7f267c0cb330 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f267a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 0x7f267c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 0x7f267c06ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2673e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f267c0cdf60 0x7f267c0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:48566/0 (socket says 172.21.15.192:48566) 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2673e00640 1 -- 172.21.15.192:0/30783139 learned_addr learned my addr 172.21.15.192:0/30783139 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679e00640 1 -- 172.21.15.192:0/30783139 >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 msgr2=0x7f267c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679e00640 1 --2- 172.21.15.192:0/30783139 >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 0x7f267c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679e00640 1 -- 172.21.15.192:0/30783139 >> v1:172.21.15.194:6789/0 conn(0x7f267c0cdf60 legacy=0x7f267c0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679e00640 1 -- 172.21.15.192:0/30783139 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c0b2990 con 0x7f267c0cb330 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f267a800640 1 --2- 172.21.15.192:0/30783139 >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 0x7f267c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.950+0000 7f2679400640 1 -- 172.21.15.192:0/30783139 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153939228 0 0) 0x7f267c15a8e0 con 0x7f267c0cdf60 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.951+0000 7f2679e00640 1 --2- 172.21.15.192:0/30783139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 0x7f267c06ac00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097a0 tx=0x7f266c02a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efdcdd7ddb334899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2679400640 1 -- 172.21.15.192:0/30783139 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c02adb0 con 0x7f267c0cb330 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2679400640 1 -- 172.21.15.192:0/30783139 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c032440 con 0x7f267c0cb330 2024-09-13T18:41:52.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2679400640 1 -- 172.21.15.192:0/30783139 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0327d0 con 0x7f267c0cb330 2024-09-13T18:41:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 -- 172.21.15.192:0/30783139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 msgr2=0x7f267c06ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 --2- 172.21.15.192:0/30783139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 0x7f267c06ac00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f266c0097a0 tx=0x7f266c02a060 comp rx=0 tx=0).stop 2024-09-13T18:41:52.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 -- 172.21.15.192:0/30783139 shutdown_connections 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 --2- 172.21.15.192:0/30783139 >> v2:172.21.15.194:3300/0 conn(0x7f267c0b3470 0x7f267c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 --2- 172.21.15.192:0/30783139 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cb330 0x7f267c06ac00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 -- 172.21.15.192:0/30783139 >> 172.21.15.192:0/30783139 conn(0x7f267c0b08f0 msgr2=0x7f267c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 -- 172.21.15.192:0/30783139 shutdown_connections 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.952+0000 7f2681000640 1 -- 172.21.15.192:0/30783139 wait complete. 2024-09-13T18:41:52.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.954+0000 7f2681000640 1 Processor -- start 2024-09-13T18:41:52.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.954+0000 7f2681000640 1 -- start start 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f267c0b3470 0x7f267c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cdf60 0x7f267c15bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c1541a0 con 0x7f267c0cb330 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267c154480 con 0x7f267c0b3470 2024-09-13T18:41:52.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2681000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267c154760 con 0x7f267c0cdf60 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2673e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2673e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37172/0 (socket says 172.21.15.192:37172) 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2673e00640 1 -- 172.21.15.192:0/1802598442 learned_addr learned my addr 172.21.15.192:0/1802598442 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2679e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f267c0b3470 0x7f267c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f267a800640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cdf60 0x7f267c15bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.955+0000 7f2673e00640 1 -- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cdf60 msgr2=0x7f267c15bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2673e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cdf60 0x7f267c15bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2673e00640 1 -- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f267c0b3470 msgr2=0x7f267c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2673e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f267c0b3470 0x7f267c14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:52.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2673e00640 1 -- 172.21.15.192:0/1802598442 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267400ab80 con 0x7f267c0cb330 2024-09-13T18:41:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2673e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f266400c4d0 tx=0x7f266400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640074e0 con 0x7f267c0cb330 2024-09-13T18:41:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664007660 con 0x7f267c0cb330 2024-09-13T18:41:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664004a20 con 0x7f267c0cb330 2024-09-13T18:41:52.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c009400 con 0x7f267c0cb330 2024-09-13T18:41:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.956+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c154d20 con 0x7f267c0cb330 2024-09-13T18:41:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.957+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267c0b38a0 con 0x7f267c0cb330 2024-09-13T18:41:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.958+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2664004b80 con 0x7f267c0cb330 2024-09-13T18:41:52.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.959+0000 7f2672000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 0x7f265806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:52.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.959+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26640884f0 con 0x7f267c0cb330 2024-09-13T18:41:52.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.959+0000 7f2679e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 0x7f265806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:52.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.960+0000 7f2679e00640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 0x7f265806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f266c034000 tx=0x7f266c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:52.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:52.963+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f26640536e0 con 0x7f267c0cb330 2024-09-13T18:41:53.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.166+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f267c0af190 con 0x7f267c0cb330 2024-09-13T18:41:53.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.777+0000 7f2672000640 1 -- 172.21.15.192:0/1802598442 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v55) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2664056d00 con 0x7f267c0cb330 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 msgr2=0x7f265806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 0x7f265806d0c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f266c034000 tx=0x7f266c02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 msgr2=0x7f267c155240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f266400c4d0 tx=0x7f266400c990 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 shutdown_connections 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f265806ac00 0x7f265806d0c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f267c0cdf60 0x7f267c15bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f267c0cb330 0x7f267c155240 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 --2- 172.21.15.192:0/1802598442 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f267c0b3470 0x7f267c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 >> 172.21.15.192:0/1802598442 conn(0x7f267c0b08f0 msgr2=0x7f267c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:53.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 shutdown_connections 2024-09-13T18:41:53.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.780+0000 7f2681000640 1 -- 172.21.15.192:0/1802598442 wait complete. 2024-09-13T18:41:53.801 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:41:53.801 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:53.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.955+0000 7f5b1d000640 1 Processor -- start 2024-09-13T18:41:53.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.956+0000 7f5b1d000640 1 -- start start 2024-09-13T18:41:53.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b1d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5b18156e30 0x7f5b18157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b1d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b180adf50 0x7f5b1815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b1d000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180b3c90 con 0x7f5b18161210 2024-09-13T18:41:53.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b1d000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b18157750 con 0x7f5b18156e30 2024-09-13T18:41:53.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b1d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b180b3110 con 0x7f5b180adf50 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b17400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5b18156e30 0x7f5b18157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b17400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5b18156e30 0x7f5b18157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37184/0 (socket says 172.21.15.192:37184) 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b16a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f5b18161210 0x7f5b180ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60666/0 (socket says 172.21.15.192:60666) 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b17400640 1 -- 172.21.15.192:0/341342176 learned_addr learned my addr 172.21.15.192:0/341342176 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.957+0000 7f5b17e00640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b180adf50 0x7f5b1815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.958+0000 7f5b17400640 1 -- 172.21.15.192:0/341342176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b180adf50 msgr2=0x7f5b1815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.958+0000 7f5b17400640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b180adf50 0x7f5b1815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.958+0000 7f5b17400640 1 -- 172.21.15.192:0/341342176 >> v1:172.21.15.192:6789/0 conn(0x7f5b18161210 legacy=0x7f5b180ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.958+0000 7f5b17400640 1 -- 172.21.15.192:0/341342176 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b180b33f0 con 0x7f5b18156e30 2024-09-13T18:41:53.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.958+0000 7f5b17400640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18156e30 0x7f5b18157210 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009e50 tx=0x7f5b0802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6ea58c22b3d16a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:53.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b16000640 1 -- 172.21.15.192:0/341342176 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08031600 con 0x7f5b18156e30 2024-09-13T18:41:53.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b16000640 1 -- 172.21.15.192:0/341342176 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0802d050 con 0x7f5b18156e30 2024-09-13T18:41:53.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b16000640 1 -- 172.21.15.192:0/341342176 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08031980 con 0x7f5b18156e30 2024-09-13T18:41:53.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 -- 172.21.15.192:0/341342176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18156e30 msgr2=0x7f5b18157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18156e30 0x7f5b18157210 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009e50 tx=0x7f5b0802a710 comp rx=0 tx=0).stop 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 -- 172.21.15.192:0/341342176 shutdown_connections 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b180adf50 0x7f5b1815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 --2- 172.21.15.192:0/341342176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18156e30 0x7f5b18157210 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 -- 172.21.15.192:0/341342176 >> 172.21.15.192:0/341342176 conn(0x7f5b180736d0 msgr2=0x7f5b180b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 -- 172.21.15.192:0/341342176 shutdown_connections 2024-09-13T18:41:53.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.959+0000 7f5b1d000640 1 -- 172.21.15.192:0/341342176 wait complete. 2024-09-13T18:41:53.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.961+0000 7f5b1d000640 1 Processor -- start 2024-09-13T18:41:53.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.961+0000 7f5b1d000640 1 -- start start 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 0x7f5b1806b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b18156e30 0x7f5b1813e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18071110 con 0x7f5b18161210 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18070490 con 0x7f5b180adf50 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b1d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b18070770 con 0x7f5b18156e30 2024-09-13T18:41:53.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37198/0 (socket says 172.21.15.192:37198) 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.962+0000 7f5b17e00640 1 -- 172.21.15.192:0/781733646 learned_addr learned my addr 172.21.15.192:0/781733646 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b16a00640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b18156e30 0x7f5b1813e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17400640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 0x7f5b1806b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 -- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b18156e30 msgr2=0x7f5b1813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b18156e30 0x7f5b1813e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 -- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 msgr2=0x7f5b1806b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 0x7f5b1806b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 -- 172.21.15.192:0/781733646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b08009b30 con 0x7f5b18161210 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17400640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 0x7f5b1806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b17e00640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d800 tx=0x7f5b1000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000b6c0 con 0x7f5b18161210 2024-09-13T18:41:53.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000b840 con 0x7f5b18161210 2024-09-13T18:41:53.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18070a50 con 0x7f5b18161210 2024-09-13T18:41:53.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000bbf0 con 0x7f5b18161210 2024-09-13T18:41:53.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.963+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b1806beb0 con 0x7f5b18161210 2024-09-13T18:41:53.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.964+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b180af6b0 con 0x7f5b18161210 2024-09-13T18:41:53.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.965+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5b1000bd50 con 0x7f5b18161210 2024-09-13T18:41:53.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.966+0000 7f5b0f400640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 0x7f5af806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:53.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.966+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b10089930 con 0x7f5b18161210 2024-09-13T18:41:53.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.966+0000 7f5b17400640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 0x7f5af806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:53.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.967+0000 7f5b17400640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 0x7f5af806d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5b08033000 tx=0x7f5b08009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:53.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:53.971+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5b10054a70 con 0x7f5b18161210 2024-09-13T18:41:54.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.173+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b180b2d70 con 0x7f5b18161210 2024-09-13T18:41:54.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.174+0000 7f5b0f400640 1 -- 172.21.15.192:0/781733646 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f5b10058090 con 0x7f5b18161210 2024-09-13T18:41:54.177 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:54.177 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:41:54.177 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 msgr2=0x7f5af806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 0x7f5af806d0c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5b08033000 tx=0x7f5b08009000 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 msgr2=0x7f5b1813e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f5b1000d800 tx=0x7f5b1000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 shutdown_connections 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5af806ac00 0x7f5af806d0c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b18161210 0x7f5b1813e630 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5b18156e30 0x7f5b1813e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 --2- 172.21.15.192:0/781733646 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5b180adf50 0x7f5b1806b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 >> 172.21.15.192:0/781733646 conn(0x7f5b180736d0 msgr2=0x7f5b1813eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:54.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 shutdown_connections 2024-09-13T18:41:54.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.176+0000 7f5b1d000640 1 -- 172.21.15.192:0/781733646 wait complete. 2024-09-13T18:41:54.194 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:41:54.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.345+0000 7f3583200640 1 Processor -- start 2024-09-13T18:41:54.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.345+0000 7f3583200640 1 -- start start 2024-09-13T18:41:54.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.346+0000 7f3583200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35840b3600 0x7f35840b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.346+0000 7f3583200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f358406bca0 0x7f358406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.346+0000 7f3583200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358406f830 con 0x7f35841592d0 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3583200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3584071230 con 0x7f358406bca0 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3583200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840b3fb0 con 0x7f35840b3600 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f358406bca0 0x7f358406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f358406bca0 0x7f358406c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37212/0 (socket says 172.21.15.192:37212) 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 -- 172.21.15.192:0/1834107694 learned_addr learned my addr 172.21.15.192:0/1834107694 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:54.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f357be00640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35840b3600 0x7f35840b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 -- 172.21.15.192:0/1834107694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35840b3600 msgr2=0x7f35840b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35840b3600 0x7f35840b3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 -- 172.21.15.192:0/1834107694 >> v1:172.21.15.194:6789/0 conn(0x7f35841592d0 legacy=0x7f3584070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.347+0000 7f3582800640 1 -- 172.21.15.192:0/1834107694 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358406c630 con 0x7f358406bca0 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.348+0000 7f3582800640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f358406bca0 0x7f358406c0f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f357c009e80 tx=0x7f357c02a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cffdb434f2b5899 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3581400640 1 -- 172.21.15.192:0/1834107694 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031600 con 0x7f358406bca0 2024-09-13T18:41:54.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3581400640 1 -- 172.21.15.192:0/1834107694 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357c02d050 con 0x7f358406bca0 2024-09-13T18:41:54.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3581400640 1 -- 172.21.15.192:0/1834107694 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357c031980 con 0x7f358406bca0 2024-09-13T18:41:54.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 -- 172.21.15.192:0/1834107694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f358406bca0 msgr2=0x7f358406c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f358406bca0 0x7f358406c0f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f357c009e80 tx=0x7f357c02a750 comp rx=0 tx=0).stop 2024-09-13T18:41:54.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 -- 172.21.15.192:0/1834107694 shutdown_connections 2024-09-13T18:41:54.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f358406bca0 0x7f358406c0f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 --2- 172.21.15.192:0/1834107694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f35840b3600 0x7f35840b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 -- 172.21.15.192:0/1834107694 >> 172.21.15.192:0/1834107694 conn(0x7f35840736d0 msgr2=0x7f35840b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:54.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 -- 172.21.15.192:0/1834107694 shutdown_connections 2024-09-13T18:41:54.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.349+0000 7f3583200640 1 -- 172.21.15.192:0/1834107694 wait complete. 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.351+0000 7f3583200640 1 Processor -- start 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.351+0000 7f3583200640 1 -- start start 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f358406bca0 0x7f3584153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35841592d0 0x7f3584145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584151f60 con 0x7f35840b3600 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35841f2990 con 0x7f35841592d0 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3583200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35841f2c70 con 0x7f358406bca0 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37214/0 (socket says 172.21.15.192:37214) 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 -- 172.21.15.192:0/1045362625 learned_addr learned my addr 172.21.15.192:0/1045362625 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3582800640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35841592d0 0x7f3584145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f3581e00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f358406bca0 0x7f3584153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 -- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f358406bca0 msgr2=0x7f3584153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f358406bca0 0x7f3584153690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 -- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35841592d0 msgr2=0x7f3584145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35841592d0 0x7f3584145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.352+0000 7f357be00640 1 -- 172.21.15.192:0/1045362625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c009b30 con 0x7f35840b3600 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f357be00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e9b0 tx=0x7f356c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c009670 con 0x7f35840b3600 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f356c00c9a0 con 0x7f35840b3600 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f356c00cd50 con 0x7f35840b3600 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35841f2f50 con 0x7f35840b3600 2024-09-13T18:41:54.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.353+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3584153bd0 con 0x7f35840b3600 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.354+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358414e740 con 0x7f35840b3600 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.355+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f356c013470 con 0x7f35840b3600 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.356+0000 7f357a000640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 0x7f356006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.356+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f356c089550 con 0x7f35840b3600 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.356+0000 7f3581e00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 0x7f356006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.357+0000 7f3581e00640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 0x7f356006d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3574000f60 tx=0x7f3574009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.360+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f356c0547d0 con 0x7f35840b3600 2024-09-13T18:41:54.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.528+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3584070600 con 0x7f35840b3600 2024-09-13T18:41:54.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.529+0000 7f357a000640 1 -- 172.21.15.192:0/1045362625 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+16580 (secure 0 0 0) 0x7f356c057df0 con 0x7f35840b3600 2024-09-13T18:41:54.532 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:54.533 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":134,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:41:51.753178+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"134","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:41:54.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.531+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 msgr2=0x7f356006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.531+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 0x7f356006d0c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3574000f60 tx=0x7f3574009040 comp rx=0 tx=0).stop 2024-09-13T18:41:54.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.531+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 msgr2=0x7f358415c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.531+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f356c00e9b0 tx=0x7f356c00ee70 comp rx=0 tx=0).stop 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 shutdown_connections 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f356006ac00 0x7f356006d0c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f35841592d0 0x7f3584145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f35840b3600 0x7f358415c300 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 --2- 172.21.15.192:0/1045362625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f358406bca0 0x7f3584153690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 >> 172.21.15.192:0/1045362625 conn(0x7f35840736d0 msgr2=0x7f35841580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 shutdown_connections 2024-09-13T18:41:54.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.532+0000 7f3583200640 1 -- 172.21.15.192:0/1045362625 wait complete. 2024-09-13T18:41:54.552 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:41:54.552 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:41:54.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.703+0000 7f7384000640 1 Processor -- start 2024-09-13T18:41:54.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.703+0000 7f7384000640 1 -- start start 2024-09-13T18:41:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 0x7f737c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c0cb0b0 0x7f737c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c15c160 con 0x7f737c0cb0b0 2024-09-13T18:41:54.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c140480 con 0x7f737c0cacd0 2024-09-13T18:41:54.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.704+0000 7f7384000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c0cb520 con 0x7f737c140980 2024-09-13T18:41:54.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c0cb0b0 0x7f737c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f737c0cb0b0 0x7f737c15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37224/0 (socket says 172.21.15.192:37224) 2024-09-13T18:41:54.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 -- 172.21.15.192:0/1401855644 learned_addr learned my addr 172.21.15.192:0/1401855644 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7381600640 1 --2- 172.21.15.192:0/1401855644 >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 0x7f737c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 -- 172.21.15.192:0/1401855644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 msgr2=0x7f737c140dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7382000640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c140dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 -- 172.21.15.192:0/1401855644 >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 msgr2=0x7f737c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 --2- 172.21.15.192:0/1401855644 >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 0x7f737c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7380c00640 1 -- 172.21.15.192:0/1401855644 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c15ee90 con 0x7f737c0cb0b0 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7381600640 1 --2- 172.21.15.192:0/1401855644 >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 0x7f737c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.705+0000 7f7382000640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.706+0000 7f7380c00640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c15bc20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f737c0b2350 tx=0x7f736802a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e45228f20abccaf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.706+0000 7f737be00640 1 -- 172.21.15.192:0/1401855644 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368032440 con 0x7f737c0cb0b0 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.706+0000 7f737be00640 1 -- 172.21.15.192:0/1401855644 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73680325a0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.706+0000 7f737be00640 1 -- 172.21.15.192:0/1401855644 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368032930 con 0x7f737c0cb0b0 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 -- 172.21.15.192:0/1401855644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 msgr2=0x7f737c15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c15bc20 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f737c0b2350 tx=0x7f736802a1d0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 -- 172.21.15.192:0/1401855644 shutdown_connections 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c140dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 --2- 172.21.15.192:0/1401855644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c15bc20 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 --2- 172.21.15.192:0/1401855644 >> v2:172.21.15.194:3300/0 conn(0x7f737c0cacd0 0x7f737c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 -- 172.21.15.192:0/1401855644 >> 172.21.15.192:0/1401855644 conn(0x7f737c0ae960 msgr2=0x7f737c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 -- 172.21.15.192:0/1401855644 shutdown_connections 2024-09-13T18:41:54.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.707+0000 7f7384000640 1 -- 172.21.15.192:0/1401855644 wait complete. 2024-09-13T18:41:54.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.709+0000 7f7384000640 1 Processor -- start 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.709+0000 7f7384000640 1 -- start start 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.709+0000 7f7384000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0cacd0 0x7f737c13fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.709+0000 7f7384000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.709+0000 7f7384000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c1e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7384000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c140100 con 0x7f737c0cb0b0 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7384000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c13f480 con 0x7f737c0cacd0 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7384000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c13f1a0 con 0x7f737c140980 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37234/0 (socket says 172.21.15.192:37234) 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 -- 172.21.15.192:0/1669709754 learned_addr learned my addr 172.21.15.192:0/1669709754 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7381600640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0cacd0 0x7f737c13fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7382000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c1e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 -- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 msgr2=0x7f737c1e6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c1e6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 -- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0cacd0 msgr2=0x7f737c13fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0cacd0 0x7f737c13fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 -- 172.21.15.192:0/1669709754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73680094d0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.710+0000 7f7380c00640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f736802a210 tx=0x7f73680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.711+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7368030b80 con 0x7f737c0cb0b0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.711+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7368030ce0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.711+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c1e50f0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.711+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736803d680 con 0x7f737c0cb0b0 2024-09-13T18:41:54.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.711+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c1e56b0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.712+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c0b1cf0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.713+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7368039040 con 0x7f737c0cb0b0 2024-09-13T18:41:54.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.714+0000 7f7379600640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 0x7f735c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.714+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73680a9fc0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.714+0000 7f7381600640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 0x7f735c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:54.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.715+0000 7f7381600640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 0x7f735c06d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7370006fd0 tx=0x7f7370008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:54.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.718+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73680751b0 con 0x7f737c0cb0b0 2024-09-13T18:41:54.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.885+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f737c15f450 con 0x7f735c06ac00 2024-09-13T18:41:54.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.893+0000 7f7379600640 1 -- 172.21.15.192:0/1669709754 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285311 (secure 0 0 0) 0x7f737000c040 con 0x7f735c06ac00 2024-09-13T18:41:54.899 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:54.900 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:41:54.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 msgr2=0x7f735c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 0x7f735c06d0c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f7370006fd0 tx=0x7f7370008040 comp rx=0 tx=0).stop 2024-09-13T18:41:54.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 msgr2=0x7f737c1e5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:54.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f736802a210 tx=0x7f73680046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 shutdown_connections 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f735c06ac00 0x7f735c06d0c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f737c140980 0x7f737c1e6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f737c0cb0b0 0x7f737c1e5bd0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 --2- 172.21.15.192:0/1669709754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f737c0cacd0 0x7f737c13fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 >> 172.21.15.192:0/1669709754 conn(0x7f737c0ae960 msgr2=0x7f737c159110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 shutdown_connections 2024-09-13T18:41:54.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:54.897+0000 7f7384000640 1 -- 172.21.15.192:0/1669709754 wait complete. 2024-09-13T18:41:54.915 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-13T18:41:54.816519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555537,"statfs":{"total":1600000000,"available":1592870592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.482211"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602091+0000","last_change":"2024-09-13T18:41:50.775388+0000","last_active":"2024-09-13T18:41:52.602091+0000","last_peered":"2024-09-13T18:41:52.602091+0000","last_clean":"2024-09-13T18:41:52.602091+0000","last_became_active":"2024-09-13T18:41:50.773097+0000","last_became_peered":"2024-09-13T18:41:50.773097+0000","last_unstale":"2024-09-13T18:41:52.602091+0000","last_undegraded":"2024-09-13T18:41:52.602091+0000","last_fullsized":"2024-09-13T18:41:52.602091+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:28.759849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601708+0000","last_change":"2024-09-13T18:41:50.769357+0000","last_active":"2024-09-13T18:41:52.601708+0000","last_peered":"2024-09-13T18:41:52.601708+0000","last_clean":"2024-09-13T18:41:52.601708+0000","last_became_active":"2024-09-13T18:41:50.769096+0000","last_became_peered":"2024-09-13T18:41:50.769096+0000","last_unstale":"2024-09-13T18:41:52.601708+0000","last_undegraded":"2024-09-13T18:41:52.601708+0000","last_fullsized":"2024-09-13T18:41:52.601708+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602509+0000","last_change":"2024-09-13T18:41:50.767999+0000","last_active":"2024-09-13T18:41:52.602509+0000","last_peered":"2024-09-13T18:41:52.602509+0000","last_clean":"2024-09-13T18:41:52.602509+0000","last_became_active":"2024-09-13T18:41:50.767544+0000","last_became_peered":"2024-09-13T18:41:50.767544+0000","last_unstale":"2024-09-13T18:41:52.602509+0000","last_undegraded":"2024-09-13T18:41:52.602509+0000","last_fullsized":"2024-09-13T18:41:52.602509+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:11.648191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601872+0000","last_change":"2024-09-13T18:41:50.779860+0000","last_active":"2024-09-13T18:41:52.601872+0000","last_peered":"2024-09-13T18:41:52.601872+0000","last_clean":"2024-09-13T18:41:52.601872+0000","last_became_active":"2024-09-13T18:41:50.779445+0000","last_became_peered":"2024-09-13T18:41:50.779445+0000","last_unstale":"2024-09-13T18:41:52.601872+0000","last_undegraded":"2024-09-13T18:41:52.601872+0000","last_fullsized":"2024-09-13T18:41:52.601872+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:09.174087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760276+0000","last_change":"2024-09-13T18:41:50.761227+0000","last_active":"2024-09-13T18:41:51.760276+0000","last_peered":"2024-09-13T18:41:51.760276+0000","last_clean":"2024-09-13T18:41:51.760276+0000","last_became_active":"2024-09-13T18:41:50.760999+0000","last_became_peered":"2024-09-13T18:41:50.760999+0000","last_unstale":"2024-09-13T18:41:51.760276+0000","last_undegraded":"2024-09-13T18:41:51.760276+0000","last_fullsized":"2024-09-13T18:41:51.760276+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:28.263678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760491+0000","last_change":"2024-09-13T18:41:50.767070+0000","last_active":"2024-09-13T18:41:51.760491+0000","last_peered":"2024-09-13T18:41:51.760491+0000","last_clean":"2024-09-13T18:41:51.760491+0000","last_became_active":"2024-09-13T18:41:50.766602+0000","last_became_peered":"2024-09-13T18:41:50.766602+0000","last_unstale":"2024-09-13T18:41:51.760491+0000","last_undegraded":"2024-09-13T18:41:51.760491+0000","last_fullsized":"2024-09-13T18:41:51.760491+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:14.060827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760310+0000","last_change":"2024-09-13T18:41:50.758381+0000","last_active":"2024-09-13T18:41:51.760310+0000","last_peered":"2024-09-13T18:41:51.760310+0000","last_clean":"2024-09-13T18:41:51.760310+0000","last_became_active":"2024-09-13T18:41:50.758138+0000","last_became_peered":"2024-09-13T18:41:50.758138+0000","last_unstale":"2024-09-13T18:41:51.760310+0000","last_undegraded":"2024-09-13T18:41:51.760310+0000","last_fullsized":"2024-09-13T18:41:51.760310+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:48.630766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602591+0000","last_change":"2024-09-13T18:41:50.767869+0000","last_active":"2024-09-13T18:41:52.602591+0000","last_peered":"2024-09-13T18:41:52.602591+0000","last_clean":"2024-09-13T18:41:52.602591+0000","last_became_active":"2024-09-13T18:41:50.766790+0000","last_became_peered":"2024-09-13T18:41:50.766790+0000","last_unstale":"2024-09-13T18:41:52.602591+0000","last_undegraded":"2024-09-13T18:41:52.602591+0000","last_fullsized":"2024-09-13T18:41:52.602591+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760247+0000","last_change":"2024-09-13T18:41:50.763132+0000","last_active":"2024-09-13T18:41:51.760247+0000","last_peered":"2024-09-13T18:41:51.760247+0000","last_clean":"2024-09-13T18:41:51.760247+0000","last_became_active":"2024-09-13T18:41:50.761140+0000","last_became_peered":"2024-09-13T18:41:50.761140+0000","last_unstale":"2024-09-13T18:41:51.760247+0000","last_undegraded":"2024-09-13T18:41:51.760247+0000","last_fullsized":"2024-09-13T18:41:51.760247+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:40.044765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761100+0000","last_change":"2024-09-13T18:41:50.775450+0000","last_active":"2024-09-13T18:41:51.761100+0000","last_peered":"2024-09-13T18:41:51.761100+0000","last_clean":"2024-09-13T18:41:51.761100+0000","last_became_active":"2024-09-13T18:41:50.775235+0000","last_became_peered":"2024-09-13T18:41:50.775235+0000","last_unstale":"2024-09-13T18:41:51.761100+0000","last_undegraded":"2024-09-13T18:41:51.761100+0000","last_fullsized":"2024-09-13T18:41:51.761100+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760566+0000","last_change":"2024-09-13T18:41:50.766859+0000","last_active":"2024-09-13T18:41:51.760566+0000","last_peered":"2024-09-13T18:41:51.760566+0000","last_clean":"2024-09-13T18:41:51.760566+0000","last_became_active":"2024-09-13T18:41:50.766274+0000","last_became_peered":"2024-09-13T18:41:50.766274+0000","last_unstale":"2024-09-13T18:41:51.760566+0000","last_undegraded":"2024-09-13T18:41:51.760566+0000","last_fullsized":"2024-09-13T18:41:51.760566+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:46.054537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601401+0000","last_change":"2024-09-13T18:41:50.773493+0000","last_active":"2024-09-13T18:41:52.601401+0000","last_peered":"2024-09-13T18:41:52.601401+0000","last_clean":"2024-09-13T18:41:52.601401+0000","last_became_active":"2024-09-13T18:41:50.773197+0000","last_became_peered":"2024-09-13T18:41:50.773197+0000","last_unstale":"2024-09-13T18:41:52.601401+0000","last_undegraded":"2024-09-13T18:41:52.601401+0000","last_fullsized":"2024-09-13T18:41:52.601401+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:20.535040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.759815+0000","last_change":"2024-09-13T18:41:50.765681+0000","last_active":"2024-09-13T18:41:51.759815+0000","last_peered":"2024-09-13T18:41:51.759815+0000","last_clean":"2024-09-13T18:41:51.759815+0000","last_became_active":"2024-09-13T18:41:50.765410+0000","last_became_peered":"2024-09-13T18:41:50.765410+0000","last_unstale":"2024-09-13T18:41:51.759815+0000","last_undegraded":"2024-09-13T18:41:51.759815+0000","last_fullsized":"2024-09-13T18:41:51.759815+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:45.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602009+0000","last_change":"2024-09-13T18:41:50.774075+0000","last_active":"2024-09-13T18:41:52.602009+0000","last_peered":"2024-09-13T18:41:52.602009+0000","last_clean":"2024-09-13T18:41:52.602009+0000","last_became_active":"2024-09-13T18:41:50.773759+0000","last_became_peered":"2024-09-13T18:41:50.773759+0000","last_unstale":"2024-09-13T18:41:52.602009+0000","last_undegraded":"2024-09-13T18:41:52.602009+0000","last_fullsized":"2024-09-13T18:41:52.602009+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:23.060936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602212+0000","last_change":"2024-09-13T18:41:50.776346+0000","last_active":"2024-09-13T18:41:52.602212+0000","last_peered":"2024-09-13T18:41:52.602212+0000","last_clean":"2024-09-13T18:41:52.602212+0000","last_became_active":"2024-09-13T18:41:50.775491+0000","last_became_peered":"2024-09-13T18:41:50.775491+0000","last_unstale":"2024-09-13T18:41:52.602212+0000","last_undegraded":"2024-09-13T18:41:52.602212+0000","last_fullsized":"2024-09-13T18:41:52.602212+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:01.991158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760636+0000","last_change":"2024-09-13T18:41:50.773040+0000","last_active":"2024-09-13T18:41:51.760636+0000","last_peered":"2024-09-13T18:41:51.760636+0000","last_clean":"2024-09-13T18:41:51.760636+0000","last_became_active":"2024-09-13T18:41:50.772795+0000","last_became_peered":"2024-09-13T18:41:50.772795+0000","last_unstale":"2024-09-13T18:41:51.760636+0000","last_undegraded":"2024-09-13T18:41:51.760636+0000","last_fullsized":"2024-09-13T18:41:51.760636+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:09.770792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061379+0000","last_change":"2024-09-13T18:41:50.777637+0000","last_active":"2024-09-13T18:41:53.061379+0000","last_peered":"2024-09-13T18:41:53.061379+0000","last_clean":"2024-09-13T18:41:53.061379+0000","last_became_active":"2024-09-13T18:41:50.777179+0000","last_became_peered":"2024-09-13T18:41:50.777179+0000","last_unstale":"2024-09-13T18:41:53.061379+0000","last_undegraded":"2024-09-13T18:41:53.061379+0000","last_fullsized":"2024-09-13T18:41:53.061379+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:25.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601781+0000","last_change":"2024-09-13T18:41:50.777553+0000","last_active":"2024-09-13T18:41:52.601781+0000","last_peered":"2024-09-13T18:41:52.601781+0000","last_clean":"2024-09-13T18:41:52.601781+0000","last_became_active":"2024-09-13T18:41:50.775437+0000","last_became_peered":"2024-09-13T18:41:50.775437+0000","last_unstale":"2024-09-13T18:41:52.601781+0000","last_undegraded":"2024-09-13T18:41:52.601781+0000","last_fullsized":"2024-09-13T18:41:52.601781+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061494+0000","last_change":"2024-09-13T18:41:50.777417+0000","last_active":"2024-09-13T18:41:53.061494+0000","last_peered":"2024-09-13T18:41:53.061494+0000","last_clean":"2024-09-13T18:41:53.061494+0000","last_became_active":"2024-09-13T18:41:50.777162+0000","last_became_peered":"2024-09-13T18:41:50.777162+0000","last_unstale":"2024-09-13T18:41:53.061494+0000","last_undegraded":"2024-09-13T18:41:53.061494+0000","last_fullsized":"2024-09-13T18:41:53.061494+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:29.964995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601293+0000","last_change":"2024-09-13T18:41:50.767163+0000","last_active":"2024-09-13T18:41:52.601293+0000","last_peered":"2024-09-13T18:41:52.601293+0000","last_clean":"2024-09-13T18:41:52.601293+0000","last_became_active":"2024-09-13T18:41:50.766938+0000","last_became_peered":"2024-09-13T18:41:50.766938+0000","last_unstale":"2024-09-13T18:41:52.601293+0000","last_undegraded":"2024-09-13T18:41:52.601293+0000","last_fullsized":"2024-09-13T18:41:52.601293+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:25.165007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601751+0000","last_change":"2024-09-13T18:41:50.759354+0000","last_active":"2024-09-13T18:41:52.601751+0000","last_peered":"2024-09-13T18:41:52.601751+0000","last_clean":"2024-09-13T18:41:52.601751+0000","last_became_active":"2024-09-13T18:41:50.758719+0000","last_became_peered":"2024-09-13T18:41:50.758719+0000","last_unstale":"2024-09-13T18:41:52.601751+0000","last_undegraded":"2024-09-13T18:41:52.601751+0000","last_fullsized":"2024-09-13T18:41:52.601751+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.343962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601843+0000","last_change":"2024-09-13T18:41:50.757878+0000","last_active":"2024-09-13T18:41:52.601843+0000","last_peered":"2024-09-13T18:41:52.601843+0000","last_clean":"2024-09-13T18:41:52.601843+0000","last_became_active":"2024-09-13T18:41:50.757597+0000","last_became_peered":"2024-09-13T18:41:50.757597+0000","last_unstale":"2024-09-13T18:41:52.601843+0000","last_undegraded":"2024-09-13T18:41:52.601843+0000","last_fullsized":"2024-09-13T18:41:52.601843+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:01.991158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601907+0000","last_change":"2024-09-13T18:41:50.767395+0000","last_active":"2024-09-13T18:41:52.601907+0000","last_peered":"2024-09-13T18:41:52.601907+0000","last_clean":"2024-09-13T18:41:52.601907+0000","last_became_active":"2024-09-13T18:41:50.767103+0000","last_became_peered":"2024-09-13T18:41:50.767103+0000","last_unstale":"2024-09-13T18:41:52.601907+0000","last_undegraded":"2024-09-13T18:41:52.601907+0000","last_fullsized":"2024-09-13T18:41:52.601907+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060903+0000","last_change":"2024-09-13T18:41:50.774847+0000","last_active":"2024-09-13T18:41:53.060903+0000","last_peered":"2024-09-13T18:41:53.060903+0000","last_clean":"2024-09-13T18:41:53.060903+0000","last_became_active":"2024-09-13T18:41:50.774667+0000","last_became_peered":"2024-09-13T18:41:50.774667+0000","last_unstale":"2024-09-13T18:41:53.060903+0000","last_undegraded":"2024-09-13T18:41:53.060903+0000","last_fullsized":"2024-09-13T18:41:53.060903+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:19.634680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761015+0000","last_change":"2024-09-13T18:41:50.768822+0000","last_active":"2024-09-13T18:41:51.761015+0000","last_peered":"2024-09-13T18:41:51.761015+0000","last_clean":"2024-09-13T18:41:51.761015+0000","last_became_active":"2024-09-13T18:41:50.768565+0000","last_became_peered":"2024-09-13T18:41:50.768565+0000","last_unstale":"2024-09-13T18:41:51.761015+0000","last_undegraded":"2024-09-13T18:41:51.761015+0000","last_fullsized":"2024-09-13T18:41:51.761015+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760164+0000","last_change":"2024-09-13T18:41:50.764799+0000","last_active":"2024-09-13T18:41:51.760164+0000","last_peered":"2024-09-13T18:41:51.760164+0000","last_clean":"2024-09-13T18:41:51.760164+0000","last_became_active":"2024-09-13T18:41:50.764009+0000","last_became_peered":"2024-09-13T18:41:50.764009+0000","last_unstale":"2024-09-13T18:41:51.760164+0000","last_undegraded":"2024-09-13T18:41:51.760164+0000","last_fullsized":"2024-09-13T18:41:51.760164+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:11.521835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061213+0000","last_change":"2024-09-13T18:41:50.765943+0000","last_active":"2024-09-13T18:41:53.061213+0000","last_peered":"2024-09-13T18:41:53.061213+0000","last_clean":"2024-09-13T18:41:53.061213+0000","last_became_active":"2024-09-13T18:41:50.765617+0000","last_became_peered":"2024-09-13T18:41:50.765617+0000","last_unstale":"2024-09-13T18:41:53.061213+0000","last_undegraded":"2024-09-13T18:41:53.061213+0000","last_fullsized":"2024-09-13T18:41:53.061213+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061030+0000","last_change":"2024-09-13T18:41:50.769304+0000","last_active":"2024-09-13T18:41:53.061030+0000","last_peered":"2024-09-13T18:41:53.061030+0000","last_clean":"2024-09-13T18:41:53.061030+0000","last_became_active":"2024-09-13T18:41:50.769100+0000","last_became_peered":"2024-09-13T18:41:50.769100+0000","last_unstale":"2024-09-13T18:41:53.061030+0000","last_undegraded":"2024-09-13T18:41:53.061030+0000","last_fullsized":"2024-09-13T18:41:53.061030+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:03.911209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760022+0000","last_change":"2024-09-13T18:41:50.767190+0000","last_active":"2024-09-13T18:41:51.760022+0000","last_peered":"2024-09-13T18:41:51.760022+0000","last_clean":"2024-09-13T18:41:51.760022+0000","last_became_active":"2024-09-13T18:41:50.766370+0000","last_became_peered":"2024-09-13T18:41:50.766370+0000","last_unstale":"2024-09-13T18:41:51.760022+0000","last_undegraded":"2024-09-13T18:41:51.760022+0000","last_fullsized":"2024-09-13T18:41:51.760022+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:36.404867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760213+0000","last_change":"2024-09-13T18:41:50.773664+0000","last_active":"2024-09-13T18:41:51.760213+0000","last_peered":"2024-09-13T18:41:51.760213+0000","last_clean":"2024-09-13T18:41:51.760213+0000","last_became_active":"2024-09-13T18:41:50.773370+0000","last_became_peered":"2024-09-13T18:41:50.773370+0000","last_unstale":"2024-09-13T18:41:51.760213+0000","last_undegraded":"2024-09-13T18:41:51.760213+0000","last_fullsized":"2024-09-13T18:41:51.760213+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:38.780233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601852+0000","last_change":"2024-09-13T18:41:50.759523+0000","last_active":"2024-09-13T18:41:52.601852+0000","last_peered":"2024-09-13T18:41:52.601852+0000","last_clean":"2024-09-13T18:41:52.601852+0000","last_became_active":"2024-09-13T18:41:50.759150+0000","last_became_peered":"2024-09-13T18:41:50.759150+0000","last_unstale":"2024-09-13T18:41:52.601852+0000","last_undegraded":"2024-09-13T18:41:52.601852+0000","last_fullsized":"2024-09-13T18:41:52.601852+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:23.060936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602049+0000","last_change":"2024-09-13T18:41:50.777452+0000","last_active":"2024-09-13T18:41:52.602049+0000","last_peered":"2024-09-13T18:41:52.602049+0000","last_clean":"2024-09-13T18:41:52.602049+0000","last_became_active":"2024-09-13T18:41:50.776929+0000","last_became_peered":"2024-09-13T18:41:50.776929+0000","last_unstale":"2024-09-13T18:41:52.602049+0000","last_undegraded":"2024-09-13T18:41:52.602049+0000","last_fullsized":"2024-09-13T18:41:52.602049+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:19.634680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061597+0000","last_change":"2024-09-13T18:41:50.776181+0000","last_active":"2024-09-13T18:41:53.061597+0000","last_peered":"2024-09-13T18:41:53.061597+0000","last_clean":"2024-09-13T18:41:53.061597+0000","last_became_active":"2024-09-13T18:41:50.772719+0000","last_became_peered":"2024-09-13T18:41:50.772719+0000","last_unstale":"2024-09-13T18:41:53.061597+0000","last_undegraded":"2024-09-13T18:41:53.061597+0000","last_fullsized":"2024-09-13T18:41:53.061597+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:20.058090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"133'4","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760186+0000","last_change":"2024-09-13T18:41:50.356606+0000","last_active":"2024-09-13T18:41:51.760186+0000","last_peered":"2024-09-13T18:41:51.760186+0000","last_clean":"2024-09-13T18:41:51.760186+0000","last_became_active":"2024-09-13T18:41:50.356380+0000","last_became_peered":"2024-09-13T18:41:50.356380+0000","last_unstale":"2024-09-13T18:41:51.760186+0000","last_undegraded":"2024-09-13T18:41:51.760186+0000","last_fullsized":"2024-09-13T18:41:51.760186+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:29.478457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.759937+0000","last_change":"2024-09-13T18:41:50.763388+0000","last_active":"2024-09-13T18:41:51.759937+0000","last_peered":"2024-09-13T18:41:51.759937+0000","last_clean":"2024-09-13T18:41:51.759937+0000","last_became_active":"2024-09-13T18:41:50.763161+0000","last_became_peered":"2024-09-13T18:41:50.763161+0000","last_unstale":"2024-09-13T18:41:51.759937+0000","last_undegraded":"2024-09-13T18:41:51.759937+0000","last_fullsized":"2024-09-13T18:41:51.759937+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:12.434200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760419+0000","last_change":"2024-09-13T18:41:50.358658+0000","last_active":"2024-09-13T18:41:51.760419+0000","last_peered":"2024-09-13T18:41:51.760419+0000","last_clean":"2024-09-13T18:41:51.760419+0000","last_became_active":"2024-09-13T18:41:50.358465+0000","last_became_peered":"2024-09-13T18:41:50.358465+0000","last_unstale":"2024-09-13T18:41:51.760419+0000","last_undegraded":"2024-09-13T18:41:51.760419+0000","last_fullsized":"2024-09-13T18:41:51.760419+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:10.391935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602192+0000","last_change":"2024-09-13T18:41:50.773358+0000","last_active":"2024-09-13T18:41:52.602192+0000","last_peered":"2024-09-13T18:41:52.602192+0000","last_clean":"2024-09-13T18:41:52.602192+0000","last_became_active":"2024-09-13T18:41:50.767685+0000","last_became_peered":"2024-09-13T18:41:50.767685+0000","last_unstale":"2024-09-13T18:41:52.602192+0000","last_undegraded":"2024-09-13T18:41:52.602192+0000","last_fullsized":"2024-09-13T18:41:52.602192+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602612+0000","last_change":"2024-09-13T18:41:50.354179+0000","last_active":"2024-09-13T18:41:52.602612+0000","last_peered":"2024-09-13T18:41:52.602612+0000","last_clean":"2024-09-13T18:41:52.602612+0000","last_became_active":"2024-09-13T18:41:50.353701+0000","last_became_peered":"2024-09-13T18:41:50.353701+0000","last_unstale":"2024-09-13T18:41:52.602612+0000","last_undegraded":"2024-09-13T18:41:52.602612+0000","last_fullsized":"2024-09-13T18:41:52.602612+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:53.591220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761198+0000","last_change":"2024-09-13T18:41:50.757849+0000","last_active":"2024-09-13T18:41:51.761198+0000","last_peered":"2024-09-13T18:41:51.761198+0000","last_clean":"2024-09-13T18:41:51.761198+0000","last_became_active":"2024-09-13T18:41:50.757623+0000","last_became_peered":"2024-09-13T18:41:50.757623+0000","last_unstale":"2024-09-13T18:41:51.761198+0000","last_undegraded":"2024-09-13T18:41:51.761198+0000","last_fullsized":"2024-09-13T18:41:51.761198+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602526+0000","last_change":"2024-09-13T18:41:50.355988+0000","last_active":"2024-09-13T18:41:52.602526+0000","last_peered":"2024-09-13T18:41:52.602526+0000","last_clean":"2024-09-13T18:41:52.602526+0000","last_became_active":"2024-09-13T18:41:50.355186+0000","last_became_peered":"2024-09-13T18:41:50.355186+0000","last_unstale":"2024-09-13T18:41:52.602526+0000","last_undegraded":"2024-09-13T18:41:52.602526+0000","last_fullsized":"2024-09-13T18:41:52.602526+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:33.601401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601359+0000","last_change":"2024-09-13T18:41:50.768577+0000","last_active":"2024-09-13T18:41:52.601359+0000","last_peered":"2024-09-13T18:41:52.601359+0000","last_clean":"2024-09-13T18:41:52.601359+0000","last_became_active":"2024-09-13T18:41:50.767992+0000","last_became_peered":"2024-09-13T18:41:50.767992+0000","last_unstale":"2024-09-13T18:41:52.601359+0000","last_undegraded":"2024-09-13T18:41:52.601359+0000","last_fullsized":"2024-09-13T18:41:52.601359+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:32.751131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602281+0000","last_change":"2024-09-13T18:41:50.354210+0000","last_active":"2024-09-13T18:41:52.602281+0000","last_peered":"2024-09-13T18:41:52.602281+0000","last_clean":"2024-09-13T18:41:52.602281+0000","last_became_active":"2024-09-13T18:41:50.353909+0000","last_became_peered":"2024-09-13T18:41:50.353909+0000","last_unstale":"2024-09-13T18:41:52.602281+0000","last_undegraded":"2024-09-13T18:41:52.602281+0000","last_fullsized":"2024-09-13T18:41:52.602281+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:04.317106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760145+0000","last_change":"2024-09-13T18:41:50.766624+0000","last_active":"2024-09-13T18:41:51.760145+0000","last_peered":"2024-09-13T18:41:51.760145+0000","last_clean":"2024-09-13T18:41:51.760145+0000","last_became_active":"2024-09-13T18:41:50.766378+0000","last_became_peered":"2024-09-13T18:41:50.766378+0000","last_unstale":"2024-09-13T18:41:51.760145+0000","last_undegraded":"2024-09-13T18:41:51.760145+0000","last_fullsized":"2024-09-13T18:41:51.760145+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:38.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602703+0000","last_change":"2024-09-13T18:41:50.354477+0000","last_active":"2024-09-13T18:41:52.602703+0000","last_peered":"2024-09-13T18:41:52.602703+0000","last_clean":"2024-09-13T18:41:52.602703+0000","last_became_active":"2024-09-13T18:41:50.354152+0000","last_became_peered":"2024-09-13T18:41:50.354152+0000","last_unstale":"2024-09-13T18:41:52.602703+0000","last_undegraded":"2024-09-13T18:41:52.602703+0000","last_fullsized":"2024-09-13T18:41:52.602703+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:04.317106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760312+0000","last_change":"2024-09-13T18:41:50.765135+0000","last_active":"2024-09-13T18:41:51.760312+0000","last_peered":"2024-09-13T18:41:51.760312+0000","last_clean":"2024-09-13T18:41:51.760312+0000","last_became_active":"2024-09-13T18:41:50.764845+0000","last_became_peered":"2024-09-13T18:41:50.764845+0000","last_unstale":"2024-09-13T18:41:51.760312+0000","last_undegraded":"2024-09-13T18:41:51.760312+0000","last_fullsized":"2024-09-13T18:41:51.760312+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:43.142310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760558+0000","last_change":"2024-09-13T18:41:50.355155+0000","last_active":"2024-09-13T18:41:51.760558+0000","last_peered":"2024-09-13T18:41:51.760558+0000","last_clean":"2024-09-13T18:41:51.760558+0000","last_became_active":"2024-09-13T18:41:50.354018+0000","last_became_peered":"2024-09-13T18:41:50.354018+0000","last_unstale":"2024-09-13T18:41:51.760558+0000","last_undegraded":"2024-09-13T18:41:51.760558+0000","last_fullsized":"2024-09-13T18:41:51.760558+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:31.410912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601080+0000","last_change":"2024-09-13T18:41:50.765083+0000","last_active":"2024-09-13T18:41:52.601080+0000","last_peered":"2024-09-13T18:41:52.601080+0000","last_clean":"2024-09-13T18:41:52.601080+0000","last_became_active":"2024-09-13T18:41:50.764870+0000","last_became_peered":"2024-09-13T18:41:50.764870+0000","last_unstale":"2024-09-13T18:41:52.601080+0000","last_undegraded":"2024-09-13T18:41:52.601080+0000","last_fullsized":"2024-09-13T18:41:52.601080+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:33.680441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.766095+0000","last_change":"2024-09-13T18:41:50.357389+0000","last_active":"2024-09-13T18:41:50.766095+0000","last_peered":"2024-09-13T18:41:50.766095+0000","last_clean":"2024-09-13T18:41:50.766095+0000","last_became_active":"2024-09-13T18:41:50.357145+0000","last_became_peered":"2024-09-13T18:41:50.357145+0000","last_unstale":"2024-09-13T18:41:50.766095+0000","last_undegraded":"2024-09-13T18:41:50.766095+0000","last_fullsized":"2024-09-13T18:41:50.766095+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:16.200809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601838+0000","last_change":"2024-09-13T18:41:50.777691+0000","last_active":"2024-09-13T18:41:52.601838+0000","last_peered":"2024-09-13T18:41:52.601838+0000","last_clean":"2024-09-13T18:41:52.601838+0000","last_became_active":"2024-09-13T18:41:50.777242+0000","last_became_peered":"2024-09-13T18:41:50.777242+0000","last_unstale":"2024-09-13T18:41:52.601838+0000","last_undegraded":"2024-09-13T18:41:52.601838+0000","last_fullsized":"2024-09-13T18:41:52.601838+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602008+0000","last_change":"2024-09-13T18:41:50.355991+0000","last_active":"2024-09-13T18:41:52.602008+0000","last_peered":"2024-09-13T18:41:52.602008+0000","last_clean":"2024-09-13T18:41:52.602008+0000","last_became_active":"2024-09-13T18:41:50.355595+0000","last_became_peered":"2024-09-13T18:41:50.355595+0000","last_unstale":"2024-09-13T18:41:52.602008+0000","last_undegraded":"2024-09-13T18:41:52.602008+0000","last_fullsized":"2024-09-13T18:41:52.602008+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:21.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061032+0000","last_change":"2024-09-13T18:41:50.764528+0000","last_active":"2024-09-13T18:41:53.061032+0000","last_peered":"2024-09-13T18:41:53.061032+0000","last_clean":"2024-09-13T18:41:53.061032+0000","last_became_active":"2024-09-13T18:41:50.764073+0000","last_became_peered":"2024-09-13T18:41:50.764073+0000","last_unstale":"2024-09-13T18:41:53.061032+0000","last_undegraded":"2024-09-13T18:41:53.061032+0000","last_fullsized":"2024-09-13T18:41:53.061032+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602365+0000","last_change":"2024-09-13T18:41:50.356618+0000","last_active":"2024-09-13T18:41:52.602365+0000","last_peered":"2024-09-13T18:41:52.602365+0000","last_clean":"2024-09-13T18:41:52.602365+0000","last_became_active":"2024-09-13T18:41:50.356387+0000","last_became_peered":"2024-09-13T18:41:50.356387+0000","last_unstale":"2024-09-13T18:41:52.602365+0000","last_undegraded":"2024-09-13T18:41:52.602365+0000","last_fullsized":"2024-09-13T18:41:52.602365+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:21.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760334+0000","last_change":"2024-09-13T18:41:50.769633+0000","last_active":"2024-09-13T18:41:51.760334+0000","last_peered":"2024-09-13T18:41:51.760334+0000","last_clean":"2024-09-13T18:41:51.760334+0000","last_became_active":"2024-09-13T18:41:50.769431+0000","last_became_peered":"2024-09-13T18:41:50.769431+0000","last_unstale":"2024-09-13T18:41:51.760334+0000","last_undegraded":"2024-09-13T18:41:51.760334+0000","last_fullsized":"2024-09-13T18:41:51.760334+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.944646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"133'3","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760334+0000","last_change":"2024-09-13T18:41:50.354774+0000","last_active":"2024-09-13T18:41:51.760334+0000","last_peered":"2024-09-13T18:41:51.760334+0000","last_clean":"2024-09-13T18:41:51.760334+0000","last_became_active":"2024-09-13T18:41:50.354344+0000","last_became_peered":"2024-09-13T18:41:50.354344+0000","last_unstale":"2024-09-13T18:41:51.760334+0000","last_undegraded":"2024-09-13T18:41:51.760334+0000","last_fullsized":"2024-09-13T18:41:51.760334+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.751837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061137+0000","last_change":"2024-09-13T18:41:50.772377+0000","last_active":"2024-09-13T18:41:53.061137+0000","last_peered":"2024-09-13T18:41:53.061137+0000","last_clean":"2024-09-13T18:41:53.061137+0000","last_became_active":"2024-09-13T18:41:50.772090+0000","last_became_peered":"2024-09-13T18:41:50.772090+0000","last_unstale":"2024-09-13T18:41:53.061137+0000","last_undegraded":"2024-09-13T18:41:53.061137+0000","last_fullsized":"2024-09-13T18:41:53.061137+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"133'6","reported_seq":17,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601292+0000","last_change":"2024-09-13T18:41:50.361848+0000","last_active":"2024-09-13T18:41:52.601292+0000","last_peered":"2024-09-13T18:41:52.601292+0000","last_clean":"2024-09-13T18:41:52.601292+0000","last_became_active":"2024-09-13T18:41:50.361720+0000","last_became_peered":"2024-09-13T18:41:50.361720+0000","last_unstale":"2024-09-13T18:41:52.601292+0000","last_undegraded":"2024-09-13T18:41:52.601292+0000","last_fullsized":"2024-09-13T18:41:52.601292+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.135119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602280+0000","last_change":"2024-09-13T18:41:50.775233+0000","last_active":"2024-09-13T18:41:52.602280+0000","last_peered":"2024-09-13T18:41:52.602280+0000","last_clean":"2024-09-13T18:41:52.602280+0000","last_became_active":"2024-09-13T18:41:50.768569+0000","last_became_peered":"2024-09-13T18:41:50.768569+0000","last_unstale":"2024-09-13T18:41:52.602280+0000","last_undegraded":"2024-09-13T18:41:52.602280+0000","last_fullsized":"2024-09-13T18:41:52.602280+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:11.648191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"133'2","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.779820+0000","last_change":"2024-09-13T18:41:50.357872+0000","last_active":"2024-09-13T18:41:50.779820+0000","last_peered":"2024-09-13T18:41:50.779820+0000","last_clean":"2024-09-13T18:41:50.779820+0000","last_became_active":"2024-09-13T18:41:50.357644+0000","last_became_peered":"2024-09-13T18:41:50.357644+0000","last_unstale":"2024-09-13T18:41:50.779820+0000","last_undegraded":"2024-09-13T18:41:50.779820+0000","last_fullsized":"2024-09-13T18:41:50.779820+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:32.743137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602288+0000","last_change":"2024-09-13T18:41:50.771788+0000","last_active":"2024-09-13T18:41:52.602288+0000","last_peered":"2024-09-13T18:41:52.602288+0000","last_clean":"2024-09-13T18:41:52.602288+0000","last_became_active":"2024-09-13T18:41:50.770762+0000","last_became_peered":"2024-09-13T18:41:50.770762+0000","last_unstale":"2024-09-13T18:41:52.602288+0000","last_undegraded":"2024-09-13T18:41:52.602288+0000","last_fullsized":"2024-09-13T18:41:52.602288+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602479+0000","last_change":"2024-09-13T18:41:50.355476+0000","last_active":"2024-09-13T18:41:52.602479+0000","last_peered":"2024-09-13T18:41:52.602479+0000","last_clean":"2024-09-13T18:41:52.602479+0000","last_became_active":"2024-09-13T18:41:50.354629+0000","last_became_peered":"2024-09-13T18:41:50.354629+0000","last_unstale":"2024-09-13T18:41:52.602479+0000","last_undegraded":"2024-09-13T18:41:52.602479+0000","last_fullsized":"2024-09-13T18:41:52.602479+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:53.591220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760247+0000","last_change":"2024-09-13T18:41:50.766909+0000","last_active":"2024-09-13T18:41:51.760247+0000","last_peered":"2024-09-13T18:41:51.760247+0000","last_clean":"2024-09-13T18:41:51.760247+0000","last_became_active":"2024-09-13T18:41:50.766681+0000","last_became_peered":"2024-09-13T18:41:50.766681+0000","last_unstale":"2024-09-13T18:41:51.760247+0000","last_undegraded":"2024-09-13T18:41:51.760247+0000","last_fullsized":"2024-09-13T18:41:51.760247+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:29.463204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601492+0000","last_change":"2024-09-13T18:41:50.352864+0000","last_active":"2024-09-13T18:41:52.601492+0000","last_peered":"2024-09-13T18:41:52.601492+0000","last_clean":"2024-09-13T18:41:52.601492+0000","last_became_active":"2024-09-13T18:41:50.352518+0000","last_became_peered":"2024-09-13T18:41:50.352518+0000","last_unstale":"2024-09-13T18:41:52.601492+0000","last_undegraded":"2024-09-13T18:41:52.601492+0000","last_fullsized":"2024-09-13T18:41:52.601492+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:10.514643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601941+0000","last_change":"2024-09-13T18:41:50.766624+0000","last_active":"2024-09-13T18:41:52.601941+0000","last_peered":"2024-09-13T18:41:52.601941+0000","last_clean":"2024-09-13T18:41:52.601941+0000","last_became_active":"2024-09-13T18:41:50.763217+0000","last_became_peered":"2024-09-13T18:41:50.763217+0000","last_unstale":"2024-09-13T18:41:52.601941+0000","last_undegraded":"2024-09-13T18:41:52.601941+0000","last_fullsized":"2024-09-13T18:41:52.601941+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:28.759849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"133'8","reported_seq":19,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601998+0000","last_change":"2024-09-13T18:41:50.357877+0000","last_active":"2024-09-13T18:41:52.601998+0000","last_peered":"2024-09-13T18:41:52.601998+0000","last_clean":"2024-09-13T18:41:52.601998+0000","last_became_active":"2024-09-13T18:41:50.357655+0000","last_became_peered":"2024-09-13T18:41:50.357655+0000","last_unstale":"2024-09-13T18:41:52.601998+0000","last_undegraded":"2024-09-13T18:41:52.601998+0000","last_fullsized":"2024-09-13T18:41:52.601998+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:41.290958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060992+0000","last_change":"2024-09-13T18:41:50.765598+0000","last_active":"2024-09-13T18:41:53.060992+0000","last_peered":"2024-09-13T18:41:53.060992+0000","last_clean":"2024-09-13T18:41:53.060992+0000","last_became_active":"2024-09-13T18:41:50.765368+0000","last_became_peered":"2024-09-13T18:41:50.765368+0000","last_unstale":"2024-09-13T18:41:53.060992+0000","last_undegraded":"2024-09-13T18:41:53.060992+0000","last_fullsized":"2024-09-13T18:41:53.060992+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601431+0000","last_change":"2024-09-13T18:41:50.361238+0000","last_active":"2024-09-13T18:41:52.601431+0000","last_peered":"2024-09-13T18:41:52.601431+0000","last_clean":"2024-09-13T18:41:52.601431+0000","last_became_active":"2024-09-13T18:41:50.360988+0000","last_became_peered":"2024-09-13T18:41:50.360988+0000","last_unstale":"2024-09-13T18:41:52.601431+0000","last_undegraded":"2024-09-13T18:41:52.601431+0000","last_fullsized":"2024-09-13T18:41:52.601431+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:37.773042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061295+0000","last_change":"2024-09-13T18:41:50.765813+0000","last_active":"2024-09-13T18:41:53.061295+0000","last_peered":"2024-09-13T18:41:53.061295+0000","last_clean":"2024-09-13T18:41:53.061295+0000","last_became_active":"2024-09-13T18:41:50.765310+0000","last_became_peered":"2024-09-13T18:41:50.765310+0000","last_unstale":"2024-09-13T18:41:53.061295+0000","last_undegraded":"2024-09-13T18:41:53.061295+0000","last_fullsized":"2024-09-13T18:41:53.061295+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:09.174087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760761+0000","last_change":"2024-09-13T18:41:50.355207+0000","last_active":"2024-09-13T18:41:51.760761+0000","last_peered":"2024-09-13T18:41:51.760761+0000","last_clean":"2024-09-13T18:41:51.760761+0000","last_became_active":"2024-09-13T18:41:50.354615+0000","last_became_peered":"2024-09-13T18:41:50.354615+0000","last_unstale":"2024-09-13T18:41:51.760761+0000","last_undegraded":"2024-09-13T18:41:51.760761+0000","last_fullsized":"2024-09-13T18:41:51.760761+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:09.017807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601322+0000","last_change":"2024-09-13T18:41:50.767175+0000","last_active":"2024-09-13T18:41:52.601322+0000","last_peered":"2024-09-13T18:41:52.601322+0000","last_clean":"2024-09-13T18:41:52.601322+0000","last_became_active":"2024-09-13T18:41:50.766951+0000","last_became_peered":"2024-09-13T18:41:50.766951+0000","last_unstale":"2024-09-13T18:41:52.601322+0000","last_undegraded":"2024-09-13T18:41:52.601322+0000","last_fullsized":"2024-09-13T18:41:52.601322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:54.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.770701+0000","last_change":"2024-09-13T18:41:50.357930+0000","last_active":"2024-09-13T18:41:50.770701+0000","last_peered":"2024-09-13T18:41:50.770701+0000","last_clean":"2024-09-13T18:41:50.770701+0000","last_became_active":"2024-09-13T18:41:50.357696+0000","last_became_peered":"2024-09-13T18:41:50.357696+0000","last_unstale":"2024-09-13T18:41:50.770701+0000","last_undegraded":"2024-09-13T18:41:50.770701+0000","last_fullsized":"2024-09-13T18:41:50.770701+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.794214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061664+0000","last_change":"2024-09-13T18:41:50.772491+0000","last_active":"2024-09-13T18:41:53.061664+0000","last_peered":"2024-09-13T18:41:53.061664+0000","last_clean":"2024-09-13T18:41:53.061664+0000","last_became_active":"2024-09-13T18:41:50.772242+0000","last_became_peered":"2024-09-13T18:41:50.772242+0000","last_unstale":"2024-09-13T18:41:53.061664+0000","last_undegraded":"2024-09-13T18:41:53.061664+0000","last_fullsized":"2024-09-13T18:41:53.061664+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:24.071119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602131+0000","last_change":"2024-09-13T18:41:50.355633+0000","last_active":"2024-09-13T18:41:52.602131+0000","last_peered":"2024-09-13T18:41:52.602131+0000","last_clean":"2024-09-13T18:41:52.602131+0000","last_became_active":"2024-09-13T18:41:50.355381+0000","last_became_peered":"2024-09-13T18:41:50.355381+0000","last_unstale":"2024-09-13T18:41:52.602131+0000","last_undegraded":"2024-09-13T18:41:52.602131+0000","last_fullsized":"2024-09-13T18:41:52.602131+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:16.031518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061399+0000","last_change":"2024-09-13T18:41:50.780314+0000","last_active":"2024-09-13T18:41:53.061399+0000","last_peered":"2024-09-13T18:41:53.061399+0000","last_clean":"2024-09-13T18:41:53.061399+0000","last_became_active":"2024-09-13T18:41:50.780011+0000","last_became_peered":"2024-09-13T18:41:50.780011+0000","last_unstale":"2024-09-13T18:41:53.061399+0000","last_undegraded":"2024-09-13T18:41:53.061399+0000","last_fullsized":"2024-09-13T18:41:53.061399+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:39.796414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061067+0000","last_change":"2024-09-13T18:41:50.347888+0000","last_active":"2024-09-13T18:41:53.061067+0000","last_peered":"2024-09-13T18:41:53.061067+0000","last_clean":"2024-09-13T18:41:53.061067+0000","last_became_active":"2024-09-13T18:41:50.347639+0000","last_became_peered":"2024-09-13T18:41:50.347639+0000","last_unstale":"2024-09-13T18:41:53.061067+0000","last_undegraded":"2024-09-13T18:41:53.061067+0000","last_fullsized":"2024-09-13T18:41:53.061067+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:03.536893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602371+0000","last_change":"2024-09-13T18:41:50.773503+0000","last_active":"2024-09-13T18:41:52.602371+0000","last_peered":"2024-09-13T18:41:52.602371+0000","last_clean":"2024-09-13T18:41:52.602371+0000","last_became_active":"2024-09-13T18:41:50.768227+0000","last_became_peered":"2024-09-13T18:41:50.768227+0000","last_unstale":"2024-09-13T18:41:52.602371+0000","last_undegraded":"2024-09-13T18:41:52.602371+0000","last_fullsized":"2024-09-13T18:41:52.602371+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:15.918374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761284+0000","last_change":"2024-09-13T18:41:50.350321+0000","last_active":"2024-09-13T18:41:51.761284+0000","last_peered":"2024-09-13T18:41:51.761284+0000","last_clean":"2024-09-13T18:41:51.761284+0000","last_became_active":"2024-09-13T18:41:50.349727+0000","last_became_peered":"2024-09-13T18:41:50.349727+0000","last_unstale":"2024-09-13T18:41:51.761284+0000","last_undegraded":"2024-09-13T18:41:51.761284+0000","last_fullsized":"2024-09-13T18:41:51.761284+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:06.562886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060897+0000","last_change":"2024-09-13T18:41:50.770379+0000","last_active":"2024-09-13T18:41:53.060897+0000","last_peered":"2024-09-13T18:41:53.060897+0000","last_clean":"2024-09-13T18:41:53.060897+0000","last_became_active":"2024-09-13T18:41:50.770178+0000","last_became_peered":"2024-09-13T18:41:50.770178+0000","last_unstale":"2024-09-13T18:41:53.060897+0000","last_undegraded":"2024-09-13T18:41:53.060897+0000","last_fullsized":"2024-09-13T18:41:53.060897+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:02.569298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602106+0000","last_change":"2024-09-13T18:41:50.359307+0000","last_active":"2024-09-13T18:41:52.602106+0000","last_peered":"2024-09-13T18:41:52.602106+0000","last_clean":"2024-09-13T18:41:52.602106+0000","last_became_active":"2024-09-13T18:41:50.359064+0000","last_became_peered":"2024-09-13T18:41:50.359064+0000","last_unstale":"2024-09-13T18:41:52.602106+0000","last_undegraded":"2024-09-13T18:41:52.602106+0000","last_fullsized":"2024-09-13T18:41:52.602106+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:53.006801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061503+0000","last_change":"2024-09-13T18:41:50.777268+0000","last_active":"2024-09-13T18:41:53.061503+0000","last_peered":"2024-09-13T18:41:53.061503+0000","last_clean":"2024-09-13T18:41:53.061503+0000","last_became_active":"2024-09-13T18:41:50.775649+0000","last_became_peered":"2024-09-13T18:41:50.775649+0000","last_unstale":"2024-09-13T18:41:53.061503+0000","last_undegraded":"2024-09-13T18:41:53.061503+0000","last_fullsized":"2024-09-13T18:41:53.061503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:52.908292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601562+0000","last_change":"2024-09-13T18:41:50.352732+0000","last_active":"2024-09-13T18:41:52.601562+0000","last_peered":"2024-09-13T18:41:52.601562+0000","last_clean":"2024-09-13T18:41:52.601562+0000","last_became_active":"2024-09-13T18:41:50.352238+0000","last_became_peered":"2024-09-13T18:41:50.352238+0000","last_unstale":"2024-09-13T18:41:52.601562+0000","last_undegraded":"2024-09-13T18:41:52.601562+0000","last_fullsized":"2024-09-13T18:41:52.601562+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:35.397676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061594+0000","last_change":"2024-09-13T18:41:50.778095+0000","last_active":"2024-09-13T18:41:53.061594+0000","last_peered":"2024-09-13T18:41:53.061594+0000","last_clean":"2024-09-13T18:41:53.061594+0000","last_became_active":"2024-09-13T18:41:50.777863+0000","last_became_peered":"2024-09-13T18:41:50.777863+0000","last_unstale":"2024-09-13T18:41:53.061594+0000","last_undegraded":"2024-09-13T18:41:53.061594+0000","last_fullsized":"2024-09-13T18:41:53.061594+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:34.813525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.763507+0000","last_change":"2024-09-13T18:41:50.359388+0000","last_active":"2024-09-13T18:41:50.763507+0000","last_peered":"2024-09-13T18:41:50.763507+0000","last_clean":"2024-09-13T18:41:50.763507+0000","last_became_active":"2024-09-13T18:41:50.359156+0000","last_became_peered":"2024-09-13T18:41:50.359156+0000","last_unstale":"2024-09-13T18:41:50.763507+0000","last_undegraded":"2024-09-13T18:41:50.763507+0000","last_fullsized":"2024-09-13T18:41:50.763507+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:27.752658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602470+0000","last_change":"2024-09-13T18:41:50.768541+0000","last_active":"2024-09-13T18:41:52.602470+0000","last_peered":"2024-09-13T18:41:52.602470+0000","last_clean":"2024-09-13T18:41:52.602470+0000","last_became_active":"2024-09-13T18:41:50.768240+0000","last_became_peered":"2024-09-13T18:41:50.768240+0000","last_unstale":"2024-09-13T18:41:52.602470+0000","last_undegraded":"2024-09-13T18:41:52.602470+0000","last_fullsized":"2024-09-13T18:41:52.602470+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.766660+0000","last_change":"2024-09-13T18:41:50.358155+0000","last_active":"2024-09-13T18:41:50.766660+0000","last_peered":"2024-09-13T18:41:50.766660+0000","last_clean":"2024-09-13T18:41:50.766660+0000","last_became_active":"2024-09-13T18:41:50.357307+0000","last_became_peered":"2024-09-13T18:41:50.357307+0000","last_unstale":"2024-09-13T18:41:50.766660+0000","last_undegraded":"2024-09-13T18:41:50.766660+0000","last_fullsized":"2024-09-13T18:41:50.766660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:34.855460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760494+0000","last_change":"2024-09-13T18:41:50.758317+0000","last_active":"2024-09-13T18:41:51.760494+0000","last_peered":"2024-09-13T18:41:51.760494+0000","last_clean":"2024-09-13T18:41:51.760494+0000","last_became_active":"2024-09-13T18:41:50.758080+0000","last_became_peered":"2024-09-13T18:41:50.758080+0000","last_unstale":"2024-09-13T18:41:51.760494+0000","last_undegraded":"2024-09-13T18:41:51.760494+0000","last_fullsized":"2024-09-13T18:41:51.760494+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:37.614664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060953+0000","last_change":"2024-09-13T18:41:50.355279+0000","last_active":"2024-09-13T18:41:53.060953+0000","last_peered":"2024-09-13T18:41:53.060953+0000","last_clean":"2024-09-13T18:41:53.060953+0000","last_became_active":"2024-09-13T18:41:50.355043+0000","last_became_peered":"2024-09-13T18:41:50.355043+0000","last_unstale":"2024-09-13T18:41:53.060953+0000","last_undegraded":"2024-09-13T18:41:53.060953+0000","last_fullsized":"2024-09-13T18:41:53.060953+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:30.943529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061695+0000","last_change":"2024-09-13T18:41:50.776962+0000","last_active":"2024-09-13T18:41:53.061695+0000","last_peered":"2024-09-13T18:41:53.061695+0000","last_clean":"2024-09-13T18:41:53.061695+0000","last_became_active":"2024-09-13T18:41:50.776618+0000","last_became_peered":"2024-09-13T18:41:50.776618+0000","last_unstale":"2024-09-13T18:41:53.061695+0000","last_undegraded":"2024-09-13T18:41:53.061695+0000","last_fullsized":"2024-09-13T18:41:53.061695+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:16.432162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602212+0000","last_change":"2024-09-13T18:41:50.355838+0000","last_active":"2024-09-13T18:41:52.602212+0000","last_peered":"2024-09-13T18:41:52.602212+0000","last_clean":"2024-09-13T18:41:52.602212+0000","last_became_active":"2024-09-13T18:41:50.353111+0000","last_became_peered":"2024-09-13T18:41:50.353111+0000","last_unstale":"2024-09-13T18:41:52.602212+0000","last_undegraded":"2024-09-13T18:41:52.602212+0000","last_fullsized":"2024-09-13T18:41:52.602212+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:31.743940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760681+0000","last_change":"2024-09-13T18:41:50.761907+0000","last_active":"2024-09-13T18:41:51.760681+0000","last_peered":"2024-09-13T18:41:51.760681+0000","last_clean":"2024-09-13T18:41:51.760681+0000","last_became_active":"2024-09-13T18:41:50.761680+0000","last_became_peered":"2024-09-13T18:41:50.761680+0000","last_unstale":"2024-09-13T18:41:51.760681+0000","last_undegraded":"2024-09-13T18:41:51.760681+0000","last_fullsized":"2024-09-13T18:41:51.760681+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:20.730659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061364+0000","last_change":"2024-09-13T18:41:50.359283+0000","last_active":"2024-09-13T18:41:53.061364+0000","last_peered":"2024-09-13T18:41:53.061364+0000","last_clean":"2024-09-13T18:41:53.061364+0000","last_became_active":"2024-09-13T18:41:50.359049+0000","last_became_peered":"2024-09-13T18:41:50.359049+0000","last_unstale":"2024-09-13T18:41:53.061364+0000","last_undegraded":"2024-09-13T18:41:53.061364+0000","last_fullsized":"2024-09-13T18:41:53.061364+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:26.381575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061726+0000","last_change":"2024-09-13T18:41:50.771800+0000","last_active":"2024-09-13T18:41:53.061726+0000","last_peered":"2024-09-13T18:41:53.061726+0000","last_clean":"2024-09-13T18:41:53.061726+0000","last_became_active":"2024-09-13T18:41:50.771452+0000","last_became_peered":"2024-09-13T18:41:50.771452+0000","last_unstale":"2024-09-13T18:41:53.061726+0000","last_undegraded":"2024-09-13T18:41:53.061726+0000","last_fullsized":"2024-09-13T18:41:53.061726+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:15.655961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760273+0000","last_change":"2024-09-13T18:41:50.358445+0000","last_active":"2024-09-13T18:41:51.760273+0000","last_peered":"2024-09-13T18:41:51.760273+0000","last_clean":"2024-09-13T18:41:51.760273+0000","last_became_active":"2024-09-13T18:41:50.358184+0000","last_became_peered":"2024-09-13T18:41:50.358184+0000","last_unstale":"2024-09-13T18:41:51.760273+0000","last_undegraded":"2024-09-13T18:41:51.760273+0000","last_fullsized":"2024-09-13T18:41:51.760273+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:49.129244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601470+0000","last_change":"2024-09-13T18:41:50.769319+0000","last_active":"2024-09-13T18:41:52.601470+0000","last_peered":"2024-09-13T18:41:52.601470+0000","last_clean":"2024-09-13T18:41:52.601470+0000","last_became_active":"2024-09-13T18:41:50.769111+0000","last_became_peered":"2024-09-13T18:41:50.769111+0000","last_unstale":"2024-09-13T18:41:52.601470+0000","last_undegraded":"2024-09-13T18:41:52.601470+0000","last_fullsized":"2024-09-13T18:41:52.601470+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:24.390519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602375+0000","last_change":"2024-09-13T18:41:50.359748+0000","last_active":"2024-09-13T18:41:52.602375+0000","last_peered":"2024-09-13T18:41:52.602375+0000","last_clean":"2024-09-13T18:41:52.602375+0000","last_became_active":"2024-09-13T18:41:50.359479+0000","last_became_peered":"2024-09-13T18:41:50.359479+0000","last_unstale":"2024-09-13T18:41:52.602375+0000","last_undegraded":"2024-09-13T18:41:52.602375+0000","last_fullsized":"2024-09-13T18:41:52.602375+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:33.601401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602385+0000","last_change":"2024-09-13T18:41:50.776283+0000","last_active":"2024-09-13T18:41:52.602385+0000","last_peered":"2024-09-13T18:41:52.602385+0000","last_clean":"2024-09-13T18:41:52.602385+0000","last_became_active":"2024-09-13T18:41:50.776056+0000","last_became_peered":"2024-09-13T18:41:50.776056+0000","last_unstale":"2024-09-13T18:41:52.602385+0000","last_undegraded":"2024-09-13T18:41:52.602385+0000","last_fullsized":"2024-09-13T18:41:52.602385+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:15.918374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601407+0000","last_change":"2024-09-13T18:41:50.359439+0000","last_active":"2024-09-13T18:41:52.601407+0000","last_peered":"2024-09-13T18:41:52.601407+0000","last_clean":"2024-09-13T18:41:52.601407+0000","last_became_active":"2024-09-13T18:41:50.359261+0000","last_became_peered":"2024-09-13T18:41:50.359261+0000","last_unstale":"2024-09-13T18:41:52.601407+0000","last_undegraded":"2024-09-13T18:41:52.601407+0000","last_fullsized":"2024-09-13T18:41:52.601407+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:11.427009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.763370+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:41:50.763370+0000","last_peered":"2024-09-13T18:41:50.763370+0000","last_clean":"2024-09-13T18:41:50.763370+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:41:50.763370+0000","last_undegraded":"2024-09-13T18:41:50.763370+0000","last_fullsized":"2024-09-13T18:41:50.763370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542225,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194008,"statfs":{"total":200000000,"available":198664231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.313},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.34599999999999997},"max":{"1min":0.89200000000000002,"5min":1.014,"15min":1.014},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.64800000000000002},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84399999999999997,"5min":0.90500000000000003,"15min":0.94499999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77300000000000002,"5min":0.999,"15min":0.999},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.84199999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.47499999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":1.0189999999999999,"15min":6.0890000000000004},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.88800000000000001,"5min":1.036,"15min":1.036},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91800000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85999999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":1.101,"15min":1.371},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67100000000000004},"min":{"1min":0.53600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94399999999999995,"5min":1.143,"15min":1.143},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99399999999999999,"5min":1.125,"15min":1.125},"last":0.78400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199255637,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70099999999999996,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93300000000000005,"5min":1.665,"15min":1.665},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.64800000000000002},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85099999999999998,"5min":1.591,"15min":1.591},"last":0.502}]},{"osd":2,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.439},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":2.169,"15min":2.169},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97199999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92800000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.51900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.748},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194586,"statfs":{"total":200000000,"available":199256219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69999999999999996,"15min":0.82399999999999995},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92800000000000005,"5min":1.696,"15min":6.4539999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.999,"15min":0.999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.84299999999999997},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.82699999999999996},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94099999999999995,"5min":1.032,"15min":1.032},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.879},"min":{"1min":0.53000000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.81999999999999995},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":1.004,"15min":6.2039999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.403,"15min":1.403},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97199999999999998,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199255637,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.70699999999999996,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73499999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":3.706,"15min":3.706},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.68400000000000005},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84099999999999997,"5min":3.742,"15min":3.742},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75700000000000001,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88100000000000001,"5min":1.552,"15min":1.552},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.90500000000000003,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.73199999999999998},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92800000000000005,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.55200000000000005,"5min":0.45800000000000002,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.89200000000000002,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.69299999999999995},"min":{"1min":0.57299999999999995,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":0.95799999999999996,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199256025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.54100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.754},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":8.1059999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57899999999999996,"5min":0.77800000000000002,"15min":4.7919999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.5,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.95399999999999996,"15min":7.798},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0800000000000001,"15min":3.093},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.01,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":1.1519999999999999,"15min":3.0299999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91200000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.98299999999999998},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.51800000000000002},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.91300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82499999999999996,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.71299999999999997},"min":{"1min":0.55200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.206,"15min":1.206},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96999999999999997,"5min":1.218,"15min":2.9900000000000002},"last":0.96999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262449,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70799999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.435,"5min":0.442,"15min":0.47999999999999998},"min":{"1min":0.34999999999999998,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.50900000000000001},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.435,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.7030000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89300000000000002,"5min":1.075,"15min":1.1830000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72099999999999997,"15min":0.70099999999999996},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.02},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.079,"15min":1.079},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84999999999999998,"5min":1.0409999999999999,"15min":1.1850000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":1.097,"15min":1.1419999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.77200000000000002},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.96499999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194007,"statfs":{"total":200000000,"available":198664175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":1.036,"15min":1.036},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52400000000000002,"15min":0.47999999999999998},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56299999999999994,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80600000000000005,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.54200000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.242,"15min":1.242},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.53200000000000003},"max":{"1min":1.0509999999999999,"5min":1.21,"15min":1.21},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.81200000000000006,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96799999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":1.149,"15min":1.1539999999999999},"last":0.91000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194586,"statfs":{"total":200000000,"available":199256219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.436,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":1.669},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.27800000000000002,"15min":0.24099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.874},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.67500000000000004,"5min":0.76600000000000001,"15min":1.591},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.85899999999999999,"15min":1.637},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":1.2,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.698},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.74099999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":1.204,"15min":1.204},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.085,"5min":1.121,"15min":2.2589999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.044,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.79500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:41:54.921 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:41:55.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.106+0000 7fefa0400640 1 Processor -- start 2024-09-13T18:41:55.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.106+0000 7fefa0400640 1 -- start start 2024-09-13T18:41:55.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fefa0400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fef980b3f10 0x7fef9815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fefa0400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef980b0490 0x7fef9815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fefa0400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef980b2f00 con 0x7fef9815dee0 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fefa0400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9815aec0 con 0x7fef980b0490 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fefa0400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef980b3150 con 0x7fef980b3f10 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9da00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fef9815dee0 0x7fef980afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60680/0 (socket says 172.21.15.192:60680) 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9da00640 1 -- 172.21.15.192:0/3819490524 learned_addr learned my addr 172.21.15.192:0/3819490524 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9e400640 1 --2- 172.21.15.192:0/3819490524 >> v2:172.21.15.192:3300/0 conn(0x7fef980b0490 0x7fef9815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9d000640 1 --2- 172.21.15.192:0/3819490524 >> v2:172.21.15.194:3300/0 conn(0x7fef980b3f10 0x7fef9815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef97e00640 1 -- 172.21.15.192:0/3819490524 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290758866 0 0) 0x7fef980b2f00 con 0x7fef9815dee0 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef97e00640 1 -- 172.21.15.192:0/3819490524 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef80003520 con 0x7fef9815dee0 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9e400640 1 -- 172.21.15.192:0/3819490524 >> v2:172.21.15.194:3300/0 conn(0x7fef980b3f10 msgr2=0x7fef9815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9e400640 1 --2- 172.21.15.192:0/3819490524 >> v2:172.21.15.194:3300/0 conn(0x7fef980b3f10 0x7fef9815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9e400640 1 -- 172.21.15.192:0/3819490524 >> v1:172.21.15.192:6789/0 conn(0x7fef9815dee0 legacy=0x7fef980afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.108+0000 7fef9e400640 1 -- 172.21.15.192:0/3819490524 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef980b3430 con 0x7fef980b0490 2024-09-13T18:41:55.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.109+0000 7fef9e400640 1 --2- 172.21.15.192:0/3819490524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef980b0490 0x7fef9815a980 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fef980b4700 tx=0x7fef9002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a0f90c55fccdb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fef97e00640 1 -- 172.21.15.192:0/3819490524 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9002aea0 con 0x7fef980b0490 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fef97e00640 1 -- 172.21.15.192:0/3819490524 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9002d050 con 0x7fef980b0490 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fef97e00640 1 -- 172.21.15.192:0/3819490524 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90007960 con 0x7fef980b0490 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 -- 172.21.15.192:0/3819490524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef980b0490 msgr2=0x7fef9815a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 --2- 172.21.15.192:0/3819490524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef980b0490 0x7fef9815a980 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fef980b4700 tx=0x7fef9002a680 comp rx=0 tx=0).stop 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 -- 172.21.15.192:0/3819490524 shutdown_connections 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 --2- 172.21.15.192:0/3819490524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef980b0490 0x7fef9815a980 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 --2- 172.21.15.192:0/3819490524 >> v2:172.21.15.194:3300/0 conn(0x7fef980b3f10 0x7fef9815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 -- 172.21.15.192:0/3819490524 >> 172.21.15.192:0/3819490524 conn(0x7fef980ae960 msgr2=0x7fef9806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:55.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 -- 172.21.15.192:0/3819490524 shutdown_connections 2024-09-13T18:41:55.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.110+0000 7fefa0400640 1 -- 172.21.15.192:0/3819490524 wait complete. 2024-09-13T18:41:55.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.112+0000 7fefa0400640 1 Processor -- start 2024-09-13T18:41:55.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.112+0000 7fefa0400640 1 -- start start 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef980b0490 0x7fef98138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9815dee0 0x7fef9815c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9815d140 con 0x7fef9815ccd0 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef981f3f10 con 0x7fef980b0490 2024-09-13T18:41:55.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fefa0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef981f4330 con 0x7fef9815dee0 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fef9e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fef9e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37254/0 (socket says 172.21.15.192:37254) 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fef9e400640 1 -- 172.21.15.192:0/1971843409 learned_addr learned my addr 172.21.15.192:0/1971843409 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.113+0000 7fef9da00640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef980b0490 0x7fef98138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9d000640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9815dee0 0x7fef9815c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 -- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9815dee0 msgr2=0x7fef9815c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9815dee0 0x7fef9815c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 -- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef980b0490 msgr2=0x7fef98138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef980b0490 0x7fef98138850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 -- 172.21.15.192:0/1971843409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90009a70 con 0x7fef9815ccd0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef9e400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fef9002ac70 tx=0x7fef90004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.114+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9003c830 con 0x7fef9815ccd0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.115+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef9003c990 con 0x7fef9815ccd0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.115+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef9003cd00 con 0x7fef9815ccd0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.115+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef981f3c30 con 0x7fef9815ccd0 2024-09-13T18:41:55.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.115+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef981f48b0 con 0x7fef9815ccd0 2024-09-13T18:41:55.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.116+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9806ee50 con 0x7fef9815ccd0 2024-09-13T18:41:55.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.117+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef90031400 con 0x7fef9815ccd0 2024-09-13T18:41:55.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.117+0000 7fef95600640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 0x7fef7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.118+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef900aad80 con 0x7fef9815ccd0 2024-09-13T18:41:55.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.118+0000 7fef9da00640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 0x7fef7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.118+0000 7fef9da00640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 0x7fef7806d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0011e0 tx=0x7fef8c007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.121+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef90075f80 con 0x7fef9815ccd0 2024-09-13T18:41:55.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.288+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fef980b39f0 con 0x7fef7806ac00 2024-09-13T18:41:55.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.295+0000 7fef95600640 1 -- 172.21.15.192:0/1971843409 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285311 (secure 0 0 0) 0x7fef8c005850 con 0x7fef7806ac00 2024-09-13T18:41:55.304 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:55.306 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:41:55.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 msgr2=0x7fef7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 0x7fef7806d0c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0011e0 tx=0x7fef8c007d30 comp rx=0 tx=0).stop 2024-09-13T18:41:55.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 msgr2=0x7fef981f2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fef9002ac70 tx=0x7fef90004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 shutdown_connections 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef7806ac00 0x7fef7806d0c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef9815ccd0 0x7fef981f2ee0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef9815dee0 0x7fef9815c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 --2- 172.21.15.192:0/1971843409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef980b0490 0x7fef98138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 >> 172.21.15.192:0/1971843409 conn(0x7fef980ae960 msgr2=0x7fef9806ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 shutdown_connections 2024-09-13T18:41:55.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.299+0000 7fefa0400640 1 -- 172.21.15.192:0/1971843409 wait complete. 2024-09-13T18:41:55.318 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2024-09-13T18:41:54.816519+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6962,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555537,"statfs":{"total":1600000000,"available":1592870592,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.482211"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602091+0000","last_change":"2024-09-13T18:41:50.775388+0000","last_active":"2024-09-13T18:41:52.602091+0000","last_peered":"2024-09-13T18:41:52.602091+0000","last_clean":"2024-09-13T18:41:52.602091+0000","last_became_active":"2024-09-13T18:41:50.773097+0000","last_became_peered":"2024-09-13T18:41:50.773097+0000","last_unstale":"2024-09-13T18:41:52.602091+0000","last_undegraded":"2024-09-13T18:41:52.602091+0000","last_fullsized":"2024-09-13T18:41:52.602091+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:28.759849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601708+0000","last_change":"2024-09-13T18:41:50.769357+0000","last_active":"2024-09-13T18:41:52.601708+0000","last_peered":"2024-09-13T18:41:52.601708+0000","last_clean":"2024-09-13T18:41:52.601708+0000","last_became_active":"2024-09-13T18:41:50.769096+0000","last_became_peered":"2024-09-13T18:41:50.769096+0000","last_unstale":"2024-09-13T18:41:52.601708+0000","last_undegraded":"2024-09-13T18:41:52.601708+0000","last_fullsized":"2024-09-13T18:41:52.601708+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602509+0000","last_change":"2024-09-13T18:41:50.767999+0000","last_active":"2024-09-13T18:41:52.602509+0000","last_peered":"2024-09-13T18:41:52.602509+0000","last_clean":"2024-09-13T18:41:52.602509+0000","last_became_active":"2024-09-13T18:41:50.767544+0000","last_became_peered":"2024-09-13T18:41:50.767544+0000","last_unstale":"2024-09-13T18:41:52.602509+0000","last_undegraded":"2024-09-13T18:41:52.602509+0000","last_fullsized":"2024-09-13T18:41:52.602509+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:11.648191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601872+0000","last_change":"2024-09-13T18:41:50.779860+0000","last_active":"2024-09-13T18:41:52.601872+0000","last_peered":"2024-09-13T18:41:52.601872+0000","last_clean":"2024-09-13T18:41:52.601872+0000","last_became_active":"2024-09-13T18:41:50.779445+0000","last_became_peered":"2024-09-13T18:41:50.779445+0000","last_unstale":"2024-09-13T18:41:52.601872+0000","last_undegraded":"2024-09-13T18:41:52.601872+0000","last_fullsized":"2024-09-13T18:41:52.601872+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:09.174087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760276+0000","last_change":"2024-09-13T18:41:50.761227+0000","last_active":"2024-09-13T18:41:51.760276+0000","last_peered":"2024-09-13T18:41:51.760276+0000","last_clean":"2024-09-13T18:41:51.760276+0000","last_became_active":"2024-09-13T18:41:50.760999+0000","last_became_peered":"2024-09-13T18:41:50.760999+0000","last_unstale":"2024-09-13T18:41:51.760276+0000","last_undegraded":"2024-09-13T18:41:51.760276+0000","last_fullsized":"2024-09-13T18:41:51.760276+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:08:28.263678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760491+0000","last_change":"2024-09-13T18:41:50.767070+0000","last_active":"2024-09-13T18:41:51.760491+0000","last_peered":"2024-09-13T18:41:51.760491+0000","last_clean":"2024-09-13T18:41:51.760491+0000","last_became_active":"2024-09-13T18:41:50.766602+0000","last_became_peered":"2024-09-13T18:41:50.766602+0000","last_unstale":"2024-09-13T18:41:51.760491+0000","last_undegraded":"2024-09-13T18:41:51.760491+0000","last_fullsized":"2024-09-13T18:41:51.760491+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:14.060827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760310+0000","last_change":"2024-09-13T18:41:50.758381+0000","last_active":"2024-09-13T18:41:51.760310+0000","last_peered":"2024-09-13T18:41:51.760310+0000","last_clean":"2024-09-13T18:41:51.760310+0000","last_became_active":"2024-09-13T18:41:50.758138+0000","last_became_peered":"2024-09-13T18:41:50.758138+0000","last_unstale":"2024-09-13T18:41:51.760310+0000","last_undegraded":"2024-09-13T18:41:51.760310+0000","last_fullsized":"2024-09-13T18:41:51.760310+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:07:48.630766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602591+0000","last_change":"2024-09-13T18:41:50.767869+0000","last_active":"2024-09-13T18:41:52.602591+0000","last_peered":"2024-09-13T18:41:52.602591+0000","last_clean":"2024-09-13T18:41:52.602591+0000","last_became_active":"2024-09-13T18:41:50.766790+0000","last_became_peered":"2024-09-13T18:41:50.766790+0000","last_unstale":"2024-09-13T18:41:52.602591+0000","last_undegraded":"2024-09-13T18:41:52.602591+0000","last_fullsized":"2024-09-13T18:41:52.602591+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760247+0000","last_change":"2024-09-13T18:41:50.763132+0000","last_active":"2024-09-13T18:41:51.760247+0000","last_peered":"2024-09-13T18:41:51.760247+0000","last_clean":"2024-09-13T18:41:51.760247+0000","last_became_active":"2024-09-13T18:41:50.761140+0000","last_became_peered":"2024-09-13T18:41:50.761140+0000","last_unstale":"2024-09-13T18:41:51.760247+0000","last_undegraded":"2024-09-13T18:41:51.760247+0000","last_fullsized":"2024-09-13T18:41:51.760247+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:42:40.044765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761100+0000","last_change":"2024-09-13T18:41:50.775450+0000","last_active":"2024-09-13T18:41:51.761100+0000","last_peered":"2024-09-13T18:41:51.761100+0000","last_clean":"2024-09-13T18:41:51.761100+0000","last_became_active":"2024-09-13T18:41:50.775235+0000","last_became_peered":"2024-09-13T18:41:50.775235+0000","last_unstale":"2024-09-13T18:41:51.761100+0000","last_undegraded":"2024-09-13T18:41:51.761100+0000","last_fullsized":"2024-09-13T18:41:51.761100+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760566+0000","last_change":"2024-09-13T18:41:50.766859+0000","last_active":"2024-09-13T18:41:51.760566+0000","last_peered":"2024-09-13T18:41:51.760566+0000","last_clean":"2024-09-13T18:41:51.760566+0000","last_became_active":"2024-09-13T18:41:50.766274+0000","last_became_peered":"2024-09-13T18:41:50.766274+0000","last_unstale":"2024-09-13T18:41:51.760566+0000","last_undegraded":"2024-09-13T18:41:51.760566+0000","last_fullsized":"2024-09-13T18:41:51.760566+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:28:46.054537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601401+0000","last_change":"2024-09-13T18:41:50.773493+0000","last_active":"2024-09-13T18:41:52.601401+0000","last_peered":"2024-09-13T18:41:52.601401+0000","last_clean":"2024-09-13T18:41:52.601401+0000","last_became_active":"2024-09-13T18:41:50.773197+0000","last_became_peered":"2024-09-13T18:41:50.773197+0000","last_unstale":"2024-09-13T18:41:52.601401+0000","last_undegraded":"2024-09-13T18:41:52.601401+0000","last_fullsized":"2024-09-13T18:41:52.601401+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:52:20.535040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.759815+0000","last_change":"2024-09-13T18:41:50.765681+0000","last_active":"2024-09-13T18:41:51.759815+0000","last_peered":"2024-09-13T18:41:51.759815+0000","last_clean":"2024-09-13T18:41:51.759815+0000","last_became_active":"2024-09-13T18:41:50.765410+0000","last_became_peered":"2024-09-13T18:41:50.765410+0000","last_unstale":"2024-09-13T18:41:51.759815+0000","last_undegraded":"2024-09-13T18:41:51.759815+0000","last_fullsized":"2024-09-13T18:41:51.759815+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:43:45.636292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602009+0000","last_change":"2024-09-13T18:41:50.774075+0000","last_active":"2024-09-13T18:41:52.602009+0000","last_peered":"2024-09-13T18:41:52.602009+0000","last_clean":"2024-09-13T18:41:52.602009+0000","last_became_active":"2024-09-13T18:41:50.773759+0000","last_became_peered":"2024-09-13T18:41:50.773759+0000","last_unstale":"2024-09-13T18:41:52.602009+0000","last_undegraded":"2024-09-13T18:41:52.602009+0000","last_fullsized":"2024-09-13T18:41:52.602009+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:23.060936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602212+0000","last_change":"2024-09-13T18:41:50.776346+0000","last_active":"2024-09-13T18:41:52.602212+0000","last_peered":"2024-09-13T18:41:52.602212+0000","last_clean":"2024-09-13T18:41:52.602212+0000","last_became_active":"2024-09-13T18:41:50.775491+0000","last_became_peered":"2024-09-13T18:41:50.775491+0000","last_unstale":"2024-09-13T18:41:52.602212+0000","last_undegraded":"2024-09-13T18:41:52.602212+0000","last_fullsized":"2024-09-13T18:41:52.602212+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:01.991158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760636+0000","last_change":"2024-09-13T18:41:50.773040+0000","last_active":"2024-09-13T18:41:51.760636+0000","last_peered":"2024-09-13T18:41:51.760636+0000","last_clean":"2024-09-13T18:41:51.760636+0000","last_became_active":"2024-09-13T18:41:50.772795+0000","last_became_peered":"2024-09-13T18:41:50.772795+0000","last_unstale":"2024-09-13T18:41:51.760636+0000","last_undegraded":"2024-09-13T18:41:51.760636+0000","last_fullsized":"2024-09-13T18:41:51.760636+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:09.770792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061379+0000","last_change":"2024-09-13T18:41:50.777637+0000","last_active":"2024-09-13T18:41:53.061379+0000","last_peered":"2024-09-13T18:41:53.061379+0000","last_clean":"2024-09-13T18:41:53.061379+0000","last_became_active":"2024-09-13T18:41:50.777179+0000","last_became_peered":"2024-09-13T18:41:50.777179+0000","last_unstale":"2024-09-13T18:41:53.061379+0000","last_undegraded":"2024-09-13T18:41:53.061379+0000","last_fullsized":"2024-09-13T18:41:53.061379+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:12:25.584372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601781+0000","last_change":"2024-09-13T18:41:50.777553+0000","last_active":"2024-09-13T18:41:52.601781+0000","last_peered":"2024-09-13T18:41:52.601781+0000","last_clean":"2024-09-13T18:41:52.601781+0000","last_became_active":"2024-09-13T18:41:50.775437+0000","last_became_peered":"2024-09-13T18:41:50.775437+0000","last_unstale":"2024-09-13T18:41:52.601781+0000","last_undegraded":"2024-09-13T18:41:52.601781+0000","last_fullsized":"2024-09-13T18:41:52.601781+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061494+0000","last_change":"2024-09-13T18:41:50.777417+0000","last_active":"2024-09-13T18:41:53.061494+0000","last_peered":"2024-09-13T18:41:53.061494+0000","last_clean":"2024-09-13T18:41:53.061494+0000","last_became_active":"2024-09-13T18:41:50.777162+0000","last_became_peered":"2024-09-13T18:41:50.777162+0000","last_unstale":"2024-09-13T18:41:53.061494+0000","last_undegraded":"2024-09-13T18:41:53.061494+0000","last_fullsized":"2024-09-13T18:41:53.061494+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:42:29.964995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601293+0000","last_change":"2024-09-13T18:41:50.767163+0000","last_active":"2024-09-13T18:41:52.601293+0000","last_peered":"2024-09-13T18:41:52.601293+0000","last_clean":"2024-09-13T18:41:52.601293+0000","last_became_active":"2024-09-13T18:41:50.766938+0000","last_became_peered":"2024-09-13T18:41:50.766938+0000","last_unstale":"2024-09-13T18:41:52.601293+0000","last_undegraded":"2024-09-13T18:41:52.601293+0000","last_fullsized":"2024-09-13T18:41:52.601293+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:25.165007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601751+0000","last_change":"2024-09-13T18:41:50.759354+0000","last_active":"2024-09-13T18:41:52.601751+0000","last_peered":"2024-09-13T18:41:52.601751+0000","last_clean":"2024-09-13T18:41:52.601751+0000","last_became_active":"2024-09-13T18:41:50.758719+0000","last_became_peered":"2024-09-13T18:41:50.758719+0000","last_unstale":"2024-09-13T18:41:52.601751+0000","last_undegraded":"2024-09-13T18:41:52.601751+0000","last_fullsized":"2024-09-13T18:41:52.601751+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:24:16.343962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601843+0000","last_change":"2024-09-13T18:41:50.757878+0000","last_active":"2024-09-13T18:41:52.601843+0000","last_peered":"2024-09-13T18:41:52.601843+0000","last_clean":"2024-09-13T18:41:52.601843+0000","last_became_active":"2024-09-13T18:41:50.757597+0000","last_became_peered":"2024-09-13T18:41:50.757597+0000","last_unstale":"2024-09-13T18:41:52.601843+0000","last_undegraded":"2024-09-13T18:41:52.601843+0000","last_fullsized":"2024-09-13T18:41:52.601843+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:41:01.991158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601907+0000","last_change":"2024-09-13T18:41:50.767395+0000","last_active":"2024-09-13T18:41:52.601907+0000","last_peered":"2024-09-13T18:41:52.601907+0000","last_clean":"2024-09-13T18:41:52.601907+0000","last_became_active":"2024-09-13T18:41:50.767103+0000","last_became_peered":"2024-09-13T18:41:50.767103+0000","last_unstale":"2024-09-13T18:41:52.601907+0000","last_undegraded":"2024-09-13T18:41:52.601907+0000","last_fullsized":"2024-09-13T18:41:52.601907+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060903+0000","last_change":"2024-09-13T18:41:50.774847+0000","last_active":"2024-09-13T18:41:53.060903+0000","last_peered":"2024-09-13T18:41:53.060903+0000","last_clean":"2024-09-13T18:41:53.060903+0000","last_became_active":"2024-09-13T18:41:50.774667+0000","last_became_peered":"2024-09-13T18:41:50.774667+0000","last_unstale":"2024-09-13T18:41:53.060903+0000","last_undegraded":"2024-09-13T18:41:53.060903+0000","last_fullsized":"2024-09-13T18:41:53.060903+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:19.634680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761015+0000","last_change":"2024-09-13T18:41:50.768822+0000","last_active":"2024-09-13T18:41:51.761015+0000","last_peered":"2024-09-13T18:41:51.761015+0000","last_clean":"2024-09-13T18:41:51.761015+0000","last_became_active":"2024-09-13T18:41:50.768565+0000","last_became_peered":"2024-09-13T18:41:50.768565+0000","last_unstale":"2024-09-13T18:41:51.761015+0000","last_undegraded":"2024-09-13T18:41:51.761015+0000","last_fullsized":"2024-09-13T18:41:51.761015+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760164+0000","last_change":"2024-09-13T18:41:50.764799+0000","last_active":"2024-09-13T18:41:51.760164+0000","last_peered":"2024-09-13T18:41:51.760164+0000","last_clean":"2024-09-13T18:41:51.760164+0000","last_became_active":"2024-09-13T18:41:50.764009+0000","last_became_peered":"2024-09-13T18:41:50.764009+0000","last_unstale":"2024-09-13T18:41:51.760164+0000","last_undegraded":"2024-09-13T18:41:51.760164+0000","last_fullsized":"2024-09-13T18:41:51.760164+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:11.521835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061213+0000","last_change":"2024-09-13T18:41:50.765943+0000","last_active":"2024-09-13T18:41:53.061213+0000","last_peered":"2024-09-13T18:41:53.061213+0000","last_clean":"2024-09-13T18:41:53.061213+0000","last_became_active":"2024-09-13T18:41:50.765617+0000","last_became_peered":"2024-09-13T18:41:50.765617+0000","last_unstale":"2024-09-13T18:41:53.061213+0000","last_undegraded":"2024-09-13T18:41:53.061213+0000","last_fullsized":"2024-09-13T18:41:53.061213+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061030+0000","last_change":"2024-09-13T18:41:50.769304+0000","last_active":"2024-09-13T18:41:53.061030+0000","last_peered":"2024-09-13T18:41:53.061030+0000","last_clean":"2024-09-13T18:41:53.061030+0000","last_became_active":"2024-09-13T18:41:50.769100+0000","last_became_peered":"2024-09-13T18:41:50.769100+0000","last_unstale":"2024-09-13T18:41:53.061030+0000","last_undegraded":"2024-09-13T18:41:53.061030+0000","last_fullsized":"2024-09-13T18:41:53.061030+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:21:03.911209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760022+0000","last_change":"2024-09-13T18:41:50.767190+0000","last_active":"2024-09-13T18:41:51.760022+0000","last_peered":"2024-09-13T18:41:51.760022+0000","last_clean":"2024-09-13T18:41:51.760022+0000","last_became_active":"2024-09-13T18:41:50.766370+0000","last_became_peered":"2024-09-13T18:41:50.766370+0000","last_unstale":"2024-09-13T18:41:51.760022+0000","last_undegraded":"2024-09-13T18:41:51.760022+0000","last_fullsized":"2024-09-13T18:41:51.760022+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:36.404867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760213+0000","last_change":"2024-09-13T18:41:50.773664+0000","last_active":"2024-09-13T18:41:51.760213+0000","last_peered":"2024-09-13T18:41:51.760213+0000","last_clean":"2024-09-13T18:41:51.760213+0000","last_became_active":"2024-09-13T18:41:50.773370+0000","last_became_peered":"2024-09-13T18:41:50.773370+0000","last_unstale":"2024-09-13T18:41:51.760213+0000","last_undegraded":"2024-09-13T18:41:51.760213+0000","last_fullsized":"2024-09-13T18:41:51.760213+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:38.780233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601852+0000","last_change":"2024-09-13T18:41:50.759523+0000","last_active":"2024-09-13T18:41:52.601852+0000","last_peered":"2024-09-13T18:41:52.601852+0000","last_clean":"2024-09-13T18:41:52.601852+0000","last_became_active":"2024-09-13T18:41:50.759150+0000","last_became_peered":"2024-09-13T18:41:50.759150+0000","last_unstale":"2024-09-13T18:41:52.601852+0000","last_undegraded":"2024-09-13T18:41:52.601852+0000","last_fullsized":"2024-09-13T18:41:52.601852+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:54:23.060936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602049+0000","last_change":"2024-09-13T18:41:50.777452+0000","last_active":"2024-09-13T18:41:52.602049+0000","last_peered":"2024-09-13T18:41:52.602049+0000","last_clean":"2024-09-13T18:41:52.602049+0000","last_became_active":"2024-09-13T18:41:50.776929+0000","last_became_peered":"2024-09-13T18:41:50.776929+0000","last_unstale":"2024-09-13T18:41:52.602049+0000","last_undegraded":"2024-09-13T18:41:52.602049+0000","last_fullsized":"2024-09-13T18:41:52.602049+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:25:19.634680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061597+0000","last_change":"2024-09-13T18:41:50.776181+0000","last_active":"2024-09-13T18:41:53.061597+0000","last_peered":"2024-09-13T18:41:53.061597+0000","last_clean":"2024-09-13T18:41:53.061597+0000","last_became_active":"2024-09-13T18:41:50.772719+0000","last_became_peered":"2024-09-13T18:41:50.772719+0000","last_unstale":"2024-09-13T18:41:53.061597+0000","last_undegraded":"2024-09-13T18:41:53.061597+0000","last_fullsized":"2024-09-13T18:41:53.061597+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:34:20.058090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1f","version":"133'4","reported_seq":15,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760186+0000","last_change":"2024-09-13T18:41:50.356606+0000","last_active":"2024-09-13T18:41:51.760186+0000","last_peered":"2024-09-13T18:41:51.760186+0000","last_clean":"2024-09-13T18:41:51.760186+0000","last_became_active":"2024-09-13T18:41:50.356380+0000","last_became_peered":"2024-09-13T18:41:50.356380+0000","last_unstale":"2024-09-13T18:41:51.760186+0000","last_undegraded":"2024-09-13T18:41:51.760186+0000","last_fullsized":"2024-09-13T18:41:51.760186+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:09:29.478457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.759937+0000","last_change":"2024-09-13T18:41:50.763388+0000","last_active":"2024-09-13T18:41:51.759937+0000","last_peered":"2024-09-13T18:41:51.759937+0000","last_clean":"2024-09-13T18:41:51.759937+0000","last_became_active":"2024-09-13T18:41:50.763161+0000","last_became_peered":"2024-09-13T18:41:50.763161+0000","last_unstale":"2024-09-13T18:41:51.759937+0000","last_undegraded":"2024-09-13T18:41:51.759937+0000","last_fullsized":"2024-09-13T18:41:51.759937+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:12.434200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1e","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760419+0000","last_change":"2024-09-13T18:41:50.358658+0000","last_active":"2024-09-13T18:41:51.760419+0000","last_peered":"2024-09-13T18:41:51.760419+0000","last_clean":"2024-09-13T18:41:51.760419+0000","last_became_active":"2024-09-13T18:41:50.358465+0000","last_became_peered":"2024-09-13T18:41:50.358465+0000","last_unstale":"2024-09-13T18:41:51.760419+0000","last_undegraded":"2024-09-13T18:41:51.760419+0000","last_fullsized":"2024-09-13T18:41:51.760419+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:10.391935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602192+0000","last_change":"2024-09-13T18:41:50.773358+0000","last_active":"2024-09-13T18:41:52.602192+0000","last_peered":"2024-09-13T18:41:52.602192+0000","last_clean":"2024-09-13T18:41:52.602192+0000","last_became_active":"2024-09-13T18:41:50.767685+0000","last_became_peered":"2024-09-13T18:41:50.767685+0000","last_unstale":"2024-09-13T18:41:52.602192+0000","last_undegraded":"2024-09-13T18:41:52.602192+0000","last_fullsized":"2024-09-13T18:41:52.602192+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:07.570078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.1d","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602612+0000","last_change":"2024-09-13T18:41:50.354179+0000","last_active":"2024-09-13T18:41:52.602612+0000","last_peered":"2024-09-13T18:41:52.602612+0000","last_clean":"2024-09-13T18:41:52.602612+0000","last_became_active":"2024-09-13T18:41:50.353701+0000","last_became_peered":"2024-09-13T18:41:50.353701+0000","last_unstale":"2024-09-13T18:41:52.602612+0000","last_undegraded":"2024-09-13T18:41:52.602612+0000","last_fullsized":"2024-09-13T18:41:52.602612+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:53.591220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761198+0000","last_change":"2024-09-13T18:41:50.757849+0000","last_active":"2024-09-13T18:41:51.761198+0000","last_peered":"2024-09-13T18:41:51.761198+0000","last_clean":"2024-09-13T18:41:51.761198+0000","last_became_active":"2024-09-13T18:41:50.757623+0000","last_became_peered":"2024-09-13T18:41:50.757623+0000","last_unstale":"2024-09-13T18:41:51.761198+0000","last_undegraded":"2024-09-13T18:41:51.761198+0000","last_fullsized":"2024-09-13T18:41:51.761198+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.1c","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602526+0000","last_change":"2024-09-13T18:41:50.355988+0000","last_active":"2024-09-13T18:41:52.602526+0000","last_peered":"2024-09-13T18:41:52.602526+0000","last_clean":"2024-09-13T18:41:52.602526+0000","last_became_active":"2024-09-13T18:41:50.355186+0000","last_became_peered":"2024-09-13T18:41:50.355186+0000","last_unstale":"2024-09-13T18:41:52.602526+0000","last_undegraded":"2024-09-13T18:41:52.602526+0000","last_fullsized":"2024-09-13T18:41:52.602526+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:33.601401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601359+0000","last_change":"2024-09-13T18:41:50.768577+0000","last_active":"2024-09-13T18:41:52.601359+0000","last_peered":"2024-09-13T18:41:52.601359+0000","last_clean":"2024-09-13T18:41:52.601359+0000","last_became_active":"2024-09-13T18:41:50.767992+0000","last_became_peered":"2024-09-13T18:41:50.767992+0000","last_unstale":"2024-09-13T18:41:52.601359+0000","last_undegraded":"2024-09-13T18:41:52.601359+0000","last_fullsized":"2024-09-13T18:41:52.601359+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:32.751131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1b","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602281+0000","last_change":"2024-09-13T18:41:50.354210+0000","last_active":"2024-09-13T18:41:52.602281+0000","last_peered":"2024-09-13T18:41:52.602281+0000","last_clean":"2024-09-13T18:41:52.602281+0000","last_became_active":"2024-09-13T18:41:50.353909+0000","last_became_peered":"2024-09-13T18:41:50.353909+0000","last_unstale":"2024-09-13T18:41:52.602281+0000","last_undegraded":"2024-09-13T18:41:52.602281+0000","last_fullsized":"2024-09-13T18:41:52.602281+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:04.317106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760145+0000","last_change":"2024-09-13T18:41:50.766624+0000","last_active":"2024-09-13T18:41:51.760145+0000","last_peered":"2024-09-13T18:41:51.760145+0000","last_clean":"2024-09-13T18:41:51.760145+0000","last_became_active":"2024-09-13T18:41:50.766378+0000","last_became_peered":"2024-09-13T18:41:50.766378+0000","last_unstale":"2024-09-13T18:41:51.760145+0000","last_undegraded":"2024-09-13T18:41:51.760145+0000","last_fullsized":"2024-09-13T18:41:51.760145+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:38.808518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1a","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602703+0000","last_change":"2024-09-13T18:41:50.354477+0000","last_active":"2024-09-13T18:41:52.602703+0000","last_peered":"2024-09-13T18:41:52.602703+0000","last_clean":"2024-09-13T18:41:52.602703+0000","last_became_active":"2024-09-13T18:41:50.354152+0000","last_became_peered":"2024-09-13T18:41:50.354152+0000","last_unstale":"2024-09-13T18:41:52.602703+0000","last_undegraded":"2024-09-13T18:41:52.602703+0000","last_fullsized":"2024-09-13T18:41:52.602703+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:04.317106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760312+0000","last_change":"2024-09-13T18:41:50.765135+0000","last_active":"2024-09-13T18:41:51.760312+0000","last_peered":"2024-09-13T18:41:51.760312+0000","last_clean":"2024-09-13T18:41:51.760312+0000","last_became_active":"2024-09-13T18:41:50.764845+0000","last_became_peered":"2024-09-13T18:41:50.764845+0000","last_unstale":"2024-09-13T18:41:51.760312+0000","last_undegraded":"2024-09-13T18:41:51.760312+0000","last_fullsized":"2024-09-13T18:41:51.760312+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:43.142310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760558+0000","last_change":"2024-09-13T18:41:50.355155+0000","last_active":"2024-09-13T18:41:51.760558+0000","last_peered":"2024-09-13T18:41:51.760558+0000","last_clean":"2024-09-13T18:41:51.760558+0000","last_became_active":"2024-09-13T18:41:50.354018+0000","last_became_peered":"2024-09-13T18:41:50.354018+0000","last_unstale":"2024-09-13T18:41:51.760558+0000","last_undegraded":"2024-09-13T18:41:51.760558+0000","last_fullsized":"2024-09-13T18:41:51.760558+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:32:31.410912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601080+0000","last_change":"2024-09-13T18:41:50.765083+0000","last_active":"2024-09-13T18:41:52.601080+0000","last_peered":"2024-09-13T18:41:52.601080+0000","last_clean":"2024-09-13T18:41:52.601080+0000","last_became_active":"2024-09-13T18:41:50.764870+0000","last_became_peered":"2024-09-13T18:41:50.764870+0000","last_unstale":"2024-09-13T18:41:52.601080+0000","last_undegraded":"2024-09-13T18:41:52.601080+0000","last_fullsized":"2024-09-13T18:41:52.601080+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:17:33.680441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.766095+0000","last_change":"2024-09-13T18:41:50.357389+0000","last_active":"2024-09-13T18:41:50.766095+0000","last_peered":"2024-09-13T18:41:50.766095+0000","last_clean":"2024-09-13T18:41:50.766095+0000","last_became_active":"2024-09-13T18:41:50.357145+0000","last_became_peered":"2024-09-13T18:41:50.357145+0000","last_unstale":"2024-09-13T18:41:50.766095+0000","last_undegraded":"2024-09-13T18:41:50.766095+0000","last_fullsized":"2024-09-13T18:41:50.766095+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:16.200809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601838+0000","last_change":"2024-09-13T18:41:50.777691+0000","last_active":"2024-09-13T18:41:52.601838+0000","last_peered":"2024-09-13T18:41:52.601838+0000","last_clean":"2024-09-13T18:41:52.601838+0000","last_became_active":"2024-09-13T18:41:50.777242+0000","last_became_peered":"2024-09-13T18:41:50.777242+0000","last_unstale":"2024-09-13T18:41:52.601838+0000","last_undegraded":"2024-09-13T18:41:52.601838+0000","last_fullsized":"2024-09-13T18:41:52.601838+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602008+0000","last_change":"2024-09-13T18:41:50.355991+0000","last_active":"2024-09-13T18:41:52.602008+0000","last_peered":"2024-09-13T18:41:52.602008+0000","last_clean":"2024-09-13T18:41:52.602008+0000","last_became_active":"2024-09-13T18:41:50.355595+0000","last_became_peered":"2024-09-13T18:41:50.355595+0000","last_unstale":"2024-09-13T18:41:52.602008+0000","last_undegraded":"2024-09-13T18:41:52.602008+0000","last_fullsized":"2024-09-13T18:41:52.602008+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:21.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061032+0000","last_change":"2024-09-13T18:41:50.764528+0000","last_active":"2024-09-13T18:41:53.061032+0000","last_peered":"2024-09-13T18:41:53.061032+0000","last_clean":"2024-09-13T18:41:53.061032+0000","last_became_active":"2024-09-13T18:41:50.764073+0000","last_became_peered":"2024-09-13T18:41:50.764073+0000","last_unstale":"2024-09-13T18:41:53.061032+0000","last_undegraded":"2024-09-13T18:41:53.061032+0000","last_fullsized":"2024-09-13T18:41:53.061032+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602365+0000","last_change":"2024-09-13T18:41:50.356618+0000","last_active":"2024-09-13T18:41:52.602365+0000","last_peered":"2024-09-13T18:41:52.602365+0000","last_clean":"2024-09-13T18:41:52.602365+0000","last_became_active":"2024-09-13T18:41:50.356387+0000","last_became_peered":"2024-09-13T18:41:50.356387+0000","last_unstale":"2024-09-13T18:41:52.602365+0000","last_undegraded":"2024-09-13T18:41:52.602365+0000","last_fullsized":"2024-09-13T18:41:52.602365+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:45:21.921859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760334+0000","last_change":"2024-09-13T18:41:50.769633+0000","last_active":"2024-09-13T18:41:51.760334+0000","last_peered":"2024-09-13T18:41:51.760334+0000","last_clean":"2024-09-13T18:41:51.760334+0000","last_became_active":"2024-09-13T18:41:50.769431+0000","last_became_peered":"2024-09-13T18:41:50.769431+0000","last_unstale":"2024-09-13T18:41:51.760334+0000","last_undegraded":"2024-09-13T18:41:51.760334+0000","last_fullsized":"2024-09-13T18:41:51.760334+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:11:13.944646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.15","version":"133'3","reported_seq":14,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760334+0000","last_change":"2024-09-13T18:41:50.354774+0000","last_active":"2024-09-13T18:41:51.760334+0000","last_peered":"2024-09-13T18:41:51.760334+0000","last_clean":"2024-09-13T18:41:51.760334+0000","last_became_active":"2024-09-13T18:41:50.354344+0000","last_became_peered":"2024-09-13T18:41:50.354344+0000","last_unstale":"2024-09-13T18:41:51.760334+0000","last_undegraded":"2024-09-13T18:41:51.760334+0000","last_fullsized":"2024-09-13T18:41:51.760334+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:19.751837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061137+0000","last_change":"2024-09-13T18:41:50.772377+0000","last_active":"2024-09-13T18:41:53.061137+0000","last_peered":"2024-09-13T18:41:53.061137+0000","last_clean":"2024-09-13T18:41:53.061137+0000","last_became_active":"2024-09-13T18:41:50.772090+0000","last_became_peered":"2024-09-13T18:41:50.772090+0000","last_unstale":"2024-09-13T18:41:53.061137+0000","last_undegraded":"2024-09-13T18:41:53.061137+0000","last_fullsized":"2024-09-13T18:41:53.061137+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:35.862651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.14","version":"133'6","reported_seq":17,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601292+0000","last_change":"2024-09-13T18:41:50.361848+0000","last_active":"2024-09-13T18:41:52.601292+0000","last_peered":"2024-09-13T18:41:52.601292+0000","last_clean":"2024-09-13T18:41:52.601292+0000","last_became_active":"2024-09-13T18:41:50.361720+0000","last_became_peered":"2024-09-13T18:41:50.361720+0000","last_unstale":"2024-09-13T18:41:52.601292+0000","last_undegraded":"2024-09-13T18:41:52.601292+0000","last_fullsized":"2024-09-13T18:41:52.601292+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:02:42.135119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602280+0000","last_change":"2024-09-13T18:41:50.775233+0000","last_active":"2024-09-13T18:41:52.602280+0000","last_peered":"2024-09-13T18:41:52.602280+0000","last_clean":"2024-09-13T18:41:52.602280+0000","last_became_active":"2024-09-13T18:41:50.768569+0000","last_became_peered":"2024-09-13T18:41:50.768569+0000","last_unstale":"2024-09-13T18:41:52.602280+0000","last_undegraded":"2024-09-13T18:41:52.602280+0000","last_fullsized":"2024-09-13T18:41:52.602280+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:11.648191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.13","version":"133'2","reported_seq":13,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.779820+0000","last_change":"2024-09-13T18:41:50.357872+0000","last_active":"2024-09-13T18:41:50.779820+0000","last_peered":"2024-09-13T18:41:50.779820+0000","last_clean":"2024-09-13T18:41:50.779820+0000","last_became_active":"2024-09-13T18:41:50.357644+0000","last_became_peered":"2024-09-13T18:41:50.357644+0000","last_unstale":"2024-09-13T18:41:50.779820+0000","last_undegraded":"2024-09-13T18:41:50.779820+0000","last_fullsized":"2024-09-13T18:41:50.779820+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:32.743137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602288+0000","last_change":"2024-09-13T18:41:50.771788+0000","last_active":"2024-09-13T18:41:52.602288+0000","last_peered":"2024-09-13T18:41:52.602288+0000","last_clean":"2024-09-13T18:41:52.602288+0000","last_became_active":"2024-09-13T18:41:50.770762+0000","last_became_peered":"2024-09-13T18:41:50.770762+0000","last_unstale":"2024-09-13T18:41:52.602288+0000","last_undegraded":"2024-09-13T18:41:52.602288+0000","last_fullsized":"2024-09-13T18:41:52.602288+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:54.801405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602479+0000","last_change":"2024-09-13T18:41:50.355476+0000","last_active":"2024-09-13T18:41:52.602479+0000","last_peered":"2024-09-13T18:41:52.602479+0000","last_clean":"2024-09-13T18:41:52.602479+0000","last_became_active":"2024-09-13T18:41:50.354629+0000","last_became_peered":"2024-09-13T18:41:50.354629+0000","last_unstale":"2024-09-13T18:41:52.602479+0000","last_undegraded":"2024-09-13T18:41:52.602479+0000","last_fullsized":"2024-09-13T18:41:52.602479+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:59:53.591220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760247+0000","last_change":"2024-09-13T18:41:50.766909+0000","last_active":"2024-09-13T18:41:51.760247+0000","last_peered":"2024-09-13T18:41:51.760247+0000","last_clean":"2024-09-13T18:41:51.760247+0000","last_became_active":"2024-09-13T18:41:50.766681+0000","last_became_peered":"2024-09-13T18:41:50.766681+0000","last_unstale":"2024-09-13T18:41:51.760247+0000","last_undegraded":"2024-09-13T18:41:51.760247+0000","last_fullsized":"2024-09-13T18:41:51.760247+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:15:29.463204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601492+0000","last_change":"2024-09-13T18:41:50.352864+0000","last_active":"2024-09-13T18:41:52.601492+0000","last_peered":"2024-09-13T18:41:52.601492+0000","last_clean":"2024-09-13T18:41:52.601492+0000","last_became_active":"2024-09-13T18:41:50.352518+0000","last_became_peered":"2024-09-13T18:41:50.352518+0000","last_unstale":"2024-09-13T18:41:52.601492+0000","last_undegraded":"2024-09-13T18:41:52.601492+0000","last_fullsized":"2024-09-13T18:41:52.601492+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:10.514643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601941+0000","last_change":"2024-09-13T18:41:50.766624+0000","last_active":"2024-09-13T18:41:52.601941+0000","last_peered":"2024-09-13T18:41:52.601941+0000","last_clean":"2024-09-13T18:41:52.601941+0000","last_became_active":"2024-09-13T18:41:50.763217+0000","last_became_peered":"2024-09-13T18:41:50.763217+0000","last_unstale":"2024-09-13T18:41:52.601941+0000","last_undegraded":"2024-09-13T18:41:52.601941+0000","last_fullsized":"2024-09-13T18:41:52.601941+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:28.759849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.10","version":"133'8","reported_seq":19,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601998+0000","last_change":"2024-09-13T18:41:50.357877+0000","last_active":"2024-09-13T18:41:52.601998+0000","last_peered":"2024-09-13T18:41:52.601998+0000","last_clean":"2024-09-13T18:41:52.601998+0000","last_became_active":"2024-09-13T18:41:50.357655+0000","last_became_peered":"2024-09-13T18:41:50.357655+0000","last_unstale":"2024-09-13T18:41:52.601998+0000","last_undegraded":"2024-09-13T18:41:52.601998+0000","last_fullsized":"2024-09-13T18:41:52.601998+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:57:41.290958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060992+0000","last_change":"2024-09-13T18:41:50.765598+0000","last_active":"2024-09-13T18:41:53.060992+0000","last_peered":"2024-09-13T18:41:53.060992+0000","last_clean":"2024-09-13T18:41:53.060992+0000","last_became_active":"2024-09-13T18:41:50.765368+0000","last_became_peered":"2024-09-13T18:41:50.765368+0000","last_unstale":"2024-09-13T18:41:53.060992+0000","last_undegraded":"2024-09-13T18:41:53.060992+0000","last_fullsized":"2024-09-13T18:41:53.060992+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:17.208000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.e","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601431+0000","last_change":"2024-09-13T18:41:50.361238+0000","last_active":"2024-09-13T18:41:52.601431+0000","last_peered":"2024-09-13T18:41:52.601431+0000","last_clean":"2024-09-13T18:41:52.601431+0000","last_became_active":"2024-09-13T18:41:50.360988+0000","last_became_peered":"2024-09-13T18:41:50.360988+0000","last_unstale":"2024-09-13T18:41:52.601431+0000","last_undegraded":"2024-09-13T18:41:52.601431+0000","last_fullsized":"2024-09-13T18:41:52.601431+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:47:37.773042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061295+0000","last_change":"2024-09-13T18:41:50.765813+0000","last_active":"2024-09-13T18:41:53.061295+0000","last_peered":"2024-09-13T18:41:53.061295+0000","last_clean":"2024-09-13T18:41:53.061295+0000","last_became_active":"2024-09-13T18:41:50.765310+0000","last_became_peered":"2024-09-13T18:41:50.765310+0000","last_unstale":"2024-09-13T18:41:53.061295+0000","last_undegraded":"2024-09-13T18:41:53.061295+0000","last_fullsized":"2024-09-13T18:41:53.061295+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:09.174087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.d","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760761+0000","last_change":"2024-09-13T18:41:50.355207+0000","last_active":"2024-09-13T18:41:51.760761+0000","last_peered":"2024-09-13T18:41:51.760761+0000","last_clean":"2024-09-13T18:41:51.760761+0000","last_became_active":"2024-09-13T18:41:50.354615+0000","last_became_peered":"2024-09-13T18:41:50.354615+0000","last_unstale":"2024-09-13T18:41:51.760761+0000","last_undegraded":"2024-09-13T18:41:51.760761+0000","last_fullsized":"2024-09-13T18:41:51.760761+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:09.017807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601322+0000","last_change":"2024-09-13T18:41:50.767175+0000","last_active":"2024-09-13T18:41:52.601322+0000","last_peered":"2024-09-13T18:41:52.601322+0000","last_clean":"2024-09-13T18:41:52.601322+0000","last_became_active":"2024-09-13T18:41:50.766951+0000","last_became_peered":"2024-09-13T18:41:50.766951+0000","last_unstale":"2024-09-13T18:41:52.601322+0000","last_undegraded":"2024-09-13T18:41:52.601322+0000","last_fullsized":"2024-09-13T18:41:52.601322+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:54.013992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.770701+0000","last_change":"2024-09-13T18:41:50.357930+0000","last_active":"2024-09-13T18:41:50.770701+0000","last_peered":"2024-09-13T18:41:50.770701+0000","last_clean":"2024-09-13T18:41:50.770701+0000","last_became_active":"2024-09-13T18:41:50.357696+0000","last_became_peered":"2024-09-13T18:41:50.357696+0000","last_unstale":"2024-09-13T18:41:50.770701+0000","last_undegraded":"2024-09-13T18:41:50.770701+0000","last_fullsized":"2024-09-13T18:41:50.770701+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:01:53.794214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061664+0000","last_change":"2024-09-13T18:41:50.772491+0000","last_active":"2024-09-13T18:41:53.061664+0000","last_peered":"2024-09-13T18:41:53.061664+0000","last_clean":"2024-09-13T18:41:53.061664+0000","last_became_active":"2024-09-13T18:41:50.772242+0000","last_became_peered":"2024-09-13T18:41:50.772242+0000","last_unstale":"2024-09-13T18:41:53.061664+0000","last_undegraded":"2024-09-13T18:41:53.061664+0000","last_fullsized":"2024-09-13T18:41:53.061664+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:31:24.071119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.b","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602131+0000","last_change":"2024-09-13T18:41:50.355633+0000","last_active":"2024-09-13T18:41:52.602131+0000","last_peered":"2024-09-13T18:41:52.602131+0000","last_clean":"2024-09-13T18:41:52.602131+0000","last_became_active":"2024-09-13T18:41:50.355381+0000","last_became_peered":"2024-09-13T18:41:50.355381+0000","last_unstale":"2024-09-13T18:41:52.602131+0000","last_undegraded":"2024-09-13T18:41:52.602131+0000","last_fullsized":"2024-09-13T18:41:52.602131+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:22:16.031518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061399+0000","last_change":"2024-09-13T18:41:50.780314+0000","last_active":"2024-09-13T18:41:53.061399+0000","last_peered":"2024-09-13T18:41:53.061399+0000","last_clean":"2024-09-13T18:41:53.061399+0000","last_became_active":"2024-09-13T18:41:50.780011+0000","last_became_peered":"2024-09-13T18:41:50.780011+0000","last_unstale":"2024-09-13T18:41:53.061399+0000","last_undegraded":"2024-09-13T18:41:53.061399+0000","last_fullsized":"2024-09-13T18:41:53.061399+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:39.796414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061067+0000","last_change":"2024-09-13T18:41:50.347888+0000","last_active":"2024-09-13T18:41:53.061067+0000","last_peered":"2024-09-13T18:41:53.061067+0000","last_clean":"2024-09-13T18:41:53.061067+0000","last_became_active":"2024-09-13T18:41:50.347639+0000","last_became_peered":"2024-09-13T18:41:50.347639+0000","last_unstale":"2024-09-13T18:41:53.061067+0000","last_undegraded":"2024-09-13T18:41:53.061067+0000","last_fullsized":"2024-09-13T18:41:53.061067+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:07:03.536893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602371+0000","last_change":"2024-09-13T18:41:50.773503+0000","last_active":"2024-09-13T18:41:52.602371+0000","last_peered":"2024-09-13T18:41:52.602371+0000","last_clean":"2024-09-13T18:41:52.602371+0000","last_became_active":"2024-09-13T18:41:50.768227+0000","last_became_peered":"2024-09-13T18:41:50.768227+0000","last_unstale":"2024-09-13T18:41:52.602371+0000","last_undegraded":"2024-09-13T18:41:52.602371+0000","last_fullsized":"2024-09-13T18:41:52.602371+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:15.918374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.761284+0000","last_change":"2024-09-13T18:41:50.350321+0000","last_active":"2024-09-13T18:41:51.761284+0000","last_peered":"2024-09-13T18:41:51.761284+0000","last_clean":"2024-09-13T18:41:51.761284+0000","last_became_active":"2024-09-13T18:41:50.349727+0000","last_became_peered":"2024-09-13T18:41:50.349727+0000","last_unstale":"2024-09-13T18:41:51.761284+0000","last_undegraded":"2024-09-13T18:41:51.761284+0000","last_fullsized":"2024-09-13T18:41:51.761284+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:30:06.562886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060897+0000","last_change":"2024-09-13T18:41:50.770379+0000","last_active":"2024-09-13T18:41:53.060897+0000","last_peered":"2024-09-13T18:41:53.060897+0000","last_clean":"2024-09-13T18:41:53.060897+0000","last_became_active":"2024-09-13T18:41:50.770178+0000","last_became_peered":"2024-09-13T18:41:50.770178+0000","last_unstale":"2024-09-13T18:41:53.060897+0000","last_undegraded":"2024-09-13T18:41:53.060897+0000","last_fullsized":"2024-09-13T18:41:53.060897+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:02.569298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602106+0000","last_change":"2024-09-13T18:41:50.359307+0000","last_active":"2024-09-13T18:41:52.602106+0000","last_peered":"2024-09-13T18:41:52.602106+0000","last_clean":"2024-09-13T18:41:52.602106+0000","last_became_active":"2024-09-13T18:41:50.359064+0000","last_became_peered":"2024-09-13T18:41:50.359064+0000","last_unstale":"2024-09-13T18:41:52.602106+0000","last_undegraded":"2024-09-13T18:41:52.602106+0000","last_fullsized":"2024-09-13T18:41:52.602106+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:53.006801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061503+0000","last_change":"2024-09-13T18:41:50.777268+0000","last_active":"2024-09-13T18:41:53.061503+0000","last_peered":"2024-09-13T18:41:53.061503+0000","last_clean":"2024-09-13T18:41:53.061503+0000","last_became_active":"2024-09-13T18:41:50.775649+0000","last_became_peered":"2024-09-13T18:41:50.775649+0000","last_unstale":"2024-09-13T18:41:53.061503+0000","last_undegraded":"2024-09-13T18:41:53.061503+0000","last_fullsized":"2024-09-13T18:41:53.061503+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:20:52.908292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.7","version":"133'2","reported_seq":13,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601562+0000","last_change":"2024-09-13T18:41:50.352732+0000","last_active":"2024-09-13T18:41:52.601562+0000","last_peered":"2024-09-13T18:41:52.601562+0000","last_clean":"2024-09-13T18:41:52.601562+0000","last_became_active":"2024-09-13T18:41:50.352238+0000","last_became_peered":"2024-09-13T18:41:50.352238+0000","last_unstale":"2024-09-13T18:41:52.601562+0000","last_undegraded":"2024-09-13T18:41:52.601562+0000","last_fullsized":"2024-09-13T18:41:52.601562+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:39:35.397676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061594+0000","last_change":"2024-09-13T18:41:50.778095+0000","last_active":"2024-09-13T18:41:53.061594+0000","last_peered":"2024-09-13T18:41:53.061594+0000","last_clean":"2024-09-13T18:41:53.061594+0000","last_became_active":"2024-09-13T18:41:50.777863+0000","last_became_peered":"2024-09-13T18:41:50.777863+0000","last_unstale":"2024-09-13T18:41:53.061594+0000","last_undegraded":"2024-09-13T18:41:53.061594+0000","last_fullsized":"2024-09-13T18:41:53.061594+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:34.813525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.763507+0000","last_change":"2024-09-13T18:41:50.359388+0000","last_active":"2024-09-13T18:41:50.763507+0000","last_peered":"2024-09-13T18:41:50.763507+0000","last_clean":"2024-09-13T18:41:50.763507+0000","last_became_active":"2024-09-13T18:41:50.359156+0000","last_became_peered":"2024-09-13T18:41:50.359156+0000","last_unstale":"2024-09-13T18:41:50.763507+0000","last_undegraded":"2024-09-13T18:41:50.763507+0000","last_fullsized":"2024-09-13T18:41:50.763507+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:28:27.752658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602470+0000","last_change":"2024-09-13T18:41:50.768541+0000","last_active":"2024-09-13T18:41:52.602470+0000","last_peered":"2024-09-13T18:41:52.602470+0000","last_clean":"2024-09-13T18:41:52.602470+0000","last_became_active":"2024-09-13T18:41:50.768240+0000","last_became_peered":"2024-09-13T18:41:50.768240+0000","last_unstale":"2024-09-13T18:41:52.602470+0000","last_undegraded":"2024-09-13T18:41:52.602470+0000","last_fullsized":"2024-09-13T18:41:52.602470+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:33.750328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.766660+0000","last_change":"2024-09-13T18:41:50.358155+0000","last_active":"2024-09-13T18:41:50.766660+0000","last_peered":"2024-09-13T18:41:50.766660+0000","last_clean":"2024-09-13T18:41:50.766660+0000","last_became_active":"2024-09-13T18:41:50.357307+0000","last_became_peered":"2024-09-13T18:41:50.357307+0000","last_unstale":"2024-09-13T18:41:50.766660+0000","last_undegraded":"2024-09-13T18:41:50.766660+0000","last_fullsized":"2024-09-13T18:41:50.766660+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:07:34.855460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760494+0000","last_change":"2024-09-13T18:41:50.758317+0000","last_active":"2024-09-13T18:41:51.760494+0000","last_peered":"2024-09-13T18:41:51.760494+0000","last_clean":"2024-09-13T18:41:51.760494+0000","last_became_active":"2024-09-13T18:41:50.758080+0000","last_became_peered":"2024-09-13T18:41:50.758080+0000","last_unstale":"2024-09-13T18:41:51.760494+0000","last_undegraded":"2024-09-13T18:41:51.760494+0000","last_fullsized":"2024-09-13T18:41:51.760494+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:12:37.614664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.060953+0000","last_change":"2024-09-13T18:41:50.355279+0000","last_active":"2024-09-13T18:41:53.060953+0000","last_peered":"2024-09-13T18:41:53.060953+0000","last_clean":"2024-09-13T18:41:53.060953+0000","last_became_active":"2024-09-13T18:41:50.355043+0000","last_became_peered":"2024-09-13T18:41:50.355043+0000","last_unstale":"2024-09-13T18:41:53.060953+0000","last_undegraded":"2024-09-13T18:41:53.060953+0000","last_fullsized":"2024-09-13T18:41:53.060953+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:17:30.943529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061695+0000","last_change":"2024-09-13T18:41:50.776962+0000","last_active":"2024-09-13T18:41:53.061695+0000","last_peered":"2024-09-13T18:41:53.061695+0000","last_clean":"2024-09-13T18:41:53.061695+0000","last_became_active":"2024-09-13T18:41:50.776618+0000","last_became_peered":"2024-09-13T18:41:50.776618+0000","last_unstale":"2024-09-13T18:41:53.061695+0000","last_undegraded":"2024-09-13T18:41:53.061695+0000","last_fullsized":"2024-09-13T18:41:53.061695+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:16.432162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602212+0000","last_change":"2024-09-13T18:41:50.355838+0000","last_active":"2024-09-13T18:41:52.602212+0000","last_peered":"2024-09-13T18:41:52.602212+0000","last_clean":"2024-09-13T18:41:52.602212+0000","last_became_active":"2024-09-13T18:41:50.353111+0000","last_became_peered":"2024-09-13T18:41:50.353111+0000","last_unstale":"2024-09-13T18:41:52.602212+0000","last_undegraded":"2024-09-13T18:41:52.602212+0000","last_fullsized":"2024-09-13T18:41:52.602212+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:31.743940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760681+0000","last_change":"2024-09-13T18:41:50.761907+0000","last_active":"2024-09-13T18:41:51.760681+0000","last_peered":"2024-09-13T18:41:51.760681+0000","last_clean":"2024-09-13T18:41:51.760681+0000","last_became_active":"2024-09-13T18:41:50.761680+0000","last_became_peered":"2024-09-13T18:41:50.761680+0000","last_unstale":"2024-09-13T18:41:51.760681+0000","last_undegraded":"2024-09-13T18:41:51.760681+0000","last_fullsized":"2024-09-13T18:41:51.760681+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:20.730659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061364+0000","last_change":"2024-09-13T18:41:50.359283+0000","last_active":"2024-09-13T18:41:53.061364+0000","last_peered":"2024-09-13T18:41:53.061364+0000","last_clean":"2024-09-13T18:41:53.061364+0000","last_became_active":"2024-09-13T18:41:50.359049+0000","last_became_peered":"2024-09-13T18:41:50.359049+0000","last_unstale":"2024-09-13T18:41:53.061364+0000","last_undegraded":"2024-09-13T18:41:53.061364+0000","last_fullsized":"2024-09-13T18:41:53.061364+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:03:26.381575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:53.061726+0000","last_change":"2024-09-13T18:41:50.771800+0000","last_active":"2024-09-13T18:41:53.061726+0000","last_peered":"2024-09-13T18:41:53.061726+0000","last_clean":"2024-09-13T18:41:53.061726+0000","last_became_active":"2024-09-13T18:41:50.771452+0000","last_became_peered":"2024-09-13T18:41:50.771452+0000","last_unstale":"2024-09-13T18:41:53.061726+0000","last_undegraded":"2024-09-13T18:41:53.061726+0000","last_fullsized":"2024-09-13T18:41:53.061726+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:44:15.655961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:51.760273+0000","last_change":"2024-09-13T18:41:50.358445+0000","last_active":"2024-09-13T18:41:51.760273+0000","last_peered":"2024-09-13T18:41:51.760273+0000","last_clean":"2024-09-13T18:41:51.760273+0000","last_became_active":"2024-09-13T18:41:50.358184+0000","last_became_peered":"2024-09-13T18:41:50.358184+0000","last_unstale":"2024-09-13T18:41:51.760273+0000","last_undegraded":"2024-09-13T18:41:51.760273+0000","last_fullsized":"2024-09-13T18:41:51.760273+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:26:49.129244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601470+0000","last_change":"2024-09-13T18:41:50.769319+0000","last_active":"2024-09-13T18:41:52.601470+0000","last_peered":"2024-09-13T18:41:52.601470+0000","last_clean":"2024-09-13T18:41:52.601470+0000","last_became_active":"2024-09-13T18:41:50.769111+0000","last_became_peered":"2024-09-13T18:41:50.769111+0000","last_unstale":"2024-09-13T18:41:52.601470+0000","last_undegraded":"2024-09-13T18:41:52.601470+0000","last_fullsized":"2024-09-13T18:41:52.601470+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:39:24.390519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602375+0000","last_change":"2024-09-13T18:41:50.359748+0000","last_active":"2024-09-13T18:41:52.602375+0000","last_peered":"2024-09-13T18:41:52.602375+0000","last_clean":"2024-09-13T18:41:52.602375+0000","last_became_active":"2024-09-13T18:41:50.359479+0000","last_became_peered":"2024-09-13T18:41:50.359479+0000","last_unstale":"2024-09-13T18:41:52.602375+0000","last_undegraded":"2024-09-13T18:41:52.602375+0000","last_fullsized":"2024-09-13T18:41:52.602375+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:37:33.601401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.602385+0000","last_change":"2024-09-13T18:41:50.776283+0000","last_active":"2024-09-13T18:41:52.602385+0000","last_peered":"2024-09-13T18:41:52.602385+0000","last_clean":"2024-09-13T18:41:52.602385+0000","last_became_active":"2024-09-13T18:41:50.776056+0000","last_became_peered":"2024-09-13T18:41:50.776056+0000","last_unstale":"2024-09-13T18:41:52.602385+0000","last_undegraded":"2024-09-13T18:41:52.602385+0000","last_fullsized":"2024-09-13T18:41:52.602385+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":132,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:50.332063+0000","last_clean_scrub_stamp":"2024-09-13T18:41:50.332063+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:43:15.918374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.f","version":"133'1","reported_seq":12,"reported_epoch":134,"state":"active+clean","last_fresh":"2024-09-13T18:41:52.601407+0000","last_change":"2024-09-13T18:41:50.359439+0000","last_active":"2024-09-13T18:41:52.601407+0000","last_peered":"2024-09-13T18:41:52.601407+0000","last_clean":"2024-09-13T18:41:52.601407+0000","last_became_active":"2024-09-13T18:41:50.359261+0000","last_became_peered":"2024-09-13T18:41:50.359261+0000","last_unstale":"2024-09-13T18:41:52.601407+0000","last_undegraded":"2024-09-13T18:41:52.601407+0000","last_fullsized":"2024-09-13T18:41:52.601407+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":131,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:41:49.324872+0000","last_clean_scrub_stamp":"2024-09-13T18:41:49.324872+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:11.427009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":270,"reported_epoch":133,"state":"active+clean","last_fresh":"2024-09-13T18:41:50.763370+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:41:50.763370+0000","last_peered":"2024-09-13T18:41:50.763370+0000","last_clean":"2024-09-13T18:41:50.763370+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:41:50.763370+0000","last_undegraded":"2024-09-13T18:41:50.763370+0000","last_fullsized":"2024-09-13T18:41:50.763370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542225,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194008,"statfs":{"total":200000000,"available":198664231,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.313},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.34599999999999997},"max":{"1min":0.89200000000000002,"5min":1.014,"15min":1.014},"last":0.80900000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.64800000000000002},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.57699999999999996}]},{"osd":2,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84399999999999997,"5min":0.90500000000000003,"15min":0.94499999999999995},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77300000000000002,"5min":0.999,"15min":0.999},"last":0.69799999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.84199999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.47499999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":1.0189999999999999,"15min":6.0890000000000004},"last":0.73799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.88800000000000001,"5min":1.036,"15min":1.036},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91800000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.63100000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85999999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":1.101,"15min":1.371},"last":0.51500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67100000000000004},"min":{"1min":0.53600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94399999999999995,"5min":1.143,"15min":1.143},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99399999999999999,"5min":1.125,"15min":1.125},"last":0.78400000000000003}]}]},{"osd":7,"up_from":13,"seq":55834574927,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199255637,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70099999999999996,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93300000000000005,"5min":1.665,"15min":1.665},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.57799999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.64800000000000002},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85099999999999998,"5min":1.591,"15min":1.591},"last":0.502}]},{"osd":2,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.439},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":2.169,"15min":2.169},"last":0.627}]},{"osd":3,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97199999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.54600000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92800000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73799999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.51900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.72499999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.748},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.81799999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574927,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194586,"statfs":{"total":200000000,"available":199256219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69999999999999996,"15min":0.82399999999999995},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92800000000000005,"5min":1.696,"15min":6.4539999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.999,"15min":0.999},"last":0.59699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.84299999999999997},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.82699999999999996},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.53000000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94099999999999995,"5min":1.032,"15min":1.032},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.879},"min":{"1min":0.53000000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.81999999999999995},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":1.004,"15min":6.2039999999999997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.66800000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.50900000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.403,"15min":1.403},"last":0.57699999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97199999999999998,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199255637,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.61499999999999999}]},{"osd":1,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.625,"5min":0.70699999999999996,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73499999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":3.706,"15min":3.706},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.68400000000000005},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84099999999999997,"5min":3.742,"15min":3.742},"last":0.48099999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75700000000000001,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88100000000000001,"5min":1.552,"15min":1.552},"last":0.84799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.90500000000000003,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.73199999999999998},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92800000000000005,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.55200000000000005,"5min":0.45800000000000002,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.89200000000000002,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.69299999999999995},"min":{"1min":0.57299999999999995,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":0.95799999999999996,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194585,"statfs":{"total":200000000,"available":199256025,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.54100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.38300000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.754},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":8.1059999999999999},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57899999999999996,"5min":0.77800000000000002,"15min":4.7919999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.5,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.95399999999999996,"15min":7.798},"last":0.42599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0800000000000001,"15min":3.093},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.01,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.82499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":1.1519999999999999,"15min":3.0299999999999998},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91200000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.78800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.98299999999999998},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.51800000000000002},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.91300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82499999999999996,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.80600000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.71299999999999997},"min":{"1min":0.55200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.206,"15min":1.206},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96999999999999997,"5min":1.218,"15min":2.9900000000000002},"last":0.96999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574927,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262449,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.32100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70799999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.496},{"interface":"front","average":{"1min":0.435,"5min":0.442,"15min":0.47999999999999998},"min":{"1min":0.34999999999999998,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.43099999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.50900000000000001},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.435,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.7030000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89300000000000002,"5min":1.075,"15min":1.1830000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72099999999999997,"15min":0.70099999999999996},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.02},"last":0.54900000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.079,"15min":1.079},"last":0.65300000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84999999999999998,"5min":1.0409999999999999,"15min":1.1850000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.58099999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":1.097,"15min":1.1419999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.77200000000000002},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.96499999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.68000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1304,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194007,"statfs":{"total":200000000,"available":198664175,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.504}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":1.036,"15min":1.036},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.496,"5min":0.52400000000000002,"15min":0.47999999999999998},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.73699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56299999999999994,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80600000000000005,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.56399999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.54200000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.89500000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.242,"15min":1.242},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.53200000000000003},"max":{"1min":1.0509999999999999,"5min":1.21,"15min":1.21},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.753,"5min":0.81200000000000006,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.93700000000000006}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96799999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":1.149,"15min":1.1539999999999999},"last":0.91000000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":726,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194586,"statfs":{"total":200000000,"available":199256219,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.436,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":1.669},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.27800000000000002,"15min":0.24099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.874},"last":0.371}]},{"osd":2,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.67500000000000004,"5min":0.76600000000000001,"15min":1.591},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.85899999999999999,"15min":1.637},"last":0.53500000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":1.2,"15min":1.2},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.698},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.74099999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":1.204,"15min":1.204},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.085,"5min":1.121,"15min":2.2589999999999999},"last":0.58899999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.044,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.79500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:41:55.325 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:41:55.326 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:41:55.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.516+0000 7f4f5b200640 1 Processor -- start 2024-09-13T18:41:55.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.516+0000 7f4f5b200640 1 -- start start 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.517+0000 7f4f5b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4f5415a910 0x7f4f540b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.517+0000 7f4f5b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f54160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.517+0000 7f4f5b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f540b2b40 con 0x7f4f540ad840 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.517+0000 7f4f5b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f540b21e0 con 0x7f4f5415a910 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.517+0000 7f4f5b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f540b1bf0 con 0x7f4f54160ac0 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4f5415a910 0x7f4f540b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4f5415a910 0x7f4f540b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37268/0 (socket says 172.21.15.192:37268) 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 -- 172.21.15.192:0/3100858770 learned_addr learned my addr 172.21.15.192:0/3100858770 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f4be00640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f54160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 -- 172.21.15.192:0/3100858770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 msgr2=0x7f4f54160f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:55.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f54160f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 -- 172.21.15.192:0/3100858770 >> v1:172.21.15.194:6789/0 conn(0x7f4f540ad840 legacy=0x7f4f540cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.518+0000 7f4f53e00640 1 -- 172.21.15.192:0/3100858770 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54161510 con 0x7f4f5415a910 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.519+0000 7f4f53e00640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f5415a910 0x7f4f540b2600 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f4402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ed653f5b718baf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.519+0000 7f4f53400640 1 -- 172.21.15.192:0/3100858770 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44032440 con 0x7f4f5415a910 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f53400640 1 -- 172.21.15.192:0/3100858770 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f440325a0 con 0x7f4f5415a910 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f53400640 1 -- 172.21.15.192:0/3100858770 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44032930 con 0x7f4f5415a910 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 -- 172.21.15.192:0/3100858770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f5415a910 msgr2=0x7f4f540b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f5415a910 0x7f4f540b2600 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f4f44009870 tx=0x7f4f4402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 -- 172.21.15.192:0/3100858770 shutdown_connections 2024-09-13T18:41:55.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f54160f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 --2- 172.21.15.192:0/3100858770 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f5415a910 0x7f4f540b2600 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 -- 172.21.15.192:0/3100858770 >> 172.21.15.192:0/3100858770 conn(0x7f4f540b08f0 msgr2=0x7f4f540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 -- 172.21.15.192:0/3100858770 shutdown_connections 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.520+0000 7f4f5b200640 1 -- 172.21.15.192:0/3100858770 wait complete. 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.522+0000 7f4f5b200640 1 Processor -- start 2024-09-13T18:41:55.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.522+0000 7f4f5b200640 1 -- start start 2024-09-13T18:41:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f5415a910 0x7f4f5415d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f5406b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f541f5930 con 0x7f4f540ad840 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5415e290 con 0x7f4f5415a910 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f5b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5406ffe0 con 0x7f4f54160ac0 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37280/0 (socket says 172.21.15.192:37280) 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 -- 172.21.15.192:0/506933130 learned_addr learned my addr 172.21.15.192:0/506933130 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f59200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f5406b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f4be00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f5415a910 0x7f4f5415d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 -- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 msgr2=0x7f4f5406b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f5406b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 -- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f5415a910 msgr2=0x7f4f5415d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f5415a910 0x7f4f5415d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.523+0000 7f4f53e00640 1 -- 172.21.15.192:0/506933130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440094d0 con 0x7f4f540ad840 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f53e00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f44000c00 tx=0x7f4f440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44032440 con 0x7f4f540ad840 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f44030980 con 0x7f4f540ad840 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f44030d30 con 0x7f4f540ad840 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f540702c0 con 0x7f4f540ad840 2024-09-13T18:41:55.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.524+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f54070880 con 0x7f4f540ad840 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.525+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5415acf0 con 0x7f4f540ad840 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.526+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4f44039040 con 0x7f4f540ad840 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.527+0000 7f4f50c00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 0x7f4f3006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.527+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f440a9ca0 con 0x7f4f540ad840 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.527+0000 7f4f4be00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 0x7f4f3006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.528+0000 7f4f4be00640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 0x7f4f3006d0f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f540cb400 tx=0x7f4f3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.531+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4f44074e70 con 0x7f4f540ad840 2024-09-13T18:41:55.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.764+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4f54070120 con 0x7f4f540ad840 2024-09-13T18:41:55.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.768+0000 7f4f50c00640 1 -- 172.21.15.192:0/506933130 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4f54070120 con 0x7f4f540ad840 2024-09-13T18:41:55.771 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 msgr2=0x7f4f3006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 0x7f4f3006d0f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4f540cb400 tx=0x7f4f3c008040 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 msgr2=0x7f4f541f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f4f44000c00 tx=0x7f4f440046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 shutdown_connections 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4f3006ac30 0x7f4f3006d0f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4f54160ac0 0x7f4f5406b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4f5415a910 0x7f4f5415d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 --2- 172.21.15.192:0/506933130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f540ad840 0x7f4f541f2530 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 >> 172.21.15.192:0/506933130 conn(0x7f4f540b08f0 msgr2=0x7f4f5415fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:55.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 shutdown_connections 2024-09-13T18:41:55.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.771+0000 7f4f5b200640 1 -- 172.21.15.192:0/506933130 wait complete. 2024-09-13T18:41:55.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:55.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.938+0000 7f7086a00640 1 Processor -- start 2024-09-13T18:41:55.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.938+0000 7f7086a00640 1 -- start start 2024-09-13T18:41:55.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.939+0000 7f7086a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70800cacd0 0x7f708015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.939+0000 7f7086a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.939+0000 7f7086a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7080140480 con 0x7f70800cb0b0 2024-09-13T18:41:55.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.939+0000 7f7086a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70800cb520 con 0x7f70800cacd0 2024-09-13T18:41:55.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.939+0000 7f7086a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708015ee90 con 0x7f708015bc20 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f707fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70800cacd0 0x7f708015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f7084a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f707f400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f70800cb0b0 0x7f7080140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:48604/0 (socket says 172.21.15.192:48604) 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f7084a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:35604/0 (socket says 172.21.15.192:35604) 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f707fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70800cacd0 0x7f708015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:49464/0 (socket says 172.21.15.192:49464) 2024-09-13T18:41:55.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f707f400640 1 -- 172.21.15.192:0/3266985303 learned_addr learned my addr 172.21.15.192:0/3266985303 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.940+0000 7f707ea00640 1 -- 172.21.15.192:0/3266985303 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205902039 0 0) 0x7f7080140480 con 0x7f70800cb0b0 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f707ea00640 1 -- 172.21.15.192:0/3266985303 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7064003520 con 0x7f70800cb0b0 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f707fe00640 1 -- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 msgr2=0x7f70800afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f707fe00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f707fe00640 1 -- 172.21.15.192:0/3266985303 >> v1:172.21.15.194:6789/0 conn(0x7f70800cb0b0 legacy=0x7f7080140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f707fe00640 1 -- 172.21.15.192:0/3266985303 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708015f170 con 0x7f70800cacd0 2024-09-13T18:41:55.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.941+0000 7f7084a00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:55.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f707fe00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70800cacd0 0x7f708015e790 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f70700097a0 tx=0x7f707002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c93e8ce5ae3189c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.945 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f707ea00640 1 -- 172.21.15.192:0/3266985303 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070032440 con 0x7f70800cacd0 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f707ea00640 1 -- 172.21.15.192:0/3266985303 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70700325a0 con 0x7f70800cacd0 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f707ea00640 1 -- 172.21.15.192:0/3266985303 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7070032930 con 0x7f70800cacd0 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f7086a00640 1 -- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70800cacd0 msgr2=0x7f708015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f7086a00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70800cacd0 0x7f708015e790 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f70700097a0 tx=0x7f707002a180 comp rx=0 tx=0).stop 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f7086a00640 1 -- 172.21.15.192:0/3266985303 shutdown_connections 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.942+0000 7f7086a00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708015bc20 0x7f70800afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.943+0000 7f7086a00640 1 --2- 172.21.15.192:0/3266985303 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70800cacd0 0x7f708015e790 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.943+0000 7f7086a00640 1 -- 172.21.15.192:0/3266985303 >> 172.21.15.192:0/3266985303 conn(0x7f70800ae960 msgr2=0x7f708006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.943+0000 7f7086a00640 1 -- 172.21.15.192:0/3266985303 shutdown_connections 2024-09-13T18:41:55.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.943+0000 7f7086a00640 1 -- 172.21.15.192:0/3266985303 wait complete. 2024-09-13T18:41:55.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.944+0000 7f7086a00640 1 Processor -- start 2024-09-13T18:41:55.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.944+0000 7f7086a00640 1 -- start start 2024-09-13T18:41:55.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70800cacd0 0x7f70800ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 0x7f70801f1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708006c200 con 0x7f70800cb0b0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70801f15b0 con 0x7f708015bc20 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.945+0000 7f7086a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70800acff0 con 0x7f70800cacd0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37292/0 (socket says 172.21.15.192:37292) 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 -- 172.21.15.192:0/409129999 learned_addr learned my addr 172.21.15.192:0/409129999 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707fe00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70800cacd0 0x7f70800ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f7084a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 0x7f70801f1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 -- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70800cacd0 msgr2=0x7f70800ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70800cacd0 0x7f70800ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 -- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 msgr2=0x7f70801f1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 0x7f70801f1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 -- 172.21.15.192:0/409129999 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7078009a70 con 0x7f70800cb0b0 2024-09-13T18:41:55.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f7084a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 0x7f70801f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f707f400640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c410 tx=0x7f706c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.946+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c005ce0 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.947+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f706c005e40 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.947+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7070009400 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.947+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f706c0072f0 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.947+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70800ad380 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.948+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708015e790 con 0x7f70800cb0b0 2024-09-13T18:41:55.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.949+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f706c007510 con 0x7f70800cb0b0 2024-09-13T18:41:55.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.949+0000 7f7077e00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 0x7f706006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:55.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.950+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f706c088910 con 0x7f70800cb0b0 2024-09-13T18:41:55.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.950+0000 7f707fe00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 0x7f706006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:55.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.950+0000 7f707fe00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 0x7f706006d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:55.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:55.954+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f706c053c60 con 0x7f70800cb0b0 2024-09-13T18:41:56.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.155+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f708006c6c0 con 0x7f70800cb0b0 2024-09-13T18:41:56.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.156+0000 7f7077e00640 1 -- 172.21.15.192:0/409129999 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f706c017090 con 0x7f70800cb0b0 2024-09-13T18:41:56.159 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:56.159 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:41:56.159 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:41:56.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 msgr2=0x7f706006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 0x7f706006d0c0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7070034000 tx=0x7f707002e000 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 msgr2=0x7f70800ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f706c00c410 tx=0x7f706c00c8d0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 shutdown_connections 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706006ac00 0x7f706006d0c0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708015bc20 0x7f70801f1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70800cb0b0 0x7f70800ae090 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 --2- 172.21.15.192:0/409129999 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f70800cacd0 0x7f70800ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.158+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 >> 172.21.15.192:0/409129999 conn(0x7f70800ae960 msgr2=0x7f708013e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.159+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 shutdown_connections 2024-09-13T18:41:56.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.159+0000 7f7086a00640 1 -- 172.21.15.192:0/409129999 wait complete. 2024-09-13T18:41:56.328 INFO:tasks.ceph.mds.d.smithi194.stderr:2024-09-13T18:41:56.325+0000 7fca3ea00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:41:56.580 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 55, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:41:50.750546+0000', 'modified': '2024-09-13T18:41:53.767323+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7278': {'gid': 7278, 'name': 'd', 'rank': 0, 'incarnation': 51, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6835/1161965383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 1161965383}, {'type': 'v1', 'addr': '172.21.15.194:6835', 'nonce': 1161965383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:41:56.580 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:41:56.580 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-13T18:41:56.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.732+0000 7f08c0a00640 1 Processor -- start 2024-09-13T18:41:56.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.732+0000 7f08c0a00640 1 -- start start 2024-09-13T18:41:56.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.733+0000 7f08c0a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f08bc15dee0 0x7f08bc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.733+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc15e2c0 0x7f08bc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.733+0000 7f08c0a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08bc0b2f00 con 0x7f08bc0b3f10 2024-09-13T18:41:56.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.733+0000 7f08c0a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08bc0b3150 con 0x7f08bc15dee0 2024-09-13T18:41:56.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.733+0000 7f08c0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc0b3430 con 0x7f08bc15e2c0 2024-09-13T18:41:56.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f08bc15dee0 0x7f08bc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f08bc0b3f10 0x7f08bc15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60682/0 (socket says 172.21.15.192:60682) 2024-09-13T18:41:56.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9400640 1 -- 172.21.15.192:0/826978563 learned_addr learned my addr 172.21.15.192:0/826978563 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08ba800640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc15e2c0 0x7f08bc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9e00640 1 -- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc15e2c0 msgr2=0x7f08bc15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9e00640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc15e2c0 0x7f08bc15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9e00640 1 -- 172.21.15.192:0/826978563 >> v1:172.21.15.192:6789/0 conn(0x7f08bc0b3f10 legacy=0x7f08bc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b9e00640 1 -- 172.21.15.192:0/826978563 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08bc0b3710 con 0x7f08bc15dee0 2024-09-13T18:41:56.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.734+0000 7f08b8a00640 1 -- 172.21.15.192:0/826978563 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111691851 0 0) 0x7f08bc0b2f00 con 0x7f08bc0b3f10 2024-09-13T18:41:56.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.735+0000 7f08b9e00640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc0afd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0097a0 tx=0x7f08ac02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eebddfef2c7dcf1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08b8a00640 1 -- 172.21.15.192:0/826978563 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac032440 con 0x7f08bc15dee0 2024-09-13T18:41:56.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08b8a00640 1 -- 172.21.15.192:0/826978563 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac0325a0 con 0x7f08bc15dee0 2024-09-13T18:41:56.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08b8a00640 1 -- 172.21.15.192:0/826978563 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac032930 con 0x7f08bc15dee0 2024-09-13T18:41:56.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 -- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 msgr2=0x7f08bc0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc0afd80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f08ac0097a0 tx=0x7f08ac02a180 comp rx=0 tx=0).stop 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 -- 172.21.15.192:0/826978563 shutdown_connections 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc15e2c0 0x7f08bc15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 --2- 172.21.15.192:0/826978563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc0afd80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 -- 172.21.15.192:0/826978563 >> 172.21.15.192:0/826978563 conn(0x7f08bc0ae960 msgr2=0x7f08bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 -- 172.21.15.192:0/826978563 shutdown_connections 2024-09-13T18:41:56.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.736+0000 7f08c0a00640 1 -- 172.21.15.192:0/826978563 wait complete. 2024-09-13T18:41:56.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.738+0000 7f08c0a00640 1 Processor -- start 2024-09-13T18:41:56.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.738+0000 7f08c0a00640 1 -- start start 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc13e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc06a820 0x7f08bc06b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc06b030 con 0x7f08bc15e2c0 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc06ad50 con 0x7f08bc15dee0 2024-09-13T18:41:56.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08c0a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc13dba0 con 0x7f08bc06a820 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08b9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08b9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37302/0 (socket says 172.21.15.192:37302) 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08b9400640 1 -- 172.21.15.192:0/3887576408 learned_addr learned my addr 172.21.15.192:0/3887576408 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08b9e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc13e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.739+0000 7f08ba800640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc06a820 0x7f08bc06b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 -- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc06a820 msgr2=0x7f08bc06b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc06a820 0x7f08bc06b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 -- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 msgr2=0x7f08bc13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc13e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 -- 172.21.15.192:0/3887576408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac009400 con 0x7f08bc15e2c0 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9e00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b9400640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c4d0 tx=0x7f08a800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b2000640 1 -- 172.21.15.192:0/3887576408 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a80074e0 con 0x7f08bc15e2c0 2024-09-13T18:41:56.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b2000640 1 -- 172.21.15.192:0/3887576408 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a8007660 con 0x7f08bc15e2c0 2024-09-13T18:41:56.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc13de80 con 0x7f08bc15e2c0 2024-09-13T18:41:56.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08b2000640 1 -- 172.21.15.192:0/3887576408 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8004a20 con 0x7f08bc15e2c0 2024-09-13T18:41:56.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.740+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc13ebc0 con 0x7f08bc15e2c0 2024-09-13T18:41:56.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.742+0000 7f08b2000640 1 -- 172.21.15.192:0/3887576408 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08a8004b80 con 0x7f08bc15e2c0 2024-09-13T18:41:56.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.744+0000 7f08b2000640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 0x7f089c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.744+0000 7f08b2000640 1 -- 172.21.15.192:0/3887576408 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08a80888c0 con 0x7f08bc15e2c0 2024-09-13T18:41:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.744+0000 7f08b9e00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 0x7f089c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 Processor -- start 2024-09-13T18:41:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 -- start start 2024-09-13T18:41:56.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08b9e00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 0x7f089c06d0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08ac034000 tx=0x7f08ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561728673e90 0x5617286c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617285dfab0 con 0x5617286766d0 2024-09-13T18:41:56.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617285dd240 con 0x561728673e90 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.745+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617285d8b30 con 0x56172869db80 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37308/0 (socket says 172.21.15.192:37308) 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 -- 172.21.15.192:0/1998795296 learned_addr learned my addr 172.21.15.192:0/1998795296 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9400640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561728673e90 0x5617286c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08ba800640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 -- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 msgr2=0x5617286c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 -- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561728673e90 msgr2=0x5617286c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561728673e90 0x5617286c3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 -- 172.21.15.192:0/1998795296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617285a3bd0 con 0x5617286766d0 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08ba800640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:56.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.746+0000 7f08b9e00640 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009890 tx=0x7f08ac02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f212278d4380a1d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08a6a00640 1 -- 172.21.15.192:0/1998795296 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac004230 con 0x5617286766d0 2024-09-13T18:41:56.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08a6a00640 1 -- 172.21.15.192:0/1998795296 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08ac004390 con 0x5617286766d0 2024-09-13T18:41:56.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08a6a00640 1 -- 172.21.15.192:0/1998795296 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac03cb40 con 0x5617286766d0 2024-09-13T18:41:56.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 -- 172.21.15.192:0/1998795296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 msgr2=0x561728676ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f08ac009890 tx=0x7f08ac02c000 comp rx=0 tx=0).stop 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 -- 172.21.15.192:0/1998795296 shutdown_connections 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x561728673e90 0x5617286c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 --2- 172.21.15.192:0/1998795296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728676ab0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 -- 172.21.15.192:0/1998795296 >> 172.21.15.192:0/1998795296 conn(0x561728672e00 msgr2=0x5617286bb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 -- 172.21.15.192:0/1998795296 shutdown_connections 2024-09-13T18:41:56.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.747+0000 7f08c389c740 1 -- 172.21.15.192:0/1998795296 wait complete. 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.748+0000 7f08c389c740 1 -- start start 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.748+0000 7f08c389c740 1 Processor -- start 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56172869d3e0 0x5617286b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56172857a260 con 0x5617286766d0 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561728579f00 con 0x56172869d3e0 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56172833ff20 con 0x56172869db80 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08c389c740 10 client.0 _ll_register_callbacks cb 0x5617285d21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08b9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08b9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37314/0 (socket says 172.21.15.192:37314) 2024-09-13T18:41:56.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.749+0000 7f08b9e00640 1 -- 172.21.15.192:0/696511133 learned_addr learned my addr 172.21.15.192:0/696511133 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9400640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08ba800640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56172869d3e0 0x5617286b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 -- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 msgr2=0x5617286c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 -- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56172869d3e0 msgr2=0x5617286b85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56172869d3e0 0x5617286b85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 -- 172.21.15.192:0/696511133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc0b3710 con 0x5617286766d0 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9400640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:56.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08b9e00640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f08ac03c810 tx=0x7f08ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55081affba750e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f089b400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac003610 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08ac003770 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.750+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561728602cd0 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08ac003930 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 10 client.7407 fetch_fsmap learned FSMap version 55 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x5617285d71b0 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561728602cd0 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f08ac04e020 con 0x5617286766d0 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 10 client.7407 fetch_fsmap finished waiting for FSMap version 55 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 10 client.7407 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:41:56.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 20 client.7407 populate_metadata read hostname 'smithi192' 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x56172869f450 0x561728689d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 4 client.7407 mds_command: new command op to 7278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 --> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617282cc3c0 con 0x56172869f450 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.751+0000 7f08b9400640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x56172869f450 0x561728689d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.752+0000 7f08b9400640 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x56172869f450 0x561728689d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6720dbce1ffba593 server_cookie=b0b9fb64c16a1caa in_seq=0 out_seq=0 2024-09-13T18:41:56.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.752+0000 7f089b400640 10 client.7407 ms_handle_connect on v2:172.21.15.194:6833/1161965383 2024-09-13T18:41:56.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f089b400640 1 -- 172.21.15.192:0/696511133 <== mds.0 v2:172.21.15.194:6833/1161965383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x5617282cc3c0 con 0x56172869f450 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f089b400640 10 client.7407 handle_command_reply: tid=0 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 client.7407 shutdown 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 msgr2=0x561728689720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f08ac03c810 tx=0x7f08ac004730 comp rx=0 tx=0).stop 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 shutdown_connections 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x56172869f450 0x561728689d20 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56172869d3e0 0x5617286b85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869db80 0x5617286c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 --2- 172.21.15.192:0/696511133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x5617286766d0 0x561728689720 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f089b400640 0 client.7407 ms_handle_reset on v2:172.21.15.194:6833/1161965383 2024-09-13T18:41:56.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 >> 172.21.15.192:0/696511133 conn(0x561728673e90 msgr2=0x5617286befc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.753+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 shutdown_connections 2024-09-13T18:41:56.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.754+0000 7f08c389c740 1 -- 172.21.15.192:0/696511133 wait complete. 2024-09-13T18:41:56.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.754+0000 7f08c389c740 20 client.7407 trim_cache size 0 max 16384 2024-09-13T18:41:56.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.769+0000 7f08c389c740 1 Processor -- start 2024-09-13T18:41:56.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.769+0000 7f08c389c740 1 -- start start 2024-09-13T18:41:56.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x5617286bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x5617286a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617286a14c0 con 0x56172869db80 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617286bb520 con 0x5617286766d0 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617286b8570 con 0x56172869d3e0 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37326/0 (socket says 172.21.15.192:37326) 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 -- 172.21.15.192:0/515446439 learned_addr learned my addr 172.21.15.192:0/515446439 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08b9e00640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x5617286bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08b9400640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x5617286a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 -- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 msgr2=0x5617286a00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x5617286a00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 -- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 msgr2=0x5617286bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x5617286bd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.770+0000 7f08ba800640 1 -- 172.21.15.192:0/515446439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561728579470 con 0x56172869db80 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08b9e00640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x5617286bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08b9400640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x5617286a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08ba800640 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f08b4014610 tx=0x7f08b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00d24b75d99e971 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08a7400640 1 -- 172.21.15.192:0/515446439 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400e040 con 0x56172869db80 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08a7400640 1 -- 172.21.15.192:0/515446439 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b400f040 con 0x56172869db80 2024-09-13T18:41:56.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.771+0000 7f08a7400640 1 -- 172.21.15.192:0/515446439 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4016ab0 con 0x56172869db80 2024-09-13T18:41:56.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- 172.21.15.192:0/515446439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 msgr2=0x5617286a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f08b4014610 tx=0x7f08b4009750 comp rx=0 tx=0).stop 2024-09-13T18:41:56.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- 172.21.15.192:0/515446439 shutdown_connections 2024-09-13T18:41:56.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286a0600 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x5617286a00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 --2- 172.21.15.192:0/515446439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x5617286bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- 172.21.15.192:0/515446439 >> 172.21.15.192:0/515446439 conn(0x561728673e90 msgr2=0x56172869c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- 172.21.15.192:0/515446439 shutdown_connections 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- 172.21.15.192:0/515446439 wait complete. 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.772+0000 7f08c389c740 1 -- start start 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 Processor -- start 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x561728729270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x561728725510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617286b7330 con 0x56172869db80 2024-09-13T18:41:56.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x561728729cf0 con 0x5617286766d0 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.773+0000 7f08c389c740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x5617286a1910 con 0x56172869d3e0 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08c389c740 10 client.0 _ll_register_callbacks cb 0x7f08b40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37338/0 (socket says 172.21.15.192:37338) 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 -- 172.21.15.192:0/2370106621 learned_addr learned my addr 172.21.15.192:0/2370106621 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 -- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 msgr2=0x561728725510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x561728725510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 -- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 msgr2=0x561728729270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x561728729270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 -- 172.21.15.192:0/2370106621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b40142c0 con 0x56172869db80 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f08ba800640 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f08b401c000 tx=0x7f08b4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63863c8375c676d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f089b400640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.774+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b400e040 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b4028070 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561728676e20 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b4016d30 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 10 client.7413 fetch_fsmap learned FSMap version 55 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=2+}) v3 -- 0x56172859e980 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561728676e20 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 55) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f08b4004000 con 0x56172869db80 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 10 client.7413 fetch_fsmap finished waiting for FSMap version 55 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 10 client.7413 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 20 client.7413 populate_metadata read hostname 'smithi192' 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x5617286c9ad0 0x5617286c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 4 client.7413 mds_command: new command op to 7278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:41:56.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.775+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 --> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f08ac004390 con 0x5617286c9ad0 2024-09-13T18:41:56.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.776+0000 7f08b9e00640 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x5617286c9ad0 0x5617286c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.776+0000 7f089b400640 10 client.7413 ms_handle_connect on v2:172.21.15.194:6833/1161965383 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.776+0000 7f08b9e00640 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x5617286c9ad0 0x5617286c9eb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8be761bbd81f752 server_cookie=6028bd18a48bdd76 in_seq=0 out_seq=0 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f089b400640 1 -- 172.21.15.192:0/2370106621 <== mds.0 v2:172.21.15.194:6833/1161965383 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x7f08ac004390 con 0x5617286c9ad0 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f089b400640 10 client.7413 handle_command_reply: tid=0 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 client.7413 shutdown 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 msgr2=0x5617286b78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f08b401c000 tx=0x7f08b4004ab0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 shutdown_connections 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:6833/1161965383,v1:172.21.15.194:6835/1161965383] conn(0x5617286c9ad0 0x5617286c9eb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56172869db80 0x5617286b78d0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56172869d3e0 0x561728725510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 --2- 172.21.15.192:0/2370106621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x5617286766d0 0x561728729270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f089b400640 0 client.7413 ms_handle_reset on v2:172.21.15.194:6833/1161965383 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 >> 172.21.15.192:0/2370106621 conn(0x561728673e90 msgr2=0x56172869c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 shutdown_connections 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 1 -- 172.21.15.192:0/2370106621 wait complete. 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.777+0000 7f08c389c740 20 client.7413 trim_cache size 0 max 16384 2024-09-13T18:41:56.784 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 7278, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0242607939999999, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 55, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 134, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 134, 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 11.162548960000001 2024-09-13T18:41:56.785 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 msgr2=0x7f089c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 0x7f089c06d0f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f08ac034000 tx=0x7f08ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 msgr2=0x7f08bc138190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c4d0 tx=0x7f08a800c990 comp rx=0 tx=0).stop 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 shutdown_connections 2024-09-13T18:41:56.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f089c06ac30 0x7f089c06d0f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08bc06a820 0x7f08bc06b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08bc15e2c0 0x7f08bc138190 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 --2- 172.21.15.192:0/3887576408 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08bc15dee0 0x7f08bc13e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 >> 172.21.15.192:0/3887576408 conn(0x7f08bc0ae960 msgr2=0x7f08bc070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 shutdown_connections 2024-09-13T18:41:56.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.778+0000 7f08c0a00640 1 -- 172.21.15.192:0/3887576408 wait complete. 2024-09-13T18:41:56.797 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:41:56.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.947+0000 7f5d01e00640 1 Processor -- start 2024-09-13T18:41:56.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.947+0000 7f5d01e00640 1 -- start start 2024-09-13T18:41:56.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc1592d0 0x7f5cfc070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cfc06f830 con 0x7f5cfc0b3600 2024-09-13T18:41:56.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cfc0b3f80 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc06fa80 con 0x7f5cfc1592d0 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37340/0 (socket says 172.21.15.192:37340) 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d01400640 1 -- 172.21.15.192:0/1090806026 learned_addr learned my addr 172.21.15.192:0/1090806026 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.948+0000 7f5d00a00640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc1592d0 0x7f5cfc070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.949+0000 7f5d01400640 1 -- 172.21.15.192:0/1090806026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc1592d0 msgr2=0x7f5cfc070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.949+0000 7f5d01400640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc1592d0 0x7f5cfc070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.949+0000 7f5d01400640 1 -- 172.21.15.192:0/1090806026 >> v1:172.21.15.194:6789/0 conn(0x7f5cfc0b3600 legacy=0x7f5cfc06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.952 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.949+0000 7f5d01400640 1 -- 172.21.15.192:0/1090806026 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc06fd60 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.950+0000 7f5d01400640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf402a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ae02485d7bee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.950+0000 7f5cfb400640 1 -- 172.21.15.192:0/1090806026 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4031600 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.953 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.950+0000 7f5cfb400640 1 -- 172.21.15.192:0/1090806026 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf402d050 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.950+0000 7f5cfb400640 1 -- 172.21.15.192:0/1090806026 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf4031980 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 -- 172.21.15.192:0/1090806026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc06c3b0 msgr2=0x7f5cfc0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf402a710 comp rx=0 tx=0).stop 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 -- 172.21.15.192:0/1090806026 shutdown_connections 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc0b3a40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 --2- 172.21.15.192:0/1090806026 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc1592d0 0x7f5cfc070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 -- 172.21.15.192:0/1090806026 >> 172.21.15.192:0/1090806026 conn(0x7f5cfc0736d0 msgr2=0x7f5cfc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 -- 172.21.15.192:0/1090806026 shutdown_connections 2024-09-13T18:41:56.954 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.951+0000 7f5d01e00640 1 -- 172.21.15.192:0/1090806026 wait complete. 2024-09-13T18:41:56.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.952+0000 7f5d01e00640 1 Processor -- start 2024-09-13T18:41:56.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.952+0000 7f5d01e00640 1 -- start start 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc14fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc0b3600 0x7f5cfc1f2570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0af370 con 0x7f5cfc1592d0 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0af650 con 0x7f5cfc06c3b0 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.953+0000 7f5d01e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cfc0af930 con 0x7f5cfc0b3600 2024-09-13T18:41:56.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37352/0 (socket says 172.21.15.192:37352) 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 -- 172.21.15.192:0/845966745 learned_addr learned my addr 172.21.15.192:0/845966745 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5cfbe00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc0b3600 0x7f5cfc1f2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d00a00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc14fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 -- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc0b3600 msgr2=0x7f5cfc1f2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc0b3600 0x7f5cfc1f2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 -- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cfc06c3b0 msgr2=0x7f5cfc14fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc14fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.954+0000 7f5d01400640 1 -- 172.21.15.192:0/845966745 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf4009b30 con 0x7f5cfc1592d0 2024-09-13T18:41:56.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5d01400640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf403d860 con 0x7f5cfc1592d0 2024-09-13T18:41:56.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cf403d9c0 con 0x7f5cfc1592d0 2024-09-13T18:41:56.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cfc0afc10 con 0x7f5cfc1592d0 2024-09-13T18:41:56.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf403dd70 con 0x7f5cfc1592d0 2024-09-13T18:41:56.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.955+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cfc14ffa0 con 0x7f5cfc1592d0 2024-09-13T18:41:56.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.956+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cfc0b0130 con 0x7f5cfc1592d0 2024-09-13T18:41:56.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.957+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5cf403b400 con 0x7f5cfc1592d0 2024-09-13T18:41:56.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.958+0000 7f5cf8c00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 0x7f5cdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:56.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.958+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5cf40aa150 con 0x7f5cfc1592d0 2024-09-13T18:41:56.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.958+0000 7f5d00a00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 0x7f5cdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:56.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.959+0000 7f5d00a00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 0x7f5cdc06d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00aba0 tx=0x7f5cec00a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:56.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:56.963+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5cfc0b0130 con 0x7f5cfc1592d0 2024-09-13T18:41:57.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.162+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cfc0b0130 con 0x7f5cfc1592d0 2024-09-13T18:41:57.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.163+0000 7f5cf8c00640 1 -- 172.21.15.192:0/845966745 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5cfc0b0130 con 0x7f5cfc1592d0 2024-09-13T18:41:57.166 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 msgr2=0x7f5cdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 0x7f5cdc06d0c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5cec00aba0 tx=0x7f5cec00a2a0 comp rx=0 tx=0).stop 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 msgr2=0x7f5cfc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4009e50 tx=0x7f5cf4004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 shutdown_connections 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5cdc06ac00 0x7f5cdc06d0c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5cfc1592d0 0x7f5cfc0ad840 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:57.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5cfc0b3600 0x7f5cfc1f2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:57.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 --2- 172.21.15.192:0/845966745 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5cfc06c3b0 0x7f5cfc14fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:57.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 >> 172.21.15.192:0/845966745 conn(0x7f5cfc0736d0 msgr2=0x7f5cfc154c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:57.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 shutdown_connections 2024-09-13T18:41:57.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:57.165+0000 7f5d01e00640 1 -- 172.21.15.192:0/845966745 wait complete. 2024-09-13T18:41:57.183 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:41:57.183 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:41:57.183 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:41:57.184 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:57.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.184 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:57.220 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.221 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:57.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.223 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:41:57.314 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:41:57.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.317 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:41:57.353 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:41:57.353 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:41:57.353 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:41:57.353 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:41:57.353 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:41:57.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:41:57.354 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:41:57.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.498 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:41:57.535 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:41:57.535 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:41:57.535 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:57.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.535 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:41:57.630 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:57.630 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:57.666 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:41:57.666 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:57.666 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:57.741 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:41:57.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:57.869 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:57.869 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:57.896 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:57.896 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:57.896 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:41:57.896 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:41:57.897 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:41:57.898 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:41:57.898 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:41:57.898 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:41:57.898 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:41:57.898 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:41:57.901 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:41:57.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:41:57.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:57.958 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:41:58.005 INFO:teuthology.orchestra.run.smithi192.stdout:client7048 2024-09-13T18:41:58.005 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:41:58.005 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:58.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:41:58.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.230+0000 7fef79c00640 1 Processor -- start 2024-09-13T18:41:58.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.230+0000 7fef79c00640 1 -- start start 2024-09-13T18:41:58.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef79c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7415dee0 0x7fef740afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef79c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef740b3f10 0x7fef740b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef79c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef740b2f00 con 0x7fef7415e2c0 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef79c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef740b3150 con 0x7fef740b3f10 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef79c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef740b3430 con 0x7fef7415dee0 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef740b3f10 0x7fef740b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fef740b3f10 0x7fef740b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37358/0 (socket says 172.21.15.192:37358) 2024-09-13T18:41:58.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 -- 172.21.15.192:0/701046472 learned_addr learned my addr 172.21.15.192:0/701046472 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72a00640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7415dee0 0x7fef740afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 -- 172.21.15.192:0/701046472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7415dee0 msgr2=0x7fef740afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7415dee0 0x7fef740afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 -- 172.21.15.192:0/701046472 >> v1:172.21.15.194:6789/0 conn(0x7fef7415e2c0 legacy=0x7fef7415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.232+0000 7fef72000640 1 -- 172.21.15.192:0/701046472 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef740b3710 con 0x7fef740b3f10 2024-09-13T18:41:58.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.233+0000 7fef72000640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef740b3f10 0x7fef740b02c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fef60009870 tx=0x7fef6002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4b18dd616eb4efd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:58.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef71600640 1 -- 172.21.15.192:0/701046472 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60032440 con 0x7fef740b3f10 2024-09-13T18:41:58.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef71600640 1 -- 172.21.15.192:0/701046472 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef600325a0 con 0x7fef740b3f10 2024-09-13T18:41:58.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef71600640 1 -- 172.21.15.192:0/701046472 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60032930 con 0x7fef740b3f10 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 -- 172.21.15.192:0/701046472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef740b3f10 msgr2=0x7fef740b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef740b3f10 0x7fef740b02c0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fef60009870 tx=0x7fef6002a270 comp rx=0 tx=0).stop 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 -- 172.21.15.192:0/701046472 shutdown_connections 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef740b3f10 0x7fef740b02c0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 --2- 172.21.15.192:0/701046472 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef7415dee0 0x7fef740afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 -- 172.21.15.192:0/701046472 >> 172.21.15.192:0/701046472 conn(0x7fef740ae960 msgr2=0x7fef7406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.234+0000 7fef79c00640 1 -- 172.21.15.192:0/701046472 shutdown_connections 2024-09-13T18:41:58.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.235+0000 7fef79c00640 1 -- 172.21.15.192:0/701046472 wait complete. 2024-09-13T18:41:58.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.236+0000 7fef79c00640 1 Processor -- start 2024-09-13T18:41:58.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.236+0000 7fef79c00640 1 -- start start 2024-09-13T18:41:58.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7415dee0 0x7fef74070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 0x7fef74151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7415bc50 con 0x7fef7415e2c0 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7413bb20 con 0x7fef7415dee0 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef79c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef74151cc0 con 0x7fef74151150 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef72000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef72000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37364/0 (socket says 172.21.15.192:37364) 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.237+0000 7fef72000640 1 -- 172.21.15.192:0/1655230638 learned_addr learned my addr 172.21.15.192:0/1655230638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72a00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7415dee0 0x7fef74070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef73400640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 0x7fef74151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 -- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 msgr2=0x7fef74151600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 0x7fef74151600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 -- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7415dee0 msgr2=0x7fef74070450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7415dee0 0x7fef74070450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 -- 172.21.15.192:0/1655230638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef600094d0 con 0x7fef7415e2c0 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef73400640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 0x7fef74151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef72000640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fef60000c00 tx=0x7fef600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60032440 con 0x7fef7415e2c0 2024-09-13T18:41:58.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef60030b80 con 0x7fef7415e2c0 2024-09-13T18:41:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.238+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef74151fa0 con 0x7fef7415e2c0 2024-09-13T18:41:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.239+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6003d440 con 0x7fef7415e2c0 2024-09-13T18:41:58.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.239+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7415c180 con 0x7fef7415e2c0 2024-09-13T18:41:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.240+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef740b4a30 con 0x7fef7415e2c0 2024-09-13T18:41:58.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.240+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fef60039040 con 0x7fef7415e2c0 2024-09-13T18:41:58.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.242+0000 7fef6aa00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 0x7fef5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:58.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.242+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef600a9e90 con 0x7fef7415e2c0 2024-09-13T18:41:58.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.242+0000 7fef72a00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 0x7fef5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:58.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.243+0000 7fef72a00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 0x7fef5406d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fef64006fd0 tx=0x7fef64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:58.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.246+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fef60074fd0 con 0x7fef7415e2c0 2024-09-13T18:41:58.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.452+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fef74158b10 con 0x7fef7415e2c0 2024-09-13T18:41:58.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.453+0000 7fef6aa00640 1 -- 172.21.15.192:0/1655230638 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v55) v1 ==== 53+0+73 (secure 0 0 0) 0x7fef600785f0 con 0x7fef7415e2c0 2024-09-13T18:41:58.455 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 msgr2=0x7fef5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 0x7fef5406d0c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fef64006fd0 tx=0x7fef64008040 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 msgr2=0x7fef741547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7fef60000c00 tx=0x7fef600046c0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 shutdown_connections 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fef5406ac00 0x7fef5406d0c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fef74151150 0x7fef74151600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef7415e2c0 0x7fef741547a0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 --2- 172.21.15.192:0/1655230638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fef7415dee0 0x7fef74070450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:58.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 >> 172.21.15.192:0/1655230638 conn(0x7fef740ae960 msgr2=0x7fef7406f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:58.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 shutdown_connections 2024-09-13T18:41:58.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:58.455+0000 7fef79c00640 1 -- 172.21.15.192:0/1655230638 wait complete. 2024-09-13T18:41:58.474 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:41:58.474 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:41:58.474 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:41:58.475 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:58.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.476 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:41:58.516 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:41:58.516 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:41:58.516 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:41:58.516 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:58.517 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42396sec preferred_lft 42396sec 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:58.518 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:41:58.519 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:41:58.519 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.519 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:41:58.519 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:41:58.520 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:41:58.520 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:41:58.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.520 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:41:58.613 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:41:58.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.616 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:41:58.653 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:41:58.653 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:41:58.653 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:41:58.654 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:41:58.654 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:41:58.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:41:58.654 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:41:58.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.803 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:41:58.838 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:41:58.839 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:41:58.839 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:58.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:58.839 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:41:58.934 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:58.934 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:58.970 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:41:58.970 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:41:58.970 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:59.044 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:41:59.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:59.045 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:59.173 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:59.173 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:41:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:41:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:41:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:41:59.201 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:41:59.203 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:41:59.203 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:41:59.203 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:41:59.203 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:41:59.204 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:41:59.207 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:41:59.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:59.207 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:41:59.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:41:59.262 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:41:59.299 INFO:teuthology.orchestra.run.smithi194.stdout:client7428 2024-09-13T18:41:59.299 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:41:59.299 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:41:59.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:41:59.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.534+0000 7fdc10600640 1 Processor -- start 2024-09-13T18:41:59.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.534+0000 7fdc10600640 1 -- start start 2024-09-13T18:41:59.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.535+0000 7fdc10600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc080b0490 0x7fdc080cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:59.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.535+0000 7fdc10600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0815ec00 con 0x7fdc0815e790 2024-09-13T18:41:59.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.535+0000 7fdc10600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc08140480 con 0x7fdc080cacd0 2024-09-13T18:41:59.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.535+0000 7fdc10600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc080cb5f0 con 0x7fdc080b0490 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0d200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdc0815e790 0x7fdc080afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:60688/0 (socket says 172.21.15.192:60688) 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0e600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdc080b0490 0x7fdc080cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0d200640 1 -- 172.21.15.192:0/614131093 learned_addr learned my addr 172.21.15.192:0/614131093 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0e600640 1 -- 172.21.15.192:0/614131093 >> v1:172.21.15.194:6789/0 conn(0x7fdc080cacd0 legacy=0x7fdc08140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0e600640 1 -- 172.21.15.192:0/614131093 >> v1:172.21.15.192:6789/0 conn(0x7fdc0815e790 legacy=0x7fdc080afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.536+0000 7fdc0e600640 1 -- 172.21.15.192:0/614131093 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0815ee90 con 0x7fdc080b0490 2024-09-13T18:41:59.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.537+0000 7fdc0e600640 1 --2- 172.21.15.192:0/614131093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc080b0490 0x7fdc080cb0b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009d90 tx=0x7fdc0002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bda02b8bc6980a2b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:59.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.537+0000 7fdc07e00640 1 -- 172.21.15.192:0/614131093 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007740 con 0x7fdc080b0490 2024-09-13T18:41:59.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.537+0000 7fdc07e00640 1 -- 172.21.15.192:0/614131093 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0002d050 con 0x7fdc080b0490 2024-09-13T18:41:59.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.537+0000 7fdc07e00640 1 -- 172.21.15.192:0/614131093 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00007ac0 con 0x7fdc080b0490 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 -- 172.21.15.192:0/614131093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc080b0490 msgr2=0x7fdc080cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 --2- 172.21.15.192:0/614131093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc080b0490 0x7fdc080cb0b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009d90 tx=0x7fdc0002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 -- 172.21.15.192:0/614131093 shutdown_connections 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 --2- 172.21.15.192:0/614131093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc080b0490 0x7fdc080cb0b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 -- 172.21.15.192:0/614131093 >> 172.21.15.192:0/614131093 conn(0x7fdc080ae960 msgr2=0x7fdc0806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 -- 172.21.15.192:0/614131093 shutdown_connections 2024-09-13T18:41:59.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.538+0000 7fdc10600640 1 -- 172.21.15.192:0/614131093 wait complete. 2024-09-13T18:41:59.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.540+0000 7fdc10600640 1 Processor -- start 2024-09-13T18:41:59.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.540+0000 7fdc10600640 1 -- start start 2024-09-13T18:41:59.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.540+0000 7fdc10600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc080b0490 0x7fdc0813d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc10600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc080cacd0 0x7fdc08069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc10600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc10600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc08157f60 con 0x7fdc0815e790 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc10600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0806bfb0 con 0x7fdc080cacd0 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc10600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc0806a5a0 con 0x7fdc080b0490 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37376/0 (socket says 172.21.15.192:37376) 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 -- 172.21.15.192:0/4048097457 learned_addr learned my addr 172.21.15.192:0/4048097457 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0dc00640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc080b0490 0x7fdc0813d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0d200640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc080cacd0 0x7fdc08069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 -- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc080b0490 msgr2=0x7fdc0813d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc080b0490 0x7fdc0813d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 -- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc080cacd0 msgr2=0x7fdc08069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc080cacd0 0x7fdc08069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.541+0000 7fdc0e600640 1 -- 172.21.15.192:0/4048097457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00009a70 con 0x7fdc0815e790 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc0e600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009d90 tx=0x7fdc00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc00003b90 con 0x7fdc0815e790 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc00003cf0 con 0x7fdc0815e790 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc0806a880 con 0x7fdc0815e790 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc000319d0 con 0x7fdc0815e790 2024-09-13T18:41:59.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.542+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc0806ae40 con 0x7fdc0815e790 2024-09-13T18:41:59.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.543+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc080cb0b0 con 0x7fdc0815e790 2024-09-13T18:41:59.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.544+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdc0002ad50 con 0x7fdc0815e790 2024-09-13T18:41:59.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.545+0000 7fdc05600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:41:59.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.545+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc000aa370 con 0x7fdc0815e790 2024-09-13T18:41:59.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.545+0000 7fdc0dc00640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:41:59.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.545+0000 7fdc0dc00640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 0x7fdbe806d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000f60 tx=0x7fdbfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:41:59.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.549+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdc000755f0 con 0x7fdc0815e790 2024-09-13T18:41:59.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.747+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc0806b000 con 0x7fdc0815e790 2024-09-13T18:41:59.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.748+0000 7fdc05600640 1 -- 172.21.15.192:0/4048097457 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fdc00078c10 con 0x7fdc0815e790 2024-09-13T18:41:59.751 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:41:59.751 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:41:59.752 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:41:59.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.750+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 msgr2=0x7fdbe806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.750+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 0x7fdbe806d0c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc000f60 tx=0x7fdbfc009040 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.750+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 msgr2=0x7fdc08157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.750+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fdc00009d90 tx=0x7fdc00004a40 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 shutdown_connections 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdbe806ac00 0x7fdbe806d0c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc0815e790 0x7fdc08157a20 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdc080cacd0 0x7fdc08069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 --2- 172.21.15.192:0/4048097457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdc080b0490 0x7fdc0813d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 >> 172.21.15.192:0/4048097457 conn(0x7fdc080ae960 msgr2=0x7fdc0815d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 shutdown_connections 2024-09-13T18:41:59.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:41:59.751+0000 7fdc10600640 1 -- 172.21.15.192:0/4048097457 wait complete. 2024-09-13T18:41:59.770 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2024-09-13T18:41:59.942 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":7278,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.1747448719999998,"mdsmap_epoch":55,"osdmap_epoch":134,"osdmap_epoch_barrier":134,"uptime":14.313034182000001} 2024-09-13T18:41:59.942 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 7278, "mdsmap_epoch": 55, "osdmap_epoch": 134, "osdmap_epoch_barrier": 134, "rank_uptime": 9.174744872, "state": "up:active", "uptime": 14.313034182, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:41:59.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-13T18:42:00.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.096+0000 7fa7a3200640 1 Processor -- start 2024-09-13T18:42:00.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.097+0000 7fa7a3200640 1 -- start start 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a3200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa79c13e2e0 0x7fa79c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa79c0cc9c0 0x7fa79c0cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c13ec90 con 0x7fa79c15e880 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a3200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c15f760 con 0x7fa79c13e2e0 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa79c0ce970 con 0x7fa79c0cc9c0 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa79c13e2e0 0x7fa79c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a1400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa79c13e2e0 0x7fa79c13e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37380/0 (socket says 172.21.15.192:37380) 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a1400640 1 -- 172.21.15.192:0/3523412615 learned_addr learned my addr 172.21.15.192:0/3523412615 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:00.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.098+0000 7fa7a2800640 1 --2- 172.21.15.192:0/3523412615 >> v2:172.21.15.194:3300/0 conn(0x7fa79c0cc9c0 0x7fa79c0cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.099+0000 7fa7a1400640 1 -- 172.21.15.192:0/3523412615 >> v2:172.21.15.194:3300/0 conn(0x7fa79c0cc9c0 msgr2=0x7fa79c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:00.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.099+0000 7fa7a1400640 1 --2- 172.21.15.192:0/3523412615 >> v2:172.21.15.194:3300/0 conn(0x7fa79c0cc9c0 0x7fa79c0cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.099+0000 7fa7a1400640 1 -- 172.21.15.192:0/3523412615 >> v1:172.21.15.194:6789/0 conn(0x7fa79c15e880 legacy=0x7fa79c15ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.099+0000 7fa7a1400640 1 -- 172.21.15.192:0/3523412615 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c13eef0 con 0x7fa79c13e2e0 2024-09-13T18:42:00.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a1400640 1 --2- 172.21.15.192:0/3523412615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c13e750 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0b41b0 tx=0x7fa78c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f873971af7d077b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:00.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a0a00640 1 -- 172.21.15.192:0/3523412615 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c032440 con 0x7fa79c13e2e0 2024-09-13T18:42:00.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a0a00640 1 -- 172.21.15.192:0/3523412615 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c0325a0 con 0x7fa79c13e2e0 2024-09-13T18:42:00.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a0a00640 1 -- 172.21.15.192:0/3523412615 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c032930 con 0x7fa79c13e2e0 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 -- 172.21.15.192:0/3523412615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 msgr2=0x7fa79c13e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 --2- 172.21.15.192:0/3523412615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c13e750 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fa79c0b41b0 tx=0x7fa78c02a270 comp rx=0 tx=0).stop 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 -- 172.21.15.192:0/3523412615 shutdown_connections 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 --2- 172.21.15.192:0/3523412615 >> v2:172.21.15.194:3300/0 conn(0x7fa79c0cc9c0 0x7fa79c0cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 --2- 172.21.15.192:0/3523412615 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c13e750 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.100+0000 7fa7a3200640 1 -- 172.21.15.192:0/3523412615 >> 172.21.15.192:0/3523412615 conn(0x7fa79c073490 msgr2=0x7fa79c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.101+0000 7fa7a3200640 1 -- 172.21.15.192:0/3523412615 shutdown_connections 2024-09-13T18:42:00.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.101+0000 7fa7a3200640 1 -- 172.21.15.192:0/3523412615 wait complete. 2024-09-13T18:42:00.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.102+0000 7fa7a3200640 1 Processor -- start 2024-09-13T18:42:00.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.102+0000 7fa7a3200640 1 -- start start 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa79c0cc9c0 0x7fa79c1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa79c15e880 0x7fa79c0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1f6e90 con 0x7fa79c13e2e0 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1f2970 con 0x7fa79c15e880 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b34b0 con 0x7fa79c0cc9c0 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.103+0000 7fa7a1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37382/0 (socket says 172.21.15.192:37382) 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 -- 172.21.15.192:0/1823298938 learned_addr learned my addr 172.21.15.192:0/1823298938 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:00.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a2800640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa79c15e880 0x7fa79c0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1e00640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa79c0cc9c0 0x7fa79c1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 -- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa79c0cc9c0 msgr2=0x7fa79c1f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa79c0cc9c0 0x7fa79c1f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 -- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa79c15e880 msgr2=0x7fa79c0b1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa79c15e880 0x7fa79c0b1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 -- 172.21.15.192:0/1823298938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c0094d0 con 0x7fa79c13e2e0 2024-09-13T18:42:00.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.104+0000 7fa7a1400640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.105+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c032440 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.105+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c030980 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.105+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c030d30 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.105+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c15ac40 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.105+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1f68d0 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.106+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c067b10 con 0x7fa79c13e2e0 2024-09-13T18:42:00.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.107+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa78c039040 con 0x7fa79c13e2e0 2024-09-13T18:42:00.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.108+0000 7fa796000640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:00.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.108+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa78c0a9a20 con 0x7fa79c13e2e0 2024-09-13T18:42:00.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.108+0000 7fa7a1e00640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:00.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.109+0000 7fa7a1e00640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 0x7fa78006d0c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa790000f60 tx=0x7fa790009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:00.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.112+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa78c074d30 con 0x7fa79c13e2e0 2024-09-13T18:42:00.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.283+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fa79c13ff90 con 0x7fa79c13e2e0 2024-09-13T18:42:00.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.806+0000 7fa796000640 1 -- 172.21.15.192:0/1823298938 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v135) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa78c0370c0 con 0x7fa79c13e2e0 2024-09-13T18:42:00.809 INFO:teuthology.orchestra.run.smithi192.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-13T18:42:00.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 msgr2=0x7fa78006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 0x7fa78006d0c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa790000f60 tx=0x7fa790009040 comp rx=0 tx=0).stop 2024-09-13T18:42:00.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 msgr2=0x7fa79c1f30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fa78c000c00 tx=0x7fa78c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 shutdown_connections 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa78006ac00 0x7fa78006d0c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa79c15e880 0x7fa79c0b1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa79c13e2e0 0x7fa79c1f30a0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 --2- 172.21.15.192:0/1823298938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa79c0cc9c0 0x7fa79c1f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 >> 172.21.15.192:0/1823298938 conn(0x7fa79c073490 msgr2=0x7fa79c0ae720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 shutdown_connections 2024-09-13T18:42:00.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:00.809+0000 7fa7a3200640 1 -- 172.21.15.192:0/1823298938 wait complete. 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:42:00.830 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:42:00.831 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:42:01.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:01.115 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:01.194 INFO:teuthology.orchestra.run.smithi192.stdout:client7048 2024-09-13T18:42:01.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:01.195 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client7048/osdmap') 2024-09-13T18:42:01.290 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 134 barrier 134 flags 0x588000 2024-09-13T18:42:01.290 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:01.290 INFO:teuthology.orchestra.run.smithi192.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:42:01.291 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:42:01.292 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:42:01.292 INFO:teuthology.orchestra.run.smithi192.stderr:803 bytes copied, 9.905e-05 s, 8.1 MB/s 2024-09-13T18:42:01.293 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2024-09-13T18:42:01.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.443+0000 7f7038e00640 1 Processor -- start 2024-09-13T18:42:01.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.443+0000 7f7038e00640 1 -- start start 2024-09-13T18:42:01.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7038e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 0x7f703415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7038e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f703415bc20 0x7f70340afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7038e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7034140480 con 0x7f70340cb0b0 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7038e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70340cb520 con 0x7f703415bc20 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7038e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f703415ee90 con 0x7f70340cacd0 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7032800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f703415bc20 0x7f70340afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7031400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f70340cb0b0 0x7f7034140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41818/0 (socket says 172.21.15.192:41818) 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.444+0000 7f7031400640 1 -- 172.21.15.192:0/1391420986 learned_addr learned my addr 172.21.15.192:0/1391420986 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:01.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7031e00640 1 --2- 172.21.15.192:0/1391420986 >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 0x7f703415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7032800640 1 -- 172.21.15.192:0/1391420986 >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 msgr2=0x7f703415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:01.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7032800640 1 --2- 172.21.15.192:0/1391420986 >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 0x7f703415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7032800640 1 -- 172.21.15.192:0/1391420986 >> v1:172.21.15.192:6789/0 conn(0x7f70340cb0b0 legacy=0x7f7034140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7032800640 1 -- 172.21.15.192:0/1391420986 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f703415f170 con 0x7f703415bc20 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7030a00640 1 -- 172.21.15.192:0/1391420986 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532757092 0 0) 0x7f7034140480 con 0x7f70340cb0b0 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.445+0000 7f7031e00640 1 --2- 172.21.15.192:0/1391420986 >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 0x7f703415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.446+0000 7f7032800640 1 --2- 172.21.15.192:0/1391420986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f703415bc20 0x7f70340afd80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f70340b2350 tx=0x7f702c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04a2d4e0aa35847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.446+0000 7f7030a00640 1 -- 172.21.15.192:0/1391420986 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c02aea0 con 0x7f703415bc20 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.446+0000 7f7030a00640 1 -- 172.21.15.192:0/1391420986 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702c02d050 con 0x7f703415bc20 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.446+0000 7f7030a00640 1 -- 172.21.15.192:0/1391420986 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702c007960 con 0x7f703415bc20 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 -- 172.21.15.192:0/1391420986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f703415bc20 msgr2=0x7f70340afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 --2- 172.21.15.192:0/1391420986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f703415bc20 0x7f70340afd80 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f70340b2350 tx=0x7f702c02a680 comp rx=0 tx=0).stop 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 -- 172.21.15.192:0/1391420986 shutdown_connections 2024-09-13T18:42:01.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 --2- 172.21.15.192:0/1391420986 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f703415bc20 0x7f70340afd80 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 --2- 172.21.15.192:0/1391420986 >> v2:172.21.15.194:3300/0 conn(0x7f70340cacd0 0x7f703415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 -- 172.21.15.192:0/1391420986 >> 172.21.15.192:0/1391420986 conn(0x7f70340ae960 msgr2=0x7f703406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:01.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 -- 172.21.15.192:0/1391420986 shutdown_connections 2024-09-13T18:42:01.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.447+0000 7f7038e00640 1 -- 172.21.15.192:0/1391420986 wait complete. 2024-09-13T18:42:01.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.448+0000 7f7038e00640 1 Processor -- start 2024-09-13T18:42:01.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.448+0000 7f7038e00640 1 -- start start 2024-09-13T18:42:01.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70340cacd0 0x7f703413d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f703415bc20 0x7f703406ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034155f20 con 0x7f70340cb0b0 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7034155d20 con 0x7f70340cacd0 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.449+0000 7f7038e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7034159980 con 0x7f703415bc20 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36686/0 (socket says 172.21.15.192:36686) 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 -- 172.21.15.192:0/217714019 learned_addr learned my addr 172.21.15.192:0/217714019 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70340cacd0 0x7f703413d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7032800640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f703415bc20 0x7f703406ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 -- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f703415bc20 msgr2=0x7f703406ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f703415bc20 0x7f703406ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 -- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70340cacd0 msgr2=0x7f703413d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70340cacd0 0x7f703413d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 -- 172.21.15.192:0/217714019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702c009a70 con 0x7f70340cb0b0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.450+0000 7f7031400640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f702000c4a0 tx=0x7f702000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.451+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200074e0 con 0x7f70340cb0b0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.451+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7020007640 con 0x7f70340cb0b0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.451+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004a00 con 0x7f70340cb0b0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.451+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7034159c60 con 0x7f70340cb0b0 2024-09-13T18:42:01.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.451+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703415a220 con 0x7f70340cb0b0 2024-09-13T18:42:01.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.452+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703406f3e0 con 0x7f70340cb0b0 2024-09-13T18:42:01.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.453+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7020004b60 con 0x7f70340cb0b0 2024-09-13T18:42:01.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.454+0000 7f702a000640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 0x7f701406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.454+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70200884b0 con 0x7f70340cb0b0 2024-09-13T18:42:01.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.454+0000 7f7031e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 0x7f701406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.454+0000 7f7031e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 0x7f701406d0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:01.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.458+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7020053690 con 0x7f70340cb0b0 2024-09-13T18:42:01.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.635+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f703415e790 con 0x7f70340cb0b0 2024-09-13T18:42:01.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.813+0000 7f702a000640 1 -- 172.21.15.192:0/217714019 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v136) v1 ==== 93+0+0 (secure 0 0 0) 0x7f7020056cb0 con 0x7f70340cb0b0 2024-09-13T18:42:01.816 INFO:teuthology.orchestra.run.smithi192.stderr:pauserd,pausewr is set 2024-09-13T18:42:01.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 msgr2=0x7f701406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 0x7f701406d0c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7024006fd0 tx=0x7f7024008040 comp rx=0 tx=0).stop 2024-09-13T18:42:01.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 msgr2=0x7f703406a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f702000c4a0 tx=0x7f702000c960 comp rx=0 tx=0).stop 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 shutdown_connections 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f701406ac00 0x7f701406d0c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f703415bc20 0x7f703406ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f70340cb0b0 0x7f703406a720 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 --2- 172.21.15.192:0/217714019 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f70340cacd0 0x7f703413d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 >> 172.21.15.192:0/217714019 conn(0x7f70340ae960 msgr2=0x7f7034140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.815+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 shutdown_connections 2024-09-13T18:42:01.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.816+0000 7f7038e00640 1 -- 172.21.15.192:0/217714019 wait complete. 2024-09-13T18:42:01.835 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2024-09-13T18:42:01.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.986+0000 7fe09f600640 1 Processor -- start 2024-09-13T18:42:01.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.986+0000 7fe09f600640 1 -- start start 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 0x7fe0980afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0980b3f10 0x7fe0980b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 0x7fe09815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0980b2f00 con 0x7fe0980b3f10 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0980b3150 con 0x7fe09815e2c0 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.987+0000 7fe09f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980b3430 con 0x7fe09815dee0 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0980b3f10 0x7fe0980b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe0980b3f10 0x7fe0980b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36690/0 (socket says 172.21.15.192:36690) 2024-09-13T18:42:01.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 -- 172.21.15.192:0/753181303 learned_addr learned my addr 172.21.15.192:0/753181303 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe09d600640 1 --2- 172.21.15.192:0/753181303 >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 0x7fe09815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe09cc00640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 0x7fe0980afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 -- 172.21.15.192:0/753181303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 msgr2=0x7fe0980afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 0x7fe0980afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 -- 172.21.15.192:0/753181303 >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 msgr2=0x7fe09815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 --2- 172.21.15.192:0/753181303 >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 0x7fe09815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe097e00640 1 -- 172.21.15.192:0/753181303 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0980b3710 con 0x7fe0980b3f10 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe09d600640 1 --2- 172.21.15.192:0/753181303 >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 0x7fe09815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:01.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.988+0000 7fe09cc00640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 0x7fe0980afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:01.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.989+0000 7fe097e00640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0980b3f10 0x7fe0980b02c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b4f50 tx=0x7fe08402a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaf235c29bc6391 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:01.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.989+0000 7fe097400640 1 -- 172.21.15.192:0/753181303 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084032440 con 0x7fe0980b3f10 2024-09-13T18:42:01.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.989+0000 7fe097400640 1 -- 172.21.15.192:0/753181303 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0840325a0 con 0x7fe0980b3f10 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.989+0000 7fe097400640 1 -- 172.21.15.192:0/753181303 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084032930 con 0x7fe0980b3f10 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 -- 172.21.15.192:0/753181303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0980b3f10 msgr2=0x7fe0980b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0980b3f10 0x7fe0980b02c0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fe0980b4f50 tx=0x7fe08402a1d0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 -- 172.21.15.192:0/753181303 shutdown_connections 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 --2- 172.21.15.192:0/753181303 >> v2:172.21.15.194:3300/0 conn(0x7fe09815e2c0 0x7fe09815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe0980b3f10 0x7fe0980b02c0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 --2- 172.21.15.192:0/753181303 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe09815dee0 0x7fe0980afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 -- 172.21.15.192:0/753181303 >> 172.21.15.192:0/753181303 conn(0x7fe0980ae960 msgr2=0x7fe09806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 -- 172.21.15.192:0/753181303 shutdown_connections 2024-09-13T18:42:01.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.990+0000 7fe09f600640 1 -- 172.21.15.192:0/753181303 wait complete. 2024-09-13T18:42:01.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.992+0000 7fe09f600640 1 Processor -- start 2024-09-13T18:42:01.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.992+0000 7fe09f600640 1 -- start start 2024-09-13T18:42:01.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 0x7fe098136f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe098150700 0x7fe0980ae1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe098156f10 con 0x7fe09815dee0 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0980addc0 con 0x7fe09815e2c0 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09f600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe098150570 con 0x7fe098150700 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36698/0 (socket says 172.21.15.192:36698) 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 -- 172.21.15.192:0/3464705670 learned_addr learned my addr 172.21.15.192:0/3464705670 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe097e00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 0x7fe098136f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09d600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe098150700 0x7fe0980ae1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 -- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe098150700 msgr2=0x7fe0980ae1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe098150700 0x7fe0980ae1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 -- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 msgr2=0x7fe098136f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.993+0000 7fe09cc00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 0x7fe098136f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe09cc00640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840094d0 con 0x7fe09815dee0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe097e00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 0x7fe098136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe09cc00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c7f0 tx=0x7fe08c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c007820 con 0x7fe09815dee0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c007980 con 0x7fe09815dee0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c007cf0 con 0x7fe09815dee0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe098157390 con 0x7fe09815dee0 2024-09-13T18:42:01.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.994+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe098156c30 con 0x7fe09815dee0 2024-09-13T18:42:02.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.995+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe098067490 con 0x7fe09815dee0 2024-09-13T18:42:02.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.996+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe08c0113f0 con 0x7fe09815dee0 2024-09-13T18:42:02.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.997+0000 7fe094c00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 0x7fe07806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:02.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.997+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe08c0896f0 con 0x7fe09815dee0 2024-09-13T18:42:02.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.997+0000 7fe097e00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 0x7fe07806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:02.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.997+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=137+}) v3 -- 0x7fe078072760 con 0x7fe09815dee0 2024-09-13T18:42:02.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:01.998+0000 7fe097e00640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 0x7fe07806d0f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe084034000 tx=0x7fe08402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:02.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.001+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe08c054830 con 0x7fe09815dee0 2024-09-13T18:42:02.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.181+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fe09815a440 con 0x7fe09815dee0 2024-09-13T18:42:02.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.817+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(137..137 src has 1..137) v4 ==== 288+0+0 (secure 0 0 0) 0x7fe08c058bf0 con 0x7fe09815dee0 2024-09-13T18:42:02.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.817+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=138}) v3 -- 0x7fe078073010 con 0x7fe09815dee0 2024-09-13T18:42:02.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.819+0000 7fe094c00640 1 -- 172.21.15.192:0/3464705670 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v137) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe08c01f070 con 0x7fe09815dee0 2024-09-13T18:42:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:pauserd,pausewr is unset 2024-09-13T18:42:02.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 msgr2=0x7fe07806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:02.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 0x7fe07806d0f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe084034000 tx=0x7fe08402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:02.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 msgr2=0x7fe0981e6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:02.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c7f0 tx=0x7fe08c00ccb0 comp rx=0 tx=0).stop 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 shutdown_connections 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe07806ac30 0x7fe07806d0f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe098150700 0x7fe0980ae1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe09815e2c0 0x7fe098136f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 --2- 172.21.15.192:0/3464705670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe09815dee0 0x7fe0981e6dc0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.821+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 >> 172.21.15.192:0/3464705670 conn(0x7fe0980ae960 msgr2=0x7fe098070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:02.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.822+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 shutdown_connections 2024-09-13T18:42:02.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.822+0000 7fe09f600640 1 -- 172.21.15.192:0/3464705670 wait complete. 2024-09-13T18:42:02.844 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:02.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.996+0000 7f6d9f200640 1 Processor -- start 2024-09-13T18:42:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.996+0000 7f6d9f200640 1 -- start start 2024-09-13T18:42:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6da00b3480 0x7f6da0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 0x7f6da015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9f200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6da015af60 con 0x7f6da0159b00 2024-09-13T18:42:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da006b7a0 con 0x7f6da00b3480 2024-09-13T18:42:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6da015ac80 con 0x7f6da006bc30 2024-09-13T18:42:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.997+0000 7f6d9d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6da00b3480 0x7f6da0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9de00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6da0159b00 0x7f6da00b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41826/0 (socket says 172.21.15.192:41826) 2024-09-13T18:42:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9de00640 1 -- 172.21.15.192:0/3842162398 learned_addr learned my addr 172.21.15.192:0/3842162398 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9e800640 1 --2- 172.21.15.192:0/3842162398 >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 0x7f6da015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9d400640 1 -- 172.21.15.192:0/3842162398 >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 msgr2=0x7f6da015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9d400640 1 --2- 172.21.15.192:0/3842162398 >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 0x7f6da015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9d400640 1 -- 172.21.15.192:0/3842162398 >> v1:172.21.15.192:6789/0 conn(0x7f6da0159b00 legacy=0x7f6da00b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9d400640 1 -- 172.21.15.192:0/3842162398 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da006b150 con 0x7f6da00b3480 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.998+0000 7f6d9e800640 1 --2- 172.21.15.192:0/3842162398 >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 0x7f6da015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.999+0000 7f6d9d400640 1 --2- 172.21.15.192:0/3842162398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da00b3480 0x7f6da0159ee0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6da00ccce0 tx=0x7f6d8c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe75007b6d3ba4a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.999+0000 7f6d9ca00640 1 -- 172.21.15.192:0/3842162398 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c02ae60 con 0x7f6da00b3480 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.999+0000 7f6d9ca00640 1 -- 172.21.15.192:0/3842162398 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c032440 con 0x7f6da00b3480 2024-09-13T18:42:03.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:02.999+0000 7f6d9ca00640 1 -- 172.21.15.192:0/3842162398 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c0327d0 con 0x7f6da00b3480 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 -- 172.21.15.192:0/3842162398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da00b3480 msgr2=0x7f6da0159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3842162398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da00b3480 0x7f6da0159ee0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6da00ccce0 tx=0x7f6d8c02a110 comp rx=0 tx=0).stop 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 -- 172.21.15.192:0/3842162398 shutdown_connections 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3842162398 >> v2:172.21.15.194:3300/0 conn(0x7f6da006bc30 0x7f6da015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3842162398 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da00b3480 0x7f6da0159ee0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 -- 172.21.15.192:0/3842162398 >> 172.21.15.192:0/3842162398 conn(0x7f6da00736d0 msgr2=0x7f6da00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 -- 172.21.15.192:0/3842162398 shutdown_connections 2024-09-13T18:42:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.000+0000 7f6d9f200640 1 -- 172.21.15.192:0/3842162398 wait complete. 2024-09-13T18:42:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.001+0000 7f6d9f200640 1 Processor -- start 2024-09-13T18:42:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.002+0000 7f6d9f200640 1 -- start start 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.002+0000 7f6d9f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6da006bc30 0x7f6da015bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 0x7f6da014dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da013d520 con 0x7f6da0159b00 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da013e050 con 0x7f6da006bc30 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da014fe50 con 0x7f6da00b3480 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36722/0 (socket says 172.21.15.192:36722) 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 -- 172.21.15.192:0/3530485025 learned_addr learned my addr 172.21.15.192:0/3530485025 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9de00640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6da006bc30 0x7f6da015bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9d400640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 0x7f6da014dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 -- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 msgr2=0x7f6da014dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 0x7f6da014dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 -- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6da006bc30 msgr2=0x7f6da015bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6da006bc30 0x7f6da015bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9e800640 1 -- 172.21.15.192:0/3530485025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c009400 con 0x7f6da0159b00 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.003+0000 7f6d9d400640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 0x7f6da014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d9e800640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c820 tx=0x7f6d9800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d98007a30 con 0x7f6da0159b00 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d98007b90 con 0x7f6da0159b00 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6da013e4e0 con 0x7f6da0159b00 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d9800ce10 con 0x7f6da0159b00 2024-09-13T18:42:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.004+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da013da00 con 0x7f6da0159b00 2024-09-13T18:42:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.005+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6da013e200 con 0x7f6da0159b00 2024-09-13T18:42:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.006+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6d980113f0 con 0x7f6da0159b00 2024-09-13T18:42:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.007+0000 7f6d96000640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 0x7f6d8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.007+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6d980893e0 con 0x7f6da0159b00 2024-09-13T18:42:03.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.007+0000 7f6d9de00640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 0x7f6d8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.008+0000 7f6d9de00640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 0x7f6d8006d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d90005c00 tx=0x7f6d90009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.011+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6da013e200 con 0x7f6da0159b00 2024-09-13T18:42:03.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.181+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6da013e200 con 0x7f6da0159b00 2024-09-13T18:42:03.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.182+0000 7f6d96000640 1 -- 172.21.15.192:0/3530485025 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7f6da013e200 con 0x7f6da0159b00 2024-09-13T18:42:03.185 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:03.185 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 msgr2=0x7f6d8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 0x7f6d8006d0c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f6d90005c00 tx=0x7f6d90009040 comp rx=0 tx=0).stop 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 msgr2=0x7f6da014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6d9800c820 tx=0x7f6d9800cce0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 shutdown_connections 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d8006ac00 0x7f6d8006d0c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6da0159b00 0x7f6da014e4f0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.187 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6da00b3480 0x7f6da014dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 --2- 172.21.15.192:0/3530485025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6da006bc30 0x7f6da015bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 >> 172.21.15.192:0/3530485025 conn(0x7f6da00736d0 msgr2=0x7f6da00b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:03.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 shutdown_connections 2024-09-13T18:42:03.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.184+0000 7f6d9f200640 1 -- 172.21.15.192:0/3530485025 wait complete. 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:42:03.204 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:42:03.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:03.488 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:03.566 INFO:teuthology.orchestra.run.smithi192.stdout:client7048 2024-09-13T18:42:03.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:03.566 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client7048/osdmap') 2024-09-13T18:42:03.663 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 134 barrier 134 flags 0x588000 2024-09-13T18:42:03.663 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:03.663 INFO:teuthology.orchestra.run.smithi192.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:03.663 INFO:teuthology.orchestra.run.smithi192.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:42:03.664 INFO:teuthology.orchestra.run.smithi192.stderr:803 bytes copied, 6.9255e-05 s, 11.6 MB/s 2024-09-13T18:42:03.666 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:03.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.816+0000 7efd53e00640 1 Processor -- start 2024-09-13T18:42:03.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.817+0000 7efd53e00640 1 -- start start 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd5415cef0 0x7efd5406ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd540ce5d0 con 0x7efd540cfc30 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd540ce2f0 con 0x7efd540cde60 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd540cda20 con 0x7efd5415cef0 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efd540cfc30 0x7efd540d0050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41828/0 (socket says 172.21.15.192:41828) 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd53400640 1 -- 172.21.15.192:0/2755633040 learned_addr learned my addr 172.21.15.192:0/2755633040 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:03.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.818+0000 7efd52a00640 1 --2- 172.21.15.192:0/2755633040 >> v2:172.21.15.194:3300/0 conn(0x7efd5415cef0 0x7efd5406ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.819+0000 7efd52a00640 1 -- 172.21.15.192:0/2755633040 >> v1:172.21.15.194:6789/0 conn(0x7efd540cde60 legacy=0x7efd540b2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.819+0000 7efd52a00640 1 -- 172.21.15.192:0/2755633040 >> v1:172.21.15.192:6789/0 conn(0x7efd540cfc30 legacy=0x7efd540d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.819+0000 7efd52a00640 1 -- 172.21.15.192:0/2755633040 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5406af50 con 0x7efd5415cef0 2024-09-13T18:42:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.820+0000 7efd52a00640 1 --2- 172.21.15.192:0/2755633040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5415cef0 0x7efd5406ba30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd440097a0 tx=0x7efd4402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c9f5f09d3b3f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.821+0000 7efd51600640 1 -- 172.21.15.192:0/2755633040 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44032440 con 0x7efd5415cef0 2024-09-13T18:42:03.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.821+0000 7efd51600640 1 -- 172.21.15.192:0/2755633040 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd440325a0 con 0x7efd5415cef0 2024-09-13T18:42:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.821+0000 7efd51600640 1 -- 172.21.15.192:0/2755633040 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd44032930 con 0x7efd5415cef0 2024-09-13T18:42:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.821+0000 7efd53e00640 1 -- 172.21.15.192:0/2755633040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5415cef0 msgr2=0x7efd5406ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.821+0000 7efd53e00640 1 --2- 172.21.15.192:0/2755633040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5415cef0 0x7efd5406ba30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7efd440097a0 tx=0x7efd4402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.822+0000 7efd53e00640 1 -- 172.21.15.192:0/2755633040 shutdown_connections 2024-09-13T18:42:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.822+0000 7efd53e00640 1 --2- 172.21.15.192:0/2755633040 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5415cef0 0x7efd5406ba30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.822+0000 7efd53e00640 1 -- 172.21.15.192:0/2755633040 >> 172.21.15.192:0/2755633040 conn(0x7efd540b4b70 msgr2=0x7efd540b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.822+0000 7efd53e00640 1 -- 172.21.15.192:0/2755633040 shutdown_connections 2024-09-13T18:42:03.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.822+0000 7efd53e00640 1 -- 172.21.15.192:0/2755633040 wait complete. 2024-09-13T18:42:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.823+0000 7efd53e00640 1 Processor -- start 2024-09-13T18:42:03.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.823+0000 7efd53e00640 1 -- start start 2024-09-13T18:42:03.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd540cfc30 0x7efd54158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd540cba00 0x7efd5414fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54159020 con 0x7efd5415cef0 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd54159300 con 0x7efd540cba00 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.824+0000 7efd53e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd541595e0 con 0x7efd540cfc30 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36726/0 (socket says 172.21.15.192:36726) 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 -- 172.21.15.192:0/1088445542 learned_addr learned my addr 172.21.15.192:0/1088445542 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd53400640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd540cba00 0x7efd5414fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52a00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd540cfc30 0x7efd54158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 -- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd540cfc30 msgr2=0x7efd54158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd540cfc30 0x7efd54158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 -- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd540cba00 msgr2=0x7efd5414fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:03.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd540cba00 0x7efd5414fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:03.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 -- 172.21.15.192:0/1088445542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009400 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.825+0000 7efd52000640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3c0 tx=0x7efd4000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.826+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400052d0 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.826+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40005430 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.826+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd40003830 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.826+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd541598c0 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.826+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd540cc090 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.827+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd54159de0 con 0x7efd5415cef0 2024-09-13T18:42:03.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.828+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd40003990 con 0x7efd5415cef0 2024-09-13T18:42:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.828+0000 7efd4aa00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 0x7efd3406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.829+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd40088720 con 0x7efd5415cef0 2024-09-13T18:42:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.829+0000 7efd52a00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 0x7efd3406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.829+0000 7efd52a00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 0x7efd3406d0f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd44034000 tx=0x7efd4402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:03.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:03.833+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd54159de0 con 0x7efd5415cef0 2024-09-13T18:42:04.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.033+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd54159a50 con 0x7efd5415cef0 2024-09-13T18:42:04.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.033+0000 7efd4aa00640 1 -- 172.21.15.192:0/1088445542 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7efd400539b0 con 0x7efd5415cef0 2024-09-13T18:42:04.036 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:04.036 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:42:04.037 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 msgr2=0x7efd3406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 0x7efd3406d0f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7efd44034000 tx=0x7efd4402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 msgr2=0x7efd540aa6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3c0 tx=0x7efd4000c880 comp rx=0 tx=0).stop 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 shutdown_connections 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3406ac30 0x7efd3406d0f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd540cba00 0x7efd5414fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd5415cef0 0x7efd540aa6c0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:04.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 --2- 172.21.15.192:0/1088445542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd540cfc30 0x7efd54158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:04.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 >> 172.21.15.192:0/1088445542 conn(0x7efd540b4b70 msgr2=0x7efd540d2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:04.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 shutdown_connections 2024-09-13T18:42:04.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:04.036+0000 7efd53e00640 1 -- 172.21.15.192:0/1088445542 wait complete. 2024-09-13T18:42:04.057 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json osdmap barrier 137 2024-09-13T18:42:04.234 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> os.fchmod(fd, 0O666) 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(fd) 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> os.close(fd) 2024-09-13T18:42:04.234 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:42:04.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:04.519 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:04.612 INFO:teuthology.orchestra.run.smithi192.stdout:client7048 2024-09-13T18:42:04.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:04.613 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client7048/osdmap') 2024-09-13T18:42:04.715 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 137 barrier 137 flags 0x588000 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:42:04.716 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:42:04.717 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:42:04.717 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:42:04.717 INFO:teuthology.orchestra.run.smithi192.stderr:803 bytes copied, 6.5657e-05 s, 12.2 MB/s 2024-09-13T18:42:04.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:04.719 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:04.756 INFO:teuthology.orchestra.run.smithi192.stdout:client7048 2024-09-13T18:42:04.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:04.757 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.client7048/osdmap') 2024-09-13T18:42:04.852 INFO:teuthology.orchestra.run.smithi192.stdout:epoch 137 barrier 137 flags 0x588000 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:pool 1 '.mgr' type 1 size 2 min_size 1 pg_num 1 pg_num_mask 0 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:pool 14 'cephfs_metadata' type 1 size 2 min_size 1 pg_num 32 pg_num_mask 31 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:pool 15 'cephfs_data' type 1 size 2 min_size 1 pg_num 64 pg_num_mask 63 flags 0x1 lfor 0 read_tier -1 write_tier -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd0 (2)172.21.15.192:6823 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd1 (2)172.21.15.192:6816 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd2 (2)172.21.15.192:6808 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd3 (2)172.21.15.192:6800 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd4 (2)172.21.15.194:6800 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd5 (2)172.21.15.194:6817 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd6 (2)172.21.15.194:6808 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stdout:osd7 (2)172.21.15.194:6816 100% (exists, up) 100% -1 2024-09-13T18:42:04.853 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records in 2024-09-13T18:42:04.854 INFO:teuthology.orchestra.run.smithi192.stderr:1+1 records out 2024-09-13T18:42:04.854 INFO:teuthology.orchestra.run.smithi192.stderr:803 bytes copied, 6.9634e-05 s, 11.5 MB/s 2024-09-13T18:42:04.855 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:42:04.856 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:42:04.856 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:04.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:05.041 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:42:05.041 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:05.041 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:05.077 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:05.077 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:05.152 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:05.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.340+0000 7efe9f000640 1 Processor -- start 2024-09-13T18:42:05.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.340+0000 7efe9f000640 1 -- start start 2024-09-13T18:42:05.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9f000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efe980b0490 0x7efe9815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9f000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980b2f00 con 0x7efe9815dee0 2024-09-13T18:42:05.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe980b3150 con 0x7efe980b3f10 2024-09-13T18:42:05.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9f000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe980b3430 con 0x7efe980b0490 2024-09-13T18:42:05.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe97e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efe9815dee0 0x7efe980afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41842/0 (socket says 172.21.15.192:41842) 2024-09-13T18:42:05.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe97e00640 1 -- 172.21.15.192:0/2265047215 learned_addr learned my addr 172.21.15.192:0/2265047215 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:05.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9d000640 1 --2- 172.21.15.192:0/2265047215 >> v2:172.21.15.192:3300/0 conn(0x7efe980b0490 0x7efe9815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe96a00640 1 -- 172.21.15.192:0/2265047215 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618727468 0 0) 0x7efe980b2f00 con 0x7efe9815dee0 2024-09-13T18:42:05.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe96a00640 1 -- 172.21.15.192:0/2265047215 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe7c003520 con 0x7efe9815dee0 2024-09-13T18:42:05.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9d000640 1 -- 172.21.15.192:0/2265047215 >> v1:172.21.15.194:6789/0 conn(0x7efe980b3f10 legacy=0x7efe9815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:05.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9d000640 1 -- 172.21.15.192:0/2265047215 >> v1:172.21.15.192:6789/0 conn(0x7efe9815dee0 legacy=0x7efe980afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.342+0000 7efe9d000640 1 -- 172.21.15.192:0/2265047215 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe980b3710 con 0x7efe980b0490 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.343+0000 7efe9d000640 1 --2- 172.21.15.192:0/2265047215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe980b0490 0x7efe9815ab50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efe90009d90 tx=0x7efe9002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=776c3c9f6850e759 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe96a00640 1 -- 172.21.15.192:0/2265047215 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90007740 con 0x7efe980b0490 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe96a00640 1 -- 172.21.15.192:0/2265047215 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9002d050 con 0x7efe980b0490 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe96a00640 1 -- 172.21.15.192:0/2265047215 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe90007aa0 con 0x7efe980b0490 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 -- 172.21.15.192:0/2265047215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe980b0490 msgr2=0x7efe9815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 --2- 172.21.15.192:0/2265047215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe980b0490 0x7efe9815ab50 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7efe90009d90 tx=0x7efe9002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 -- 172.21.15.192:0/2265047215 shutdown_connections 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 --2- 172.21.15.192:0/2265047215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe980b0490 0x7efe9815ab50 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 -- 172.21.15.192:0/2265047215 >> 172.21.15.192:0/2265047215 conn(0x7efe980ae960 msgr2=0x7efe9806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 -- 172.21.15.192:0/2265047215 shutdown_connections 2024-09-13T18:42:05.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.344+0000 7efe9f000640 1 -- 172.21.15.192:0/2265047215 wait complete. 2024-09-13T18:42:05.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.346+0000 7efe9f000640 1 Processor -- start 2024-09-13T18:42:05.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.346+0000 7efe9f000640 1 -- start start 2024-09-13T18:42:05.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980b0490 0x7efe9813fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe9815c260 0x7efe9815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9815cc50 con 0x7efe9815dee0 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe98155520 con 0x7efe980b0490 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe98155800 con 0x7efe9815c260 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe97400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe97400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36738/0 (socket says 172.21.15.192:36738) 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe97400640 1 -- 172.21.15.192:0/356110896 learned_addr learned my addr 172.21.15.192:0/356110896 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe97e00640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980b0490 0x7efe9813fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.347+0000 7efe9d000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe9815c260 0x7efe9815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 -- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe9815c260 msgr2=0x7efe9815c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe9815c260 0x7efe9815c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 -- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980b0490 msgr2=0x7efe9813fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980b0490 0x7efe9813fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 -- 172.21.15.192:0/356110896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe90009a70 con 0x7efe9815dee0 2024-09-13T18:42:05.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe97400640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c430 tx=0x7efe8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011790 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe840118f0 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe98155ae0 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84011ce0 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.348+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe98134ac0 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.349+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe98156000 con 0x7efe9815dee0 2024-09-13T18:42:05.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.350+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efe8401c460 con 0x7efe9815dee0 2024-09-13T18:42:05.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.351+0000 7efe8fe00640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 0x7efe7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.351+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe84089220 con 0x7efe9815dee0 2024-09-13T18:42:05.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.351+0000 7efe97e00640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 0x7efe7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.352+0000 7efe97e00640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 0x7efe7806d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efe88005880 tx=0x7efe88009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.355+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efe98156000 con 0x7efe9815dee0 2024-09-13T18:42:05.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.524+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe98156000 con 0x7efe9815dee0 2024-09-13T18:42:05.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.526+0000 7efe8fe00640 1 -- 172.21.15.192:0/356110896 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7efe98156000 con 0x7efe9815dee0 2024-09-13T18:42:05.529 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:05.529 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:05.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 msgr2=0x7efe7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 0x7efe7806d0c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7efe88005880 tx=0x7efe88009040 comp rx=0 tx=0).stop 2024-09-13T18:42:05.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 msgr2=0x7efe98134580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7efe8400c430 tx=0x7efe8400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 shutdown_connections 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efe7806ac00 0x7efe7806d0c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efe9815c260 0x7efe9815c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efe9815dee0 0x7efe98134580 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 --2- 172.21.15.192:0/356110896 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efe980b0490 0x7efe9813fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 >> 172.21.15.192:0/356110896 conn(0x7efe980ae960 msgr2=0x7efe98158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 shutdown_connections 2024-09-13T18:42:05.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.528+0000 7efe9f000640 1 -- 172.21.15.192:0/356110896 wait complete. 2024-09-13T18:42:05.547 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:41:48.584706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:41:49.749521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:05.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:05.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.700+0000 7f24ea400640 1 Processor -- start 2024-09-13T18:42:05.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.700+0000 7f24ea400640 1 -- start start 2024-09-13T18:42:05.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.701+0000 7f24ea400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.701+0000 7f24ea400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f24e406a8b0 0x7f24e40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.701+0000 7f24ea400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24e406b480 con 0x7f24e40b3bd0 2024-09-13T18:42:05.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.701+0000 7f24ea400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24e40b4060 con 0x7f24e406a8b0 2024-09-13T18:42:05.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.701+0000 7f24ea400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e40ce770 con 0x7f24e41434c0 2024-09-13T18:42:05.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f24e40b3bd0 0x7f24e406e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41856/0 (socket says 172.21.15.192:41856) 2024-09-13T18:42:05.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3e00640 1 -- 172.21.15.192:0/240272756 learned_addr learned my addr 172.21.15.192:0/240272756 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:05.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3400640 1 --2- 172.21.15.192:0/240272756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e2a00640 1 --2- 172.21.15.192:0/240272756 >> v2:172.21.15.194:3300/0 conn(0x7f24e406a8b0 0x7f24e40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3400640 1 -- 172.21.15.192:0/240272756 >> v2:172.21.15.194:3300/0 conn(0x7f24e406a8b0 msgr2=0x7f24e40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:05.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3400640 1 --2- 172.21.15.192:0/240272756 >> v2:172.21.15.194:3300/0 conn(0x7f24e406a8b0 0x7f24e40b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3400640 1 -- 172.21.15.192:0/240272756 >> v1:172.21.15.192:6789/0 conn(0x7f24e40b3bd0 legacy=0x7f24e406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e3400640 1 -- 172.21.15.192:0/240272756 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e406b760 con 0x7f24e41434c0 2024-09-13T18:42:05.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.702+0000 7f24e2000640 1 -- 172.21.15.192:0/240272756 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361054670 0 0) 0x7f24e406b480 con 0x7f24e40b3bd0 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.703+0000 7f24e3400640 1 --2- 172.21.15.192:0/240272756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e406c800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24d40097d0 tx=0x7f24d402c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee6ec8051c642727 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24e2000640 1 -- 172.21.15.192:0/240272756 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4034640 con 0x7f24e41434c0 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24e2000640 1 -- 172.21.15.192:0/240272756 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d40347a0 con 0x7f24e41434c0 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24e2000640 1 -- 172.21.15.192:0/240272756 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d4034b30 con 0x7f24e41434c0 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 -- 172.21.15.192:0/240272756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 msgr2=0x7f24e406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 --2- 172.21.15.192:0/240272756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e406c800 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f24d40097d0 tx=0x7f24d402c3d0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 -- 172.21.15.192:0/240272756 shutdown_connections 2024-09-13T18:42:05.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 --2- 172.21.15.192:0/240272756 >> v2:172.21.15.194:3300/0 conn(0x7f24e406a8b0 0x7f24e40b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 --2- 172.21.15.192:0/240272756 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e406c800 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 -- 172.21.15.192:0/240272756 >> 172.21.15.192:0/240272756 conn(0x7f24e40b08f0 msgr2=0x7f24e40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:05.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 -- 172.21.15.192:0/240272756 shutdown_connections 2024-09-13T18:42:05.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.704+0000 7f24ea400640 1 -- 172.21.15.192:0/240272756 wait complete. 2024-09-13T18:42:05.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.706+0000 7f24ea400640 1 Processor -- start 2024-09-13T18:42:05.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.706+0000 7f24ea400640 1 -- start start 2024-09-13T18:42:05.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 0x7f24e413f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e415b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41413b0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24e41ef5f0 con 0x7f24e406a8b0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24ea400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24e4140870 con 0x7f24e41434c0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24e2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24e2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36740/0 (socket says 172.21.15.192:36740) 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24e2a00640 1 -- 172.21.15.192:0/1456931660 learned_addr learned my addr 172.21.15.192:0/1456931660 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24e3e00640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e415b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.707+0000 7f24e3400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 0x7f24e413f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 -- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 msgr2=0x7f24e415b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e415b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 -- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 msgr2=0x7f24e413f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 0x7f24e413f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 -- 172.21.15.192:0/1456931660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24d4009400 con 0x7f24e40b3bd0 2024-09-13T18:42:05.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e3400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 0x7f24e413f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:05.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24e2a00640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f24d000e9e0 tx=0x7f24d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d0009670 con 0x7f24e40b3bd0 2024-09-13T18:42:05.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24d000c9d0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24d000cd80 con 0x7f24e40b3bd0 2024-09-13T18:42:05.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24e415b8b0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.708+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24e41402b0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.710+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24e406acf0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.710+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f24d0013470 con 0x7f24e40b3bd0 2024-09-13T18:42:05.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.711+0000 7f24db400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 0x7f24c406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:05.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.711+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24d00894b0 con 0x7f24e40b3bd0 2024-09-13T18:42:05.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.711+0000 7f24e3400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 0x7f24c406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:05.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.712+0000 7f24e3400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 0x7f24c406d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f24d4036000 tx=0x7f24d4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:05.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.715+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f24d0054720 con 0x7f24e40b3bd0 2024-09-13T18:42:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.886+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24e4070a10 con 0x7f24e40b3bd0 2024-09-13T18:42:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.886+0000 7f24db400640 1 -- 172.21.15.192:0/1456931660 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24d0057d40 con 0x7f24e40b3bd0 2024-09-13T18:42:05.889 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:05.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.888+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 msgr2=0x7f24c406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.888+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 0x7f24c406d0f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f24d4036000 tx=0x7f24d4030000 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.888+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 msgr2=0x7f24e41ef0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.888+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f24d000e9e0 tx=0x7f24d000eea0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 shutdown_connections 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f24c406ac30 0x7f24c406d0f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f24e41434c0 0x7f24e415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24e40b3bd0 0x7f24e41ef0b0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 --2- 172.21.15.192:0/1456931660 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f24e406a8b0 0x7f24e413f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 >> 172.21.15.192:0/1456931660 conn(0x7f24e40b08f0 msgr2=0x7f24e4159b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 shutdown_connections 2024-09-13T18:42:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:05.889+0000 7f24ea400640 1 -- 172.21.15.192:0/1456931660 wait complete. 2024-09-13T18:42:05.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:42:06.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.059+0000 7f78f4c00640 1 Processor -- start 2024-09-13T18:42:06.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.059+0000 7f78f4c00640 1 -- start start 2024-09-13T18:42:06.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 0x7f78f006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 0x7f78f006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00b4060 con 0x7f78f00b3bd0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f00ce770 con 0x7f78f01434c0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.060+0000 7f78f4c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f006b480 con 0x7f78f006a8b0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 0x7f78f006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ee800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 0x7f78f006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:51526/0 (socket says 172.21.15.192:51526) 2024-09-13T18:42:06.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 -- 172.21.15.192:0/4214625830 learned_addr learned my addr 172.21.15.192:0/4214625830 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 -- 172.21.15.192:0/4214625830 >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 msgr2=0x7f78f006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 0x7f78f006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 -- 172.21.15.192:0/4214625830 >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 msgr2=0x7f78f006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 0x7f78f006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ed400640 1 -- 172.21.15.192:0/4214625830 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f006b760 con 0x7f78f006a8b0 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ee800640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 0x7f78f006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.061+0000 7f78ede00640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 0x7f78f006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.062+0000 7f78ed400640 1 --2- 172.21.15.192:0/4214625830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bb10 tx=0x7f78dc02c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16cb8200ba5dc5d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78eca00640 1 -- 172.21.15.192:0/4214625830 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc032780 con 0x7f78f006a8b0 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78eca00640 1 -- 172.21.15.192:0/4214625830 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78dc0328e0 con 0x7f78f006a8b0 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78eca00640 1 -- 172.21.15.192:0/4214625830 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78dc032c70 con 0x7f78f006a8b0 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 -- 172.21.15.192:0/4214625830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 msgr2=0x7f78f00b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 --2- 172.21.15.192:0/4214625830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78dc00bb10 tx=0x7f78dc02c8c0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 -- 172.21.15.192:0/4214625830 shutdown_connections 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.192:3300/0 conn(0x7f78f00b3bd0 0x7f78f006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 --2- 172.21.15.192:0/4214625830 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f006a8b0 0x7f78f00b3690 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 --2- 172.21.15.192:0/4214625830 >> v2:172.21.15.194:3300/0 conn(0x7f78f01434c0 0x7f78f006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 -- 172.21.15.192:0/4214625830 >> 172.21.15.192:0/4214625830 conn(0x7f78f00b08f0 msgr2=0x7f78f00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 -- 172.21.15.192:0/4214625830 shutdown_connections 2024-09-13T18:42:06.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.063+0000 7f78f4c00640 1 -- 172.21.15.192:0/4214625830 wait complete. 2024-09-13T18:42:06.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.065+0000 7f78f4c00640 1 Processor -- start 2024-09-13T18:42:06.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.065+0000 7f78f4c00640 1 -- start start 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f00b3bd0 0x7f78f013d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f01434c0 0x7f78f00ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f006f870 con 0x7f78f006a8b0 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f013ccd0 con 0x7f78f01434c0 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78f4c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f006ef40 con 0x7f78f00b3bd0 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78ede00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78ede00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36758/0 (socket says 172.21.15.192:36758) 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.066+0000 7f78ede00640 1 -- 172.21.15.192:0/2499277470 learned_addr learned my addr 172.21.15.192:0/2499277470 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ed400640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f00b3bd0 0x7f78f013d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ee800640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f01434c0 0x7f78f00ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 -- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f00b3bd0 msgr2=0x7f78f013d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f00b3bd0 0x7f78f013d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 -- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f01434c0 msgr2=0x7f78f00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f01434c0 0x7f78f00ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 -- 172.21.15.192:0/2499277470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e8009a70 con 0x7f78f006a8b0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78ede00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f78e000e960 tx=0x7f78e000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e000ca00 con 0x7f78f006a8b0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78e000cb60 con 0x7f78f006a8b0 2024-09-13T18:42:06.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78e0013470 con 0x7f78f006a8b0 2024-09-13T18:42:06.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e0009400 con 0x7f78f006a8b0 2024-09-13T18:42:06.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.067+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78dc00b770 con 0x7f78f006a8b0 2024-09-13T18:42:06.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.068+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f006acf0 con 0x7f78f006a8b0 2024-09-13T18:42:06.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.069+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f78e00135d0 con 0x7f78f006a8b0 2024-09-13T18:42:06.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.070+0000 7f78e6000640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 0x7f78d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.070+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78e00896f0 con 0x7f78f006a8b0 2024-09-13T18:42:06.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.070+0000 7f78ed400640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 0x7f78d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.071+0000 7f78ed400640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 0x7f78d006d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78dc037000 tx=0x7f78dc032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.074+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f78e0054830 con 0x7f78f006a8b0 2024-09-13T18:42:06.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.241+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78f015d710 con 0x7f78f006a8b0 2024-09-13T18:42:06.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.241+0000 7f78e6000640 1 -- 172.21.15.192:0/2499277470 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78e0057e50 con 0x7f78f006a8b0 2024-09-13T18:42:06.244 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:42:06.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.243+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 msgr2=0x7f78d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.243+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 0x7f78d006d0c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f78dc037000 tx=0x7f78dc032000 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.243+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 msgr2=0x7f78f013c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.243+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f78e000e960 tx=0x7f78e000ee20 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 shutdown_connections 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f78d006ac00 0x7f78d006d0c0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f78f01434c0 0x7f78f00ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f78f00b3bd0 0x7f78f013d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 --2- 172.21.15.192:0/2499277470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f78f006a8b0 0x7f78f013c790 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 >> 172.21.15.192:0/2499277470 conn(0x7f78f00b08f0 msgr2=0x7f78f015cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 shutdown_connections 2024-09-13T18:42:06.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.244+0000 7f78f4c00640 1 -- 172.21.15.192:0/2499277470 wait complete. 2024-09-13T18:42:06.263 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:42:06.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.417+0000 7f3699200640 1 Processor -- start 2024-09-13T18:42:06.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.417+0000 7f3699200640 1 -- start start 2024-09-13T18:42:06.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3699200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36941434c0 0x7f369406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3699200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 0x7f36940b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3699200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369406b480 con 0x7f36940b3bd0 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3699200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36940b4060 con 0x7f36941434c0 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3699200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36940ce770 con 0x7f369406a8b0 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3691e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f36941434c0 0x7f369406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3692800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f36940b3bd0 0x7f369406e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41870/0 (socket says 172.21.15.192:41870) 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f3692800640 1 -- 172.21.15.192:0/1854478263 learned_addr learned my addr 172.21.15.192:0/1854478263 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.418+0000 7f368be00640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 0x7f36940b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f3691e00640 1 -- 172.21.15.192:0/1854478263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 msgr2=0x7f36940b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f3691e00640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 0x7f36940b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f3691e00640 1 -- 172.21.15.192:0/1854478263 >> v1:172.21.15.192:6789/0 conn(0x7f36940b3bd0 legacy=0x7f369406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f3691e00640 1 -- 172.21.15.192:0/1854478263 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369406b760 con 0x7f36941434c0 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f3691400640 1 -- 172.21.15.192:0/1854478263 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3467624384 0 0) 0x7f369406b480 con 0x7f36940b3bd0 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.419+0000 7f368be00640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 0x7f36940b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3691e00640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36941434c0 0x7f369406c800 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f36840097d0 tx=0x7f368402a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e8849669132147 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3691400640 1 -- 172.21.15.192:0/1854478263 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684032440 con 0x7f36941434c0 2024-09-13T18:42:06.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3691400640 1 -- 172.21.15.192:0/1854478263 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840325a0 con 0x7f36941434c0 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3691400640 1 -- 172.21.15.192:0/1854478263 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684032930 con 0x7f36941434c0 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3699200640 1 -- 172.21.15.192:0/1854478263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36941434c0 msgr2=0x7f369406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.420+0000 7f3699200640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36941434c0 0x7f369406c800 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f36840097d0 tx=0x7f368402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 -- 172.21.15.192:0/1854478263 shutdown_connections 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f369406a8b0 0x7f36940b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 --2- 172.21.15.192:0/1854478263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f36941434c0 0x7f369406c800 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 -- 172.21.15.192:0/1854478263 >> 172.21.15.192:0/1854478263 conn(0x7f36940b08f0 msgr2=0x7f36940b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 -- 172.21.15.192:0/1854478263 shutdown_connections 2024-09-13T18:42:06.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.421+0000 7f3699200640 1 -- 172.21.15.192:0/1854478263 wait complete. 2024-09-13T18:42:06.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.422+0000 7f3699200640 1 Processor -- start 2024-09-13T18:42:06.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.422+0000 7f3699200640 1 -- start start 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36940b3bd0 0x7f369413f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36941434c0 0x7f369415be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36941562f0 con 0x7f369406a8b0 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f369415c890 con 0x7f36941434c0 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.423+0000 7f3699200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369415cb70 con 0x7f36940b3bd0 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36776/0 (socket says 172.21.15.192:36776) 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 -- 172.21.15.192:0/2375421910 learned_addr learned my addr 172.21.15.192:0/2375421910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f368be00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36940b3bd0 0x7f369413f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3692800640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36941434c0 0x7f369415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 -- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36940b3bd0 msgr2=0x7f369413f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36940b3bd0 0x7f369413f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 -- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36941434c0 msgr2=0x7f369415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36941434c0 0x7f369415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 -- 172.21.15.192:0/2375421910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3684009400 con 0x7f369406a8b0 2024-09-13T18:42:06.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.424+0000 7f3691e00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f3684000c00 tx=0x7f36840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.425+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684032440 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.425+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684030b80 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.425+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684006e10 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.425+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3694155f10 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.425+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36941559e0 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.426+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3694156430 con 0x7f369406a8b0 2024-09-13T18:42:06.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.427+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3684039040 con 0x7f369406a8b0 2024-09-13T18:42:06.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.427+0000 7f368a000640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 0x7f367006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.427+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36840a9a30 con 0x7f369406a8b0 2024-09-13T18:42:06.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.428+0000 7f368be00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 0x7f367006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.428+0000 7f368be00640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 0x7f367006d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f369415a910 tx=0x7f367c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.432+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3694156430 con 0x7f369406a8b0 2024-09-13T18:42:06.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.596+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3694156430 con 0x7f369406a8b0 2024-09-13T18:42:06.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.597+0000 7f368a000640 1 -- 172.21.15.192:0/2375421910 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3694156430 con 0x7f369406a8b0 2024-09-13T18:42:06.600 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 msgr2=0x7f367006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 0x7f367006d0c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f369415a910 tx=0x7f367c008040 comp rx=0 tx=0).stop 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 msgr2=0x7f36941554a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f3684000c00 tx=0x7f36840046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 shutdown_connections 2024-09-13T18:42:06.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f367006ac00 0x7f367006d0c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f36941434c0 0x7f369415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f36940b3bd0 0x7f369413f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 --2- 172.21.15.192:0/2375421910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f369406a8b0 0x7f36941554a0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 >> 172.21.15.192:0/2375421910 conn(0x7f36940b08f0 msgr2=0x7f36940b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 shutdown_connections 2024-09-13T18:42:06.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.599+0000 7f3699200640 1 -- 172.21.15.192:0/2375421910 wait complete. 2024-09-13T18:42:06.618 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:42:06.772 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.769+0000 7f3335c00640 1 Processor -- start 2024-09-13T18:42:06.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.770+0000 7f3335c00640 1 -- start start 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33300cd5b0 0x7f33300cda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f333006b180 0x7f333006b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f333006bf10 con 0x7f33301598d0 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300cdf60 con 0x7f333006b180 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33300b2e10 con 0x7f33300cd5b0 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f3335200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f333006b180 0x7f333006b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f332fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f33301598d0 0x7f33300b3bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41884/0 (socket says 172.21.15.192:41884) 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f332fe00640 1 -- 172.21.15.192:0/358214567 learned_addr learned my addr 172.21.15.192:0/358214567 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.771+0000 7f332f400640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33300cd5b0 0x7f33300cda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.772+0000 7f3335200640 1 -- 172.21.15.192:0/358214567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33300cd5b0 msgr2=0x7f33300cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.772+0000 7f3335200640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33300cd5b0 0x7f33300cda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.772+0000 7f3335200640 1 -- 172.21.15.192:0/358214567 >> v1:172.21.15.192:6789/0 conn(0x7f33301598d0 legacy=0x7f33300b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.772+0000 7f3335200640 1 -- 172.21.15.192:0/358214567 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300b30f0 con 0x7f333006b180 2024-09-13T18:42:06.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.773+0000 7f3335200640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f333006b180 0x7f333006b610 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3328009d90 tx=0x7f332802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52f48ce19ec9795f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.773+0000 7f332ea00640 1 -- 172.21.15.192:0/358214567 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328007740 con 0x7f333006b180 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.773+0000 7f332ea00640 1 -- 172.21.15.192:0/358214567 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332802d050 con 0x7f333006b180 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.773+0000 7f332ea00640 1 -- 172.21.15.192:0/358214567 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3328007ac0 con 0x7f333006b180 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 -- 172.21.15.192:0/358214567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f333006b180 msgr2=0x7f333006b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f333006b180 0x7f333006b610 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f3328009d90 tx=0x7f332802a660 comp rx=0 tx=0).stop 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 -- 172.21.15.192:0/358214567 shutdown_connections 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f333006b180 0x7f333006b610 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 --2- 172.21.15.192:0/358214567 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33300cd5b0 0x7f33300cda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 -- 172.21.15.192:0/358214567 >> 172.21.15.192:0/358214567 conn(0x7f33300736d0 msgr2=0x7f33300b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 -- 172.21.15.192:0/358214567 shutdown_connections 2024-09-13T18:42:06.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.774+0000 7f3335c00640 1 -- 172.21.15.192:0/358214567 wait complete. 2024-09-13T18:42:06.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.775+0000 7f3335c00640 1 Processor -- start 2024-09-13T18:42:06.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.776+0000 7f3335c00640 1 -- start start 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.776+0000 7f3335c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f333006b180 0x7f333014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.776+0000 7f3335c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300cd5b0 0x7f333014f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.776+0000 7f3335c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333014fd20 con 0x7f33301598d0 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333014faa0 con 0x7f33300cd5b0 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333015c300 con 0x7f333006b180 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36792/0 (socket says 172.21.15.192:36792) 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 -- 172.21.15.192:0/1148823670 learned_addr learned my addr 172.21.15.192:0/1148823670 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f332fe00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f333006b180 0x7f333014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f332f400640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300cd5b0 0x7f333014f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 -- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f333006b180 msgr2=0x7f333014fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f333006b180 0x7f333014fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 -- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300cd5b0 msgr2=0x7f333014f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300cd5b0 0x7f333014f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.777+0000 7f3335200640 1 -- 172.21.15.192:0/1148823670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3328009a70 con 0x7f33301598d0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3335200640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f3328009eb0 tx=0x7f3328004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332803b820 con 0x7f33301598d0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332803b980 con 0x7f33301598d0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332803bcf0 con 0x7f33301598d0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3330150a50 con 0x7f33301598d0 2024-09-13T18:42:06.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.778+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3330151010 con 0x7f33301598d0 2024-09-13T18:42:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.779+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333015c4c0 con 0x7f33301598d0 2024-09-13T18:42:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.780+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3328031400 con 0x7f33301598d0 2024-09-13T18:42:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.781+0000 7f3327e00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.781+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33280aab50 con 0x7f33301598d0 2024-09-13T18:42:06.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.781+0000 7f332fe00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:06.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.782+0000 7f332fe00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 0x7f331006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3320005880 tx=0x7f3320009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:06.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.785+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3328075d50 con 0x7f33301598d0 2024-09-13T18:42:06.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.966+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f333006bad0 con 0x7f33301598d0 2024-09-13T18:42:06.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.967+0000 7f3327e00640 1 -- 172.21.15.192:0/1148823670 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3328079370 con 0x7f33301598d0 2024-09-13T18:42:06.970 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 msgr2=0x7f331006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 0x7f331006d0c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f3320005880 tx=0x7f3320009040 comp rx=0 tx=0).stop 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 msgr2=0x7f3330149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f3328009eb0 tx=0x7f3328004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 shutdown_connections 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f331006ac00 0x7f331006d0c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33301598d0 0x7f3330149740 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f33300cd5b0 0x7f333014f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 --2- 172.21.15.192:0/1148823670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f333006b180 0x7f333014fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:06.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 >> 172.21.15.192:0/1148823670 conn(0x7f33300736d0 msgr2=0x7f333015a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:06.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 shutdown_connections 2024-09-13T18:42:06.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:06.969+0000 7f3335c00640 1 -- 172.21.15.192:0/1148823670 wait complete. 2024-09-13T18:42:06.988 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:42:06.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:06.988 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:07.080 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:42:07.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:07.080 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:42:07.118 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:07.118 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:07.156 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:07.156 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:07.231 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:07.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.381+0000 7ff6d9800640 1 Processor -- start 2024-09-13T18:42:07.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.381+0000 7ff6d9800640 1 -- start start 2024-09-13T18:42:07.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d40ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d9800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff6d40afd80 0x7ff6d40b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d9800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d40b0710 con 0x7ff6d40b2780 2024-09-13T18:42:07.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d9800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40cd920 con 0x7ff6d40afd80 2024-09-13T18:42:07.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40adf50 con 0x7ff6d4146610 2024-09-13T18:42:07.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6d3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff6d40afd80 0x7ff6d40b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6ca000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff6d40b2780 0x7ff6d40ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41894/0 (socket says 172.21.15.192:41894) 2024-09-13T18:42:07.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.382+0000 7ff6ca000640 1 -- 172.21.15.192:0/4162265201 learned_addr learned my addr 172.21.15.192:0/4162265201 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d2a00640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d40ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d3400640 1 -- 172.21.15.192:0/4162265201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 msgr2=0x7ff6d40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d3400640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d40ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d3400640 1 -- 172.21.15.192:0/4162265201 >> v1:172.21.15.192:6789/0 conn(0x7ff6d40b2780 legacy=0x7ff6d40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d3400640 1 -- 172.21.15.192:0/4162265201 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40ae770 con 0x7ff6d40afd80 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.383+0000 7ff6d2000640 1 -- 172.21.15.192:0/4162265201 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345713242 0 0) 0x7ff6bc001110 con 0x7ff6d40b2780 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.384+0000 7ff6d3400640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40b01d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009d90 tx=0x7ff6cc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68148dcd9a82d8e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.384+0000 7ff6d2000640 1 -- 172.21.15.192:0/4162265201 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc007740 con 0x7ff6d40afd80 2024-09-13T18:42:07.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.384+0000 7ff6d2000640 1 -- 172.21.15.192:0/4162265201 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6cc02d050 con 0x7ff6d40afd80 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.384+0000 7ff6d2000640 1 -- 172.21.15.192:0/4162265201 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc007ac0 con 0x7ff6d40afd80 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 -- 172.21.15.192:0/4162265201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 msgr2=0x7ff6d40b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40b01d0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc009d90 tx=0x7ff6cc02a660 comp rx=0 tx=0).stop 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 -- 172.21.15.192:0/4162265201 shutdown_connections 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40b01d0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 --2- 172.21.15.192:0/4162265201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d40ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 -- 172.21.15.192:0/4162265201 >> 172.21.15.192:0/4162265201 conn(0x7ff6d40ae960 msgr2=0x7ff6d406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 -- 172.21.15.192:0/4162265201 shutdown_connections 2024-09-13T18:42:07.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.385+0000 7ff6d9800640 1 -- 172.21.15.192:0/4162265201 wait complete. 2024-09-13T18:42:07.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.387+0000 7ff6d9800640 1 Processor -- start 2024-09-13T18:42:07.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.387+0000 7ff6d9800640 1 -- start start 2024-09-13T18:42:07.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6d40b2780 0x7ff6d413f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d41568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4140380 con 0x7ff6d40afd80 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d413f700 con 0x7ff6d40b2780 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d413f9e0 con 0x7ff6d4146610 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36802/0 (socket says 172.21.15.192:36802) 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 -- 172.21.15.192:0/2042517221 learned_addr learned my addr 172.21.15.192:0/2042517221 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 -- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 msgr2=0x7ff6d41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d41568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 -- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6d40b2780 msgr2=0x7ff6d413f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6d40b2780 0x7ff6d413f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 -- 172.21.15.192:0/2042517221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc009a70 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.388+0000 7ff6d2a00640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400d5f0 tx=0x7ff6c400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.389+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40125f0 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.389+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4012750 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.389+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d413fcc0 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.389+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4012b00 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.389+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4156e00 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.390+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d41469f0 con 0x7ff6d40afd80 2024-09-13T18:42:07.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.391+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff6c4012c60 con 0x7ff6d40afd80 2024-09-13T18:42:07.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.392+0000 7ff6cb400640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 0x7ff6b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.392+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c4089970 con 0x7ff6d40afd80 2024-09-13T18:42:07.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.392+0000 7ff6ca000640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 0x7ff6b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.392+0000 7ff6ca000640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 0x7ff6b006d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc007fd0 tx=0x7ff6bc001310 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.396+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff6c4054a20 con 0x7ff6d40afd80 2024-09-13T18:42:07.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.565+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6d40adb20 con 0x7ff6d40afd80 2024-09-13T18:42:07.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.566+0000 7ff6cb400640 1 -- 172.21.15.192:0/2042517221 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7ff6c4058040 con 0x7ff6d40afd80 2024-09-13T18:42:07.569 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:07.569 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:07.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 msgr2=0x7ff6b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 0x7ff6b006d0c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc007fd0 tx=0x7ff6bc001310 comp rx=0 tx=0).stop 2024-09-13T18:42:07.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 msgr2=0x7ff6d40710f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff6c400d5f0 tx=0x7ff6c400dab0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 shutdown_connections 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff6b006ac00 0x7ff6b006d0c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff6d4146610 0x7ff6d41568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff6d40b2780 0x7ff6d413f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 --2- 172.21.15.192:0/2042517221 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff6d40afd80 0x7ff6d40710f0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 >> 172.21.15.192:0/2042517221 conn(0x7ff6d40ae960 msgr2=0x7ff6d415ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 shutdown_connections 2024-09-13T18:42:07.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.568+0000 7ff6d9800640 1 -- 172.21.15.192:0/2042517221 wait complete. 2024-09-13T18:42:07.588 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:41:48.584706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:41:49.749521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:07.588 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:07.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.741+0000 7fb20ba00640 1 Processor -- start 2024-09-13T18:42:07.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.741+0000 7fb20ba00640 1 -- start start 2024-09-13T18:42:07.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.742+0000 7fb20ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb20415a910 0x7fb2040b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.742+0000 7fb20ba00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb204160ac0 0x7fb204160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.742+0000 7fb20ba00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2040b2b40 con 0x7fb2040ad840 2024-09-13T18:42:07.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.742+0000 7fb20ba00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040b21e0 con 0x7fb204160ac0 2024-09-13T18:42:07.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.742+0000 7fb20ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2040b1bf0 con 0x7fb20415a910 2024-09-13T18:42:07.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb204160ac0 0x7fb204160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb204160ac0 0x7fb204160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36810/0 (socket says 172.21.15.192:36810) 2024-09-13T18:42:07.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 -- 172.21.15.192:0/633863241 learned_addr learned my addr 172.21.15.192:0/633863241 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:07.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb209000640 1 --2- 172.21.15.192:0/633863241 >> v2:172.21.15.194:3300/0 conn(0x7fb20415a910 0x7fb2040b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 -- 172.21.15.192:0/633863241 >> v2:172.21.15.194:3300/0 conn(0x7fb20415a910 msgr2=0x7fb2040b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:07.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 --2- 172.21.15.192:0/633863241 >> v2:172.21.15.194:3300/0 conn(0x7fb20415a910 0x7fb2040b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 -- 172.21.15.192:0/633863241 >> v1:172.21.15.194:6789/0 conn(0x7fb2040ad840 legacy=0x7fb2040cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:07.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.743+0000 7fb203e00640 1 -- 172.21.15.192:0/633863241 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb204161510 con 0x7fb204160ac0 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.744+0000 7fb203e00640 1 --2- 172.21.15.192:0/633863241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb204160ac0 0x7fb204160f30 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb2040b18c0 tx=0x7fb1f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fad7319aa0b5eba server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.744+0000 7fb203400640 1 -- 172.21.15.192:0/633863241 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0032440 con 0x7fb204160ac0 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.744+0000 7fb203400640 1 -- 172.21.15.192:0/633863241 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f00325a0 con 0x7fb204160ac0 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.744+0000 7fb203400640 1 -- 172.21.15.192:0/633863241 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f0032930 con 0x7fb204160ac0 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 -- 172.21.15.192:0/633863241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb204160ac0 msgr2=0x7fb204160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 --2- 172.21.15.192:0/633863241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb204160ac0 0x7fb204160f30 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb2040b18c0 tx=0x7fb1f002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 -- 172.21.15.192:0/633863241 shutdown_connections 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 --2- 172.21.15.192:0/633863241 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb204160ac0 0x7fb204160f30 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 --2- 172.21.15.192:0/633863241 >> v2:172.21.15.194:3300/0 conn(0x7fb20415a910 0x7fb2040b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 -- 172.21.15.192:0/633863241 >> 172.21.15.192:0/633863241 conn(0x7fb2040b08f0 msgr2=0x7fb2040b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:07.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 -- 172.21.15.192:0/633863241 shutdown_connections 2024-09-13T18:42:07.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.745+0000 7fb20ba00640 1 -- 172.21.15.192:0/633863241 wait complete. 2024-09-13T18:42:07.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.747+0000 7fb20ba00640 1 Processor -- start 2024-09-13T18:42:07.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.747+0000 7fb20ba00640 1 -- start start 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20415a910 0x7fb20414a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb204160ac0 0x7fb204148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041471b0 con 0x7fb2040ad840 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20414ae70 con 0x7fb20415a910 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb20ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2041475c0 con 0x7fb204160ac0 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36824/0 (socket says 172.21.15.192:36824) 2024-09-13T18:42:07.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 -- 172.21.15.192:0/3528197742 learned_addr learned my addr 172.21.15.192:0/3528197742 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb203e00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20415a910 0x7fb20414a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209a00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb204160ac0 0x7fb204148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 -- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb204160ac0 msgr2=0x7fb204148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb204160ac0 0x7fb204148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 -- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20415a910 msgr2=0x7fb20414a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20415a910 0x7fb20414a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.748+0000 7fb209000640 1 -- 172.21.15.192:0/3528197742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f00094d0 con 0x7fb2040ad840 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb209000640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d800 tx=0x7fb1f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800b6c0 con 0x7fb2040ad840 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f800b820 con 0x7fb2040ad840 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2041478a0 con 0x7fb2040ad840 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f800bbb0 con 0x7fb2040ad840 2024-09-13T18:42:07.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.749+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb204147e60 con 0x7fb2040ad840 2024-09-13T18:42:07.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.750+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20415acf0 con 0x7fb2040ad840 2024-09-13T18:42:07.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.751+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1f800bd10 con 0x7fb2040ad840 2024-09-13T18:42:07.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.752+0000 7fb200c00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 0x7fb1e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:07.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.752+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1f8089820 con 0x7fb2040ad840 2024-09-13T18:42:07.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.752+0000 7fb203e00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 0x7fb1e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:07.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.753+0000 7fb203e00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 0x7fb1e406d0c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0034000 tx=0x7fb1f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:07.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.756+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb1f8054a20 con 0x7fb2040ad840 2024-09-13T18:42:07.837 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:42:07.842 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:42:07.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.929+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb2040cda20 con 0x7fb2040ad840 2024-09-13T18:42:07.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.929+0000 7fb200c00640 1 -- 172.21.15.192:0/3528197742 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb1f8089030 con 0x7fb2040ad840 2024-09-13T18:42:07.932 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.931+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 msgr2=0x7fb1e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.931+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 0x7fb1e406d0c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0034000 tx=0x7fb1f002e000 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.931+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 msgr2=0x7fb20406b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.931+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb1f800d800 tx=0x7fb1f800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 shutdown_connections 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1e406ac00 0x7fb1e406d0c0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb204160ac0 0x7fb204148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb20415a910 0x7fb20414a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 --2- 172.21.15.192:0/3528197742 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb2040ad840 0x7fb20406b750 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:07.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 >> 172.21.15.192:0/3528197742 conn(0x7fb2040b08f0 msgr2=0x7fb20415e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:07.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 shutdown_connections 2024-09-13T18:42:07.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:07.932+0000 7fb20ba00640 1 -- 172.21.15.192:0/3528197742 wait complete. 2024-09-13T18:42:07.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:42:08.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.144+0000 7f4acc600640 1 Processor -- start 2024-09-13T18:42:08.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.144+0000 7f4acc600640 1 -- start start 2024-09-13T18:42:08.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.145+0000 7f4acc600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ac41589f0 0x7f4ac40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.145+0000 7f4acc600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac40b2000 con 0x7f4ac40b3af0 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.145+0000 7f4acc600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ac415b970 con 0x7f4ac406c0b0 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.145+0000 7f4acc600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ac415bbd0 con 0x7f4ac41589f0 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4ac41589f0 0x7f4ac40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4ac40b3af0 0x7f4ac415b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41904/0 (socket says 172.21.15.192:41904) 2024-09-13T18:42:08.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9200640 1 -- 172.21.15.192:0/1575747441 learned_addr learned my addr 172.21.15.192:0/1575747441 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:08.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9c00640 1 -- 172.21.15.192:0/1575747441 >> v1:172.21.15.194:6789/0 conn(0x7f4ac406c0b0 legacy=0x7f4ac40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9c00640 1 -- 172.21.15.192:0/1575747441 >> v1:172.21.15.192:6789/0 conn(0x7f4ac40b3af0 legacy=0x7f4ac415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac9c00640 1 -- 172.21.15.192:0/1575747441 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac415beb0 con 0x7f4ac41589f0 2024-09-13T18:42:08.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.146+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1575747441 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618327146 0 0) 0x7f4ac40b2000 con 0x7f4ac40b3af0 2024-09-13T18:42:08.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.147+0000 7f4ac9c00640 1 --2- 172.21.15.192:0/1575747441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40b2490 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097a0 tx=0x7f4ab802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e387a7a0319057 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1575747441 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8032440 con 0x7f4ac41589f0 2024-09-13T18:42:08.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1575747441 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ab80325a0 con 0x7f4ac41589f0 2024-09-13T18:42:08.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4ac3e00640 1 -- 172.21.15.192:0/1575747441 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8032930 con 0x7f4ac41589f0 2024-09-13T18:42:08.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 -- 172.21.15.192:0/1575747441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 msgr2=0x7f4ac40b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 --2- 172.21.15.192:0/1575747441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40b2490 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f4ab80097a0 tx=0x7f4ab802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 -- 172.21.15.192:0/1575747441 shutdown_connections 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 --2- 172.21.15.192:0/1575747441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40b2490 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 -- 172.21.15.192:0/1575747441 >> 172.21.15.192:0/1575747441 conn(0x7f4ac40b08f0 msgr2=0x7f4ac40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 -- 172.21.15.192:0/1575747441 shutdown_connections 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.148+0000 7f4acc600640 1 -- 172.21.15.192:0/1575747441 wait complete. 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.150+0000 7f4acc600640 1 Processor -- start 2024-09-13T18:42:08.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.150+0000 7f4acc600640 1 -- start start 2024-09-13T18:42:08.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac41f2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4154680 con 0x7f4ac41589f0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac4153ab0 con 0x7f4ac406c0b0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4acc600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ac41525f0 con 0x7f4ac40b3af0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36848/0 (socket says 172.21.15.192:36848) 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 -- 172.21.15.192:0/4156090901 learned_addr learned my addr 172.21.15.192:0/4156090901 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4ac9c00640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4ac9200640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac41f2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 -- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 msgr2=0x7f4ac41f2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac41f2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 -- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 msgr2=0x7f4ac4151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.151+0000 7f4aca600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4aca600640 1 -- 172.21.15.192:0/4156090901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ab8009400 con 0x7f4ac41589f0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4aca600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7a0 tx=0x7f4abc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc003b70 con 0x7f4ac41589f0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4abc003cf0 con 0x7f4ac41589f0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ac4153d50 con 0x7f4ac41589f0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4abc003ea0 con 0x7f4ac41589f0 2024-09-13T18:42:08.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.152+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ac4154310 con 0x7f4ac41589f0 2024-09-13T18:42:08.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.153+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ac40cc0b0 con 0x7f4ac41589f0 2024-09-13T18:42:08.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.154+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4abc00aa90 con 0x7f4ac41589f0 2024-09-13T18:42:08.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.155+0000 7f4ac1600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.155+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4abc089070 con 0x7f4ac41589f0 2024-09-13T18:42:08.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.155+0000 7f4ac9c00640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.156+0000 7f4ac9c00640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8034000 tx=0x7f4ab802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.159+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4abc054300 con 0x7f4ac41589f0 2024-09-13T18:42:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.324+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4ac40b2470 con 0x7f4ac41589f0 2024-09-13T18:42:08.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.325+0000 7f4ac1600640 1 -- 172.21.15.192:0/4156090901 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4abc057920 con 0x7f4ac41589f0 2024-09-13T18:42:08.328 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 msgr2=0x7f4aa406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8034000 tx=0x7f4ab802e000 comp rx=0 tx=0).stop 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 msgr2=0x7f4ac40ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00c7a0 tx=0x7f4abc00cc60 comp rx=0 tx=0).stop 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 shutdown_connections 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4aa406ac00 0x7f4aa406d0c0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4ac41589f0 0x7f4ac40ad840 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4ac40b3af0 0x7f4ac41f2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 --2- 172.21.15.192:0/4156090901 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4ac406c0b0 0x7f4ac4151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 >> 172.21.15.192:0/4156090901 conn(0x7f4ac40b08f0 msgr2=0x7f4ac40b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:08.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 shutdown_connections 2024-09-13T18:42:08.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.327+0000 7f4acc600640 1 -- 172.21.15.192:0/4156090901 wait complete. 2024-09-13T18:42:08.346 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:42:08.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.498+0000 7f3c01e00640 1 Processor -- start 2024-09-13T18:42:08.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.498+0000 7f3c01e00640 1 -- start start 2024-09-13T18:42:08.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3c01e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bfc0b3af0 0x7f3bfc15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3c01e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06c0b0 0x7f3bfc06c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3c01e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0b2000 con 0x7f3bfc1589f0 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3c01e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc06ca80 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3c01e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b2ba0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3bfaa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3bfc1589f0 0x7f3bfc0b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41910/0 (socket says 172.21.15.192:41910) 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3bfaa00640 1 -- 172.21.15.192:0/4160286100 learned_addr learned my addr 172.21.15.192:0/4160286100 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.499+0000 7f3bfa000640 1 --2- 172.21.15.192:0/4160286100 >> v2:172.21.15.192:3300/0 conn(0x7f3bfc0b3af0 0x7f3bfc15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.500+0000 7f3bfb400640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06c0b0 0x7f3bfc06c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.500+0000 7f3bfa000640 1 -- 172.21.15.192:0/4160286100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06c0b0 msgr2=0x7f3bfc06c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.500+0000 7f3bfa000640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06c0b0 0x7f3bfc06c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.500+0000 7f3bfa000640 1 -- 172.21.15.192:0/4160286100 >> v1:172.21.15.192:6789/0 conn(0x7f3bfc1589f0 legacy=0x7f3bfc0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.500+0000 7f3bfa000640 1 -- 172.21.15.192:0/4160286100 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc15bbd0 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.501+0000 7f3bfa000640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0b3af0 0x7f3bfc15b260 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097a0 tx=0x7f3be802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159e6587cdbe4924 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.501+0000 7f3bf9600640 1 -- 172.21.15.192:0/4160286100 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032440 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.501+0000 7f3bf9600640 1 -- 172.21.15.192:0/4160286100 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80325a0 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.501+0000 7f3bf9600640 1 -- 172.21.15.192:0/4160286100 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8032930 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 -- 172.21.15.192:0/4160286100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0b3af0 msgr2=0x7f3bfc15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0b3af0 0x7f3bfc15b260 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097a0 tx=0x7f3be802a180 comp rx=0 tx=0).stop 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 -- 172.21.15.192:0/4160286100 shutdown_connections 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06c0b0 0x7f3bfc06c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 --2- 172.21.15.192:0/4160286100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0b3af0 0x7f3bfc15b260 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 -- 172.21.15.192:0/4160286100 >> 172.21.15.192:0/4160286100 conn(0x7f3bfc0b08f0 msgr2=0x7f3bfc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:08.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 -- 172.21.15.192:0/4160286100 shutdown_connections 2024-09-13T18:42:08.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.502+0000 7f3c01e00640 1 -- 172.21.15.192:0/4160286100 wait complete. 2024-09-13T18:42:08.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.503+0000 7f3c01e00640 1 Processor -- start 2024-09-13T18:42:08.506 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.504+0000 7f3c01e00640 1 -- start start 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.504+0000 7f3c01e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.504+0000 7f3c01e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 0x7f3bfc156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.504+0000 7f3c01e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 0x7f3bfc1e5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.504+0000 7f3c01e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1579c0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3c01e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1574d0 con 0x7f3bfc1589f0 2024-09-13T18:42:08.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3c01e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc1e6220 con 0x7f3bfc0b3af0 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36874/0 (socket says 172.21.15.192:36874) 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 -- 172.21.15.192:0/2129438210 learned_addr learned my addr 172.21.15.192:0/2129438210 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfa000640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 0x7f3bfc156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfb400640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 0x7f3bfc1e5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 -- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 msgr2=0x7f3bfc156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 0x7f3bfc156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 -- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 msgr2=0x7f3bfc1e5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 0x7f3bfc1e5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfaa00640 1 -- 172.21.15.192:0/2129438210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009400 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfa000640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 0x7f3bfc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.505+0000 7f3bfb400640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 0x7f3bfc1e5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3bfaa00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c480 tx=0x7f3bec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec005ce0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec005e40 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc1e34c0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec0072f0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.506+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc1e3a80 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.507+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc06c540 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.508+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bec007450 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.509+0000 7f3bf3400640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 0x7f3bdc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.509+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bec088770 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.509+0000 7f3bfa000640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 0x7f3bdc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.509+0000 7f3bfa000640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 0x7f3bdc06d0f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3be8034000 tx=0x7f3be802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.513+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bec053a90 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.681+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bfc0cb8f0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.681+0000 7f3bf3400640 1 -- 172.21.15.192:0/2129438210 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bec0170a0 con 0x7f3bfc06c0b0 2024-09-13T18:42:08.684 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:42:08.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.683+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 msgr2=0x7f3bdc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.686 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.683+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 0x7f3bdc06d0f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3be8034000 tx=0x7f3be802e000 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 msgr2=0x7f3bfc071520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00c480 tx=0x7f3bec00c940 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 shutdown_connections 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bdc06ac30 0x7f3bdc06d0f0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc1589f0 0x7f3bfc1e5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc0b3af0 0x7f3bfc156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 --2- 172.21.15.192:0/2129438210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc06c0b0 0x7f3bfc071520 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 >> 172.21.15.192:0/2129438210 conn(0x7f3bfc0b08f0 msgr2=0x7f3bfc15a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 shutdown_connections 2024-09-13T18:42:08.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.684+0000 7f3c01e00640 1 -- 172.21.15.192:0/2129438210 wait complete. 2024-09-13T18:42:08.703 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:42:08.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.857+0000 7f6c5ae00640 1 Processor -- start 2024-09-13T18:42:08.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.857+0000 7f6c5ae00640 1 -- start start 2024-09-13T18:42:08.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c5ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415e790 0x7f6c540cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c5ae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6c5415bc20 0x7f6c540afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c5ae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c54140480 con 0x7f6c540cacd0 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c5ae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c540cb5f0 con 0x7f6c5415bc20 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c5ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415ebd0 con 0x7f6c5415e790 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c53e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6c540cacd0 0x7f6c54140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41918/0 (socket says 172.21.15.192:41918) 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.858+0000 7f6c53e00640 1 -- 172.21.15.192:0/3173922258 learned_addr learned my addr 172.21.15.192:0/3173922258 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c58e00640 1 --2- 172.21.15.192:0/3173922258 >> v2:172.21.15.194:3300/0 conn(0x7f6c5415bc20 0x7f6c540afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c53400640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415e790 0x7f6c540cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2279518177 0 0) 0x7f6c54140480 con 0x7f6c540cacd0 2024-09-13T18:42:08.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c38003520 con 0x7f6c540cacd0 2024-09-13T18:42:08.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c58e00640 1 -- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415e790 msgr2=0x7f6c540cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:08.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c58e00640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415e790 0x7f6c540cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c58e00640 1 -- 172.21.15.192:0/3173922258 >> v1:172.21.15.192:6789/0 conn(0x7f6c540cacd0 legacy=0x7f6c54140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1252962864 0 0) 0x7f6c38003520 con 0x7f6c540cacd0 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.859+0000 7f6c58e00640 1 -- 172.21.15.192:0/3173922258 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c5415ee90 con 0x7f6c5415bc20 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.860+0000 7f6c58e00640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415bc20 0x7f6c540afd80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009d90 tx=0x7f6c4c02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa2b68dee7392934 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.860+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44001670 con 0x7f6c5415bc20 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4c02d050 con 0x7f6c5415bc20 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c52a00640 1 -- 172.21.15.192:0/3173922258 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4c007760 con 0x7f6c5415bc20 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 -- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415bc20 msgr2=0x7f6c540afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415bc20 0x7f6c540afd80 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6c4c009d90 tx=0x7f6c4c02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 -- 172.21.15.192:0/3173922258 shutdown_connections 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415bc20 0x7f6c540afd80 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/3173922258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415e790 0x7f6c540cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 -- 172.21.15.192:0/3173922258 >> 172.21.15.192:0/3173922258 conn(0x7f6c540ae960 msgr2=0x7f6c5406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 -- 172.21.15.192:0/3173922258 shutdown_connections 2024-09-13T18:42:08.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.861+0000 7f6c5ae00640 1 -- 172.21.15.192:0/3173922258 wait complete. 2024-09-13T18:42:08.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.863+0000 7f6c5ae00640 1 Processor -- start 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.863+0000 7f6c5ae00640 1 -- start start 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415bc20 0x7f6c5413e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415e790 0x7f6c5413ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415af60 con 0x7f6c540cacd0 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c540b3090 con 0x7f6c5415e790 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c5ae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c5415a720 con 0x7f6c5415bc20 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c53e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36878/0 (socket says 172.21.15.192:36878) 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c53e00640 1 -- 172.21.15.192:0/2241967668 learned_addr learned my addr 172.21.15.192:0/2241967668 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:08.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c58e00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415e790 0x7f6c5413ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.864+0000 7f6c53400640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415bc20 0x7f6c5413e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 -- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415bc20 msgr2=0x7f6c5413e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415bc20 0x7f6c5413e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 -- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415e790 msgr2=0x7f6c5413ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415e790 0x7f6c5413ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 -- 172.21.15.192:0/2241967668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4c009a70 con 0x7f6c540cacd0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c53e00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6c440011e0 tx=0x7f6c4400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44005ad0 con 0x7f6c540cacd0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c44005c50 con 0x7f6c540cacd0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c44007070 con 0x7f6c540cacd0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c5415a9a0 con 0x7f6c540cacd0 2024-09-13T18:42:08.872 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.865+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c540b2d20 con 0x7f6c540cacd0 2024-09-13T18:42:08.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.866+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c540cb0b0 con 0x7f6c540cacd0 2024-09-13T18:42:08.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.867+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6c440071d0 con 0x7f6c540cacd0 2024-09-13T18:42:08.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.868+0000 7f6c4be00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 0x7f6c3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:08.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.868+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c44088af0 con 0x7f6c540cacd0 2024-09-13T18:42:08.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.868+0000 7f6c53400640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 0x7f6c3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:08.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.869+0000 7f6c53400640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 0x7f6c3406d0c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6c541f5cd0 tx=0x7f6c40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:08.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:08.872+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6c44053c30 con 0x7f6c540cacd0 2024-09-13T18:42:09.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.051+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6c5406c6c0 con 0x7f6c540cacd0 2024-09-13T18:42:09.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.051+0000 7f6c4be00640 1 -- 172.21.15.192:0/2241967668 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v137) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6c44017020 con 0x7f6c540cacd0 2024-09-13T18:42:09.054 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.053+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 msgr2=0x7f6c3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.053+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 0x7f6c3406d0c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f6c541f5cd0 tx=0x7f6c40008040 comp rx=0 tx=0).stop 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.053+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 msgr2=0x7f6c5415a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.053+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f6c440011e0 tx=0x7f6c4400cbe0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 shutdown_connections 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6c3406ac00 0x7f6c3406d0c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6c5415e790 0x7f6c5413ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6c5415bc20 0x7f6c5413e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 --2- 172.21.15.192:0/2241967668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6c540cacd0 0x7f6c5415a1e0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 >> 172.21.15.192:0/2241967668 conn(0x7f6c540ae960 msgr2=0x7f6c5415c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:09.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 shutdown_connections 2024-09-13T18:42:09.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.054+0000 7f6c5ae00640 1 -- 172.21.15.192:0/2241967668 wait complete. 2024-09-13T18:42:09.072 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:42:09.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:09.073 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:42:09.142 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:42:09.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:09.142 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:42:09.180 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:09.180 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:09.216 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:42:09.216 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:09.216 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:09.256 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:42:09.256 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:09.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.408+0000 7f5885600640 1 Processor -- start 2024-09-13T18:42:09.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.408+0000 7f5885600640 1 -- start start 2024-09-13T18:42:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f5885600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58800cacd0 0x7f588015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f5885600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f58800afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f5885600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5880140480 con 0x7f58800cb0b0 2024-09-13T18:42:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f5885600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58800cb520 con 0x7f58800cacd0 2024-09-13T18:42:09.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f5885600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588015ee90 con 0x7f588015bc20 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f587ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58800cacd0 0x7f588015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f587ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f58800cacd0 0x7f588015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36882/0 (socket says 172.21.15.192:36882) 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.409+0000 7f587ea00640 1 -- 172.21.15.192:0/2006432099 learned_addr learned my addr 172.21.15.192:0/2006432099 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.410+0000 7f587f400640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f58800afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.410+0000 7f587ea00640 1 -- 172.21.15.192:0/2006432099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 msgr2=0x7f58800afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:09.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.410+0000 7f587ea00640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f58800afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.410+0000 7f587ea00640 1 -- 172.21.15.192:0/2006432099 >> v1:172.21.15.194:6789/0 conn(0x7f58800cb0b0 legacy=0x7f5880140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.410+0000 7f587ea00640 1 -- 172.21.15.192:0/2006432099 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588015f170 con 0x7f58800cacd0 2024-09-13T18:42:09.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.411+0000 7f587ea00640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cacd0 0x7f588015e790 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5870009870 tx=0x7f587002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6f4a19891a2f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.411+0000 7f587e000640 1 -- 172.21.15.192:0/2006432099 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870032440 con 0x7f58800cacd0 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.411+0000 7f587e000640 1 -- 172.21.15.192:0/2006432099 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58700325a0 con 0x7f58800cacd0 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.411+0000 7f587e000640 1 -- 172.21.15.192:0/2006432099 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5870032930 con 0x7f58800cacd0 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 -- 172.21.15.192:0/2006432099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cacd0 msgr2=0x7f588015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cacd0 0x7f588015e790 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f5870009870 tx=0x7f587002a270 comp rx=0 tx=0).stop 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 -- 172.21.15.192:0/2006432099 shutdown_connections 2024-09-13T18:42:09.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f58800afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 --2- 172.21.15.192:0/2006432099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cacd0 0x7f588015e790 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 -- 172.21.15.192:0/2006432099 >> 172.21.15.192:0/2006432099 conn(0x7f58800ae960 msgr2=0x7f588006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 -- 172.21.15.192:0/2006432099 shutdown_connections 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.412+0000 7f5885600640 1 -- 172.21.15.192:0/2006432099 wait complete. 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.414+0000 7f5885600640 1 Processor -- start 2024-09-13T18:42:09.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.414+0000 7f5885600640 1 -- start start 2024-09-13T18:42:09.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800cacd0 0x7f588006bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f588015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006a950 con 0x7f58800cb0b0 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f588006c010 con 0x7f58800cacd0 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5885600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f588006a020 con 0x7f588015bc20 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36890/0 (socket says 172.21.15.192:36890) 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 -- 172.21.15.192:0/726095481 learned_addr learned my addr 172.21.15.192:0/726095481 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f587ea00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800cacd0 0x7f588006bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f587f400640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f588015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 -- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 msgr2=0x7f588015a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f588015a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 -- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800cacd0 msgr2=0x7f588006bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800cacd0 0x7f588006bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.415+0000 7f5877e00640 1 -- 172.21.15.192:0/726095481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58700094d0 con 0x7f58800cb0b0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5877e00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f586800c400 tx=0x7f586800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680052d0 con 0x7f58800cb0b0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5868005430 con 0x7f58800cb0b0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f588006a300 con 0x7f58800cb0b0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868003830 con 0x7f58800cb0b0 2024-09-13T18:42:09.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.416+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f588006ade0 con 0x7f58800cb0b0 2024-09-13T18:42:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.417+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f588006ab00 con 0x7f58800cb0b0 2024-09-13T18:42:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.418+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5868003990 con 0x7f58800cb0b0 2024-09-13T18:42:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.419+0000 7f5876a00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 0x7f585c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.419+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5868088830 con 0x7f58800cb0b0 2024-09-13T18:42:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.419+0000 7f587ea00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 0x7f585c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.420+0000 7f587ea00640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 0x7f585c06d0c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.423+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f588006ab00 con 0x7f58800cb0b0 2024-09-13T18:42:09.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.627+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f588015e790 con 0x7f58800cb0b0 2024-09-13T18:42:09.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.627+0000 7f5876a00640 1 -- 172.21.15.192:0/726095481 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f5868017090 con 0x7f58800cb0b0 2024-09-13T18:42:09.815 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:09.815 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:42:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:42:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 msgr2=0x7f585c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 0x7f585c06d0c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f5870034000 tx=0x7f587002e000 comp rx=0 tx=0).stop 2024-09-13T18:42:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 msgr2=0x7f588013c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f586800c400 tx=0x7f586800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 shutdown_connections 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f585c06ac00 0x7f585c06d0c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f588015bc20 0x7f588015a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f58800cb0b0 0x7f588013c8b0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 --2- 172.21.15.192:0/726095481 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f58800cacd0 0x7f588006bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.629+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 >> 172.21.15.192:0/726095481 conn(0x7f58800ae960 msgr2=0x7f5880071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.630+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 shutdown_connections 2024-09-13T18:42:09.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.630+0000 7f5885600640 1 -- 172.21.15.192:0/726095481 wait complete. 2024-09-13T18:42:09.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.970+0000 7fdf48c00640 1 Processor -- start 2024-09-13T18:42:09.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.970+0000 7fdf48c00640 1 -- start start 2024-09-13T18:42:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.971+0000 7fdf48c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdf4415e790 0x7fdf440cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.971+0000 7fdf48c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf440afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.971+0000 7fdf48c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4415ec00 con 0x7fdf440cacd0 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.971+0000 7fdf48c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf440cb5f0 con 0x7fdf4415e790 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.971+0000 7fdf48c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44140480 con 0x7fdf4415bc20 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf41e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fdf440cacd0 0x7fdf44140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:41924/0 (socket says 172.21.15.192:41924) 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf41e00640 1 -- 172.21.15.192:0/2709659886 learned_addr learned my addr 172.21.15.192:0/2709659886 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf39400640 1 --2- 172.21.15.192:0/2709659886 >> v2:172.21.15.194:3300/0 conn(0x7fdf4415e790 0x7fdf440cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf42800640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf440afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf41400640 1 -- 172.21.15.192:0/2709659886 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361317453 0 0) 0x7fdf4415ec00 con 0x7fdf440cacd0 2024-09-13T18:42:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf41400640 1 -- 172.21.15.192:0/2709659886 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf28003520 con 0x7fdf440cacd0 2024-09-13T18:42:09.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf39400640 1 -- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 msgr2=0x7fdf440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf39400640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf440afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf39400640 1 -- 172.21.15.192:0/2709659886 >> v1:172.21.15.192:6789/0 conn(0x7fdf440cacd0 legacy=0x7fdf44140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf39400640 1 -- 172.21.15.192:0/2709659886 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4415ee90 con 0x7fdf4415e790 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.972+0000 7fdf42800640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf440afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.973+0000 7fdf39400640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf4415e790 0x7fdf440cb0b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5258c01537f3e1c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf41400640 1 -- 172.21.15.192:0/2709659886 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c032440 con 0x7fdf4415e790 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf41400640 1 -- 172.21.15.192:0/2709659886 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c0325a0 con 0x7fdf4415e790 2024-09-13T18:42:09.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf41400640 1 -- 172.21.15.192:0/2709659886 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c032930 con 0x7fdf4415e790 2024-09-13T18:42:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 -- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf4415e790 msgr2=0x7fdf440cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf4415e790 0x7fdf440cb0b0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0097a0 tx=0x7fdf2c02a180 comp rx=0 tx=0).stop 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 -- 172.21.15.192:0/2709659886 shutdown_connections 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf440afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2709659886 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf4415e790 0x7fdf440cb0b0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 -- 172.21.15.192:0/2709659886 >> 172.21.15.192:0/2709659886 conn(0x7fdf440ae960 msgr2=0x7fdf4406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 -- 172.21.15.192:0/2709659886 shutdown_connections 2024-09-13T18:42:09.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.974+0000 7fdf48c00640 1 -- 172.21.15.192:0/2709659886 wait complete. 2024-09-13T18:42:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.976+0000 7fdf48c00640 1 Processor -- start 2024-09-13T18:42:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.976+0000 7fdf48c00640 1 -- start start 2024-09-13T18:42:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf440cacd0 0x7fdf44154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf44069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4406b5e0 con 0x7fdf4415e790 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44155110 con 0x7fdf440cacd0 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf48c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4406ba70 con 0x7fdf4415bc20 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf42800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf42800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36900/0 (socket says 172.21.15.192:36900) 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf41e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf440cacd0 0x7fdf44154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf42800640 1 -- 172.21.15.192:0/2560856381 learned_addr learned my addr 172.21.15.192:0/2560856381 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:09.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.977+0000 7fdf39400640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf44069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 -- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 msgr2=0x7fdf44069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf44069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 -- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf440cacd0 msgr2=0x7fdf44154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf440cacd0 0x7fdf44154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 -- 172.21.15.192:0/2560856381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf3c009a70 con 0x7fdf4415e790 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf42800640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00efc0 tx=0x7fdf3c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c009d70 con 0x7fdf4415e790 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3c00f040 con 0x7fdf4415e790 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c003990 con 0x7fdf4415e790 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c009400 con 0x7fdf4415e790 2024-09-13T18:42:09.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.978+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4406acb0 con 0x7fdf4415e790 2024-09-13T18:42:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.980+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf440cb0b0 con 0x7fdf4415e790 2024-09-13T18:42:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.980+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf3c0144a0 con 0x7fdf4415e790 2024-09-13T18:42:09.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.981+0000 7fdf3aa00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 0x7fdf2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.981+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf3c089f70 con 0x7fdf4415e790 2024-09-13T18:42:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.981+0000 7fdf41e00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 0x7fdf2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:09.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.982+0000 7fdf41e00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 0x7fdf2006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf340011e0 tx=0x7fdf34007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:09.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:09.985+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf3c055160 con 0x7fdf4415e790 2024-09-13T18:42:10.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.157+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf4406b720 con 0x7fdf4415e790 2024-09-13T18:42:10.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.158+0000 7fdf3aa00640 1 -- 172.21.15.192:0/2560856381 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7fdf3c018090 con 0x7fdf4415e790 2024-09-13T18:42:10.162 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:10.162 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:10.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 msgr2=0x7fdf2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 0x7fdf2006d0c0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fdf340011e0 tx=0x7fdf34007d30 comp rx=0 tx=0).stop 2024-09-13T18:42:10.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 msgr2=0x7fdf4406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c00efc0 tx=0x7fdf3c009f90 comp rx=0 tx=0).stop 2024-09-13T18:42:10.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 shutdown_connections 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf2006ac00 0x7fdf2006d0c0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf4415e790 0x7fdf4406a3e0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf4415bc20 0x7fdf44069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 --2- 172.21.15.192:0/2560856381 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf440cacd0 0x7fdf44154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 >> 172.21.15.192:0/2560856381 conn(0x7fdf440ae960 msgr2=0x7fdf4415d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 shutdown_connections 2024-09-13T18:42:10.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.160+0000 7fdf48c00640 1 -- 172.21.15.192:0/2560856381 wait complete. 2024-09-13T18:42:10.180 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:41:48.584706+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '133', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:41:49.749521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '135', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:10.181 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:10.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.333+0000 7f05afe00640 1 Processor -- start 2024-09-13T18:42:10.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.334+0000 7f05afe00640 1 -- start start 2024-09-13T18:42:10.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05afe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05afe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05b015a5f0 0x7f05b00b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05afe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05b015af60 con 0x7f05b006bc30 2024-09-13T18:42:10.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05afe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05b015aaa0 con 0x7f05b015a5f0 2024-09-13T18:42:10.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05afe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b006b7a0 con 0x7f05b0159b00 2024-09-13T18:42:10.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05aea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05af400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05b015a5f0 0x7f05b00b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05aea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:43688/0 (socket says 172.21.15.192:43688) 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.335+0000 7f05aea00640 1 -- 172.21.15.192:0/3294331407 learned_addr learned my addr 172.21.15.192:0/3294331407 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.336+0000 7f05aea00640 1 -- 172.21.15.192:0/3294331407 >> v2:172.21.15.194:3300/0 conn(0x7f05b015a5f0 msgr2=0x7f05b00b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.336+0000 7f05aea00640 1 --2- 172.21.15.192:0/3294331407 >> v2:172.21.15.194:3300/0 conn(0x7f05b015a5f0 0x7f05b00b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.336+0000 7f05aea00640 1 -- 172.21.15.192:0/3294331407 >> v1:172.21.15.194:6789/0 conn(0x7f05b006bc30 legacy=0x7f05b0159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.336+0000 7f05aea00640 1 -- 172.21.15.192:0/3294331407 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05b015ac80 con 0x7f05b0159b00 2024-09-13T18:42:10.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.337+0000 7f05aea00640 1 --2- 172.21.15.192:0/3294331407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009870 tx=0x7f05a002c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c6ebcc0e2b3982 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.337+0000 7f05ad600640 1 -- 172.21.15.192:0/3294331407 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0031710 con 0x7f05b0159b00 2024-09-13T18:42:10.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.337+0000 7f05ad600640 1 -- 172.21.15.192:0/3294331407 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a002f050 con 0x7f05b0159b00 2024-09-13T18:42:10.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.337+0000 7f05ad600640 1 -- 172.21.15.192:0/3294331407 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a0031a90 con 0x7f05b0159b00 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 -- 172.21.15.192:0/3294331407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 msgr2=0x7f05b00b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 --2- 172.21.15.192:0/3294331407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05a0009870 tx=0x7f05a002c480 comp rx=0 tx=0).stop 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 -- 172.21.15.192:0/3294331407 shutdown_connections 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 --2- 172.21.15.192:0/3294331407 >> v2:172.21.15.194:3300/0 conn(0x7f05b015a5f0 0x7f05b00b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 --2- 172.21.15.192:0/3294331407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00b2d70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 -- 172.21.15.192:0/3294331407 >> 172.21.15.192:0/3294331407 conn(0x7f05b00736d0 msgr2=0x7f05b00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 -- 172.21.15.192:0/3294331407 shutdown_connections 2024-09-13T18:42:10.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.338+0000 7f05afe00640 1 -- 172.21.15.192:0/3294331407 wait complete. 2024-09-13T18:42:10.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.339+0000 7f05afe00640 1 Processor -- start 2024-09-13T18:42:10.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.339+0000 7f05afe00640 1 -- start start 2024-09-13T18:42:10.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b015a5f0 0x7f05b01e4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b0071a30 con 0x7f05b006bc30 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05b01e75d0 con 0x7f05b015a5f0 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.340+0000 7f05afe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05b01e78b0 con 0x7f05b0159b00 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53218/0 (socket says 172.21.15.192:53218) 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 -- 172.21.15.192:0/3585911590 learned_addr learned my addr 172.21.15.192:0/3585911590 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05af400640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b015a5f0 0x7f05b01e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05ae000640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 -- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 msgr2=0x7f05b00afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 -- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b015a5f0 msgr2=0x7f05b01e4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b015a5f0 0x7f05b01e4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 -- 172.21.15.192:0/3585911590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a00094d0 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05aea00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f05a0000c00 tx=0x7f05a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.341+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a003c830 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.342+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05a003c990 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.342+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05a003cd40 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.342+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05b01e7b90 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.342+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05b00b0160 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.343+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05b0159ee0 con 0x7f05b006bc30 2024-09-13T18:42:10.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.343+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05a003a070 con 0x7f05b006bc30 2024-09-13T18:42:10.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.344+0000 7f05a6a00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 0x7f059006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.344+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05a00aa130 con 0x7f05b006bc30 2024-09-13T18:42:10.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.345+0000 7f05ae000640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 0x7f059006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.345+0000 7f05ae000640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 0x7f059006d0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f05b0154a90 tx=0x7f059c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.349+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05a0075300 con 0x7f05b006bc30 2024-09-13T18:42:10.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.516+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05b015a2e0 con 0x7f05b006bc30 2024-09-13T18:42:10.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.517+0000 7f05a6a00640 1 -- 172.21.15.192:0/3585911590 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v137) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05a0078920 con 0x7f05b006bc30 2024-09-13T18:42:10.520 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 msgr2=0x7f059006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 0x7f059006d0c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f05b0154a90 tx=0x7f059c009040 comp rx=0 tx=0).stop 2024-09-13T18:42:10.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 msgr2=0x7f05b00714f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f05a0000c00 tx=0x7f05a00046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 shutdown_connections 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f059006ac00 0x7f059006d0c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05b015a5f0 0x7f05b01e4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05b0159b00 0x7f05b00afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 --2- 172.21.15.192:0/3585911590 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05b006bc30 0x7f05b00714f0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 >> 172.21.15.192:0/3585911590 conn(0x7f05b00736d0 msgr2=0x7f05b00b1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 shutdown_connections 2024-09-13T18:42:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.519+0000 7f05afe00640 1 -- 172.21.15.192:0/3585911590 wait complete. 2024-09-13T18:42:10.538 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:42:10.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.691+0000 7f085dc00640 1 Processor -- start 2024-09-13T18:42:10.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.691+0000 7f085dc00640 1 -- start start 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f085dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f085806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f085dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f085806a8b0 0x7f08580b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f085dc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085806b480 con 0x7f08580b3bd0 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f085dc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08580b4060 con 0x7f085806a8b0 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f085dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580ce770 con 0x7f08581434c0 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f085806a8b0 0x7f08580b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f085806a8b0 0x7f08580b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53220/0 (socket says 172.21.15.192:53220) 2024-09-13T18:42:10.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 -- 172.21.15.192:0/620171926 learned_addr learned my addr 172.21.15.192:0/620171926 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f0856a00640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f085806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 -- 172.21.15.192:0/620171926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 msgr2=0x7f085806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f085806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 -- 172.21.15.192:0/620171926 >> v1:172.21.15.194:6789/0 conn(0x7f08580b3bd0 legacy=0x7f085806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f084e000640 1 -- 172.21.15.192:0/620171926 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085806b760 con 0x7f085806a8b0 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.693+0000 7f0856a00640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f085806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:10.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.694+0000 7f084e000640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f08580b3690 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f08400098a0 tx=0x7f084002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a5db9b6353793c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f0856000640 1 -- 172.21.15.192:0/620171926 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840032440 con 0x7f085806a8b0 2024-09-13T18:42:10.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f0856000640 1 -- 172.21.15.192:0/620171926 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08400325a0 con 0x7f085806a8b0 2024-09-13T18:42:10.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f0856000640 1 -- 172.21.15.192:0/620171926 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0840032930 con 0x7f085806a8b0 2024-09-13T18:42:10.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 -- 172.21.15.192:0/620171926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 msgr2=0x7f08580b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f08580b3690 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f08400098a0 tx=0x7f084002a250 comp rx=0 tx=0).stop 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 -- 172.21.15.192:0/620171926 shutdown_connections 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f08580b3690 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 --2- 172.21.15.192:0/620171926 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f085806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 -- 172.21.15.192:0/620171926 >> 172.21.15.192:0/620171926 conn(0x7f08580b08f0 msgr2=0x7f08580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 -- 172.21.15.192:0/620171926 shutdown_connections 2024-09-13T18:42:10.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.695+0000 7f085dc00640 1 -- 172.21.15.192:0/620171926 wait complete. 2024-09-13T18:42:10.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.697+0000 7f085dc00640 1 Processor -- start 2024-09-13T18:42:10.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.697+0000 7f085dc00640 1 -- start start 2024-09-13T18:42:10.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580b3bd0 0x7f08580af720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f08580afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858071740 con 0x7f085806a8b0 2024-09-13T18:42:10.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085813aa10 con 0x7f08580b3bd0 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f085dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085813a0e0 con 0x7f08581434c0 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f0856a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f0856a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53224/0 (socket says 172.21.15.192:53224) 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.698+0000 7f0856a00640 1 -- 172.21.15.192:0/3639401406 learned_addr learned my addr 172.21.15.192:0/3639401406 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 -- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 msgr2=0x7f08580afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f08580afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 -- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580b3bd0 msgr2=0x7f08580af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580b3bd0 0x7f08580af720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 -- 172.21.15.192:0/3639401406 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08400094d0 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f0856a00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f084800c7f0 tx=0x7f084800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848007820 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848007980 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848007cf0 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085813a3c0 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.699+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085813aea0 con 0x7f085806a8b0 2024-09-13T18:42:10.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.700+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f085806acf0 con 0x7f085806a8b0 2024-09-13T18:42:10.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.701+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f08480113f0 con 0x7f085806a8b0 2024-09-13T18:42:10.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.702+0000 7f084f400640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 0x7f083406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:10.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.702+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0848089660 con 0x7f085806a8b0 2024-09-13T18:42:10.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.702+0000 7f084e000640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 0x7f083406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:10.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.703+0000 7f084e000640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 0x7f083406d0f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0840034000 tx=0x7f084002c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:10.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.706+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0848054830 con 0x7f085806a8b0 2024-09-13T18:42:10.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.877+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f085815dbd0 con 0x7f085806a8b0 2024-09-13T18:42:10.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.877+0000 7f084f400640 1 -- 172.21.15.192:0/3639401406 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v137) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0848057e50 con 0x7f085806a8b0 2024-09-13T18:42:10.880 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:42:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 msgr2=0x7f083406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 0x7f083406d0f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0840034000 tx=0x7f084002c000 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 msgr2=0x7f0858139890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f084800c7f0 tx=0x7f084800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 shutdown_connections 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083406ac30 0x7f083406d0f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08581434c0 0x7f08580afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580b3bd0 0x7f08580af720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.879+0000 7f085dc00640 1 --2- 172.21.15.192:0/3639401406 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f085806a8b0 0x7f0858139890 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.880+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 >> 172.21.15.192:0/3639401406 conn(0x7f08580b08f0 msgr2=0x7f08580ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.880+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 shutdown_connections 2024-09-13T18:42:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:10.880+0000 7f085dc00640 1 -- 172.21.15.192:0/3639401406 wait complete. 2024-09-13T18:42:10.898 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:42:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.050+0000 7f9455c00640 1 Processor -- start 2024-09-13T18:42:11.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.050+0000 7f9455c00640 1 -- start start 2024-09-13T18:42:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f9455c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94500b2600 0x7f94500ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f9455c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f94500cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f9455c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500ae1d0 con 0x7f945015a910 2024-09-13T18:42:11.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f9455c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500b21e0 con 0x7f94500b2600 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f9455c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500b1bf0 con 0x7f94500add80 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.051+0000 7f944e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94500b2600 0x7f94500ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94500b2600 0x7f94500ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53228/0 (socket says 172.21.15.192:53228) 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 -- 172.21.15.192:0/2553024670 learned_addr learned my addr 172.21.15.192:0/2553024670 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944f400640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f94500cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 -- 172.21.15.192:0/2553024670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 msgr2=0x7f94500cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f94500cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 -- 172.21.15.192:0/2553024670 >> v1:172.21.15.194:6789/0 conn(0x7f945015a910 legacy=0x7f9450160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944e000640 1 -- 172.21.15.192:0/2553024670 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9450161510 con 0x7f94500b2600 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.052+0000 7f944d600640 1 -- 172.21.15.192:0/2553024670 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3834708098 0 0) 0x7f9440001110 con 0x7f945015a910 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.053+0000 7f944e000640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94500ad840 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f943c009870 tx=0x7f943c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5471772078f8836 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.053+0000 7f944d600640 1 -- 172.21.15.192:0/2553024670 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c032440 con 0x7f94500b2600 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.053+0000 7f944d600640 1 -- 172.21.15.192:0/2553024670 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c0325a0 con 0x7f94500b2600 2024-09-13T18:42:11.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.053+0000 7f944d600640 1 -- 172.21.15.192:0/2553024670 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c032930 con 0x7f94500b2600 2024-09-13T18:42:11.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 -- 172.21.15.192:0/2553024670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 msgr2=0x7f94500ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94500ad840 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f943c009870 tx=0x7f943c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 -- 172.21.15.192:0/2553024670 shutdown_connections 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f94500cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 --2- 172.21.15.192:0/2553024670 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94500ad840 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 -- 172.21.15.192:0/2553024670 >> 172.21.15.192:0/2553024670 conn(0x7f94500b08f0 msgr2=0x7f94500b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 -- 172.21.15.192:0/2553024670 shutdown_connections 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.054+0000 7f9455c00640 1 -- 172.21.15.192:0/2553024670 wait complete. 2024-09-13T18:42:11.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.056+0000 7f9455c00640 1 Processor -- start 2024-09-13T18:42:11.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.056+0000 7f9455c00640 1 -- start start 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f9450153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f945015a910 0x7f945015ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94501f42d0 con 0x7f94500b2600 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9450154570 con 0x7f945015a910 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f9455c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9450154850 con 0x7f94500add80 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53238/0 (socket says 172.21.15.192:53238) 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 -- 172.21.15.192:0/76364173 learned_addr learned my addr 172.21.15.192:0/76364173 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944f400640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f945015a910 0x7f945015ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944ea00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f9450153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 -- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 msgr2=0x7f9450153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f9450153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 -- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f945015a910 msgr2=0x7f945015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f945015a910 0x7f945015ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.057+0000 7f944e000640 1 -- 172.21.15.192:0/76364173 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c0094d0 con 0x7f94500b2600 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f944e000640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f943c009870 tx=0x7f943c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c032440 con 0x7f94500b2600 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f943c004030 con 0x7f94500b2600 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9450154b30 con 0x7f94500b2600 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f943c0043e0 con 0x7f94500b2600 2024-09-13T18:42:11.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.058+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94501550f0 con 0x7f94500b2600 2024-09-13T18:42:11.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.059+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9450154990 con 0x7f94500b2600 2024-09-13T18:42:11.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.060+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f943c030980 con 0x7f94500b2600 2024-09-13T18:42:11.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.061+0000 7f9446a00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 0x7f943006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.061+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f943c0aa4b0 con 0x7f94500b2600 2024-09-13T18:42:11.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.061+0000 7f944ea00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 0x7f943006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.062+0000 7f944ea00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 0x7f943006d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9440000f60 tx=0x7f9440009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.065+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9450154990 con 0x7f94500b2600 2024-09-13T18:42:11.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.235+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9450154990 con 0x7f94500b2600 2024-09-13T18:42:11.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.236+0000 7f9446a00640 1 -- 172.21.15.192:0/76364173 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v137) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9450154990 con 0x7f94500b2600 2024-09-13T18:42:11.239 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 msgr2=0x7f943006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 0x7f943006d0c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f9440000f60 tx=0x7f9440009040 comp rx=0 tx=0).stop 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 msgr2=0x7f94501f3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f943c009870 tx=0x7f943c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 shutdown_connections 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f943006ac00 0x7f943006d0c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f945015a910 0x7f945015ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94500b2600 0x7f94501f3d90 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 --2- 172.21.15.192:0/76364173 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f94500add80 0x7f9450153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 >> 172.21.15.192:0/76364173 conn(0x7f94500b08f0 msgr2=0x7f945015fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 shutdown_connections 2024-09-13T18:42:11.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.238+0000 7f9455c00640 1 -- 172.21.15.192:0/76364173 wait complete. 2024-09-13T18:42:11.257 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:11.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.407+0000 7fbe30c00640 1 Processor -- start 2024-09-13T18:42:11.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.407+0000 7fbe30c00640 1 -- start start 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe30c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe2c146610 0x7fbe2c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 0x7fbe2c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe30c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe2c0ae770 con 0x7fbe2c0afd80 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe30c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2c0cd920 con 0x7fbe2c146610 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe30c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c0cdb30 con 0x7fbe2c0b2780 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe2c146610 0x7fbe2c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe2c146610 0x7fbe2c0ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53252/0 (socket says 172.21.15.192:53252) 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 -- 172.21.15.192:0/1285189740 learned_addr learned my addr 172.21.15.192:0/1285189740 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29400640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 0x7fbe2c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 -- 172.21.15.192:0/1285189740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 msgr2=0x7fbe2c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 0x7fbe2c0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 -- 172.21.15.192:0/1285189740 >> v1:172.21.15.194:6789/0 conn(0x7fbe2c0afd80 legacy=0x7fbe2c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29e00640 1 -- 172.21.15.192:0/1285189740 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe2c0ae1b0 con 0x7fbe2c146610 2024-09-13T18:42:11.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.409+0000 7fbe29400640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 0x7fbe2c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:11.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.410+0000 7fbe29e00640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0ce2f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009e50 tx=0x7fbe1c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ab450d69daf4ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.410+0000 7fbe28a00640 1 -- 172.21.15.192:0/1285189740 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c02aea0 con 0x7fbe2c146610 2024-09-13T18:42:11.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.410+0000 7fbe28a00640 1 -- 172.21.15.192:0/1285189740 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c02d050 con 0x7fbe2c146610 2024-09-13T18:42:11.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe28a00640 1 -- 172.21.15.192:0/1285189740 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c031820 con 0x7fbe2c146610 2024-09-13T18:42:11.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 -- 172.21.15.192:0/1285189740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 msgr2=0x7fbe2c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0ce2f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c009e50 tx=0x7fbe1c02a6c0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 -- 172.21.15.192:0/1285189740 shutdown_connections 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0b2780 0x7fbe2c0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 --2- 172.21.15.192:0/1285189740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0ce2f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 -- 172.21.15.192:0/1285189740 >> 172.21.15.192:0/1285189740 conn(0x7fbe2c0ae960 msgr2=0x7fbe2c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 -- 172.21.15.192:0/1285189740 shutdown_connections 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.411+0000 7fbe30c00640 1 -- 172.21.15.192:0/1285189740 wait complete. 2024-09-13T18:42:11.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.413+0000 7fbe30c00640 1 Processor -- start 2024-09-13T18:42:11.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.413+0000 7fbe30c00640 1 -- start start 2024-09-13T18:42:11.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0afd80 0x7fbe2c1f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2c0b2780 0x7fbe2c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c157ff0 con 0x7fbe2c146610 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c158290 con 0x7fbe2c0b2780 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe30c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2c158570 con 0x7fbe2c0afd80 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe2a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe2a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53264/0 (socket says 172.21.15.192:53264) 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe2a800640 1 -- 172.21.15.192:0/87658246 learned_addr learned my addr 172.21.15.192:0/87658246 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe29e00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0afd80 0x7fbe2c1f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.414+0000 7fbe29400640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2c0b2780 0x7fbe2c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 -- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0afd80 msgr2=0x7fbe2c1f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0afd80 0x7fbe2c1f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 -- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2c0b2780 msgr2=0x7fbe2c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2c0b2780 0x7fbe2c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 -- 172.21.15.192:0/87658246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009b30 con 0x7fbe2c146610 2024-09-13T18:42:11.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe2a800640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c410 tx=0x7fbe2400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011790 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe240118f0 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2c158850 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe24011ce0 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.415+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2c158e10 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.416+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2c0ce2f0 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.417+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe2401c460 con 0x7fbe2c146610 2024-09-13T18:42:11.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.418+0000 7fbe22000640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 0x7fbe0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.418+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe24088ef0 con 0x7fbe2c146610 2024-09-13T18:42:11.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.418+0000 7fbe29e00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 0x7fbe0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.419+0000 7fbe29e00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 0x7fbe0c06d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c033000 tx=0x7fbe1c009000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.422+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe24054170 con 0x7fbe2c146610 2024-09-13T18:42:11.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.621+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe2c1610f0 con 0x7fbe2c146610 2024-09-13T18:42:11.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.622+0000 7fbe22000640 1 -- 172.21.15.192:0/87658246 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7fbe24057790 con 0x7fbe2c146610 2024-09-13T18:42:11.625 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:11.625 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:42:11.625 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 msgr2=0x7fbe0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 0x7fbe0c06d0c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c033000 tx=0x7fbe1c009000 comp rx=0 tx=0).stop 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 msgr2=0x7fbe2c0c3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fbe2400c410 tx=0x7fbe2400c8d0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 shutdown_connections 2024-09-13T18:42:11.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe0c06ac00 0x7fbe0c06d0c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe2c146610 0x7fbe2c0c3ed0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe2c0b2780 0x7fbe2c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 --2- 172.21.15.192:0/87658246 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe2c0afd80 0x7fbe2c1f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 >> 172.21.15.192:0/87658246 conn(0x7fbe2c0ae960 msgr2=0x7fbe2c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 shutdown_connections 2024-09-13T18:42:11.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.624+0000 7fbe30c00640 1 -- 172.21.15.192:0/87658246 wait complete. 2024-09-13T18:42:11.643 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:11.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.793+0000 7ff4b7e00640 1 Processor -- start 2024-09-13T18:42:11.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.793+0000 7ff4b7e00640 1 -- start start 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4b00b0490 0x7ff4b015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b7e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00b2f00 con 0x7ff4b00b3f10 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b7e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b00b3150 con 0x7ff4b015dee0 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b7e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b00b3430 con 0x7ff4b00b0490 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4b00b0490 0x7ff4b015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff4b00b0490 0x7ff4b015ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53274/0 (socket says 172.21.15.192:53274) 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b4a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff4b00b3f10 0x7ff4b015a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55782/0 (socket says 172.21.15.192:55782) 2024-09-13T18:42:11.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.794+0000 7ff4b5e00640 1 -- 172.21.15.192:0/2404065584 learned_addr learned my addr 172.21.15.192:0/2404065584 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.795+0000 7ff4b5e00640 1 -- 172.21.15.192:0/2404065584 >> v1:172.21.15.194:6789/0 conn(0x7ff4b015dee0 legacy=0x7ff4b00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:11.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.795+0000 7ff4b5e00640 1 -- 172.21.15.192:0/2404065584 >> v1:172.21.15.192:6789/0 conn(0x7ff4b00b3f10 legacy=0x7ff4b015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.795+0000 7ff4b5e00640 1 -- 172.21.15.192:0/2404065584 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b00b3710 con 0x7ff4b00b0490 2024-09-13T18:42:11.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4b5e00640 1 --2- 172.21.15.192:0/2404065584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b015ab50 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a802a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a047f5392754772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4afe00640 1 -- 172.21.15.192:0/2404065584 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031600 con 0x7ff4b00b0490 2024-09-13T18:42:11.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4afe00640 1 -- 172.21.15.192:0/2404065584 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a802d050 con 0x7ff4b00b0490 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4afe00640 1 -- 172.21.15.192:0/2404065584 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a8031980 con 0x7ff4b00b0490 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4b7e00640 1 -- 172.21.15.192:0/2404065584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 msgr2=0x7ff4b015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.796+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/2404065584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b015ab50 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009e50 tx=0x7ff4a802a760 comp rx=0 tx=0).stop 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.797+0000 7ff4b7e00640 1 -- 172.21.15.192:0/2404065584 shutdown_connections 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.797+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/2404065584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b015ab50 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.797+0000 7ff4b7e00640 1 -- 172.21.15.192:0/2404065584 >> 172.21.15.192:0/2404065584 conn(0x7ff4b00ae960 msgr2=0x7ff4b006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.797+0000 7ff4b7e00640 1 -- 172.21.15.192:0/2404065584 shutdown_connections 2024-09-13T18:42:11.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.797+0000 7ff4b7e00640 1 -- 172.21.15.192:0/2404065584 wait complete. 2024-09-13T18:42:11.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.798+0000 7ff4b7e00640 1 Processor -- start 2024-09-13T18:42:11.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.799+0000 7ff4b7e00640 1 -- start start 2024-09-13T18:42:11.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.799+0000 7ff4b7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.799+0000 7ff4b7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 0x7ff4b0141820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 0x7ff4b0154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b7e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0155120 con 0x7ff4b00b0490 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0155570 con 0x7ff4b0154730 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b0141d60 con 0x7ff4b015dee0 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53282/0 (socket says 172.21.15.192:53282) 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 -- 172.21.15.192:0/3575775187 learned_addr learned my addr 172.21.15.192:0/3575775187 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b4a00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 0x7ff4b0141820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 0x7ff4b0154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 -- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 msgr2=0x7ff4b0141820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 0x7ff4b0141820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 -- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 msgr2=0x7ff4b0154be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 0x7ff4b0154be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 -- 172.21.15.192:0/3575775187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8009b30 con 0x7ff4b00b0490 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 0x7ff4b0154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b4a00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 0x7ff4b0141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.800+0000 7ff4b5400640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b420 tx=0x7ff4a400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.801+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011830 con 0x7ff4b00b0490 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.801+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4011990 con 0x7ff4b00b0490 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.801+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a4011d40 con 0x7ff4b00b0490 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.801+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b0141f90 con 0x7ff4b00b0490 2024-09-13T18:42:11.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.801+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b0142550 con 0x7ff4b00b0490 2024-09-13T18:42:11.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.802+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b0157860 con 0x7ff4b00b0490 2024-09-13T18:42:11.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.803+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff4a401b460 con 0x7ff4b00b0490 2024-09-13T18:42:11.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.803+0000 7ff4ad600640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 0x7ff49006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:11.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.804+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4a4088f80 con 0x7ff4b00b0490 2024-09-13T18:42:11.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.804+0000 7ff4b4a00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 0x7ff49006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:11.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.804+0000 7ff4b4a00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 0x7ff49006d0f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:11.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.808+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff4a40540c0 con 0x7ff4b00b0490 2024-09-13T18:42:11.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.977+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4b00afd80 con 0x7ff4b00b0490 2024-09-13T18:42:11.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.979+0000 7ff4ad600640 1 -- 172.21.15.192:0/3575775187 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7ff4a40576e0 con 0x7ff4b00b0490 2024-09-13T18:42:11.982 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:11.982 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:11.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 msgr2=0x7ff49006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 0x7ff49006d0f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff49c007fd0 tx=0x7ff49c007d40 comp rx=0 tx=0).stop 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 msgr2=0x7ff4b0135520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400b420 tx=0x7ff4a400b8e0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 shutdown_connections 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff49006ac30 0x7ff49006d0f0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff4b0154730 0x7ff4b0154be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff4b015dee0 0x7ff4b0141820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 --2- 172.21.15.192:0/3575775187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4b00b0490 0x7ff4b0135520 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 >> 172.21.15.192:0/3575775187 conn(0x7ff4b00ae960 msgr2=0x7ff4b00708b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 shutdown_connections 2024-09-13T18:42:11.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:11.981+0000 7ff4b7e00640 1 -- 172.21.15.192:0/3575775187 wait complete. 2024-09-13T18:42:12.001 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:42:12.001 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.151+0000 7f2d54400640 1 Processor -- start 2024-09-13T18:42:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.151+0000 7f2d54400640 1 -- start start 2024-09-13T18:42:12.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d54400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d4c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d54400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2d4c0cb0b0 0x7f2d4c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d54400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d4c140480 con 0x7f2d4c140980 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d54400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d4c15c160 con 0x7f2d4c0cb0b0 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d54400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c15ee90 con 0x7f2d4c0cacd0 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d52400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2d4c140980 0x7f2d4c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55794/0 (socket says 172.21.15.192:55794) 2024-09-13T18:42:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d52400640 1 -- 172.21.15.192:0/800319998 learned_addr learned my addr 172.21.15.192:0/800319998 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d51a00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d4c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d51000640 1 --2- 172.21.15.192:0/800319998 >> v2:172.21.15.194:3300/0 conn(0x7f2d4c0cb0b0 0x7f2d4c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.153+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875653771 0 0) 0x7f2d4c140480 con 0x7f2d4c140980 2024-09-13T18:42:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d34003520 con 0x7f2d4c140980 2024-09-13T18:42:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3287550454 0 0) 0x7f2d34003520 con 0x7f2d4c140980 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 msgr2=0x7f2d4c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d4c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 >> v2:172.21.15.194:3300/0 conn(0x7f2d4c0cb0b0 msgr2=0x7f2d4c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 --2- 172.21.15.192:0/800319998 >> v2:172.21.15.194:3300/0 conn(0x7f2d4c0cb0b0 0x7f2d4c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c15f170 con 0x7f2d4c140980 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f2d440019f0 con 0x7f2d4c140980 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d51000640 1 --2- 172.21.15.192:0/800319998 >> v2:172.21.15.194:3300/0 conn(0x7f2d4c0cb0b0 0x7f2d4c15bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 >> v1:172.21.15.192:6789/0 conn(0x7f2d4c140980 legacy=0x7f2d4c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d34003970 0x7f2d34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c15c160 con 0x7f2d34004d00 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c15ee90 con 0x7f2d34003970 2024-09-13T18:42:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3400b980 con 0x7f2d4c0cacd0 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d52400640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d51a00640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d34003970 0x7f2d34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.154+0000 7f2d51000640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.155+0000 7f2d52400640 1 -- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 msgr2=0x7f2d340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.155+0000 7f2d52400640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0cacd0 0x7f2d340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.155+0000 7f2d52400640 1 -- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d34003970 msgr2=0x7f2d34003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.155+0000 7f2d52400640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d34003970 0x7f2d34003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.155+0000 7f2d52400640 1 -- 172.21.15.192:0/800319998 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d34003520 con 0x7f2d34004d00 2024-09-13T18:42:12.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d52400640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d34005180 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a830 tx=0x7f2d340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6281194a0943daad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4402ba50 con 0x7f2d34004d00 2024-09-13T18:42:12.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4402bbb0 con 0x7f2d34004d00 2024-09-13T18:42:12.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d4be00640 1 -- 172.21.15.192:0/800319998 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44034470 con 0x7f2d34004d00 2024-09-13T18:42:12.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d54400640 1 -- 172.21.15.192:0/800319998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 msgr2=0x7f2d34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d54400640 1 --2- 172.21.15.192:0/800319998 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d34005180 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400a830 tx=0x7f2d340057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.156+0000 7f2d52400640 1 -- 172.21.15.192:0/800319998 reap_dead start 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.157+0000 7f2d54400640 1 -- 172.21.15.192:0/800319998 shutdown_connections 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.157+0000 7f2d54400640 1 -- 172.21.15.192:0/800319998 >> 172.21.15.192:0/800319998 conn(0x7f2d4c0ae960 msgr2=0x7f2d4c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.157+0000 7f2d54400640 1 -- 172.21.15.192:0/800319998 shutdown_connections 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.157+0000 7f2d54400640 1 -- 172.21.15.192:0/800319998 wait complete. 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.158+0000 7f2d54400640 1 Processor -- start 2024-09-13T18:42:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.158+0000 7f2d54400640 1 -- start start 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d4c1e45b0 0x7f2d4c13d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0ccf30 0x7f2d4c0cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0cbc80 con 0x7f2d34004d00 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0cbe90 con 0x7f2d4c1e45b0 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d54400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c0cc170 con 0x7f2d4c0ccf30 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.159+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53302/0 (socket says 172.21.15.192:53302) 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 -- 172.21.15.192:0/2940858257 learned_addr learned my addr 172.21.15.192:0/2940858257 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51000640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d4c1e45b0 0x7f2d4c13d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d52400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0ccf30 0x7f2d4c0cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 -- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0ccf30 msgr2=0x7f2d4c0cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0ccf30 0x7f2d4c0cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 -- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d4c1e45b0 msgr2=0x7f2d4c13d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d4c1e45b0 0x7f2d4c13d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 -- 172.21.15.192:0/2940858257 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4c0cc450 con 0x7f2d34004d00 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d51a00640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2d400119a0 tx=0x7f2d40011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4000faf0 con 0x7f2d34004d00 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4000fc50 con 0x7f2d34004d00 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d40014440 con 0x7f2d34004d00 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.160+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c0cc730 con 0x7f2d34004d00 2024-09-13T18:42:12.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.161+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c13d920 con 0x7f2d34004d00 2024-09-13T18:42:12.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.162+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d4c15bc20 con 0x7f2d34004d00 2024-09-13T18:42:12.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.162+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d400145a0 con 0x7f2d34004d00 2024-09-13T18:42:12.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.163+0000 7f2d49600640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 0x7f2d2c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.163+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d40089b00 con 0x7f2d34004d00 2024-09-13T18:42:12.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.164+0000 7f2d51000640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 0x7f2d2c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.164+0000 7f2d51000640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 0x7f2d2c06d0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae400 tx=0x7f2d38009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.168+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d4008be60 con 0x7f2d34004d00 2024-09-13T18:42:12.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.367+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d4c06c6c0 con 0x7f2d34004d00 2024-09-13T18:42:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.368+0000 7f2d49600640 1 -- 172.21.15.192:0/2940858257 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f2d40022020 con 0x7f2d34004d00 2024-09-13T18:42:12.371 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:12.371 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:42:12.371 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:42:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 msgr2=0x7f2d2c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 0x7f2d2c06d0c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c0ae400 tx=0x7f2d38009190 comp rx=0 tx=0).stop 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 msgr2=0x7f2d4c0cb740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f2d400119a0 tx=0x7f2d40011e60 comp rx=0 tx=0).stop 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 shutdown_connections 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d2c06ac00 0x7f2d2c06d0c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d4c0ccf30 0x7f2d4c0cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d4c1e45b0 0x7f2d4c13d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 --2- 172.21.15.192:0/2940858257 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d34004d00 0x7f2d4c0cb740 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 >> 172.21.15.192:0/2940858257 conn(0x7f2d4c0ae960 msgr2=0x7f2d4c0aed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:12.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 shutdown_connections 2024-09-13T18:42:12.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.370+0000 7f2d54400640 1 -- 172.21.15.192:0/2940858257 wait complete. 2024-09-13T18:42:12.389 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:12.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 Processor -- start 2024-09-13T18:42:12.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 -- start start 2024-09-13T18:42:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7404150480 0x7f740415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7404071810 0x7f74040b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7404071dd0 con 0x7f74040b2230 2024-09-13T18:42:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040cb770 con 0x7f7404150480 2024-09-13T18:42:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f740c000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74040cba50 con 0x7f7404071810 2024-09-13T18:42:12.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f7409600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7404150480 0x7f740415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f7409600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7404150480 0x7f740415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53318/0 (socket says 172.21.15.192:53318) 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.541+0000 7f7409600640 1 -- 172.21.15.192:0/3886535289 learned_addr learned my addr 172.21.15.192:0/3886535289 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.542+0000 7f7408c00640 1 --2- 172.21.15.192:0/3886535289 >> v2:172.21.15.194:3300/0 conn(0x7f7404071810 0x7f74040b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.542+0000 7f7409600640 1 -- 172.21.15.192:0/3886535289 >> v2:172.21.15.194:3300/0 conn(0x7f7404071810 msgr2=0x7f74040b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.542+0000 7f7409600640 1 --2- 172.21.15.192:0/3886535289 >> v2:172.21.15.194:3300/0 conn(0x7f7404071810 0x7f74040b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.542+0000 7f7409600640 1 -- 172.21.15.192:0/3886535289 >> v1:172.21.15.194:6789/0 conn(0x7f74040b2230 legacy=0x7f74040cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:12.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.542+0000 7f7409600640 1 -- 172.21.15.192:0/3886535289 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74040cbd30 con 0x7f7404150480 2024-09-13T18:42:12.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.543+0000 7f7409600640 1 --2- 172.21.15.192:0/3886535289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740415a3e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f740406cb50 tx=0x7f73f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303cfd02a71a1f00 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.543+0000 7f7403e00640 1 -- 172.21.15.192:0/3886535289 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8032440 con 0x7f7404150480 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.543+0000 7f7403e00640 1 -- 172.21.15.192:0/3886535289 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73f80325a0 con 0x7f7404150480 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.543+0000 7f7403e00640 1 -- 172.21.15.192:0/3886535289 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8032930 con 0x7f7404150480 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 -- 172.21.15.192:0/3886535289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 msgr2=0x7f740415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 --2- 172.21.15.192:0/3886535289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740415a3e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f740406cb50 tx=0x7f73f802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 -- 172.21.15.192:0/3886535289 shutdown_connections 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 --2- 172.21.15.192:0/3886535289 >> v2:172.21.15.194:3300/0 conn(0x7f7404071810 0x7f74040b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 --2- 172.21.15.192:0/3886535289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740415a3e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 -- 172.21.15.192:0/3886535289 >> 172.21.15.192:0/3886535289 conn(0x7f74040ae960 msgr2=0x7f740406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 -- 172.21.15.192:0/3886535289 shutdown_connections 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.544+0000 7f740c000640 1 -- 172.21.15.192:0/3886535289 wait complete. 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.545+0000 7f740c000640 1 Processor -- start 2024-09-13T18:42:12.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.545+0000 7f740c000640 1 -- start start 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7404071810 0x7f7404071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74040b2230 0x7f7404154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404070610 con 0x7f7404150480 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74041509e0 con 0x7f7404071810 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.546+0000 7f740c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f740414ec90 con 0x7f74040b2230 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53332/0 (socket says 172.21.15.192:53332) 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 -- 172.21.15.192:0/4247667519 learned_addr learned my addr 172.21.15.192:0/4247667519 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f7409600640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7404071810 0x7f7404071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f7408c00640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74040b2230 0x7f7404154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 -- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74040b2230 msgr2=0x7f7404154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74040b2230 0x7f7404154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 -- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7404071810 msgr2=0x7f7404071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7404071810 0x7f7404071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 -- 172.21.15.192:0/4247667519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f80094d0 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f740a000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c700 tx=0x7f73fc00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.547+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00aa50 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.548+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73fc00abb0 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.548+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc00ce10 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.548+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7404155160 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.548+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7404155720 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.549+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74040b1cf0 con 0x7f7404150480 2024-09-13T18:42:12.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.549+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73fc012420 con 0x7f7404150480 2024-09-13T18:42:12.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.550+0000 7f7401600640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 0x7f73e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.550+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73fc089690 con 0x7f7404150480 2024-09-13T18:42:12.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.551+0000 7f7409600640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 0x7f73e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.551+0000 7f7409600640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 0x7f73e406d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f73f8034000 tx=0x7f73f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.555+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73fc054910 con 0x7f7404150480 2024-09-13T18:42:12.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.756+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74040cb0b0 con 0x7f7404150480 2024-09-13T18:42:12.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.756+0000 7f7401600640 1 -- 172.21.15.192:0/4247667519 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4748 (secure 0 0 0) 0x7f73fc003eb0 con 0x7f7404150480 2024-09-13T18:42:12.759 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:12.759 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":55,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:41:50.750546+0000","modified":"2024-09-13T18:41:53.767323+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7278":{"gid":7278,"name":"d","rank":0,"incarnation":51,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6835/1161965383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1161965383},{"type":"v1","addr":"172.21.15.194:6835","nonce":1161965383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-09-13T18:42:12.759 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 55 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 msgr2=0x7f73e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 0x7f73e406d0c0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f73f8034000 tx=0x7f73f802e000 comp rx=0 tx=0).stop 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 msgr2=0x7f740414e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f73fc00c700 tx=0x7f73fc00cbc0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 shutdown_connections 2024-09-13T18:42:12.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73e406ac00 0x7f73e406d0c0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7404150480 0x7f740414e750 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f74040b2230 0x7f7404154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 --2- 172.21.15.192:0/4247667519 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7404071810 0x7f7404071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 >> 172.21.15.192:0/4247667519 conn(0x7f74040ae960 msgr2=0x7f74040ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 shutdown_connections 2024-09-13T18:42:12.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.758+0000 7f740c000640 1 -- 172.21.15.192:0/4247667519 wait complete. 2024-09-13T18:42:12.777 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:12.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.936+0000 7f2822c00640 1 Processor -- start 2024-09-13T18:42:12.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.936+0000 7f2822c00640 1 -- start start 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2822c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 0x7f281c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2822c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c0b2f00 con 0x7f281c15dee0 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2822c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f281c0b3150 con 0x7f281c0b3f10 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2822c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c0b3430 con 0x7f281c0b0490 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f281be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f281c15dee0 0x7f281c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55796/0 (socket says 172.21.15.192:55796) 2024-09-13T18:42:12.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f281be00640 1 -- 172.21.15.192:0/3927513858 learned_addr learned my addr 172.21.15.192:0/3927513858 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:12.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2820c00640 1 --2- 172.21.15.192:0/3927513858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 0x7f281c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013977410 0 0) 0x7f281c0b2f00 con 0x7f281c15dee0 2024-09-13T18:42:12.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2800003520 con 0x7f281c15dee0 2024-09-13T18:42:12.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740633302 0 0) 0x7f281c0b3150 con 0x7f281c0b3f10 2024-09-13T18:42:12.941 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2820c00640 1 -- 172.21.15.192:0/3927513858 >> v1:172.21.15.194:6789/0 conn(0x7f281c0b3f10 legacy=0x7f281c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2820c00640 1 -- 172.21.15.192:0/3927513858 >> v1:172.21.15.192:6789/0 conn(0x7f281c15dee0 legacy=0x7f281c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.942 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.938+0000 7f2820c00640 1 -- 172.21.15.192:0/3927513858 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f281c0b3710 con 0x7f281c0b0490 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.939+0000 7f2820c00640 1 --2- 172.21.15.192:0/3927513858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 0x7f281c15ab50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2814009dc0 tx=0x7f281402c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e37cb59c93036aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.939+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28140327e0 con 0x7f281c0b0490 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.939+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2814032940 con 0x7f281c0b0490 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.939+0000 7f281aa00640 1 -- 172.21.15.192:0/3927513858 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814032cb0 con 0x7f281c0b0490 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 -- 172.21.15.192:0/3927513858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 msgr2=0x7f281c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 --2- 172.21.15.192:0/3927513858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 0x7f281c15ab50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2814009dc0 tx=0x7f281402c8e0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 -- 172.21.15.192:0/3927513858 shutdown_connections 2024-09-13T18:42:12.943 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 --2- 172.21.15.192:0/3927513858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c0b0490 0x7f281c15ab50 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 -- 172.21.15.192:0/3927513858 >> 172.21.15.192:0/3927513858 conn(0x7f281c0ae960 msgr2=0x7f281c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:12.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 -- 172.21.15.192:0/3927513858 shutdown_connections 2024-09-13T18:42:12.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.940+0000 7f2822c00640 1 -- 172.21.15.192:0/3927513858 wait complete. 2024-09-13T18:42:12.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.942+0000 7f2822c00640 1 Processor -- start 2024-09-13T18:42:12.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.942+0000 7f2822c00640 1 -- start start 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c0b0490 0x7f281c157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15dee0 0x7f281c13eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15d3c0 con 0x7f281c15c260 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f281c157880 con 0x7f281c0b0490 2024-09-13T18:42:12.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2822c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f281c15c7b0 con 0x7f281c15dee0 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53336/0 (socket says 172.21.15.192:53336) 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 -- 172.21.15.192:0/2264962612 learned_addr learned my addr 172.21.15.192:0/2264962612 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f281be00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c0b0490 0x7f281c157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f281b400640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15dee0 0x7f281c13eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 -- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15dee0 msgr2=0x7f281c13eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15dee0 0x7f281c13eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 -- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c0b0490 msgr2=0x7f281c157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c0b0490 0x7f281c157340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:12.947 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.943+0000 7f2820c00640 1 -- 172.21.15.192:0/2264962612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2814009a70 con 0x7f281c15c260 2024-09-13T18:42:12.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2820c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2814035040 tx=0x7f2814004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814033880 con 0x7f281c15c260 2024-09-13T18:42:12.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28140339e0 con 0x7f281c15c260 2024-09-13T18:42:12.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2814033d70 con 0x7f281c15c260 2024-09-13T18:42:12.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f281c15ca90 con 0x7f281c15c260 2024-09-13T18:42:12.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.944+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f281c15d050 con 0x7f281c15c260 2024-09-13T18:42:12.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.945+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f281c15d210 con 0x7f281c15c260 2024-09-13T18:42:12.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.946+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2814050440 con 0x7f281c15c260 2024-09-13T18:42:12.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.947+0000 7f2813e00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 0x7f27fc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:12.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.947+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28140ac9d0 con 0x7f281c15c260 2024-09-13T18:42:12.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.947+0000 7f281be00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 0x7f27fc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:12.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.948+0000 7f281be00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 0x7f27fc06d0f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f280c005880 tx=0x7f280c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:12.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:12.952+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2814077ce0 con 0x7f281c15c260 2024-09-13T18:42:13.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.120+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f281c067490 con 0x7f281c15c260 2024-09-13T18:42:13.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.121+0000 7f2813e00640 1 -- 172.21.15.192:0/2264962612 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16587 (secure 0 0 0) 0x7f281407b300 con 0x7f281c15c260 2024-09-13T18:42:13.124 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:13.124 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":137,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:02.811955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:41:48.584706+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"133","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-09-13T18:41:49.749521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"135","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 msgr2=0x7f27fc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 0x7f27fc06d0f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f280c005880 tx=0x7f280c009040 comp rx=0 tx=0).stop 2024-09-13T18:42:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 msgr2=0x7f281c13f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2814035040 tx=0x7f2814004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:13.126 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 shutdown_connections 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f27fc06ac30 0x7f27fc06d0f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f281c15c260 0x7f281c13f0e0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f281c15dee0 0x7f281c13eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 --2- 172.21.15.192:0/2264962612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f281c0b0490 0x7f281c157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 >> 172.21.15.192:0/2264962612 conn(0x7f281c0ae960 msgr2=0x7f281c157a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 shutdown_connections 2024-09-13T18:42:13.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.124+0000 7f2822c00640 1 -- 172.21.15.192:0/2264962612 wait complete. 2024-09-13T18:42:13.142 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:42:13.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.292+0000 7fe24b800640 1 Processor -- start 2024-09-13T18:42:13.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.292+0000 7fe24b800640 1 -- start start 2024-09-13T18:42:13.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.293+0000 7fe24b800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe24415e790 0x7fe2440cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe24b800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24415ec00 con 0x7fe24415bc20 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe24b800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe244140480 con 0x7fe2440cacd0 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe24b800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2440cb5f0 con 0x7fe24415e790 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe23be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe24415e790 0x7fe2440cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe249800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe24415bc20 0x7fe2440afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55798/0 (socket says 172.21.15.192:55798) 2024-09-13T18:42:13.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe249800640 1 -- 172.21.15.192:0/2148313571 learned_addr learned my addr 172.21.15.192:0/2148313571 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:13.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe23be00640 1 -- 172.21.15.192:0/2148313571 >> v1:172.21.15.194:6789/0 conn(0x7fe2440cacd0 legacy=0x7fe244140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe23be00640 1 -- 172.21.15.192:0/2148313571 >> v1:172.21.15.192:6789/0 conn(0x7fe24415bc20 legacy=0x7fe2440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe243e00640 1 -- 172.21.15.192:0/2148313571 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008023783 0 0) 0x7fe24415ec00 con 0x7fe24415bc20 2024-09-13T18:42:13.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe23be00640 1 -- 172.21.15.192:0/2148313571 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24415ee90 con 0x7fe24415e790 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe23be00640 1 --2- 172.21.15.192:0/2148313571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe2440cb0b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0097a0 tx=0x7fe22c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fefea6f00513525 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.295+0000 7fe243e00640 1 -- 172.21.15.192:0/2148313571 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c032440 con 0x7fe24415e790 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe243e00640 1 -- 172.21.15.192:0/2148313571 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe22c0325a0 con 0x7fe24415e790 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe243e00640 1 -- 172.21.15.192:0/2148313571 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe22c032930 con 0x7fe24415e790 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 -- 172.21.15.192:0/2148313571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 msgr2=0x7fe2440cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 --2- 172.21.15.192:0/2148313571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe2440cb0b0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0097a0 tx=0x7fe22c02a230 comp rx=0 tx=0).stop 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 -- 172.21.15.192:0/2148313571 shutdown_connections 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 --2- 172.21.15.192:0/2148313571 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe2440cb0b0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 -- 172.21.15.192:0/2148313571 >> 172.21.15.192:0/2148313571 conn(0x7fe2440ae960 msgr2=0x7fe24406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:13.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 -- 172.21.15.192:0/2148313571 shutdown_connections 2024-09-13T18:42:13.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.296+0000 7fe24b800640 1 -- 172.21.15.192:0/2148313571 wait complete. 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.298+0000 7fe24b800640 1 Processor -- start 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.298+0000 7fe24b800640 1 -- start start 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2440cacd0 0x7fe244130420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24415bc20 0x7fe244159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b4a40 con 0x7fe24415e790 2024-09-13T18:42:13.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2440b3e70 con 0x7fe24415bc20 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe24b800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe244158f50 con 0x7fe2440cacd0 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53358/0 (socket says 172.21.15.192:53358) 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 -- 172.21.15.192:0/1556069723 learned_addr learned my addr 172.21.15.192:0/1556069723 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe23be00640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24415bc20 0x7fe244159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe248e00640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2440cacd0 0x7fe244130420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 -- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2440cacd0 msgr2=0x7fe244130420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2440cacd0 0x7fe244130420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 -- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24415bc20 msgr2=0x7fe244159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24415bc20 0x7fe244159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.299+0000 7fe249800640 1 -- 172.21.15.192:0/1556069723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe22c009400 con 0x7fe24415e790 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe249800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c700 tx=0x7fe23c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00ce10 con 0x7fe24415e790 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00a640 con 0x7fe24415e790 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2440b4110 con 0x7fe24415e790 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00aa70 con 0x7fe24415e790 2024-09-13T18:42:13.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.300+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2440b46d0 con 0x7fe24415e790 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.301+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2440b4bb0 con 0x7fe24415e790 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.302+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe23c00abd0 con 0x7fe24415e790 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.303+0000 7fe241600640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 0x7fe22006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.303+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe23c088a10 con 0x7fe24415e790 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.303+0000 7fe248e00640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 0x7fe22006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.304+0000 7fe248e00640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 0x7fe22006d0f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe234000f60 tx=0x7fe234009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.308+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe23c053ca0 con 0x7fe24415e790 2024-09-13T18:42:13.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.510+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe2440cb0b0 con 0x7fe24415e790 2024-09-13T18:42:13.514 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:42:13.511+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:42:13.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.521+0000 7fe241600640 1 -- 172.21.15.192:0/1556069723 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe23c018020 con 0x7fe24415e790 2024-09-13T18:42:13.524 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 msgr2=0x7fe22006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 0x7fe22006d0f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe234000f60 tx=0x7fe234009040 comp rx=0 tx=0).stop 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 msgr2=0x7fe24415a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00c700 tx=0x7fe23c00cbc0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 shutdown_connections 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe22006ac30 0x7fe22006d0f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24415e790 0x7fe24415a0b0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe24415bc20 0x7fe244159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 --2- 172.21.15.192:0/1556069723 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe2440cacd0 0x7fe244130420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 >> 172.21.15.192:0/1556069723 conn(0x7fe2440ae960 msgr2=0x7fe2440ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:13.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 shutdown_connections 2024-09-13T18:42:13.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.524+0000 7fe24b800640 1 -- 172.21.15.192:0/1556069723 wait complete. 2024-09-13T18:42:13.533 INFO:tasks.ceph.mds.d.smithi194.stderr: -4715> 2024-09-13T18:41:56.325+0000 7fca3ea00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:42:13.542 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:42:13.585 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:42:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.692+0000 7ff16e400640 1 Processor -- start 2024-09-13T18:42:13.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.693+0000 7ff16e400640 1 -- start start 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff16e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff16806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff16e400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff16806a8b0 0x7ff1680b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff16e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16806b480 con 0x7ff1680b3bd0 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff16e400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b4060 con 0x7ff16806a8b0 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff16e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680ce770 con 0x7ff1681434c0 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff16806a8b0 0x7ff1680b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.697 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff16806a8b0 0x7ff1680b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53374/0 (socket says 172.21.15.192:53374) 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 -- 172.21.15.192:0/3987100884 learned_addr learned my addr 172.21.15.192:0/3987100884 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff167400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff16806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 -- 172.21.15.192:0/3987100884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 msgr2=0x7ff16806c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 --2- 172.21.15.192:0/3987100884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff16806c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 -- 172.21.15.192:0/3987100884 >> v1:172.21.15.194:6789/0 conn(0x7ff1680b3bd0 legacy=0x7ff16806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 -- 172.21.15.192:0/3987100884 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16806b760 con 0x7ff16806a8b0 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.695+0000 7ff166a00640 1 --2- 172.21.15.192:0/3987100884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff1680b3690 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff1540098a0 tx=0x7ff15402a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8616db9ef5002e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff166000640 1 -- 172.21.15.192:0/3987100884 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154032440 con 0x7ff16806a8b0 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff166000640 1 -- 172.21.15.192:0/3987100884 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1540325a0 con 0x7ff16806a8b0 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff166000640 1 -- 172.21.15.192:0/3987100884 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff154032930 con 0x7ff16806a8b0 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 -- 172.21.15.192:0/3987100884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 msgr2=0x7ff1680b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 --2- 172.21.15.192:0/3987100884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff1680b3690 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff1540098a0 tx=0x7ff15402a290 comp rx=0 tx=0).stop 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 -- 172.21.15.192:0/3987100884 shutdown_connections 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 --2- 172.21.15.192:0/3987100884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff1680b3690 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 --2- 172.21.15.192:0/3987100884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff16806c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 -- 172.21.15.192:0/3987100884 >> 172.21.15.192:0/3987100884 conn(0x7ff1680b08f0 msgr2=0x7ff1680b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 -- 172.21.15.192:0/3987100884 shutdown_connections 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.696+0000 7ff16e400640 1 -- 172.21.15.192:0/3987100884 wait complete. 2024-09-13T18:42:13.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.698+0000 7ff16e400640 1 Processor -- start 2024-09-13T18:42:13.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.698+0000 7ff16e400640 1 -- start start 2024-09-13T18:42:13.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1680b3bd0 0x7ff168070380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff1681f2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681586f0 con 0x7ff16806a8b0 2024-09-13T18:42:13.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16806f970 con 0x7ff1680b3bd0 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff16e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680708c0 con 0x7ff1681434c0 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff167400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff167400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53390/0 (socket says 172.21.15.192:53390) 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff167400640 1 -- 172.21.15.192:0/1647685310 learned_addr learned my addr 172.21.15.192:0/1647685310 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff167e00640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff1681f2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.699+0000 7ff166a00640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1680b3bd0 0x7ff168070380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 -- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 msgr2=0x7ff1681f2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff1681f2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 -- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1680b3bd0 msgr2=0x7ff168070380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1680b3bd0 0x7ff168070380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:13.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 -- 172.21.15.192:0/1647685310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1540094d0 con 0x7ff16806a8b0 2024-09-13T18:42:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff167400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e870 tx=0x7ff15800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580094f0 con 0x7ff16806a8b0 2024-09-13T18:42:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15800c940 con 0x7ff16806a8b0 2024-09-13T18:42:13.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1681f35c0 con 0x7ff16806a8b0 2024-09-13T18:42:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800ccf0 con 0x7ff16806a8b0 2024-09-13T18:42:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.700+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff16806fb80 con 0x7ff16806a8b0 2024-09-13T18:42:13.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.701+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16806acf0 con 0x7ff16806a8b0 2024-09-13T18:42:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.702+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff158013470 con 0x7ff16806a8b0 2024-09-13T18:42:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.703+0000 7ff15f400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 0x7ff14806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.703+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5795+0+0 (secure 0 0 0) 0x7ff158089400 con 0x7ff16806a8b0 2024-09-13T18:42:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.703+0000 7ff166a00640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 0x7ff14806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:13.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.704+0000 7ff166a00640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 0x7ff14806d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff154034000 tx=0x7ff15402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:13.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.708+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff158054620 con 0x7ff16806a8b0 2024-09-13T18:42:13.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:13.911+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff16813d6d0 con 0x7ff16806a8b0 2024-09-13T18:42:14.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.525+0000 7ff15f400640 1 -- 172.21.15.192:0/1647685310 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff158057c40 con 0x7ff16806a8b0 2024-09-13T18:42:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 msgr2=0x7ff14806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 0x7ff14806d0c0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff154034000 tx=0x7ff15402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 msgr2=0x7ff168156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff15800e870 tx=0x7ff15800ed30 comp rx=0 tx=0).stop 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 shutdown_connections 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff14806ac00 0x7ff14806d0c0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff1681434c0 0x7ff1681f2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff1680b3bd0 0x7ff168070380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 --2- 172.21.15.192:0/1647685310 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff16806a8b0 0x7ff168156530 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 >> 172.21.15.192:0/1647685310 conn(0x7ff1680b08f0 msgr2=0x7ff1680af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 shutdown_connections 2024-09-13T18:42:14.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.527+0000 7ff16e400640 1 -- 172.21.15.192:0/1647685310 wait complete. 2024-09-13T18:42:14.547 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:42:14.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.702+0000 7f40ade00640 1 Processor -- start 2024-09-13T18:42:14.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.702+0000 7f40ade00640 1 -- start start 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40ade00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40a8071b80 0x7f40a815f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40ade00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 0x7f40a80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40ade00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a806a330 con 0x7f40a81403e0 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40ade00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a813e0f0 con 0x7f40a8071b80 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40ade00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a80ce370 con 0x7f40a80cd9c0 2024-09-13T18:42:14.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40a6000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f40a81403e0 0x7f40a8070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55806/0 (socket says 172.21.15.192:55806) 2024-09-13T18:42:14.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.703+0000 7f40a6000640 1 -- 172.21.15.192:0/1901923695 learned_addr learned my addr 172.21.15.192:0/1901923695 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:14.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a7400640 1 --2- 172.21.15.192:0/1901923695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 0x7f40a80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a6a00640 1 --2- 172.21.15.192:0/1901923695 >> v2:172.21.15.194:3300/0 conn(0x7f40a8071b80 0x7f40a815f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a5600640 1 -- 172.21.15.192:0/1901923695 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 459581070 0 0) 0x7f4094001110 con 0x7f40a81403e0 2024-09-13T18:42:14.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a5600640 1 -- 172.21.15.192:0/1901923695 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f408c003520 con 0x7f40a81403e0 2024-09-13T18:42:14.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a7400640 1 -- 172.21.15.192:0/1901923695 >> v2:172.21.15.194:3300/0 conn(0x7f40a8071b80 msgr2=0x7f40a815f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:14.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a7400640 1 --2- 172.21.15.192:0/1901923695 >> v2:172.21.15.194:3300/0 conn(0x7f40a8071b80 0x7f40a815f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a7400640 1 -- 172.21.15.192:0/1901923695 >> v1:172.21.15.192:6789/0 conn(0x7f40a81403e0 legacy=0x7f40a8070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.704+0000 7f40a7400640 1 -- 172.21.15.192:0/1901923695 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a815f840 con 0x7f40a80cd9c0 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.705+0000 7f40a7400640 1 --2- 172.21.15.192:0/1901923695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 0x7f40a80cde30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d90 tx=0x7f40a002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605e90b0bf61cf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.705+0000 7f40a5600640 1 -- 172.21.15.192:0/1901923695 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0007740 con 0x7f40a80cd9c0 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.705+0000 7f40a5600640 1 -- 172.21.15.192:0/1901923695 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a002d050 con 0x7f40a80cd9c0 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40a5600640 1 -- 172.21.15.192:0/1901923695 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a0007ac0 con 0x7f40a80cd9c0 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 -- 172.21.15.192:0/1901923695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 msgr2=0x7f40a80cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 --2- 172.21.15.192:0/1901923695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 0x7f40a80cde30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f40a0009d90 tx=0x7f40a002a660 comp rx=0 tx=0).stop 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 -- 172.21.15.192:0/1901923695 shutdown_connections 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 --2- 172.21.15.192:0/1901923695 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a80cd9c0 0x7f40a80cde30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 --2- 172.21.15.192:0/1901923695 >> v2:172.21.15.194:3300/0 conn(0x7f40a8071b80 0x7f40a815f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 -- 172.21.15.192:0/1901923695 >> 172.21.15.192:0/1901923695 conn(0x7f40a80b0c40 msgr2=0x7f40a80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 -- 172.21.15.192:0/1901923695 shutdown_connections 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.706+0000 7f40ade00640 1 -- 172.21.15.192:0/1901923695 wait complete. 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.708+0000 7f40ade00640 1 Processor -- start 2024-09-13T18:42:14.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.708+0000 7f40ade00640 1 -- start start 2024-09-13T18:42:14.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 0x7f40a81f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 0x7f40a8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8158ac0 con 0x7f40a80cd9c0 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a81569b0 con 0x7f40a8071b80 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40ade00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a8156c60 con 0x7f40a81403e0 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53406/0 (socket says 172.21.15.192:53406) 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 -- 172.21.15.192:0/180446921 learned_addr learned my addr 172.21.15.192:0/180446921 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a7400640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 0x7f40a8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6a00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 0x7f40a81f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 -- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 msgr2=0x7f40a8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 0x7f40a8156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 -- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 msgr2=0x7f40a81f4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 0x7f40a81f4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6000640 1 -- 172.21.15.192:0/180446921 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a0009a70 con 0x7f40a80cd9c0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a6a00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 0x7f40a81f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.709+0000 7f40a7400640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 0x7f40a8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f40a6000640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f409400c420 tx=0x7f409400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4094005ce0 con 0x7f40a80cd9c0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4094005e40 con 0x7f40a80cd9c0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40940072f0 con 0x7f40a80cd9c0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a8156f40 con 0x7f40a80cd9c0 2024-09-13T18:42:14.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.710+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a8139e10 con 0x7f40a80cd9c0 2024-09-13T18:42:14.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.711+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a813a000 con 0x7f40a80cd9c0 2024-09-13T18:42:14.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.712+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4094007510 con 0x7f40a80cd9c0 2024-09-13T18:42:14.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.713+0000 7f409f400640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 0x7f408806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:14.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.713+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4094088910 con 0x7f40a80cd9c0 2024-09-13T18:42:14.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.713+0000 7f40a6a00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 0x7f408806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:14.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.714+0000 7f40a6a00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 0x7f408806d0c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f40a8070970 tx=0x7f4098008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:14.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.717+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40940539f0 con 0x7f40a80cd9c0 2024-09-13T18:42:14.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:14.893+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f40a806a330 con 0x7f40a80cd9c0 2024-09-13T18:42:15.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.885+0000 7f409f400640 1 -- 172.21.15.192:0/180446921 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v139) v1 ==== 181+0+0 (secure 0 0 0) 0x7f40a806a330 con 0x7f40a80cd9c0 2024-09-13T18:42:15.887 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 msgr2=0x7f408806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 0x7f408806d0c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f40a8070970 tx=0x7f4098008040 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 msgr2=0x7f40a8158580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f409400c420 tx=0x7f409400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 shutdown_connections 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f408806ac00 0x7f408806d0c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40a81403e0 0x7f40a8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40a80cd9c0 0x7f40a8158580 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 --2- 172.21.15.192:0/180446921 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40a8071b80 0x7f40a81f4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 >> 172.21.15.192:0/180446921 conn(0x7f40a80b0c40 msgr2=0x7f40a806b140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 shutdown_connections 2024-09-13T18:42:15.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:15.889+0000 7f40ade00640 1 -- 172.21.15.192:0/180446921 wait complete. 2024-09-13T18:42:15.909 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:42:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.069+0000 7f303b600640 1 Processor -- start 2024-09-13T18:42:16.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.069+0000 7f303b600640 1 -- start start 2024-09-13T18:42:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f303b600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f30341403e0 0x7f3034070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f303b600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303406a330 con 0x7f3034071b80 2024-09-13T18:42:16.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f303b600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303415b300 con 0x7f3034071100 2024-09-13T18:42:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f303b600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303413e0f0 con 0x7f30341403e0 2024-09-13T18:42:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f3038c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3034071b80 0x7f303415f300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55808/0 (socket says 172.21.15.192:55808) 2024-09-13T18:42:16.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f3038c00640 1 -- 172.21.15.192:0/955196531 learned_addr learned my addr 172.21.15.192:0/955196531 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:16.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f302be00640 1 --2- 172.21.15.192:0/955196531 >> v2:172.21.15.194:3300/0 conn(0x7f30341403e0 0x7f3034070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804177100 0 0) 0x7f3024001110 con 0x7f3034071b80 2024-09-13T18:42:16.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3018003520 con 0x7f3034071b80 2024-09-13T18:42:16.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.071+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 145644509 0 0) 0x7f3018003520 con 0x7f3034071b80 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 >> v2:172.21.15.194:3300/0 conn(0x7f30341403e0 msgr2=0x7f3034070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 --2- 172.21.15.192:0/955196531 >> v2:172.21.15.194:3300/0 conn(0x7f30341403e0 0x7f3034070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 >> v1:172.21.15.194:6789/0 conn(0x7f3034071100 legacy=0x7f30340cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30341408a0 con 0x7f3034071b80 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f3024001800 con 0x7f3034071b80 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 >> v1:172.21.15.192:6789/0 conn(0x7f3034071b80 legacy=0x7f303415f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018003970 0x7f3018003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180047c0 0x7f3018004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 0x7f301800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303413e0f0 con 0x7f3018005180 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301800c120 con 0x7f3018003970 2024-09-13T18:42:16.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301800c2e0 con 0x7f30180047c0 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 0x7f301800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3038c00640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018003970 0x7f3018003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f302be00640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180047c0 0x7f3018004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 -- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180047c0 msgr2=0x7f3018004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30180047c0 0x7f3018004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 -- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018003970 msgr2=0x7f3018003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018003970 0x7f3018003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.072+0000 7f3039600640 1 -- 172.21.15.192:0/955196531 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018003520 con 0x7f3018005180 2024-09-13T18:42:16.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.073+0000 7f3039600640 1 -- 172.21.15.192:0/955196531 reap_dead start 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.073+0000 7f3039600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 0x7f301800b980 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f302c001e50 tx=0x7f30180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0abc50e57b4226 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c02ae70 con 0x7f3018005180 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302c003970 con 0x7f3018005180 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f3033e00640 1 -- 172.21.15.192:0/955196531 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003d20 con 0x7f3018005180 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 -- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 msgr2=0x7f301800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 0x7f301800b980 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f302c001e50 tx=0x7f30180057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 -- 172.21.15.192:0/955196531 shutdown_connections 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 --2- 172.21.15.192:0/955196531 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3018005180 0x7f301800b980 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 -- 172.21.15.192:0/955196531 >> 172.21.15.192:0/955196531 conn(0x7f30340b0c40 msgr2=0x7f30340b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 -- 172.21.15.192:0/955196531 shutdown_connections 2024-09-13T18:42:16.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.074+0000 7f303b600640 1 -- 172.21.15.192:0/955196531 wait complete. 2024-09-13T18:42:16.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.076+0000 7f303b600640 1 Processor -- start 2024-09-13T18:42:16.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.076+0000 7f303b600640 1 -- start start 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 0x7f30340cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f303415de60 0x7f30341f2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303415e2e0 con 0x7f303406ac00 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340c3cd0 con 0x7f3018005180 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f303b600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340cbe00 con 0x7f303415de60 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f302be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f302be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53426/0 (socket says 172.21.15.192:53426) 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f302be00640 1 -- 172.21.15.192:0/2789617942 learned_addr learned my addr 172.21.15.192:0/2789617942 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f3038c00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 0x7f30340cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.077+0000 7f3039600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f303415de60 0x7f30341f2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 -- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f303415de60 msgr2=0x7f30341f2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f303415de60 0x7f30341f2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 -- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 msgr2=0x7f30340cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 0x7f30340cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 -- 172.21.15.192:0/2789617942 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340cc7d0 con 0x7f303406ac00 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f3038c00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 0x7f30340cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f302be00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f301c0118e0 tx=0x7f301c011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c00faf0 con 0x7f303406ac00 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c00fc50 con 0x7f303406ac00 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c014440 con 0x7f303406ac00 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340c3f20 con 0x7f303406ac00 2024-09-13T18:42:16.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.078+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340cb7b0 con 0x7f303406ac00 2024-09-13T18:42:16.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.079+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30340cbf70 con 0x7f303406ac00 2024-09-13T18:42:16.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.080+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f301c0145a0 con 0x7f303406ac00 2024-09-13T18:42:16.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.081+0000 7f3031600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 0x7f301006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:16.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.081+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f301c089c00 con 0x7f303406ac00 2024-09-13T18:42:16.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.081+0000 7f3038c00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 0x7f301006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:16.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.082+0000 7f3038c00640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 0x7f301006d0f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3024001270 tx=0x7f3024009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:16.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.085+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f301c054e10 con 0x7f303406ac00 2024-09-13T18:42:16.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.256+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3034070bc0 con 0x7f303406ac00 2024-09-13T18:42:16.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.897+0000 7f3031600640 1 -- 172.21.15.192:0/2789617942 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v140) v1 ==== 169+0+0 (secure 0 0 0) 0x7f301c0220d0 con 0x7f303406ac00 2024-09-13T18:42:16.899 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 msgr2=0x7f301006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 0x7f301006d0f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3024001270 tx=0x7f3024009040 comp rx=0 tx=0).stop 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 msgr2=0x7f303415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f301c0118e0 tx=0x7f301c011da0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 shutdown_connections 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f301006ac30 0x7f301006d0f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f303415de60 0x7f30341f2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f303406ac00 0x7f303415d920 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 --2- 172.21.15.192:0/2789617942 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3018005180 0x7f30340cc290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:16.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 >> 172.21.15.192:0/2789617942 conn(0x7f30340b0c40 msgr2=0x7f303406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:16.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 shutdown_connections 2024-09-13T18:42:16.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:16.900+0000 7f303b600640 1 -- 172.21.15.192:0/2789617942 wait complete. 2024-09-13T18:42:16.919 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:42:17.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.074+0000 7fe55c800640 1 Processor -- start 2024-09-13T18:42:17.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.074+0000 7fe55c800640 1 -- start start 2024-09-13T18:42:17.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.075+0000 7fe55c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe5540b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.075+0000 7fe55c800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe5540b3bd0 0x7fe55406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.075+0000 7fe55c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55406cc40 con 0x7fe5541434c0 2024-09-13T18:42:17.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.075+0000 7fe55c800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540b4060 con 0x7fe5540b3bd0 2024-09-13T18:42:17.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.075+0000 7fe55c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540ce770 con 0x7fe55406c800 2024-09-13T18:42:17.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe559e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe5541434c0 0x7fe55406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55810/0 (socket says 172.21.15.192:55810) 2024-09-13T18:42:17.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe559e00640 1 -- 172.21.15.192:0/3710658869 learned_addr learned my addr 172.21.15.192:0/3710658869 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:17.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270470770 0 0) 0x7fe55406cc40 con 0x7fe5541434c0 2024-09-13T18:42:17.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c003520 con 0x7fe5541434c0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe559400640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe5540b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe55a800640 1 --2- 172.21.15.192:0/3710658869 >> v2:172.21.15.194:3300/0 conn(0x7fe5540b3bd0 0x7fe55406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790040676 0 0) 0x7fe53c003520 con 0x7fe5541434c0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.076+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 msgr2=0x7fe5540b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe5540b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 >> v2:172.21.15.194:3300/0 conn(0x7fe5540b3bd0 msgr2=0x7fe55406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 --2- 172.21.15.192:0/3710658869 >> v2:172.21.15.194:3300/0 conn(0x7fe5540b3bd0 0x7fe55406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55406b480 con 0x7fe5541434c0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe548001670 con 0x7fe5541434c0 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 >> v1:172.21.15.192:6789/0 conn(0x7fe5541434c0 legacy=0x7fe55406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe53c003970 0x7fe53c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe53c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe53c004d00 0x7fe53c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540b4060 con 0x7fe53c004d00 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5540ce770 con 0x7fe53c003970 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c00b980 con 0x7fe55406c800 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe53c004d00 0x7fe53c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe559e00640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe53c003970 0x7fe53c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe559400640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe53c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 -- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 msgr2=0x7fe53c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55406c800 0x7fe53c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 -- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe53c003970 msgr2=0x7fe53c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe53c003970 0x7fe53c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.077+0000 7fe55a800640 1 -- 172.21.15.192:0/3710658869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53c003520 con 0x7fe53c004d00 2024-09-13T18:42:17.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.078+0000 7fe55a800640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe53c004d00 0x7fe53c005180 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e170 tx=0x7fe53c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98ff027e37ffdc8c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550030430 con 0x7fe53c004d00 2024-09-13T18:42:17.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55000f040 con 0x7fe53c004d00 2024-09-13T18:42:17.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe558a00640 1 -- 172.21.15.192:0/3710658869 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5500307d0 con 0x7fe53c004d00 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 -- 172.21.15.192:0/3710658869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe53c004d00 msgr2=0x7fe53c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 --2- 172.21.15.192:0/3710658869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe53c004d00 0x7fe53c005180 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fe55000e170 tx=0x7fe53c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55a800640 1 -- 172.21.15.192:0/3710658869 reap_dead start 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 -- 172.21.15.192:0/3710658869 shutdown_connections 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 -- 172.21.15.192:0/3710658869 >> 172.21.15.192:0/3710658869 conn(0x7fe5540b08f0 msgr2=0x7fe5540b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 -- 172.21.15.192:0/3710658869 shutdown_connections 2024-09-13T18:42:17.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.079+0000 7fe55c800640 1 -- 172.21.15.192:0/3710658869 wait complete. 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.081+0000 7fe55c800640 1 Processor -- start 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.081+0000 7fe55c800640 1 -- start start 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55413fcd0 0x7fe554139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 0x7fe554156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55413b9c0 con 0x7fe55413cd00 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe55413bc60 con 0x7fe5541400b0 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe55413bf40 con 0x7fe55413fcd0 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53434/0 (socket says 172.21.15.192:53434) 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe55a800640 1 -- 172.21.15.192:0/2098876085 learned_addr learned my addr 172.21.15.192:0/2098876085 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe559400640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 0x7fe554156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.082+0000 7fe559e00640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55413fcd0 0x7fe554139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 -- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55413fcd0 msgr2=0x7fe554139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55413fcd0 0x7fe554139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 -- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 msgr2=0x7fe554156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 0x7fe554156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 -- 172.21.15.192:0/2098876085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55413c220 con 0x7fe55413cd00 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe559400640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 0x7fe554156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55a800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe550009f90 tx=0x7fe550009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550003b90 con 0x7fe55413cd00 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe550003cf0 con 0x7fe55413cd00 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe550030880 con 0x7fe55413cd00 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe55413c500 con 0x7fe55413cd00 2024-09-13T18:42:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.083+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe55413a4f0 con 0x7fe55413cd00 2024-09-13T18:42:17.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.084+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe55413ca20 con 0x7fe55413cd00 2024-09-13T18:42:17.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.085+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe5500309e0 con 0x7fe55413cd00 2024-09-13T18:42:17.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.086+0000 7fe54e000640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 0x7fe53806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.086+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe5500a99c0 con 0x7fe55413cd00 2024-09-13T18:42:17.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.086+0000 7fe559e00640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 0x7fe53806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.087+0000 7fe559e00640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 0x7fe53806d0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5480017a0 tx=0x7fe5480014b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.090+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe55413ca20 con 0x7fe55413cd00 2024-09-13T18:42:17.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.264+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe55413ca20 con 0x7fe55413cd00 2024-09-13T18:42:17.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.269+0000 7fe54e000640 1 -- 172.21.15.192:0/2098876085 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe55413ca20 con 0x7fe55413cd00 2024-09-13T18:42:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 msgr2=0x7fe53806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 0x7fe53806d0f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe5480017a0 tx=0x7fe5480014b0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 msgr2=0x7fe554156da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe550009f90 tx=0x7fe550009750 comp rx=0 tx=0).stop 2024-09-13T18:42:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 shutdown_connections 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe53806ac30 0x7fe53806d0f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe55413cd00 0x7fe554156da0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe5541400b0 0x7fe554156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 --2- 172.21.15.192:0/2098876085 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe55413fcd0 0x7fe554139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 >> 172.21.15.192:0/2098876085 conn(0x7fe5540b08f0 msgr2=0x7fe5540ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 shutdown_connections 2024-09-13T18:42:17.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.271+0000 7fe55c800640 1 -- 172.21.15.192:0/2098876085 wait complete. 2024-09-13T18:42:17.289 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2024-09-13T18:42:17.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.440+0000 7f2d41000640 1 Processor -- start 2024-09-13T18:42:17.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.440+0000 7f2d41000640 1 -- start start 2024-09-13T18:42:17.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d41000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d3c146610 0x7f2d3c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d41000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0adf50 con 0x7f2d3c0afd80 2024-09-13T18:42:17.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d41000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d3c0ae770 con 0x7f2d3c0b2780 2024-09-13T18:42:17.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d41000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d3c0cd920 con 0x7f2d3c146610 2024-09-13T18:42:17.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d39e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2d3c146610 0x7f2d3c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d3a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2d3c0afd80 0x7f2d3c0b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55812/0 (socket says 172.21.15.192:55812) 2024-09-13T18:42:17.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.442+0000 7f2d3a800640 1 -- 172.21.15.192:0/787575907 learned_addr learned my addr 172.21.15.192:0/787575907 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:17.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.443+0000 7f2d39e00640 1 -- 172.21.15.192:0/787575907 >> v1:172.21.15.194:6789/0 conn(0x7f2d3c0b2780 legacy=0x7f2d3c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.443+0000 7f2d39e00640 1 -- 172.21.15.192:0/787575907 >> v1:172.21.15.192:6789/0 conn(0x7f2d3c0afd80 legacy=0x7f2d3c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.443+0000 7f2d39e00640 1 -- 172.21.15.192:0/787575907 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0cdb30 con 0x7f2d3c146610 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.443+0000 7f2d38a00640 1 -- 172.21.15.192:0/787575907 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2996423596 0 0) 0x7f2d3c0adf50 con 0x7f2d3c0afd80 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d39e00640 1 --2- 172.21.15.192:0/787575907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c146610 0x7f2d3c0ce2f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0cda60 tx=0x7f2d2c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3a61bd62e45f772 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d38a00640 1 -- 172.21.15.192:0/787575907 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c007740 con 0x7f2d3c146610 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d38a00640 1 -- 172.21.15.192:0/787575907 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c02d050 con 0x7f2d3c146610 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d38a00640 1 -- 172.21.15.192:0/787575907 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c007ac0 con 0x7f2d3c146610 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d41000640 1 -- 172.21.15.192:0/787575907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c146610 msgr2=0x7f2d3c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.444+0000 7f2d41000640 1 --2- 172.21.15.192:0/787575907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c146610 0x7f2d3c0ce2f0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0cda60 tx=0x7f2d2c02a680 comp rx=0 tx=0).stop 2024-09-13T18:42:17.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.445+0000 7f2d41000640 1 -- 172.21.15.192:0/787575907 shutdown_connections 2024-09-13T18:42:17.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.445+0000 7f2d41000640 1 --2- 172.21.15.192:0/787575907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c146610 0x7f2d3c0ce2f0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.445+0000 7f2d41000640 1 -- 172.21.15.192:0/787575907 >> 172.21.15.192:0/787575907 conn(0x7f2d3c0ae960 msgr2=0x7f2d3c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:17.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.445+0000 7f2d41000640 1 -- 172.21.15.192:0/787575907 shutdown_connections 2024-09-13T18:42:17.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.445+0000 7f2d41000640 1 -- 172.21.15.192:0/787575907 wait complete. 2024-09-13T18:42:17.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.446+0000 7f2d41000640 1 Processor -- start 2024-09-13T18:42:17.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.446+0000 7f2d41000640 1 -- start start 2024-09-13T18:42:17.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0b2780 0x7f2d3c070420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 0x7f2d3c06b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c13eaf0 con 0x7f2d3c0afd80 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1f2c80 con 0x7f2d3c0b2780 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d41000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3c1f2f60 con 0x7f2d3c146610 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d39e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d39e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53448/0 (socket says 172.21.15.192:53448) 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.447+0000 7f2d39e00640 1 -- 172.21.15.192:0/919442113 learned_addr learned my addr 172.21.15.192:0/919442113 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d3a800640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 0x7f2d3c06b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39400640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0b2780 0x7f2d3c070420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 -- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 msgr2=0x7f2d3c06b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 0x7f2d3c06b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 -- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0b2780 msgr2=0x7f2d3c070420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0b2780 0x7f2d3c070420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 -- 172.21.15.192:0/919442113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c009a70 con 0x7f2d3c0afd80 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d3a800640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 0x7f2d3c06b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d39e00640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000f80 tx=0x7f2d2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c031c40 con 0x7f2d3c0afd80 2024-09-13T18:42:17.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c031da0 con 0x7f2d3c0afd80 2024-09-13T18:42:17.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3c1f3240 con 0x7f2d3c0afd80 2024-09-13T18:42:17.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.448+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c003b90 con 0x7f2d3c0afd80 2024-09-13T18:42:17.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.449+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d3c142120 con 0x7f2d3c0afd80 2024-09-13T18:42:17.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.450+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3c1f3a40 con 0x7f2d3c0afd80 2024-09-13T18:42:17.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.451+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2d2c003cf0 con 0x7f2d3c0afd80 2024-09-13T18:42:17.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.451+0000 7f2d32000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 0x7f2d1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:17.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.451+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2d2c0aa070 con 0x7f2d3c0afd80 2024-09-13T18:42:17.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.452+0000 7f2d39400640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 0x7f2d1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:17.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.452+0000 7f2d39400640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 0x7f2d1c06d0c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c1577b0 tx=0x7f2d28009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:17.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.456+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2d3c1f3a40 con 0x7f2d3c0afd80 2024-09-13T18:42:17.688 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.686+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f2d3c1f3a40 con 0x7f2d3c0afd80 2024-09-13T18:42:17.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.894+0000 7f2d32000640 1 -- 172.21.15.192:0/919442113 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v353) v1 ==== 128+0+0 (secure 0 0 0) 0x7f2d3c1f3a40 con 0x7f2d3c0afd80 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 msgr2=0x7f2d1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 0x7f2d1c06d0c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c1577b0 tx=0x7f2d28009040 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 msgr2=0x7f2d3c13e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000f80 tx=0x7f2d2c004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 shutdown_connections 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2d1c06ac00 0x7f2d1c06d0c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2d3c146610 0x7f2d3c06b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2d3c0b2780 0x7f2d3c070420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.896+0000 7f2d41000640 1 --2- 172.21.15.192:0/919442113 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d3c0afd80 0x7f2d3c13e5b0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:17.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.897+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 >> 172.21.15.192:0/919442113 conn(0x7f2d3c0ae960 msgr2=0x7f2d3c0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:17.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.897+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 shutdown_connections 2024-09-13T18:42:17.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:17.897+0000 7f2d41000640 1 -- 172.21.15.192:0/919442113 wait complete. 2024-09-13T18:42:17.914 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2024-09-13T18:42:17.914 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-13T18:42:17.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:18.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.065+0000 7fe9d9800640 1 Processor -- start 2024-09-13T18:42:18.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.065+0000 7fe9d9800640 1 -- start start 2024-09-13T18:42:18.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d9800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9d415a9e0 0x7fe9d406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d9800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe9d40cdfd0 0x7fe9d4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d9800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d406c5d0 con 0x7fe9d406b3d0 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d9800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40b3730 con 0x7fe9d415a9e0 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d9800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d40b3920 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe9d415a9e0 0x7fe9d406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe9d406b3d0 0x7fe9d40cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55816/0 (socket says 172.21.15.192:55816) 2024-09-13T18:42:18.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3400640 1 -- 172.21.15.192:0/644150845 learned_addr learned my addr 172.21.15.192:0/644150845 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:18.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3e00640 1 -- 172.21.15.192:0/644150845 >> v2:172.21.15.194:3300/0 conn(0x7fe9d40cdfd0 msgr2=0x7fe9d4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:18.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3e00640 1 --2- 172.21.15.192:0/644150845 >> v2:172.21.15.194:3300/0 conn(0x7fe9d40cdfd0 0x7fe9d4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3e00640 1 -- 172.21.15.192:0/644150845 >> v1:172.21.15.192:6789/0 conn(0x7fe9d406b3d0 legacy=0x7fe9d40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.067+0000 7fe9d3e00640 1 -- 172.21.15.192:0/644150845 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d40b3c00 con 0x7fe9d415a9e0 2024-09-13T18:42:18.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.068+0000 7fe9d3e00640 1 --2- 172.21.15.192:0/644150845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d415a9e0 0x7fe9d406ae90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4071bd0 tx=0x7fe9c402a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18dc99cc927875c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d2a00640 1 -- 172.21.15.192:0/644150845 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4032440 con 0x7fe9d415a9e0 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d2a00640 1 -- 172.21.15.192:0/644150845 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c40325a0 con 0x7fe9d415a9e0 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d2a00640 1 -- 172.21.15.192:0/644150845 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c4032930 con 0x7fe9d415a9e0 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 -- 172.21.15.192:0/644150845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d415a9e0 msgr2=0x7fe9d406ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 --2- 172.21.15.192:0/644150845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d415a9e0 0x7fe9d406ae90 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fe9d4071bd0 tx=0x7fe9c402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 -- 172.21.15.192:0/644150845 shutdown_connections 2024-09-13T18:42:18.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 --2- 172.21.15.192:0/644150845 >> v2:172.21.15.194:3300/0 conn(0x7fe9d40cdfd0 0x7fe9d4070630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 --2- 172.21.15.192:0/644150845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d415a9e0 0x7fe9d406ae90 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 -- 172.21.15.192:0/644150845 >> 172.21.15.192:0/644150845 conn(0x7fe9d40736d0 msgr2=0x7fe9d40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 -- 172.21.15.192:0/644150845 shutdown_connections 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.069+0000 7fe9d9800640 1 -- 172.21.15.192:0/644150845 wait complete. 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.071+0000 7fe9d9800640 1 Processor -- start 2024-09-13T18:42:18.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.071+0000 7fe9d9800640 1 -- start start 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d406b3d0 0x7fe9d41542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9d415a9e0 0x7fe9d41f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40a9c40 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d41e6740 con 0x7fe9d406b3d0 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d40a9430 con 0x7fe9d415a9e0 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53468/0 (socket says 172.21.15.192:53468) 2024-09-13T18:42:18.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d3400640 1 -- 172.21.15.192:0/861781 learned_addr learned my addr 172.21.15.192:0/861781 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d3e00640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d406b3d0 0x7fe9d41542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.072+0000 7fe9d8e00640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9d415a9e0 0x7fe9d41f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 -- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9d415a9e0 msgr2=0x7fe9d41f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9d415a9e0 0x7fe9d41f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 -- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d406b3d0 msgr2=0x7fe9d41542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d406b3d0 0x7fe9d41542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 -- 172.21.15.192:0/861781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c4009400 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d3400640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c500 tx=0x7fe9c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c0005ce0 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c0005e40 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d41e69e0 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00072f0 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.073+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d40a9680 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.074+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d41e6b70 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.075+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe9c0007510 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.076+0000 7fe9cbe00640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 0x7fe9b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.076+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe9c0088500 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.076+0000 7fe9d3e00640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 0x7fe9b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.077+0000 7fe9d3e00640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 0x7fe9b406d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.080+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe9c0053a80 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.249+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9d406e970 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.250+0000 7fe9cbe00640 1 -- 172.21.15.192:0/861781 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+13059 (secure 0 0 0) 0x7fe9c0017090 con 0x7fe9d40cdfd0 2024-09-13T18:42:18.252 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:18.252 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":140,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:16.881630+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6835/1161965383":"2024-09-14T18:42:13.511891+0000","172.21.15.194:6833/1161965383":"2024-09-14T18:42:13.511891+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 msgr2=0x7fe9b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 0x7fe9b406d0c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe9c4034000 tx=0x7fe9c402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 msgr2=0x7fe9d4153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000c500 tx=0x7fe9c000c9c0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 shutdown_connections 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe9b406ac00 0x7fe9b406d0c0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe9d415a9e0 0x7fe9d41f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe9d40cdfd0 0x7fe9d4153a30 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 --2- 172.21.15.192:0/861781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe9d406b3d0 0x7fe9d41542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 >> 172.21.15.192:0/861781 conn(0x7fe9d40736d0 msgr2=0x7fe9d4156ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:18.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 shutdown_connections 2024-09-13T18:42:18.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.253+0000 7fe9d9800640 1 -- 172.21.15.192:0/861781 wait complete. 2024-09-13T18:42:18.273 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:18.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:18.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.426+0000 7fab4ee00640 1 Processor -- start 2024-09-13T18:42:18.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.426+0000 7fab4ee00640 1 -- start start 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ee00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fab481589f0 0x7fab480b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ee00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab4806c0b0 0x7fab4806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ee00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab480b2000 con 0x7fab480b3af0 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ee00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4806ca30 con 0x7fab4806c0b0 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ee00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4815b970 con 0x7fab481589f0 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab4ce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab4806c0b0 0x7fab4806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab47400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fab480b3af0 0x7fab4815b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55826/0 (socket says 172.21.15.192:55826) 2024-09-13T18:42:18.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.427+0000 7fab47400640 1 -- 172.21.15.192:0/2631879071 learned_addr learned my addr 172.21.15.192:0/2631879071 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:18.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab47e00640 1 --2- 172.21.15.192:0/2631879071 >> v2:172.21.15.194:3300/0 conn(0x7fab481589f0 0x7fab480b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab4ce00640 1 -- 172.21.15.192:0/2631879071 >> v2:172.21.15.194:3300/0 conn(0x7fab481589f0 msgr2=0x7fab480b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab4ce00640 1 --2- 172.21.15.192:0/2631879071 >> v2:172.21.15.194:3300/0 conn(0x7fab481589f0 0x7fab480b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab4ce00640 1 -- 172.21.15.192:0/2631879071 >> v1:172.21.15.192:6789/0 conn(0x7fab480b3af0 legacy=0x7fab4815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab4ce00640 1 -- 172.21.15.192:0/2631879071 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4815bbd0 con 0x7fab4806c0b0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.428+0000 7fab46a00640 1 -- 172.21.15.192:0/2631879071 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675066639 0 0) 0x7fab480b2000 con 0x7fab480b3af0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.429+0000 7fab4ce00640 1 --2- 172.21.15.192:0/2631879071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab4806c4f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fab4806e230 tx=0x7fab4002a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6192d95859ac87c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.429+0000 7fab46a00640 1 -- 172.21.15.192:0/2631879071 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40007740 con 0x7fab4806c0b0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.429+0000 7fab46a00640 1 -- 172.21.15.192:0/2631879071 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4002d050 con 0x7fab4806c0b0 2024-09-13T18:42:18.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.429+0000 7fab46a00640 1 -- 172.21.15.192:0/2631879071 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40007ac0 con 0x7fab4806c0b0 2024-09-13T18:42:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 -- 172.21.15.192:0/2631879071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 msgr2=0x7fab4806c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 --2- 172.21.15.192:0/2631879071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab4806c4f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fab4806e230 tx=0x7fab4002a5f0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 -- 172.21.15.192:0/2631879071 shutdown_connections 2024-09-13T18:42:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 --2- 172.21.15.192:0/2631879071 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab4806c4f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 --2- 172.21.15.192:0/2631879071 >> v2:172.21.15.194:3300/0 conn(0x7fab481589f0 0x7fab480b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 -- 172.21.15.192:0/2631879071 >> 172.21.15.192:0/2631879071 conn(0x7fab480b08f0 msgr2=0x7fab480b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 -- 172.21.15.192:0/2631879071 shutdown_connections 2024-09-13T18:42:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.430+0000 7fab4ee00640 1 -- 172.21.15.192:0/2631879071 wait complete. 2024-09-13T18:42:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.431+0000 7fab4ee00640 1 Processor -- start 2024-09-13T18:42:18.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 -- start start 2024-09-13T18:42:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3af0 0x7fab4815d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab481589f0 0x7fab48154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4815d1b0 con 0x7fab4806c0b0 2024-09-13T18:42:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab48154720 con 0x7fab480b3af0 2024-09-13T18:42:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.432+0000 7fab4ee00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4815c5a0 con 0x7fab481589f0 2024-09-13T18:42:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53484/0 (socket says 172.21.15.192:53484) 2024-09-13T18:42:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 -- 172.21.15.192:0/3957479981 learned_addr learned my addr 172.21.15.192:0/3957479981 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 -- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab481589f0 msgr2=0x7fab48154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab481589f0 0x7fab48154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 -- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3af0 msgr2=0x7fab4815d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3af0 0x7fab4815d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 -- 172.21.15.192:0/3957479981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab40009a70 con 0x7fab4806c0b0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab47e00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e870 tx=0x7fab3800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.433+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab380094f0 con 0x7fab4806c0b0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.434+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab3800c940 con 0x7fab4806c0b0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.434+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4815c880 con 0x7fab4806c0b0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.434+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3800ccf0 con 0x7fab4806c0b0 2024-09-13T18:42:18.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.434+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4815ce40 con 0x7fab4806c0b0 2024-09-13T18:42:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.435+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4806c4f0 con 0x7fab4806c0b0 2024-09-13T18:42:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.436+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab38013470 con 0x7fab4806c0b0 2024-09-13T18:42:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.436+0000 7fab3fe00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 0x7fab2806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.436+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fab38089140 con 0x7fab4806c0b0 2024-09-13T18:42:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.437+0000 7fab47400640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 0x7fab2806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.437+0000 7fab47400640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 0x7fab2806d0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab34007fd0 tx=0x7fab34007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.441+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab38054610 con 0x7fab4806c0b0 2024-09-13T18:42:18.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.605+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab480cb8f0 con 0x7fab4806c0b0 2024-09-13T18:42:18.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.606+0000 7fab3fe00640 1 -- 172.21.15.192:0/3957479981 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab38057c30 con 0x7fab4806c0b0 2024-09-13T18:42:18.607 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:18.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 msgr2=0x7fab2806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 0x7fab2806d0f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fab34007fd0 tx=0x7fab34007920 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 msgr2=0x7fab481e4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fab3800e870 tx=0x7fab3800ed30 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 shutdown_connections 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab2806ac30 0x7fab2806d0f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab481589f0 0x7fab48154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab480b3af0 0x7fab4815d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 --2- 172.21.15.192:0/3957479981 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab4806c0b0 0x7fab481e4340 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 >> 172.21.15.192:0/3957479981 conn(0x7fab480b08f0 msgr2=0x7fab480ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 shutdown_connections 2024-09-13T18:42:18.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.608+0000 7fab4ee00640 1 -- 172.21.15.192:0/3957479981 wait complete. 2024-09-13T18:42:18.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-13T18:42:18.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.776+0000 7f887d000640 1 Processor -- start 2024-09-13T18:42:18.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.776+0000 7f887d000640 1 -- start start 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f887d000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 0x7f887806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f887d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f88780cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f887d000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887806f2b0 con 0x7f887813e2a0 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f887d000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88780ccb40 con 0x7f887806e990 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f887d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780cce00 con 0x7f8878071ac0 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f8876a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f887813e2a0 0x7f88780713b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55828/0 (socket says 172.21.15.192:55828) 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.777+0000 7f8876a00640 1 -- 172.21.15.192:0/2025997177 learned_addr learned my addr 172.21.15.192:0/2025997177 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877400640 1 --2- 172.21.15.192:0/2025997177 >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 0x7f887806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877e00640 1 --2- 172.21.15.192:0/2025997177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f88780cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8876000640 1 -- 172.21.15.192:0/2025997177 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606073676 0 0) 0x7f887806f2b0 con 0x7f887813e2a0 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8876000640 1 -- 172.21.15.192:0/2025997177 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c003520 con 0x7f887813e2a0 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877e00640 1 -- 172.21.15.192:0/2025997177 >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 msgr2=0x7f887806ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877e00640 1 --2- 172.21.15.192:0/2025997177 >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 0x7f887806ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877e00640 1 -- 172.21.15.192:0/2025997177 >> v1:172.21.15.192:6789/0 conn(0x7f887813e2a0 legacy=0x7f88780713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877e00640 1 -- 172.21.15.192:0/2025997177 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780cd0e0 con 0x7f8878071ac0 2024-09-13T18:42:18.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.778+0000 7f8877400640 1 --2- 172.21.15.192:0/2025997177 >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 0x7f887806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:18.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.779+0000 7f8877e00640 1 --2- 172.21.15.192:0/2025997177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f88780cdbc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a04dd2d4296f677 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f8876000640 1 -- 172.21.15.192:0/2025997177 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870031600 con 0x7f8878071ac0 2024-09-13T18:42:18.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f8876000640 1 -- 172.21.15.192:0/2025997177 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887002d050 con 0x7f8878071ac0 2024-09-13T18:42:18.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f8876000640 1 -- 172.21.15.192:0/2025997177 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870031980 con 0x7f8878071ac0 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 -- 172.21.15.192:0/2025997177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 msgr2=0x7f88780cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 --2- 172.21.15.192:0/2025997177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f88780cdbc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8870009d90 tx=0x7f887002a5d0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 -- 172.21.15.192:0/2025997177 shutdown_connections 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 --2- 172.21.15.192:0/2025997177 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f88780cdbc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 --2- 172.21.15.192:0/2025997177 >> v2:172.21.15.194:3300/0 conn(0x7f887806e990 0x7f887806ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 -- 172.21.15.192:0/2025997177 >> 172.21.15.192:0/2025997177 conn(0x7f88780b09f0 msgr2=0x7f88780b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 -- 172.21.15.192:0/2025997177 shutdown_connections 2024-09-13T18:42:18.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.780+0000 7f887d000640 1 -- 172.21.15.192:0/2025997177 wait complete. 2024-09-13T18:42:18.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.782+0000 7f887d000640 1 Processor -- start 2024-09-13T18:42:18.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.782+0000 7f887d000640 1 -- start start 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887806e990 0x7f887813ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f887813d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88780b3d00 con 0x7f887813e2a0 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88781e2bc0 con 0x7f887806e990 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f887d000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88780b21b0 con 0x7f8878071ac0 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f8877e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f8877e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53490/0 (socket says 172.21.15.192:53490) 2024-09-13T18:42:18.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f8877e00640 1 -- 172.21.15.192:0/2394096928 learned_addr learned my addr 172.21.15.192:0/2394096928 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f8876a00640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f887813d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.783+0000 7f8877400640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887806e990 0x7f887813ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 -- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 msgr2=0x7f887813d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f887813d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 -- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887806e990 msgr2=0x7f887813ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887806e990 0x7f887813ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 -- 172.21.15.192:0/2394096928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8868009400 con 0x7f887813e2a0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f8877e00640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8870009eb0 tx=0x7f8870004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887003c830 con 0x7f887813e2a0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887003c990 con 0x7f887813e2a0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887003cd20 con 0x7f887813e2a0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8870009a70 con 0x7f887813e2a0 2024-09-13T18:42:18.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.784+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88780b2770 con 0x7f887813e2a0 2024-09-13T18:42:18.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.785+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887806f260 con 0x7f887813e2a0 2024-09-13T18:42:18.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.786+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f887003b3b0 con 0x7f887813e2a0 2024-09-13T18:42:18.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.787+0000 7f886f400640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 0x7f885806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:18.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.787+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f88700aa8d0 con 0x7f887813e2a0 2024-09-13T18:42:18.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.787+0000 7f8877400640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 0x7f885806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:18.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.788+0000 7f8877400640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 0x7f885806d0c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8868009c30 tx=0x7f8868009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:18.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:18.791+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8870075e50 con 0x7f887813e2a0 2024-09-13T18:42:19.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.026+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f887806ed70 con 0x7f887813e2a0 2024-09-13T18:42:19.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.902+0000 7f886f400640 1 -- 172.21.15.192:0/2394096928 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v355) v1 ==== 143+0+0 (secure 0 0 0) 0x7f8870009450 con 0x7f887813e2a0 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 msgr2=0x7f885806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 0x7f885806d0c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8868009c30 tx=0x7f8868009190 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 msgr2=0x7f88780ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8870009eb0 tx=0x7f8870004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 shutdown_connections 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac00 0x7f885806d0c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887813e2a0 0x7f88780ad840 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8878071ac0 0x7f887813d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 --2- 172.21.15.192:0/2394096928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887806e990 0x7f887813ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 >> 172.21.15.192:0/2394096928 conn(0x7f88780b09f0 msgr2=0x7f88780afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 shutdown_connections 2024-09-13T18:42:19.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:19.905+0000 7f887d000640 1 -- 172.21.15.192:0/2394096928 wait complete. 2024-09-13T18:42:19.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:42:20.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.085+0000 7f874ec00640 1 Processor -- start 2024-09-13T18:42:20.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.085+0000 7f874ec00640 1 -- start start 2024-09-13T18:42:20.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.086+0000 7f874ec00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87481589f0 0x7f87480b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f874ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f874806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f874ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87480b2000 con 0x7f87480b3af0 2024-09-13T18:42:20.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f874ec00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874806ca80 con 0x7f87481589f0 2024-09-13T18:42:20.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f874ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874815b970 con 0x7f874806c0b0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f8747e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87481589f0 0x7f87480b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f874cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f874806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f8747400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f87480b3af0 0x7f874815b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:56298/0 (socket says 172.21.15.192:56298) 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.087+0000 7f8747400640 1 -- 172.21.15.192:0/2970798952 learned_addr learned my addr 172.21.15.192:0/2970798952 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.088+0000 7f874cc00640 1 -- 172.21.15.192:0/2970798952 >> v2:172.21.15.194:3300/0 conn(0x7f87481589f0 msgr2=0x7f87480b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.088+0000 7f874cc00640 1 --2- 172.21.15.192:0/2970798952 >> v2:172.21.15.194:3300/0 conn(0x7f87481589f0 0x7f87480b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.088+0000 7f874cc00640 1 -- 172.21.15.192:0/2970798952 >> v1:172.21.15.194:6789/0 conn(0x7f87480b3af0 legacy=0x7f874815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.088+0000 7f8746a00640 1 -- 172.21.15.192:0/2970798952 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227302050 0 0) 0x7f87480b2000 con 0x7f87480b3af0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.088+0000 7f874cc00640 1 -- 172.21.15.192:0/2970798952 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874815bbd0 con 0x7f874806c0b0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.089+0000 7f874cc00640 1 --2- 172.21.15.192:0/2970798952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f874806c540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8740009d90 tx=0x7f874002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40be54c59c66da99 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.089+0000 7f8746a00640 1 -- 172.21.15.192:0/2970798952 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740007740 con 0x7f874806c0b0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.089+0000 7f8746a00640 1 -- 172.21.15.192:0/2970798952 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874002d050 con 0x7f874806c0b0 2024-09-13T18:42:20.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.089+0000 7f8746a00640 1 -- 172.21.15.192:0/2970798952 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740007ac0 con 0x7f874806c0b0 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 -- 172.21.15.192:0/2970798952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 msgr2=0x7f874806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 --2- 172.21.15.192:0/2970798952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f874806c540 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8740009d90 tx=0x7f874002a660 comp rx=0 tx=0).stop 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 -- 172.21.15.192:0/2970798952 shutdown_connections 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 --2- 172.21.15.192:0/2970798952 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f874806c540 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 --2- 172.21.15.192:0/2970798952 >> v2:172.21.15.194:3300/0 conn(0x7f87481589f0 0x7f87480b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 -- 172.21.15.192:0/2970798952 >> 172.21.15.192:0/2970798952 conn(0x7f87480b08f0 msgr2=0x7f87480b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 -- 172.21.15.192:0/2970798952 shutdown_connections 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.090+0000 7f874ec00640 1 -- 172.21.15.192:0/2970798952 wait complete. 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.091+0000 7f874ec00640 1 Processor -- start 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.092+0000 7f874ec00640 1 -- start start 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.092+0000 7f874ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f87481486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.092+0000 7f874ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.092+0000 7f874ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87481589f0 0x7f8748153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f874ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748148c30 con 0x7f87480b3af0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f874ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874806a820 con 0x7f87481589f0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f874ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874806ab00 con 0x7f874806c0b0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53492/0 (socket says 172.21.15.192:53492) 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 -- 172.21.15.192:0/2655009503 learned_addr learned my addr 172.21.15.192:0/2655009503 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f874cc00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87481589f0 0x7f8748153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747e00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f87481486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 -- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 msgr2=0x7f87481486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f87481486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 -- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87481589f0 msgr2=0x7f8748153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87481589f0 0x7f8748153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.093+0000 7f8747400640 1 -- 172.21.15.192:0/2655009503 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009a70 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f8747400640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f873400c4d0 tx=0x7f873400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87340074e0 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8734007660 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874806ade0 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8734004a20 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.094+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874806b3a0 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.095+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f874806c540 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.096+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8734004b80 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.097+0000 7f873fe00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 0x7f872806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.097+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f87340881a0 con 0x7f87480b3af0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.097+0000 7f8747e00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 0x7f872806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:20.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.098+0000 7f8747e00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 0x7f872806d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f874806a430 tx=0x7f8738009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.101+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8734053720 con 0x7f87480b3af0 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.268+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8748158170 con 0x7f87480b3af0 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.273+0000 7f873fe00640 1 -- 172.21.15.192:0/2655009503 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8734056d40 con 0x7f87480b3af0 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 msgr2=0x7f872806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 0x7f872806d0c0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f874806a430 tx=0x7f8738009190 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 msgr2=0x7f874806b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f873400c4d0 tx=0x7f873400c990 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 shutdown_connections 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f872806ac00 0x7f872806d0c0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87481589f0 0x7f8748153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87480b3af0 0x7f874806b8c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 --2- 172.21.15.192:0/2655009503 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f874806c0b0 0x7f87481486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:20.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 >> 172.21.15.192:0/2655009503 conn(0x7f87480b08f0 msgr2=0x7f8748159ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:20.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 shutdown_connections 2024-09-13T18:42:20.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:20.275+0000 7f874ec00640 1 -- 172.21.15.192:0/2655009503 wait complete. 2024-09-13T18:42:20.649 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:42:20.649 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:20.735 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:20.830 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:42:20.830 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:20.830 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:20.866 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:42:20.866 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:20.866 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:20.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:42:20.903 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:20.903 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:20.941 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:42:20.941 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:20.941 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:20.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:42:20.980 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:42:20.980 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.131+0000 7fe486c00640 1 Processor -- start 2024-09-13T18:42:21.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.131+0000 7fe486c00640 1 -- start start 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.132+0000 7fe486c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe48015dee0 0x7fe4800afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.132+0000 7fe486c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4800b3f10 0x7fe4800b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.132+0000 7fe486c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe48015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.132+0000 7fe486c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800b2f00 con 0x7fe4800b3f10 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.132+0000 7fe486c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4800b3150 con 0x7fe48015dee0 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe486c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4800b3430 con 0x7fe48015e2c0 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4800b3f10 0x7fe4800b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe4800b3f10 0x7fe4800b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51702/0 (socket says 172.21.15.192:51702) 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 -- 172.21.15.192:0/1521762641 learned_addr learned my addr 172.21.15.192:0/1521762641 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe47fe00640 1 --2- 172.21.15.192:0/1521762641 >> v2:172.21.15.194:3300/0 conn(0x7fe48015dee0 0x7fe4800afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe484c00640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe48015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 -- 172.21.15.192:0/1521762641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 msgr2=0x7fe48015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe48015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 -- 172.21.15.192:0/1521762641 >> v2:172.21.15.194:3300/0 conn(0x7fe48015dee0 msgr2=0x7fe4800afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 --2- 172.21.15.192:0/1521762641 >> v2:172.21.15.194:3300/0 conn(0x7fe48015dee0 0x7fe4800afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.133+0000 7fe477400640 1 -- 172.21.15.192:0/1521762641 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4800b3710 con 0x7fe4800b3f10 2024-09-13T18:42:21.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.134+0000 7fe477400640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4800b3f10 0x7fe4800b02c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe48006cd20 tx=0x7fe46802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73359eddbdfe3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe47f400640 1 -- 172.21.15.192:0/1521762641 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468032440 con 0x7fe4800b3f10 2024-09-13T18:42:21.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe47f400640 1 -- 172.21.15.192:0/1521762641 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4680325a0 con 0x7fe4800b3f10 2024-09-13T18:42:21.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe47f400640 1 -- 172.21.15.192:0/1521762641 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468032930 con 0x7fe4800b3f10 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 -- 172.21.15.192:0/1521762641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4800b3f10 msgr2=0x7fe4800b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4800b3f10 0x7fe4800b02c0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fe48006cd20 tx=0x7fe46802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 -- 172.21.15.192:0/1521762641 shutdown_connections 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe48015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 --2- 172.21.15.192:0/1521762641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4800b3f10 0x7fe4800b02c0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 --2- 172.21.15.192:0/1521762641 >> v2:172.21.15.194:3300/0 conn(0x7fe48015dee0 0x7fe4800afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 -- 172.21.15.192:0/1521762641 >> 172.21.15.192:0/1521762641 conn(0x7fe4800ae960 msgr2=0x7fe48006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 -- 172.21.15.192:0/1521762641 shutdown_connections 2024-09-13T18:42:21.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.135+0000 7fe486c00640 1 -- 172.21.15.192:0/1521762641 wait complete. 2024-09-13T18:42:21.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.137+0000 7fe486c00640 1 Processor -- start 2024-09-13T18:42:21.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.137+0000 7fe486c00640 1 -- start start 2024-09-13T18:42:21.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 0x7fe480137e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe4801e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4801e3a00 con 0x7fe4801e5880 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe480152250 con 0x7fe48015dee0 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe486c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe480138360 con 0x7fe48015e2c0 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe484c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe484c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51710/0 (socket says 172.21.15.192:51710) 2024-09-13T18:42:21.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe484c00640 1 -- 172.21.15.192:0/2316480245 learned_addr learned my addr 172.21.15.192:0/2316480245 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:21.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.138+0000 7fe47fe00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 0x7fe480137e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe477400640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe4801e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 -- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 msgr2=0x7fe4801e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe4801e3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 -- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 msgr2=0x7fe480137e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 0x7fe480137e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 -- 172.21.15.192:0/2316480245 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4680094d0 con 0x7fe4801e5880 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe47fe00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 0x7fe480137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe484c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d30 tx=0x7fe47800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe478009ba0 con 0x7fe4801e5880 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe47800f040 con 0x7fe4801e5880 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe480151cd0 con 0x7fe4801e5880 2024-09-13T18:42:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.139+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4780146c0 con 0x7fe4801e5880 2024-09-13T18:42:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.140+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe480151f70 con 0x7fe4801e5880 2024-09-13T18:42:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.141+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4801e3b40 con 0x7fe4801e5880 2024-09-13T18:42:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.141+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe478014820 con 0x7fe4801e5880 2024-09-13T18:42:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.143+0000 7fe47cc00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 0x7fe45c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.143+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe478089980 con 0x7fe4801e5880 2024-09-13T18:42:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.143+0000 7fe47fe00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 0x7fe45c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.144+0000 7fe47fe00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 0x7fe45c06d0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe4800673c0 tx=0x7fe470009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.147+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe478054f00 con 0x7fe4801e5880 2024-09-13T18:42:21.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.350+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe48015a440 con 0x7fe4801e5880 2024-09-13T18:42:21.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.351+0000 7fe47cc00640 1 -- 172.21.15.192:0/2316480245 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3541 (secure 0 0 0) 0x7fe478018090 con 0x7fe4801e5880 2024-09-13T18:42:21.354 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:21.354 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6182,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3442276113","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3442276113},{"type":"v1","addr":"172.21.15.194:6834","nonce":3442276113}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6191,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/1916289246","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":1916289246},{"type":"v1","addr":"172.21.15.192:6837","nonce":1916289246}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50},{"gid":6410,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3261000663","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":3261000663},{"type":"v1","addr":"172.21.15.194:6835","nonce":3261000663}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":57},{"gid":6916,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/3838735242","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":3838735242},{"type":"v1","addr":"172.21.15.192:6836","nonce":3838735242}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":50}],"filesystems":[]} 2024-09-13T18:42:21.354 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 57 2024-09-13T18:42:21.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 msgr2=0x7fe45c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 0x7fe45c06d0c0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe4800673c0 tx=0x7fe470009190 comp rx=0 tx=0).stop 2024-09-13T18:42:21.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 msgr2=0x7fe480152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7fe478009d30 tx=0x7fe47800c490 comp rx=0 tx=0).stop 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 shutdown_connections 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe45c06ac00 0x7fe45c06d0c0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe4801e5880 0x7fe480152f60 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe48015e2c0 0x7fe4801e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 --2- 172.21.15.192:0/2316480245 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe48015dee0 0x7fe480137e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 >> 172.21.15.192:0/2316480245 conn(0x7fe4800ae960 msgr2=0x7fe48006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 shutdown_connections 2024-09-13T18:42:21.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.353+0000 7fe486c00640 1 -- 172.21.15.192:0/2316480245 wait complete. 2024-09-13T18:42:21.373 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:42:21.373 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:42:21.373 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:42:21.373 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:42:21.374 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:42:21.374 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:42:21.374 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:42:21.374 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:42:21.375 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:42:21.375 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:42:21.375 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:42:21.375 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:42:21.375 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:42:21.375 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:42:21.376 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:42:21.376 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:42:21.390 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:42:21.390 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:42:21.392 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:42:21.392 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:42:21.393 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:42:21.393 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:42:21.394 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:42:21.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:42:21.436 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:42:21.436 DEBUG:teuthology.parallel:result is None 2024-09-13T18:42:21.437 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:42:21.438 DEBUG:teuthology.parallel:result is None 2024-09-13T18:42:21.438 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:42:21.439 DEBUG:teuthology.parallel:result is None 2024-09-13T18:42:21.439 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:42:21.440 DEBUG:teuthology.parallel:result is None 2024-09-13T18:42:21.440 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:42:21.564 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:42:21.565 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:42:21.566 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:42:21.566 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:42:21.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.600+0000 7f53afe00640 1 Processor -- start 2024-09-13T18:42:21.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.600+0000 7f53afe00640 1 -- start start 2024-09-13T18:42:21.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.601+0000 7f53afe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b00b2d70 0x7f53b0069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.601+0000 7f53afe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53b006e990 0x7f53b006b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.601+0000 7f53afe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b006b290 con 0x7f53b01611f0 2024-09-13T18:42:21.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.601+0000 7f53afe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b006a3e0 con 0x7f53b006e990 2024-09-13T18:42:21.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.601+0000 7f53afe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b006a680 con 0x7f53b00b2d70 2024-09-13T18:42:21.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53b006e990 0x7f53b006b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f53b006e990 0x7f53b006b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51740/0 (socket says 172.21.15.192:51740) 2024-09-13T18:42:21.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 -- 172.21.15.192:0/3570352910 learned_addr learned my addr 172.21.15.192:0/3570352910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53aea00640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b00b2d70 0x7f53b0069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 -- 172.21.15.192:0/3570352910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b00b2d70 msgr2=0x7f53b0069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b00b2d70 0x7f53b0069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 -- 172.21.15.192:0/3570352910 >> v1:172.21.15.194:6789/0 conn(0x7f53b01611f0 legacy=0x7f53b00b3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.602+0000 7f53af400640 1 -- 172.21.15.192:0/3570352910 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b006a960 con 0x7f53b006e990 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.603+0000 7f53af400640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b006e990 0x7f53b006b720 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009870 tx=0x7f53a802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5edfa06f5bbed6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.603+0000 7f53ad600640 1 -- 172.21.15.192:0/3570352910 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8032440 con 0x7f53b006e990 2024-09-13T18:42:21.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.603+0000 7f53ad600640 1 -- 172.21.15.192:0/3570352910 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a80325a0 con 0x7f53b006e990 2024-09-13T18:42:21.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.603+0000 7f53ad600640 1 -- 172.21.15.192:0/3570352910 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8032930 con 0x7f53b006e990 2024-09-13T18:42:21.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 -- 172.21.15.192:0/3570352910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b006e990 msgr2=0x7f53b006b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b006e990 0x7f53b006b720 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009870 tx=0x7f53a802a250 comp rx=0 tx=0).stop 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 -- 172.21.15.192:0/3570352910 shutdown_connections 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b006e990 0x7f53b006b720 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 --2- 172.21.15.192:0/3570352910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b00b2d70 0x7f53b0069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 -- 172.21.15.192:0/3570352910 >> 172.21.15.192:0/3570352910 conn(0x7f53b00736d0 msgr2=0x7f53b00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 -- 172.21.15.192:0/3570352910 shutdown_connections 2024-09-13T18:42:21.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.604+0000 7f53afe00640 1 -- 172.21.15.192:0/3570352910 wait complete. 2024-09-13T18:42:21.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.606+0000 7f53afe00640 1 Processor -- start 2024-09-13T18:42:21.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.606+0000 7f53afe00640 1 -- start start 2024-09-13T18:42:21.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b006e990 0x7f53b01628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53b00b2d70 0x7f53b0156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b01615d0 con 0x7f53b01611f0 2024-09-13T18:42:21.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0161820 con 0x7f53b00b2d70 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53afe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b0161b00 con 0x7f53b006e990 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51756/0 (socket says 172.21.15.192:51756) 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 -- 172.21.15.192:0/1286054798 learned_addr learned my addr 172.21.15.192:0/1286054798 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53ae000640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53b00b2d70 0x7f53b0156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53aea00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b006e990 0x7f53b01628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 -- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b006e990 msgr2=0x7f53b01628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b006e990 0x7f53b01628c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 -- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53b00b2d70 msgr2=0x7f53b0156fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:21.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53b00b2d70 0x7f53b0156fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:21.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.607+0000 7f53af400640 1 -- 172.21.15.192:0/1286054798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80094d0 con 0x7f53b01611f0 2024-09-13T18:42:21.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53af400640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f53a802a290 tx=0x7f53a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8032440 con 0x7f53b01611f0 2024-09-13T18:42:21.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a8030b80 con 0x7f53b01611f0 2024-09-13T18:42:21.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a803b400 con 0x7f53b01611f0 2024-09-13T18:42:21.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b0161de0 con 0x7f53b01611f0 2024-09-13T18:42:21.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.608+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b01623a0 con 0x7f53b01611f0 2024-09-13T18:42:21.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.609+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b01625c0 con 0x7f53b01611f0 2024-09-13T18:42:21.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.610+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f53a8039040 con 0x7f53b01611f0 2024-09-13T18:42:21.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.611+0000 7f53a7400640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 0x7f539006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:21.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.611+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f53a80a9710 con 0x7f53b01611f0 2024-09-13T18:42:21.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.611+0000 7f53aea00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 0x7f539006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:21.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.612+0000 7f53aea00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 0x7f539006d110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f53a0003b80 tx=0x7f53a00098d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:21.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.615+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f53a8074d10 con 0x7f53b01611f0 2024-09-13T18:42:21.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:21.796+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f53b0161c40 con 0x7f53b01611f0 2024-09-13T18:42:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.598+0000 7f53a7400640 1 -- 172.21.15.192:0/1286054798 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v145) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53b0161c40 con 0x7f53b01611f0 2024-09-13T18:42:22.601 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 msgr2=0x7f539006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 0x7f539006d110 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f53a0003b80 tx=0x7f53a00098d0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 msgr2=0x7f53b0157520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f53a802a290 tx=0x7f53a80046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 shutdown_connections 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f539006ac50 0x7f539006d110 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f53b01611f0 0x7f53b0157520 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f53b00b2d70 0x7f53b0156fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 --2- 172.21.15.192:0/1286054798 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f53b006e990 0x7f53b01628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 >> 172.21.15.192:0/1286054798 conn(0x7f53b00736d0 msgr2=0x7f53b006bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:22.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 shutdown_connections 2024-09-13T18:42:22.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.601+0000 7f53afe00640 1 -- 172.21.15.192:0/1286054798 wait complete. 2024-09-13T18:42:22.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:42:22.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.777+0000 7f9421a00640 1 Processor -- start 2024-09-13T18:42:22.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.778+0000 7f9421a00640 1 -- start start 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 0x7f941c06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f941c06b3d0 0x7f941c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0b3730 con 0x7f941c06b3d0 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c06c5d0 con 0x7f941c15a9e0 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0b3920 con 0x7f941c06e990 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9413400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f941c06b3d0 0x7f941c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9413400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f941c06b3d0 0x7f941c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51760/0 (socket says 172.21.15.192:51760) 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9413400640 1 -- 172.21.15.192:0/2177928487 learned_addr learned my addr 172.21.15.192:0/2177928487 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:22.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f941be00640 1 --2- 172.21.15.192:0/2177928487 >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 0x7f941c06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.779+0000 7f9421000640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f9413400640 1 -- 172.21.15.192:0/2177928487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 msgr2=0x7f941c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f9413400640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f9413400640 1 -- 172.21.15.192:0/2177928487 >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 msgr2=0x7f941c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f9413400640 1 --2- 172.21.15.192:0/2177928487 >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 0x7f941c06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f9413400640 1 -- 172.21.15.192:0/2177928487 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0b3c00 con 0x7f941c06b3d0 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.780+0000 7f941be00640 1 --2- 172.21.15.192:0/2177928487 >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 0x7f941c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9413400640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c06b3d0 0x7f941c0cd8c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f941c06cc90 tx=0x7f940402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9139a4b079f24d07 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f941b400640 1 -- 172.21.15.192:0/2177928487 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404032440 con 0x7f941c06b3d0 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f941b400640 1 -- 172.21.15.192:0/2177928487 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94040325a0 con 0x7f941c06b3d0 2024-09-13T18:42:22.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f941b400640 1 -- 172.21.15.192:0/2177928487 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404032930 con 0x7f941c06b3d0 2024-09-13T18:42:22.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 -- 172.21.15.192:0/2177928487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c06b3d0 msgr2=0x7f941c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:22.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c06b3d0 0x7f941c0cd8c0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f941c06cc90 tx=0x7f940402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 -- 172.21.15.192:0/2177928487 shutdown_connections 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 --2- 172.21.15.192:0/2177928487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c06b3d0 0x7f941c0cd8c0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 --2- 172.21.15.192:0/2177928487 >> v2:172.21.15.194:3300/0 conn(0x7f941c15a9e0 0x7f941c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.781+0000 7f9421a00640 1 -- 172.21.15.192:0/2177928487 >> 172.21.15.192:0/2177928487 conn(0x7f941c0736d0 msgr2=0x7f941c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.782+0000 7f9421a00640 1 -- 172.21.15.192:0/2177928487 shutdown_connections 2024-09-13T18:42:22.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.782+0000 7f9421a00640 1 -- 172.21.15.192:0/2177928487 wait complete. 2024-09-13T18:42:22.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.783+0000 7f9421a00640 1 Processor -- start 2024-09-13T18:42:22.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.783+0000 7f9421a00640 1 -- start start 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f941c06b3d0 0x7f941c14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c1f0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c151410 con 0x7f941c15a9e0 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c1f1380 con 0x7f941c06b3d0 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c150800 con 0x7f941c06e990 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51772/0 (socket says 172.21.15.192:51772) 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f9421000640 1 -- 172.21.15.192:0/1869513947 learned_addr learned my addr 172.21.15.192:0/1869513947 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.784+0000 7f941be00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f941c06b3d0 0x7f941c14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9413400640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c1f0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 -- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 msgr2=0x7f941c1f0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:22.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c1f0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 -- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f941c06b3d0 msgr2=0x7f941c14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:22.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f941c06b3d0 0x7f941c14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:22.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 -- 172.21.15.192:0/1869513947 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040094d0 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421000640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f941400eed0 tx=0x7f941400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414010040 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9414014400 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414009ea0 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.785+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c150ae0 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.786+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c1510a0 con 0x7f941c15a9e0 2024-09-13T18:42:22.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.787+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c1515c0 con 0x7f941c15a9e0 2024-09-13T18:42:22.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.787+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f94140147b0 con 0x7f941c15a9e0 2024-09-13T18:42:22.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.788+0000 7f9418c00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 0x7f93f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:22.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.788+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9414089940 con 0x7f941c15a9e0 2024-09-13T18:42:22.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.788+0000 7f941be00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 0x7f93f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:22.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.789+0000 7f941be00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 0x7f93f806d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f941c15e180 tx=0x7f940c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:22.793+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f941c1515c0 con 0x7f941c15a9e0 2024-09-13T18:42:23.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.021+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f941c1515c0 con 0x7f941c15a9e0 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.022+0000 7f9418c00640 1 -- 172.21.15.192:0/1869513947 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f941c1515c0 con 0x7f941c15a9e0 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:42:23.027 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.028 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:42:23.029 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.031 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.032 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.033 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.035 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:42:23.036 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:42:23.037 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:42:23.038 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:23.039 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:23.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 msgr2=0x7f93f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 0x7f93f806d0c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f941c15e180 tx=0x7f940c008040 comp rx=0 tx=0).stop 2024-09-13T18:42:23.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 msgr2=0x7f941c0705f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f941400eed0 tx=0x7f941400b480 comp rx=0 tx=0).stop 2024-09-13T18:42:23.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 shutdown_connections 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f806ac00 0x7f93f806d0c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941c15a9e0 0x7f941c0705f0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941c06e990 0x7f941c1f0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 --2- 172.21.15.192:0/1869513947 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f941c06b3d0 0x7f941c14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 >> 172.21.15.192:0/1869513947 conn(0x7f941c0736d0 msgr2=0x7f941c155b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 shutdown_connections 2024-09-13T18:42:23.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.024+0000 7f9421a00640 1 -- 172.21.15.192:0/1869513947 wait complete. 2024-09-13T18:42:23.043 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:23.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.193+0000 7f7c75c00640 1 Processor -- start 2024-09-13T18:42:23.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.193+0000 7f7c75c00640 1 -- start start 2024-09-13T18:42:23.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.194+0000 7f7c75c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7c700afd80 0x7f7c700b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.194+0000 7f7c75c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c700adf50 con 0x7f7c70146610 2024-09-13T18:42:23.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.194+0000 7f7c75c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c700ae770 con 0x7f7c700b2780 2024-09-13T18:42:23.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.194+0000 7f7c75c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700cd920 con 0x7f7c700afd80 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7c70146610 0x7f7c700ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47712/0 (socket says 172.21.15.192:47712) 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6ea00640 1 -- 172.21.15.192:0/1784926342 learned_addr learned my addr 172.21.15.192:0/1784926342 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6f400640 1 --2- 172.21.15.192:0/1784926342 >> v2:172.21.15.192:3300/0 conn(0x7f7c700afd80 0x7f7c700b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6f400640 1 -- 172.21.15.192:0/1784926342 >> v1:172.21.15.194:6789/0 conn(0x7f7c700b2780 legacy=0x7f7c700ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6f400640 1 -- 172.21.15.192:0/1784926342 >> v1:172.21.15.192:6789/0 conn(0x7f7c70146610 legacy=0x7f7c700ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.195+0000 7f7c6f400640 1 -- 172.21.15.192:0/1784926342 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700cdb30 con 0x7f7c700afd80 2024-09-13T18:42:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.196+0000 7f7c6f400640 1 --2- 172.21.15.192:0/1784926342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c700b01f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7c700cda60 tx=0x7f7c6802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc7d28efc83c330 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.196+0000 7f7c6d600640 1 -- 172.21.15.192:0/1784926342 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68007740 con 0x7f7c700afd80 2024-09-13T18:42:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.196+0000 7f7c6d600640 1 -- 172.21.15.192:0/1784926342 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6802d050 con 0x7f7c700afd80 2024-09-13T18:42:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.196+0000 7f7c6d600640 1 -- 172.21.15.192:0/1784926342 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68007ac0 con 0x7f7c700afd80 2024-09-13T18:42:23.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 -- 172.21.15.192:0/1784926342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 msgr2=0x7f7c700b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 --2- 172.21.15.192:0/1784926342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c700b01f0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f7c700cda60 tx=0x7f7c6802a680 comp rx=0 tx=0).stop 2024-09-13T18:42:23.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 -- 172.21.15.192:0/1784926342 shutdown_connections 2024-09-13T18:42:23.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 --2- 172.21.15.192:0/1784926342 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c700b01f0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 -- 172.21.15.192:0/1784926342 >> 172.21.15.192:0/1784926342 conn(0x7f7c700ae960 msgr2=0x7f7c7006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:23.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 -- 172.21.15.192:0/1784926342 shutdown_connections 2024-09-13T18:42:23.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.197+0000 7f7c75c00640 1 -- 172.21.15.192:0/1784926342 wait complete. 2024-09-13T18:42:23.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.199+0000 7f7c75c00640 1 Processor -- start 2024-09-13T18:42:23.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.199+0000 7f7c75c00640 1 -- start start 2024-09-13T18:42:23.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 0x7f7c7013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c70146610 0x7f7c701f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c701598b0 con 0x7f7c700afd80 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70159b10 con 0x7f7c70146610 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c75c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70159df0 con 0x7f7c700b2780 2024-09-13T18:42:23.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51786/0 (socket says 172.21.15.192:51786) 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 -- 172.21.15.192:0/3022008216 learned_addr learned my addr 172.21.15.192:0/3022008216 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6f400640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c70146610 0x7f7c701f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6e000640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 0x7f7c7013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 -- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 msgr2=0x7f7c7013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 0x7f7c7013dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 -- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c70146610 msgr2=0x7f7c701f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c70146610 0x7f7c701f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6ea00640 1 -- 172.21.15.192:0/3022008216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c68009a70 con 0x7f7c700afd80 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.200+0000 7f7c6e000640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 0x7f7c7013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c6ea00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c4a0 tx=0x7f7c6000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60005ce0 con 0x7f7c700afd80 2024-09-13T18:42:23.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c60005e40 con 0x7f7c700afd80 2024-09-13T18:42:23.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7015a0d0 con 0x7f7c700afd80 2024-09-13T18:42:23.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c60007270 con 0x7f7c700afd80 2024-09-13T18:42:23.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.201+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7015a8d0 con 0x7f7c700afd80 2024-09-13T18:42:23.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.202+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7015aac0 con 0x7f7c700afd80 2024-09-13T18:42:23.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.203+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c60007490 con 0x7f7c700afd80 2024-09-13T18:42:23.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.204+0000 7f7c66a00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 0x7f7c5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.204+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7c600884f0 con 0x7f7c700afd80 2024-09-13T18:42:23.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.204+0000 7f7c6e000640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 0x7f7c5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.205+0000 7f7c6e000640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 0x7f7c5006d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c7015ef10 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.208+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c60053a30 con 0x7f7c700afd80 2024-09-13T18:42:23.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.379+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c701469f0 con 0x7f7c700afd80 2024-09-13T18:42:23.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.380+0000 7f7c66a00640 1 -- 172.21.15.192:0/3022008216 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v145) v1 ==== 74+0+12928 (secure 0 0 0) 0x7f7c60017090 con 0x7f7c700afd80 2024-09-13T18:42:23.385 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:23.385 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":145,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:22.594287+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":132,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 msgr2=0x7f7c5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 0x7f7c5006d0c0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f7c7015ef10 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 msgr2=0x7f7c70159370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f7c6000c4a0 tx=0x7f7c6000c960 comp rx=0 tx=0).stop 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 shutdown_connections 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c5006ac00 0x7f7c5006d0c0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c70146610 0x7f7c701f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c700b2780 0x7f7c7013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 --2- 172.21.15.192:0/3022008216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c700afd80 0x7f7c70159370 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 >> 172.21.15.192:0/3022008216 conn(0x7f7c700ae960 msgr2=0x7f7c700aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:23.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 shutdown_connections 2024-09-13T18:42:23.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.382+0000 7f7c75c00640 1 -- 172.21.15.192:0/3022008216 wait complete. 2024-09-13T18:42:23.402 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:23.402 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:23.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.554+0000 7f0ef4c00640 1 Processor -- start 2024-09-13T18:42:23.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.554+0000 7f0ef4c00640 1 -- start start 2024-09-13T18:42:23.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.555+0000 7f0ef4c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.555+0000 7f0ef4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.555+0000 7f0ef4c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ef00b2000 con 0x7f0ef00b3af0 2024-09-13T18:42:23.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.555+0000 7f0ef4c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ef006ca80 con 0x7f0ef01589f0 2024-09-13T18:42:23.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.555+0000 7f0ef4c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef015b970 con 0x7f0ef006c0b0 2024-09-13T18:42:23.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eee800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eede00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:43738/0 (socket says 172.21.15.192:43738) 2024-09-13T18:42:23.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eede00640 1 -- 172.21.15.192:0/3359670762 learned_addr learned my addr 172.21.15.192:0/3359670762 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:23.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eed400640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f0ef00b3af0 0x7f0ef015b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:60924/0 (socket says 172.21.15.192:60924) 2024-09-13T18:42:23.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eee800640 1 -- 172.21.15.192:0/3359670762 >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 msgr2=0x7f0ef00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:23.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eee800640 1 --2- 172.21.15.192:0/3359670762 >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eee800640 1 -- 172.21.15.192:0/3359670762 >> v1:172.21.15.194:6789/0 conn(0x7f0ef00b3af0 legacy=0x7f0ef015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eee800640 1 -- 172.21.15.192:0/3359670762 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef015bbd0 con 0x7f0ef006c0b0 2024-09-13T18:42:23.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.556+0000 7f0eede00640 1 --2- 172.21.15.192:0/3359670762 >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:23.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.557+0000 7f0eee800640 1 --2- 172.21.15.192:0/3359670762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef006c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=914f8a12b4a7c171 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0eeca00640 1 -- 172.21.15.192:0/3359670762 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007740 con 0x7f0ef006c0b0 2024-09-13T18:42:23.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0eeca00640 1 -- 172.21.15.192:0/3359670762 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee802d050 con 0x7f0ef006c0b0 2024-09-13T18:42:23.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0eeca00640 1 -- 172.21.15.192:0/3359670762 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007ac0 con 0x7f0ef006c0b0 2024-09-13T18:42:23.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 -- 172.21.15.192:0/3359670762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 msgr2=0x7f0ef006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/3359670762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef006c540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009d90 tx=0x7f0ee802a660 comp rx=0 tx=0).stop 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 -- 172.21.15.192:0/3359670762 shutdown_connections 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/3359670762 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef006c540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/3359670762 >> v2:172.21.15.194:3300/0 conn(0x7f0ef01589f0 0x7f0ef00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 -- 172.21.15.192:0/3359670762 >> 172.21.15.192:0/3359670762 conn(0x7f0ef00b08f0 msgr2=0x7f0ef00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 -- 172.21.15.192:0/3359670762 shutdown_connections 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.558+0000 7f0ef4c00640 1 -- 172.21.15.192:0/3359670762 wait complete. 2024-09-13T18:42:23.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.560+0000 7f0ef4c00640 1 Processor -- start 2024-09-13T18:42:23.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.560+0000 7f0ef4c00640 1 -- start start 2024-09-13T18:42:23.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef00702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 0x7f0ef014b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef014ba80 con 0x7f0ef01589f0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00709d0 con 0x7f0ef00b3af0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0ef4c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0070cb0 con 0x7f0ef006c0b0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0eee800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0eee800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51794/0 (socket says 172.21.15.192:51794) 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.561+0000 7f0eee800640 1 -- 172.21.15.192:0/694553838 learned_addr learned my addr 172.21.15.192:0/694553838 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eede00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef00702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eed400640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 0x7f0ef014b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 -- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 msgr2=0x7f0ef00702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef00702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 -- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 msgr2=0x7f0ef014b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 0x7f0ef014b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 -- 172.21.15.192:0/694553838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00094d0 con 0x7f0ef01589f0 2024-09-13T18:42:23.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eed400640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 0x7f0ef014b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:23.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0eee800640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009eb0 tx=0x7f0ee8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee803c830 con 0x7f0ef01589f0 2024-09-13T18:42:23.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ee803c990 con 0x7f0ef01589f0 2024-09-13T18:42:23.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.562+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee803cd00 con 0x7f0ef01589f0 2024-09-13T18:42:23.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.563+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee8009a70 con 0x7f0ef01589f0 2024-09-13T18:42:23.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.563+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef0071270 con 0x7f0ef01589f0 2024-09-13T18:42:23.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.564+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef006c540 con 0x7f0ef01589f0 2024-09-13T18:42:23.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.564+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0ee8031400 con 0x7f0ef01589f0 2024-09-13T18:42:23.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.565+0000 7f0ee6000640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 0x7f0ed006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:23.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.565+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ee80aab30 con 0x7f0ef01589f0 2024-09-13T18:42:23.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.565+0000 7f0eede00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 0x7f0ed006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:23.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.566+0000 7f0eede00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 0x7f0ed006d0f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006ca0 tx=0x7f0ee0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:23.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.569+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0ee8076050 con 0x7f0ef01589f0 2024-09-13T18:42:23.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.740+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ef00cb670 con 0x7f0ef01589f0 2024-09-13T18:42:23.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.740+0000 7f0ee6000640 1 -- 172.21.15.192:0/694553838 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v145) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0ee8040020 con 0x7f0ef01589f0 2024-09-13T18:42:23.743 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 msgr2=0x7f0ed006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 0x7f0ed006d0f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f0ee0006ca0 tx=0x7f0ee0009240 comp rx=0 tx=0).stop 2024-09-13T18:42:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 msgr2=0x7f0ef00af890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:23.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8009eb0 tx=0x7f0ee8004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 shutdown_connections 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0ed006ac30 0x7f0ed006d0f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ef01589f0 0x7f0ef00af890 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0ef00b3af0 0x7f0ef014b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 --2- 172.21.15.192:0/694553838 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0ef006c0b0 0x7f0ef00702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 >> 172.21.15.192:0/694553838 conn(0x7f0ef00b08f0 msgr2=0x7f0ef00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.742+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 shutdown_connections 2024-09-13T18:42:23.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.743+0000 7f0ef4c00640 1 -- 172.21.15.192:0/694553838 wait complete. 2024-09-13T18:42:23.761 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:42:23.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.911+0000 7f5f51200640 1 Processor -- start 2024-09-13T18:42:24.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.911+0000 7f5f51200640 1 -- start start 2024-09-13T18:42:24.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f51200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f4c15ad10 0x7f5f4c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f51200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f51200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f4c0b2100 con 0x7f5f4c06a3e0 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f51200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f4c150f10 con 0x7f5f4c15ad10 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f51200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c15a2c0 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f4be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f4b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5f4c15ad10 0x7f5f4c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f4be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:41338/0 (socket says 172.21.15.192:41338) 2024-09-13T18:42:24.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f42a00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f5f4c06a3e0 0x7f5f4c06b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:60940/0 (socket says 172.21.15.192:60940) 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.913+0000 7f5f4be00640 1 -- 172.21.15.192:0/2322628394 learned_addr learned my addr 172.21.15.192:0/2322628394 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.914+0000 7f5f4be00640 1 -- 172.21.15.192:0/2322628394 >> v2:172.21.15.194:3300/0 conn(0x7f5f4c15ad10 msgr2=0x7f5f4c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.914+0000 7f5f4be00640 1 --2- 172.21.15.192:0/2322628394 >> v2:172.21.15.194:3300/0 conn(0x7f5f4c15ad10 0x7f5f4c069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.914+0000 7f5f4be00640 1 -- 172.21.15.192:0/2322628394 >> v1:172.21.15.194:6789/0 conn(0x7f5f4c06a3e0 legacy=0x7f5f4c06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.914+0000 7f5f4be00640 1 -- 172.21.15.192:0/2322628394 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f4c06af20 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f4be00640 1 --2- 172.21.15.192:0/2322628394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e50 tx=0x7f5f4402a730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3012a378ef0ae096 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f4aa00640 1 -- 172.21.15.192:0/2322628394 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031600 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f4aa00640 1 -- 172.21.15.192:0/2322628394 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4402d050 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f4aa00640 1 -- 172.21.15.192:0/2322628394 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f44031980 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f51200640 1 -- 172.21.15.192:0/2322628394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 msgr2=0x7f5f4c0b2590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f51200640 1 --2- 172.21.15.192:0/2322628394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5f44009e50 tx=0x7f5f4402a730 comp rx=0 tx=0).stop 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.915+0000 7f5f51200640 1 -- 172.21.15.192:0/2322628394 shutdown_connections 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.916+0000 7f5f51200640 1 --2- 172.21.15.192:0/2322628394 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06bfe0 0x7f5f4c0b2590 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.916+0000 7f5f51200640 1 --2- 172.21.15.192:0/2322628394 >> v2:172.21.15.194:3300/0 conn(0x7f5f4c15ad10 0x7f5f4c069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.916+0000 7f5f51200640 1 -- 172.21.15.192:0/2322628394 >> 172.21.15.192:0/2322628394 conn(0x7f5f4c0b09f0 msgr2=0x7f5f4c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.916+0000 7f5f51200640 1 -- 172.21.15.192:0/2322628394 shutdown_connections 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.916+0000 7f5f51200640 1 -- 172.21.15.192:0/2322628394 wait complete. 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.917+0000 7f5f51200640 1 Processor -- start 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.917+0000 7f5f51200640 1 -- start start 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06a3e0 0x7f5f4c150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f4c15ad10 0x7f5f4c14d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c14f970 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c152d50 con 0x7f5f4c15ad10 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f51200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f4c14e8d0 con 0x7f5f4c06a3e0 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f42a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f42a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51798/0 (socket says 172.21.15.192:51798) 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.918+0000 7f5f42a00640 1 -- 172.21.15.192:0/3122592938 learned_addr learned my addr 172.21.15.192:0/3122592938 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f4b400640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06a3e0 0x7f5f4c150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f4be00640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f4c15ad10 0x7f5f4c14d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 -- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06a3e0 msgr2=0x7f5f4c150490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06a3e0 0x7f5f4c150490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 -- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f4c15ad10 msgr2=0x7f5f4c14d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f4c15ad10 0x7f5f4c14d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 -- 172.21.15.192:0/3122592938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f44009b30 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f42a00640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c4d0 tx=0x7f5f3400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34007480 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f340075e0 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.919+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f340049e0 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.920+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f4c14ebb0 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.920+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f4c14f170 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.921+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f4c0b2590 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.921+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5f34004b40 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.922+0000 7f5f43e00640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.922+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f34088090 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.922+0000 7f5f4b400640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.923+0000 7f5f4b400640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 0x7f5f2806d0c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009aa0 tx=0x7f5f3c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:23.926+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5f34053660 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.098+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5f4c0ae740 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.099+0000 7f5f43e00640 1 -- 172.21.15.192:0/3122592938 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v145) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5f34018060 con 0x7f5f4c06bfe0 2024-09-13T18:42:24.153 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:24.153 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:42:24.153 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:24.154 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:42:24.154 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:42:24.154 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:24.154 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:42:24.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 msgr2=0x7f5f2806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 0x7f5f2806d0c0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c009aa0 tx=0x7f5f3c009190 comp rx=0 tx=0).stop 2024-09-13T18:42:24.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 msgr2=0x7f5f4c14ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f3400c4d0 tx=0x7f5f3400c990 comp rx=0 tx=0).stop 2024-09-13T18:42:24.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 shutdown_connections 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5f2806ac00 0x7f5f2806d0c0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5f4c15ad10 0x7f5f4c14d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5f4c06bfe0 0x7f5f4c14ddc0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 --2- 172.21.15.192:0/3122592938 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5f4c06a3e0 0x7f5f4c150490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 >> 172.21.15.192:0/3122592938 conn(0x7f5f4c0b09f0 msgr2=0x7f5f4c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 shutdown_connections 2024-09-13T18:42:24.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.101+0000 7f5f51200640 1 -- 172.21.15.192:0/3122592938 wait complete. 2024-09-13T18:42:24.156 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:42:24.157 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:42:24.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.324+0000 7fedf3200640 1 Processor -- start 2024-09-13T18:42:24.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.325+0000 7fedf3200640 1 -- start start 2024-09-13T18:42:24.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 0x7fedf413e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fedf40cc9c0 0x7fedf40cce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf3200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf413ec60 con 0x7fedf415e880 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedf415f760 con 0x7fedf40cc9c0 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf40ce970 con 0x7fedf413e2e0 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf1e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fedf415e880 0x7fedf415ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47716/0 (socket says 172.21.15.192:47716) 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf1e00640 1 -- 172.21.15.192:0/2389924452 learned_addr learned my addr 172.21.15.192:0/2389924452 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fede9400640 1 --2- 172.21.15.192:0/2389924452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 0x7fedf413e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf2800640 1 --2- 172.21.15.192:0/2389924452 >> v2:172.21.15.194:3300/0 conn(0x7fedf40cc9c0 0x7fedf40cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.326+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695489459 0 0) 0x7fedf413ec60 con 0x7fedf415e880 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedd8003520 con 0x7fedf415e880 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fede9400640 1 -- 172.21.15.192:0/2389924452 >> v2:172.21.15.194:3300/0 conn(0x7fedf40cc9c0 msgr2=0x7fedf40cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fede9400640 1 --2- 172.21.15.192:0/2389924452 >> v2:172.21.15.194:3300/0 conn(0x7fedf40cc9c0 0x7fedf40cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fede9400640 1 -- 172.21.15.192:0/2389924452 >> v1:172.21.15.192:6789/0 conn(0x7fedf415e880 legacy=0x7fedf415ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 965873055 0 0) 0x7fedd8003520 con 0x7fedf415e880 2024-09-13T18:42:24.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.327+0000 7fede9400640 1 -- 172.21.15.192:0/2389924452 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf413eef0 con 0x7fedf413e2e0 2024-09-13T18:42:24.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.328+0000 7fede9400640 1 --2- 172.21.15.192:0/2389924452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 0x7fedf413e720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feddc0097a0 tx=0x7feddc02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=139eaff85feb5d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.328+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede4001670 con 0x7fedf413e2e0 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.328+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc02aba0 con 0x7fedf413e2e0 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.328+0000 7fedf1400640 1 -- 172.21.15.192:0/2389924452 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc032440 con 0x7fedf413e2e0 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 -- 172.21.15.192:0/2389924452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 msgr2=0x7fedf413e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 --2- 172.21.15.192:0/2389924452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 0x7fedf413e720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feddc0097a0 tx=0x7feddc02a110 comp rx=0 tx=0).stop 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 -- 172.21.15.192:0/2389924452 shutdown_connections 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 --2- 172.21.15.192:0/2389924452 >> v2:172.21.15.194:3300/0 conn(0x7fedf40cc9c0 0x7fedf40cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 --2- 172.21.15.192:0/2389924452 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf413e2e0 0x7fedf413e720 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 -- 172.21.15.192:0/2389924452 >> 172.21.15.192:0/2389924452 conn(0x7fedf4073490 msgr2=0x7fedf40b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 -- 172.21.15.192:0/2389924452 shutdown_connections 2024-09-13T18:42:24.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.329+0000 7fedf3200640 1 -- 172.21.15.192:0/2389924452 wait complete. 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.331+0000 7fedf3200640 1 Processor -- start 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.331+0000 7fedf3200640 1 -- start start 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.331+0000 7fedf3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40cc9c0 0x7fedf4153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.331+0000 7fedf3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.331+0000 7fedf3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf415e880 0x7fedf4141810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fedf3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf413da60 con 0x7fedf413e2e0 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fedf3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41421f0 con 0x7fedf40cc9c0 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fedf3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf41424d0 con 0x7fedf415e880 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51808/0 (socket says 172.21.15.192:51808) 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 -- 172.21.15.192:0/3286521106 learned_addr learned my addr 172.21.15.192:0/3286521106 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fedf1e00640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40cc9c0 0x7fedf4153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fedf2800640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf415e880 0x7fedf4141810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 -- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf415e880 msgr2=0x7fedf4141810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf415e880 0x7fedf4141810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 -- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40cc9c0 msgr2=0x7fedf4153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40cc9c0 0x7fedf4153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.332+0000 7fede9400640 1 -- 172.21.15.192:0/3286521106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc009400 con 0x7fedf413e2e0 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fede9400640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feddc035040 tx=0x7feddc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc03d830 con 0x7fedf413e2e0 2024-09-13T18:42:24.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feddc03d990 con 0x7fedf413e2e0 2024-09-13T18:42:24.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc03dd20 con 0x7fedf413e2e0 2024-09-13T18:42:24.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4152fa0 con 0x7fedf413e2e0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.333+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf4153560 con 0x7fedf413e2e0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.334+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf4067b10 con 0x7fedf413e2e0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.335+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feddc039040 con 0x7fedf413e2e0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.336+0000 7fedeaa00640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 0x7fedd006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.336+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feddc0a9860 con 0x7fedf413e2e0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.336+0000 7fedf1e00640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 0x7fedd006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:24.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.337+0000 7fedf1e00640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 0x7fedd006d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fede40011e0 tx=0x7fede40016d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:24.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.340+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feddc074e30 con 0x7fedf413e2e0 2024-09-13T18:42:24.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:24.507+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fedf415d570 con 0x7fedf413e2e0 2024-09-13T18:42:25.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.288+0000 7fedeaa00640 1 -- 172.21.15.192:0/3286521106 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v146) v1 ==== 138+0+0 (secure 0 0 0) 0x7feddc006e10 con 0x7fedf413e2e0 2024-09-13T18:42:25.291 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:42:25.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 msgr2=0x7fedd006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 0x7fedd006d0c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fede40011e0 tx=0x7fede40016d0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 msgr2=0x7fedf413d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7feddc035040 tx=0x7feddc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 shutdown_connections 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fedd006ac00 0x7fedd006d0c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fedf415e880 0x7fedf4141810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf413e2e0 0x7fedf413d520 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 --2- 172.21.15.192:0/3286521106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fedf40cc9c0 0x7fedf4153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.291+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 >> 172.21.15.192:0/3286521106 conn(0x7fedf4073490 msgr2=0x7fedf415ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.292+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 shutdown_connections 2024-09-13T18:42:25.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.292+0000 7fedf3200640 1 -- 172.21.15.192:0/3286521106 wait complete. 2024-09-13T18:42:25.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:42:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.469+0000 7f3b85400640 1 Processor -- start 2024-09-13T18:42:25.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.469+0000 7f3b85400640 1 -- start start 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b85400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b8006c800 0x7f3b800b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b85400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b8006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b85400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006cc70 con 0x7f3b801434c0 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b85400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b800b4060 con 0x7f3b8006c800 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b85400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800ce770 con 0x7f3b800b3bd0 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b7e800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3b801434c0 0x7f3b8006a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47718/0 (socket says 172.21.15.192:47718) 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b7e800640 1 -- 172.21.15.192:0/722903935 learned_addr learned my addr 172.21.15.192:0/722903935 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.470+0000 7f3b7de00640 1 --2- 172.21.15.192:0/722903935 >> v2:172.21.15.192:3300/0 conn(0x7f3b8006c800 0x7f3b800b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7f200640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b8006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7d400640 1 -- 172.21.15.192:0/722903935 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461110128 0 0) 0x7f3b8006cc70 con 0x7f3b801434c0 2024-09-13T18:42:25.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7d400640 1 -- 172.21.15.192:0/722903935 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b64005730 con 0x7f3b801434c0 2024-09-13T18:42:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7de00640 1 -- 172.21.15.192:0/722903935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 msgr2=0x7f3b8006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7de00640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b8006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7de00640 1 -- 172.21.15.192:0/722903935 >> v1:172.21.15.192:6789/0 conn(0x7f3b801434c0 legacy=0x7f3b8006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.471+0000 7f3b7de00640 1 -- 172.21.15.192:0/722903935 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b8006b480 con 0x7f3b8006c800 2024-09-13T18:42:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.472+0000 7f3b7de00640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8006c800 0x7f3b800b3690 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0097d0 tx=0x7f3b6c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b50f1c5b150840 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.472+0000 7f3b7d400640 1 -- 172.21.15.192:0/722903935 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c032440 con 0x7f3b8006c800 2024-09-13T18:42:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.472+0000 7f3b7d400640 1 -- 172.21.15.192:0/722903935 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0325a0 con 0x7f3b8006c800 2024-09-13T18:42:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.472+0000 7f3b7d400640 1 -- 172.21.15.192:0/722903935 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c032930 con 0x7f3b8006c800 2024-09-13T18:42:25.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 -- 172.21.15.192:0/722903935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8006c800 msgr2=0x7f3b800b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8006c800 0x7f3b800b3690 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c0097d0 tx=0x7f3b6c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 -- 172.21.15.192:0/722903935 shutdown_connections 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b8006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 --2- 172.21.15.192:0/722903935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b8006c800 0x7f3b800b3690 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 -- 172.21.15.192:0/722903935 >> 172.21.15.192:0/722903935 conn(0x7f3b800b08f0 msgr2=0x7f3b800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 -- 172.21.15.192:0/722903935 shutdown_connections 2024-09-13T18:42:25.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.473+0000 7f3b85400640 1 -- 172.21.15.192:0/722903935 wait complete. 2024-09-13T18:42:25.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.474+0000 7f3b85400640 1 Processor -- start 2024-09-13T18:42:25.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 -- start start 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b8006c800 0x7f3b8013fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b800706a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80071720 con 0x7f3b801434c0 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b80071440 con 0x7f3b8006c800 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.475+0000 7f3b85400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8013d5d0 con 0x7f3b800b3bd0 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51832/0 (socket says 172.21.15.192:51832) 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 -- 172.21.15.192:0/3028110462 learned_addr learned my addr 172.21.15.192:0/3028110462 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:25.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7e800640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b8006c800 0x7f3b8013fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7de00640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b800706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 -- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 msgr2=0x7f3b800706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b800706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 -- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b8006c800 msgr2=0x7f3b8013fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b8006c800 0x7f3b8013fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.476+0000 7f3b7f200640 1 -- 172.21.15.192:0/3028110462 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c009400 con 0x7f3b801434c0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b7f200640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007e40 tx=0x7f3b7800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78014620 con 0x7f3b801434c0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7800ee90 con 0x7f3b801434c0 2024-09-13T18:42:25.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780149e0 con 0x7f3b801434c0 2024-09-13T18:42:25.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8013d8b0 con 0x7f3b801434c0 2024-09-13T18:42:25.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.477+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b80139fb0 con 0x7f3b801434c0 2024-09-13T18:42:25.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.478+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8013ddd0 con 0x7f3b801434c0 2024-09-13T18:42:25.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.479+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b78014b40 con 0x7f3b801434c0 2024-09-13T18:42:25.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.480+0000 7f3b76a00640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 0x7f3b6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:25.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.480+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3b7808a6f0 con 0x7f3b801434c0 2024-09-13T18:42:25.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.480+0000 7f3b7e800640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 0x7f3b6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:25.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.481+0000 7f3b7e800640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 0x7f3b6006d0c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3b700011e0 tx=0x7f3b70007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:25.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.483+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b78055bd0 con 0x7f3b801434c0 2024-09-13T18:42:25.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:25.652+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3b8013ddd0 con 0x7f3b801434c0 2024-09-13T18:42:26.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.293+0000 7f3b76a00640 1 -- 172.21.15.192:0/3028110462 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v147) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3b8013ddd0 con 0x7f3b801434c0 2024-09-13T18:42:26.297 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:42:26.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 msgr2=0x7f3b6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 0x7f3b6006d0c0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f3b700011e0 tx=0x7f3b70007d30 comp rx=0 tx=0).stop 2024-09-13T18:42:26.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 msgr2=0x7f3b80070be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007e40 tx=0x7f3b7800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 shutdown_connections 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b6006ac00 0x7f3b6006d0c0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b801434c0 0x7f3b80070be0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b800b3bd0 0x7f3b800706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 --2- 172.21.15.192:0/3028110462 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b8006c800 0x7f3b8013fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 >> 172.21.15.192:0/3028110462 conn(0x7f3b800b08f0 msgr2=0x7f3b80069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 shutdown_connections 2024-09-13T18:42:26.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.299+0000 7f3b85400640 1 -- 172.21.15.192:0/3028110462 wait complete. 2024-09-13T18:42:26.321 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:42:26.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.473+0000 7f871d400640 1 Processor -- start 2024-09-13T18:42:26.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.473+0000 7f871d400640 1 -- start start 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f871d400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f87181589f0 0x7f87180b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f871d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87180b3af0 0x7f871815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f871d400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87180b2000 con 0x7f871806c0b0 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f871d400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871815bbd0 con 0x7f87180b3af0 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f871d400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f871815beb0 con 0x7f87181589f0 2024-09-13T18:42:26.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f870de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87180b3af0 0x7f871815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f870de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f87180b3af0 0x7f871815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51846/0 (socket says 172.21.15.192:51846) 2024-09-13T18:42:26.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.474+0000 7f870de00640 1 -- 172.21.15.192:0/672490850 learned_addr learned my addr 172.21.15.192:0/672490850 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:26.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.475+0000 7f8716800640 1 --2- 172.21.15.192:0/672490850 >> v2:172.21.15.194:3300/0 conn(0x7f87181589f0 0x7f87180b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.475+0000 7f870de00640 1 -- 172.21.15.192:0/672490850 >> v2:172.21.15.194:3300/0 conn(0x7f87181589f0 msgr2=0x7f87180b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:26.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.475+0000 7f870de00640 1 --2- 172.21.15.192:0/672490850 >> v2:172.21.15.194:3300/0 conn(0x7f87181589f0 0x7f87180b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.475+0000 7f870de00640 1 -- 172.21.15.192:0/672490850 >> v1:172.21.15.194:6789/0 conn(0x7f871806c0b0 legacy=0x7f87180cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:26.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.475+0000 7f870de00640 1 -- 172.21.15.192:0/672490850 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f871815c190 con 0x7f87180b3af0 2024-09-13T18:42:26.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.476+0000 7f870de00640 1 --2- 172.21.15.192:0/672490850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87180b3af0 0x7f871815b260 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f871806e230 tx=0x7f870002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1dabed7b9000a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.476+0000 7f8715e00640 1 -- 172.21.15.192:0/672490850 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700032440 con 0x7f87180b3af0 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.476+0000 7f8715e00640 1 -- 172.21.15.192:0/672490850 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87000325a0 con 0x7f87180b3af0 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.476+0000 7f8715e00640 1 -- 172.21.15.192:0/672490850 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8700032930 con 0x7f87180b3af0 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 -- 172.21.15.192:0/672490850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87180b3af0 msgr2=0x7f871815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 --2- 172.21.15.192:0/672490850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87180b3af0 0x7f871815b260 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f871806e230 tx=0x7f870002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 -- 172.21.15.192:0/672490850 shutdown_connections 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 --2- 172.21.15.192:0/672490850 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87180b3af0 0x7f871815b260 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 --2- 172.21.15.192:0/672490850 >> v2:172.21.15.194:3300/0 conn(0x7f87181589f0 0x7f87180b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 -- 172.21.15.192:0/672490850 >> 172.21.15.192:0/672490850 conn(0x7f87180b08f0 msgr2=0x7f87180b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:26.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 -- 172.21.15.192:0/672490850 shutdown_connections 2024-09-13T18:42:26.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.477+0000 7f871d400640 1 -- 172.21.15.192:0/672490850 wait complete. 2024-09-13T18:42:26.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.478+0000 7f871d400640 1 Processor -- start 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 -- start start 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871806c0b0 0x7f8718150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87180b3af0 0x7f87181f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87181f1720 con 0x7f87181589f0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f871814f870 con 0x7f87180b3af0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.479+0000 7f871d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f871814fb50 con 0x7f871806c0b0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51862/0 (socket says 172.21.15.192:51862) 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 -- 172.21.15.192:0/2172800569 learned_addr learned my addr 172.21.15.192:0/2172800569 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f870de00640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87180b3af0 0x7f87181f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8716800640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871806c0b0 0x7f8718150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 -- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871806c0b0 msgr2=0x7f8718150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871806c0b0 0x7f8718150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 -- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87180b3af0 msgr2=0x7f87181f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87180b3af0 0x7f87181f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 -- 172.21.15.192:0/2172800569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87000094d0 con 0x7f87181589f0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.480+0000 7f8717200640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f871000c7a0 tx=0x7f871000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.481+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710003b70 con 0x7f87181589f0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.481+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710003cf0 con 0x7f87181589f0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.481+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710003ea0 con 0x7f87181589f0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.481+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f871814fe30 con 0x7f87181589f0 2024-09-13T18:42:26.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.481+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87181503f0 con 0x7f87181589f0 2024-09-13T18:42:26.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.482+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871815b260 con 0x7f87181589f0 2024-09-13T18:42:26.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.483+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f871000aa90 con 0x7f87181589f0 2024-09-13T18:42:26.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.484+0000 7f870f400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 0x7f86f406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.484+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8710088ff0 con 0x7f87181589f0 2024-09-13T18:42:26.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.484+0000 7f8716800640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 0x7f86f406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.485+0000 7f8716800640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 0x7f86f406d0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f87080079a0 tx=0x7f8708008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.489+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f87100542a0 con 0x7f87181589f0 2024-09-13T18:42:26.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.692+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8718071c40 con 0x7f87181589f0 2024-09-13T18:42:26.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.701+0000 7f870f400640 1 -- 172.21.15.192:0/2172800569 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v59) v1 ==== 174+0+0 (secure 0 0 0) 0x7f87100578c0 con 0x7f87181589f0 2024-09-13T18:42:26.705 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 16 and data pool 17 2024-09-13T18:42:26.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.706+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 msgr2=0x7f86f406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.706+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 0x7f86f406d0f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f87080079a0 tx=0x7f8708008040 comp rx=0 tx=0).stop 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.706+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 msgr2=0x7f8718070c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.706+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f871000c7a0 tx=0x7f871000cc60 comp rx=0 tx=0).stop 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 shutdown_connections 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86f406ac30 0x7f86f406d0f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f87181589f0 0x7f8718070c40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f87180b3af0 0x7f87181f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 --2- 172.21.15.192:0/2172800569 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f871806c0b0 0x7f8718150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 >> 172.21.15.192:0/2172800569 conn(0x7f87180b08f0 msgr2=0x7f8718159af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 shutdown_connections 2024-09-13T18:42:26.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.707+0000 7f871d400640 1 -- 172.21.15.192:0/2172800569 wait complete. 2024-09-13T18:42:26.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:26.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.885+0000 7f414da00640 1 Processor -- start 2024-09-13T18:42:26.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.885+0000 7f414da00640 1 -- start start 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.886+0000 7f414da00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f41480cacd0 0x7f414815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.886+0000 7f414da00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4148140480 con 0x7f41480cb0b0 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.886+0000 7f414da00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41480cb520 con 0x7f414815bc20 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.886+0000 7f414da00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414815ee90 con 0x7f41480cacd0 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f413e000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f41480cb0b0 0x7f4148140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47726/0 (socket says 172.21.15.192:47726) 2024-09-13T18:42:26.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f413e000640 1 -- 172.21.15.192:0/3546338956 learned_addr learned my addr 172.21.15.192:0/3546338956 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:26.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146a00640 1 --2- 172.21.15.192:0/3546338956 >> v2:172.21.15.194:3300/0 conn(0x7f41480cacd0 0x7f414815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315244877 0 0) 0x7f4148140480 con 0x7f41480cb0b0 2024-09-13T18:42:26.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f412c003520 con 0x7f41480cb0b0 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3379190298 0 0) 0x7f412c003520 con 0x7f41480cb0b0 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 >> v2:172.21.15.194:3300/0 conn(0x7f41480cacd0 msgr2=0x7f414815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 --2- 172.21.15.192:0/3546338956 >> v2:172.21.15.194:3300/0 conn(0x7f41480cacd0 0x7f414815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 >> v1:172.21.15.194:6789/0 conn(0x7f414815bc20 legacy=0x7f41480afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414815f170 con 0x7f41480cb0b0 2024-09-13T18:42:26.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f4130001670 con 0x7f41480cb0b0 2024-09-13T18:42:26.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.887+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 >> v1:172.21.15.192:6789/0 conn(0x7f41480cb0b0 legacy=0x7f4148140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f412c003970 0x7f412c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f412c0047c0 0x7f412c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f412c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414815ee90 con 0x7f412c005180 2024-09-13T18:42:26.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412c00c020 con 0x7f412c003970 2024-09-13T18:42:26.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412c00c1e0 con 0x7f412c0047c0 2024-09-13T18:42:26.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f412c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4146a00640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f412c003970 0x7f412c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f413e000640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f412c0047c0 0x7f412c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 -- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f412c0047c0 msgr2=0x7f412c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:26.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f412c0047c0 0x7f412c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 -- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f412c003970 msgr2=0x7f412c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f412c003970 0x7f412c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.888+0000 7f4147400640 1 -- 172.21.15.192:0/3546338956 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f412c003520 con 0x7f412c005180 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.889+0000 7f4147400640 1 -- 172.21.15.192:0/3546338956 reap_dead start 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.889+0000 7f4147400640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f412c00b980 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4140001e50 tx=0x7f412c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671a84fddfb9dbc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.889+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414002ae70 con 0x7f412c005180 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.889+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4140003970 con 0x7f412c005180 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.889+0000 7f4146000640 1 -- 172.21.15.192:0/3546338956 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140003d40 con 0x7f412c005180 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 -- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 msgr2=0x7f412c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f412c00b980 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4140001e50 tx=0x7f412c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 -- 172.21.15.192:0/3546338956 shutdown_connections 2024-09-13T18:42:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 --2- 172.21.15.192:0/3546338956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f412c00b980 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 -- 172.21.15.192:0/3546338956 >> 172.21.15.192:0/3546338956 conn(0x7f41480ae960 msgr2=0x7f414806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 -- 172.21.15.192:0/3546338956 shutdown_connections 2024-09-13T18:42:26.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.890+0000 7f414da00640 1 -- 172.21.15.192:0/3546338956 wait complete. 2024-09-13T18:42:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.892+0000 7f414da00640 1 Processor -- start 2024-09-13T18:42:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.892+0000 7f414da00640 1 -- start start 2024-09-13T18:42:26.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 0x7f414806b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41481e4fc0 0x7f41481e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414806b8b0 con 0x7f412c005180 2024-09-13T18:42:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41481e68c0 con 0x7f414806aef0 2024-09-13T18:42:26.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f414da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41481e5cb0 con 0x7f41481e4fc0 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51882/0 (socket says 172.21.15.192:51882) 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 -- 172.21.15.192:0/2128157458 learned_addr learned my addr 172.21.15.192:0/2128157458 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f413e000640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 0x7f414806b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 -- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41481e4fc0 msgr2=0x7f41481e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4147400640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41481e4fc0 0x7f41481e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41481e4fc0 0x7f41481e5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 -- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 msgr2=0x7f414806b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 0x7f414806b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:26.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f4146a00640 1 -- 172.21.15.192:0/2128157458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41481e5f90 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.893+0000 7f413e000640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 0x7f414806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f4146a00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f41380118e0 tx=0x7f4138011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800fa90 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413800fbf0 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41481e6270 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138014440 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.894+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41481e5980 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.895+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4148140980 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.896+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f41380145a0 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.897+0000 7f413f400640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 0x7f412406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.897+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4138089c30 con 0x7f412c005180 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.897+0000 7f413e000640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 0x7f412406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:26.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.898+0000 7f413e000640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 0x7f412406d0f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4130001200 tx=0x7f4130000f70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:26.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:26.902+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4138054d70 con 0x7f412c005180 2024-09-13T18:42:27.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.074+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f414806c6c0 con 0x7f412c005180 2024-09-13T18:42:27.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.075+0000 7f413f400640 1 -- 172.21.15.192:0/2128157458 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f4138058390 con 0x7f412c005180 2024-09-13T18:42:27.078 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:27.079 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":148,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:26.694184+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 msgr2=0x7f412406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 0x7f412406d0f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f4130001200 tx=0x7f4130000f70 comp rx=0 tx=0).stop 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 msgr2=0x7f414813d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f41380118e0 tx=0x7f4138011da0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 shutdown_connections 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f412406ac30 0x7f412406d0f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f41481e4fc0 0x7f41481e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f414806aef0 0x7f414806b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 --2- 172.21.15.192:0/2128157458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f412c005180 0x7f414813d3c0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 >> 172.21.15.192:0/2128157458 conn(0x7f41480ae960 msgr2=0x7f414815d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 shutdown_connections 2024-09-13T18:42:27.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.078+0000 7f414da00640 1 -- 172.21.15.192:0/2128157458 wait complete. 2024-09-13T18:42:27.098 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:27.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.246+0000 7f10ac400640 1 Processor -- start 2024-09-13T18:42:27.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.246+0000 7f10ac400640 1 -- start start 2024-09-13T18:42:27.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10ac400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f10a40b3f10 0x7f10a415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10ac400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40b2f00 con 0x7f10a40b0490 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10ac400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a40b3150 con 0x7f10a415dee0 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10ac400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a40b3430 con 0x7f10a40b3f10 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10aa400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f10a40b0490 0x7f10a415a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47730/0 (socket says 172.21.15.192:47730) 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10aa400640 1 -- 172.21.15.192:0/2956736093 learned_addr learned my addr 172.21.15.192:0/2956736093 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.248+0000 7f10a9000640 1 --2- 172.21.15.192:0/2956736093 >> v2:172.21.15.194:3300/0 conn(0x7f10a40b3f10 0x7f10a415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.249+0000 7f10a9000640 1 -- 172.21.15.192:0/2956736093 >> v1:172.21.15.194:6789/0 conn(0x7f10a415dee0 legacy=0x7f10a40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.249+0000 7f10a9000640 1 -- 172.21.15.192:0/2956736093 >> v1:172.21.15.192:6789/0 conn(0x7f10a40b0490 legacy=0x7f10a415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.249+0000 7f10a3e00640 1 -- 172.21.15.192:0/2956736093 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054037335 0 0) 0x7f10a40b2f00 con 0x7f10a40b0490 2024-09-13T18:42:27.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.249+0000 7f10a9000640 1 -- 172.21.15.192:0/2956736093 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a40b3710 con 0x7f10a40b3f10 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.250+0000 7f10a9000640 1 --2- 172.21.15.192:0/2956736093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a40b3f10 0x7f10a415a440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f10900097a0 tx=0x7f109002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f97af52c0a8e5b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.250+0000 7f10a3e00640 1 -- 172.21.15.192:0/2956736093 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090032440 con 0x7f10a40b3f10 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.250+0000 7f10a3e00640 1 -- 172.21.15.192:0/2956736093 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10900325a0 con 0x7f10a40b3f10 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.250+0000 7f10a3e00640 1 -- 172.21.15.192:0/2956736093 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090032930 con 0x7f10a40b3f10 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 -- 172.21.15.192:0/2956736093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a40b3f10 msgr2=0x7f10a415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 --2- 172.21.15.192:0/2956736093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a40b3f10 0x7f10a415a440 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f10900097a0 tx=0x7f109002a230 comp rx=0 tx=0).stop 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 -- 172.21.15.192:0/2956736093 shutdown_connections 2024-09-13T18:42:27.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 --2- 172.21.15.192:0/2956736093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a40b3f10 0x7f10a415a440 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 -- 172.21.15.192:0/2956736093 >> 172.21.15.192:0/2956736093 conn(0x7f10a40ae960 msgr2=0x7f10a406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:27.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 -- 172.21.15.192:0/2956736093 shutdown_connections 2024-09-13T18:42:27.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.251+0000 7f10ac400640 1 -- 172.21.15.192:0/2956736093 wait complete. 2024-09-13T18:42:27.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.252+0000 7f10ac400640 1 Processor -- start 2024-09-13T18:42:27.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.252+0000 7f10ac400640 1 -- start start 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10a40b0490 0x7f10a4154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a413d110 0x7f10a4156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4157690 con 0x7f10a415dee0 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4154c70 con 0x7f10a413d110 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.253+0000 7f10ac400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a4156d60 con 0x7f10a40b0490 2024-09-13T18:42:27.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51888/0 (socket says 172.21.15.192:51888) 2024-09-13T18:42:27.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 -- 172.21.15.192:0/1328163279 learned_addr learned my addr 172.21.15.192:0/1328163279 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10aa400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a413d110 0x7f10a4156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9a00640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10a40b0490 0x7f10a4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 -- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10a40b0490 msgr2=0x7f10a4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10a40b0490 0x7f10a4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 -- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a413d110 msgr2=0x7f10a4156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a413d110 0x7f10a4156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 -- 172.21.15.192:0/1328163279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1090009400 con 0x7f10a415dee0 2024-09-13T18:42:27.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.254+0000 7f10a9000640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1090000c00 tx=0x7f10900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.255+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090004230 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.255+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1090004390 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.255+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a4136a10 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.255+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1090030ac0 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.255+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41572b0 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.256+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a41577d0 con 0x7f10a415dee0 2024-09-13T18:42:27.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.257+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1090039050 con 0x7f10a415dee0 2024-09-13T18:42:27.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.258+0000 7f10a1600640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 0x7f108406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.258+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10900a9c40 con 0x7f10a415dee0 2024-09-13T18:42:27.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.258+0000 7f10a9a00640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 0x7f108406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.259+0000 7f10a9a00640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 0x7f108406d0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f10a4071480 tx=0x7f1098009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.262+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f10a41577d0 con 0x7f10a415dee0 2024-09-13T18:42:27.286 INFO:tasks.ceph.mds.c.smithi192.stderr:2024-09-13T18:42:27.282+0000 7f9853000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:42:27.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.434+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10a41577d0 con 0x7f10a415dee0 2024-09-13T18:42:27.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.435+0000 7f10a1600640 1 -- 172.21.15.192:0/1328163279 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v148) v1 ==== 74+0+16657 (secure 0 0 0) 0x7f10a41577d0 con 0x7f10a415dee0 2024-09-13T18:42:27.439 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:27.439 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":148,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:26.694184+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:27.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 msgr2=0x7f108406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 0x7f108406d0c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f10a4071480 tx=0x7f1098009040 comp rx=0 tx=0).stop 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 msgr2=0x7f10a4135ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f1090000c00 tx=0x7f10900046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 shutdown_connections 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f108406ac00 0x7f108406d0c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f10a413d110 0x7f10a4156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f10a415dee0 0x7f10a4135ea0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 --2- 172.21.15.192:0/1328163279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f10a40b0490 0x7f10a4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.437+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 >> 172.21.15.192:0/1328163279 conn(0x7f10a40ae960 msgr2=0x7f10a415b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:27.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.438+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 shutdown_connections 2024-09-13T18:42:27.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.438+0000 7f10ac400640 1 -- 172.21.15.192:0/1328163279 wait complete. 2024-09-13T18:42:27.456 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:42:27.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.608+0000 7f2cb9800640 1 Processor -- start 2024-09-13T18:42:27.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.608+0000 7f2cb9800640 1 -- start start 2024-09-13T18:42:27.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.609+0000 7f2cb9800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2cb41589f0 0x7f2cb40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.609+0000 7f2cb9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.609+0000 7f2cb9800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb40b2000 con 0x7f2cb406c0b0 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.609+0000 7f2cb9800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb415bbd0 con 0x7f2cb41589f0 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.609+0000 7f2cb9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb415beb0 con 0x7f2cb40b3af0 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2cb406c0b0 0x7f2cb40cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47734/0 (socket says 172.21.15.192:47734) 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb3400640 1 -- 172.21.15.192:0/2951650346 learned_addr learned my addr 172.21.15.192:0/2951650346 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/2951650346 >> v2:172.21.15.194:3300/0 conn(0x7f2cb41589f0 0x7f2cb40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2000640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb1600640 1 -- 172.21.15.192:0/2951650346 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796821961 0 0) 0x7f2cb40b2000 con 0x7f2cb406c0b0 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb1600640 1 -- 172.21.15.192:0/2951650346 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c98003520 con 0x7f2cb406c0b0 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2a00640 1 -- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 msgr2=0x7f2cb415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2a00640 1 -- 172.21.15.192:0/2951650346 >> v1:172.21.15.192:6789/0 conn(0x7f2cb406c0b0 legacy=0x7f2cb40cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2a00640 1 -- 172.21.15.192:0/2951650346 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb415c190 con 0x7f2cb41589f0 2024-09-13T18:42:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.610+0000 7f2cb2000640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:27.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.611+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40b2490 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40097a0 tx=0x7f2ca402a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151025a7d9f031d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.612+0000 7f2cb1600640 1 -- 172.21.15.192:0/2951650346 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4032440 con 0x7f2cb41589f0 2024-09-13T18:42:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.612+0000 7f2cb1600640 1 -- 172.21.15.192:0/2951650346 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca40325a0 con 0x7f2cb41589f0 2024-09-13T18:42:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.612+0000 7f2cb1600640 1 -- 172.21.15.192:0/2951650346 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4032930 con 0x7f2cb41589f0 2024-09-13T18:42:27.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 -- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 msgr2=0x7f2cb40b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40b2490 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2ca40097a0 tx=0x7f2ca402a180 comp rx=0 tx=0).stop 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 -- 172.21.15.192:0/2951650346 shutdown_connections 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb415b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 --2- 172.21.15.192:0/2951650346 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40b2490 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 -- 172.21.15.192:0/2951650346 >> 172.21.15.192:0/2951650346 conn(0x7f2cb40b08f0 msgr2=0x7f2cb40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 -- 172.21.15.192:0/2951650346 shutdown_connections 2024-09-13T18:42:27.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.613+0000 7f2cb9800640 1 -- 172.21.15.192:0/2951650346 wait complete. 2024-09-13T18:42:27.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.614+0000 7f2cb9800640 1 Processor -- start 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.614+0000 7f2cb9800640 1 -- start start 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb40adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4157970 con 0x7f2cb406c0b0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40714b0 con 0x7f2cb41589f0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.615+0000 7f2cb9800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb414b910 con 0x7f2cb40b3af0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb40adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51902/0 (socket says 172.21.15.192:51902) 2024-09-13T18:42:27.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 -- 172.21.15.192:0/3070032621 learned_addr learned my addr 172.21.15.192:0/3070032621 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 -- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 msgr2=0x7f2cb40adaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb40adaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 -- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 msgr2=0x7f2cb40afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 -- 172.21.15.192:0/3070032621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009400 con 0x7f2cb406c0b0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.616+0000 7f2cb2a00640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4035040 tx=0x7f2ca40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.617+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403d8f0 con 0x7f2cb406c0b0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.617+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca403da70 con 0x7f2cb406c0b0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.617+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca403de20 con 0x7f2cb406c0b0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.617+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca4009400 con 0x7f2cb406c0b0 2024-09-13T18:42:27.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.617+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4157040 con 0x7f2cb406c0b0 2024-09-13T18:42:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.618+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb415b260 con 0x7f2cb406c0b0 2024-09-13T18:42:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.619+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ca4039040 con 0x7f2cb406c0b0 2024-09-13T18:42:27.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.619+0000 7f2caaa00640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 0x7f2c9406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.620+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca40a9ae0 con 0x7f2cb406c0b0 2024-09-13T18:42:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.620+0000 7f2cb2000640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 0x7f2c9406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:27.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.620+0000 7f2cb2000640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 0x7f2c9406d0f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2cb41f5db0 tx=0x7f2ca0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:27.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.624+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2ca4074f20 con 0x7f2cb406c0b0 2024-09-13T18:42:27.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:27.828+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2cb40cc0b0 con 0x7f2cb406c0b0 2024-09-13T18:42:28.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.709+0000 7f2caaa00640 1 -- 172.21.15.192:0/3070032621 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v61) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2ca4078540 con 0x7f2cb406c0b0 2024-09-13T18:42:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 msgr2=0x7f2c9406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 0x7f2c9406d0f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2cb41f5db0 tx=0x7f2ca0009190 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 msgr2=0x7f2cb414b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4035040 tx=0x7f2ca40046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 shutdown_connections 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2c9406ac30 0x7f2c9406d0f0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cb41589f0 0x7f2cb40afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cb40b3af0 0x7f2cb40adaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 --2- 172.21.15.192:0/3070032621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cb406c0b0 0x7f2cb414b3d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 >> 172.21.15.192:0/3070032621 conn(0x7f2cb40b08f0 msgr2=0x7f2cb415aab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 shutdown_connections 2024-09-13T18:42:28.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.712+0000 7f2cb9800640 1 -- 172.21.15.192:0/3070032621 wait complete. 2024-09-13T18:42:28.733 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:42:28.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:42:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.889+0000 7f1891400640 1 Processor -- start 2024-09-13T18:42:28.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.889+0000 7f1891400640 1 -- start start 2024-09-13T18:42:28.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1891400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f188c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1891400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c15a8e0 con 0x7f188c0cb330 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1891400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188c0b2fe0 con 0x7f188c0cdf60 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1891400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0b26b0 con 0x7f188c0b3470 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f188a800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f188c0cb330 0x7f188c06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47744/0 (socket says 172.21.15.192:47744) 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f188a800640 1 -- 172.21.15.192:0/1451518987 learned_addr learned my addr 172.21.15.192:0/1451518987 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f188b200640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f188c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107892507 0 0) 0x7f188c15a8e0 con 0x7f188c0cb330 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.891+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1870003440 con 0x7f188c0cb330 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 464293105 0 0) 0x7f1870003440 con 0x7f188c0cb330 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 msgr2=0x7f188c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f188c0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 >> v1:172.21.15.194:6789/0 conn(0x7f188c0cdf60 legacy=0x7f188c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0b2990 con 0x7f188c0cb330 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f187c001670 con 0x7f188c0cb330 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 >> v1:172.21.15.192:6789/0 conn(0x7f188c0cb330 legacy=0x7f188c06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1870003a90 0x7f1870003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f187000acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f187000d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c0b26b0 con 0x7f1870008850 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1870004630 con 0x7f1870003a90 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18700047f0 con 0x7f188c0b3470 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f1889e00640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f187000acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f188a800640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1870003a90 0x7f1870003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.892+0000 7f188b200640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f187000d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 -- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 msgr2=0x7f187000d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f187000d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 -- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1870003a90 msgr2=0x7f1870003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1870003a90 0x7f1870003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 -- 172.21.15.192:0/1451518987 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1870003440 con 0x7f1870008850 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f188b200640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c0b3470 0x7f187000d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:28.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.893+0000 7f1889e00640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f187000acc0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1878001860 tx=0x7f18700036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb87e99b41d7ed98 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187802abd0 con 0x7f1870008850 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187802ad50 con 0x7f1870008850 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1889400640 1 -- 172.21.15.192:0/1451518987 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1878032680 con 0x7f1870008850 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 -- 172.21.15.192:0/1451518987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 msgr2=0x7f187000acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 --2- 172.21.15.192:0/1451518987 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f187000acc0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f1878001860 tx=0x7f18700036f0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f188b200640 1 -- 172.21.15.192:0/1451518987 reap_dead start 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 -- 172.21.15.192:0/1451518987 shutdown_connections 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 -- 172.21.15.192:0/1451518987 >> 172.21.15.192:0/1451518987 conn(0x7f188c0b08f0 msgr2=0x7f188c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 -- 172.21.15.192:0/1451518987 shutdown_connections 2024-09-13T18:42:28.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.894+0000 7f1891400640 1 -- 172.21.15.192:0/1451518987 wait complete. 2024-09-13T18:42:28.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.896+0000 7f1891400640 1 Processor -- start 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.896+0000 7f1891400640 1 -- start start 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c1504e0 0x7f188c150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c14f710 0x7f188c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c157540 con 0x7f1870008850 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188c155090 con 0x7f188c14f710 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f1891400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f188c06fed0 con 0x7f188c1504e0 2024-09-13T18:42:28.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f188a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f188a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51908/0 (socket says 172.21.15.192:51908) 2024-09-13T18:42:28.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.897+0000 7f188a800640 1 -- 172.21.15.192:0/2862880464 learned_addr learned my addr 172.21.15.192:0/2862880464 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:28.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1889e00640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c1504e0 0x7f188c150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188b200640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c14f710 0x7f188c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 -- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c1504e0 msgr2=0x7f188c150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c1504e0 0x7f188c150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 -- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c14f710 msgr2=0x7f188c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c14f710 0x7f188c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 -- 172.21.15.192:0/2862880464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188c0701b0 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f188a800640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f187c0017a0 tx=0x7f187c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c007770 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187c00f7b0 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f188c070490 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187c00fb60 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.898+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f188c06fbc0 con 0x7f1870008850 2024-09-13T18:42:28.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.899+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f188c155200 con 0x7f1870008850 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.900+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f187c00fcc0 con 0x7f1870008850 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.901+0000 7f1882a00640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 0x7f186c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.901+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f187c0893f0 con 0x7f1870008850 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.901+0000 7f1889e00640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 0x7f186c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.902+0000 7f1889e00640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 0x7f186c06d0f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f1878009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:28.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:28.905+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f188c155200 con 0x7f1870008850 2024-09-13T18:42:29.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.108+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f188c155200 con 0x7f1870008850 2024-09-13T18:42:29.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.719+0000 7f1882a00640 1 -- 172.21.15.192:0/2862880464 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v62) v1 ==== 122+0+0 (secure 0 0 0) 0x7f188c155200 con 0x7f1870008850 2024-09-13T18:42:29.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 msgr2=0x7f186c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 0x7f186c06d0f0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f1878009030 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 msgr2=0x7f188c06f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f187c0017a0 tx=0x7f187c007430 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 shutdown_connections 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f186c06ac30 0x7f186c06d0f0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f188c14f710 0x7f188c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f188c1504e0 0x7f188c150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 --2- 172.21.15.192:0/2862880464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1870008850 0x7f188c06f680 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.722+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 >> 172.21.15.192:0/2862880464 conn(0x7f188c0b08f0 msgr2=0x7f188c1531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.723+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 shutdown_connections 2024-09-13T18:42:29.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.723+0000 7f1891400640 1 -- 172.21.15.192:0/2862880464 wait complete. 2024-09-13T18:42:29.745 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:42:29.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:29.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.905+0000 7fcbfae00640 1 Processor -- start 2024-09-13T18:42:29.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.906+0000 7fcbfae00640 1 -- start start 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbfae00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcbf40b3480 0x7fcbf4159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbfae00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf415af60 con 0x7fcbf4159b00 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbfae00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf406b7a0 con 0x7fcbf406bc30 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbfae00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf415ac80 con 0x7fcbf40b3480 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbf9a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcbf4159b00 0x7fcbf40b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47750/0 (socket says 172.21.15.192:47750) 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbf9a00640 1 -- 172.21.15.192:0/3742193334 learned_addr learned my addr 172.21.15.192:0/3742193334 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbf9000640 1 --2- 172.21.15.192:0/3742193334 >> v2:172.21.15.194:3300/0 conn(0x7fcbf40b3480 0x7fcbf4159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3155800110 0 0) 0x7fcbf415af60 con 0x7fcbf4159b00 2024-09-13T18:42:29.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.907+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbdc005730 con 0x7fcbf4159b00 2024-09-13T18:42:29.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4157225889 0 0) 0x7fcbdc005730 con 0x7fcbf4159b00 2024-09-13T18:42:29.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 >> v2:172.21.15.194:3300/0 conn(0x7fcbf40b3480 msgr2=0x7fcbf4159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:29.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 --2- 172.21.15.192:0/3742193334 >> v2:172.21.15.194:3300/0 conn(0x7fcbf40b3480 0x7fcbf4159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 >> v1:172.21.15.194:6789/0 conn(0x7fcbf406bc30 legacy=0x7fcbf415a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf406b150 con 0x7fcbf4159b00 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fcbe8001670 con 0x7fcbf4159b00 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 >> v1:172.21.15.192:6789/0 conn(0x7fcbf4159b00 legacy=0x7fcbf40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 0x7fcbdc005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc0069d0 0x7fcbdc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbdc007390 0x7fcbdc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf415ac80 con 0x7fcbdc005b80 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00e330 con 0x7fcbdc007390 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc00e4f0 con 0x7fcbdc0069d0 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 0x7fcbdc005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbf9000640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc0069d0 0x7fcbdc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.908+0000 7fcbfa400640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbdc007390 0x7fcbdc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbf9a00640 1 -- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc0069d0 msgr2=0x7fcbdc006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc0069d0 0x7fcbdc006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbf9a00640 1 -- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbdc007390 msgr2=0x7fcbdc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbdc007390 0x7fcbdc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbf9a00640 1 -- 172.21.15.192:0/3742193334 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc005730 con 0x7fcbdc005b80 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbfa400640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbdc007390 0x7fcbdc00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:29.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.909+0000 7fcbfa400640 1 -- 172.21.15.192:0/3742193334 reap_dead start 2024-09-13T18:42:29.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 0x7fcbdc005fa0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c240 tx=0x7fcbdc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad95244a7eb15c47 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:29.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe802e070 con 0x7fcbdc005b80 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe80058d0 con 0x7fcbdc005b80 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbf3e00640 1 -- 172.21.15.192:0/3742193334 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8005d00 con 0x7fcbdc005b80 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 -- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 msgr2=0x7fcbdc005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 0x7fcbdc005fa0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800c240 tx=0x7fcbdc007a00 comp rx=0 tx=0).stop 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 -- 172.21.15.192:0/3742193334 shutdown_connections 2024-09-13T18:42:29.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 --2- 172.21.15.192:0/3742193334 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbdc005b80 0x7fcbdc005fa0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 -- 172.21.15.192:0/3742193334 >> 172.21.15.192:0/3742193334 conn(0x7fcbf40736d0 msgr2=0x7fcbf40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 -- 172.21.15.192:0/3742193334 shutdown_connections 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.910+0000 7fcbfae00640 1 -- 172.21.15.192:0/3742193334 wait complete. 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.912+0000 7fcbfae00640 1 Processor -- start 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.912+0000 7fcbfae00640 1 -- start start 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc005b80 0x7fcbf40b00b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 0x7fcbf40cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41e3760 con 0x7fcbf4155870 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41e3a40 con 0x7fcbf41e6a50 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.913+0000 7fcbfae00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf41e3d20 con 0x7fcbdc005b80 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51930/0 (socket says 172.21.15.192:51930) 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 -- 172.21.15.192:0/1784031281 learned_addr learned my addr 172.21.15.192:0/1784031281 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc005b80 0x7fcbf40b00b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbfa400640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 0x7fcbf40cbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 -- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc005b80 msgr2=0x7fcbf40b00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc005b80 0x7fcbf40b00b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 -- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 msgr2=0x7fcbf40cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 0x7fcbf40cbe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 -- 172.21.15.192:0/1784031281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf41e4000 con 0x7fcbf4155870 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbfa400640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 0x7fcbf40cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.914+0000 7fcbf9000640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0011890 tx=0x7fcbe0011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.915+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe0004240 con 0x7fcbf4155870 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.915+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe00043a0 con 0x7fcbf4155870 2024-09-13T18:42:29.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.915+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe000fa20 con 0x7fcbf4155870 2024-09-13T18:42:29.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.915+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf41e42e0 con 0x7fcbf4155870 2024-09-13T18:42:29.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.915+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf41e3380 con 0x7fcbf4155870 2024-09-13T18:42:29.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.916+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf41e4470 con 0x7fcbf4155870 2024-09-13T18:42:29.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.917+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcbe000fb80 con 0x7fcbf4155870 2024-09-13T18:42:29.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.918+0000 7fcbf1600640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 0x7fcbd406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:29.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.918+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbe0089970 con 0x7fcbf4155870 2024-09-13T18:42:29.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.918+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 0x7fcbd406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:29.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.919+0000 7fcbf9a00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 0x7fcbd406d0c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8033000 tx=0x7fcbe802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:29.925 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:29.922+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcbe0054b60 con 0x7fcbf4155870 2024-09-13T18:42:30.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.125+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbf4159ee0 con 0x7fcbf4155870 2024-09-13T18:42:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.125+0000 7fcbf1600640 1 -- 172.21.15.192:0/1784031281 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fcbe0023090 con 0x7fcbf4155870 2024-09-13T18:42:30.128 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:30.128 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:42:30.128 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:42:30.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 msgr2=0x7fcbd406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 0x7fcbd406d0c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8033000 tx=0x7fcbe802e000 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 msgr2=0x7fcbf4154bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0011890 tx=0x7fcbe0011d50 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 shutdown_connections 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcbd406ac00 0x7fcbd406d0c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcbf41e6a50 0x7fcbf40cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcbf4155870 0x7fcbf4154bb0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 --2- 172.21.15.192:0/1784031281 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcbdc005b80 0x7fcbf40b00b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 >> 172.21.15.192:0/1784031281 conn(0x7fcbf40736d0 msgr2=0x7fcbf40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 shutdown_connections 2024-09-13T18:42:30.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.127+0000 7fcbfae00640 1 -- 172.21.15.192:0/1784031281 wait complete. 2024-09-13T18:42:30.146 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:30.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.294+0000 7fdded200640 1 Processor -- start 2024-09-13T18:42:30.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.295+0000 7fdded200640 1 -- start start 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdded200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 0x7fdde80cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdded200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdde815bc20 0x7fdde80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdded200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdde815ec00 con 0x7fdde80cacd0 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdded200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde80cb5f0 con 0x7fdde815bc20 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdded200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdde8140480 con 0x7fdde815e790 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdde815bc20 0x7fdde80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdde815bc20 0x7fdde80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51940/0 (socket says 172.21.15.192:51940) 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 -- 172.21.15.192:0/532536314 learned_addr learned my addr 172.21.15.192:0/532536314 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde5400640 1 --2- 172.21.15.192:0/532536314 >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 0x7fdde80cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 -- 172.21.15.192:0/532536314 >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 msgr2=0x7fdde80cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 --2- 172.21.15.192:0/532536314 >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 0x7fdde80cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 -- 172.21.15.192:0/532536314 >> v1:172.21.15.194:6789/0 conn(0x7fdde80cacd0 legacy=0x7fdde8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.296+0000 7fdde6800640 1 -- 172.21.15.192:0/532536314 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde815ee90 con 0x7fdde815bc20 2024-09-13T18:42:30.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.297+0000 7fdde5400640 1 --2- 172.21.15.192:0/532536314 >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 0x7fdde80cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:30.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.297+0000 7fdde6800640 1 --2- 172.21.15.192:0/532536314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde80afd80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fdde80ce9e0 tx=0x7fdde002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9a6f32ff8f04a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdde4a00640 1 -- 172.21.15.192:0/532536314 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0031600 con 0x7fdde815bc20 2024-09-13T18:42:30.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdde4a00640 1 -- 172.21.15.192:0/532536314 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde002d050 con 0x7fdde815bc20 2024-09-13T18:42:30.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdde4a00640 1 -- 172.21.15.192:0/532536314 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0031980 con 0x7fdde815bc20 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 -- 172.21.15.192:0/532536314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 msgr2=0x7fdde80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 --2- 172.21.15.192:0/532536314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde80afd80 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fdde80ce9e0 tx=0x7fdde002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 -- 172.21.15.192:0/532536314 shutdown_connections 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 --2- 172.21.15.192:0/532536314 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde80afd80 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 --2- 172.21.15.192:0/532536314 >> v2:172.21.15.194:3300/0 conn(0x7fdde815e790 0x7fdde80cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 -- 172.21.15.192:0/532536314 >> 172.21.15.192:0/532536314 conn(0x7fdde80ae960 msgr2=0x7fdde806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 -- 172.21.15.192:0/532536314 shutdown_connections 2024-09-13T18:42:30.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.298+0000 7fdded200640 1 -- 172.21.15.192:0/532536314 wait complete. 2024-09-13T18:42:30.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.300+0000 7fdded200640 1 Processor -- start 2024-09-13T18:42:30.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.300+0000 7fdded200640 1 -- start start 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde80cacd0 0x7fdde806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde815e790 0x7fdde813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8157c50 con 0x7fdde815bc20 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdde8155b70 con 0x7fdde815e790 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdded200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdde806c130 con 0x7fdde80cacd0 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdde5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdde5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:51944/0 (socket says 172.21.15.192:51944) 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.301+0000 7fdde5400640 1 -- 172.21.15.192:0/2225940596 learned_addr learned my addr 172.21.15.192:0/2225940596 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde6800640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde815e790 0x7fdde813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5e00640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde80cacd0 0x7fdde806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 -- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde80cacd0 msgr2=0x7fdde806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde80cacd0 0x7fdde806bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 -- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde815e790 msgr2=0x7fdde813f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde815e790 0x7fdde813f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 -- 172.21.15.192:0/2225940596 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde0009b30 con 0x7fdde815bc20 2024-09-13T18:42:30.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fdde5400640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e7e0 tx=0x7fddd400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.302+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4004030 con 0x7fdde815bc20 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.303+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd4004190 con 0x7fdde815bc20 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.303+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd4004520 con 0x7fdde815bc20 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.303+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde8156fd0 con 0x7fdde815bc20 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.303+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdde8157870 con 0x7fdde815bc20 2024-09-13T18:42:30.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.304+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdde80677f0 con 0x7fdde815bc20 2024-09-13T18:42:30.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.305+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fddd400c6d0 con 0x7fdde815bc20 2024-09-13T18:42:30.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.305+0000 7fddde000640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 0x7fddc806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.306+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddd4088ff0 con 0x7fdde815bc20 2024-09-13T18:42:30.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.306+0000 7fdde5e00640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 0x7fddc806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.306+0000 7fdde5e00640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 0x7fddc806d0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006fd0 tx=0x7fddd8009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.309+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fddd4054220 con 0x7fdde815bc20 2024-09-13T18:42:30.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.476+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdde80cb0b0 con 0x7fdde815bc20 2024-09-13T18:42:30.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.478+0000 7fddde000640 1 -- 172.21.15.192:0/2225940596 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+16644 (secure 0 0 0) 0x7fddd4057840 con 0x7fdde815bc20 2024-09-13T18:42:30.481 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:30.481 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":149,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:27.697337+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"149","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 msgr2=0x7fddc806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 0x7fddc806d0c0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fddd8006fd0 tx=0x7fddd8009060 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 msgr2=0x7fdde81566a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fddd400e7e0 tx=0x7fddd400eca0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 shutdown_connections 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fddc806ac00 0x7fddc806d0c0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdde815e790 0x7fdde813f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdde815bc20 0x7fdde81566a0 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 --2- 172.21.15.192:0/2225940596 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdde80cacd0 0x7fdde806bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 >> 172.21.15.192:0/2225940596 conn(0x7fdde80ae960 msgr2=0x7fdde815cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:30.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 shutdown_connections 2024-09-13T18:42:30.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.480+0000 7fdded200640 1 -- 172.21.15.192:0/2225940596 wait complete. 2024-09-13T18:42:30.499 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:42:30.499 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:42:30.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.651+0000 7f490d600640 1 Processor -- start 2024-09-13T18:42:30.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.651+0000 7f490d600640 1 -- start start 2024-09-13T18:42:30.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908150480 0x7f490815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4908071810 0x7f49080b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49080b2230 0x7f49080cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908071dd0 con 0x7f49080b2230 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49080cb770 con 0x7f4908071810 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f490d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49080cba50 con 0x7f4908150480 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f4907400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49080b2230 0x7f49080cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f4907400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f49080b2230 0x7f49080cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55598/0 (socket says 172.21.15.192:55598) 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.652+0000 7f4907400640 1 -- 172.21.15.192:0/1573561790 learned_addr learned my addr 172.21.15.192:0/1573561790 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:30.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4906a00640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908150480 0x7f490815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4906000640 1 --2- 172.21.15.192:0/1573561790 >> v2:172.21.15.194:3300/0 conn(0x7f4908071810 0x7f49080b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4907400640 1 -- 172.21.15.192:0/1573561790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908150480 msgr2=0x7f490815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4907400640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908150480 0x7f490815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4907400640 1 -- 172.21.15.192:0/1573561790 >> v2:172.21.15.194:3300/0 conn(0x7f4908071810 msgr2=0x7f49080b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4907400640 1 --2- 172.21.15.192:0/1573561790 >> v2:172.21.15.194:3300/0 conn(0x7f4908071810 0x7f49080b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.653+0000 7f4907400640 1 -- 172.21.15.192:0/1573561790 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080cbd30 con 0x7f49080b2230 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.654+0000 7f4907400640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49080b2230 0x7f49080cc530 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f490806ccf0 tx=0x7f490002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692ef9a97159a8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.654+0000 7f4905600640 1 -- 172.21.15.192:0/1573561790 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900031600 con 0x7f49080b2230 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.654+0000 7f4905600640 1 -- 172.21.15.192:0/1573561790 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490002d050 con 0x7f49080b2230 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.654+0000 7f4905600640 1 -- 172.21.15.192:0/1573561790 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900031980 con 0x7f49080b2230 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 -- 172.21.15.192:0/1573561790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49080b2230 msgr2=0x7f49080cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49080b2230 0x7f49080cc530 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f490806ccf0 tx=0x7f490002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 -- 172.21.15.192:0/1573561790 shutdown_connections 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f49080b2230 0x7f49080cc530 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 --2- 172.21.15.192:0/1573561790 >> v2:172.21.15.194:3300/0 conn(0x7f4908071810 0x7f49080b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 --2- 172.21.15.192:0/1573561790 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908150480 0x7f490815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 -- 172.21.15.192:0/1573561790 >> 172.21.15.192:0/1573561790 conn(0x7f49080ae960 msgr2=0x7f490806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 -- 172.21.15.192:0/1573561790 shutdown_connections 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.655+0000 7f490d600640 1 -- 172.21.15.192:0/1573561790 wait complete. 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.656+0000 7f490d600640 1 Processor -- start 2024-09-13T18:42:30.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 -- start start 2024-09-13T18:42:30.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 0x7f490806b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49080b2230 0x7f4908154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 0x7f4908154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4908154fd0 con 0x7f4908150480 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f490813bfd0 con 0x7f49080b2230 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.657+0000 7f490d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490806b700 con 0x7f4908071810 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4906a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 0x7f490806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 0x7f4908154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4906a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 0x7f490806b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37110/0 (socket says 172.21.15.192:37110) 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4906a00640 1 -- 172.21.15.192:0/2179877740 learned_addr learned my addr 172.21.15.192:0/2179877740 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4906000640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49080b2230 0x7f4908154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 -- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 msgr2=0x7f490806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 0x7f490806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 -- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49080b2230 msgr2=0x7f4908154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49080b2230 0x7f4908154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 -- 172.21.15.192:0/2179877740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4900009b30 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.658+0000 7f4907400640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 0x7f4908154590 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4900030000 tx=0x7f4900004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.659+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4900031ea0 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.659+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f490003d860 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.659+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f490806b9e0 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.659+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f490003dc10 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.659+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f490806bfa0 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.660+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f490813c140 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.661+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f490003b400 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.662+0000 7f48fea00640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 0x7f48e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.662+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f49000a9f80 con 0x7f4908150480 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.662+0000 7f4906a00640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 0x7f48e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:30.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.663+0000 7f4906a00640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 0x7f48e806d0c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f48f800ac60 tx=0x7f48f800a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:30.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.666+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f49000dd9c0 con 0x7f4908150480 2024-09-13T18:42:30.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.831+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4908150860 con 0x7f48e806ac00 2024-09-13T18:42:30.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.838+0000 7f48fea00640 1 -- 172.21.15.192:0/2179877740 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285221 (secure 0 0 0) 0x7f48f800ac90 con 0x7f48e806ac00 2024-09-13T18:42:30.844 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:30.846 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:42:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.841+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 msgr2=0x7f48e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.841+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 0x7f48e806d0c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f48f800ac60 tx=0x7f48f800a2a0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.841+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 msgr2=0x7f4908154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.841+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 0x7f4908154590 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f4900030000 tx=0x7f4900004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 shutdown_connections 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f48e806ac00 0x7f48e806d0c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4908150480 0x7f4908154590 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49080b2230 0x7f4908154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 --2- 172.21.15.192:0/2179877740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4908071810 0x7f490806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 >> 172.21.15.192:0/2179877740 conn(0x7f49080ae960 msgr2=0x7f4908070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:30.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 shutdown_connections 2024-09-13T18:42:30.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:30.842+0000 7f490d600640 1 -- 172.21.15.192:0/2179877740 wait complete. 2024-09-13T18:42:30.861 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-13T18:42:30.823355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554860,"statfs":{"total":1600000000,"available":1592177528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.537066"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008571+0000","last_change":"2024-09-13T18:42:26.720020+0000","last_active":"2024-09-13T18:42:28.008571+0000","last_peered":"2024-09-13T18:42:28.008571+0000","last_clean":"2024-09-13T18:42:28.008571+0000","last_became_active":"2024-09-13T18:42:26.719465+0000","last_became_peered":"2024-09-13T18:42:26.719465+0000","last_unstale":"2024-09-13T18:42:28.008571+0000","last_undegraded":"2024-09-13T18:42:28.008571+0000","last_fullsized":"2024-09-13T18:42:28.008571+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:40.703721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705820+0000","last_change":"2024-09-13T18:42:26.706423+0000","last_active":"2024-09-13T18:42:27.705820+0000","last_peered":"2024-09-13T18:42:27.705820+0000","last_clean":"2024-09-13T18:42:27.705820+0000","last_became_active":"2024-09-13T18:42:26.704463+0000","last_became_peered":"2024-09-13T18:42:26.704463+0000","last_unstale":"2024-09-13T18:42:27.705820+0000","last_undegraded":"2024-09-13T18:42:27.705820+0000","last_fullsized":"2024-09-13T18:42:27.705820+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:30.789964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706572+0000","last_change":"2024-09-13T18:42:26.702146+0000","last_active":"2024-09-13T18:42:27.706572+0000","last_peered":"2024-09-13T18:42:27.706572+0000","last_clean":"2024-09-13T18:42:27.706572+0000","last_became_active":"2024-09-13T18:42:26.701895+0000","last_became_peered":"2024-09-13T18:42:26.701895+0000","last_unstale":"2024-09-13T18:42:27.706572+0000","last_undegraded":"2024-09-13T18:42:27.706572+0000","last_fullsized":"2024-09-13T18:42:27.706572+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:04.217007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709212+0000","last_change":"2024-09-13T18:42:26.713945+0000","last_active":"2024-09-13T18:42:27.709212+0000","last_peered":"2024-09-13T18:42:27.709212+0000","last_clean":"2024-09-13T18:42:27.709212+0000","last_became_active":"2024-09-13T18:42:26.713402+0000","last_became_peered":"2024-09-13T18:42:26.713402+0000","last_unstale":"2024-09-13T18:42:27.709212+0000","last_undegraded":"2024-09-13T18:42:27.709212+0000","last_fullsized":"2024-09-13T18:42:27.709212+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:52.457008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008155+0000","last_change":"2024-09-13T18:42:26.715513+0000","last_active":"2024-09-13T18:42:28.008155+0000","last_peered":"2024-09-13T18:42:28.008155+0000","last_clean":"2024-09-13T18:42:28.008155+0000","last_became_active":"2024-09-13T18:42:26.715273+0000","last_became_peered":"2024-09-13T18:42:26.715273+0000","last_unstale":"2024-09-13T18:42:28.008155+0000","last_undegraded":"2024-09-13T18:42:28.008155+0000","last_fullsized":"2024-09-13T18:42:28.008155+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:56.683988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007481+0000","last_change":"2024-09-13T18:42:26.712722+0000","last_active":"2024-09-13T18:42:28.007481+0000","last_peered":"2024-09-13T18:42:28.007481+0000","last_clean":"2024-09-13T18:42:28.007481+0000","last_became_active":"2024-09-13T18:42:26.712471+0000","last_became_peered":"2024-09-13T18:42:26.712471+0000","last_unstale":"2024-09-13T18:42:28.007481+0000","last_undegraded":"2024-09-13T18:42:28.007481+0000","last_fullsized":"2024-09-13T18:42:28.007481+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:48.428534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007159+0000","last_change":"2024-09-13T18:42:26.711762+0000","last_active":"2024-09-13T18:42:28.007159+0000","last_peered":"2024-09-13T18:42:28.007159+0000","last_clean":"2024-09-13T18:42:28.007159+0000","last_became_active":"2024-09-13T18:42:26.709953+0000","last_became_peered":"2024-09-13T18:42:26.709953+0000","last_unstale":"2024-09-13T18:42:28.007159+0000","last_undegraded":"2024-09-13T18:42:28.007159+0000","last_fullsized":"2024-09-13T18:42:28.007159+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:54.322814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006835+0000","last_change":"2024-09-13T18:42:26.718246+0000","last_active":"2024-09-13T18:42:28.006835+0000","last_peered":"2024-09-13T18:42:28.006835+0000","last_clean":"2024-09-13T18:42:28.006835+0000","last_became_active":"2024-09-13T18:42:26.717824+0000","last_became_peered":"2024-09-13T18:42:26.717824+0000","last_unstale":"2024-09-13T18:42:28.006835+0000","last_undegraded":"2024-09-13T18:42:28.006835+0000","last_fullsized":"2024-09-13T18:42:28.006835+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:39.759953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007281+0000","last_change":"2024-09-13T18:42:26.721785+0000","last_active":"2024-09-13T18:42:28.007281+0000","last_peered":"2024-09-13T18:42:28.007281+0000","last_clean":"2024-09-13T18:42:28.007281+0000","last_became_active":"2024-09-13T18:42:26.721127+0000","last_became_peered":"2024-09-13T18:42:26.721127+0000","last_unstale":"2024-09-13T18:42:28.007281+0000","last_undegraded":"2024-09-13T18:42:28.007281+0000","last_fullsized":"2024-09-13T18:42:28.007281+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:50.105639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007612+0000","last_change":"2024-09-13T18:42:26.712136+0000","last_active":"2024-09-13T18:42:28.007612+0000","last_peered":"2024-09-13T18:42:28.007612+0000","last_clean":"2024-09-13T18:42:28.007612+0000","last_became_active":"2024-09-13T18:42:26.711675+0000","last_became_peered":"2024-09-13T18:42:26.711675+0000","last_unstale":"2024-09-13T18:42:28.007612+0000","last_undegraded":"2024-09-13T18:42:28.007612+0000","last_fullsized":"2024-09-13T18:42:28.007612+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.007866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007302+0000","last_change":"2024-09-13T18:42:26.714400+0000","last_active":"2024-09-13T18:42:28.007302+0000","last_peered":"2024-09-13T18:42:28.007302+0000","last_clean":"2024-09-13T18:42:28.007302+0000","last_became_active":"2024-09-13T18:42:26.714143+0000","last_became_peered":"2024-09-13T18:42:26.714143+0000","last_unstale":"2024-09-13T18:42:28.007302+0000","last_undegraded":"2024-09-13T18:42:28.007302+0000","last_fullsized":"2024-09-13T18:42:28.007302+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:15.504825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007768+0000","last_change":"2024-09-13T18:42:26.720518+0000","last_active":"2024-09-13T18:42:28.007768+0000","last_peered":"2024-09-13T18:42:28.007768+0000","last_clean":"2024-09-13T18:42:28.007768+0000","last_became_active":"2024-09-13T18:42:26.719534+0000","last_became_peered":"2024-09-13T18:42:26.719534+0000","last_unstale":"2024-09-13T18:42:28.007768+0000","last_undegraded":"2024-09-13T18:42:28.007768+0000","last_fullsized":"2024-09-13T18:42:28.007768+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706029+0000","last_change":"2024-09-13T18:42:26.709432+0000","last_active":"2024-09-13T18:42:27.706029+0000","last_peered":"2024-09-13T18:42:27.706029+0000","last_clean":"2024-09-13T18:42:27.706029+0000","last_became_active":"2024-09-13T18:42:26.708886+0000","last_became_peered":"2024-09-13T18:42:26.708886+0000","last_unstale":"2024-09-13T18:42:27.706029+0000","last_undegraded":"2024-09-13T18:42:27.706029+0000","last_fullsized":"2024-09-13T18:42:27.706029+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.984032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006663+0000","last_change":"2024-09-13T18:42:26.715750+0000","last_active":"2024-09-13T18:42:28.006663+0000","last_peered":"2024-09-13T18:42:28.006663+0000","last_clean":"2024-09-13T18:42:28.006663+0000","last_became_active":"2024-09-13T18:42:26.714953+0000","last_became_peered":"2024-09-13T18:42:26.714953+0000","last_unstale":"2024-09-13T18:42:28.006663+0000","last_undegraded":"2024-09-13T18:42:28.006663+0000","last_fullsized":"2024-09-13T18:42:28.006663+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:03.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008660+0000","last_change":"2024-09-13T18:42:26.717284+0000","last_active":"2024-09-13T18:42:28.008660+0000","last_peered":"2024-09-13T18:42:28.008660+0000","last_clean":"2024-09-13T18:42:28.008660+0000","last_became_active":"2024-09-13T18:42:26.716726+0000","last_became_peered":"2024-09-13T18:42:26.716726+0000","last_unstale":"2024-09-13T18:42:28.008660+0000","last_undegraded":"2024-09-13T18:42:28.008660+0000","last_fullsized":"2024-09-13T18:42:28.008660+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:29.180195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007524+0000","last_change":"2024-09-13T18:42:26.714125+0000","last_active":"2024-09-13T18:42:28.007524+0000","last_peered":"2024-09-13T18:42:28.007524+0000","last_clean":"2024-09-13T18:42:28.007524+0000","last_became_active":"2024-09-13T18:42:26.713608+0000","last_became_peered":"2024-09-13T18:42:26.713608+0000","last_unstale":"2024-09-13T18:42:28.007524+0000","last_undegraded":"2024-09-13T18:42:28.007524+0000","last_fullsized":"2024-09-13T18:42:28.007524+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:14.761847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706385+0000","last_change":"2024-09-13T18:42:26.707438+0000","last_active":"2024-09-13T18:42:27.706385+0000","last_peered":"2024-09-13T18:42:27.706385+0000","last_clean":"2024-09-13T18:42:27.706385+0000","last_became_active":"2024-09-13T18:42:26.707239+0000","last_became_peered":"2024-09-13T18:42:26.707239+0000","last_unstale":"2024-09-13T18:42:27.706385+0000","last_undegraded":"2024-09-13T18:42:27.706385+0000","last_fullsized":"2024-09-13T18:42:27.706385+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:45.724121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006925+0000","last_change":"2024-09-13T18:42:26.718063+0000","last_active":"2024-09-13T18:42:28.006925+0000","last_peered":"2024-09-13T18:42:28.006925+0000","last_clean":"2024-09-13T18:42:28.006925+0000","last_became_active":"2024-09-13T18:42:26.715211+0000","last_became_peered":"2024-09-13T18:42:26.715211+0000","last_unstale":"2024-09-13T18:42:28.006925+0000","last_undegraded":"2024-09-13T18:42:28.006925+0000","last_fullsized":"2024-09-13T18:42:28.006925+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.829811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706386+0000","last_change":"2024-09-13T18:42:26.710825+0000","last_active":"2024-09-13T18:42:27.706386+0000","last_peered":"2024-09-13T18:42:27.706386+0000","last_clean":"2024-09-13T18:42:27.706386+0000","last_became_active":"2024-09-13T18:42:26.709198+0000","last_became_peered":"2024-09-13T18:42:26.709198+0000","last_unstale":"2024-09-13T18:42:27.706386+0000","last_undegraded":"2024-09-13T18:42:27.706386+0000","last_fullsized":"2024-09-13T18:42:27.706386+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.014156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706449+0000","last_change":"2024-09-13T18:42:26.704469+0000","last_active":"2024-09-13T18:42:27.706449+0000","last_peered":"2024-09-13T18:42:27.706449+0000","last_clean":"2024-09-13T18:42:27.706449+0000","last_became_active":"2024-09-13T18:42:26.704252+0000","last_became_peered":"2024-09-13T18:42:26.704252+0000","last_unstale":"2024-09-13T18:42:27.706449+0000","last_undegraded":"2024-09-13T18:42:27.706449+0000","last_fullsized":"2024-09-13T18:42:27.706449+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.998094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007393+0000","last_change":"2024-09-13T18:42:26.713031+0000","last_active":"2024-09-13T18:42:28.007393+0000","last_peered":"2024-09-13T18:42:28.007393+0000","last_clean":"2024-09-13T18:42:28.007393+0000","last_became_active":"2024-09-13T18:42:26.712792+0000","last_became_peered":"2024-09-13T18:42:26.712792+0000","last_unstale":"2024-09-13T18:42:28.007393+0000","last_undegraded":"2024-09-13T18:42:28.007393+0000","last_fullsized":"2024-09-13T18:42:28.007393+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:58.778300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007851+0000","last_change":"2024-09-13T18:42:26.711891+0000","last_active":"2024-09-13T18:42:28.007851+0000","last_peered":"2024-09-13T18:42:28.007851+0000","last_clean":"2024-09-13T18:42:28.007851+0000","last_became_active":"2024-09-13T18:42:26.711680+0000","last_became_peered":"2024-09-13T18:42:26.711680+0000","last_unstale":"2024-09-13T18:42:28.007851+0000","last_undegraded":"2024-09-13T18:42:28.007851+0000","last_fullsized":"2024-09-13T18:42:28.007851+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:12.167764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006662+0000","last_change":"2024-09-13T18:42:26.718097+0000","last_active":"2024-09-13T18:42:28.006662+0000","last_peered":"2024-09-13T18:42:28.006662+0000","last_clean":"2024-09-13T18:42:28.006662+0000","last_became_active":"2024-09-13T18:42:26.715042+0000","last_became_peered":"2024-09-13T18:42:26.715042+0000","last_unstale":"2024-09-13T18:42:28.006662+0000","last_undegraded":"2024-09-13T18:42:28.006662+0000","last_fullsized":"2024-09-13T18:42:28.006662+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:50.105639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709308+0000","last_change":"2024-09-13T18:42:26.714094+0000","last_active":"2024-09-13T18:42:27.709308+0000","last_peered":"2024-09-13T18:42:27.709308+0000","last_clean":"2024-09-13T18:42:27.709308+0000","last_became_active":"2024-09-13T18:42:26.713725+0000","last_became_peered":"2024-09-13T18:42:26.713725+0000","last_unstale":"2024-09-13T18:42:27.709308+0000","last_undegraded":"2024-09-13T18:42:27.709308+0000","last_fullsized":"2024-09-13T18:42:27.709308+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.102034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007445+0000","last_change":"2024-09-13T18:42:26.716067+0000","last_active":"2024-09-13T18:42:28.007445+0000","last_peered":"2024-09-13T18:42:28.007445+0000","last_clean":"2024-09-13T18:42:28.007445+0000","last_became_active":"2024-09-13T18:42:26.715838+0000","last_became_peered":"2024-09-13T18:42:26.715838+0000","last_unstale":"2024-09-13T18:42:28.007445+0000","last_undegraded":"2024-09-13T18:42:28.007445+0000","last_fullsized":"2024-09-13T18:42:28.007445+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007716+0000","last_change":"2024-09-13T18:42:26.716290+0000","last_active":"2024-09-13T18:42:28.007716+0000","last_peered":"2024-09-13T18:42:28.007716+0000","last_clean":"2024-09-13T18:42:28.007716+0000","last_became_active":"2024-09-13T18:42:26.716066+0000","last_became_peered":"2024-09-13T18:42:26.716066+0000","last_unstale":"2024-09-13T18:42:28.007716+0000","last_undegraded":"2024-09-13T18:42:28.007716+0000","last_fullsized":"2024-09-13T18:42:28.007716+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:34.061395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.708995+0000","last_change":"2024-09-13T18:42:26.715224+0000","last_active":"2024-09-13T18:42:27.708995+0000","last_peered":"2024-09-13T18:42:27.708995+0000","last_clean":"2024-09-13T18:42:27.708995+0000","last_became_active":"2024-09-13T18:42:26.714961+0000","last_became_peered":"2024-09-13T18:42:26.714961+0000","last_unstale":"2024-09-13T18:42:27.708995+0000","last_undegraded":"2024-09-13T18:42:27.708995+0000","last_fullsized":"2024-09-13T18:42:27.708995+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:52.729015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007199+0000","last_change":"2024-09-13T18:42:26.711204+0000","last_active":"2024-09-13T18:42:28.007199+0000","last_peered":"2024-09-13T18:42:28.007199+0000","last_clean":"2024-09-13T18:42:28.007199+0000","last_became_active":"2024-09-13T18:42:26.709873+0000","last_became_peered":"2024-09-13T18:42:26.709873+0000","last_unstale":"2024-09-13T18:42:28.007199+0000","last_undegraded":"2024-09-13T18:42:28.007199+0000","last_fullsized":"2024-09-13T18:42:28.007199+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:52.457008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006758+0000","last_change":"2024-09-13T18:42:26.715566+0000","last_active":"2024-09-13T18:42:28.006758+0000","last_peered":"2024-09-13T18:42:28.006758+0000","last_clean":"2024-09-13T18:42:28.006758+0000","last_became_active":"2024-09-13T18:42:26.714412+0000","last_became_peered":"2024-09-13T18:42:26.714412+0000","last_unstale":"2024-09-13T18:42:28.006758+0000","last_undegraded":"2024-09-13T18:42:28.006758+0000","last_fullsized":"2024-09-13T18:42:28.006758+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:29.180195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007523+0000","last_change":"2024-09-13T18:42:26.711899+0000","last_active":"2024-09-13T18:42:28.007523+0000","last_peered":"2024-09-13T18:42:28.007523+0000","last_clean":"2024-09-13T18:42:28.007523+0000","last_became_active":"2024-09-13T18:42:26.711617+0000","last_became_peered":"2024-09-13T18:42:26.711617+0000","last_unstale":"2024-09-13T18:42:28.007523+0000","last_undegraded":"2024-09-13T18:42:28.007523+0000","last_fullsized":"2024-09-13T18:42:28.007523+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:48.922377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008631+0000","last_change":"2024-09-13T18:42:26.719812+0000","last_active":"2024-09-13T18:42:28.008631+0000","last_peered":"2024-09-13T18:42:28.008631+0000","last_clean":"2024-09-13T18:42:28.008631+0000","last_became_active":"2024-09-13T18:42:26.719059+0000","last_became_peered":"2024-09-13T18:42:26.719059+0000","last_unstale":"2024-09-13T18:42:28.008631+0000","last_undegraded":"2024-09-13T18:42:28.008631+0000","last_fullsized":"2024-09-13T18:42:28.008631+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:00.272587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007914+0000","last_change":"2024-09-13T18:42:26.707962+0000","last_active":"2024-09-13T18:42:28.007914+0000","last_peered":"2024-09-13T18:42:28.007914+0000","last_clean":"2024-09-13T18:42:28.007914+0000","last_became_active":"2024-09-13T18:42:26.707733+0000","last_became_peered":"2024-09-13T18:42:26.707733+0000","last_unstale":"2024-09-13T18:42:28.007914+0000","last_undegraded":"2024-09-13T18:42:28.007914+0000","last_fullsized":"2024-09-13T18:42:28.007914+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:55.722519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007371+0000","last_change":"2024-09-13T18:42:26.721570+0000","last_active":"2024-09-13T18:42:28.007371+0000","last_peered":"2024-09-13T18:42:28.007371+0000","last_clean":"2024-09-13T18:42:28.007371+0000","last_became_active":"2024-09-13T18:42:26.720806+0000","last_became_peered":"2024-09-13T18:42:26.720806+0000","last_unstale":"2024-09-13T18:42:28.007371+0000","last_undegraded":"2024-09-13T18:42:28.007371+0000","last_fullsized":"2024-09-13T18:42:28.007371+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:30.789964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"148'4","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006960+0000","last_change":"2024-09-13T18:42:26.298090+0000","last_active":"2024-09-13T18:42:28.006960+0000","last_peered":"2024-09-13T18:42:28.006960+0000","last_clean":"2024-09-13T18:42:28.006960+0000","last_became_active":"2024-09-13T18:42:26.297136+0000","last_became_peered":"2024-09-13T18:42:26.297136+0000","last_unstale":"2024-09-13T18:42:28.006960+0000","last_undegraded":"2024-09-13T18:42:28.006960+0000","last_fullsized":"2024-09-13T18:42:28.006960+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:12.211686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006763+0000","last_change":"2024-09-13T18:42:26.717928+0000","last_active":"2024-09-13T18:42:28.006763+0000","last_peered":"2024-09-13T18:42:28.006763+0000","last_clean":"2024-09-13T18:42:28.006763+0000","last_became_active":"2024-09-13T18:42:26.713189+0000","last_became_peered":"2024-09-13T18:42:26.713189+0000","last_unstale":"2024-09-13T18:42:28.006763+0000","last_undegraded":"2024-09-13T18:42:28.006763+0000","last_fullsized":"2024-09-13T18:42:28.006763+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:53.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706037+0000","last_change":"2024-09-13T18:42:26.294193+0000","last_active":"2024-09-13T18:42:27.706037+0000","last_peered":"2024-09-13T18:42:27.706037+0000","last_clean":"2024-09-13T18:42:27.706037+0000","last_became_active":"2024-09-13T18:42:26.293971+0000","last_became_peered":"2024-09-13T18:42:26.293971+0000","last_unstale":"2024-09-13T18:42:27.706037+0000","last_undegraded":"2024-09-13T18:42:27.706037+0000","last_fullsized":"2024-09-13T18:42:27.706037+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:33.029705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007565+0000","last_change":"2024-09-13T18:42:26.715378+0000","last_active":"2024-09-13T18:42:28.007565+0000","last_peered":"2024-09-13T18:42:28.007565+0000","last_clean":"2024-09-13T18:42:28.007565+0000","last_became_active":"2024-09-13T18:42:26.715159+0000","last_became_peered":"2024-09-13T18:42:26.715159+0000","last_unstale":"2024-09-13T18:42:28.007565+0000","last_undegraded":"2024-09-13T18:42:28.007565+0000","last_fullsized":"2024-09-13T18:42:28.007565+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:39.717272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709383+0000","last_change":"2024-09-13T18:42:26.302642+0000","last_active":"2024-09-13T18:42:27.709383+0000","last_peered":"2024-09-13T18:42:27.709383+0000","last_clean":"2024-09-13T18:42:27.709383+0000","last_became_active":"2024-09-13T18:42:26.302215+0000","last_became_peered":"2024-09-13T18:42:26.302215+0000","last_unstale":"2024-09-13T18:42:27.709383+0000","last_undegraded":"2024-09-13T18:42:27.709383+0000","last_fullsized":"2024-09-13T18:42:27.709383+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:13.822126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706536+0000","last_change":"2024-09-13T18:42:26.710344+0000","last_active":"2024-09-13T18:42:27.706536+0000","last_peered":"2024-09-13T18:42:27.706536+0000","last_clean":"2024-09-13T18:42:27.706536+0000","last_became_active":"2024-09-13T18:42:26.710121+0000","last_became_peered":"2024-09-13T18:42:26.710121+0000","last_unstale":"2024-09-13T18:42:27.706536+0000","last_undegraded":"2024-09-13T18:42:27.706536+0000","last_fullsized":"2024-09-13T18:42:27.706536+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:24.584095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709151+0000","last_change":"2024-09-13T18:42:26.307045+0000","last_active":"2024-09-13T18:42:27.709151+0000","last_peered":"2024-09-13T18:42:27.709151+0000","last_clean":"2024-09-13T18:42:27.709151+0000","last_became_active":"2024-09-13T18:42:26.303978+0000","last_became_peered":"2024-09-13T18:42:26.303978+0000","last_unstale":"2024-09-13T18:42:27.709151+0000","last_undegraded":"2024-09-13T18:42:27.709151+0000","last_fullsized":"2024-09-13T18:42:27.709151+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:27.530953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.708928+0000","last_change":"2024-09-13T18:42:26.714659+0000","last_active":"2024-09-13T18:42:27.708928+0000","last_peered":"2024-09-13T18:42:27.708928+0000","last_clean":"2024-09-13T18:42:27.708928+0000","last_became_active":"2024-09-13T18:42:26.714450+0000","last_became_peered":"2024-09-13T18:42:26.714450+0000","last_unstale":"2024-09-13T18:42:27.708928+0000","last_undegraded":"2024-09-13T18:42:27.708928+0000","last_fullsized":"2024-09-13T18:42:27.708928+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:03.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706658+0000","last_change":"2024-09-13T18:42:26.307130+0000","last_active":"2024-09-13T18:42:27.706658+0000","last_peered":"2024-09-13T18:42:27.706658+0000","last_clean":"2024-09-13T18:42:27.706658+0000","last_became_active":"2024-09-13T18:42:26.306901+0000","last_became_peered":"2024-09-13T18:42:26.306901+0000","last_unstale":"2024-09-13T18:42:27.706658+0000","last_undegraded":"2024-09-13T18:42:27.706658+0000","last_fullsized":"2024-09-13T18:42:27.706658+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:27.532708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007251+0000","last_change":"2024-09-13T18:42:26.712203+0000","last_active":"2024-09-13T18:42:28.007251+0000","last_peered":"2024-09-13T18:42:28.007251+0000","last_clean":"2024-09-13T18:42:28.007251+0000","last_became_active":"2024-09-13T18:42:26.711978+0000","last_became_peered":"2024-09-13T18:42:26.711978+0000","last_unstale":"2024-09-13T18:42:28.007251+0000","last_undegraded":"2024-09-13T18:42:28.007251+0000","last_fullsized":"2024-09-13T18:42:28.007251+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:50.397364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007897+0000","last_change":"2024-09-13T18:42:26.305765+0000","last_active":"2024-09-13T18:42:28.007897+0000","last_peered":"2024-09-13T18:42:28.007897+0000","last_clean":"2024-09-13T18:42:28.007897+0000","last_became_active":"2024-09-13T18:42:26.303968+0000","last_became_peered":"2024-09-13T18:42:26.303968+0000","last_unstale":"2024-09-13T18:42:28.007897+0000","last_undegraded":"2024-09-13T18:42:28.007897+0000","last_fullsized":"2024-09-13T18:42:28.007897+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:38.478770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007714+0000","last_change":"2024-09-13T18:42:26.708965+0000","last_active":"2024-09-13T18:42:28.007714+0000","last_peered":"2024-09-13T18:42:28.007714+0000","last_clean":"2024-09-13T18:42:28.007714+0000","last_became_active":"2024-09-13T18:42:26.708419+0000","last_became_peered":"2024-09-13T18:42:26.708419+0000","last_unstale":"2024-09-13T18:42:28.007714+0000","last_undegraded":"2024-09-13T18:42:28.007714+0000","last_fullsized":"2024-09-13T18:42:28.007714+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:55.768015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006972+0000","last_change":"2024-09-13T18:42:26.301171+0000","last_active":"2024-09-13T18:42:28.006972+0000","last_peered":"2024-09-13T18:42:28.006972+0000","last_clean":"2024-09-13T18:42:28.006972+0000","last_became_active":"2024-09-13T18:42:26.300917+0000","last_became_peered":"2024-09-13T18:42:26.300917+0000","last_unstale":"2024-09-13T18:42:28.006972+0000","last_undegraded":"2024-09-13T18:42:28.006972+0000","last_fullsized":"2024-09-13T18:42:28.006972+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:03.801310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006823+0000","last_change":"2024-09-13T18:42:26.712544+0000","last_active":"2024-09-13T18:42:28.006823+0000","last_peered":"2024-09-13T18:42:28.006823+0000","last_clean":"2024-09-13T18:42:28.006823+0000","last_became_active":"2024-09-13T18:42:26.712133+0000","last_became_peered":"2024-09-13T18:42:26.712133+0000","last_unstale":"2024-09-13T18:42:28.006823+0000","last_undegraded":"2024-09-13T18:42:28.006823+0000","last_fullsized":"2024-09-13T18:42:28.006823+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:34.325498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008064+0000","last_change":"2024-09-13T18:42:26.307923+0000","last_active":"2024-09-13T18:42:28.008064+0000","last_peered":"2024-09-13T18:42:28.008064+0000","last_clean":"2024-09-13T18:42:28.008064+0000","last_became_active":"2024-09-13T18:42:26.307707+0000","last_became_peered":"2024-09-13T18:42:26.307707+0000","last_unstale":"2024-09-13T18:42:28.008064+0000","last_undegraded":"2024-09-13T18:42:28.008064+0000","last_fullsized":"2024-09-13T18:42:28.008064+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:46.346598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705870+0000","last_change":"2024-09-13T18:42:26.714123+0000","last_active":"2024-09-13T18:42:27.705870+0000","last_peered":"2024-09-13T18:42:27.705870+0000","last_clean":"2024-09-13T18:42:27.705870+0000","last_became_active":"2024-09-13T18:42:26.713893+0000","last_became_peered":"2024-09-13T18:42:26.713893+0000","last_unstale":"2024-09-13T18:42:27.705870+0000","last_undegraded":"2024-09-13T18:42:27.705870+0000","last_fullsized":"2024-09-13T18:42:27.705870+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:53.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709274+0000","last_change":"2024-09-13T18:42:26.307921+0000","last_active":"2024-09-13T18:42:27.709274+0000","last_peered":"2024-09-13T18:42:27.709274+0000","last_clean":"2024-09-13T18:42:27.709274+0000","last_became_active":"2024-09-13T18:42:26.306360+0000","last_became_peered":"2024-09-13T18:42:26.306360+0000","last_unstale":"2024-09-13T18:42:27.709274+0000","last_undegraded":"2024-09-13T18:42:27.709274+0000","last_fullsized":"2024-09-13T18:42:27.709274+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:29.983463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705772+0000","last_change":"2024-09-13T18:42:26.707645+0000","last_active":"2024-09-13T18:42:27.705772+0000","last_peered":"2024-09-13T18:42:27.705772+0000","last_clean":"2024-09-13T18:42:27.705772+0000","last_became_active":"2024-09-13T18:42:26.707445+0000","last_became_peered":"2024-09-13T18:42:26.707445+0000","last_unstale":"2024-09-13T18:42:27.705772+0000","last_undegraded":"2024-09-13T18:42:27.705772+0000","last_fullsized":"2024-09-13T18:42:27.705772+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:14.827984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007964+0000","last_change":"2024-09-13T18:42:26.295078+0000","last_active":"2024-09-13T18:42:28.007964+0000","last_peered":"2024-09-13T18:42:28.007964+0000","last_clean":"2024-09-13T18:42:28.007964+0000","last_became_active":"2024-09-13T18:42:26.294829+0000","last_became_peered":"2024-09-13T18:42:26.294829+0000","last_unstale":"2024-09-13T18:42:28.007964+0000","last_undegraded":"2024-09-13T18:42:28.007964+0000","last_fullsized":"2024-09-13T18:42:28.007964+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:30.120189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007211+0000","last_change":"2024-09-13T18:42:26.717261+0000","last_active":"2024-09-13T18:42:28.007211+0000","last_peered":"2024-09-13T18:42:28.007211+0000","last_clean":"2024-09-13T18:42:28.007211+0000","last_became_active":"2024-09-13T18:42:26.717026+0000","last_became_peered":"2024-09-13T18:42:26.717026+0000","last_unstale":"2024-09-13T18:42:28.007211+0000","last_undegraded":"2024-09-13T18:42:28.007211+0000","last_fullsized":"2024-09-13T18:42:28.007211+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.102034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"148'3","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007555+0000","last_change":"2024-09-13T18:42:26.297528+0000","last_active":"2024-09-13T18:42:28.007555+0000","last_peered":"2024-09-13T18:42:28.007555+0000","last_clean":"2024-09-13T18:42:28.007555+0000","last_became_active":"2024-09-13T18:42:26.297285+0000","last_became_peered":"2024-09-13T18:42:26.297285+0000","last_unstale":"2024-09-13T18:42:28.007555+0000","last_undegraded":"2024-09-13T18:42:28.007555+0000","last_fullsized":"2024-09-13T18:42:28.007555+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:55.706500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007003+0000","last_change":"2024-09-13T18:42:26.713245+0000","last_active":"2024-09-13T18:42:28.007003+0000","last_peered":"2024-09-13T18:42:28.007003+0000","last_clean":"2024-09-13T18:42:28.007003+0000","last_became_active":"2024-09-13T18:42:26.711323+0000","last_became_peered":"2024-09-13T18:42:26.711323+0000","last_unstale":"2024-09-13T18:42:28.007003+0000","last_undegraded":"2024-09-13T18:42:28.007003+0000","last_fullsized":"2024-09-13T18:42:28.007003+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:19.937679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"148'6","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709413+0000","last_change":"2024-09-13T18:42:26.307046+0000","last_active":"2024-09-13T18:42:27.709413+0000","last_peered":"2024-09-13T18:42:27.709413+0000","last_clean":"2024-09-13T18:42:27.709413+0000","last_became_active":"2024-09-13T18:42:26.305921+0000","last_became_peered":"2024-09-13T18:42:26.305921+0000","last_unstale":"2024-09-13T18:42:27.709413+0000","last_undegraded":"2024-09-13T18:42:27.709413+0000","last_fullsized":"2024-09-13T18:42:27.709413+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007620+0000","last_change":"2024-09-13T18:42:26.713962+0000","last_active":"2024-09-13T18:42:28.007620+0000","last_peered":"2024-09-13T18:42:28.007620+0000","last_clean":"2024-09-13T18:42:28.007620+0000","last_became_active":"2024-09-13T18:42:26.713231+0000","last_became_peered":"2024-09-13T18:42:26.713231+0000","last_unstale":"2024-09-13T18:42:28.007620+0000","last_undegraded":"2024-09-13T18:42:28.007620+0000","last_fullsized":"2024-09-13T18:42:28.007620+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:05.416533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008236+0000","last_change":"2024-09-13T18:42:26.293986+0000","last_active":"2024-09-13T18:42:28.008236+0000","last_peered":"2024-09-13T18:42:28.008236+0000","last_clean":"2024-09-13T18:42:28.008236+0000","last_became_active":"2024-09-13T18:42:26.293191+0000","last_became_peered":"2024-09-13T18:42:26.293191+0000","last_unstale":"2024-09-13T18:42:28.008236+0000","last_undegraded":"2024-09-13T18:42:28.008236+0000","last_fullsized":"2024-09-13T18:42:28.008236+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:44.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709087+0000","last_change":"2024-09-13T18:42:26.708794+0000","last_active":"2024-09-13T18:42:27.709087+0000","last_peered":"2024-09-13T18:42:27.709087+0000","last_clean":"2024-09-13T18:42:27.709087+0000","last_became_active":"2024-09-13T18:42:26.708495+0000","last_became_peered":"2024-09-13T18:42:26.708495+0000","last_unstale":"2024-09-13T18:42:27.709087+0000","last_undegraded":"2024-09-13T18:42:27.709087+0000","last_fullsized":"2024-09-13T18:42:27.709087+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:52.908939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706578+0000","last_change":"2024-09-13T18:42:26.298881+0000","last_active":"2024-09-13T18:42:27.706578+0000","last_peered":"2024-09-13T18:42:27.706578+0000","last_clean":"2024-09-13T18:42:27.706578+0000","last_became_active":"2024-09-13T18:42:26.298655+0000","last_became_peered":"2024-09-13T18:42:26.298655+0000","last_unstale":"2024-09-13T18:42:27.706578+0000","last_undegraded":"2024-09-13T18:42:27.706578+0000","last_fullsized":"2024-09-13T18:42:27.706578+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:09.118198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709155+0000","last_change":"2024-09-13T18:42:26.707511+0000","last_active":"2024-09-13T18:42:27.709155+0000","last_peered":"2024-09-13T18:42:27.709155+0000","last_clean":"2024-09-13T18:42:27.709155+0000","last_became_active":"2024-09-13T18:42:26.707262+0000","last_became_peered":"2024-09-13T18:42:26.707262+0000","last_unstale":"2024-09-13T18:42:27.709155+0000","last_undegraded":"2024-09-13T18:42:27.709155+0000","last_fullsized":"2024-09-13T18:42:27.709155+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"148'8","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008082+0000","last_change":"2024-09-13T18:42:26.305614+0000","last_active":"2024-09-13T18:42:28.008082+0000","last_peered":"2024-09-13T18:42:28.008082+0000","last_clean":"2024-09-13T18:42:28.008082+0000","last_became_active":"2024-09-13T18:42:26.303743+0000","last_became_peered":"2024-09-13T18:42:26.303743+0000","last_unstale":"2024-09-13T18:42:28.008082+0000","last_undegraded":"2024-09-13T18:42:28.008082+0000","last_fullsized":"2024-09-13T18:42:28.008082+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:47.173185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008712+0000","last_change":"2024-09-13T18:42:26.712450+0000","last_active":"2024-09-13T18:42:28.008712+0000","last_peered":"2024-09-13T18:42:28.008712+0000","last_clean":"2024-09-13T18:42:28.008712+0000","last_became_active":"2024-09-13T18:42:26.712225+0000","last_became_peered":"2024-09-13T18:42:26.712225+0000","last_unstale":"2024-09-13T18:42:28.008712+0000","last_undegraded":"2024-09-13T18:42:28.008712+0000","last_fullsized":"2024-09-13T18:42:28.008712+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007302+0000","last_change":"2024-09-13T18:42:26.305578+0000","last_active":"2024-09-13T18:42:28.007302+0000","last_peered":"2024-09-13T18:42:28.007302+0000","last_clean":"2024-09-13T18:42:28.007302+0000","last_became_active":"2024-09-13T18:42:26.305141+0000","last_became_peered":"2024-09-13T18:42:26.305141+0000","last_unstale":"2024-09-13T18:42:28.007302+0000","last_undegraded":"2024-09-13T18:42:28.007302+0000","last_fullsized":"2024-09-13T18:42:28.007302+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:49.099781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007456+0000","last_change":"2024-09-13T18:42:26.721352+0000","last_active":"2024-09-13T18:42:28.007456+0000","last_peered":"2024-09-13T18:42:28.007456+0000","last_clean":"2024-09-13T18:42:28.007456+0000","last_became_active":"2024-09-13T18:42:26.720214+0000","last_became_peered":"2024-09-13T18:42:26.720214+0000","last_unstale":"2024-09-13T18:42:28.007456+0000","last_undegraded":"2024-09-13T18:42:28.007456+0000","last_fullsized":"2024-09-13T18:42:28.007456+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:14.827984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008317+0000","last_change":"2024-09-13T18:42:26.294139+0000","last_active":"2024-09-13T18:42:28.008317+0000","last_peered":"2024-09-13T18:42:28.008317+0000","last_clean":"2024-09-13T18:42:28.008317+0000","last_became_active":"2024-09-13T18:42:26.293759+0000","last_became_peered":"2024-09-13T18:42:26.293759+0000","last_unstale":"2024-09-13T18:42:28.008317+0000","last_undegraded":"2024-09-13T18:42:28.008317+0000","last_fullsized":"2024-09-13T18:42:28.008317+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:25.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007336+0000","last_change":"2024-09-13T18:42:26.714685+0000","last_active":"2024-09-13T18:42:28.007336+0000","last_peered":"2024-09-13T18:42:28.007336+0000","last_clean":"2024-09-13T18:42:28.007336+0000","last_became_active":"2024-09-13T18:42:26.714454+0000","last_became_peered":"2024-09-13T18:42:26.714454+0000","last_unstale":"2024-09-13T18:42:28.007336+0000","last_undegraded":"2024-09-13T18:42:28.007336+0000","last_fullsized":"2024-09-13T18:42:28.007336+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.509240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007183+0000","last_change":"2024-09-13T18:42:26.308244+0000","last_active":"2024-09-13T18:42:28.007183+0000","last_peered":"2024-09-13T18:42:28.007183+0000","last_clean":"2024-09-13T18:42:28.007183+0000","last_became_active":"2024-09-13T18:42:26.307958+0000","last_became_peered":"2024-09-13T18:42:26.307958+0000","last_unstale":"2024-09-13T18:42:28.007183+0000","last_undegraded":"2024-09-13T18:42:28.007183+0000","last_fullsized":"2024-09-13T18:42:28.007183+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:47.173185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007033+0000","last_change":"2024-09-13T18:42:26.711726+0000","last_active":"2024-09-13T18:42:28.007033+0000","last_peered":"2024-09-13T18:42:28.007033+0000","last_clean":"2024-09-13T18:42:28.007033+0000","last_became_active":"2024-09-13T18:42:26.710538+0000","last_became_peered":"2024-09-13T18:42:26.710538+0000","last_unstale":"2024-09-13T18:42:28.007033+0000","last_undegraded":"2024-09-13T18:42:28.007033+0000","last_fullsized":"2024-09-13T18:42:28.007033+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:00.272587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006870+0000","last_change":"2024-09-13T18:42:26.302134+0000","last_active":"2024-09-13T18:42:28.006870+0000","last_peered":"2024-09-13T18:42:28.006870+0000","last_clean":"2024-09-13T18:42:28.006870+0000","last_became_active":"2024-09-13T18:42:26.301833+0000","last_became_peered":"2024-09-13T18:42:26.301833+0000","last_unstale":"2024-09-13T18:42:28.006870+0000","last_undegraded":"2024-09-13T18:42:28.006870+0000","last_fullsized":"2024-09-13T18:42:28.006870+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:08.051825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706533+0000","last_change":"2024-09-13T18:42:26.702041+0000","last_active":"2024-09-13T18:42:27.706533+0000","last_peered":"2024-09-13T18:42:27.706533+0000","last_clean":"2024-09-13T18:42:27.706533+0000","last_became_active":"2024-09-13T18:42:26.701818+0000","last_became_peered":"2024-09-13T18:42:26.701818+0000","last_unstale":"2024-09-13T18:42:27.706533+0000","last_undegraded":"2024-09-13T18:42:27.706533+0000","last_fullsized":"2024-09-13T18:42:27.706533+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.007866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007651+0000","last_change":"2024-09-13T18:42:26.295495+0000","last_active":"2024-09-13T18:42:28.007651+0000","last_peered":"2024-09-13T18:42:28.007651+0000","last_clean":"2024-09-13T18:42:28.007651+0000","last_became_active":"2024-09-13T18:42:26.295095+0000","last_became_peered":"2024-09-13T18:42:26.295095+0000","last_unstale":"2024-09-13T18:42:28.007651+0000","last_undegraded":"2024-09-13T18:42:28.007651+0000","last_fullsized":"2024-09-13T18:42:28.007651+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.734455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007986+0000","last_change":"2024-09-13T18:42:26.714205+0000","last_active":"2024-09-13T18:42:28.007986+0000","last_peered":"2024-09-13T18:42:28.007986+0000","last_clean":"2024-09-13T18:42:28.007986+0000","last_became_active":"2024-09-13T18:42:26.713959+0000","last_became_peered":"2024-09-13T18:42:26.713959+0000","last_unstale":"2024-09-13T18:42:28.007986+0000","last_undegraded":"2024-09-13T18:42:28.007986+0000","last_fullsized":"2024-09-13T18:42:28.007986+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:39.403729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007539+0000","last_change":"2024-09-13T18:42:26.304687+0000","last_active":"2024-09-13T18:42:28.007539+0000","last_peered":"2024-09-13T18:42:28.007539+0000","last_clean":"2024-09-13T18:42:28.007539+0000","last_became_active":"2024-09-13T18:42:26.303290+0000","last_became_peered":"2024-09-13T18:42:26.303290+0000","last_unstale":"2024-09-13T18:42:28.007539+0000","last_undegraded":"2024-09-13T18:42:28.007539+0000","last_fullsized":"2024-09-13T18:42:28.007539+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:11.962621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007079+0000","last_change":"2024-09-13T18:42:26.715619+0000","last_active":"2024-09-13T18:42:28.007079+0000","last_peered":"2024-09-13T18:42:28.007079+0000","last_clean":"2024-09-13T18:42:28.007079+0000","last_became_active":"2024-09-13T18:42:26.714596+0000","last_became_peered":"2024-09-13T18:42:26.714596+0000","last_unstale":"2024-09-13T18:42:28.007079+0000","last_undegraded":"2024-09-13T18:42:28.007079+0000","last_fullsized":"2024-09-13T18:42:28.007079+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:20.504215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709488+0000","last_change":"2024-09-13T18:42:26.305486+0000","last_active":"2024-09-13T18:42:27.709488+0000","last_peered":"2024-09-13T18:42:27.709488+0000","last_clean":"2024-09-13T18:42:27.709488+0000","last_became_active":"2024-09-13T18:42:26.305188+0000","last_became_peered":"2024-09-13T18:42:26.305188+0000","last_unstale":"2024-09-13T18:42:27.709488+0000","last_undegraded":"2024-09-13T18:42:27.709488+0000","last_fullsized":"2024-09-13T18:42:27.709488+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.515035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007816+0000","last_change":"2024-09-13T18:42:26.709124+0000","last_active":"2024-09-13T18:42:28.007816+0000","last_peered":"2024-09-13T18:42:28.007816+0000","last_clean":"2024-09-13T18:42:28.007816+0000","last_became_active":"2024-09-13T18:42:26.708729+0000","last_became_peered":"2024-09-13T18:42:26.708729+0000","last_unstale":"2024-09-13T18:42:28.007816+0000","last_undegraded":"2024-09-13T18:42:28.007816+0000","last_fullsized":"2024-09-13T18:42:28.007816+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:01.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709352+0000","last_change":"2024-09-13T18:42:26.308324+0000","last_active":"2024-09-13T18:42:27.709352+0000","last_peered":"2024-09-13T18:42:27.709352+0000","last_clean":"2024-09-13T18:42:27.709352+0000","last_became_active":"2024-09-13T18:42:26.306768+0000","last_became_peered":"2024-09-13T18:42:26.306768+0000","last_unstale":"2024-09-13T18:42:27.709352+0000","last_undegraded":"2024-09-13T18:42:27.709352+0000","last_fullsized":"2024-09-13T18:42:27.709352+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:04.986823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006865+0000","last_change":"2024-09-13T18:42:26.718242+0000","last_active":"2024-09-13T18:42:28.006865+0000","last_peered":"2024-09-13T18:42:28.006865+0000","last_clean":"2024-09-13T18:42:28.006865+0000","last_became_active":"2024-09-13T18:42:26.715342+0000","last_became_peered":"2024-09-13T18:42:26.715342+0000","last_unstale":"2024-09-13T18:42:28.006865+0000","last_undegraded":"2024-09-13T18:42:28.006865+0000","last_fullsized":"2024-09-13T18:42:28.006865+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709485+0000","last_change":"2024-09-13T18:42:26.305296+0000","last_active":"2024-09-13T18:42:27.709485+0000","last_peered":"2024-09-13T18:42:27.709485+0000","last_clean":"2024-09-13T18:42:27.709485+0000","last_became_active":"2024-09-13T18:42:26.304660+0000","last_became_peered":"2024-09-13T18:42:26.304660+0000","last_unstale":"2024-09-13T18:42:27.709485+0000","last_undegraded":"2024-09-13T18:42:27.709485+0000","last_fullsized":"2024-09-13T18:42:27.709485+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007939+0000","last_change":"2024-09-13T18:42:26.714908+0000","last_active":"2024-09-13T18:42:28.007939+0000","last_peered":"2024-09-13T18:42:28.007939+0000","last_clean":"2024-09-13T18:42:28.007939+0000","last_became_active":"2024-09-13T18:42:26.714689+0000","last_became_peered":"2024-09-13T18:42:26.714689+0000","last_unstale":"2024-09-13T18:42:28.007939+0000","last_undegraded":"2024-09-13T18:42:28.007939+0000","last_fullsized":"2024-09-13T18:42:28.007939+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:53.034185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007049+0000","last_change":"2024-09-13T18:42:26.308785+0000","last_active":"2024-09-13T18:42:28.007049+0000","last_peered":"2024-09-13T18:42:28.007049+0000","last_clean":"2024-09-13T18:42:28.007049+0000","last_became_active":"2024-09-13T18:42:26.308596+0000","last_became_peered":"2024-09-13T18:42:26.308596+0000","last_unstale":"2024-09-13T18:42:28.007049+0000","last_undegraded":"2024-09-13T18:42:28.007049+0000","last_fullsized":"2024-09-13T18:42:28.007049+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:39.440252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008760+0000","last_change":"2024-09-13T18:42:26.717129+0000","last_active":"2024-09-13T18:42:28.008760+0000","last_peered":"2024-09-13T18:42:28.008760+0000","last_clean":"2024-09-13T18:42:28.008760+0000","last_became_active":"2024-09-13T18:42:26.715970+0000","last_became_peered":"2024-09-13T18:42:26.715970+0000","last_unstale":"2024-09-13T18:42:28.008760+0000","last_undegraded":"2024-09-13T18:42:28.008760+0000","last_fullsized":"2024-09-13T18:42:28.008760+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:20.504215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709492+0000","last_change":"2024-09-13T18:42:26.307185+0000","last_active":"2024-09-13T18:42:27.709492+0000","last_peered":"2024-09-13T18:42:27.709492+0000","last_clean":"2024-09-13T18:42:27.709492+0000","last_became_active":"2024-09-13T18:42:26.306511+0000","last_became_peered":"2024-09-13T18:42:26.306511+0000","last_unstale":"2024-09-13T18:42:27.709492+0000","last_undegraded":"2024-09-13T18:42:27.709492+0000","last_fullsized":"2024-09-13T18:42:27.709492+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:06.866101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006853+0000","last_change":"2024-09-13T18:42:26.710165+0000","last_active":"2024-09-13T18:42:28.006853+0000","last_peered":"2024-09-13T18:42:28.006853+0000","last_clean":"2024-09-13T18:42:28.006853+0000","last_became_active":"2024-09-13T18:42:26.709949+0000","last_became_peered":"2024-09-13T18:42:26.709949+0000","last_unstale":"2024-09-13T18:42:28.006853+0000","last_undegraded":"2024-09-13T18:42:28.006853+0000","last_fullsized":"2024-09-13T18:42:28.006853+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:39.403729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709571+0000","last_change":"2024-09-13T18:42:26.308086+0000","last_active":"2024-09-13T18:42:27.709571+0000","last_peered":"2024-09-13T18:42:27.709571+0000","last_clean":"2024-09-13T18:42:27.709571+0000","last_became_active":"2024-09-13T18:42:26.307839+0000","last_became_peered":"2024-09-13T18:42:26.307839+0000","last_unstale":"2024-09-13T18:42:27.709571+0000","last_undegraded":"2024-09-13T18:42:27.709571+0000","last_fullsized":"2024-09-13T18:42:27.709571+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.564811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706497+0000","last_change":"2024-09-13T18:42:26.704811+0000","last_active":"2024-09-13T18:42:27.706497+0000","last_peered":"2024-09-13T18:42:27.706497+0000","last_clean":"2024-09-13T18:42:27.706497+0000","last_became_active":"2024-09-13T18:42:26.704553+0000","last_became_peered":"2024-09-13T18:42:26.704553+0000","last_unstale":"2024-09-13T18:42:27.706497+0000","last_undegraded":"2024-09-13T18:42:27.706497+0000","last_fullsized":"2024-09-13T18:42:27.706497+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.478507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007468+0000","last_change":"2024-09-13T18:42:26.303518+0000","last_active":"2024-09-13T18:42:28.007468+0000","last_peered":"2024-09-13T18:42:28.007468+0000","last_clean":"2024-09-13T18:42:28.007468+0000","last_became_active":"2024-09-13T18:42:26.303299+0000","last_became_peered":"2024-09-13T18:42:26.303299+0000","last_unstale":"2024-09-13T18:42:28.007468+0000","last_undegraded":"2024-09-13T18:42:28.007468+0000","last_fullsized":"2024-09-13T18:42:28.007468+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:11.416179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007137+0000","last_change":"2024-09-13T18:42:26.711841+0000","last_active":"2024-09-13T18:42:28.007137+0000","last_peered":"2024-09-13T18:42:28.007137+0000","last_clean":"2024-09-13T18:42:28.007137+0000","last_became_active":"2024-09-13T18:42:26.710862+0000","last_became_peered":"2024-09-13T18:42:26.710862+0000","last_unstale":"2024-09-13T18:42:28.007137+0000","last_undegraded":"2024-09-13T18:42:28.007137+0000","last_fullsized":"2024-09-13T18:42:28.007137+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:40.703721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006953+0000","last_change":"2024-09-13T18:42:26.304239+0000","last_active":"2024-09-13T18:42:28.006953+0000","last_peered":"2024-09-13T18:42:28.006953+0000","last_clean":"2024-09-13T18:42:28.006953+0000","last_became_active":"2024-09-13T18:42:26.304053+0000","last_became_peered":"2024-09-13T18:42:26.304053+0000","last_unstale":"2024-09-13T18:42:28.006953+0000","last_undegraded":"2024-09-13T18:42:28.006953+0000","last_fullsized":"2024-09-13T18:42:28.006953+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:11.962621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006947+0000","last_change":"2024-09-13T18:42:26.715870+0000","last_active":"2024-09-13T18:42:28.006947+0000","last_peered":"2024-09-13T18:42:28.006947+0000","last_clean":"2024-09-13T18:42:28.006947+0000","last_became_active":"2024-09-13T18:42:26.715325+0000","last_became_peered":"2024-09-13T18:42:26.715325+0000","last_unstale":"2024-09-13T18:42:28.006947+0000","last_undegraded":"2024-09-13T18:42:28.006947+0000","last_fullsized":"2024-09-13T18:42:28.006947+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.984032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008165+0000","last_change":"2024-09-13T18:42:26.304192+0000","last_active":"2024-09-13T18:42:28.008165+0000","last_peered":"2024-09-13T18:42:28.008165+0000","last_clean":"2024-09-13T18:42:28.008165+0000","last_became_active":"2024-09-13T18:42:26.302777+0000","last_became_peered":"2024-09-13T18:42:26.302777+0000","last_unstale":"2024-09-13T18:42:28.008165+0000","last_undegraded":"2024-09-13T18:42:28.008165+0000","last_fullsized":"2024-09-13T18:42:28.008165+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:08.051825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007296+0000","last_change":"2024-09-13T18:42:26.716691+0000","last_active":"2024-09-13T18:42:28.007296+0000","last_peered":"2024-09-13T18:42:28.007296+0000","last_clean":"2024-09-13T18:42:28.007296+0000","last_became_active":"2024-09-13T18:42:26.715749+0000","last_became_peered":"2024-09-13T18:42:26.715749+0000","last_unstale":"2024-09-13T18:42:28.007296+0000","last_undegraded":"2024-09-13T18:42:28.007296+0000","last_fullsized":"2024-09-13T18:42:28.007296+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:35.229298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007097+0000","last_change":"2024-09-13T18:42:26.305714+0000","last_active":"2024-09-13T18:42:28.007097+0000","last_peered":"2024-09-13T18:42:28.007097+0000","last_clean":"2024-09-13T18:42:28.007097+0000","last_became_active":"2024-09-13T18:42:26.305371+0000","last_became_peered":"2024-09-13T18:42:26.305371+0000","last_unstale":"2024-09-13T18:42:28.007097+0000","last_undegraded":"2024-09-13T18:42:28.007097+0000","last_fullsized":"2024-09-13T18:42:28.007097+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:59.266730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709173+0000","last_change":"2024-09-13T18:42:26.710806+0000","last_active":"2024-09-13T18:42:27.709173+0000","last_peered":"2024-09-13T18:42:27.709173+0000","last_clean":"2024-09-13T18:42:27.709173+0000","last_became_active":"2024-09-13T18:42:26.710504+0000","last_became_peered":"2024-09-13T18:42:26.710504+0000","last_unstale":"2024-09-13T18:42:27.709173+0000","last_undegraded":"2024-09-13T18:42:27.709173+0000","last_fullsized":"2024-09-13T18:42:27.709173+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.525392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705944+0000","last_change":"2024-09-13T18:42:26.299369+0000","last_active":"2024-09-13T18:42:27.705944+0000","last_peered":"2024-09-13T18:42:27.705944+0000","last_clean":"2024-09-13T18:42:27.705944+0000","last_became_active":"2024-09-13T18:42:26.298294+0000","last_became_peered":"2024-09-13T18:42:26.298294+0000","last_unstale":"2024-09-13T18:42:27.705944+0000","last_undegraded":"2024-09-13T18:42:27.705944+0000","last_fullsized":"2024-09-13T18:42:27.705944+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.564811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-13T18:42:26.699727+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:42:26.699727+0000","last_peered":"2024-09-13T18:42:26.699727+0000","last_clean":"2024-09-13T18:42:26.699727+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:42:26.699727+0000","last_undegraded":"2024-09-13T18:42:26.699727+0000","last_fullsized":"2024-09-13T18:42:26.699727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193924,"statfs":{"total":200000000,"available":198579126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.313},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.34599999999999997},"max":{"1min":0.89200000000000002,"5min":1.014,"15min":1.014},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.64800000000000002},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84399999999999997,"5min":0.90500000000000003,"15min":0.94499999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77300000000000002,"5min":0.999,"15min":0.999},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.84199999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.47499999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":1.0189999999999999,"15min":6.0890000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.88800000000000001,"5min":1.036,"15min":1.036},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91800000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85999999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":1.101,"15min":1.371},"last":0.62}]},{"osd":7,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67100000000000004},"min":{"1min":0.53600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94399999999999995,"5min":1.143,"15min":1.143},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99399999999999999,"5min":1.125,"15min":1.125},"last":0.80900000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70099999999999996,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93300000000000005,"5min":1.665,"15min":1.665},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.64800000000000002},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.755},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85099999999999998,"5min":1.591,"15min":1.591},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":2.169,"15min":2.169},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97199999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92800000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.51900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":804,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194507,"statfs":{"total":200000000,"available":199175886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69999999999999996,"15min":0.82399999999999995},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92800000000000005,"5min":1.696,"15min":6.4539999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.999,"15min":0.999},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.84299999999999997},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.82699999999999996},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94099999999999995,"5min":1.032,"15min":1.032},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.879},"min":{"1min":0.53000000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.81999999999999995},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":1.004,"15min":6.2039999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.751},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.403,"15min":1.403},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97199999999999998,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.621}]},{"osd":1,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.70699999999999996,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73499999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":3.706,"15min":3.706},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.68400000000000005},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84099999999999997,"5min":3.742,"15min":3.742},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75700000000000001,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.63},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88100000000000001,"5min":1.552,"15min":1.552},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.90500000000000003,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.73199999999999998},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92800000000000005,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.55200000000000005,"5min":0.45800000000000002,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.89200000000000002,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.69299999999999995},"min":{"1min":0.57299999999999995,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":0.95799999999999996,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.54100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.754},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":8.1059999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57899999999999996,"5min":0.77800000000000002,"15min":4.7919999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.5,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.95399999999999996,"15min":7.798},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0800000000000001,"15min":3.093},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.01,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":1.1519999999999999,"15min":3.0299999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91200000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.98299999999999998},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.51800000000000002},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.91300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82499999999999996,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.71299999999999997},"min":{"1min":0.55200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.206,"15min":1.206},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96999999999999997,"5min":1.218,"15min":2.9900000000000002},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70799999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.442,"15min":0.47999999999999998},"min":{"1min":0.34999999999999998,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.50900000000000001},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.435,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.7030000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89300000000000002,"5min":1.075,"15min":1.1830000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72099999999999997,"15min":0.70099999999999996},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.02},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.079,"15min":1.079},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84999999999999998,"5min":1.0409999999999999,"15min":1.1850000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":1.097,"15min":1.1419999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.77200000000000002},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.96499999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198579218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.377}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":1.036,"15min":1.036},"last":0.434},{"interface":"front","average":{"1min":0.496,"5min":0.52400000000000002,"15min":0.47999999999999998},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56299999999999994,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80600000000000005,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.54200000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.75},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.242,"15min":1.242},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.53200000000000003},"max":{"1min":1.0509999999999999,"5min":1.21,"15min":1.21},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.753,"5min":0.81200000000000006,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96799999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":1.149,"15min":1.1539999999999999},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168934,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.436,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":1.669},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.27800000000000002,"15min":0.24099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.874},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.67500000000000004,"5min":0.76600000000000001,"15min":1.591},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.85899999999999999,"15min":1.637},"last":0.38}]},{"osd":4,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":1.2,"15min":1.2},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.698},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.74099999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":1.204,"15min":1.204},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.085,"5min":1.121,"15min":2.2589999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.044,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61199999999999999}]}]}],"pool_statfs":[]}} 2024-09-13T18:42:30.867 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:42:31.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.053+0000 7fb3f3a00640 1 Processor -- start 2024-09-13T18:42:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.054+0000 7fb3f3a00640 1 -- start start 2024-09-13T18:42:31.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 0x7fb3ec0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f3a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f3a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3ec0b2f00 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f3a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b3150 con 0x7fb3ec0b3f10 2024-09-13T18:42:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0b3430 con 0x7fb3ec15dee0 2024-09-13T18:42:31.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 0x7fb3ec0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3e3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3e3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:42746/0 (socket says 172.21.15.192:42746) 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3e3e00640 1 -- 172.21.15.192:0/3075910570 learned_addr learned my addr 172.21.15.192:0/3075910570 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.055+0000 7fb3f1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 0x7fb3ec0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:37112/0 (socket says 172.21.15.192:37112) 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.056+0000 7fb3e3e00640 1 -- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 msgr2=0x7fb3ec0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.056+0000 7fb3e3e00640 1 --2- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 0x7fb3ec0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.056+0000 7fb3e3e00640 1 -- 172.21.15.192:0/3075910570 >> v1:172.21.15.194:6789/0 conn(0x7fb3ec15e2c0 legacy=0x7fb3ec15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.056+0000 7fb3e3e00640 1 -- 172.21.15.192:0/3075910570 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3ec0b3710 con 0x7fb3ec0b3f10 2024-09-13T18:42:31.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.057+0000 7fb3e3e00640 1 --2- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009870 tx=0x7fb3d402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=791691688cf04628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.057+0000 7fb3ebe00640 1 -- 172.21.15.192:0/3075910570 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4032440 con 0x7fb3ec0b3f10 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.057+0000 7fb3ebe00640 1 -- 172.21.15.192:0/3075910570 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d40325a0 con 0x7fb3ec0b3f10 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.057+0000 7fb3ebe00640 1 -- 172.21.15.192:0/3075910570 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4032930 con 0x7fb3ec0b3f10 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 -- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec0b3f10 msgr2=0x7fb3ec0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4009870 tx=0x7fb3d402a270 comp rx=0 tx=0).stop 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 -- 172.21.15.192:0/3075910570 shutdown_connections 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec0b3f10 0x7fb3ec0b02c0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/3075910570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec15dee0 0x7fb3ec0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 -- 172.21.15.192:0/3075910570 >> 172.21.15.192:0/3075910570 conn(0x7fb3ec0ae960 msgr2=0x7fb3ec06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:31.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 -- 172.21.15.192:0/3075910570 shutdown_connections 2024-09-13T18:42:31.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.058+0000 7fb3f3a00640 1 -- 172.21.15.192:0/3075910570 wait complete. 2024-09-13T18:42:31.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.060+0000 7fb3f3a00640 1 Processor -- start 2024-09-13T18:42:31.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.060+0000 7fb3f3a00640 1 -- start start 2024-09-13T18:42:31.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec15dee0 0x7fb3ec153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec13eed0 0x7fb3ec13f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec155d00 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec13f990 con 0x7fb3ec15dee0 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec13fc70 con 0x7fb3ec13eed0 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3e3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55606/0 (socket says 172.21.15.192:55606) 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3e3e00640 1 -- 172.21.15.192:0/2144737136 learned_addr learned my addr 172.21.15.192:0/2144737136 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:31.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f1000640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec15dee0 0x7fb3ec153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.061+0000 7fb3f1a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec13eed0 0x7fb3ec13f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 -- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec13eed0 msgr2=0x7fb3ec13f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec13eed0 0x7fb3ec13f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 -- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec15dee0 msgr2=0x7fb3ec153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec15dee0 0x7fb3ec153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 -- 172.21.15.192:0/2144737136 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d40094d0 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e3e00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000c00 tx=0x7fb3d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4032440 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4030980 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4030d30 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.062+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec155920 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.063+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec1f3740 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.064+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec155780 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.064+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3d4039040 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.065+0000 7fb3e9600640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 0x7fb3c806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.065+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3d40a9b50 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.065+0000 7fb3f1000640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 0x7fb3c806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.066+0000 7fb3f1000640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 0x7fb3c806d0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec06acd0 tx=0x7fb3dc009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.069+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb3ec155780 con 0x7fb3ec15e2c0 2024-09-13T18:42:31.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.236+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3ec155e40 con 0x7fb3c806ac00 2024-09-13T18:42:31.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.243+0000 7fb3e9600640 1 -- 172.21.15.192:0/2144737136 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285221 (secure 0 0 0) 0x7fb3ec155e40 con 0x7fb3c806ac00 2024-09-13T18:42:31.249 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:31.251 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 msgr2=0x7fb3c806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 0x7fb3c806d0c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec06acd0 tx=0x7fb3dc009190 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 msgr2=0x7fb3ec156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4000c00 tx=0x7fb3d40046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 shutdown_connections 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3c806ac00 0x7fb3c806d0c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3ec13eed0 0x7fb3ec13f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3ec15e2c0 0x7fb3ec156120 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 --2- 172.21.15.192:0/2144737136 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3ec15dee0 0x7fb3ec153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 >> 172.21.15.192:0/2144737136 conn(0x7fb3ec0ae960 msgr2=0x7fb3ec159030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:31.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 shutdown_connections 2024-09-13T18:42:31.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.248+0000 7fb3f3a00640 1 -- 172.21.15.192:0/2144737136 wait complete. 2024-09-13T18:42:31.268 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2024-09-13T18:42:30.823355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":174,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7639,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554860,"statfs":{"total":1600000000,"available":1592177528,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.537066"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008571+0000","last_change":"2024-09-13T18:42:26.720020+0000","last_active":"2024-09-13T18:42:28.008571+0000","last_peered":"2024-09-13T18:42:28.008571+0000","last_clean":"2024-09-13T18:42:28.008571+0000","last_became_active":"2024-09-13T18:42:26.719465+0000","last_became_peered":"2024-09-13T18:42:26.719465+0000","last_unstale":"2024-09-13T18:42:28.008571+0000","last_undegraded":"2024-09-13T18:42:28.008571+0000","last_fullsized":"2024-09-13T18:42:28.008571+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:40.703721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705820+0000","last_change":"2024-09-13T18:42:26.706423+0000","last_active":"2024-09-13T18:42:27.705820+0000","last_peered":"2024-09-13T18:42:27.705820+0000","last_clean":"2024-09-13T18:42:27.705820+0000","last_became_active":"2024-09-13T18:42:26.704463+0000","last_became_peered":"2024-09-13T18:42:26.704463+0000","last_unstale":"2024-09-13T18:42:27.705820+0000","last_undegraded":"2024-09-13T18:42:27.705820+0000","last_fullsized":"2024-09-13T18:42:27.705820+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:30.789964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706572+0000","last_change":"2024-09-13T18:42:26.702146+0000","last_active":"2024-09-13T18:42:27.706572+0000","last_peered":"2024-09-13T18:42:27.706572+0000","last_clean":"2024-09-13T18:42:27.706572+0000","last_became_active":"2024-09-13T18:42:26.701895+0000","last_became_peered":"2024-09-13T18:42:26.701895+0000","last_unstale":"2024-09-13T18:42:27.706572+0000","last_undegraded":"2024-09-13T18:42:27.706572+0000","last_fullsized":"2024-09-13T18:42:27.706572+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:09:04.217007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709212+0000","last_change":"2024-09-13T18:42:26.713945+0000","last_active":"2024-09-13T18:42:27.709212+0000","last_peered":"2024-09-13T18:42:27.709212+0000","last_clean":"2024-09-13T18:42:27.709212+0000","last_became_active":"2024-09-13T18:42:26.713402+0000","last_became_peered":"2024-09-13T18:42:26.713402+0000","last_unstale":"2024-09-13T18:42:27.709212+0000","last_undegraded":"2024-09-13T18:42:27.709212+0000","last_fullsized":"2024-09-13T18:42:27.709212+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:52.457008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008155+0000","last_change":"2024-09-13T18:42:26.715513+0000","last_active":"2024-09-13T18:42:28.008155+0000","last_peered":"2024-09-13T18:42:28.008155+0000","last_clean":"2024-09-13T18:42:28.008155+0000","last_became_active":"2024-09-13T18:42:26.715273+0000","last_became_peered":"2024-09-13T18:42:26.715273+0000","last_unstale":"2024-09-13T18:42:28.008155+0000","last_undegraded":"2024-09-13T18:42:28.008155+0000","last_fullsized":"2024-09-13T18:42:28.008155+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:26:56.683988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007481+0000","last_change":"2024-09-13T18:42:26.712722+0000","last_active":"2024-09-13T18:42:28.007481+0000","last_peered":"2024-09-13T18:42:28.007481+0000","last_clean":"2024-09-13T18:42:28.007481+0000","last_became_active":"2024-09-13T18:42:26.712471+0000","last_became_peered":"2024-09-13T18:42:26.712471+0000","last_unstale":"2024-09-13T18:42:28.007481+0000","last_undegraded":"2024-09-13T18:42:28.007481+0000","last_fullsized":"2024-09-13T18:42:28.007481+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:48.428534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007159+0000","last_change":"2024-09-13T18:42:26.711762+0000","last_active":"2024-09-13T18:42:28.007159+0000","last_peered":"2024-09-13T18:42:28.007159+0000","last_clean":"2024-09-13T18:42:28.007159+0000","last_became_active":"2024-09-13T18:42:26.709953+0000","last_became_peered":"2024-09-13T18:42:26.709953+0000","last_unstale":"2024-09-13T18:42:28.007159+0000","last_undegraded":"2024-09-13T18:42:28.007159+0000","last_fullsized":"2024-09-13T18:42:28.007159+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:26:54.322814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006835+0000","last_change":"2024-09-13T18:42:26.718246+0000","last_active":"2024-09-13T18:42:28.006835+0000","last_peered":"2024-09-13T18:42:28.006835+0000","last_clean":"2024-09-13T18:42:28.006835+0000","last_became_active":"2024-09-13T18:42:26.717824+0000","last_became_peered":"2024-09-13T18:42:26.717824+0000","last_unstale":"2024-09-13T18:42:28.006835+0000","last_undegraded":"2024-09-13T18:42:28.006835+0000","last_fullsized":"2024-09-13T18:42:28.006835+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:42:39.759953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007281+0000","last_change":"2024-09-13T18:42:26.721785+0000","last_active":"2024-09-13T18:42:28.007281+0000","last_peered":"2024-09-13T18:42:28.007281+0000","last_clean":"2024-09-13T18:42:28.007281+0000","last_became_active":"2024-09-13T18:42:26.721127+0000","last_became_peered":"2024-09-13T18:42:26.721127+0000","last_unstale":"2024-09-13T18:42:28.007281+0000","last_undegraded":"2024-09-13T18:42:28.007281+0000","last_fullsized":"2024-09-13T18:42:28.007281+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:50.105639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007612+0000","last_change":"2024-09-13T18:42:26.712136+0000","last_active":"2024-09-13T18:42:28.007612+0000","last_peered":"2024-09-13T18:42:28.007612+0000","last_clean":"2024-09-13T18:42:28.007612+0000","last_became_active":"2024-09-13T18:42:26.711675+0000","last_became_peered":"2024-09-13T18:42:26.711675+0000","last_unstale":"2024-09-13T18:42:28.007612+0000","last_undegraded":"2024-09-13T18:42:28.007612+0000","last_fullsized":"2024-09-13T18:42:28.007612+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.007866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007302+0000","last_change":"2024-09-13T18:42:26.714400+0000","last_active":"2024-09-13T18:42:28.007302+0000","last_peered":"2024-09-13T18:42:28.007302+0000","last_clean":"2024-09-13T18:42:28.007302+0000","last_became_active":"2024-09-13T18:42:26.714143+0000","last_became_peered":"2024-09-13T18:42:26.714143+0000","last_unstale":"2024-09-13T18:42:28.007302+0000","last_undegraded":"2024-09-13T18:42:28.007302+0000","last_fullsized":"2024-09-13T18:42:28.007302+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:03:15.504825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007768+0000","last_change":"2024-09-13T18:42:26.720518+0000","last_active":"2024-09-13T18:42:28.007768+0000","last_peered":"2024-09-13T18:42:28.007768+0000","last_clean":"2024-09-13T18:42:28.007768+0000","last_became_active":"2024-09-13T18:42:26.719534+0000","last_became_peered":"2024-09-13T18:42:26.719534+0000","last_unstale":"2024-09-13T18:42:28.007768+0000","last_undegraded":"2024-09-13T18:42:28.007768+0000","last_fullsized":"2024-09-13T18:42:28.007768+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:13:13.567993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706029+0000","last_change":"2024-09-13T18:42:26.709432+0000","last_active":"2024-09-13T18:42:27.706029+0000","last_peered":"2024-09-13T18:42:27.706029+0000","last_clean":"2024-09-13T18:42:27.706029+0000","last_became_active":"2024-09-13T18:42:26.708886+0000","last_became_peered":"2024-09-13T18:42:26.708886+0000","last_unstale":"2024-09-13T18:42:27.706029+0000","last_undegraded":"2024-09-13T18:42:27.706029+0000","last_fullsized":"2024-09-13T18:42:27.706029+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.984032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006663+0000","last_change":"2024-09-13T18:42:26.715750+0000","last_active":"2024-09-13T18:42:28.006663+0000","last_peered":"2024-09-13T18:42:28.006663+0000","last_clean":"2024-09-13T18:42:28.006663+0000","last_became_active":"2024-09-13T18:42:26.714953+0000","last_became_peered":"2024-09-13T18:42:26.714953+0000","last_unstale":"2024-09-13T18:42:28.006663+0000","last_undegraded":"2024-09-13T18:42:28.006663+0000","last_fullsized":"2024-09-13T18:42:28.006663+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:03.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008660+0000","last_change":"2024-09-13T18:42:26.717284+0000","last_active":"2024-09-13T18:42:28.008660+0000","last_peered":"2024-09-13T18:42:28.008660+0000","last_clean":"2024-09-13T18:42:28.008660+0000","last_became_active":"2024-09-13T18:42:26.716726+0000","last_became_peered":"2024-09-13T18:42:26.716726+0000","last_unstale":"2024-09-13T18:42:28.008660+0000","last_undegraded":"2024-09-13T18:42:28.008660+0000","last_fullsized":"2024-09-13T18:42:28.008660+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:29.180195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007524+0000","last_change":"2024-09-13T18:42:26.714125+0000","last_active":"2024-09-13T18:42:28.007524+0000","last_peered":"2024-09-13T18:42:28.007524+0000","last_clean":"2024-09-13T18:42:28.007524+0000","last_became_active":"2024-09-13T18:42:26.713608+0000","last_became_peered":"2024-09-13T18:42:26.713608+0000","last_unstale":"2024-09-13T18:42:28.007524+0000","last_undegraded":"2024-09-13T18:42:28.007524+0000","last_fullsized":"2024-09-13T18:42:28.007524+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:14.761847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706385+0000","last_change":"2024-09-13T18:42:26.707438+0000","last_active":"2024-09-13T18:42:27.706385+0000","last_peered":"2024-09-13T18:42:27.706385+0000","last_clean":"2024-09-13T18:42:27.706385+0000","last_became_active":"2024-09-13T18:42:26.707239+0000","last_became_peered":"2024-09-13T18:42:26.707239+0000","last_unstale":"2024-09-13T18:42:27.706385+0000","last_undegraded":"2024-09-13T18:42:27.706385+0000","last_fullsized":"2024-09-13T18:42:27.706385+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:35:45.724121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006925+0000","last_change":"2024-09-13T18:42:26.718063+0000","last_active":"2024-09-13T18:42:28.006925+0000","last_peered":"2024-09-13T18:42:28.006925+0000","last_clean":"2024-09-13T18:42:28.006925+0000","last_became_active":"2024-09-13T18:42:26.715211+0000","last_became_peered":"2024-09-13T18:42:26.715211+0000","last_unstale":"2024-09-13T18:42:28.006925+0000","last_undegraded":"2024-09-13T18:42:28.006925+0000","last_fullsized":"2024-09-13T18:42:28.006925+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:08.829811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706386+0000","last_change":"2024-09-13T18:42:26.710825+0000","last_active":"2024-09-13T18:42:27.706386+0000","last_peered":"2024-09-13T18:42:27.706386+0000","last_clean":"2024-09-13T18:42:27.706386+0000","last_became_active":"2024-09-13T18:42:26.709198+0000","last_became_peered":"2024-09-13T18:42:26.709198+0000","last_unstale":"2024-09-13T18:42:27.706386+0000","last_undegraded":"2024-09-13T18:42:27.706386+0000","last_fullsized":"2024-09-13T18:42:27.706386+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:16:50.014156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706449+0000","last_change":"2024-09-13T18:42:26.704469+0000","last_active":"2024-09-13T18:42:27.706449+0000","last_peered":"2024-09-13T18:42:27.706449+0000","last_clean":"2024-09-13T18:42:27.706449+0000","last_became_active":"2024-09-13T18:42:26.704252+0000","last_became_peered":"2024-09-13T18:42:26.704252+0000","last_unstale":"2024-09-13T18:42:27.706449+0000","last_undegraded":"2024-09-13T18:42:27.706449+0000","last_fullsized":"2024-09-13T18:42:27.706449+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:43:15.998094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007393+0000","last_change":"2024-09-13T18:42:26.713031+0000","last_active":"2024-09-13T18:42:28.007393+0000","last_peered":"2024-09-13T18:42:28.007393+0000","last_clean":"2024-09-13T18:42:28.007393+0000","last_became_active":"2024-09-13T18:42:26.712792+0000","last_became_peered":"2024-09-13T18:42:26.712792+0000","last_unstale":"2024-09-13T18:42:28.007393+0000","last_undegraded":"2024-09-13T18:42:28.007393+0000","last_fullsized":"2024-09-13T18:42:28.007393+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:12:58.778300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007851+0000","last_change":"2024-09-13T18:42:26.711891+0000","last_active":"2024-09-13T18:42:28.007851+0000","last_peered":"2024-09-13T18:42:28.007851+0000","last_clean":"2024-09-13T18:42:28.007851+0000","last_became_active":"2024-09-13T18:42:26.711680+0000","last_became_peered":"2024-09-13T18:42:26.711680+0000","last_unstale":"2024-09-13T18:42:28.007851+0000","last_undegraded":"2024-09-13T18:42:28.007851+0000","last_fullsized":"2024-09-13T18:42:28.007851+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:12.167764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006662+0000","last_change":"2024-09-13T18:42:26.718097+0000","last_active":"2024-09-13T18:42:28.006662+0000","last_peered":"2024-09-13T18:42:28.006662+0000","last_clean":"2024-09-13T18:42:28.006662+0000","last_became_active":"2024-09-13T18:42:26.715042+0000","last_became_peered":"2024-09-13T18:42:26.715042+0000","last_unstale":"2024-09-13T18:42:28.006662+0000","last_undegraded":"2024-09-13T18:42:28.006662+0000","last_fullsized":"2024-09-13T18:42:28.006662+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:50.105639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709308+0000","last_change":"2024-09-13T18:42:26.714094+0000","last_active":"2024-09-13T18:42:27.709308+0000","last_peered":"2024-09-13T18:42:27.709308+0000","last_clean":"2024-09-13T18:42:27.709308+0000","last_became_active":"2024-09-13T18:42:26.713725+0000","last_became_peered":"2024-09-13T18:42:26.713725+0000","last_unstale":"2024-09-13T18:42:27.709308+0000","last_undegraded":"2024-09-13T18:42:27.709308+0000","last_fullsized":"2024-09-13T18:42:27.709308+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.102034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007445+0000","last_change":"2024-09-13T18:42:26.716067+0000","last_active":"2024-09-13T18:42:28.007445+0000","last_peered":"2024-09-13T18:42:28.007445+0000","last_clean":"2024-09-13T18:42:28.007445+0000","last_became_active":"2024-09-13T18:42:26.715838+0000","last_became_peered":"2024-09-13T18:42:26.715838+0000","last_unstale":"2024-09-13T18:42:28.007445+0000","last_undegraded":"2024-09-13T18:42:28.007445+0000","last_fullsized":"2024-09-13T18:42:28.007445+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:12:42.080821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007716+0000","last_change":"2024-09-13T18:42:26.716290+0000","last_active":"2024-09-13T18:42:28.007716+0000","last_peered":"2024-09-13T18:42:28.007716+0000","last_clean":"2024-09-13T18:42:28.007716+0000","last_became_active":"2024-09-13T18:42:26.716066+0000","last_became_peered":"2024-09-13T18:42:26.716066+0000","last_unstale":"2024-09-13T18:42:28.007716+0000","last_undegraded":"2024-09-13T18:42:28.007716+0000","last_fullsized":"2024-09-13T18:42:28.007716+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:31:34.061395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.708995+0000","last_change":"2024-09-13T18:42:26.715224+0000","last_active":"2024-09-13T18:42:27.708995+0000","last_peered":"2024-09-13T18:42:27.708995+0000","last_clean":"2024-09-13T18:42:27.708995+0000","last_became_active":"2024-09-13T18:42:26.714961+0000","last_became_peered":"2024-09-13T18:42:26.714961+0000","last_unstale":"2024-09-13T18:42:27.708995+0000","last_undegraded":"2024-09-13T18:42:27.708995+0000","last_fullsized":"2024-09-13T18:42:27.708995+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:52.729015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007199+0000","last_change":"2024-09-13T18:42:26.711204+0000","last_active":"2024-09-13T18:42:28.007199+0000","last_peered":"2024-09-13T18:42:28.007199+0000","last_clean":"2024-09-13T18:42:28.007199+0000","last_became_active":"2024-09-13T18:42:26.709873+0000","last_became_peered":"2024-09-13T18:42:26.709873+0000","last_unstale":"2024-09-13T18:42:28.007199+0000","last_undegraded":"2024-09-13T18:42:28.007199+0000","last_fullsized":"2024-09-13T18:42:28.007199+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:43:52.457008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006758+0000","last_change":"2024-09-13T18:42:26.715566+0000","last_active":"2024-09-13T18:42:28.006758+0000","last_peered":"2024-09-13T18:42:28.006758+0000","last_clean":"2024-09-13T18:42:28.006758+0000","last_became_active":"2024-09-13T18:42:26.714412+0000","last_became_peered":"2024-09-13T18:42:26.714412+0000","last_unstale":"2024-09-13T18:42:28.006758+0000","last_undegraded":"2024-09-13T18:42:28.006758+0000","last_fullsized":"2024-09-13T18:42:28.006758+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:54:29.180195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007523+0000","last_change":"2024-09-13T18:42:26.711899+0000","last_active":"2024-09-13T18:42:28.007523+0000","last_peered":"2024-09-13T18:42:28.007523+0000","last_clean":"2024-09-13T18:42:28.007523+0000","last_became_active":"2024-09-13T18:42:26.711617+0000","last_became_peered":"2024-09-13T18:42:26.711617+0000","last_unstale":"2024-09-13T18:42:28.007523+0000","last_undegraded":"2024-09-13T18:42:28.007523+0000","last_fullsized":"2024-09-13T18:42:28.007523+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:37:48.922377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008631+0000","last_change":"2024-09-13T18:42:26.719812+0000","last_active":"2024-09-13T18:42:28.008631+0000","last_peered":"2024-09-13T18:42:28.008631+0000","last_clean":"2024-09-13T18:42:28.008631+0000","last_became_active":"2024-09-13T18:42:26.719059+0000","last_became_peered":"2024-09-13T18:42:26.719059+0000","last_unstale":"2024-09-13T18:42:28.008631+0000","last_undegraded":"2024-09-13T18:42:28.008631+0000","last_fullsized":"2024-09-13T18:42:28.008631+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:00.272587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007914+0000","last_change":"2024-09-13T18:42:26.707962+0000","last_active":"2024-09-13T18:42:28.007914+0000","last_peered":"2024-09-13T18:42:28.007914+0000","last_clean":"2024-09-13T18:42:28.007914+0000","last_became_active":"2024-09-13T18:42:26.707733+0000","last_became_peered":"2024-09-13T18:42:26.707733+0000","last_unstale":"2024-09-13T18:42:28.007914+0000","last_undegraded":"2024-09-13T18:42:28.007914+0000","last_fullsized":"2024-09-13T18:42:28.007914+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:15:55.722519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007371+0000","last_change":"2024-09-13T18:42:26.721570+0000","last_active":"2024-09-13T18:42:28.007371+0000","last_peered":"2024-09-13T18:42:28.007371+0000","last_clean":"2024-09-13T18:42:28.007371+0000","last_became_active":"2024-09-13T18:42:26.720806+0000","last_became_peered":"2024-09-13T18:42:26.720806+0000","last_unstale":"2024-09-13T18:42:28.007371+0000","last_undegraded":"2024-09-13T18:42:28.007371+0000","last_fullsized":"2024-09-13T18:42:28.007371+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:18:30.789964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1f","version":"148'4","reported_seq":15,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006960+0000","last_change":"2024-09-13T18:42:26.298090+0000","last_active":"2024-09-13T18:42:28.006960+0000","last_peered":"2024-09-13T18:42:28.006960+0000","last_clean":"2024-09-13T18:42:28.006960+0000","last_became_active":"2024-09-13T18:42:26.297136+0000","last_became_peered":"2024-09-13T18:42:26.297136+0000","last_unstale":"2024-09-13T18:42:28.006960+0000","last_undegraded":"2024-09-13T18:42:28.006960+0000","last_fullsized":"2024-09-13T18:42:28.006960+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:02:12.211686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006763+0000","last_change":"2024-09-13T18:42:26.717928+0000","last_active":"2024-09-13T18:42:28.006763+0000","last_peered":"2024-09-13T18:42:28.006763+0000","last_clean":"2024-09-13T18:42:28.006763+0000","last_became_active":"2024-09-13T18:42:26.713189+0000","last_became_peered":"2024-09-13T18:42:26.713189+0000","last_unstale":"2024-09-13T18:42:28.006763+0000","last_undegraded":"2024-09-13T18:42:28.006763+0000","last_fullsized":"2024-09-13T18:42:28.006763+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:53.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1e","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706037+0000","last_change":"2024-09-13T18:42:26.294193+0000","last_active":"2024-09-13T18:42:27.706037+0000","last_peered":"2024-09-13T18:42:27.706037+0000","last_clean":"2024-09-13T18:42:27.706037+0000","last_became_active":"2024-09-13T18:42:26.293971+0000","last_became_peered":"2024-09-13T18:42:26.293971+0000","last_unstale":"2024-09-13T18:42:27.706037+0000","last_undegraded":"2024-09-13T18:42:27.706037+0000","last_fullsized":"2024-09-13T18:42:27.706037+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:50:33.029705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007565+0000","last_change":"2024-09-13T18:42:26.715378+0000","last_active":"2024-09-13T18:42:28.007565+0000","last_peered":"2024-09-13T18:42:28.007565+0000","last_clean":"2024-09-13T18:42:28.007565+0000","last_became_active":"2024-09-13T18:42:26.715159+0000","last_became_peered":"2024-09-13T18:42:26.715159+0000","last_unstale":"2024-09-13T18:42:28.007565+0000","last_undegraded":"2024-09-13T18:42:28.007565+0000","last_fullsized":"2024-09-13T18:42:28.007565+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:10:39.717272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.1d","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709383+0000","last_change":"2024-09-13T18:42:26.302642+0000","last_active":"2024-09-13T18:42:27.709383+0000","last_peered":"2024-09-13T18:42:27.709383+0000","last_clean":"2024-09-13T18:42:27.709383+0000","last_became_active":"2024-09-13T18:42:26.302215+0000","last_became_peered":"2024-09-13T18:42:26.302215+0000","last_unstale":"2024-09-13T18:42:27.709383+0000","last_undegraded":"2024-09-13T18:42:27.709383+0000","last_fullsized":"2024-09-13T18:42:27.709383+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:13.822126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706536+0000","last_change":"2024-09-13T18:42:26.710344+0000","last_active":"2024-09-13T18:42:27.706536+0000","last_peered":"2024-09-13T18:42:27.706536+0000","last_clean":"2024-09-13T18:42:27.706536+0000","last_became_active":"2024-09-13T18:42:26.710121+0000","last_became_peered":"2024-09-13T18:42:26.710121+0000","last_unstale":"2024-09-13T18:42:27.706536+0000","last_undegraded":"2024-09-13T18:42:27.706536+0000","last_fullsized":"2024-09-13T18:42:27.706536+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:08:24.584095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1c","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709151+0000","last_change":"2024-09-13T18:42:26.307045+0000","last_active":"2024-09-13T18:42:27.709151+0000","last_peered":"2024-09-13T18:42:27.709151+0000","last_clean":"2024-09-13T18:42:27.709151+0000","last_became_active":"2024-09-13T18:42:26.303978+0000","last_became_peered":"2024-09-13T18:42:26.303978+0000","last_unstale":"2024-09-13T18:42:27.709151+0000","last_undegraded":"2024-09-13T18:42:27.709151+0000","last_fullsized":"2024-09-13T18:42:27.709151+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:27.530953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.708928+0000","last_change":"2024-09-13T18:42:26.714659+0000","last_active":"2024-09-13T18:42:27.708928+0000","last_peered":"2024-09-13T18:42:27.708928+0000","last_clean":"2024-09-13T18:42:27.708928+0000","last_became_active":"2024-09-13T18:42:26.714450+0000","last_became_peered":"2024-09-13T18:42:26.714450+0000","last_unstale":"2024-09-13T18:42:27.708928+0000","last_undegraded":"2024-09-13T18:42:27.708928+0000","last_fullsized":"2024-09-13T18:42:27.708928+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:03.016312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1b","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706658+0000","last_change":"2024-09-13T18:42:26.307130+0000","last_active":"2024-09-13T18:42:27.706658+0000","last_peered":"2024-09-13T18:42:27.706658+0000","last_clean":"2024-09-13T18:42:27.706658+0000","last_became_active":"2024-09-13T18:42:26.306901+0000","last_became_peered":"2024-09-13T18:42:26.306901+0000","last_unstale":"2024-09-13T18:42:27.706658+0000","last_undegraded":"2024-09-13T18:42:27.706658+0000","last_fullsized":"2024-09-13T18:42:27.706658+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:04:27.532708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007251+0000","last_change":"2024-09-13T18:42:26.712203+0000","last_active":"2024-09-13T18:42:28.007251+0000","last_peered":"2024-09-13T18:42:28.007251+0000","last_clean":"2024-09-13T18:42:28.007251+0000","last_became_active":"2024-09-13T18:42:26.711978+0000","last_became_peered":"2024-09-13T18:42:26.711978+0000","last_unstale":"2024-09-13T18:42:28.007251+0000","last_undegraded":"2024-09-13T18:42:28.007251+0000","last_fullsized":"2024-09-13T18:42:28.007251+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:01:50.397364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.1a","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007897+0000","last_change":"2024-09-13T18:42:26.305765+0000","last_active":"2024-09-13T18:42:28.007897+0000","last_peered":"2024-09-13T18:42:28.007897+0000","last_clean":"2024-09-13T18:42:28.007897+0000","last_became_active":"2024-09-13T18:42:26.303968+0000","last_became_peered":"2024-09-13T18:42:26.303968+0000","last_unstale":"2024-09-13T18:42:28.007897+0000","last_undegraded":"2024-09-13T18:42:28.007897+0000","last_fullsized":"2024-09-13T18:42:28.007897+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:50:38.478770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007714+0000","last_change":"2024-09-13T18:42:26.708965+0000","last_active":"2024-09-13T18:42:28.007714+0000","last_peered":"2024-09-13T18:42:28.007714+0000","last_clean":"2024-09-13T18:42:28.007714+0000","last_became_active":"2024-09-13T18:42:26.708419+0000","last_became_peered":"2024-09-13T18:42:26.708419+0000","last_unstale":"2024-09-13T18:42:28.007714+0000","last_undegraded":"2024-09-13T18:42:28.007714+0000","last_fullsized":"2024-09-13T18:42:28.007714+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:59:55.768015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006972+0000","last_change":"2024-09-13T18:42:26.301171+0000","last_active":"2024-09-13T18:42:28.006972+0000","last_peered":"2024-09-13T18:42:28.006972+0000","last_clean":"2024-09-13T18:42:28.006972+0000","last_became_active":"2024-09-13T18:42:26.300917+0000","last_became_peered":"2024-09-13T18:42:26.300917+0000","last_unstale":"2024-09-13T18:42:28.006972+0000","last_undegraded":"2024-09-13T18:42:28.006972+0000","last_fullsized":"2024-09-13T18:42:28.006972+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:07:03.801310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006823+0000","last_change":"2024-09-13T18:42:26.712544+0000","last_active":"2024-09-13T18:42:28.006823+0000","last_peered":"2024-09-13T18:42:28.006823+0000","last_clean":"2024-09-13T18:42:28.006823+0000","last_became_active":"2024-09-13T18:42:26.712133+0000","last_became_peered":"2024-09-13T18:42:26.712133+0000","last_unstale":"2024-09-13T18:42:28.006823+0000","last_undegraded":"2024-09-13T18:42:28.006823+0000","last_fullsized":"2024-09-13T18:42:28.006823+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:05:34.325498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008064+0000","last_change":"2024-09-13T18:42:26.307923+0000","last_active":"2024-09-13T18:42:28.008064+0000","last_peered":"2024-09-13T18:42:28.008064+0000","last_clean":"2024-09-13T18:42:28.008064+0000","last_became_active":"2024-09-13T18:42:26.307707+0000","last_became_peered":"2024-09-13T18:42:26.307707+0000","last_unstale":"2024-09-13T18:42:28.008064+0000","last_undegraded":"2024-09-13T18:42:28.008064+0000","last_fullsized":"2024-09-13T18:42:28.008064+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:58:46.346598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705870+0000","last_change":"2024-09-13T18:42:26.714123+0000","last_active":"2024-09-13T18:42:27.705870+0000","last_peered":"2024-09-13T18:42:27.705870+0000","last_clean":"2024-09-13T18:42:27.705870+0000","last_became_active":"2024-09-13T18:42:26.713893+0000","last_became_peered":"2024-09-13T18:42:26.713893+0000","last_unstale":"2024-09-13T18:42:27.705870+0000","last_undegraded":"2024-09-13T18:42:27.705870+0000","last_fullsized":"2024-09-13T18:42:27.705870+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:19:53.421139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709274+0000","last_change":"2024-09-13T18:42:26.307921+0000","last_active":"2024-09-13T18:42:27.709274+0000","last_peered":"2024-09-13T18:42:27.709274+0000","last_clean":"2024-09-13T18:42:27.709274+0000","last_became_active":"2024-09-13T18:42:26.306360+0000","last_became_peered":"2024-09-13T18:42:26.306360+0000","last_unstale":"2024-09-13T18:42:27.709274+0000","last_undegraded":"2024-09-13T18:42:27.709274+0000","last_fullsized":"2024-09-13T18:42:27.709274+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:46:29.983463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705772+0000","last_change":"2024-09-13T18:42:26.707645+0000","last_active":"2024-09-13T18:42:27.705772+0000","last_peered":"2024-09-13T18:42:27.705772+0000","last_clean":"2024-09-13T18:42:27.705772+0000","last_became_active":"2024-09-13T18:42:26.707445+0000","last_became_peered":"2024-09-13T18:42:26.707445+0000","last_unstale":"2024-09-13T18:42:27.705772+0000","last_undegraded":"2024-09-13T18:42:27.705772+0000","last_fullsized":"2024-09-13T18:42:27.705772+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:14.827984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007964+0000","last_change":"2024-09-13T18:42:26.295078+0000","last_active":"2024-09-13T18:42:28.007964+0000","last_peered":"2024-09-13T18:42:28.007964+0000","last_clean":"2024-09-13T18:42:28.007964+0000","last_became_active":"2024-09-13T18:42:26.294829+0000","last_became_peered":"2024-09-13T18:42:26.294829+0000","last_unstale":"2024-09-13T18:42:28.007964+0000","last_undegraded":"2024-09-13T18:42:28.007964+0000","last_fullsized":"2024-09-13T18:42:28.007964+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:32:30.120189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007211+0000","last_change":"2024-09-13T18:42:26.717261+0000","last_active":"2024-09-13T18:42:28.007211+0000","last_peered":"2024-09-13T18:42:28.007211+0000","last_clean":"2024-09-13T18:42:28.007211+0000","last_became_active":"2024-09-13T18:42:26.717026+0000","last_became_peered":"2024-09-13T18:42:26.717026+0000","last_unstale":"2024-09-13T18:42:28.007211+0000","last_undegraded":"2024-09-13T18:42:28.007211+0000","last_fullsized":"2024-09-13T18:42:28.007211+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:59:06.102034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.15","version":"148'3","reported_seq":14,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007555+0000","last_change":"2024-09-13T18:42:26.297528+0000","last_active":"2024-09-13T18:42:28.007555+0000","last_peered":"2024-09-13T18:42:28.007555+0000","last_clean":"2024-09-13T18:42:28.007555+0000","last_became_active":"2024-09-13T18:42:26.297285+0000","last_became_peered":"2024-09-13T18:42:26.297285+0000","last_unstale":"2024-09-13T18:42:28.007555+0000","last_undegraded":"2024-09-13T18:42:28.007555+0000","last_fullsized":"2024-09-13T18:42:28.007555+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:33:55.706500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007003+0000","last_change":"2024-09-13T18:42:26.713245+0000","last_active":"2024-09-13T18:42:28.007003+0000","last_peered":"2024-09-13T18:42:28.007003+0000","last_clean":"2024-09-13T18:42:28.007003+0000","last_became_active":"2024-09-13T18:42:26.711323+0000","last_became_peered":"2024-09-13T18:42:26.711323+0000","last_unstale":"2024-09-13T18:42:28.007003+0000","last_undegraded":"2024-09-13T18:42:28.007003+0000","last_fullsized":"2024-09-13T18:42:28.007003+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:46:19.937679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.14","version":"148'6","reported_seq":17,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709413+0000","last_change":"2024-09-13T18:42:26.307046+0000","last_active":"2024-09-13T18:42:27.709413+0000","last_peered":"2024-09-13T18:42:27.709413+0000","last_clean":"2024-09-13T18:42:27.709413+0000","last_became_active":"2024-09-13T18:42:26.305921+0000","last_became_peered":"2024-09-13T18:42:26.305921+0000","last_unstale":"2024-09-13T18:42:27.709413+0000","last_undegraded":"2024-09-13T18:42:27.709413+0000","last_fullsized":"2024-09-13T18:42:27.709413+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:52:07.120194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007620+0000","last_change":"2024-09-13T18:42:26.713962+0000","last_active":"2024-09-13T18:42:28.007620+0000","last_peered":"2024-09-13T18:42:28.007620+0000","last_clean":"2024-09-13T18:42:28.007620+0000","last_became_active":"2024-09-13T18:42:26.713231+0000","last_became_peered":"2024-09-13T18:42:26.713231+0000","last_unstale":"2024-09-13T18:42:28.007620+0000","last_undegraded":"2024-09-13T18:42:28.007620+0000","last_fullsized":"2024-09-13T18:42:28.007620+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:16:05.416533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.13","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008236+0000","last_change":"2024-09-13T18:42:26.293986+0000","last_active":"2024-09-13T18:42:28.008236+0000","last_peered":"2024-09-13T18:42:28.008236+0000","last_clean":"2024-09-13T18:42:28.008236+0000","last_became_active":"2024-09-13T18:42:26.293191+0000","last_became_peered":"2024-09-13T18:42:26.293191+0000","last_unstale":"2024-09-13T18:42:28.008236+0000","last_undegraded":"2024-09-13T18:42:28.008236+0000","last_fullsized":"2024-09-13T18:42:28.008236+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:44.972470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709087+0000","last_change":"2024-09-13T18:42:26.708794+0000","last_active":"2024-09-13T18:42:27.709087+0000","last_peered":"2024-09-13T18:42:27.709087+0000","last_clean":"2024-09-13T18:42:27.709087+0000","last_became_active":"2024-09-13T18:42:26.708495+0000","last_became_peered":"2024-09-13T18:42:26.708495+0000","last_unstale":"2024-09-13T18:42:27.709087+0000","last_undegraded":"2024-09-13T18:42:27.709087+0000","last_fullsized":"2024-09-13T18:42:27.709087+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:52.908939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706578+0000","last_change":"2024-09-13T18:42:26.298881+0000","last_active":"2024-09-13T18:42:27.706578+0000","last_peered":"2024-09-13T18:42:27.706578+0000","last_clean":"2024-09-13T18:42:27.706578+0000","last_became_active":"2024-09-13T18:42:26.298655+0000","last_became_peered":"2024-09-13T18:42:26.298655+0000","last_unstale":"2024-09-13T18:42:27.706578+0000","last_undegraded":"2024-09-13T18:42:27.706578+0000","last_fullsized":"2024-09-13T18:42:27.706578+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:23:09.118198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709155+0000","last_change":"2024-09-13T18:42:26.707511+0000","last_active":"2024-09-13T18:42:27.709155+0000","last_peered":"2024-09-13T18:42:27.709155+0000","last_clean":"2024-09-13T18:42:27.709155+0000","last_became_active":"2024-09-13T18:42:26.707262+0000","last_became_peered":"2024-09-13T18:42:26.707262+0000","last_unstale":"2024-09-13T18:42:27.709155+0000","last_undegraded":"2024-09-13T18:42:27.709155+0000","last_fullsized":"2024-09-13T18:42:27.709155+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.10","version":"148'8","reported_seq":19,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008082+0000","last_change":"2024-09-13T18:42:26.305614+0000","last_active":"2024-09-13T18:42:28.008082+0000","last_peered":"2024-09-13T18:42:28.008082+0000","last_clean":"2024-09-13T18:42:28.008082+0000","last_became_active":"2024-09-13T18:42:26.303743+0000","last_became_peered":"2024-09-13T18:42:26.303743+0000","last_unstale":"2024-09-13T18:42:28.008082+0000","last_undegraded":"2024-09-13T18:42:28.008082+0000","last_fullsized":"2024-09-13T18:42:28.008082+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:47.173185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008712+0000","last_change":"2024-09-13T18:42:26.712450+0000","last_active":"2024-09-13T18:42:28.008712+0000","last_peered":"2024-09-13T18:42:28.008712+0000","last_clean":"2024-09-13T18:42:28.008712+0000","last_became_active":"2024-09-13T18:42:26.712225+0000","last_became_peered":"2024-09-13T18:42:26.712225+0000","last_unstale":"2024-09-13T18:42:28.008712+0000","last_undegraded":"2024-09-13T18:42:28.008712+0000","last_fullsized":"2024-09-13T18:42:28.008712+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.f","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007302+0000","last_change":"2024-09-13T18:42:26.305578+0000","last_active":"2024-09-13T18:42:28.007302+0000","last_peered":"2024-09-13T18:42:28.007302+0000","last_clean":"2024-09-13T18:42:28.007302+0000","last_became_active":"2024-09-13T18:42:26.305141+0000","last_became_peered":"2024-09-13T18:42:26.305141+0000","last_unstale":"2024-09-13T18:42:28.007302+0000","last_undegraded":"2024-09-13T18:42:28.007302+0000","last_fullsized":"2024-09-13T18:42:28.007302+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:49.099781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007456+0000","last_change":"2024-09-13T18:42:26.721352+0000","last_active":"2024-09-13T18:42:28.007456+0000","last_peered":"2024-09-13T18:42:28.007456+0000","last_clean":"2024-09-13T18:42:28.007456+0000","last_became_active":"2024-09-13T18:42:26.720214+0000","last_became_peered":"2024-09-13T18:42:26.720214+0000","last_unstale":"2024-09-13T18:42:28.007456+0000","last_undegraded":"2024-09-13T18:42:28.007456+0000","last_fullsized":"2024-09-13T18:42:28.007456+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:27:14.827984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.e","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008317+0000","last_change":"2024-09-13T18:42:26.294139+0000","last_active":"2024-09-13T18:42:28.008317+0000","last_peered":"2024-09-13T18:42:28.008317+0000","last_clean":"2024-09-13T18:42:28.008317+0000","last_became_active":"2024-09-13T18:42:26.293759+0000","last_became_peered":"2024-09-13T18:42:26.293759+0000","last_unstale":"2024-09-13T18:42:28.008317+0000","last_undegraded":"2024-09-13T18:42:28.008317+0000","last_fullsized":"2024-09-13T18:42:28.008317+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:14:25.030490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007336+0000","last_change":"2024-09-13T18:42:26.714685+0000","last_active":"2024-09-13T18:42:28.007336+0000","last_peered":"2024-09-13T18:42:28.007336+0000","last_clean":"2024-09-13T18:42:28.007336+0000","last_became_active":"2024-09-13T18:42:26.714454+0000","last_became_peered":"2024-09-13T18:42:26.714454+0000","last_unstale":"2024-09-13T18:42:28.007336+0000","last_undegraded":"2024-09-13T18:42:28.007336+0000","last_fullsized":"2024-09-13T18:42:28.007336+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:37:59.509240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.d","version":"148'1","reported_seq":12,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007183+0000","last_change":"2024-09-13T18:42:26.308244+0000","last_active":"2024-09-13T18:42:28.007183+0000","last_peered":"2024-09-13T18:42:28.007183+0000","last_clean":"2024-09-13T18:42:28.007183+0000","last_became_active":"2024-09-13T18:42:26.307958+0000","last_became_peered":"2024-09-13T18:42:26.307958+0000","last_unstale":"2024-09-13T18:42:28.007183+0000","last_undegraded":"2024-09-13T18:42:28.007183+0000","last_fullsized":"2024-09-13T18:42:28.007183+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:40:47.173185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007033+0000","last_change":"2024-09-13T18:42:26.711726+0000","last_active":"2024-09-13T18:42:28.007033+0000","last_peered":"2024-09-13T18:42:28.007033+0000","last_clean":"2024-09-13T18:42:28.007033+0000","last_became_active":"2024-09-13T18:42:26.710538+0000","last_became_peered":"2024-09-13T18:42:26.710538+0000","last_unstale":"2024-09-13T18:42:28.007033+0000","last_undegraded":"2024-09-13T18:42:28.007033+0000","last_fullsized":"2024-09-13T18:42:28.007033+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:36:00.272587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006870+0000","last_change":"2024-09-13T18:42:26.302134+0000","last_active":"2024-09-13T18:42:28.006870+0000","last_peered":"2024-09-13T18:42:28.006870+0000","last_clean":"2024-09-13T18:42:28.006870+0000","last_became_active":"2024-09-13T18:42:26.301833+0000","last_became_peered":"2024-09-13T18:42:26.301833+0000","last_unstale":"2024-09-13T18:42:28.006870+0000","last_undegraded":"2024-09-13T18:42:28.006870+0000","last_fullsized":"2024-09-13T18:42:28.006870+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:08.051825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706533+0000","last_change":"2024-09-13T18:42:26.702041+0000","last_active":"2024-09-13T18:42:27.706533+0000","last_peered":"2024-09-13T18:42:27.706533+0000","last_clean":"2024-09-13T18:42:27.706533+0000","last_became_active":"2024-09-13T18:42:26.701818+0000","last_became_peered":"2024-09-13T18:42:26.701818+0000","last_unstale":"2024-09-13T18:42:27.706533+0000","last_undegraded":"2024-09-13T18:42:27.706533+0000","last_fullsized":"2024-09-13T18:42:27.706533+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:29:22.007866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.b","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007651+0000","last_change":"2024-09-13T18:42:26.295495+0000","last_active":"2024-09-13T18:42:28.007651+0000","last_peered":"2024-09-13T18:42:28.007651+0000","last_clean":"2024-09-13T18:42:28.007651+0000","last_became_active":"2024-09-13T18:42:26.295095+0000","last_became_peered":"2024-09-13T18:42:26.295095+0000","last_unstale":"2024-09-13T18:42:28.007651+0000","last_undegraded":"2024-09-13T18:42:28.007651+0000","last_fullsized":"2024-09-13T18:42:28.007651+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:27.734455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007986+0000","last_change":"2024-09-13T18:42:26.714205+0000","last_active":"2024-09-13T18:42:28.007986+0000","last_peered":"2024-09-13T18:42:28.007986+0000","last_clean":"2024-09-13T18:42:28.007986+0000","last_became_active":"2024-09-13T18:42:26.713959+0000","last_became_peered":"2024-09-13T18:42:26.713959+0000","last_unstale":"2024-09-13T18:42:28.007986+0000","last_undegraded":"2024-09-13T18:42:28.007986+0000","last_fullsized":"2024-09-13T18:42:28.007986+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:39.403729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007539+0000","last_change":"2024-09-13T18:42:26.304687+0000","last_active":"2024-09-13T18:42:28.007539+0000","last_peered":"2024-09-13T18:42:28.007539+0000","last_clean":"2024-09-13T18:42:28.007539+0000","last_became_active":"2024-09-13T18:42:26.303290+0000","last_became_peered":"2024-09-13T18:42:26.303290+0000","last_unstale":"2024-09-13T18:42:28.007539+0000","last_undegraded":"2024-09-13T18:42:28.007539+0000","last_fullsized":"2024-09-13T18:42:28.007539+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:11.962621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007079+0000","last_change":"2024-09-13T18:42:26.715619+0000","last_active":"2024-09-13T18:42:28.007079+0000","last_peered":"2024-09-13T18:42:28.007079+0000","last_clean":"2024-09-13T18:42:28.007079+0000","last_became_active":"2024-09-13T18:42:26.714596+0000","last_became_peered":"2024-09-13T18:42:26.714596+0000","last_unstale":"2024-09-13T18:42:28.007079+0000","last_undegraded":"2024-09-13T18:42:28.007079+0000","last_fullsized":"2024-09-13T18:42:28.007079+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:20.504215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709488+0000","last_change":"2024-09-13T18:42:26.305486+0000","last_active":"2024-09-13T18:42:27.709488+0000","last_peered":"2024-09-13T18:42:27.709488+0000","last_clean":"2024-09-13T18:42:27.709488+0000","last_became_active":"2024-09-13T18:42:26.305188+0000","last_became_peered":"2024-09-13T18:42:26.305188+0000","last_unstale":"2024-09-13T18:42:27.709488+0000","last_undegraded":"2024-09-13T18:42:27.709488+0000","last_fullsized":"2024-09-13T18:42:27.709488+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:40:37.515035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007816+0000","last_change":"2024-09-13T18:42:26.709124+0000","last_active":"2024-09-13T18:42:28.007816+0000","last_peered":"2024-09-13T18:42:28.007816+0000","last_clean":"2024-09-13T18:42:28.007816+0000","last_became_active":"2024-09-13T18:42:26.708729+0000","last_became_peered":"2024-09-13T18:42:26.708729+0000","last_unstale":"2024-09-13T18:42:28.007816+0000","last_undegraded":"2024-09-13T18:42:28.007816+0000","last_fullsized":"2024-09-13T18:42:28.007816+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:01.563067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709352+0000","last_change":"2024-09-13T18:42:26.308324+0000","last_active":"2024-09-13T18:42:27.709352+0000","last_peered":"2024-09-13T18:42:27.709352+0000","last_clean":"2024-09-13T18:42:27.709352+0000","last_became_active":"2024-09-13T18:42:26.306768+0000","last_became_peered":"2024-09-13T18:42:26.306768+0000","last_unstale":"2024-09-13T18:42:27.709352+0000","last_undegraded":"2024-09-13T18:42:27.709352+0000","last_fullsized":"2024-09-13T18:42:27.709352+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:04.986823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006865+0000","last_change":"2024-09-13T18:42:26.718242+0000","last_active":"2024-09-13T18:42:28.006865+0000","last_peered":"2024-09-13T18:42:28.006865+0000","last_clean":"2024-09-13T18:42:28.006865+0000","last_became_active":"2024-09-13T18:42:26.715342+0000","last_became_peered":"2024-09-13T18:42:26.715342+0000","last_unstale":"2024-09-13T18:42:28.006865+0000","last_undegraded":"2024-09-13T18:42:28.006865+0000","last_fullsized":"2024-09-13T18:42:28.006865+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:51:16.226709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.7","version":"148'2","reported_seq":13,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709485+0000","last_change":"2024-09-13T18:42:26.305296+0000","last_active":"2024-09-13T18:42:27.709485+0000","last_peered":"2024-09-13T18:42:27.709485+0000","last_clean":"2024-09-13T18:42:27.709485+0000","last_became_active":"2024-09-13T18:42:26.304660+0000","last_became_peered":"2024-09-13T18:42:26.304660+0000","last_unstale":"2024-09-13T18:42:27.709485+0000","last_undegraded":"2024-09-13T18:42:27.709485+0000","last_fullsized":"2024-09-13T18:42:27.709485+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:22.978175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007939+0000","last_change":"2024-09-13T18:42:26.714908+0000","last_active":"2024-09-13T18:42:28.007939+0000","last_peered":"2024-09-13T18:42:28.007939+0000","last_clean":"2024-09-13T18:42:28.007939+0000","last_became_active":"2024-09-13T18:42:26.714689+0000","last_became_peered":"2024-09-13T18:42:26.714689+0000","last_unstale":"2024-09-13T18:42:28.007939+0000","last_undegraded":"2024-09-13T18:42:28.007939+0000","last_fullsized":"2024-09-13T18:42:28.007939+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:53.034185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007049+0000","last_change":"2024-09-13T18:42:26.308785+0000","last_active":"2024-09-13T18:42:28.007049+0000","last_peered":"2024-09-13T18:42:28.007049+0000","last_clean":"2024-09-13T18:42:28.007049+0000","last_became_active":"2024-09-13T18:42:26.308596+0000","last_became_peered":"2024-09-13T18:42:26.308596+0000","last_unstale":"2024-09-13T18:42:28.007049+0000","last_undegraded":"2024-09-13T18:42:28.007049+0000","last_fullsized":"2024-09-13T18:42:28.007049+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:39.440252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008760+0000","last_change":"2024-09-13T18:42:26.717129+0000","last_active":"2024-09-13T18:42:28.008760+0000","last_peered":"2024-09-13T18:42:28.008760+0000","last_clean":"2024-09-13T18:42:28.008760+0000","last_became_active":"2024-09-13T18:42:26.715970+0000","last_became_peered":"2024-09-13T18:42:26.715970+0000","last_unstale":"2024-09-13T18:42:28.008760+0000","last_undegraded":"2024-09-13T18:42:28.008760+0000","last_fullsized":"2024-09-13T18:42:28.008760+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:04:20.504215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709492+0000","last_change":"2024-09-13T18:42:26.307185+0000","last_active":"2024-09-13T18:42:27.709492+0000","last_peered":"2024-09-13T18:42:27.709492+0000","last_clean":"2024-09-13T18:42:27.709492+0000","last_became_active":"2024-09-13T18:42:26.306511+0000","last_became_peered":"2024-09-13T18:42:26.306511+0000","last_unstale":"2024-09-13T18:42:27.709492+0000","last_undegraded":"2024-09-13T18:42:27.709492+0000","last_fullsized":"2024-09-13T18:42:27.709492+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:34:06.866101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006853+0000","last_change":"2024-09-13T18:42:26.710165+0000","last_active":"2024-09-13T18:42:28.006853+0000","last_peered":"2024-09-13T18:42:28.006853+0000","last_clean":"2024-09-13T18:42:28.006853+0000","last_became_active":"2024-09-13T18:42:26.709949+0000","last_became_peered":"2024-09-13T18:42:26.709949+0000","last_unstale":"2024-09-13T18:42:28.006853+0000","last_undegraded":"2024-09-13T18:42:28.006853+0000","last_fullsized":"2024-09-13T18:42:28.006853+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:39.403729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709571+0000","last_change":"2024-09-13T18:42:26.308086+0000","last_active":"2024-09-13T18:42:27.709571+0000","last_peered":"2024-09-13T18:42:27.709571+0000","last_clean":"2024-09-13T18:42:27.709571+0000","last_became_active":"2024-09-13T18:42:26.307839+0000","last_became_peered":"2024-09-13T18:42:26.307839+0000","last_unstale":"2024-09-13T18:42:27.709571+0000","last_undegraded":"2024-09-13T18:42:27.709571+0000","last_fullsized":"2024-09-13T18:42:27.709571+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.564811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.706497+0000","last_change":"2024-09-13T18:42:26.704811+0000","last_active":"2024-09-13T18:42:27.706497+0000","last_peered":"2024-09-13T18:42:27.706497+0000","last_clean":"2024-09-13T18:42:27.706497+0000","last_became_active":"2024-09-13T18:42:26.704553+0000","last_became_peered":"2024-09-13T18:42:26.704553+0000","last_unstale":"2024-09-13T18:42:27.706497+0000","last_undegraded":"2024-09-13T18:42:27.706497+0000","last_fullsized":"2024-09-13T18:42:27.706497+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:12:39.478507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007468+0000","last_change":"2024-09-13T18:42:26.303518+0000","last_active":"2024-09-13T18:42:28.007468+0000","last_peered":"2024-09-13T18:42:28.007468+0000","last_clean":"2024-09-13T18:42:28.007468+0000","last_became_active":"2024-09-13T18:42:26.303299+0000","last_became_peered":"2024-09-13T18:42:26.303299+0000","last_unstale":"2024-09-13T18:42:28.007468+0000","last_undegraded":"2024-09-13T18:42:28.007468+0000","last_fullsized":"2024-09-13T18:42:28.007468+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:21:11.416179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007137+0000","last_change":"2024-09-13T18:42:26.711841+0000","last_active":"2024-09-13T18:42:28.007137+0000","last_peered":"2024-09-13T18:42:28.007137+0000","last_clean":"2024-09-13T18:42:28.007137+0000","last_became_active":"2024-09-13T18:42:26.710862+0000","last_became_peered":"2024-09-13T18:42:26.710862+0000","last_unstale":"2024-09-13T18:42:28.007137+0000","last_undegraded":"2024-09-13T18:42:28.007137+0000","last_fullsized":"2024-09-13T18:42:28.007137+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:40.703721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006953+0000","last_change":"2024-09-13T18:42:26.304239+0000","last_active":"2024-09-13T18:42:28.006953+0000","last_peered":"2024-09-13T18:42:28.006953+0000","last_clean":"2024-09-13T18:42:28.006953+0000","last_became_active":"2024-09-13T18:42:26.304053+0000","last_became_peered":"2024-09-13T18:42:26.304053+0000","last_unstale":"2024-09-13T18:42:28.006953+0000","last_undegraded":"2024-09-13T18:42:28.006953+0000","last_fullsized":"2024-09-13T18:42:28.006953+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:34:11.962621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.006947+0000","last_change":"2024-09-13T18:42:26.715870+0000","last_active":"2024-09-13T18:42:28.006947+0000","last_peered":"2024-09-13T18:42:28.006947+0000","last_clean":"2024-09-13T18:42:28.006947+0000","last_became_active":"2024-09-13T18:42:26.715325+0000","last_became_peered":"2024-09-13T18:42:26.715325+0000","last_unstale":"2024-09-13T18:42:28.006947+0000","last_undegraded":"2024-09-13T18:42:28.006947+0000","last_fullsized":"2024-09-13T18:42:28.006947+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:46:23.984032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.008165+0000","last_change":"2024-09-13T18:42:26.304192+0000","last_active":"2024-09-13T18:42:28.008165+0000","last_peered":"2024-09-13T18:42:28.008165+0000","last_clean":"2024-09-13T18:42:28.008165+0000","last_became_active":"2024-09-13T18:42:26.302777+0000","last_became_peered":"2024-09-13T18:42:26.302777+0000","last_unstale":"2024-09-13T18:42:28.008165+0000","last_undegraded":"2024-09-13T18:42:28.008165+0000","last_fullsized":"2024-09-13T18:42:28.008165+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:59:08.051825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007296+0000","last_change":"2024-09-13T18:42:26.716691+0000","last_active":"2024-09-13T18:42:28.007296+0000","last_peered":"2024-09-13T18:42:28.007296+0000","last_clean":"2024-09-13T18:42:28.007296+0000","last_became_active":"2024-09-13T18:42:26.715749+0000","last_became_peered":"2024-09-13T18:42:26.715749+0000","last_unstale":"2024-09-13T18:42:28.007296+0000","last_undegraded":"2024-09-13T18:42:28.007296+0000","last_fullsized":"2024-09-13T18:42:28.007296+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:00:35.229298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:28.007097+0000","last_change":"2024-09-13T18:42:26.305714+0000","last_active":"2024-09-13T18:42:28.007097+0000","last_peered":"2024-09-13T18:42:28.007097+0000","last_clean":"2024-09-13T18:42:28.007097+0000","last_became_active":"2024-09-13T18:42:26.305371+0000","last_became_peered":"2024-09-13T18:42:26.305371+0000","last_unstale":"2024-09-13T18:42:28.007097+0000","last_undegraded":"2024-09-13T18:42:28.007097+0000","last_fullsized":"2024-09-13T18:42:28.007097+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:59.266730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.709173+0000","last_change":"2024-09-13T18:42:26.710806+0000","last_active":"2024-09-13T18:42:27.709173+0000","last_peered":"2024-09-13T18:42:27.709173+0000","last_clean":"2024-09-13T18:42:27.709173+0000","last_became_active":"2024-09-13T18:42:26.710504+0000","last_became_peered":"2024-09-13T18:42:26.710504+0000","last_unstale":"2024-09-13T18:42:27.709173+0000","last_undegraded":"2024-09-13T18:42:27.709173+0000","last_fullsized":"2024-09-13T18:42:27.709173+0000","mapping_epoch":147,"log_start":"0'0","ondisk_log_start":"0'0","created":147,"last_epoch_clean":148,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:26.285392+0000","last_clean_scrub_stamp":"2024-09-13T18:42:26.285392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:17:14.525392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-09-13T18:42:27.705944+0000","last_change":"2024-09-13T18:42:26.299369+0000","last_active":"2024-09-13T18:42:27.705944+0000","last_peered":"2024-09-13T18:42:27.705944+0000","last_clean":"2024-09-13T18:42:27.705944+0000","last_became_active":"2024-09-13T18:42:26.298294+0000","last_became_peered":"2024-09-13T18:42:26.298294+0000","last_unstale":"2024-09-13T18:42:27.705944+0000","last_undegraded":"2024-09-13T18:42:27.705944+0000","last_fullsized":"2024-09-13T18:42:27.705944+0000","mapping_epoch":146,"log_start":"0'0","ondisk_log_start":"0'0","created":146,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:42:25.279534+0000","last_clean_scrub_stamp":"2024-09-13T18:42:25.279534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.564811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":282,"reported_epoch":148,"state":"active+clean","last_fresh":"2024-09-13T18:42:26.699727+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:42:26.699727+0000","last_peered":"2024-09-13T18:42:26.699727+0000","last_clean":"2024-09-13T18:42:26.699727+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:42:26.699727+0000","last_undegraded":"2024-09-13T18:42:26.699727+0000","last_fullsized":"2024-09-13T18:42:26.699727+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542232,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193924,"statfs":{"total":200000000,"available":198579126,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66800000000000004,"15min":0.63200000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.313},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67900000000000005,"15min":0.63100000000000001},"min":{"1min":0.46100000000000002,"5min":0.42499999999999999,"15min":0.34599999999999997},"max":{"1min":0.89200000000000002,"5min":1.014,"15min":1.014},"last":0.72399999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.622,"5min":0.67600000000000005,"15min":0.64800000000000002},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.66500000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.68100000000000005,"15min":0.65600000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.84399999999999997,"5min":0.90500000000000003,"15min":0.94499999999999995},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.64900000000000002},"min":{"1min":0.437,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.77300000000000002,"5min":0.999,"15min":0.999},"last":0.57199999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.72499999999999998,"15min":0.84199999999999997},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.47499999999999998},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.497},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.70399999999999996,"15min":0.84599999999999997},"min":{"1min":0.52200000000000002,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":1.0189999999999999,"15min":6.0890000000000004},"last":0.59599999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.33400000000000002,"15min":0.313},"max":{"1min":0.88800000000000001,"5min":1.036,"15min":1.036},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.61899999999999999,"15min":0.61699999999999999},"min":{"1min":0.42299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91800000000000004,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.54900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.66600000000000004,"15min":0.64300000000000002},"min":{"1min":0.39200000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.85999999999999999,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69499999999999995,"15min":0.71699999999999997},"min":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.91600000000000004,"5min":1.101,"15min":1.371},"last":0.62}]},{"osd":7,"last update":"Fri Sep 13 18:41:37 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.69599999999999995,"15min":0.67100000000000004},"min":{"1min":0.53600000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94399999999999995,"5min":1.143,"15min":1.143},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.69499999999999995,"15min":0.68200000000000005},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.99399999999999999,"5min":1.125,"15min":1.125},"last":0.80900000000000005}]}]},{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167898,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.70099999999999996,"15min":0.64400000000000002},"min":{"1min":0.45700000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93300000000000005,"5min":1.665,"15min":1.665},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67600000000000005,"15min":0.63600000000000001},"min":{"1min":0.45400000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.54500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.64800000000000002},"min":{"1min":0.51000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":0.88300000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.755},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.67700000000000005,"15min":0.64700000000000002},"min":{"1min":0.498,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.85099999999999998,"5min":1.591,"15min":1.591},"last":0.56399999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73799999999999999,"15min":0.68100000000000005},"min":{"1min":0.52500000000000002,"5min":0.48399999999999999,"15min":0.44800000000000001},"max":{"1min":1.0049999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.73499999999999999,"15min":0.70199999999999996},"min":{"1min":0.47599999999999998,"5min":0.435,"15min":0.435},"max":{"1min":1.0680000000000001,"5min":2.169,"15min":2.169},"last":0.58399999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.72999999999999998,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.97199999999999998,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.64600000000000002},"min":{"1min":0.52000000000000002,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.627}]},{"osd":4,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.57299999999999995,"15min":0.58899999999999997},"min":{"1min":0.44700000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79800000000000004,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.61299999999999999,"15min":0.64500000000000002},"min":{"1min":0.38500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.92800000000000005,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.60199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70299999999999996,"15min":0.67600000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.96899999999999997,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65800000000000003,"15min":0.65200000000000002},"min":{"1min":0.51900000000000002,"5min":0.372,"15min":0.372},"max":{"1min":1.0169999999999999,"5min":1.115,"15min":1.115},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:41:38 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.70699999999999996,"15min":0.70199999999999996},"min":{"1min":0.53400000000000003,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.73699999999999999,"15min":0.73499999999999999},"min":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.83099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":804,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194507,"statfs":{"total":200000000,"available":199175886,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.69999999999999996,"15min":0.82399999999999995},"min":{"1min":0.39300000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.92800000000000005,"5min":1.696,"15min":6.4539999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66200000000000003,"15min":0.63500000000000001},"min":{"1min":0.439,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82899999999999996,"5min":0.999,"15min":0.999},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.69499999999999995,"15min":0.84299999999999997},"min":{"1min":0.48099999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68899999999999995,"15min":0.82699999999999996},"min":{"1min":0.499,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.92200000000000004,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.69199999999999995}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.68300000000000005,"15min":0.64700000000000002},"min":{"1min":0.46600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94099999999999995,"5min":1.032,"15min":1.032},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.752,"5min":0.70999999999999996,"15min":0.879},"min":{"1min":0.53000000000000003,"5min":0.441,"15min":0.441},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.71799999999999997,"15min":0.81999999999999995},"min":{"1min":0.48599999999999999,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.89000000000000001,"5min":1.004,"15min":6.2039999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.69799999999999995,"15min":0.65800000000000003},"min":{"1min":0.46800000000000003,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.98199999999999998,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.66500000000000004,"15min":0.63},"min":{"1min":0.50900000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.94499999999999995,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.751},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.68999999999999995,"15min":0.68400000000000005},"min":{"1min":0.41499999999999998,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.95099999999999996,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67100000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.374,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.96199999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.65800000000000003,"15min":0.622},"min":{"1min":0.45400000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80100000000000005,"5min":1.403,"15min":1.403},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69499999999999995,"15min":0.67900000000000005},"min":{"1min":0.41699999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97199999999999998,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73099999999999998,"15min":0.69099999999999995},"min":{"1min":0.5,"5min":0.5,"15min":0.45500000000000002},"max":{"1min":0.91400000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.81599999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194499,"statfs":{"total":200000000,"available":199167932,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.69699999999999995,"15min":0.66600000000000004},"min":{"1min":0.44600000000000001,"5min":0.40100000000000002,"15min":0.39800000000000002},"max":{"1min":0.99299999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.63,"5min":0.69299999999999995,"15min":0.64700000000000002},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.92800000000000005,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.621}]},{"osd":1,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.71299999999999997,"15min":0.67700000000000005},"min":{"1min":0.49099999999999999,"5min":0.47299999999999998,"15min":0.40400000000000003},"max":{"1min":0.83899999999999997,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.70699999999999996,"15min":0.68200000000000005},"min":{"1min":0.51300000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.73499999999999999,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.75800000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.74099999999999999,"15min":0.69899999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.84199999999999997,"5min":3.706,"15min":3.706},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.74099999999999999,"15min":0.68400000000000005},"min":{"1min":0.47099999999999997,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84099999999999997,"5min":3.742,"15min":3.742},"last":0.73499999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.75700000000000001,"15min":0.70999999999999996},"min":{"1min":0.56899999999999995,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.873,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.63},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.67200000000000004},"min":{"1min":0.47399999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.88100000000000001,"5min":1.552,"15min":1.552},"last":0.59399999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63,"15min":0.60799999999999998},"min":{"1min":0.436,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":0.90500000000000003,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.621,"15min":0.59299999999999997},"min":{"1min":0.52800000000000002,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":0.83999999999999997,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.65800000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.81499999999999995,"15min":0.73199999999999998},"min":{"1min":0.55100000000000005,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.92800000000000005,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72999999999999998,"15min":0.69199999999999995},"min":{"1min":0.55200000000000005,"5min":0.45800000000000002,"15min":0.36399999999999999},"max":{"1min":0.94499999999999995,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.57499999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:42 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.89200000000000002,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.73699999999999999,"15min":0.69299999999999995},"min":{"1min":0.57299999999999995,"5min":0.501,"15min":0.44800000000000001},"max":{"1min":0.95799999999999996,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.79500000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":810,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194501,"statfs":{"total":200000000,"available":199169586,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.41599999999999998,"15min":0.44500000000000001},"min":{"1min":0.308,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.57299999999999995,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.46000000000000002,"15min":0.44900000000000001},"min":{"1min":0.33800000000000002,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.54100000000000004,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.34999999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48599999999999999,"15min":0.754},"min":{"1min":0.36199999999999999,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":1.546,"5min":1.546,"15min":8.1059999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.46800000000000003,"15min":0.56999999999999995},"min":{"1min":0.32900000000000001,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51800000000000002,"15min":0.60899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.57899999999999996,"5min":0.77800000000000002,"15min":4.7919999999999998},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.5,"15min":0.70399999999999996},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79100000000000004,"5min":0.95399999999999996,"15min":7.798},"last":0.40799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.53600000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.96299999999999997,"5min":1.0800000000000001,"15min":3.093},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.76600000000000001,"15min":0.74199999999999999},"min":{"1min":0.56200000000000006,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.01,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.65100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.78500000000000003,"15min":0.80300000000000005},"min":{"1min":0.57499999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.91400000000000003,"5min":1.1519999999999999,"15min":3.0299999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.76300000000000001,"15min":0.72199999999999998},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.91200000000000003,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.79500000000000004,"15min":0.98299999999999998},"min":{"1min":0.626,"5min":0.57799999999999996,"15min":0.51800000000000002},"max":{"1min":0.98999999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.73999999999999999,"15min":0.91300000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82499999999999996,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.77500000000000002,"15min":0.71299999999999997},"min":{"1min":0.55200000000000005,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.99199999999999999,"5min":1.206,"15min":1.206},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.79900000000000004,"15min":0.84699999999999998},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.96999999999999997,"5min":1.218,"15min":2.9900000000000002},"last":0.78300000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.26900000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.63100000000000001,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44900000000000001,"15min":0.45500000000000002},"min":{"1min":0.29899999999999999,"5min":0.27700000000000002,"15min":0.253},"max":{"1min":0.65400000000000003,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"min":{"1min":0.32000000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.70799999999999996,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.442,"15min":0.47999999999999998},"min":{"1min":0.34999999999999998,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.60099999999999998,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.38}]},{"osd":3,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.49099999999999999,"15min":0.50900000000000001},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.30499999999999999},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56000000000000005,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.435,"15min":0.34499999999999997},"max":{"1min":0.71399999999999997,"5min":0.81299999999999994,"15min":1.7030000000000001},"last":0.49099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.72799999999999998,"15min":0.71599999999999997},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.89300000000000002,"5min":1.075,"15min":1.1830000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.72099999999999997,"15min":0.70099999999999996},"min":{"1min":0.505,"5min":0.49199999999999999,"15min":0.48099999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.02},"last":0.68300000000000005}]},{"osd":5,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.78500000000000003,"15min":0.76300000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.93100000000000005,"5min":1.079,"15min":1.079},"last":0.75}]},{"osd":6,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.74199999999999999,"15min":0.72399999999999998},"min":{"1min":0.48899999999999999,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.84999999999999998,"5min":1.0409999999999999,"15min":1.1850000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.73299999999999998,"15min":0.70199999999999996},"min":{"1min":0.48299999999999998,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.88300000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":0.82899999999999996}]},{"osd":7,"last update":"Fri Sep 13 18:41:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.76300000000000001,"15min":0.74099999999999999},"min":{"1min":0.54300000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"max":{"1min":0.88,"5min":1.097,"15min":1.1419999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.79700000000000004,"15min":0.77200000000000002},"min":{"1min":0.55900000000000005,"5min":0.502,"15min":0.502},"max":{"1min":0.96499999999999997,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1387,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193925,"statfs":{"total":200000000,"available":198579218,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45200000000000001,"15min":0.438},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.23999999999999999},"max":{"1min":0.67100000000000004,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.49099999999999999,"15min":0.48099999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.377}]},{"osd":2,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32500000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.63100000000000001,"5min":1.036,"15min":1.036},"last":0.434},{"interface":"front","average":{"1min":0.496,"5min":0.52400000000000002,"15min":0.47999999999999998},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.51300000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.56299999999999994,"15min":0.51700000000000002},"min":{"1min":0.41399999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82499999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52400000000000002,"15min":0.51000000000000001},"min":{"1min":0.39500000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.80600000000000005,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.44700000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.79400000000000004,"15min":0.76200000000000001},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.54200000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47699999999999998,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.3,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.72199999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:41:44 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.42599999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.75},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.46600000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0289999999999999,"5min":1.242,"15min":1.242},"last":0.85799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.79500000000000004,"15min":0.78100000000000003},"min":{"1min":0.56499999999999995,"5min":0.55500000000000005,"15min":0.53200000000000003},"max":{"1min":1.0509999999999999,"5min":1.21,"15min":1.21},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.753,"5min":0.81200000000000006,"15min":0.77700000000000002},"min":{"1min":0.53300000000000003,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.042,"5min":1.278,"15min":1.278},"last":0.80700000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:41:35 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76800000000000002,"15min":0.751},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.96799999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.78100000000000003,"15min":0.77100000000000002},"min":{"1min":0.60599999999999998,"5min":0.5,"15min":0.5},"max":{"1min":1.1399999999999999,"5min":1.149,"15min":1.1539999999999999},"last":0.63}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":811,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194500,"statfs":{"total":200000000,"available":199168934,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.436,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":1.669},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.45400000000000001,"15min":0.44900000000000001},"min":{"1min":0.29499999999999998,"5min":0.27800000000000002,"15min":0.24099999999999999},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.874},"last":0.42399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.67500000000000004,"5min":0.76600000000000001,"15min":1.591},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.499,"15min":0.47899999999999998},"min":{"1min":0.371,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.45500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.47399999999999998,"15min":0.46200000000000002},"min":{"1min":0.32100000000000001,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.53100000000000003,"15min":0.53900000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.73399999999999999,"5min":0.85899999999999999,"15min":1.637},"last":0.38}]},{"osd":4,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72699999999999998,"15min":0.69999999999999996},"min":{"1min":0.54200000000000004,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.88300000000000001,"5min":1.2,"15min":1.2},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.53000000000000003,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.94499999999999995,"5min":1.006,"15min":1.698},"last":0.52700000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:41:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.78600000000000003,"15min":0.74099999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":1.204,"15min":1.204},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76800000000000002,"15min":0.78200000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.085,"5min":1.121,"15min":2.2589999999999999},"last":0.503}]},{"osd":6,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.73399999999999999,"15min":0.752},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.95699999999999996,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.751,"15min":0.70999999999999996},"min":{"1min":0.50600000000000001,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.92900000000000005,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:41:41 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73799999999999999,"15min":0.75900000000000001},"min":{"1min":0.53300000000000003,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.044,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.74399999999999999,"15min":0.69199999999999995},"min":{"1min":0.53600000000000003,"5min":0.52200000000000002,"15min":0.47999999999999998},"max":{"1min":0.96699999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61199999999999999}]}]}],"pool_statfs":[]}} 2024-09-13T18:42:31.273 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:42:31.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:42:31.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.469+0000 7fe081200640 1 Processor -- start 2024-09-13T18:42:31.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.469+0000 7fe081200640 1 -- start start 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe081200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe07c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe081200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c06cc40 con 0x7fe07c1434c0 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe081200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c06b480 con 0x7fe07c0b3bd0 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe081200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b4060 con 0x7fe07c06c800 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe079e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe07c1434c0 0x7fe07c06a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52884/0 (socket says 172.21.15.192:52884) 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe079e00640 1 -- 172.21.15.192:0/2829819923 learned_addr learned my addr 172.21.15.192:0/2829819923 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe079400640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe07c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304700439 0 0) 0x7fe07c06cc40 con 0x7fe07c1434c0 2024-09-13T18:42:31.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe060003520 con 0x7fe07c1434c0 2024-09-13T18:42:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.471+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1574608917 0 0) 0x7fe060003520 con 0x7fe07c1434c0 2024-09-13T18:42:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 msgr2=0x7fe07c0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe07c0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 >> v1:172.21.15.194:6789/0 conn(0x7fe07c0b3bd0 legacy=0x7fe07c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c06b760 con 0x7fe07c1434c0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe06c001670 con 0x7fe07c1434c0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 >> v1:172.21.15.192:6789/0 conn(0x7fe07c1434c0 legacy=0x7fe07c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe0600039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe060003ee0 0x7fe0600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe060004d00 0x7fe060005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0b4060 con 0x7fe060003ee0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe06000dbf0 con 0x7fe060004d00 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06000ddb0 con 0x7fe07c06c800 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe079400640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe060003ee0 0x7fe0600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe079e00640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe0600039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.472+0000 7fe07a800640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe060004d00 0x7fe060005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.473+0000 7fe079400640 1 -- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 msgr2=0x7fe0600039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:31.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.473+0000 7fe079400640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe07c06c800 0x7fe0600039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.473+0000 7fe079400640 1 -- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe060004d00 msgr2=0x7fe060005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.473+0000 7fe079400640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe060004d00 0x7fe060005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.473+0000 7fe079400640 1 -- 172.21.15.192:0/2829819923 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe060003520 con 0x7fe060003ee0 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe079400640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe060003ee0 0x7fe0600047c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe068009ac0 tx=0x7fe0600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1799f4279a7123c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031400 con 0x7fe060003ee0 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe06802d050 con 0x7fe060003ee0 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe078a00640 1 -- 172.21.15.192:0/2829819923 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068031780 con 0x7fe060003ee0 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe081200640 1 -- 172.21.15.192:0/2829819923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe060003ee0 msgr2=0x7fe0600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe081200640 1 --2- 172.21.15.192:0/2829819923 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe060003ee0 0x7fe0600047c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe068009ac0 tx=0x7fe0600057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe07a800640 1 -- 172.21.15.192:0/2829819923 reap_dead start 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe081200640 1 -- 172.21.15.192:0/2829819923 shutdown_connections 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe081200640 1 -- 172.21.15.192:0/2829819923 >> 172.21.15.192:0/2829819923 conn(0x7fe07c0b08f0 msgr2=0x7fe07c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.474+0000 7fe081200640 1 -- 172.21.15.192:0/2829819923 shutdown_connections 2024-09-13T18:42:31.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.475+0000 7fe081200640 1 -- 172.21.15.192:0/2829819923 wait complete. 2024-09-13T18:42:31.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.476+0000 7fe081200640 1 Processor -- start 2024-09-13T18:42:31.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.476+0000 7fe081200640 1 -- start start 2024-09-13T18:42:31.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe060003ee0 0x7fe07c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe07c138af0 0x7fe07c138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c1e1e40 con 0x7fe07c139690 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c139490 con 0x7fe07c138af0 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe081200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c139b90 con 0x7fe060003ee0 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe079400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe079400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55618/0 (socket says 172.21.15.192:55618) 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe079400640 1 -- 172.21.15.192:0/249722061 learned_addr learned my addr 172.21.15.192:0/249722061 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.477+0000 7fe079e00640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe060003ee0 0x7fe07c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe07a800640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe07c138af0 0x7fe07c138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 -- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe060003ee0 msgr2=0x7fe07c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe060003ee0 0x7fe07c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 -- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe07c138af0 msgr2=0x7fe07c138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe07c138af0 0x7fe07c138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 -- 172.21.15.192:0/249722061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c1e2090 con 0x7fe07c139690 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe079400640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe06802aa10 tx=0x7fe068004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068003c90 con 0x7fe07c139690 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe068003df0 con 0x7fe07c139690 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.478+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c1e2370 con 0x7fe07c139690 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.479+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe068044650 con 0x7fe07c139690 2024-09-13T18:42:31.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.479+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c1562f0 con 0x7fe07c139690 2024-09-13T18:42:31.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.480+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c0cc7d0 con 0x7fe07c139690 2024-09-13T18:42:31.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.480+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe068038070 con 0x7fe07c139690 2024-09-13T18:42:31.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.481+0000 7fe072000640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.481+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0680a98d0 con 0x7fe07c139690 2024-09-13T18:42:31.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.482+0000 7fe079e00640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.482+0000 7fe079e00640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 0x7fe05c06d0f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe06c001050 tx=0x7fe06c000f80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.485+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe068074ac0 con 0x7fe07c139690 2024-09-13T18:42:31.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.717+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe07c0707e0 con 0x7fe07c139690 2024-09-13T18:42:31.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.721+0000 7fe072000640 1 -- 172.21.15.192:0/249722061 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe0680490e0 con 0x7fe07c139690 2024-09-13T18:42:31.724 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 msgr2=0x7fe05c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 0x7fe05c06d0f0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fe06c001050 tx=0x7fe06c000f80 comp rx=0 tx=0).stop 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 msgr2=0x7fe07c0adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe06802aa10 tx=0x7fe068004730 comp rx=0 tx=0).stop 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 shutdown_connections 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe05c06ac30 0x7fe05c06d0f0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe07c138af0 0x7fe07c138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe07c139690 0x7fe07c0adab0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 --2- 172.21.15.192:0/249722061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe060003ee0 0x7fe07c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 >> 172.21.15.192:0/249722061 conn(0x7fe07c0b08f0 msgr2=0x7fe07c06f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:31.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 shutdown_connections 2024-09-13T18:42:31.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.724+0000 7fe081200640 1 -- 172.21.15.192:0/249722061 wait complete. 2024-09-13T18:42:31.746 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:31.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.895+0000 7fb7f3000640 1 Processor -- start 2024-09-13T18:42:31.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.895+0000 7fb7f3000640 1 -- start start 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f3000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7ec159b00 0x7fb7ec0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f3000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7ec15a5f0 0x7fb7ec0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f3000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec15af60 con 0x7fb7ec06bc30 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f3000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec15aa40 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f3000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec06b7a0 con 0x7fb7ec159b00 2024-09-13T18:42:31.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f1200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb7ec06bc30 0x7fb7ec159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52900/0 (socket says 172.21.15.192:52900) 2024-09-13T18:42:31.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f1200640 1 -- 172.21.15.192:0/1048232099 learned_addr learned my addr 172.21.15.192:0/1048232099 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:31.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.896+0000 7fb7f2600640 1 --2- 172.21.15.192:0/1048232099 >> v2:172.21.15.192:3300/0 conn(0x7fb7ec15a5f0 0x7fb7ec0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7f1c00640 1 --2- 172.21.15.192:0/1048232099 >> v2:172.21.15.194:3300/0 conn(0x7fb7ec159b00 0x7fb7ec0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7ebe00640 1 -- 172.21.15.192:0/1048232099 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707431640 0 0) 0x7fb7ec15af60 con 0x7fb7ec06bc30 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7ebe00640 1 -- 172.21.15.192:0/1048232099 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d4003520 con 0x7fb7ec06bc30 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7f2600640 1 -- 172.21.15.192:0/1048232099 >> v2:172.21.15.194:3300/0 conn(0x7fb7ec159b00 msgr2=0x7fb7ec0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7f2600640 1 --2- 172.21.15.192:0/1048232099 >> v2:172.21.15.194:3300/0 conn(0x7fb7ec159b00 0x7fb7ec0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7f2600640 1 -- 172.21.15.192:0/1048232099 >> v1:172.21.15.192:6789/0 conn(0x7fb7ec06bc30 legacy=0x7fb7ec159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.897+0000 7fb7f2600640 1 -- 172.21.15.192:0/1048232099 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec15ac80 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.898+0000 7fb7f2600640 1 --2- 172.21.15.192:0/1048232099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec0b32b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec06cc90 tx=0x7fb7e402a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea6e6f2a46e30df server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.898+0000 7fb7ebe00640 1 -- 172.21.15.192:0/1048232099 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e402aea0 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.898+0000 7fb7ebe00640 1 -- 172.21.15.192:0/1048232099 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e402d050 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.898+0000 7fb7ebe00640 1 -- 172.21.15.192:0/1048232099 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4007940 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 -- 172.21.15.192:0/1048232099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec15a5f0 msgr2=0x7fb7ec0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1048232099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec0b32b0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec06cc90 tx=0x7fb7e402a680 comp rx=0 tx=0).stop 2024-09-13T18:42:31.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 -- 172.21.15.192:0/1048232099 shutdown_connections 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1048232099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec0b32b0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1048232099 >> v2:172.21.15.194:3300/0 conn(0x7fb7ec159b00 0x7fb7ec0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 -- 172.21.15.192:0/1048232099 >> 172.21.15.192:0/1048232099 conn(0x7fb7ec0736d0 msgr2=0x7fb7ec0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 -- 172.21.15.192:0/1048232099 shutdown_connections 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.899+0000 7fb7f3000640 1 -- 172.21.15.192:0/1048232099 wait complete. 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.900+0000 7fb7f3000640 1 Processor -- start 2024-09-13T18:42:31.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.901+0000 7fb7f3000640 1 -- start start 2024-09-13T18:42:31.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.901+0000 7fb7f3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 0x7fb7ec14c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.901+0000 7fb7f3000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec155370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f3000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0ae730 con 0x7fb7ec159b00 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0ae9d0 con 0x7fb7ec15a5f0 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec0aecb0 con 0x7fb7ec06bc30 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55642/0 (socket says 172.21.15.192:55642) 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 -- 172.21.15.192:0/1482944542 learned_addr learned my addr 172.21.15.192:0/1482944542 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:31.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1c00640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 0x7fb7ec14c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f2600640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec155370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 -- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 msgr2=0x7fb7ec14c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 0x7fb7ec14c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 -- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ec15a5f0 msgr2=0x7fb7ec155370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec155370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 -- 172.21.15.192:0/1482944542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e4009a70 con 0x7fb7ec159b00 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1c00640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 0x7fb7ec14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.902+0000 7fb7f1200640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c430 tx=0x7fb7d800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.903+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d8005ce0 con 0x7fb7ec159b00 2024-09-13T18:42:31.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.903+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d8005e40 con 0x7fb7ec159b00 2024-09-13T18:42:31.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.903+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7ec0aef90 con 0x7fb7ec159b00 2024-09-13T18:42:31.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.903+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80072f0 con 0x7fb7ec159b00 2024-09-13T18:42:31.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.903+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec1504f0 con 0x7fb7ec159b00 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.904+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec0b0300 con 0x7fb7ec159b00 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.905+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7d8007450 con 0x7fb7ec159b00 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.906+0000 7fb7e9600640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 0x7fb7cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.906+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7d8088a50 con 0x7fb7ec159b00 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.906+0000 7fb7f1c00640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 0x7fb7cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:31.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.906+0000 7fb7f1c00640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 0x7fb7cc06d0c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:31.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:31.910+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7d80576c0 con 0x7fb7ec159b00 2024-09-13T18:42:32.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.111+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7ec0af1d0 con 0x7fb7ec159b00 2024-09-13T18:42:32.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.111+0000 7fb7e9600640 1 -- 172.21.15.192:0/1482944542 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fb7ec0af1d0 con 0x7fb7ec159b00 2024-09-13T18:42:32.115 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:32.115 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:42:32.115 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.113+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 msgr2=0x7fb7cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.113+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 0x7fb7cc06d0c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0008040 comp rx=0 tx=0).stop 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.113+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 msgr2=0x7fb7ec154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.113+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb7d800c430 tx=0x7fb7d800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 shutdown_connections 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7cc06ac00 0x7fb7cc06d0c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7ec15a5f0 0x7fb7ec155370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7ec159b00 0x7fb7ec154e30 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 --2- 172.21.15.192:0/1482944542 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7ec06bc30 0x7fb7ec14c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 >> 172.21.15.192:0/1482944542 conn(0x7fb7ec0736d0 msgr2=0x7fb7ec0cccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 shutdown_connections 2024-09-13T18:42:32.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.114+0000 7fb7f3000640 1 -- 172.21.15.192:0/1482944542 wait complete. 2024-09-13T18:42:32.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 62, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:42:26.694601+0000', 'modified': '2024-09-13T18:42:29.709240+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7710}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7710': {'gid': 7710, 'name': 'c', 'rank': 0, 'incarnation': 59, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/3552139706', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6835', 'nonce': 3552139706}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3552139706}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:42:32.535 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:42:32.536 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.686+0000 7f91d5e00640 1 Processor -- start 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.686+0000 7f91d5e00640 1 -- start start 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91d5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f91d00b0490 0x7f91d00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91d5e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d015ec00 con 0x7f91d015e790 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91d5e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d0140480 con 0x7f91d00cacd0 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91d5e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d00cb5f0 con 0x7f91d00b0490 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91ce000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f91d015e790 0x7f91d00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52916/0 (socket says 172.21.15.192:52916) 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91ce000640 1 -- 172.21.15.192:0/1958003448 learned_addr learned my addr 172.21.15.192:0/1958003448 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91cf400640 1 --2- 172.21.15.192:0/1958003448 >> v2:172.21.15.194:3300/0 conn(0x7f91d00b0490 0x7f91d00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3777658959 0 0) 0x7f91d015ec00 con 0x7f91d015e790 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.688+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b4003520 con 0x7f91d015e790 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 210716411 0 0) 0x7f91b4003520 con 0x7f91d015e790 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 >> v2:172.21.15.194:3300/0 conn(0x7f91d00b0490 msgr2=0x7f91d00cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 --2- 172.21.15.192:0/1958003448 >> v2:172.21.15.194:3300/0 conn(0x7f91d00b0490 0x7f91d00cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 >> v1:172.21.15.194:6789/0 conn(0x7f91d00cacd0 legacy=0x7f91d0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d015ee90 con 0x7f91d015e790 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f91bc001670 con 0x7f91d015e790 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 >> v1:172.21.15.192:6789/0 conn(0x7f91d015e790 legacy=0x7f91d00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 0x7f91b4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40047c0 0x7f91b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91b4005180 0x7f91b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b400c050 con 0x7f91b40039c0 2024-09-13T18:42:32.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b400c1c0 con 0x7f91b40047c0 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91b400c380 con 0x7f91b4005180 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 0x7f91b4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91ce000640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40047c0 0x7f91b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cf400640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91b4005180 0x7f91b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 -- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91b4005180 msgr2=0x7f91b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91b4005180 0x7f91b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 -- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40047c0 msgr2=0x7f91b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40047c0 0x7f91b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.689+0000 7f91cea00640 1 -- 172.21.15.192:0/1958003448 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4003520 con 0x7f91b40039c0 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.690+0000 7f91cf400640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91b4005180 0x7f91b400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.690+0000 7f91cf400640 1 -- 172.21.15.192:0/1958003448 reap_dead start 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.690+0000 7f91cea00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 0x7f91b4003de0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f91c0001750 tx=0x7f91b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7185722c1a2900f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00052d0 con 0x7f91b40039c0 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c0005430 con 0x7f91b40039c0 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91cd600640 1 -- 172.21.15.192:0/1958003448 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c002abc0 con 0x7f91b40039c0 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 -- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 msgr2=0x7f91b4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 0x7f91b4003de0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f91c0001750 tx=0x7f91b40057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 -- 172.21.15.192:0/1958003448 shutdown_connections 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 --2- 172.21.15.192:0/1958003448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91b40039c0 0x7f91b4003de0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 -- 172.21.15.192:0/1958003448 >> 172.21.15.192:0/1958003448 conn(0x7f91d00ae960 msgr2=0x7f91d006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 -- 172.21.15.192:0/1958003448 shutdown_connections 2024-09-13T18:42:32.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.691+0000 7f91d5e00640 1 -- 172.21.15.192:0/1958003448 wait complete. 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.693+0000 7f91d5e00640 1 Processor -- start 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.693+0000 7f91d5e00640 1 -- start start 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40039c0 0x7f91d01f2fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91d006aba0 0x7f91d006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d00cc7f0 con 0x7f91d00cbe30 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d013f250 con 0x7f91b40039c0 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91d5e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d013f530 con 0x7f91d006aba0 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.694+0000 7f91ce000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55654/0 (socket says 172.21.15.192:55654) 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 -- 172.21.15.192:0/3235805940 learned_addr learned my addr 172.21.15.192:0/3235805940 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91cea00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40039c0 0x7f91d01f2fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91cf400640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91d006aba0 0x7f91d006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 -- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91d006aba0 msgr2=0x7f91d006b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91d006aba0 0x7f91d006b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 -- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40039c0 msgr2=0x7f91d01f2fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40039c0 0x7f91d01f2fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 -- 172.21.15.192:0/3235805940 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d013f810 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.695+0000 7f91ce000640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.696+0000 7f91c7400640 1 -- 172.21.15.192:0/3235805940 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc007790 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.696+0000 7f91c7400640 1 -- 172.21.15.192:0/3235805940 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc001650 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.696+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d013faf0 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.696+0000 7f91c7400640 1 -- 172.21.15.192:0/3235805940 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00fbe0 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.696+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d006b8d0 con 0x7f91d00cbe30 2024-09-13T18:42:32.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.699+0000 7f91c7400640 1 -- 172.21.15.192:0/3235805940 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f91bc00fd40 con 0x7f91d00cbe30 2024-09-13T18:42:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.699+0000 7f91c7400640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.700+0000 7f91c7400640 1 -- 172.21.15.192:0/3235805940 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91bc089250 con 0x7f91d00cbe30 2024-09-13T18:42:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.700+0000 7f91cea00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.700+0000 7f91d8c18740 1 Processor -- start 2024-09-13T18:42:32.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.700+0000 7f91d8c18740 1 -- start start 2024-09-13T18:42:32.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.700+0000 7f91cea00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 0x7f91b006d0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91c0032000 tx=0x7f91c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f69ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fb70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022ed2ab0 con 0x560022f66e90 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022ed0240 con 0x560022f90b80 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560022ecbb30 con 0x560022f696d0 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91ce000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91ce000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55658/0 (socket says 172.21.15.192:55658) 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91ce000640 1 -- 172.21.15.192:0/4216742405 learned_addr learned my addr 172.21.15.192:0/4216742405 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91cea00640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f69ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91cf400640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fb70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.701+0000 7f91ce000640 1 -- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 msgr2=0x560022f69ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91ce000640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f69ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91ce000640 1 -- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 msgr2=0x560022fb70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91ce000640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fb70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91ce000640 1 -- 172.21.15.192:0/4216742405 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560022e96bd0 con 0x560022f66e90 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91cf400640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fb70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91cea00640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f69ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91ce000640 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0877b0 tx=0x7f91bc058370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d888aa9506cefcab server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91bbe00640 1 -- 172.21.15.192:0/4216742405 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0565d0 con 0x560022f66e90 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91bbe00640 1 -- 172.21.15.192:0/4216742405 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc054940 con 0x560022f66e90 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.702+0000 7f91bbe00640 1 -- 172.21.15.192:0/4216742405 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc05e2d0 con 0x560022f66e90 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- 172.21.15.192:0/4216742405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 msgr2=0x560022fb6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0877b0 tx=0x7f91bc058370 comp rx=0 tx=0).stop 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- 172.21.15.192:0/4216742405 shutdown_connections 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fb70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f66e90 0x560022fb6ba0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 --2- 172.21.15.192:0/4216742405 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f69ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- 172.21.15.192:0/4216742405 >> 172.21.15.192:0/4216742405 conn(0x560022f65e00 msgr2=0x560022fae2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- 172.21.15.192:0/4216742405 shutdown_connections 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- 172.21.15.192:0/4216742405 wait complete. 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.703+0000 7f91d8c18740 1 -- start start 2024-09-13T18:42:32.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.704+0000 7f91d8c18740 1 Processor -- start 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.704+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fbdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 0x560022fbe150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022e6d260 con 0x560022f696d0 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022e6cf00 con 0x560022f90b80 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560022c32f20 con 0x560022f902b0 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91d8c18740 10 client.0 _ll_register_callbacks cb 0x560022ec51a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55660/0 (socket says 172.21.15.192:55660) 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 -- 172.21.15.192:0/1070824932 learned_addr learned my addr 172.21.15.192:0/1070824932 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91ce000640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fbdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cf400640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 0x560022fbe150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 -- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 msgr2=0x560022fbe150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 0x560022fbe150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 -- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 msgr2=0x560022fbdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fbdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cea00640 1 -- 172.21.15.192:0/1070824932 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d006b8d0 con 0x560022f696d0 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91cf400640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 0x560022fbe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.705+0000 7f91ce000640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fbdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91cea00640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f91c0001840 tx=0x7f91c0001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc46861903056322 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:42:32.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c0047480 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560022ef5cd0 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91c00475e0 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c00477a0 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 10 client.7836 fetch_fsmap learned FSMap version 62 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x560022eca1b0 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560022ef5cd0 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f91c0047900 con 0x560022f696d0 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 10 client.7836 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:42:32.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 10 client.7836 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.706+0000 7f91d8c18740 20 client.7836 populate_metadata read hostname 'smithi192' 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022f92af0 0x560022fb2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91d8c18740 4 client.7836 mds_command: new command op to 7710 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 --> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560022bbf3c0 con 0x560022f92af0 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91ce000640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022f92af0 0x560022fb2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91ce000640 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022f92af0 0x560022fb2980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f62b4c41d08d9fb9 server_cookie=e7644c4636099db8 in_seq=0 out_seq=0 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.707+0000 7f91b8c00640 10 client.7836 ms_handle_connect on v2:172.21.15.192:6835/3552139706 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91b8c00640 1 -- 172.21.15.192:0/1070824932 <== mds.0 v2:172.21.15.192:6835/3552139706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x560022bbf3c0 con 0x560022f92af0 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91b8c00640 10 client.7836 handle_command_reply: tid=0 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 client.7836 shutdown 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 msgr2=0x560022fb5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f91c0001840 tx=0x7f91c0001190 comp rx=0 tx=0).stop 2024-09-13T18:42:32.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 shutdown_connections 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022f92af0 0x560022fb2980 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f902b0 0x560022fbe150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f90b80 0x560022fbdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 --2- 172.21.15.192:0/1070824932 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f696d0 0x560022fb5010 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91b8c00640 0 client.7836 ms_handle_reset on v2:172.21.15.192:6835/3552139706 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.708+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 >> 172.21.15.192:0/1070824932 conn(0x560022f66e90 msgr2=0x560022fac5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.709+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 shutdown_connections 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.709+0000 7f91d8c18740 1 -- 172.21.15.192:0/1070824932 wait complete. 2024-09-13T18:42:32.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.709+0000 7f91d8c18740 20 client.7836 trim_cache size 0 max 16384 2024-09-13T18:42:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.724+0000 7f91d8c18740 1 Processor -- start 2024-09-13T18:42:32.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.724+0000 7f91d8c18740 1 -- start start 2024-09-13T18:42:32.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f94d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022f69ce0 con 0x560022f90b80 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022f688e0 con 0x560022f902b0 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560022e52850 con 0x560022f696d0 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91cf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91cf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55664/0 (socket says 172.21.15.192:55664) 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91cf400640 1 -- 172.21.15.192:0/434395849 learned_addr learned my addr 172.21.15.192:0/434395849 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91ce000640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.725+0000 7f91cea00640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f94d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 -- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 msgr2=0x560022f94d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f94d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 -- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 msgr2=0x560022fada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 -- 172.21.15.192:0/434395849 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560022eff170 con 0x560022f90b80 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91ce000640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91cf400640 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f91d006e7b0 tx=0x7f91c8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b51ace371152468 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91c4c00640 1 -- 172.21.15.192:0/434395849 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800e040 con 0x560022f90b80 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91c4c00640 1 -- 172.21.15.192:0/434395849 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c801b070 con 0x560022f90b80 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.726+0000 7f91c4c00640 1 -- 172.21.15.192:0/434395849 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80228c0 con 0x560022f90b80 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 -- 172.21.15.192:0/434395849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 msgr2=0x560022fadf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f91d006e7b0 tx=0x7f91c8009750 comp rx=0 tx=0).stop 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 -- 172.21.15.192:0/434395849 shutdown_connections 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fadf90 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 --2- 172.21.15.192:0/434395849 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f94d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 -- 172.21.15.192:0/434395849 >> 172.21.15.192:0/434395849 conn(0x560022f66e90 msgr2=0x560022f68ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 -- 172.21.15.192:0/434395849 shutdown_connections 2024-09-13T18:42:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.727+0000 7f91d8c18740 1 -- 172.21.15.192:0/434395849 wait complete. 2024-09-13T18:42:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.728+0000 7f91d8c18740 1 -- start start 2024-09-13T18:42:32.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.728+0000 7f91d8c18740 1 Processor -- start 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f67d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fffc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022fca6d0 con 0x560022f90b80 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x560022f91300 con 0x560022f902b0 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x560022f91830 con 0x560022f696d0 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91d8c18740 10 client.0 _ll_register_callbacks cb 0x7f91b40045f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:42:32.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91cf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91cf400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55668/0 (socket says 172.21.15.192:55668) 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91cf400640 1 -- 172.21.15.192:0/3480986843 learned_addr learned my addr 172.21.15.192:0/3480986843 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91cea00640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f67d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.729+0000 7f91ce000640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 -- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 msgr2=0x560022f67d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f67d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 -- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 msgr2=0x560022fffc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fffc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 -- 172.21.15.192:0/3480986843 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c80163a0 con 0x560022f90b80 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91ce000640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91cf400640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f91c8004270 tx=0x7f91c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd61b2863c9c446c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91b8c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c800e040 con 0x560022f90b80 2024-09-13T18:42:32.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91c801d070 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.730+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91bc054940 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91c8003e40 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 10 client.7842 fetch_fsmap learned FSMap version 62 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=2+}) v3 -- 0x560022e6c470 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc054940 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 62) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f91c8022480 con 0x560022f90b80 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 10 client.7842 fetch_fsmap finished waiting for FSMap version 62 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 10 client.7842 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 20 client.7842 populate_metadata read hostname 'smithi192' 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022faf050 0x560022faf430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 4 client.7842 mds_command: new command op to 7710 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 --> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560022bd06c0 con 0x560022faf050 2024-09-13T18:42:32.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.731+0000 7f91cea00640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022faf050 0x560022faf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91cea00640 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022faf050 0x560022faf430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5742b0a8d9aeebf5 server_cookie=d017290f00b7f146 in_seq=0 out_seq=0 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91b8c00640 10 client.7842 ms_handle_connect on v2:172.21.15.192:6835/3552139706 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91b8c00640 1 -- 172.21.15.192:0/3480986843 <== mds.0 v2:172.21.15.192:6835/3552139706 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x560022bd06c0 con 0x560022faf050 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91b8c00640 10 client.7842 handle_command_reply: tid=0 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 client.7842 shutdown 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 msgr2=0x560022fac300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f91c8004270 tx=0x7f91c8004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 shutdown_connections 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:6835/3552139706,v1:172.21.15.192:6837/3552139706] conn(0x560022faf050 0x560022faf430 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x560022f90b80 0x560022fac300 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x560022f902b0 0x560022fffc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 --2- 172.21.15.192:0/3480986843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x560022f696d0 0x560022f67d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91b8c00640 0 client.7842 ms_handle_reset on v2:172.21.15.192:6835/3552139706 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 >> 172.21.15.192:0/3480986843 conn(0x560022f66e90 msgr2=0x560022f68ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 shutdown_connections 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.732+0000 7f91d8c18740 1 -- 172.21.15.192:0/3480986843 wait complete. 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d8c18740 20 client.7842 trim_cache size 0 max 16384 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:32.740 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 7710, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0359074379999997, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 62, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 149, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 149, 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 11.166265101 2024-09-13T18:42:32.741 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 msgr2=0x7f91b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 0x7f91b006d0c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f91c0032000 tx=0x7f91c002e000 comp rx=0 tx=0).stop 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 msgr2=0x7f91d00cc2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f91bc000c00 tx=0x7f91bc007660 comp rx=0 tx=0).stop 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 shutdown_connections 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f91b006ac00 0x7f91b006d0c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f91d006aba0 0x7f91d006b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f91d00cbe30 0x7f91d00cc2b0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 --2- 172.21.15.192:0/3235805940 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f91b40039c0 0x7f91d01f2fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 >> 172.21.15.192:0/3235805940 conn(0x7f91d00ae960 msgr2=0x7f91d00ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 shutdown_connections 2024-09-13T18:42:32.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.733+0000 7f91d5e00640 1 -- 172.21.15.192:0/3235805940 wait complete. 2024-09-13T18:42:32.751 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:42:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.902+0000 7f4cbdc00640 1 Processor -- start 2024-09-13T18:42:32.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.902+0000 7f4cbdc00640 1 -- start start 2024-09-13T18:42:32.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cbdc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4cb815dee0 0x7f4cb80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cbdc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cb80b3f10 0x7f4cb80b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cbdc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cb80b2f00 con 0x7f4cb815e2c0 2024-09-13T18:42:32.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cbdc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80b3150 con 0x7f4cb80b3f10 2024-09-13T18:42:32.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cbdc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cb80b3430 con 0x7f4cb815dee0 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cb6000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cb80b3f10 0x7f4cb80b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cb6000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4cb80b3f10 0x7f4cb80b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55674/0 (socket says 172.21.15.192:55674) 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.903+0000 7f4cb6000640 1 -- 172.21.15.192:0/2559130427 learned_addr learned my addr 172.21.15.192:0/2559130427 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.904+0000 7f4cb6a00640 1 --2- 172.21.15.192:0/2559130427 >> v2:172.21.15.194:3300/0 conn(0x7f4cb815dee0 0x7f4cb80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.904+0000 7f4cb6000640 1 -- 172.21.15.192:0/2559130427 >> v2:172.21.15.194:3300/0 conn(0x7f4cb815dee0 msgr2=0x7f4cb80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.904+0000 7f4cb6000640 1 --2- 172.21.15.192:0/2559130427 >> v2:172.21.15.194:3300/0 conn(0x7f4cb815dee0 0x7f4cb80afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.904+0000 7f4cb6000640 1 -- 172.21.15.192:0/2559130427 >> v1:172.21.15.194:6789/0 conn(0x7f4cb815e2c0 legacy=0x7f4cb815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.904+0000 7f4cb6000640 1 -- 172.21.15.192:0/2559130427 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cb80b3710 con 0x7f4cb80b3f10 2024-09-13T18:42:32.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.905+0000 7f4cb6000640 1 --2- 172.21.15.192:0/2559130427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb80b3f10 0x7f4cb80b02c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4cb806cd20 tx=0x7f4ca402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b53e360f3d6cce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.905+0000 7f4cb5600640 1 -- 172.21.15.192:0/2559130427 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4032440 con 0x7f4cb80b3f10 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.905+0000 7f4cb5600640 1 -- 172.21.15.192:0/2559130427 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca40325a0 con 0x7f4cb80b3f10 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.905+0000 7f4cb5600640 1 -- 172.21.15.192:0/2559130427 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4032930 con 0x7f4cb80b3f10 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 -- 172.21.15.192:0/2559130427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb80b3f10 msgr2=0x7f4cb80b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/2559130427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb80b3f10 0x7f4cb80b02c0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f4cb806cd20 tx=0x7f4ca402a270 comp rx=0 tx=0).stop 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 -- 172.21.15.192:0/2559130427 shutdown_connections 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/2559130427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb80b3f10 0x7f4cb80b02c0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/2559130427 >> v2:172.21.15.194:3300/0 conn(0x7f4cb815dee0 0x7f4cb80afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 -- 172.21.15.192:0/2559130427 >> 172.21.15.192:0/2559130427 conn(0x7f4cb80ae960 msgr2=0x7f4cb806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:32.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 -- 172.21.15.192:0/2559130427 shutdown_connections 2024-09-13T18:42:32.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.906+0000 7f4cbdc00640 1 -- 172.21.15.192:0/2559130427 wait complete. 2024-09-13T18:42:32.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.907+0000 7f4cbdc00640 1 Processor -- start 2024-09-13T18:42:32.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 -- start start 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cb815e2c0 0x7f4cb813c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb813fd10 0x7f4cb813c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813d5a0 con 0x7f4cb815dee0 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.908+0000 7f4cbdc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813db20 con 0x7f4cb813fd10 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cbdc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cb813d840 con 0x7f4cb815e2c0 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55690/0 (socket says 172.21.15.192:55690) 2024-09-13T18:42:32.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 -- 172.21.15.192:0/3314019766 learned_addr learned my addr 172.21.15.192:0/3314019766 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6000640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cb815e2c0 0x7f4cb813c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb7400640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb813fd10 0x7f4cb813c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 -- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cb815e2c0 msgr2=0x7f4cb813c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cb815e2c0 0x7f4cb813c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 -- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb813fd10 msgr2=0x7f4cb813c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb813fd10 0x7f4cb813c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 -- 172.21.15.192:0/3314019766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40094d0 con 0x7f4cb815dee0 2024-09-13T18:42:32.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.909+0000 7f4cb6a00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e9b0 tx=0x7f4ca800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.910+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8009670 con 0x7f4cb815dee0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.910+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca800c9a0 con 0x7f4cb815dee0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.910+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca800cd50 con 0x7f4cb815dee0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.910+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cb813f230 con 0x7f4cb815dee0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.910+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cb813f7f0 con 0x7f4cb815dee0 2024-09-13T18:42:32.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.911+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cb813f090 con 0x7f4cb815dee0 2024-09-13T18:42:32.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.912+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4ca8013470 con 0x7f4cb815dee0 2024-09-13T18:42:32.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.913+0000 7f4caea00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 0x7f4c9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:32.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.913+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ca8089690 con 0x7f4cb815dee0 2024-09-13T18:42:32.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.913+0000 7f4cb6000640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 0x7f4c9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:32.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.913+0000 7f4cb6000640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 0x7f4c9806d0c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4034000 tx=0x7f4ca402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:32.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:32.917+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4cb813f090 con 0x7f4cb815dee0 2024-09-13T18:42:33.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.118+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4cb813f090 con 0x7f4cb815dee0 2024-09-13T18:42:33.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.118+0000 7f4caea00640 1 -- 172.21.15.192:0/3314019766 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4cb813f090 con 0x7f4cb815dee0 2024-09-13T18:42:33.121 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:42:33.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.120+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 msgr2=0x7f4c9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.120+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 0x7f4c9806d0c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4034000 tx=0x7f4ca402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.120+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 msgr2=0x7f4cb813d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.120+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f4ca800e9b0 tx=0x7f4ca800ee70 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 shutdown_connections 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c9806ac00 0x7f4c9806d0c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4cb813fd10 0x7f4cb813c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4cb815e2c0 0x7f4cb813c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 --2- 172.21.15.192:0/3314019766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4cb815dee0 0x7f4cb813d060 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 >> 172.21.15.192:0/3314019766 conn(0x7f4cb80ae960 msgr2=0x7f4cb8158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 shutdown_connections 2024-09-13T18:42:33.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:33.121+0000 7f4cbdc00640 1 -- 172.21.15.192:0/3314019766 wait complete. 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:42:33.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:42:33.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.141 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:42:33.176 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:42:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:42:33.176 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:33.177 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42356sec preferred_lft 42356sec 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.178 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:42:33.179 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:42:33.179 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:42:33.179 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:33.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.179 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:42:33.270 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:42:33.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.274 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:42:33.310 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:42:33.310 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:42:33.310 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:42:33.310 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:42:33.310 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:42:33.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:42:33.311 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:42:33.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.456 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:42:33.492 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:42:33.492 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:42:33.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:42:33.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.493 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:42:33.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:42:33.589 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:33.624 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:42:33.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:42:33.624 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:33.698 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:42:33.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.699 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:33.828 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:33.828 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:42:33.854 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:33.854 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:42:33.854 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:42:33.855 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:42:33.855 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:42:33.856 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:42:33.856 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:42:33.856 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:42:33.856 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:42:33.856 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:42:33.859 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:42:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.859 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:33.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:33.916 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:33.962 INFO:teuthology.orchestra.run.smithi192.stdout:client7851 2024-09-13T18:42:33.963 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:33.963 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:34.041 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:42:34.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.230+0000 7f0662a00640 1 Processor -- start 2024-09-13T18:42:34.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.230+0000 7f0662a00640 1 -- start start 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f0662a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f065c15dee0 0x7f065c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f0662a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c0b2f00 con 0x7f065c0b3f10 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f0662a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f065c0b3150 con 0x7f065c15e2c0 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f0662a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f065c0b3430 con 0x7f065c15dee0 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f065b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f065c0b3f10 0x7f065c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52924/0 (socket says 172.21.15.192:52924) 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f065b400640 1 -- 172.21.15.192:0/2342740120 learned_addr learned my addr 172.21.15.192:0/2342740120 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:34.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.231+0000 7f065be00640 1 --2- 172.21.15.192:0/2342740120 >> v2:172.21.15.192:3300/0 conn(0x7f065c15dee0 0x7f065c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:34.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.232+0000 7f065be00640 1 -- 172.21.15.192:0/2342740120 >> v1:172.21.15.194:6789/0 conn(0x7f065c15e2c0 legacy=0x7f065c1637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:34.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.232+0000 7f065be00640 1 -- 172.21.15.192:0/2342740120 >> v1:172.21.15.192:6789/0 conn(0x7f065c0b3f10 legacy=0x7f065c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.232+0000 7f065be00640 1 -- 172.21.15.192:0/2342740120 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f065c0b3710 con 0x7f065c15dee0 2024-09-13T18:42:34.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.233+0000 7f065be00640 1 --2- 172.21.15.192:0/2342740120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15dee0 0x7f065c0afd80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f064c0097a0 tx=0x7f064c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb2c56524b06202 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:34.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.233+0000 7f065aa00640 1 -- 172.21.15.192:0/2342740120 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c032440 con 0x7f065c15dee0 2024-09-13T18:42:34.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.233+0000 7f065aa00640 1 -- 172.21.15.192:0/2342740120 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064c0325a0 con 0x7f065c15dee0 2024-09-13T18:42:34.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.233+0000 7f065aa00640 1 -- 172.21.15.192:0/2342740120 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064c032930 con 0x7f065c15dee0 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 -- 172.21.15.192:0/2342740120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15dee0 msgr2=0x7f065c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 --2- 172.21.15.192:0/2342740120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15dee0 0x7f065c0afd80 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f064c0097a0 tx=0x7f064c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 -- 172.21.15.192:0/2342740120 shutdown_connections 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 --2- 172.21.15.192:0/2342740120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15dee0 0x7f065c0afd80 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 -- 172.21.15.192:0/2342740120 >> 172.21.15.192:0/2342740120 conn(0x7f065c0ae960 msgr2=0x7f065c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 -- 172.21.15.192:0/2342740120 shutdown_connections 2024-09-13T18:42:34.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.234+0000 7f0662a00640 1 -- 172.21.15.192:0/2342740120 wait complete. 2024-09-13T18:42:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.235+0000 7f0662a00640 1 Processor -- start 2024-09-13T18:42:34.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.235+0000 7f0662a00640 1 -- start start 2024-09-13T18:42:34.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f065c15dee0 0x7f065c070f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 0x7f065c13b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c152240 con 0x7f065c15e2c0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1515c0 con 0x7f065c15dee0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.236+0000 7f0662a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f065c1518a0 con 0x7f065c152ba0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55706/0 (socket says 172.21.15.192:55706) 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 -- 172.21.15.192:0/1365321974 learned_addr learned my addr 172.21.15.192:0/1365321974 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065be00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f065c15dee0 0x7f065c070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f0660a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 0x7f065c13b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 -- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 msgr2=0x7f065c13b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 0x7f065c13b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 -- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f065c15dee0 msgr2=0x7f065c070f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f065c15dee0 0x7f065c070f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 -- 172.21.15.192:0/1365321974 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c009400 con 0x7f065c15e2c0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f0660a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 0x7f065c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.237+0000 7f065b400640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f064800c4a0 tx=0x7f064800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.238+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648005ce0 con 0x7f065c15e2c0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.238+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648005e40 con 0x7f065c15e2c0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.238+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648007270 con 0x7f065c15e2c0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.238+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f065c151b80 con 0x7f065c15e2c0 2024-09-13T18:42:34.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.238+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f065c071450 con 0x7f065c15e2c0 2024-09-13T18:42:34.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.239+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065c152380 con 0x7f065c15e2c0 2024-09-13T18:42:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.240+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0648007490 con 0x7f065c15e2c0 2024-09-13T18:42:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.240+0000 7f0653e00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 0x7f063c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.241+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06480887b0 con 0x7f065c15e2c0 2024-09-13T18:42:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.241+0000 7f065be00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 0x7f063c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.241+0000 7f065be00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 0x7f063c06d0c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:34.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.245+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f065c152380 con 0x7f065c15e2c0 2024-09-13T18:42:34.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.451+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f065c152380 con 0x7f065c15e2c0 2024-09-13T18:42:34.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.451+0000 7f0653e00640 1 -- 172.21.15.192:0/1365321974 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v62) v1 ==== 53+0+73 (secure 0 0 0) 0x7f065c152380 con 0x7f065c15e2c0 2024-09-13T18:42:34.455 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:42:34.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.453+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 msgr2=0x7f063c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.453+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 0x7f063c06d0c0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f064c034000 tx=0x7f064c02e000 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.453+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 msgr2=0x7f065c152660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.453+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f064800c4a0 tx=0x7f064800c960 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 shutdown_connections 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f063c06ac00 0x7f063c06d0c0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f065c152ba0 0x7f065c13b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f065c15e2c0 0x7f065c152660 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 --2- 172.21.15.192:0/1365321974 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f065c15dee0 0x7f065c070f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 >> 172.21.15.192:0/1365321974 conn(0x7f065c0ae960 msgr2=0x7f065c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 shutdown_connections 2024-09-13T18:42:34.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:34.454+0000 7f0662a00640 1 -- 172.21.15.192:0/1365321974 wait complete. 2024-09-13T18:42:34.472 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:42:34.473 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:42:34.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.473 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:34.514 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:42:34.515 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:42:34.516 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:42:34.517 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:42:34.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.517 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:42:34.612 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:42:34.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.615 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:42:34.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:42:34.653 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:42:34.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.801 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:42:34.835 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:42:34.835 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:42:34.836 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:42:34.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:34.836 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:42:34.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:42:34.932 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:42:34.967 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:42:34.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:42:34.967 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:42:35.042 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:42:35.042 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:35.042 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:35.169 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:35.169 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:42:35.195 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:42:35.195 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:42:35.195 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:42:35.195 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:42:35.195 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:42:35.197 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:42:35.197 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:42:35.197 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:42:35.197 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:42:35.197 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:42:35.200 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:42:35.200 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:35.200 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:42:35.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:35.258 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:42:35.295 INFO:teuthology.orchestra.run.smithi194.stdout:client6572 2024-09-13T18:42:35.295 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:35.296 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:35.371 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.520+0000 7fb4efe00640 1 Processor -- start 2024-09-13T18:42:35.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.521+0000 7fb4efe00640 1 -- start start 2024-09-13T18:42:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4efe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4f015a9e0 0x7fb4f006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006b3d0 0x7fb4f00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4efe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f006c5d0 con 0x7fb4f006e990 2024-09-13T18:42:35.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4efe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00b3730 con 0x7fb4f015a9e0 2024-09-13T18:42:35.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4efe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00b3920 con 0x7fb4f006b3d0 2024-09-13T18:42:35.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4eea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4f015a9e0 0x7fb4f006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4ef400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb4f006e990 0x7fb4f0070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52926/0 (socket says 172.21.15.192:52926) 2024-09-13T18:42:35.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4ef400640 1 -- 172.21.15.192:0/1511520290 learned_addr learned my addr 172.21.15.192:0/1511520290 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.522+0000 7fb4e6000640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006b3d0 0x7fb4f00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.523+0000 7fb4eea00640 1 -- 172.21.15.192:0/1511520290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006b3d0 msgr2=0x7fb4f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.523+0000 7fb4eea00640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006b3d0 0x7fb4f00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.523+0000 7fb4eea00640 1 -- 172.21.15.192:0/1511520290 >> v1:172.21.15.192:6789/0 conn(0x7fb4f006e990 legacy=0x7fb4f0070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.523+0000 7fb4eea00640 1 -- 172.21.15.192:0/1511520290 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00b3c00 con 0x7fb4f015a9e0 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.523+0000 7fb4ee000640 1 -- 172.21.15.192:0/1511520290 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936266954 0 0) 0x7fb4f006c5d0 con 0x7fb4f006e990 2024-09-13T18:42:35.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4eea00640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f015a9e0 0x7fb4f006ae90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00097a0 tx=0x7fb4e002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3007a13049b11e16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4ee000640 1 -- 172.21.15.192:0/1511520290 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0032440 con 0x7fb4f015a9e0 2024-09-13T18:42:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4ee000640 1 -- 172.21.15.192:0/1511520290 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e00325a0 con 0x7fb4f015a9e0 2024-09-13T18:42:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4ee000640 1 -- 172.21.15.192:0/1511520290 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0032930 con 0x7fb4f015a9e0 2024-09-13T18:42:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 -- 172.21.15.192:0/1511520290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f015a9e0 msgr2=0x7fb4f006ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f015a9e0 0x7fb4f006ae90 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb4e00097a0 tx=0x7fb4e002a180 comp rx=0 tx=0).stop 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 -- 172.21.15.192:0/1511520290 shutdown_connections 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006b3d0 0x7fb4f00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 --2- 172.21.15.192:0/1511520290 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f015a9e0 0x7fb4f006ae90 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.524+0000 7fb4efe00640 1 -- 172.21.15.192:0/1511520290 >> 172.21.15.192:0/1511520290 conn(0x7fb4f00736d0 msgr2=0x7fb4f00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.525+0000 7fb4efe00640 1 -- 172.21.15.192:0/1511520290 shutdown_connections 2024-09-13T18:42:35.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.525+0000 7fb4efe00640 1 -- 172.21.15.192:0/1511520290 wait complete. 2024-09-13T18:42:35.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.526+0000 7fb4efe00640 1 Processor -- start 2024-09-13T18:42:35.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.526+0000 7fb4efe00640 1 -- start start 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 0x7fb4f0140870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f015a9e0 0x7fb4f01f3970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0140db0 con 0x7fb4f006b3d0 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f014cc20 con 0x7fb4f015a9e0 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4efe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f013dae0 con 0x7fb4f006e990 2024-09-13T18:42:35.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4eea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4eea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55712/0 (socket says 172.21.15.192:55712) 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4eea00640 1 -- 172.21.15.192:0/3045392768 learned_addr learned my addr 172.21.15.192:0/3045392768 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4e6000640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 0x7fb4f0140870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.527+0000 7fb4ef400640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f015a9e0 0x7fb4f01f3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 -- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 msgr2=0x7fb4f0140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 0x7fb4f0140870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 -- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f015a9e0 msgr2=0x7fb4f01f3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f015a9e0 0x7fb4f01f3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 -- 172.21.15.192:0/3045392768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e0009400 con 0x7fb4f006b3d0 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4e6000640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 0x7fb4f0140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:35.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4eea00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0035040 tx=0x7fb4e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0006e10 con 0x7fb4f006b3d0 2024-09-13T18:42:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0032e90 con 0x7fb4f006b3d0 2024-09-13T18:42:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f014e220 con 0x7fb4f006b3d0 2024-09-13T18:42:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0030be0 con 0x7fb4f006b3d0 2024-09-13T18:42:35.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.528+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01411f0 con 0x7fb4f006b3d0 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.529+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f014e080 con 0x7fb4f006b3d0 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.530+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb4e0039040 con 0x7fb4f006b3d0 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.531+0000 7fb4e7e00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 0x7fb4cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.531+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e00a9e50 con 0x7fb4f006b3d0 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.531+0000 7fb4e6000640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 0x7fb4cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:35.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.532+0000 7fb4e6000640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 0x7fb4cc06d0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0155db0 tx=0x7fb4d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:35.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.535+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb4f014e080 con 0x7fb4f006b3d0 2024-09-13T18:42:35.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.735+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f014e080 con 0x7fb4f006b3d0 2024-09-13T18:42:35.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.735+0000 7fb4e7e00640 1 -- 172.21.15.192:0/3045392768 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fb4f014e080 con 0x7fb4f006b3d0 2024-09-13T18:42:35.738 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:35.738 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:42:35.739 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 msgr2=0x7fb4cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 0x7fb4cc06d0c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0155db0 tx=0x7fb4d8008040 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 msgr2=0x7fb4f0159ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fb4e0035040 tx=0x7fb4e00046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 shutdown_connections 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4cc06ac00 0x7fb4cc06d0c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4f015a9e0 0x7fb4f01f3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4f006e990 0x7fb4f0140870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 --2- 172.21.15.192:0/3045392768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f006b3d0 0x7fb4f0159ac0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 >> 172.21.15.192:0/3045392768 conn(0x7fb4f00736d0 msgr2=0x7fb4f00af450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:35.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 shutdown_connections 2024-09-13T18:42:35.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:35.738+0000 7fb4efe00640 1 -- 172.21.15.192:0/3045392768 wait complete. 2024-09-13T18:42:35.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:42:35.926 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":7710,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.2157017969999995,"mdsmap_epoch":62,"osdmap_epoch":149,"osdmap_epoch_barrier":149,"uptime":14.346058891} 2024-09-13T18:42:35.927 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 7710, "mdsmap_epoch": 62, "osdmap_epoch": 149, "osdmap_epoch_barrier": 149, "rank_uptime": 9.215701797, "state": "up:active", "uptime": 14.346058891, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:42:35.927 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-13T18:42:36.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.081+0000 7fa3e8200640 1 Processor -- start 2024-09-13T18:42:36.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.081+0000 7fa3e8200640 1 -- start start 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.082+0000 7fa3e8200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 0x7fa3e006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.082+0000 7fa3e8200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 0x7fa3e00adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.082+0000 7fa3e8200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e0146010 con 0x7fa3e00b3b90 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.082+0000 7fa3e8200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e006ab60 con 0x7fa3e0145c30 2024-09-13T18:42:36.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.082+0000 7fa3e8200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e006b6e0 con 0x7fa3e00ad840 2024-09-13T18:42:36.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e5800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 0x7fa3e006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e4e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fa3e00b3b90 0x7fa3e006a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:46568/0 (socket says 172.21.15.192:46568) 2024-09-13T18:42:36.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e4e00640 1 -- 172.21.15.192:0/3027181340 learned_addr learned my addr 172.21.15.192:0/3027181340 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:36.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e6200640 1 --2- 172.21.15.192:0/3027181340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 0x7fa3e00adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3dfe00640 1 -- 172.21.15.192:0/3027181340 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870269692 0 0) 0x7fa3cc001110 con 0x7fa3e00b3b90 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3dfe00640 1 -- 172.21.15.192:0/3027181340 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c8003520 con 0x7fa3e00b3b90 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e6200640 1 -- 172.21.15.192:0/3027181340 >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 msgr2=0x7fa3e006bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e6200640 1 --2- 172.21.15.192:0/3027181340 >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 0x7fa3e006bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e6200640 1 -- 172.21.15.192:0/3027181340 >> v1:172.21.15.194:6789/0 conn(0x7fa3e00b3b90 legacy=0x7fa3e006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e6200640 1 -- 172.21.15.192:0/3027181340 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e006c0b0 con 0x7fa3e00ad840 2024-09-13T18:42:36.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.083+0000 7fa3e5800640 1 --2- 172.21.15.192:0/3027181340 >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 0x7fa3e006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:36.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.084+0000 7fa3e6200640 1 --2- 172.21.15.192:0/3027181340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 0x7fa3e00adcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8918be2b4a795199 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:36.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.084+0000 7fa3dfe00640 1 -- 172.21.15.192:0/3027181340 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8031600 con 0x7fa3e00ad840 2024-09-13T18:42:36.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.084+0000 7fa3dfe00640 1 -- 172.21.15.192:0/3027181340 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d802d050 con 0x7fa3e00ad840 2024-09-13T18:42:36.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.084+0000 7fa3dfe00640 1 -- 172.21.15.192:0/3027181340 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d8031980 con 0x7fa3e00ad840 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 -- 172.21.15.192:0/3027181340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 msgr2=0x7fa3e00adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 --2- 172.21.15.192:0/3027181340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 0x7fa3e00adcb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa3d8009d90 tx=0x7fa3d802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 -- 172.21.15.192:0/3027181340 shutdown_connections 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 --2- 172.21.15.192:0/3027181340 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e00ad840 0x7fa3e00adcb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 --2- 172.21.15.192:0/3027181340 >> v2:172.21.15.194:3300/0 conn(0x7fa3e0145c30 0x7fa3e006bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 -- 172.21.15.192:0/3027181340 >> 172.21.15.192:0/3027181340 conn(0x7fa3e00b0c40 msgr2=0x7fa3e00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 -- 172.21.15.192:0/3027181340 shutdown_connections 2024-09-13T18:42:36.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.085+0000 7fa3e8200640 1 -- 172.21.15.192:0/3027181340 wait complete. 2024-09-13T18:42:36.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.086+0000 7fa3e8200640 1 Processor -- start 2024-09-13T18:42:36.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 -- start start 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 0x7fa3e01f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e0145c30 0x7fa3e00b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e0070510 con 0x7fa3e00b3b90 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e013cb40 con 0x7fa3e00ad840 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.087+0000 7fa3e8200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e01f32a0 con 0x7fa3e0145c30 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 0x7fa3e01f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:42882/0 (socket says 172.21.15.192:42882) 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 -- 172.21.15.192:0/1473664612 learned_addr learned my addr 172.21.15.192:0/1473664612 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 0x7fa3e01f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55726/0 (socket says 172.21.15.192:55726) 2024-09-13T18:42:36.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e6200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e0145c30 0x7fa3e00b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 -- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e0145c30 msgr2=0x7fa3e00b0240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e0145c30 0x7fa3e00b0240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 -- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 msgr2=0x7fa3e01f2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 0x7fa3e01f2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 -- 172.21.15.192:0/1473664612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4009400 con 0x7fa3e00ad840 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.088+0000 7fa3e5800640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400e960 tx=0x7fa3d400ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.089+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400ca00 con 0x7fa3e00ad840 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.089+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d400cb60 con 0x7fa3e00ad840 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.089+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4013470 con 0x7fa3e00ad840 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.089+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d8009a70 con 0x7fa3e00ad840 2024-09-13T18:42:36.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.089+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e0140000 con 0x7fa3e00ad840 2024-09-13T18:42:36.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.090+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e00adcb0 con 0x7fa3e00ad840 2024-09-13T18:42:36.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.091+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa3d40135d0 con 0x7fa3e00ad840 2024-09-13T18:42:36.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.092+0000 7fa3dd600640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 0x7fa3c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:36.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.092+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3d40896d0 con 0x7fa3e00ad840 2024-09-13T18:42:36.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.092+0000 7fa3e4e00640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 0x7fa3c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:36.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.092+0000 7fa3e4e00640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 0x7fa3c006d0c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa3e015feb0 tx=0x7fa3cc007bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:36.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.096+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa3d4054830 con 0x7fa3e00ad840 2024-09-13T18:42:36.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.265+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fa3e00b0780 con 0x7fa3e00ad840 2024-09-13T18:42:36.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.754+0000 7fa3dd600640 1 -- 172.21.15.192:0/1473664612 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v150) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa3d4057e50 con 0x7fa3e00ad840 2024-09-13T18:42:36.757 INFO:teuthology.orchestra.run.smithi192.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 msgr2=0x7fa3c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 0x7fa3c006d0c0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa3e015feb0 tx=0x7fa3cc007bb0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 msgr2=0x7fa3e013c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400e960 tx=0x7fa3d400ee20 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 shutdown_connections 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa3c006ac00 0x7fa3c006d0c0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa3e0145c30 0x7fa3e00b0240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3e00b3b90 0x7fa3e01f2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 --2- 172.21.15.192:0/1473664612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa3e00ad840 0x7fa3e013c600 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 >> 172.21.15.192:0/1473664612 conn(0x7fa3e00b0c40 msgr2=0x7fa3e0143090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 shutdown_connections 2024-09-13T18:42:36.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:36.757+0000 7fa3e8200640 1 -- 172.21.15.192:0/1473664612 wait complete. 2024-09-13T18:42:36.778 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:42:36.948 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:42:36.948 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:42:36.948 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-13T18:42:36.949 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:36.949 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:36.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:36.986 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-13T18:42:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:16+0 records in 2024-09-13T18:42:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:16+0 records out 2024-09-13T18:42:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.138605 s, 121 MB/s 2024-09-13T18:42:37.204 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:37.204 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:37.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:37.240 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-13T18:42:37.458 INFO:teuthology.orchestra.run.smithi192.stderr:17+0 records in 2024-09-13T18:42:37.458 INFO:teuthology.orchestra.run.smithi192.stderr:17+0 records out 2024-09-13T18:42:37.458 INFO:teuthology.orchestra.run.smithi192.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.141044 s, 126 MB/s 2024-09-13T18:42:37.459 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-13T18:42:37.460 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:37.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.610+0000 7f2f0e400640 1 Processor -- start 2024-09-13T18:42:37.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.610+0000 7f2f0e400640 1 -- start start 2024-09-13T18:42:37.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.611+0000 7f2f0e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2f0815e790 0x7f2f080cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:37.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.611+0000 7f2f0e400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f0815ec00 con 0x7f2f0815bc20 2024-09-13T18:42:37.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.611+0000 7f2f0e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f08140480 con 0x7f2f080cacd0 2024-09-13T18:42:37.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.611+0000 7f2f0e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f080cb5f0 con 0x7f2f0815e790 2024-09-13T18:42:37.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f07e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2f0815bc20 0x7f2f080afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52940/0 (socket says 172.21.15.192:52940) 2024-09-13T18:42:37.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f07e00640 1 -- 172.21.15.192:0/1382474343 learned_addr learned my addr 172.21.15.192:0/1382474343 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:37.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06a00640 1 --2- 172.21.15.192:0/1382474343 >> v2:172.21.15.194:3300/0 conn(0x7f2f0815e790 0x7f2f080cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143940411 0 0) 0x7f2f0815ec00 con 0x7f2f0815bc20 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2eec003520 con 0x7f2f0815bc20 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2544830029 0 0) 0x7f2f08140480 con 0x7f2f080cacd0 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f0815ec00 con 0x7f2f080cacd0 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06a00640 1 -- 172.21.15.192:0/1382474343 >> v1:172.21.15.194:6789/0 conn(0x7f2f080cacd0 legacy=0x7f2f08140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06a00640 1 -- 172.21.15.192:0/1382474343 >> v1:172.21.15.192:6789/0 conn(0x7f2f0815bc20 legacy=0x7f2f080afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3438359745 0 0) 0x7f2eec003520 con 0x7f2f0815bc20 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.612+0000 7f2f06a00640 1 -- 172.21.15.192:0/1382474343 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f0815ee90 con 0x7f2f0815e790 2024-09-13T18:42:37.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.613+0000 7f2f06a00640 1 --2- 172.21.15.192:0/1382474343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815e790 0x7f2f080cb0b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40097a0 tx=0x7f2ef402a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2d2ea061ebb7c5a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:37.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000019f0 con 0x7f2f0815e790 2024-09-13T18:42:37.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef402ac50 con 0x7f2f0815e790 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f06000640 1 -- 172.21.15.192:0/1382474343 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef4032440 con 0x7f2f0815e790 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 -- 172.21.15.192:0/1382474343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815e790 msgr2=0x7f2f080cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1382474343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815e790 0x7f2f080cb0b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40097a0 tx=0x7f2ef402a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 -- 172.21.15.192:0/1382474343 shutdown_connections 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1382474343 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815e790 0x7f2f080cb0b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 -- 172.21.15.192:0/1382474343 >> 172.21.15.192:0/1382474343 conn(0x7f2f080ae960 msgr2=0x7f2f0806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 -- 172.21.15.192:0/1382474343 shutdown_connections 2024-09-13T18:42:37.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.614+0000 7f2f0e400640 1 -- 172.21.15.192:0/1382474343 wait complete. 2024-09-13T18:42:37.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.616+0000 7f2f0e400640 1 Processor -- start 2024-09-13T18:42:37.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.616+0000 7f2f0e400640 1 -- start start 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 0x7f2f08159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815bc20 0x7f2f0815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0813e290 con 0x7f2f0815e790 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080b4b50 con 0x7f2f0815bc20 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f0e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f080b42b0 con 0x7f2f080cacd0 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f07e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:55730/0 (socket says 172.21.15.192:55730) 2024-09-13T18:42:37.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.617+0000 7f2f07e00640 1 -- 172.21.15.192:0/1317001390 learned_addr learned my addr 172.21.15.192:0/1317001390 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:37.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f06a00640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815bc20 0x7f2f0815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:37.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 0x7f2f08159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 -- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 msgr2=0x7f2f08159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 0x7f2f08159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 -- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815bc20 msgr2=0x7f2f0815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815bc20 0x7f2f0815a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 -- 172.21.15.192:0/1317001390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef4009400 con 0x7f2f0815e790 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 0x7f2f08159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f07e00640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000cc80 tx=0x7f2f0000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000ce90 con 0x7f2f0815e790 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f00012400 con 0x7f2f0815e790 2024-09-13T18:42:37.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f000127f0 con 0x7f2f0815e790 2024-09-13T18:42:37.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f080b4590 con 0x7f2f0815e790 2024-09-13T18:42:37.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.618+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f0806be60 con 0x7f2f0815e790 2024-09-13T18:42:37.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.619+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f0815b6d0 con 0x7f2f0815e790 2024-09-13T18:42:37.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.620+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2f00012950 con 0x7f2f0815e790 2024-09-13T18:42:37.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.621+0000 7f2eff400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:37.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.621+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f00089a80 con 0x7f2f0815e790 2024-09-13T18:42:37.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.621+0000 7f2f07400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:37.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.622+0000 7f2f07400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80011e0 tx=0x7f2ef8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:37.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.626+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2f00054c50 con 0x7f2f0815e790 2024-09-13T18:42:37.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.797+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2f080cb0b0 con 0x7f2f0815e790 2024-09-13T18:42:37.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.798+0000 7f2eff400640 1 -- 172.21.15.192:0/1317001390 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v150) v1 ==== 81+0+34086 (secure 0 0 0) 0x7f2f00058270 con 0x7f2f0815e790 2024-09-13T18:42:37.801 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:37.801 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:37.802 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 150, 2024-09-13T18:42:37.802 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:37.802 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:37.802 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:36.743830+0000", 2024-09-13T18:42:37.802 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:37.803 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:37.804 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.805 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:37.806 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:37.807 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:37.808 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:37.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:37.811 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:37.812 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:37.813 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:37.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.815 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:37.816 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:37.817 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:37.818 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:37.819 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:37.820 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:37.821 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:37.822 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:37.822 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:37.822 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:37.822 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:37.822 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:37.823 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "150", 2024-09-13T18:42:37.824 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:37.825 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:37.826 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:37.827 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:37.828 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:37.828 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:37.828 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:37.828 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:37.828 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:37.829 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:37.830 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:37.831 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:37.832 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.833 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:37.834 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.835 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.836 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.837 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.838 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.839 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.840 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.841 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.842 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.843 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.844 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:37.845 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:37.846 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.847 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.848 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.849 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.850 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.851 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:37.852 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.853 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:37.854 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.855 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.856 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.857 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.858 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.859 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:37.860 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.861 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.861 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.862 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:37.863 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.864 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:37.865 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.866 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.867 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.868 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.869 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.870 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:37.871 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.872 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:37.873 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.874 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.875 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.876 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:37.877 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.878 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.879 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.880 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.881 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.883 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.884 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.885 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.886 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:37.887 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:37.888 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.889 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.890 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.891 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.892 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.893 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.894 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.895 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.896 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.897 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.898 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.899 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:37.900 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:37.901 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:37.902 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:37.903 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:37.903 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:37.903 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:37.903 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:37.903 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 msgr2=0x7f2ee806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2ef80011e0 tx=0x7f2ef8009040 comp rx=0 tx=0).stop 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 msgr2=0x7f2f0813d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000cc80 tx=0x7f2f0000a430 comp rx=0 tx=0).stop 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 shutdown_connections 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2ee806ac00 0x7f2ee806d0c0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f0815e790 0x7f2f0813d030 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2f0815bc20 0x7f2f0815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 --2- 172.21.15.192:0/1317001390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2f080cacd0 0x7f2f08159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 >> 172.21.15.192:0/1317001390 conn(0x7f2f080ae960 msgr2=0x7f2f080ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 shutdown_connections 2024-09-13T18:42:37.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:37.800+0000 7f2f0e400640 1 -- 172.21.15.192:0/1317001390 wait complete. 2024-09-13T18:42:37.906 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:42:37.941 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:42:37.946 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:42:42.907 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:43.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.067+0000 7f83cbe00640 1 Processor -- start 2024-09-13T18:42:43.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.067+0000 7f83cbe00640 1 -- start start 2024-09-13T18:42:43.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.068+0000 7f83cbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83cc1592d0 0x7f83cc070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.068+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.068+0000 7f83cbe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83cc06f830 con 0x7f83cc0b3600 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.068+0000 7f83cbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83cc0b3fb0 con 0x7f83cc1592d0 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.068+0000 7f83cbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc06fa80 con 0x7f83cc06c3b0 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83caa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f83cc1592d0 0x7f83cc070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83ca000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f83cc0b3600 0x7f83cc06bca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55180/0 (socket says 172.21.15.192:55180) 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83ca000640 1 -- 172.21.15.192:0/2097316499 learned_addr learned my addr 172.21.15.192:0/2097316499 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83caa00640 1 -- 172.21.15.192:0/2097316499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 msgr2=0x7f83cc0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:43.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83caa00640 1 --2- 172.21.15.192:0/2097316499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83caa00640 1 -- 172.21.15.192:0/2097316499 >> v1:172.21.15.192:6789/0 conn(0x7f83cc0b3600 legacy=0x7f83cc06bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.069+0000 7f83caa00640 1 -- 172.21.15.192:0/2097316499 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc06fd60 con 0x7f83cc1592d0 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.070+0000 7f83caa00640 1 --2- 172.21.15.192:0/2097316499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc1592d0 0x7f83cc070b20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02b290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=174a62e84c1dea40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.070+0000 7f83c9600640 1 -- 172.21.15.192:0/2097316499 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc033440 con 0x7f83cc1592d0 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.070+0000 7f83c9600640 1 -- 172.21.15.192:0/2097316499 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83bc0335a0 con 0x7f83cc1592d0 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.070+0000 7f83c9600640 1 -- 172.21.15.192:0/2097316499 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83bc033910 con 0x7f83cc1592d0 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 -- 172.21.15.192:0/2097316499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc1592d0 msgr2=0x7f83cc070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 --2- 172.21.15.192:0/2097316499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc1592d0 0x7f83cc070b20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f83bc0097a0 tx=0x7f83bc02b290 comp rx=0 tx=0).stop 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 -- 172.21.15.192:0/2097316499 shutdown_connections 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 --2- 172.21.15.192:0/2097316499 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 --2- 172.21.15.192:0/2097316499 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc1592d0 0x7f83cc070b20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 -- 172.21.15.192:0/2097316499 >> 172.21.15.192:0/2097316499 conn(0x7f83cc0736d0 msgr2=0x7f83cc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:43.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 -- 172.21.15.192:0/2097316499 shutdown_connections 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.071+0000 7f83cbe00640 1 -- 172.21.15.192:0/2097316499 wait complete. 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.073+0000 7f83cbe00640 1 Processor -- start 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.073+0000 7f83cbe00640 1 -- start start 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.073+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc14f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83cc1592d0 0x7f83cc1e1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc14f670 con 0x7f83cc0b3600 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc13c2b0 con 0x7f83cc1592d0 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83cc13c550 con 0x7f83cc06c3b0 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:40990/0 (socket says 172.21.15.192:40990) 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 -- 172.21.15.192:0/892925551 learned_addr learned my addr 172.21.15.192:0/892925551 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83caa00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc14f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83cb400640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83cc1592d0 0x7f83cc1e1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 -- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 msgr2=0x7f83cc14f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc14f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 -- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83cc1592d0 msgr2=0x7f83cc1e1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83cc1592d0 0x7f83cc1e1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.074+0000 7f83ca000640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc009400 con 0x7f83cc0b3600 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83ca000640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c4a0 tx=0x7f83b800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8005ce0 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8005e40 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8007270 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83cc13c830 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.075+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83cc0a98f0 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.076+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83cc13cd50 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.077+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f83b8007490 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.078+0000 7f83c2a00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 0x7f83ac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.078+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f83b80887b0 con 0x7f83cc0b3600 2024-09-13T18:42:43.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.078+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f83ac072730 con 0x7f83cc0b3600 2024-09-13T18:42:43.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.078+0000 7f83caa00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 0x7f83ac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.078+0000 7f83caa00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 0x7f83ac06d0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83bc035000 tx=0x7f83bc02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.082+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83b8017020 con 0x7f83cc0b3600 2024-09-13T18:42:43.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.249+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f83cc0b3a70 con 0x7f83cc0b3600 2024-09-13T18:42:43.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.251+0000 7f83c2a00640 1 -- 172.21.15.192:0/892925551 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v151) v1 ==== 81+0+34105 (secure 0 0 0) 0x7f83cc13cd50 con 0x7f83cc0b3600 2024-09-13T18:42:43.254 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:43.254 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:43.254 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 151, 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:41.826688+0000", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:43.255 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:43.256 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:43.257 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:43.258 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:43.259 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:43.261 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:43.262 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:43.264 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:43.264 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:43.265 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:43.266 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.267 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:43.268 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:43.269 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:43.270 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:43.271 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:43.272 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:43.273 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:43.274 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:43.275 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:43.276 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:43.277 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:43.278 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:43.278 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:43.279 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:43.280 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "151", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:43.281 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:43.282 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:43.283 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:43.284 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.285 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:43.286 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:43.287 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.288 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.289 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.290 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:43.290 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.290 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.290 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.291 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.291 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.291 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.292 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.292 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.292 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:43.292 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.292 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.293 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.294 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.294 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.294 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.294 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.295 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:43.295 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.295 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.296 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.296 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.296 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:43.296 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.296 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.297 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.297 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.297 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.297 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.298 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.299 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.300 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.301 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:43.302 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.302 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.302 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.303 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.304 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.305 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.306 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.307 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.308 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:43.309 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.310 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.311 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.312 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:43.313 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.313 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.313 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.314 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:43.315 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.317 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.317 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:43.318 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.319 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.319 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.319 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.319 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.319 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.320 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.321 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.321 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:43.321 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:43.321 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.321 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.322 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:43.323 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:43.323 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:43.323 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:43.323 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.323 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.324 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.324 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.324 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:43.325 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.325 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.325 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.325 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.325 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.326 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:43.327 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.328 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.328 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.328 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.328 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:43.328 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.329 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.329 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.329 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.330 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.330 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.330 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.331 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.331 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:43.331 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.331 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.332 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.333 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:43.334 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.335 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.336 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.336 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.337 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.338 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.339 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.340 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.342 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.343 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.344 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:43.346 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.346 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.346 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.346 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.346 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.347 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:43.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.349 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.350 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.351 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.352 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.353 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.354 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:43.355 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:43.356 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.357 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.358 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.359 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.360 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:43.361 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:43.363 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:43.364 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.365 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.366 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.367 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.368 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.369 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:43.370 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:43.371 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:43.372 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 msgr2=0x7f83ac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 0x7f83ac06d0c0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f83bc035000 tx=0x7f83bc02f000 comp rx=0 tx=0).stop 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 msgr2=0x7f83cc1e1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f83b800c4a0 tx=0x7f83b800c960 comp rx=0 tx=0).stop 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 shutdown_connections 2024-09-13T18:42:43.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f83ac06ac00 0x7f83ac06d0c0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f83cc1592d0 0x7f83cc1e1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83cc0b3600 0x7f83cc1e1980 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 --2- 172.21.15.192:0/892925551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f83cc06c3b0 0x7f83cc14f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.253+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 >> 172.21.15.192:0/892925551 conn(0x7f83cc0736d0 msgr2=0x7f83cc0cae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.254+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 shutdown_connections 2024-09-13T18:42:43.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.254+0000 7f83cbe00640 1 -- 172.21.15.192:0/892925551 wait complete. 2024-09-13T18:42:43.376 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-13T18:42:43.376 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:43.376 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:43.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:43.414 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-13T18:42:43.805 INFO:teuthology.orchestra.run.smithi192.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-13T18:42:43.805 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:42:43.805 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:42:43.805 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.311754 s, 168 MB/s 2024-09-13T18:42:43.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:42:43.806 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:43.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.957+0000 7fb8d7200640 1 Processor -- start 2024-09-13T18:42:43.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.958+0000 7fb8d7200640 1 -- start start 2024-09-13T18:42:43.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d7200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 0x7fb8d0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d7200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8d006bc30 0x7fb8d015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d7200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d015af60 con 0x7fb8d0159b00 2024-09-13T18:42:43.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d7200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d006b7a0 con 0x7fb8d006bc30 2024-09-13T18:42:43.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d7200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d015ac80 con 0x7fb8d00b3480 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb8d006bc30 0x7fb8d015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d5e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb8d0159b00 0x7fb8d00b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55182/0 (socket says 172.21.15.192:55182) 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d5e00640 1 -- 172.21.15.192:0/1755649242 learned_addr learned my addr 172.21.15.192:0/1755649242 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.959+0000 7fb8d5400640 1 --2- 172.21.15.192:0/1755649242 >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 0x7fb8d0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d6800640 1 -- 172.21.15.192:0/1755649242 >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 msgr2=0x7fb8d0159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d6800640 1 --2- 172.21.15.192:0/1755649242 >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 0x7fb8d0159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d6800640 1 -- 172.21.15.192:0/1755649242 >> v1:172.21.15.192:6789/0 conn(0x7fb8d0159b00 legacy=0x7fb8d00b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d4a00640 1 -- 172.21.15.192:0/1755649242 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2434590127 0 0) 0x7fb8d015af60 con 0x7fb8d0159b00 2024-09-13T18:42:43.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d6800640 1 -- 172.21.15.192:0/1755649242 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d006b150 con 0x7fb8d006bc30 2024-09-13T18:42:43.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.960+0000 7fb8d5400640 1 --2- 172.21.15.192:0/1755649242 >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 0x7fb8d0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d6800640 1 --2- 172.21.15.192:0/1755649242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d006bc30 0x7fb8d015a420 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb8d006c830 tx=0x7fb8cc02a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d99890fb784e0ae3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d4a00640 1 -- 172.21.15.192:0/1755649242 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc007740 con 0x7fb8d006bc30 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d4a00640 1 -- 172.21.15.192:0/1755649242 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc02d050 con 0x7fb8d006bc30 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d4a00640 1 -- 172.21.15.192:0/1755649242 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc007ac0 con 0x7fb8d006bc30 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 -- 172.21.15.192:0/1755649242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d006bc30 msgr2=0x7fb8d015a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1755649242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d006bc30 0x7fb8d015a420 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fb8d006c830 tx=0x7fb8cc02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 -- 172.21.15.192:0/1755649242 shutdown_connections 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1755649242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d006bc30 0x7fb8d015a420 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1755649242 >> v2:172.21.15.194:3300/0 conn(0x7fb8d00b3480 0x7fb8d0159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.961+0000 7fb8d7200640 1 -- 172.21.15.192:0/1755649242 >> 172.21.15.192:0/1755649242 conn(0x7fb8d00736d0 msgr2=0x7fb8d00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:43.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.962+0000 7fb8d7200640 1 -- 172.21.15.192:0/1755649242 shutdown_connections 2024-09-13T18:42:43.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.962+0000 7fb8d7200640 1 -- 172.21.15.192:0/1755649242 wait complete. 2024-09-13T18:42:43.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.963+0000 7fb8d7200640 1 Processor -- start 2024-09-13T18:42:43.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.963+0000 7fb8d7200640 1 -- start start 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8d006bc30 0x7fb8d00adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d00b3480 0x7fb8d01f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d015b7d0 con 0x7fb8d0159b00 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d015bab0 con 0x7fb8d00b3480 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d7200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d015bd90 con 0x7fb8d006bc30 2024-09-13T18:42:43.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41008/0 (socket says 172.21.15.192:41008) 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d6800640 1 -- 172.21.15.192:0/1924273982 learned_addr learned my addr 172.21.15.192:0/1924273982 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d5400640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d00b3480 0x7fb8d01f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.964+0000 7fb8d5e00640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8d006bc30 0x7fb8d00adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 -- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8d006bc30 msgr2=0x7fb8d00adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8d006bc30 0x7fb8d00adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 -- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d00b3480 msgr2=0x7fb8d01f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d00b3480 0x7fb8d01f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8cc009a70 con 0x7fb8d0159b00 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d6800640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009e80 tx=0x7fb8cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc003b90 con 0x7fb8d0159b00 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8cc003cf0 con 0x7fb8d0159b00 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8cc004230 con 0x7fb8d0159b00 2024-09-13T18:42:43.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.965+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8d015c070 con 0x7fb8d0159b00 2024-09-13T18:42:43.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.966+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d015c630 con 0x7fb8d0159b00 2024-09-13T18:42:43.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.966+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d00b2d70 con 0x7fb8d0159b00 2024-09-13T18:42:43.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.967+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8cc004390 con 0x7fb8d0159b00 2024-09-13T18:42:43.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.968+0000 7fb8ca000640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 0x7fb8b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:43.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.968+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8cc0aa920 con 0x7fb8d0159b00 2024-09-13T18:42:43.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.968+0000 7fb8d5e00640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 0x7fb8b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:43.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.969+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fb8b4072730 con 0x7fb8d0159b00 2024-09-13T18:42:43.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.969+0000 7fb8d5e00640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 0x7fb8b406d0c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4007fd0 tx=0x7fb8c4007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:43.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:43.972+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8cc040060 con 0x7fb8d0159b00 2024-09-13T18:42:44.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.141+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fb8d00b3c70 con 0x7fb8d0159b00 2024-09-13T18:42:44.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.142+0000 7fb8ca000640 1 -- 172.21.15.192:0/1924273982 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v151) v1 ==== 81+0+34105 (secure 0 0 0) 0x7fb8cc049070 con 0x7fb8d0159b00 2024-09-13T18:42:44.145 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:44.145 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:44.145 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 151, 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:41.826688+0000", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:44.146 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:44.147 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:44.148 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:44.149 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:44.150 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:44.151 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:44.152 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:44.153 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:44.154 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:44.155 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:44.157 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:44.158 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:44.159 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:44.160 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:44.161 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:44.162 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:44.163 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:44.164 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:42:44.165 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:44.166 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:44.167 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:44.167 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:44.168 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "151", 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:44.169 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:44.170 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:44.171 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:44.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:44.173 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.174 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:44.175 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.176 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.177 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.179 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:44.180 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.181 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.182 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.183 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.184 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.186 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.187 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:44.188 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.189 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.190 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.193 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.194 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:44.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.196 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.198 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:44.199 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.200 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.206 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.207 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.207 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.207 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.208 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:44.211 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:44.212 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.213 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.214 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.220 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.221 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:44.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.225 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:44.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.229 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:44.231 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.233 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.234 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.235 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:44.237 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:44.238 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:44.239 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:44.240 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 msgr2=0x7fb8b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 0x7fb8b406d0c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4007fd0 tx=0x7fb8c4007de0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 msgr2=0x7fb8d01f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fb8cc009e80 tx=0x7fb8cc004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 shutdown_connections 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb8b406ac00 0x7fb8b406d0c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8d0159b00 0x7fb8d01f3b00 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8d00b3480 0x7fb8d01f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 --2- 172.21.15.192:0/1924273982 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8d006bc30 0x7fb8d00adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 >> 172.21.15.192:0/1924273982 conn(0x7fb8d00736d0 msgr2=0x7fb8d00cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 shutdown_connections 2024-09-13T18:42:44.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.144+0000 7fb8d7200640 1 -- 172.21.15.192:0/1924273982 wait complete. 2024-09-13T18:42:44.244 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:44.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.392+0000 7fa91a000640 1 Processor -- start 2024-09-13T18:42:44.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.392+0000 7fa91a000640 1 -- start start 2024-09-13T18:42:44.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa91a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 0x7fa914162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:44.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa91a000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9141586f0 con 0x7fa9140b2690 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa91a000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa914162230 con 0x7fa9140afd80 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa91a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141627f0 con 0x7fa9140b2b00 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa912a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa9140b2690 0x7fa914161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:55190/0 (socket says 172.21.15.192:55190) 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.393+0000 7fa912a00640 1 -- 172.21.15.192:0/2660326846 learned_addr learned my addr 172.21.15.192:0/2660326846 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa913e00640 1 --2- 172.21.15.192:0/2660326846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 0x7fa914162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1711147039 0 0) 0x7fa9141586f0 con 0x7fa9140b2690 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8f8003520 con 0x7fa9140b2690 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738969450 0 0) 0x7fa914162230 con 0x7fa9140afd80 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9141586f0 con 0x7fa9140afd80 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa913e00640 1 -- 172.21.15.192:0/2660326846 >> v1:172.21.15.194:6789/0 conn(0x7fa9140afd80 legacy=0x7fa9140b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa913e00640 1 -- 172.21.15.192:0/2660326846 >> v1:172.21.15.192:6789/0 conn(0x7fa9140b2690 legacy=0x7fa914161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.394+0000 7fa913e00640 1 -- 172.21.15.192:0/2660326846 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa914162510 con 0x7fa9140b2b00 2024-09-13T18:42:44.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.395+0000 7fa913e00640 1 --2- 172.21.15.192:0/2660326846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 0x7fa914162950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009dc0 tx=0x7fa90c02a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cda8b7fec8f94b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:44.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c007740 con 0x7fa9140b2b00 2024-09-13T18:42:44.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c02d050 con 0x7fa9140b2b00 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa912000640 1 -- 172.21.15.192:0/2660326846 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c007ac0 con 0x7fa9140b2b00 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 -- 172.21.15.192:0/2660326846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 msgr2=0x7fa914162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 --2- 172.21.15.192:0/2660326846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 0x7fa914162950 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009dc0 tx=0x7fa90c02a6d0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 -- 172.21.15.192:0/2660326846 shutdown_connections 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 --2- 172.21.15.192:0/2660326846 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2b00 0x7fa914162950 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 -- 172.21.15.192:0/2660326846 >> 172.21.15.192:0/2660326846 conn(0x7fa9140ae960 msgr2=0x7fa91406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:44.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 -- 172.21.15.192:0/2660326846 shutdown_connections 2024-09-13T18:42:44.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.396+0000 7fa91a000640 1 -- 172.21.15.192:0/2660326846 wait complete. 2024-09-13T18:42:44.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.398+0000 7fa91a000640 1 Processor -- start 2024-09-13T18:42:44.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.398+0000 7fa91a000640 1 -- start start 2024-09-13T18:42:44.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 0x7fa914156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 0x7fa9141eb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141ec980 con 0x7fa9140b2b00 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141ebd00 con 0x7fa9140afd80 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa91a000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9141ebfe0 con 0x7fa9140b2690 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41020/0 (socket says 172.21.15.192:41020) 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 -- 172.21.15.192:0/2849043551 learned_addr learned my addr 172.21.15.192:0/2849043551 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:44.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913400640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 0x7fa914156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa912a00640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 0x7fa9141eb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 -- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 msgr2=0x7fa9141eb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 0x7fa9141eb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 -- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 msgr2=0x7fa914156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.399+0000 7fa913e00640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 0x7fa914156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa913e00640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c009a70 con 0x7fa9140b2b00 2024-09-13T18:42:44.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa913400640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 0x7fa914156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa912a00640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 0x7fa9141eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa913e00640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ee0 tx=0x7fa90c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c03b820 con 0x7fa9140b2b00 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c03b980 con 0x7fa9140b2b00 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9141ec2c0 con 0x7fa9140b2b00 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c03bd10 con 0x7fa9140b2b00 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.400+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa914157020 con 0x7fa9140b2b00 2024-09-13T18:42:44.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.401+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9141ecac0 con 0x7fa9140b2b00 2024-09-13T18:42:44.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.402+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa90c031400 con 0x7fa9140b2b00 2024-09-13T18:42:44.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.403+0000 7fa90b400640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 0x7fa8f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:44.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.403+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa90c0aab50 con 0x7fa9140b2b00 2024-09-13T18:42:44.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.403+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7fa8f4072730 con 0x7fa9140b2b00 2024-09-13T18:42:44.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.403+0000 7fa913400640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 0x7fa8f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:44.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.404+0000 7fa913400640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 0x7fa8f406d0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa9040011e0 tx=0x7fa904009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:44.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.407+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa9141ecac0 con 0x7fa9140b2b00 2024-09-13T18:42:44.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.610+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9141ecac0 con 0x7fa9140b2b00 2024-09-13T18:42:44.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.611+0000 7fa90b400640 1 -- 172.21.15.192:0/2849043551 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fa9141ecac0 con 0x7fa9140b2b00 2024-09-13T18:42:44.614 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:44.614 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:42:44.614 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:42:44.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 msgr2=0x7fa8f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 0x7fa8f406d0c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa9040011e0 tx=0x7fa904009040 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 msgr2=0x7fa9140a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009ee0 tx=0x7fa90c004a40 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 shutdown_connections 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa8f406ac00 0x7fa8f406d0c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9140b2b00 0x7fa9140a9430 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa9140b2690 0x7fa9141eb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 --2- 172.21.15.192:0/2849043551 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa9140afd80 0x7fa914156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 >> 172.21.15.192:0/2849043551 conn(0x7fa9140ae960 msgr2=0x7fa91406b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 shutdown_connections 2024-09-13T18:42:44.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:44.613+0000 7fa91a000640 1 -- 172.21.15.192:0/2849043551 wait complete. 2024-09-13T18:42:44.633 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:42:44.805 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":7710,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.093210172999999,"mdsmap_epoch":62,"osdmap_epoch":151,"osdmap_epoch_barrier":151,"uptime":23.223567940999999} 2024-09-13T18:42:44.805 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 7710, "mdsmap_epoch": 62, "osdmap_epoch": 151, "osdmap_epoch_barrier": 151, "rank_uptime": 18.093210173, "state": "up:active", "uptime": 23.223567941, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:42:44.806 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:42:44.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:44.806 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-13T18:42:44.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:44.845 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-13T18:42:44.925 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:45.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.115+0000 7f77b8c00640 1 Processor -- start 2024-09-13T18:42:45.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.115+0000 7f77b8c00640 1 -- start start 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.116+0000 7f77b8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77b415dee0 0x7f77b40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.116+0000 7f77b8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f77b40b3f10 0x7f77b40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.116+0000 7f77b8c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b40b2f00 con 0x7f77b415e2c0 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b8c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b40b3150 con 0x7f77b415dee0 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b40b3430 con 0x7f77b40b3f10 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77b415dee0 0x7f77b40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f77b415dee0 0x7f77b40afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41024/0 (socket says 172.21.15.192:41024) 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 -- 172.21.15.192:0/2460182359 learned_addr learned my addr 172.21.15.192:0/2460182359 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:45.120 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77a9400640 1 --2- 172.21.15.192:0/2460182359 >> v2:172.21.15.194:3300/0 conn(0x7f77b40b3f10 0x7f77b40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 -- 172.21.15.192:0/2460182359 >> v2:172.21.15.194:3300/0 conn(0x7f77b40b3f10 msgr2=0x7f77b40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:45.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 --2- 172.21.15.192:0/2460182359 >> v2:172.21.15.194:3300/0 conn(0x7f77b40b3f10 0x7f77b40b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 -- 172.21.15.192:0/2460182359 >> v1:172.21.15.192:6789/0 conn(0x7f77b415e2c0 legacy=0x7f77b415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.117+0000 7f77b1e00640 1 -- 172.21.15.192:0/2460182359 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b40b3710 con 0x7f77b415dee0 2024-09-13T18:42:45.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b1e00640 1 --2- 172.21.15.192:0/2460182359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b415dee0 0x7f77b40afd80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b4700 tx=0x7f77a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fef53d8b3785f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:45.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b1400640 1 -- 172.21.15.192:0/2460182359 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4032440 con 0x7f77b415dee0 2024-09-13T18:42:45.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b1400640 1 -- 172.21.15.192:0/2460182359 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a40325a0 con 0x7f77b415dee0 2024-09-13T18:42:45.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b1400640 1 -- 172.21.15.192:0/2460182359 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4032930 con 0x7f77b415dee0 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 -- 172.21.15.192:0/2460182359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b415dee0 msgr2=0x7f77b40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 --2- 172.21.15.192:0/2460182359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b415dee0 0x7f77b40afd80 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b4700 tx=0x7f77a402a270 comp rx=0 tx=0).stop 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 -- 172.21.15.192:0/2460182359 shutdown_connections 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 --2- 172.21.15.192:0/2460182359 >> v2:172.21.15.194:3300/0 conn(0x7f77b40b3f10 0x7f77b40b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 --2- 172.21.15.192:0/2460182359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b415dee0 0x7f77b40afd80 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.119+0000 7f77b8c00640 1 -- 172.21.15.192:0/2460182359 >> 172.21.15.192:0/2460182359 conn(0x7f77b40ae960 msgr2=0x7f77b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.120+0000 7f77b8c00640 1 -- 172.21.15.192:0/2460182359 shutdown_connections 2024-09-13T18:42:45.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.120+0000 7f77b8c00640 1 -- 172.21.15.192:0/2460182359 wait complete. 2024-09-13T18:42:45.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.121+0000 7f77b8c00640 1 Processor -- start 2024-09-13T18:42:45.124 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.121+0000 7f77b8c00640 1 -- start start 2024-09-13T18:42:45.127 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77b415dee0 0x7f77b4158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77b415e2c0 0x7f77b40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40ae1e0 con 0x7f77b40add80 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b4150af0 con 0x7f77b415dee0 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.122+0000 7f77b8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b41f3750 con 0x7f77b415e2c0 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:41032/0 (socket says 172.21.15.192:41032) 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 -- 172.21.15.192:0/971215368 learned_addr learned my addr 172.21.15.192:0/971215368 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b1e00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77b415dee0 0x7f77b4158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77a9400640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77b415e2c0 0x7f77b40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 -- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77b415e2c0 msgr2=0x7f77b40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77b415e2c0 0x7f77b40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 -- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77b415dee0 msgr2=0x7f77b4158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77b415dee0 0x7f77b4158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a40094d0 con 0x7f77b40add80 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.123+0000 7f77b2800640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c6b0 tx=0x7f77ac00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.124+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac003b70 con 0x7f77b40add80 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.124+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac003cf0 con 0x7f77b40add80 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.124+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac003ea0 con 0x7f77b40add80 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.124+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b415d220 con 0x7f77b40add80 2024-09-13T18:42:45.129 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.124+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b41f5e80 con 0x7f77b40add80 2024-09-13T18:42:45.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.125+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b415a440 con 0x7f77b40add80 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.126+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f77ac005310 con 0x7f77b40add80 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.126+0000 7f77aaa00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 0x7f779006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.127+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77ac088f90 con 0x7f77b40add80 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.127+0000 7f77b1e00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 0x7f779006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.127+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f7790072730 con 0x7f77b40add80 2024-09-13T18:42:45.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.127+0000 7f77b1e00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 0x7f779006d0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f77a4034000 tx=0x7f77a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:45.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.131+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f77ac054210 con 0x7f77b40add80 2024-09-13T18:42:45.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.300+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f77b4142ed0 con 0x7f77b40add80 2024-09-13T18:42:45.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.302+0000 7f77aaa00640 1 -- 172.21.15.192:0/971215368 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v151) v1 ==== 81+0+34105 (secure 0 0 0) 0x7f77ac057830 con 0x7f77b40add80 2024-09-13T18:42:45.305 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:45.305 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 151, 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:41.826688+0000", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:45.306 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:45.307 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:45.308 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:45.309 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:45.310 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:45.311 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:45.311 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:45.312 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:45.313 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.314 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:45.315 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:45.316 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:45.317 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:45.318 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:45.319 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:45.320 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:45.321 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.322 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:45.323 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:42:45.324 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:45.325 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:45.326 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "151", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:45.327 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:45.328 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:45.329 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:45.330 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:45.331 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.332 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.333 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.334 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.335 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.336 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.337 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.338 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:45.339 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.340 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.341 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.342 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.343 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.344 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.345 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.346 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.347 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.348 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:45.349 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:45.350 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.351 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.352 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.353 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.354 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.355 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:45.356 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.357 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.358 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.359 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.360 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.361 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.362 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:45.363 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.364 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.365 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.366 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.367 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.368 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.369 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.370 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.371 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:45.372 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.373 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.374 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.375 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:45.376 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:45.377 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:45.378 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.379 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.380 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.381 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:45.382 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.383 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.384 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.385 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.386 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.387 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.388 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:45.389 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:45.390 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.391 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:45.392 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:45.393 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 msgr2=0x7f779006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 0x7f779006d0c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f77a4034000 tx=0x7f77a402e000 comp rx=0 tx=0).stop 2024-09-13T18:42:45.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 msgr2=0x7f77b41f29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00c6b0 tx=0x7f77ac00cb70 comp rx=0 tx=0).stop 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 shutdown_connections 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f779006ac00 0x7f779006d0c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f77b40add80 0x7f77b41f29a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f77b415e2c0 0x7f77b40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 --2- 172.21.15.192:0/971215368 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f77b415dee0 0x7f77b4158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 >> 172.21.15.192:0/971215368 conn(0x7f77b40ae960 msgr2=0x7f77b40b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 shutdown_connections 2024-09-13T18:42:45.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:45.304+0000 7f77b8c00640 1 -- 172.21.15.192:0/971215368 wait complete. 2024-09-13T18:42:45.397 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:42:50.400 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:50.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.560+0000 7f4941000640 1 Processor -- start 2024-09-13T18:42:50.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.560+0000 7f4941000640 1 -- start start 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4941000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f493c146610 0x7f493c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4941000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4941000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f493c0adf50 con 0x7f493c0b2780 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4941000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0cd920 con 0x7f493c146610 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4941000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0b0730 con 0x7f493c0afd80 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f493c0b2780 0x7f493c0ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44150/0 (socket says 172.21.15.192:44150) 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f493c146610 0x7f493c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939400640 1 -- 172.21.15.192:0/2970773439 learned_addr learned my addr 172.21.15.192:0/2970773439 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:50.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f493a800640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939e00640 1 -- 172.21.15.192:0/2970773439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 msgr2=0x7f493c0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939e00640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939e00640 1 -- 172.21.15.192:0/2970773439 >> v1:172.21.15.192:6789/0 conn(0x7f493c0b2780 legacy=0x7f493c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4938a00640 1 -- 172.21.15.192:0/2970773439 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184911855 0 0) 0x7f493c0adf50 con 0x7f493c0b2780 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.562+0000 7f4939e00640 1 -- 172.21.15.192:0/2970773439 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c0ae770 con 0x7f493c146610 2024-09-13T18:42:50.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4939e00640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c146610 0x7f493c0ce2f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f492c0097d0 tx=0x7f492c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa713bf0566c3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4938a00640 1 -- 172.21.15.192:0/2970773439 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c032440 con 0x7f493c146610 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4938a00640 1 -- 172.21.15.192:0/2970773439 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f492c0325a0 con 0x7f493c146610 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4938a00640 1 -- 172.21.15.192:0/2970773439 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c032930 con 0x7f493c146610 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 -- 172.21.15.192:0/2970773439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c146610 msgr2=0x7f493c0ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c146610 0x7f493c0ce2f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f492c0097d0 tx=0x7f492c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 -- 172.21.15.192:0/2970773439 shutdown_connections 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c0b01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 --2- 172.21.15.192:0/2970773439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c146610 0x7f493c0ce2f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 -- 172.21.15.192:0/2970773439 >> 172.21.15.192:0/2970773439 conn(0x7f493c0ae960 msgr2=0x7f493c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 -- 172.21.15.192:0/2970773439 shutdown_connections 2024-09-13T18:42:50.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.564+0000 7f4941000640 1 -- 172.21.15.192:0/2970773439 wait complete. 2024-09-13T18:42:50.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.566+0000 7f4941000640 1 Processor -- start 2024-09-13T18:42:50.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.566+0000 7f4941000640 1 -- start start 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 0x7f493c157ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f4910 con 0x7f493c0b2780 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f3d00 con 0x7f493c146610 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4941000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f3fe0 con 0x7f493c0afd80 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4939400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4939400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33664/0 (socket says 172.21.15.192:33664) 2024-09-13T18:42:50.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.567+0000 7f4939400640 1 -- 172.21.15.192:0/2598373732 learned_addr learned my addr 172.21.15.192:0/2598373732 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:50.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939e00640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f493a800640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 0x7f493c157ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 -- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 msgr2=0x7f493c13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c13d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 -- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 msgr2=0x7f493c157ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 0x7f493c157ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f492c009400 con 0x7f493c0b2780 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f493a800640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 0x7f493c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939e00640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:50.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4939400640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f492800c4b0 tx=0x7f492800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280074e0 con 0x7f493c0b2780 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928007660 con 0x7f493c0b2780 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c1f42c0 con 0x7f493c0b2780 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4928004a20 con 0x7f493c0b2780 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.568+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c13d710 con 0x7f493c0b2780 2024-09-13T18:42:50.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.569+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c1f4ac0 con 0x7f493c0b2780 2024-09-13T18:42:50.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.570+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4928004b80 con 0x7f493c0b2780 2024-09-13T18:42:50.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.571+0000 7f4932000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 0x7f491c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:50.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.571+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4928088550 con 0x7f493c0b2780 2024-09-13T18:42:50.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.571+0000 7f4939e00640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 0x7f491c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:50.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.571+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=152}) v3 -- 0x7f491c072760 con 0x7f493c0b2780 2024-09-13T18:42:50.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.572+0000 7f4939e00640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 0x7f491c06d0f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f492c034000 tx=0x7f492c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:50.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.575+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4928018060 con 0x7f493c0b2780 2024-09-13T18:42:50.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.747+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f493c145c70 con 0x7f493c0b2780 2024-09-13T18:42:50.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.749+0000 7f4932000640 1 -- 172.21.15.192:0/2598373732 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v151) v1 ==== 81+0+34105 (secure 0 0 0) 0x7f493c1f4ac0 con 0x7f493c0b2780 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 151, 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:41.826688+0000", 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:50.752 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:50.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:50.754 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:50.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:50.756 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:50.757 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:50.758 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:50.759 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:50.760 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:50.761 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:50.762 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:50.763 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.764 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:50.765 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:50.766 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:50.767 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:50.768 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:50.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "151", 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:50.770 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:50.771 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:50.772 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:50.773 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:50.774 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.775 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.776 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.777 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:50.779 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.780 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:50.781 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.782 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.783 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.785 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.786 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.787 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:50.788 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.789 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.790 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.791 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:50.793 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.794 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.795 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.797 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.798 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.799 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.800 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.801 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.802 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.803 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.805 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.806 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.807 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.808 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.809 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.810 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.811 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.812 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.813 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.814 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:50.815 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.816 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:50.817 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.818 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.819 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:50.820 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:50.821 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.822 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.823 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.824 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:50.825 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:50.826 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.827 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.828 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.829 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.830 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.831 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.832 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:50.833 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:50.834 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:50.835 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:50.836 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 msgr2=0x7f491c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 0x7f491c06d0f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f492c034000 tx=0x7f492c02e000 comp rx=0 tx=0).stop 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 msgr2=0x7f493c157ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f492800c4b0 tx=0x7f492800c970 comp rx=0 tx=0).stop 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 shutdown_connections 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491c06ac30 0x7f491c06d0f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f493c146610 0x7f493c157ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493c0b2780 0x7f493c157ab0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 --2- 172.21.15.192:0/2598373732 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f493c0afd80 0x7f493c13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 >> 172.21.15.192:0/2598373732 conn(0x7f493c0ae960 msgr2=0x7f493c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 shutdown_connections 2024-09-13T18:42:50.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:50.751+0000 7f4941000640 1 -- 172.21.15.192:0/2598373732 wait complete. 2024-09-13T18:42:50.840 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:42:55.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:56.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.001+0000 7f4765e00640 1 Processor -- start 2024-09-13T18:42:56.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.001+0000 7f4765e00640 1 -- start start 2024-09-13T18:42:56.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4765e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4760146610 0x7f47600ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4765e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f47600ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4765e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47600ae770 con 0x7f47600afd80 2024-09-13T18:42:56.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4765e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47600cd920 con 0x7f4760146610 2024-09-13T18:42:56.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4765e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47600cdb30 con 0x7f47600b2780 2024-09-13T18:42:56.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f475f400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f47600afd80 0x7f47600b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44158/0 (socket says 172.21.15.192:44158) 2024-09-13T18:42:56.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f475f400640 1 -- 172.21.15.192:0/2408195073 learned_addr learned my addr 172.21.15.192:0/2408195073 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:56.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f4756000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f47600ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f475ea00640 1 --2- 172.21.15.192:0/2408195073 >> v2:172.21.15.194:3300/0 conn(0x7f4760146610 0x7f47600ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3323065460 0 0) 0x7f47600ae770 con 0x7f47600afd80 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.003+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4744003520 con 0x7f47600afd80 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1754246206 0 0) 0x7f4744003520 con 0x7f47600afd80 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 msgr2=0x7f47600ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f47600ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 >> v2:172.21.15.194:3300/0 conn(0x7f4760146610 msgr2=0x7f47600ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 --2- 172.21.15.192:0/2408195073 >> v2:172.21.15.194:3300/0 conn(0x7f4760146610 0x7f47600ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600ae1b0 con 0x7f47600afd80 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f47580019f0 con 0x7f47600afd80 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 >> v1:172.21.15.192:6789/0 conn(0x7f47600afd80 legacy=0x7f47600b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f4744003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f47440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4744004d00 0x7f4744005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600cd920 con 0x7f4744003f40 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600cdb30 con 0x7f4744004d00 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474400b980 con 0x7f47600b2780 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f47440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475f400640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4744004d00 0x7f4744005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f475ea00640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f4744003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 -- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 msgr2=0x7f4744003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f47600b2780 0x7f4744003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 -- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4744004d00 msgr2=0x7f4744005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4744004d00 0x7f4744005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.004+0000 7f4756000640 1 -- 172.21.15.192:0/2408195073 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4744003520 con 0x7f4744003f40 2024-09-13T18:42:56.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.005+0000 7f475f400640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4744004d00 0x7f4744005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:56.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.005+0000 7f4756000640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f47440047c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f4748009ac0 tx=0x7f47440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be7fcc5276a3aff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748031400 con 0x7f4744003f40 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474802d050 con 0x7f4744003f40 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f475e000640 1 -- 172.21.15.192:0/2408195073 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4748031780 con 0x7f4744003f40 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 -- 172.21.15.192:0/2408195073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 msgr2=0x7f47440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 --2- 172.21.15.192:0/2408195073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f47440047c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f4748009ac0 tx=0x7f47440057f0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f475f400640 1 -- 172.21.15.192:0/2408195073 reap_dead start 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 -- 172.21.15.192:0/2408195073 shutdown_connections 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 -- 172.21.15.192:0/2408195073 >> 172.21.15.192:0/2408195073 conn(0x7f47600ae960 msgr2=0x7f476006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 -- 172.21.15.192:0/2408195073 shutdown_connections 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.006+0000 7f4765e00640 1 -- 172.21.15.192:0/2408195073 wait complete. 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.008+0000 7f4765e00640 1 Processor -- start 2024-09-13T18:42:56.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.008+0000 7f4765e00640 1 -- start start 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f476006e8f0 0x7f476006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 0x7f4760071110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760070430 con 0x7f4744003f40 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760071650 con 0x7f4760070c90 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f4765e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476006ffa0 con 0x7f476006e8f0 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f475ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f475ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33696/0 (socket says 172.21.15.192:33696) 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.009+0000 7f475ea00640 1 -- 172.21.15.192:0/1569806297 learned_addr learned my addr 172.21.15.192:0/1569806297 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475f400640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 0x7f4760071110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 -- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f476006e8f0 msgr2=0x7f476006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4756000640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f476006e8f0 0x7f476006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f476006e8f0 0x7f476006ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 -- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 msgr2=0x7f4760071110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 0x7f4760071110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 -- 172.21.15.192:0/1569806297 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f476015ccb0 con 0x7f4744003f40 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475f400640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 0x7f4760071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f475ea00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f4750011aa0 tx=0x7f4750011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750009680 con 0x7f4744003f40 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475000fb80 con 0x7f4744003f40 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750014440 con 0x7f4744003f40 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476006f390 con 0x7f4744003f40 2024-09-13T18:42:56.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.010+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476006f950 con 0x7f4744003f40 2024-09-13T18:42:56.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.011+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47600ce2f0 con 0x7f4744003f40 2024-09-13T18:42:56.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.012+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f47500145a0 con 0x7f4744003f40 2024-09-13T18:42:56.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.013+0000 7f4757e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 0x7f473c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.013+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4750089cb0 con 0x7f4744003f40 2024-09-13T18:42:56.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.013+0000 7f4756000640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 0x7f473c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.014+0000 7f4756000640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 0x7f473c06d0c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4748033000 tx=0x7f4748008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.018+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4750054f30 con 0x7f4744003f40 2024-09-13T18:42:56.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.186+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f47600b3540 con 0x7f4744003f40 2024-09-13T18:42:56.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.188+0000 7f4757e00640 1 -- 172.21.15.192:0/1569806297 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+34086 (secure 0 0 0) 0x7f4750022090 con 0x7f4744003f40 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 152, 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:51.829419+0000", 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:56.191 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:56.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.193 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:56.194 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.195 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.196 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.196 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.196 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.196 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.197 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.198 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:56.199 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.200 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:56.201 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.202 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.203 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.204 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:56.205 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.206 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.207 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.208 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "152", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.209 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.211 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:56.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:56.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:56.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:56.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:56.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:56.219 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.225 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.226 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:56.227 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.230 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.232 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.235 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:56.237 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.238 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.243 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.244 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.245 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.246 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.247 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.249 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:56.250 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.251 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.252 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.253 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:56.254 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.255 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.256 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.257 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:56.258 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:56.259 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.260 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.261 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.262 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.263 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.264 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:56.265 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:56.266 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.267 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.268 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 msgr2=0x7f473c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 0x7f473c06d0c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4748033000 tx=0x7f4748008030 comp rx=0 tx=0).stop 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 msgr2=0x7f476015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f4750011aa0 tx=0x7f4750011f60 comp rx=0 tx=0).stop 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 shutdown_connections 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f473c06ac00 0x7f473c06d0c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4760070c90 0x7f4760071110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f476006e8f0 0x7f476006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 --2- 172.21.15.192:0/1569806297 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4744003f40 0x7f476015c770 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 >> 172.21.15.192:0/1569806297 conn(0x7f47600ae960 msgr2=0x7f4760160bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:56.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 shutdown_connections 2024-09-13T18:42:56.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.190+0000 7f4765e00640 1 -- 172.21.15.192:0/1569806297 wait complete. 2024-09-13T18:42:56.271 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-13T18:42:56.272 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:42:56.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.421+0000 7f171b400640 1 Processor -- start 2024-09-13T18:42:56.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.421+0000 7f171b400640 1 -- start start 2024-09-13T18:42:56.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.422+0000 7f171b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 0x7f171415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.422+0000 7f171b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f171415bc20 0x7f17140afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.422+0000 7f171b400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1714140480 con 0x7f17140cb0b0 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.422+0000 7f171b400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17140cb520 con 0x7f171415bc20 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.422+0000 7f171b400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f171415ee90 con 0x7f17140cacd0 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f170be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f17140cb0b0 0x7f1714140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44166/0 (socket says 172.21.15.192:44166) 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f170be00640 1 -- 172.21.15.192:0/1057070805 learned_addr learned my addr 172.21.15.192:0/1057070805 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1719400640 1 --2- 172.21.15.192:0/1057070805 >> v2:172.21.15.192:3300/0 conn(0x7f171415bc20 0x7f17140afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1718a00640 1 --2- 172.21.15.192:0/1057070805 >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 0x7f171415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1719400640 1 -- 172.21.15.192:0/1057070805 >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 msgr2=0x7f171415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1719400640 1 --2- 172.21.15.192:0/1057070805 >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 0x7f171415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1719400640 1 -- 172.21.15.192:0/1057070805 >> v1:172.21.15.192:6789/0 conn(0x7f17140cb0b0 legacy=0x7f1714140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1719400640 1 -- 172.21.15.192:0/1057070805 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171415f170 con 0x7f171415bc20 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1713e00640 1 -- 172.21.15.192:0/1057070805 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435088549 0 0) 0x7f1714140480 con 0x7f17140cb0b0 2024-09-13T18:42:56.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.423+0000 7f1718a00640 1 --2- 172.21.15.192:0/1057070805 >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 0x7f171415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:56.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.424+0000 7f1719400640 1 --2- 172.21.15.192:0/1057070805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f171415bc20 0x7f17140afd80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f17140b2350 tx=0x7f170c02a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a4068558c195a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.424+0000 7f1713e00640 1 -- 172.21.15.192:0/1057070805 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c02aea0 con 0x7f171415bc20 2024-09-13T18:42:56.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f1713e00640 1 -- 172.21.15.192:0/1057070805 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170c02d050 con 0x7f171415bc20 2024-09-13T18:42:56.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f1713e00640 1 -- 172.21.15.192:0/1057070805 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170c007960 con 0x7f171415bc20 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 -- 172.21.15.192:0/1057070805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f171415bc20 msgr2=0x7f17140afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 --2- 172.21.15.192:0/1057070805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f171415bc20 0x7f17140afd80 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f17140b2350 tx=0x7f170c02a680 comp rx=0 tx=0).stop 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 -- 172.21.15.192:0/1057070805 shutdown_connections 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 --2- 172.21.15.192:0/1057070805 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f171415bc20 0x7f17140afd80 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 --2- 172.21.15.192:0/1057070805 >> v2:172.21.15.194:3300/0 conn(0x7f17140cacd0 0x7f171415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 -- 172.21.15.192:0/1057070805 >> 172.21.15.192:0/1057070805 conn(0x7f17140ae960 msgr2=0x7f171406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 -- 172.21.15.192:0/1057070805 shutdown_connections 2024-09-13T18:42:56.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.425+0000 7f171b400640 1 -- 172.21.15.192:0/1057070805 wait complete. 2024-09-13T18:42:56.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.427+0000 7f171b400640 1 Processor -- start 2024-09-13T18:42:56.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.427+0000 7f171b400640 1 -- start start 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17140cb0b0 0x7f17141f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171415bc20 0x7f17141f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171406bce0 con 0x7f17140cacd0 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f171406b060 con 0x7f171415bc20 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f171b400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f171406b340 con 0x7f17140cb0b0 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33714/0 (socket says 172.21.15.192:33714) 2024-09-13T18:42:56.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 -- 172.21.15.192:0/1468401006 learned_addr learned my addr 172.21.15.192:0/1468401006 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:56.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1719400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171415bc20 0x7f17141f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f170be00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17140cb0b0 0x7f17141f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 -- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17140cb0b0 msgr2=0x7f17141f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17140cb0b0 0x7f17141f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 -- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171415bc20 msgr2=0x7f17141f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171415bc20 0x7f17141f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.428+0000 7f1718a00640 1 -- 172.21.15.192:0/1468401006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1704009400 con 0x7f17140cacd0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f1718a00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f170400e960 tx=0x7f170400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f170400ca00 con 0x7f17140cacd0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f170400cb60 con 0x7f17140cacd0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1704013470 con 0x7f17140cacd0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170c009a70 con 0x7f17140cacd0 2024-09-13T18:42:56.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.429+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f171406b900 con 0x7f17140cacd0 2024-09-13T18:42:56.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.430+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17140b1cf0 con 0x7f17140cacd0 2024-09-13T18:42:56.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.431+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17040135d0 con 0x7f17140cacd0 2024-09-13T18:42:56.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.432+0000 7f1711600640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 0x7f16f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.432+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1704089510 con 0x7f17140cacd0 2024-09-13T18:42:56.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.432+0000 7f170be00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 0x7f16f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.433+0000 7f170be00640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 0x7f16f006d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f17140718c0 tx=0x7f16fc007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.436+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1704054790 con 0x7f17140cacd0 2024-09-13T18:42:56.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.604+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f171415e790 con 0x7f17140cacd0 2024-09-13T18:42:56.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.606+0000 7f1711600640 1 -- 172.21.15.192:0/1468401006 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v152) v1 ==== 81+0+34086 (secure 0 0 0) 0x7f1704057db0 con 0x7f17140cacd0 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 152, 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:42:51.829419+0000", 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:42:56.609 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:42:56.610 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 17, 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.611 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:42:56.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.613 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.614 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.615 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.616 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.617 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 16, 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:42:56.618 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:24.548758+0000", 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.619 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.620 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "148", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.621 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.622 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.623 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.624 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 2.25, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 2.25, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2.25, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2.25, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 17, 2024-09-13T18:42:56.625 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:42:25.693389+0000", 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:42:56.626 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.627 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "152", 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:42:56.628 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:42:56.629 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:42:56.630 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:42:56.631 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.632 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.633 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.634 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.635 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.636 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:42:56.637 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.638 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.639 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.640 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.642 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.644 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.646 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.647 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.649 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.650 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.651 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.652 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.654 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.655 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.656 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:42:56.657 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.658 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.660 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.662 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.663 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.664 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.665 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:42:56.666 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:42:56.667 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.668 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.669 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.670 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.671 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.672 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.673 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 147, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:42:56.674 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.676 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:42:56.677 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:42:56.678 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:42:56.679 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.680 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.681 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:42:56.682 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.683 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.684 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:42:56.685 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:42:56.686 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:42:56.687 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:42:56.688 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:42:56.688 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:42:56.688 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:42:56.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 msgr2=0x7f16f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 0x7f16f006d0c0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f17140718c0 tx=0x7f16fc007d50 comp rx=0 tx=0).stop 2024-09-13T18:42:56.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 msgr2=0x7f1714159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f170400e960 tx=0x7f170400ee20 comp rx=0 tx=0).stop 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 shutdown_connections 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f16f006ac00 0x7f16f006d0c0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f171415bc20 0x7f17141f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17140cb0b0 0x7f17141f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 --2- 172.21.15.192:0/1468401006 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17140cacd0 0x7f1714159a90 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 >> 172.21.15.192:0/1468401006 conn(0x7f17140ae960 msgr2=0x7f171413f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 shutdown_connections 2024-09-13T18:42:56.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.608+0000 7f171b400640 1 -- 172.21.15.192:0/1468401006 wait complete. 2024-09-13T18:42:56.691 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:42:56.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.840+0000 7f3c08400640 1 Processor -- start 2024-09-13T18:42:56.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.840+0000 7f3c08400640 1 -- start start 2024-09-13T18:42:56.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.841+0000 7f3c08400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.841+0000 7f3c08400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3c0015bc20 0x7f3c000afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.841+0000 7f3c08400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c00140480 con 0x7f3c000cacd0 2024-09-13T18:42:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.841+0000 7f3c08400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c000cb5f0 con 0x7f3c0015bc20 2024-09-13T18:42:56.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.841+0000 7f3c08400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0015ebd0 con 0x7f3c0015e790 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c06400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3c0015bc20 0x7f3c000afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c05000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c06400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3c0015bc20 0x7f3c000afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:38344/0 (socket says 172.21.15.192:38344) 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c06400640 1 -- 172.21.15.192:0/3412052880 learned_addr learned my addr 172.21.15.192:0/3412052880 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c06400640 1 -- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 msgr2=0x7f3c000cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.842+0000 7f3c06400640 1 --2- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.843+0000 7f3c06400640 1 -- 172.21.15.192:0/3412052880 >> v1:172.21.15.194:6789/0 conn(0x7f3c000cacd0 legacy=0x7f3c00140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.843+0000 7f3c06400640 1 -- 172.21.15.192:0/3412052880 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c0015ee90 con 0x7f3c0015bc20 2024-09-13T18:42:56.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.843+0000 7f3c06400640 1 --2- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0015bc20 0x7f3c000afd80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ee420968a9fc686 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3bffe00640 1 -- 172.21.15.192:0/3412052880 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8031600 con 0x7f3c0015bc20 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3bffe00640 1 -- 172.21.15.192:0/3412052880 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf802d050 con 0x7f3c0015bc20 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3bffe00640 1 -- 172.21.15.192:0/3412052880 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf8031980 con 0x7f3c0015bc20 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 -- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0015bc20 msgr2=0x7f3c000afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 --2- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0015bc20 0x7f3c000afd80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f3bf8009e50 tx=0x7f3bf802a730 comp rx=0 tx=0).stop 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 -- 172.21.15.192:0/3412052880 shutdown_connections 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 --2- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c0015bc20 0x7f3c000afd80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 --2- 172.21.15.192:0/3412052880 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 -- 172.21.15.192:0/3412052880 >> 172.21.15.192:0/3412052880 conn(0x7f3c000ae960 msgr2=0x7f3c0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.844+0000 7f3c08400640 1 -- 172.21.15.192:0/3412052880 shutdown_connections 2024-09-13T18:42:56.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.845+0000 7f3c08400640 1 -- 172.21.15.192:0/3412052880 wait complete. 2024-09-13T18:42:56.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.846+0000 7f3c08400640 1 Processor -- start 2024-09-13T18:42:56.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.846+0000 7f3c08400640 1 -- start start 2024-09-13T18:42:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c000cacd0 0x7f3c0013d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c000cbca0 con 0x7f3c0015bc20 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f2d10 con 0x7f3c000cacd0 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c08400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c001f2ff0 con 0x7f3c0015e790 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c05000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c05000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33718/0 (socket says 172.21.15.192:33718) 2024-09-13T18:42:56.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.847+0000 7f3c05000640 1 -- 172.21.15.192:0/392641244 learned_addr learned my addr 172.21.15.192:0/392641244 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05a00640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c000cacd0 0x7f3c0013d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c06400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 -- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 msgr2=0x7f3c000ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 -- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c000cacd0 msgr2=0x7f3c0013d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c000cacd0 0x7f3c0013d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 -- 172.21.15.192:0/392641244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf8009b30 con 0x7f3c0015bc20 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c05000640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e9b0 tx=0x7f3bec00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec009670 con 0x7f3c0015bc20 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bec00c9a0 con 0x7f3c0015bc20 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c001f32d0 con 0x7f3c0015bc20 2024-09-13T18:42:56.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.848+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bec00cd50 con 0x7f3c0015bc20 2024-09-13T18:42:56.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.849+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c000cb8d0 con 0x7f3c0015bc20 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.849+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c000cb0b0 con 0x7f3c0015bc20 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.850+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bec013470 con 0x7f3c0015bc20 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.851+0000 7f3bfd600640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 0x7f3be006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.851+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bec0895f0 con 0x7f3c0015bc20 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.851+0000 7f3c05a00640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 0x7f3be006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:56.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.852+0000 7f3c05a00640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 0x7f3be006d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c00158790 tx=0x7f3bf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:56.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:56.856+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bec0547d0 con 0x7f3c0015bc20 2024-09-13T18:42:57.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.058+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c000cbde0 con 0x7f3c0015bc20 2024-09-13T18:42:57.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.059+0000 7f3bfd600640 1 -- 172.21.15.192:0/392641244 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f3c000cbde0 con 0x7f3c0015bc20 2024-09-13T18:42:57.062 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:57.062 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:42:57.062 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 msgr2=0x7f3be006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 0x7f3be006d0c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f3c00158790 tx=0x7f3bf4009040 comp rx=0 tx=0).stop 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 msgr2=0x7f3c001f26c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3bec00e9b0 tx=0x7f3bec00ee70 comp rx=0 tx=0).stop 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 shutdown_connections 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3be006ac00 0x7f3be006d0c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3c0015e790 0x7f3c000ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:57.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3c0015bc20 0x7f3c001f26c0 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 --2- 172.21.15.192:0/392641244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3c000cacd0 0x7f3c0013d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 >> 172.21.15.192:0/392641244 conn(0x7f3c000ae960 msgr2=0x7f3c0015d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 shutdown_connections 2024-09-13T18:42:57.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:57.061+0000 7f3c08400640 1 -- 172.21.15.192:0/392641244 wait complete. 2024-09-13T18:42:57.080 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:42:57.249 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":7710,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.537671266,"mdsmap_epoch":62,"osdmap_epoch":152,"osdmap_epoch_barrier":151,"uptime":35.668028931999999} 2024-09-13T18:42:57.249 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 7710, "mdsmap_epoch": 62, "osdmap_epoch": 152, "osdmap_epoch_barrier": 151, "rank_uptime": 30.537671266, "state": "up:active", "uptime": 35.668028932, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:42:57.249 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:42:57.249 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:57.249 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:57.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:57.284 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-13T18:42:57.717 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:42:57.717 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:42:57.718 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.356587 s, 147 MB/s 2024-09-13T18:42:57.718 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:42:57.719 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:57.816 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:42:57.897 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:42:57.898 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:57.898 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:57.933 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:42:57.933 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:42:58.009 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:42:58.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.199+0000 7fb8b8000640 1 Processor -- start 2024-09-13T18:42:58.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.199+0000 7fb8b8000640 1 -- start start 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b8000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb8b00b3f10 0x7fb8b015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b8000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8b015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b8000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8b00b2f00 con 0x7fb8b015dee0 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b8000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8b015aec0 con 0x7fb8b00b3f10 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b8000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b3150 con 0x7fb8b00b0490 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b5600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb8b015dee0 0x7fb8b00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44180/0 (socket says 172.21.15.192:44180) 2024-09-13T18:42:58.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.200+0000 7fb8b5600640 1 -- 172.21.15.192:0/2903964984 learned_addr learned my addr 172.21.15.192:0/2903964984 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:58.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653860627 0 0) 0x7fb8b00b2f00 con 0x7fb8b015dee0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb898005730 con 0x7fb8b015dee0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8b4c00640 1 --2- 172.21.15.192:0/2903964984 >> v2:172.21.15.194:3300/0 conn(0x7fb8b00b3f10 0x7fb8b015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8b6000640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8b015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414681961 0 0) 0x7fb898005730 con 0x7fb8b015dee0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 msgr2=0x7fb8b015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8b015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 >> v2:172.21.15.194:3300/0 conn(0x7fb8b00b3f10 msgr2=0x7fb8b015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 --2- 172.21.15.192:0/2903964984 >> v2:172.21.15.194:3300/0 conn(0x7fb8b00b3f10 0x7fb8b015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00b3430 con 0x7fb8b015dee0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fb8a4001670 con 0x7fb8b015dee0 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8b4c00640 1 --2- 172.21.15.192:0/2903964984 >> v2:172.21.15.194:3300/0 conn(0x7fb8b00b3f10 0x7fb8b015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 >> v1:172.21.15.192:6789/0 conn(0x7fb8b015dee0 legacy=0x7fb8b00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb898005b80 0x7fb898005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8980069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb898006f10 0x7fb898007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b015aec0 con 0x7fb898005b80 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00b3150 con 0x7fb898006f10 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.201+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb89800dcf0 con 0x7fb8b00b0490 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb898005b80 0x7fb898005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b6000640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb898006f10 0x7fb898007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b4c00640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8980069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 -- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 msgr2=0x7fb8980069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb8b00b0490 0x7fb8980069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 -- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb898006f10 msgr2=0x7fb898007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb898006f10 0x7fb898007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.202+0000 7fb8b5600640 1 -- 172.21.15.192:0/2903964984 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb898005730 con 0x7fb898005b80 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.203+0000 7fb8b5600640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb898005b80 0x7fb898005fa0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c110 tx=0x7fb898007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1d862dfc3284a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.203+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4005ad0 con 0x7fb898005b80 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.203+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a402d070 con 0x7fb898005b80 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.203+0000 7fb8afe00640 1 -- 172.21.15.192:0/2903964984 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4005e90 con 0x7fb898005b80 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 -- 172.21.15.192:0/2903964984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb898005b80 msgr2=0x7fb898005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 --2- 172.21.15.192:0/2903964984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb898005b80 0x7fb898005fa0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fb8a400c110 tx=0x7fb898007a00 comp rx=0 tx=0).stop 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b6000640 1 -- 172.21.15.192:0/2903964984 reap_dead start 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 -- 172.21.15.192:0/2903964984 shutdown_connections 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 -- 172.21.15.192:0/2903964984 >> 172.21.15.192:0/2903964984 conn(0x7fb8b00ae960 msgr2=0x7fb8b006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 -- 172.21.15.192:0/2903964984 shutdown_connections 2024-09-13T18:42:58.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.204+0000 7fb8b8000640 1 -- 172.21.15.192:0/2903964984 wait complete. 2024-09-13T18:42:58.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.205+0000 7fb8b8000640 1 Processor -- start 2024-09-13T18:42:58.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.206+0000 7fb8b8000640 1 -- start start 2024-09-13T18:42:58.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.206+0000 7fb8b8000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb898005b80 0x7fb8b013b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.206+0000 7fb8b8000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.206+0000 7fb8b8000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.206+0000 7fb8b8000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00aa1b0 con 0x7fb8b00a9550 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b8000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00a9f20 con 0x7fb8b013c060 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b8000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8b00ae220 con 0x7fb898005b80 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb898005b80 0x7fb8b013b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33734/0 (socket says 172.21.15.192:33734) 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b4c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:38384/0 (socket says 172.21.15.192:38384) 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 -- 172.21.15.192:0/620041584 learned_addr learned my addr 172.21.15.192:0/620041584 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 -- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb898005b80 msgr2=0x7fb8b013b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb898005b80 0x7fb8b013b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 -- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 msgr2=0x7fb8b013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b6000640 1 -- 172.21.15.192:0/620041584 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b00ab570 con 0x7fb8b00a9550 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.207+0000 7fb8b4c00640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8b6000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80045e0 tx=0x7fb8a8007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a80046d0 con 0x7fb8b00a9550 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a8004830 con 0x7fb8b00a9550 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a8015660 con 0x7fb8b00a9550 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8b0140ca0 con 0x7fb8b00a9550 2024-09-13T18:42:58.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.208+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8b00abad0 con 0x7fb8b00a9550 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.209+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8b00afd80 con 0x7fb8b00a9550 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.210+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb8a80157c0 con 0x7fb8b00a9550 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.211+0000 7fb8ad600640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 0x7fb89006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.211+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb8a8089960 con 0x7fb8b00a9550 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.211+0000 7fb8b5600640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 0x7fb89006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.212+0000 7fb8b5600640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 0x7fb89006d0f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4032000 tx=0x7fb8a4034040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.215+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb8a8054be0 con 0x7fb8b00a9550 2024-09-13T18:42:58.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.387+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8b013ce40 con 0x7fb8b00a9550 2024-09-13T18:42:58.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.389+0000 7fb8ad600640 1 -- 172.21.15.192:0/620041584 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16651 (secure 0 0 0) 0x7fb8a8058200 con 0x7fb8b00a9550 2024-09-13T18:42:58.392 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:42:58.392 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":152,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:51.829419+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 msgr2=0x7fb89006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 0x7fb89006d0f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4032000 tx=0x7fb8a4034040 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 msgr2=0x7fb8b00a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fb8a80045e0 tx=0x7fb8a8007700 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 shutdown_connections 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb89006ac30 0x7fb89006d0f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb8b00a9550 0x7fb8b00a99e0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8b013c060 0x7fb8b013c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 --2- 172.21.15.192:0/620041584 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb898005b80 0x7fb8b013b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 >> 172.21.15.192:0/620041584 conn(0x7fb8b00ae960 msgr2=0x7fb8b006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:58.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 shutdown_connections 2024-09-13T18:42:58.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.391+0000 7fb8b8000640 1 -- 172.21.15.192:0/620041584 wait complete. 2024-09-13T18:42:58.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:42:24.548758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:42:25.693389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:42:58.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:42:58.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.564+0000 7fd74d600640 1 Processor -- start 2024-09-13T18:42:58.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.564+0000 7fd74d600640 1 -- start start 2024-09-13T18:42:58.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd74d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7481434c0 0x7fd74806c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd74d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 0x7fd7480b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd74d600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74806b480 con 0x7fd7480b3bd0 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd74d600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7480b4060 con 0x7fd7481434c0 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd74d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7480ce770 con 0x7fd74806a8b0 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd746a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd7481434c0 0x7fd74806c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd747400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd7480b3bd0 0x7fd74806e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44194/0 (socket says 172.21.15.192:44194) 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.565+0000 7fd747400640 1 -- 172.21.15.192:0/2808646407 learned_addr learned my addr 172.21.15.192:0/2808646407 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746000640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 0x7fd7480b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746a00640 1 -- 172.21.15.192:0/2808646407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 msgr2=0x7fd7480b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746a00640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 0x7fd7480b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746a00640 1 -- 172.21.15.192:0/2808646407 >> v1:172.21.15.192:6789/0 conn(0x7fd7480b3bd0 legacy=0x7fd74806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd745600640 1 -- 172.21.15.192:0/2808646407 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590735971 0 0) 0x7fd74806b480 con 0x7fd7480b3bd0 2024-09-13T18:42:58.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746a00640 1 -- 172.21.15.192:0/2808646407 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd74806b760 con 0x7fd7481434c0 2024-09-13T18:42:58.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.566+0000 7fd746000640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 0x7fd7480b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.567+0000 7fd746a00640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7481434c0 0x7fd74806c800 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097d0 tx=0x7fd73802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d345fea9e4c85d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.567+0000 7fd745600640 1 -- 172.21.15.192:0/2808646407 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738032440 con 0x7fd7481434c0 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.567+0000 7fd745600640 1 -- 172.21.15.192:0/2808646407 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7380325a0 con 0x7fd7481434c0 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.567+0000 7fd745600640 1 -- 172.21.15.192:0/2808646407 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738032930 con 0x7fd7481434c0 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 -- 172.21.15.192:0/2808646407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7481434c0 msgr2=0x7fd74806c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7481434c0 0x7fd74806c800 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7fd7380097d0 tx=0x7fd73802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 -- 172.21.15.192:0/2808646407 shutdown_connections 2024-09-13T18:42:58.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd74806a8b0 0x7fd7480b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 --2- 172.21.15.192:0/2808646407 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd7481434c0 0x7fd74806c800 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 -- 172.21.15.192:0/2808646407 >> 172.21.15.192:0/2808646407 conn(0x7fd7480b08f0 msgr2=0x7fd7480b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:58.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 -- 172.21.15.192:0/2808646407 shutdown_connections 2024-09-13T18:42:58.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.568+0000 7fd74d600640 1 -- 172.21.15.192:0/2808646407 wait complete. 2024-09-13T18:42:58.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.569+0000 7fd74d600640 1 Processor -- start 2024-09-13T18:42:58.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.569+0000 7fd74d600640 1 -- start start 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7480b3bd0 0x7fd7481f0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7481434c0 0x7fd7481403b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7481f0880 con 0x7fd74806a8b0 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748140ea0 con 0x7fd7480b3bd0 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.570+0000 7fd74d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd748156300 con 0x7fd7481434c0 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33766/0 (socket says 172.21.15.192:33766) 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 -- 172.21.15.192:0/3730402885 learned_addr learned my addr 172.21.15.192:0/3730402885 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746000640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7480b3bd0 0x7fd7481f0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd747400640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7481434c0 0x7fd7481403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 -- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7481434c0 msgr2=0x7fd7481403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7481434c0 0x7fd7481403b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 -- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7480b3bd0 msgr2=0x7fd7481f0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7480b3bd0 0x7fd7481f0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 -- 172.21.15.192:0/3730402885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd738009400 con 0x7fd74806a8b0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.571+0000 7fd746a00640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd7380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.572+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738004230 con 0x7fd74806a8b0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.572+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd738004390 con 0x7fd74806a8b0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.572+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7481408f0 con 0x7fd74806a8b0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.572+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd738030b20 con 0x7fd74806a8b0 2024-09-13T18:42:58.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.572+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748155cb0 con 0x7fd74806a8b0 2024-09-13T18:42:58.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.573+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd74806acf0 con 0x7fd74806a8b0 2024-09-13T18:42:58.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.574+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd738039050 con 0x7fd74806a8b0 2024-09-13T18:42:58.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.575+0000 7fd73ea00640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 0x7fd72806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.575+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7380a9c90 con 0x7fd74806a8b0 2024-09-13T18:42:58.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.575+0000 7fd746000640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 0x7fd72806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.576+0000 7fd746000640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 0x7fd72806d0c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b2a70 tx=0x7fd734008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.579+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd738074e60 con 0x7fd74806a8b0 2024-09-13T18:42:58.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.749+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7480b26e0 con 0x7fd74806a8b0 2024-09-13T18:42:58.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.749+0000 7fd73ea00640 1 -- 172.21.15.192:0/3730402885 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd73804b020 con 0x7fd74806a8b0 2024-09-13T18:42:58.752 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:42:58.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.751+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 msgr2=0x7fd72806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.751+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 0x7fd72806d0c0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fd7480b2a70 tx=0x7fd734008040 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.751+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 msgr2=0x7fd748139120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.751+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7fd738000c00 tx=0x7fd7380046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 shutdown_connections 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd72806ac00 0x7fd72806d0c0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd7481434c0 0x7fd7481403b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd7480b3bd0 0x7fd7481f0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 --2- 172.21.15.192:0/3730402885 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd74806a8b0 0x7fd748139120 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 >> 172.21.15.192:0/3730402885 conn(0x7fd7480b08f0 msgr2=0x7fd7480b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 shutdown_connections 2024-09-13T18:42:58.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.752+0000 7fd74d600640 1 -- 172.21.15.192:0/3730402885 wait complete. 2024-09-13T18:42:58.770 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:42:58.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.923+0000 7fcd72a00640 1 Processor -- start 2024-09-13T18:42:58.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.924+0000 7fcd72a00640 1 -- start start 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd72a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd6c15b810 0x7fcd6c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd72a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c15b070 con 0x7fcd6c1402c0 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd72a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd6c15ee20 con 0x7fcd6c0afbe0 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd72a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd6c15f100 con 0x7fcd6c15b810 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd71600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fcd6c1402c0 0x7fcd6c15e660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44204/0 (socket says 172.21.15.192:44204) 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd71600640 1 -- 172.21.15.192:0/3604396160 learned_addr learned my addr 172.21.15.192:0/3604396160 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:58.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd70c00640 1 --2- 172.21.15.192:0/3604396160 >> v2:172.21.15.194:3300/0 conn(0x7fcd6c15b810 0x7fcd6c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.925+0000 7fcd6be00640 1 -- 172.21.15.192:0/3604396160 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 569921113 0 0) 0x7fcd6c15b070 con 0x7fcd6c1402c0 2024-09-13T18:42:58.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.926+0000 7fcd6be00640 1 -- 172.21.15.192:0/3604396160 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd54003520 con 0x7fcd6c1402c0 2024-09-13T18:42:58.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.926+0000 7fcd70c00640 1 -- 172.21.15.192:0/3604396160 >> v1:172.21.15.194:6789/0 conn(0x7fcd6c0afbe0 legacy=0x7fcd6c1406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.926+0000 7fcd70c00640 1 -- 172.21.15.192:0/3604396160 >> v1:172.21.15.192:6789/0 conn(0x7fcd6c1402c0 legacy=0x7fcd6c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.926+0000 7fcd70c00640 1 -- 172.21.15.192:0/3604396160 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c15f3e0 con 0x7fcd6c15b810 2024-09-13T18:42:58.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.927+0000 7fcd70c00640 1 --2- 172.21.15.192:0/3604396160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c15b810 0x7fcd6c15bc50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd580097a0 tx=0x7fcd5802a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1a60ff7f42f9b2a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.927+0000 7fcd6be00640 1 -- 172.21.15.192:0/3604396160 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58032440 con 0x7fcd6c15b810 2024-09-13T18:42:58.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.927+0000 7fcd6be00640 1 -- 172.21.15.192:0/3604396160 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd580325a0 con 0x7fcd6c15b810 2024-09-13T18:42:58.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.927+0000 7fcd6be00640 1 -- 172.21.15.192:0/3604396160 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58032930 con 0x7fcd6c15b810 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 -- 172.21.15.192:0/3604396160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c15b810 msgr2=0x7fcd6c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 --2- 172.21.15.192:0/3604396160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c15b810 0x7fcd6c15bc50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fcd580097a0 tx=0x7fcd5802a230 comp rx=0 tx=0).stop 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 -- 172.21.15.192:0/3604396160 shutdown_connections 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 --2- 172.21.15.192:0/3604396160 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c15b810 0x7fcd6c15bc50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 -- 172.21.15.192:0/3604396160 >> 172.21.15.192:0/3604396160 conn(0x7fcd6c0ae7f0 msgr2=0x7fcd6c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 -- 172.21.15.192:0/3604396160 shutdown_connections 2024-09-13T18:42:58.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.928+0000 7fcd72a00640 1 -- 172.21.15.192:0/3604396160 wait complete. 2024-09-13T18:42:58.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.929+0000 7fcd72a00640 1 Processor -- start 2024-09-13T18:42:58.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 -- start start 2024-09-13T18:42:58.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c0afbe0 0x7fcd6c1412c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 0x7fcd6c1422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c13c1b0 con 0x7fcd6c1402c0 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c143f80 con 0x7fcd6c0afbe0 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.930+0000 7fcd72a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd6c144260 con 0x7fcd6c15b810 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33768/0 (socket says 172.21.15.192:33768) 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 -- 172.21.15.192:0/2757647943 learned_addr learned my addr 172.21.15.192:0/2757647943 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd71600640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c0afbe0 0x7fcd6c1412c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd72000640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 0x7fcd6c1422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 -- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 msgr2=0x7fcd6c1422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 0x7fcd6c1422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 -- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c0afbe0 msgr2=0x7fcd6c1412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c0afbe0 0x7fcd6c1412c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:58.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 -- 172.21.15.192:0/2757647943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd58009400 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd72000640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 0x7fcd6c1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.931+0000 7fcd70c00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcd58035040 tx=0x7fcd580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.932+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58006e10 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.932+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58032e90 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.932+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd6c13c420 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.932+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58030be0 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.932+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd6c144540 con 0x7fcd6c1402c0 2024-09-13T18:42:58.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.933+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd6c13c630 con 0x7fcd6c1402c0 2024-09-13T18:42:58.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.934+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcd58039040 con 0x7fcd6c1402c0 2024-09-13T18:42:58.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.935+0000 7fcd69600640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 0x7fcd4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:58.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.935+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd580a9c90 con 0x7fcd6c1402c0 2024-09-13T18:42:58.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.935+0000 7fcd71600640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 0x7fcd4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:58.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.935+0000 7fcd71600640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 0x7fcd4c06d0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcd600011e0 tx=0x7fcd60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:58.944 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:58.941+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcd58074f80 con 0x7fcd6c1402c0 2024-09-13T18:42:59.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.109+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd6c15bc50 con 0x7fcd6c1402c0 2024-09-13T18:42:59.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.109+0000 7fcd69600640 1 -- 172.21.15.192:0/2757647943 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd58030d40 con 0x7fcd6c1402c0 2024-09-13T18:42:59.112 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.111+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 msgr2=0x7fcd4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.111+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 0x7fcd4c06d0c0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fcd600011e0 tx=0x7fcd60009040 comp rx=0 tx=0).stop 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.111+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 msgr2=0x7fcd6c0cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.111+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fcd58035040 tx=0x7fcd580046c0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 shutdown_connections 2024-09-13T18:42:59.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcd4c06ac00 0x7fcd4c06d0c0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd6c15b810 0x7fcd6c1422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd6c1402c0 0x7fcd6c0cb890 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 --2- 172.21.15.192:0/2757647943 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd6c0afbe0 0x7fcd6c1412c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 >> 172.21.15.192:0/2757647943 conn(0x7fcd6c0ae7f0 msgr2=0x7fcd6c13f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 shutdown_connections 2024-09-13T18:42:59.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.112+0000 7fcd72a00640 1 -- 172.21.15.192:0/2757647943 wait complete. 2024-09-13T18:42:59.130 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:42:59.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.282+0000 7f632ac00640 1 Processor -- start 2024-09-13T18:42:59.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.282+0000 7f632ac00640 1 -- start start 2024-09-13T18:42:59.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.283+0000 7f632ac00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f632406c0b0 0x7f632406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.283+0000 7f632ac00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240b2000 con 0x7f63240b3af0 2024-09-13T18:42:59.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.283+0000 7f632ac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63240b2ba0 con 0x7f63241589f0 2024-09-13T18:42:59.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.283+0000 7f632ac00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f632406ca30 con 0x7f632406c0b0 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.283+0000 7f6323400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f63240b3af0 0x7f632415b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44220/0 (socket says 172.21.15.192:44220) 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6323400640 1 -- 172.21.15.192:0/2116282661 learned_addr learned my addr 172.21.15.192:0/2116282661 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6328c00640 1 --2- 172.21.15.192:0/2116282661 >> v2:172.21.15.194:3300/0 conn(0x7f632406c0b0 0x7f632406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6322a00640 1 -- 172.21.15.192:0/2116282661 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1756383642 0 0) 0x7f63240b2000 con 0x7f63240b3af0 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6322a00640 1 -- 172.21.15.192:0/2116282661 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6308003520 con 0x7f63240b3af0 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6328c00640 1 -- 172.21.15.192:0/2116282661 >> v1:172.21.15.194:6789/0 conn(0x7f63241589f0 legacy=0x7f63240b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6328c00640 1 -- 172.21.15.192:0/2116282661 >> v1:172.21.15.192:6789/0 conn(0x7f63240b3af0 legacy=0x7f632415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.284+0000 7f6328c00640 1 -- 172.21.15.192:0/2116282661 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f632415b970 con 0x7f632406c0b0 2024-09-13T18:42:59.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.285+0000 7f6328c00640 1 --2- 172.21.15.192:0/2116282661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632406c0b0 0x7f632406c4f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f631c009d90 tx=0x7f631c02a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b77effcf079fa83f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.285+0000 7f6322a00640 1 -- 172.21.15.192:0/2116282661 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c007740 con 0x7f632406c0b0 2024-09-13T18:42:59.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.285+0000 7f6322a00640 1 -- 172.21.15.192:0/2116282661 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631c02d050 con 0x7f632406c0b0 2024-09-13T18:42:59.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.285+0000 7f6322a00640 1 -- 172.21.15.192:0/2116282661 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631c007ac0 con 0x7f632406c0b0 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 -- 172.21.15.192:0/2116282661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632406c0b0 msgr2=0x7f632406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 --2- 172.21.15.192:0/2116282661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632406c0b0 0x7f632406c4f0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f631c009d90 tx=0x7f631c02a660 comp rx=0 tx=0).stop 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 -- 172.21.15.192:0/2116282661 shutdown_connections 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 --2- 172.21.15.192:0/2116282661 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f632406c0b0 0x7f632406c4f0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 -- 172.21.15.192:0/2116282661 >> 172.21.15.192:0/2116282661 conn(0x7f63240b08f0 msgr2=0x7f63240b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 -- 172.21.15.192:0/2116282661 shutdown_connections 2024-09-13T18:42:59.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.286+0000 7f632ac00640 1 -- 172.21.15.192:0/2116282661 wait complete. 2024-09-13T18:42:59.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.288+0000 7f632ac00640 1 Processor -- start 2024-09-13T18:42:59.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.288+0000 7f632ac00640 1 -- start start 2024-09-13T18:42:59.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 0x7f632414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 0x7f632414a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632415a270 con 0x7f632406c0b0 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63241593c0 con 0x7f63241589f0 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f632ac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632414d820 con 0x7f63240b3af0 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33782/0 (socket says 172.21.15.192:33782) 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 -- 172.21.15.192:0/3407170610 learned_addr learned my addr 172.21.15.192:0/3407170610 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6328c00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 0x7f632414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 -- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 msgr2=0x7f632414d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323400640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 0x7f632414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 0x7f632414d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 -- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 msgr2=0x7f632414a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 0x7f632414a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323e00640 1 -- 172.21.15.192:0/3407170610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631c009a70 con 0x7f632406c0b0 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6328c00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 0x7f632414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.289+0000 7f6323400640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 0x7f632414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f6323e00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f631400c430 tx=0x7f631400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63140052d0 con 0x7f632406c0b0 2024-09-13T18:42:59.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6314005430 con 0x7f632406c0b0 2024-09-13T18:42:59.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6314003830 con 0x7f632406c0b0 2024-09-13T18:42:59.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632414a540 con 0x7f632406c0b0 2024-09-13T18:42:59.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.290+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63241598d0 con 0x7f632406c0b0 2024-09-13T18:42:59.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.291+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632406c4f0 con 0x7f632406c0b0 2024-09-13T18:42:59.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.292+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6314003990 con 0x7f632406c0b0 2024-09-13T18:42:59.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.293+0000 7f631be00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 0x7f630406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.293+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6314088900 con 0x7f632406c0b0 2024-09-13T18:42:59.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.293+0000 7f6323400640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 0x7f630406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.294+0000 7f6323400640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 0x7f630406d0c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6324067360 tx=0x7f6310009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.297+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6314053ae0 con 0x7f632406c0b0 2024-09-13T18:42:59.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.465+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f63240cb8f0 con 0x7f632406c0b0 2024-09-13T18:42:59.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.465+0000 7f631be00640 1 -- 172.21.15.192:0/3407170610 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+11 (secure 0 0 0) 0x7f63140170a0 con 0x7f632406c0b0 2024-09-13T18:42:59.468 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:42:59.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 msgr2=0x7f630406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 0x7f630406d0c0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f6324067360 tx=0x7f6310009040 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 msgr2=0x7f6324158e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f631400c430 tx=0x7f631400c8f0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 shutdown_connections 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f630406ac00 0x7f630406d0c0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f63241589f0 0x7f632414a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f63240b3af0 0x7f632414d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 --2- 172.21.15.192:0/3407170610 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f632406c0b0 0x7f6324158e80 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 >> 172.21.15.192:0/3407170610 conn(0x7f63240b08f0 msgr2=0x7f6324069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 shutdown_connections 2024-09-13T18:42:59.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.468+0000 7f632ac00640 1 -- 172.21.15.192:0/3407170610 wait complete. 2024-09-13T18:42:59.486 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:42:59.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.637+0000 7effc7000640 1 Processor -- start 2024-09-13T18:42:59.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.637+0000 7effc7000640 1 -- start start 2024-09-13T18:42:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effc7000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7effc0150480 0x7effc015a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effc7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effc7000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc00ccec0 con 0x7effc0071810 2024-09-13T18:42:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effc7000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc0071dd0 con 0x7effc0150480 2024-09-13T18:42:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effc7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc00cb770 con 0x7effc00cc530 2024-09-13T18:42:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.638+0000 7effbfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7effc0150480 0x7effc015a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7effc0150480 0x7effc015a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33798/0 (socket says 172.21.15.192:33798) 2024-09-13T18:42:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 -- 172.21.15.192:0/3083688461 learned_addr learned my addr 172.21.15.192:0/3083688461 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effc5000640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 -- 172.21.15.192:0/3083688461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 msgr2=0x7effc00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:42:59.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 -- 172.21.15.192:0/3083688461 >> v1:172.21.15.194:6789/0 conn(0x7effc0071810 legacy=0x7effc00b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbea00640 1 -- 172.21.15.192:0/3083688461 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976638726 0 0) 0x7effc00ccec0 con 0x7effc0071810 2024-09-13T18:42:59.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.639+0000 7effbfe00640 1 -- 172.21.15.192:0/3083688461 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc00cba50 con 0x7effc0150480 2024-09-13T18:42:59.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.640+0000 7effbfe00640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc015a3e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7effb0009870 tx=0x7effb002a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661a90af9bb95235 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.640+0000 7effbea00640 1 -- 172.21.15.192:0/3083688461 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0032440 con 0x7effc0150480 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.640+0000 7effbea00640 1 -- 172.21.15.192:0/3083688461 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb00325a0 con 0x7effc0150480 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.640+0000 7effbea00640 1 -- 172.21.15.192:0/3083688461 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0032930 con 0x7effc0150480 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 -- 172.21.15.192:0/3083688461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 msgr2=0x7effc015a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc015a3e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7effb0009870 tx=0x7effb002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 -- 172.21.15.192:0/3083688461 shutdown_connections 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc00cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 --2- 172.21.15.192:0/3083688461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc015a3e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 -- 172.21.15.192:0/3083688461 >> 172.21.15.192:0/3083688461 conn(0x7effc00ae960 msgr2=0x7effc006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 -- 172.21.15.192:0/3083688461 shutdown_connections 2024-09-13T18:42:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.641+0000 7effc7000640 1 -- 172.21.15.192:0/3083688461 wait complete. 2024-09-13T18:42:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.643+0000 7effc7000640 1 Processor -- start 2024-09-13T18:42:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.643+0000 7effc7000640 1 -- start start 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.643+0000 7effc7000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 0x7effc0166bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.643+0000 7effc7000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc01453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc7000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc7000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0167460 con 0x7effc0150480 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc7000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc0167740 con 0x7effc0071810 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc7000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc0167a20 con 0x7effc00cc530 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 0x7effc0166bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33810/0 (socket says 172.21.15.192:33810) 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effbfe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 0x7effc0166bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:38444/0 (socket says 172.21.15.192:38444) 2024-09-13T18:42:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 -- 172.21.15.192:0/891732217 learned_addr learned my addr 172.21.15.192:0/891732217 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effbf400640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc01453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 -- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 msgr2=0x7effc01453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc01453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 -- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 msgr2=0x7effc0166bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 0x7effc0166bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.644+0000 7effc5000640 1 -- 172.21.15.192:0/891732217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb00094d0 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effc5000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7effb800efc0 tx=0x7effb800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8014480 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800f040 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8014820 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc0167d00 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.645+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc0167100 con 0x7effc0150480 2024-09-13T18:42:59.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.646+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc00b3e10 con 0x7effc0150480 2024-09-13T18:42:59.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.647+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7effb8014980 con 0x7effc0150480 2024-09-13T18:42:59.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.648+0000 7effb7e00640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 0x7effa006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:42:59.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.648+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7effb8089df0 con 0x7effc0150480 2024-09-13T18:42:59.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.648+0000 7effbfe00640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 0x7effa006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:42:59.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.649+0000 7effbfe00640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 0x7effa006d0c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:42:59.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.652+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7effb8054fe0 con 0x7effc0150480 2024-09-13T18:42:59.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.831+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7effc01675a0 con 0x7effc0150480 2024-09-13T18:42:59.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.831+0000 7effb7e00640 1 -- 172.21.15.192:0/891732217 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v152) v1 ==== 80+0+0 (secure 0 0 0) 0x7effc01675a0 con 0x7effc0150480 2024-09-13T18:42:59.834 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:42:59.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 msgr2=0x7effa006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 0x7effa006d0c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7effb0034000 tx=0x7effb002e000 comp rx=0 tx=0).stop 2024-09-13T18:42:59.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 msgr2=0x7effc014e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7effb800efc0 tx=0x7effb800c490 comp rx=0 tx=0).stop 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 shutdown_connections 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7effa006ac00 0x7effa006d0c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7effc0150480 0x7effc014e8e0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7effc00cc530 0x7effc01453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 --2- 172.21.15.192:0/891732217 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7effc0071810 0x7effc0166bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 >> 172.21.15.192:0/891732217 conn(0x7effc00ae960 msgr2=0x7effc015ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 shutdown_connections 2024-09-13T18:42:59.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:42:59.833+0000 7effc7000640 1 -- 172.21.15.192:0/891732217 wait complete. 2024-09-13T18:42:59.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:42:59.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:59.853 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:42:59.946 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:42:59.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:42:59.946 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:42:59.989 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:42:59.990 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:00.028 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:43:00.028 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:00.105 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:00.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.254+0000 7f2cee200640 1 Processor -- start 2024-09-13T18:43:00.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.254+0000 7f2cee200640 1 -- start start 2024-09-13T18:43:00.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2cee200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce8162950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2cee200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce81586f0 con 0x7f2ce80b2690 2024-09-13T18:43:00.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2cee200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce8162230 con 0x7f2ce80afd80 2024-09-13T18:43:00.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2cee200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce81627f0 con 0x7f2ce80b2b00 2024-09-13T18:43:00.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2ce6a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2ce80b2690 0x7f2ce8161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:44232/0 (socket says 172.21.15.192:44232) 2024-09-13T18:43:00.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2ce6a00640 1 -- 172.21.15.192:0/2003685990 learned_addr learned my addr 172.21.15.192:0/2003685990 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2ce7e00640 1 --2- 172.21.15.192:0/2003685990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce8162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671627857 0 0) 0x7f2ce81586f0 con 0x7f2ce80b2690 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.256+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ccc003520 con 0x7f2ce80b2690 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890538170 0 0) 0x7f2ce8162230 con 0x7f2ce80afd80 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce81586f0 con 0x7f2ce80afd80 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce7e00640 1 -- 172.21.15.192:0/2003685990 >> v1:172.21.15.194:6789/0 conn(0x7f2ce80afd80 legacy=0x7f2ce80b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce7e00640 1 -- 172.21.15.192:0/2003685990 >> v1:172.21.15.192:6789/0 conn(0x7f2ce80b2690 legacy=0x7f2ce8161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1059562903 0 0) 0x7f2ccc003520 con 0x7f2ce80b2690 2024-09-13T18:43:00.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.257+0000 7f2ce7e00640 1 -- 172.21.15.192:0/2003685990 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8162510 con 0x7f2ce80b2b00 2024-09-13T18:43:00.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2ce7e00640 1 --2- 172.21.15.192:0/2003685990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce8162950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009dc0 tx=0x7f2ce002a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d59ff0fe9af6fa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4001690 con 0x7f2ce80b2b00 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce002d050 con 0x7f2ce80b2b00 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2ce6000640 1 -- 172.21.15.192:0/2003685990 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0007760 con 0x7f2ce80b2b00 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2cee200640 1 -- 172.21.15.192:0/2003685990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 msgr2=0x7f2ce8162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.258+0000 7f2cee200640 1 --2- 172.21.15.192:0/2003685990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce8162950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2ce0009dc0 tx=0x7f2ce002a660 comp rx=0 tx=0).stop 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.259+0000 7f2cee200640 1 -- 172.21.15.192:0/2003685990 shutdown_connections 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.259+0000 7f2cee200640 1 --2- 172.21.15.192:0/2003685990 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce8162950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.259+0000 7f2cee200640 1 -- 172.21.15.192:0/2003685990 >> 172.21.15.192:0/2003685990 conn(0x7f2ce80ae960 msgr2=0x7f2ce806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.259+0000 7f2cee200640 1 -- 172.21.15.192:0/2003685990 shutdown_connections 2024-09-13T18:43:00.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.259+0000 7f2cee200640 1 -- 172.21.15.192:0/2003685990 wait complete. 2024-09-13T18:43:00.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.260+0000 7f2cee200640 1 Processor -- start 2024-09-13T18:43:00.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.260+0000 7f2cee200640 1 -- start start 2024-09-13T18:43:00.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ce80afd80 0x7f2ce81456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce81569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8143ac0 con 0x7f2ce80b2690 2024-09-13T18:43:00.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8145bf0 con 0x7f2ce80afd80 2024-09-13T18:43:00.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2cee200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce8142c10 con 0x7f2ce80b2b00 2024-09-13T18:43:00.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.261+0000 7f2ce6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33820/0 (socket says 172.21.15.192:33820) 2024-09-13T18:43:00.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 -- 172.21.15.192:0/3308012766 learned_addr learned my addr 172.21.15.192:0/3308012766 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:00.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce7e00640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce81569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce7400640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ce80afd80 0x7f2ce81456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 -- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 msgr2=0x7f2ce81569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce81569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 -- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ce80afd80 msgr2=0x7f2ce81456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ce80afd80 0x7f2ce81456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 -- 172.21.15.192:0/3308012766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce0009a70 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce7e00640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce81569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2ce6a00640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c780 tx=0x7f2cd400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd40072d0 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4007430 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4004a20 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.262+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce8142eb0 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.263+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce8143470 con 0x7f2ce80b2690 2024-09-13T18:43:00.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.264+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce8143c30 con 0x7f2ce80b2690 2024-09-13T18:43:00.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.265+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2cd4004b80 con 0x7f2ce80b2690 2024-09-13T18:43:00.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.266+0000 7f2cdf400640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 0x7f2cc806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.266+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cd4088750 con 0x7f2ce80b2690 2024-09-13T18:43:00.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.266+0000 7f2ce7400640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 0x7f2cc806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.267+0000 7f2ce7400640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 0x7f2cc806d0f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80011e0 tx=0x7f2cd8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.270+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2cd4053890 con 0x7f2ce80b2690 2024-09-13T18:43:00.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.440+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ce80cd370 con 0x7f2ce80b2690 2024-09-13T18:43:00.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.442+0000 7f2cdf400640 1 -- 172.21.15.192:0/3308012766 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16651 (secure 0 0 0) 0x7f2cd4056eb0 con 0x7f2ce80b2690 2024-09-13T18:43:00.445 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:00.446 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":152,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:42:51.829419+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 msgr2=0x7f2cc806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 0x7f2cc806d0f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f2cd80011e0 tx=0x7f2cd8009040 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 msgr2=0x7f2ce81e9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400c780 tx=0x7f2cd400cc40 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 shutdown_connections 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cc806ac30 0x7f2cc806d0f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2ce80b2b00 0x7f2ce81569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2ce80b2690 0x7f2ce81e9a70 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 --2- 172.21.15.192:0/3308012766 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2ce80afd80 0x7f2ce81456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 >> 172.21.15.192:0/3308012766 conn(0x7f2ce80ae960 msgr2=0x7f2ce8071740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:00.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 shutdown_connections 2024-09-13T18:43:00.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.444+0000 7f2cee200640 1 -- 172.21.15.192:0/3308012766 wait complete. 2024-09-13T18:43:00.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:42:24.548758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:42:25.693389+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:43:00.463 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:00.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.615+0000 7f0c5f200640 1 Processor -- start 2024-09-13T18:43:00.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.615+0000 7f0c5f200640 1 -- start start 2024-09-13T18:43:00.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c5f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 0x7f0c580b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c5f200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5806cc40 con 0x7f0c581434c0 2024-09-13T18:43:00.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c5f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c5806b480 con 0x7f0c580b3bd0 2024-09-13T18:43:00.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c5f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580b4060 con 0x7f0c5806c800 2024-09-13T18:43:00.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c57e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0c581434c0 0x7f0c5806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33682/0 (socket says 172.21.15.192:33682) 2024-09-13T18:43:00.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.616+0000 7f0c57e00640 1 -- 172.21.15.192:0/816043902 learned_addr learned my addr 172.21.15.192:0/816043902 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:00.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c4fe00640 1 --2- 172.21.15.192:0/816043902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 0x7f0c580b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690426126 0 0) 0x7f0c5806cc40 con 0x7f0c581434c0 2024-09-13T18:43:00.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c3c005730 con 0x7f0c581434c0 2024-09-13T18:43:00.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335772190 0 0) 0x7f0c5806b480 con 0x7f0c580b3bd0 2024-09-13T18:43:00.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c5806cc40 con 0x7f0c580b3bd0 2024-09-13T18:43:00.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c4fe00640 1 -- 172.21.15.192:0/816043902 >> v1:172.21.15.194:6789/0 conn(0x7f0c580b3bd0 legacy=0x7f0c5806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c4fe00640 1 -- 172.21.15.192:0/816043902 >> v1:172.21.15.192:6789/0 conn(0x7f0c581434c0 legacy=0x7f0c5806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.617+0000 7f0c4fe00640 1 -- 172.21.15.192:0/816043902 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5806b760 con 0x7f0c5806c800 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.618+0000 7f0c4fe00640 1 --2- 172.21.15.192:0/816043902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 0x7f0c580b3690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009800 tx=0x7f0c4002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edad445d5e156176 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.618+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40032440 con 0x7f0c5806c800 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c400325a0 con 0x7f0c5806c800 2024-09-13T18:43:00.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c57400640 1 -- 172.21.15.192:0/816043902 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c40032910 con 0x7f0c5806c800 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 -- 172.21.15.192:0/816043902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 msgr2=0x7f0c580b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 --2- 172.21.15.192:0/816043902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 0x7f0c580b3690 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0c40009800 tx=0x7f0c4002a250 comp rx=0 tx=0).stop 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 -- 172.21.15.192:0/816043902 shutdown_connections 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 --2- 172.21.15.192:0/816043902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c5806c800 0x7f0c580b3690 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 -- 172.21.15.192:0/816043902 >> 172.21.15.192:0/816043902 conn(0x7f0c580b08f0 msgr2=0x7f0c580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 -- 172.21.15.192:0/816043902 shutdown_connections 2024-09-13T18:43:00.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.619+0000 7f0c5f200640 1 -- 172.21.15.192:0/816043902 wait complete. 2024-09-13T18:43:00.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.621+0000 7f0c5f200640 1 Processor -- start 2024-09-13T18:43:00.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.621+0000 7f0c5f200640 1 -- start start 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c5806c800 0x7f0c5806e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c580b3bd0 0x7f0c5813f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c580717c0 con 0x7f0c581434c0 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58070f20 con 0x7f0c5806c800 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c58071200 con 0x7f0c580b3bd0 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48370/0 (socket says 172.21.15.192:48370) 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c5d200640 1 -- 172.21.15.192:0/3593025612 learned_addr learned my addr 172.21.15.192:0/3593025612 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c4fe00640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c580b3bd0 0x7f0c5813f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.622+0000 7f0c57e00640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c5806c800 0x7f0c5806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 -- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c580b3bd0 msgr2=0x7f0c5813f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c580b3bd0 0x7f0c5813f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 -- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c5806c800 msgr2=0x7f0c5806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c5806c800 0x7f0c5806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 -- 172.21.15.192:0/3593025612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c40009400 con 0x7f0c581434c0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5d200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c790 tx=0x7f0c5000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000cea0 con 0x7f0c581434c0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c50003b70 con 0x7f0c581434c0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c580714e0 con 0x7f0c581434c0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5000a850 con 0x7f0c581434c0 2024-09-13T18:43:00.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.623+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c5813d9b0 con 0x7f0c581434c0 2024-09-13T18:43:00.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.624+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c5813d530 con 0x7f0c581434c0 2024-09-13T18:43:00.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.625+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c5000a9b0 con 0x7f0c581434c0 2024-09-13T18:43:00.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.626+0000 7f0c54c00640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.626+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c500890f0 con 0x7f0c581434c0 2024-09-13T18:43:00.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.626+0000 7f0c57e00640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.627+0000 7f0c57e00640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 0x7f0c3406d0c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c480011e0 tx=0x7f0c48007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.630+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c5813d530 con 0x7f0c581434c0 2024-09-13T18:43:00.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.798+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c5813d530 con 0x7f0c581434c0 2024-09-13T18:43:00.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.798+0000 7f0c54c00640 1 -- 172.21.15.192:0/3593025612 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c5813d530 con 0x7f0c581434c0 2024-09-13T18:43:00.800 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:43:00.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.799+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 msgr2=0x7f0c3406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.799+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 0x7f0c3406d0c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0c480011e0 tx=0x7f0c48007d30 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.799+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 msgr2=0x7f0c580ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0c5000c790 tx=0x7f0c5000cc50 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 shutdown_connections 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c3406ac00 0x7f0c3406d0c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c581434c0 0x7f0c580ad840 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c580b3bd0 0x7f0c5813f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 --2- 172.21.15.192:0/3593025612 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c5806c800 0x7f0c5806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 >> 172.21.15.192:0/3593025612 conn(0x7f0c580b08f0 msgr2=0x7f0c580b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 shutdown_connections 2024-09-13T18:43:00.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.800+0000 7f0c5f200640 1 -- 172.21.15.192:0/3593025612 wait complete. 2024-09-13T18:43:00.818 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:43:00.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.972+0000 7fd91f200640 1 Processor -- start 2024-09-13T18:43:00.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.972+0000 7fd91f200640 1 -- start start 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 0x7fd92015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91f200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92015b070 con 0x7fd9200afbe0 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92015ee20 con 0x7fd9201402c0 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015f100 con 0x7fd92015b810 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91e800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd9200afbe0 0x7fd9201406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33686/0 (socket says 172.21.15.192:33686) 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91e800640 1 -- 172.21.15.192:0/2240616087 learned_addr learned my addr 172.21.15.192:0/2240616087 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:00.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.973+0000 7fd91d400640 1 --2- 172.21.15.192:0/2240616087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 0x7fd92015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2456782605 0 0) 0x7fd92015b070 con 0x7fd9200afbe0 2024-09-13T18:43:00.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd904003520 con 0x7fd9200afbe0 2024-09-13T18:43:00.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91d400640 1 -- 172.21.15.192:0/2240616087 >> v1:172.21.15.194:6789/0 conn(0x7fd9201402c0 legacy=0x7fd92015e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1538323574 0 0) 0x7fd92015ee20 con 0x7fd9201402c0 2024-09-13T18:43:00.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91d400640 1 -- 172.21.15.192:0/2240616087 >> v1:172.21.15.192:6789/0 conn(0x7fd9200afbe0 legacy=0x7fd9201406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.974+0000 7fd91d400640 1 -- 172.21.15.192:0/2240616087 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92015f3e0 con 0x7fd92015b810 2024-09-13T18:43:00.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.975+0000 7fd91d400640 1 --2- 172.21.15.192:0/2240616087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 0x7fd92015bc50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097d0 tx=0x7fd90c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edcce54e96953a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.975+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c032440 con 0x7fd92015b810 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.975+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0325a0 con 0x7fd92015b810 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.975+0000 7fd91ca00640 1 -- 172.21.15.192:0/2240616087 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c032930 con 0x7fd92015b810 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 -- 172.21.15.192:0/2240616087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 msgr2=0x7fd92015bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 --2- 172.21.15.192:0/2240616087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 0x7fd92015bc50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0097d0 tx=0x7fd90c02a210 comp rx=0 tx=0).stop 2024-09-13T18:43:00.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 -- 172.21.15.192:0/2240616087 shutdown_connections 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 --2- 172.21.15.192:0/2240616087 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd92015b810 0x7fd92015bc50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 -- 172.21.15.192:0/2240616087 >> 172.21.15.192:0/2240616087 conn(0x7fd9200ae7f0 msgr2=0x7fd92006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 -- 172.21.15.192:0/2240616087 shutdown_connections 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.976+0000 7fd91f200640 1 -- 172.21.15.192:0/2240616087 wait complete. 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.977+0000 7fd91f200640 1 Processor -- start 2024-09-13T18:43:00.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.978+0000 7fd91f200640 1 -- start start 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.978+0000 7fd91f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.978+0000 7fd91f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9201402c0 0x7fd92013d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 0x7fd9200b3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200cdc80 con 0x7fd92015b810 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200cd070 con 0x7fd9201402c0 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9200cd350 con 0x7fd9200afbe0 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 0x7fd9200b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:44426/0 (socket says 172.21.15.192:44426) 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 -- 172.21.15.192:0/4292668991 learned_addr learned my addr 172.21.15.192:0/4292668991 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91d400640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9201402c0 0x7fd92013d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 -- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9201402c0 msgr2=0x7fd92013d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9201402c0 0x7fd92013d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 -- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 msgr2=0x7fd9200b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 0x7fd9200b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91de00640 1 -- 172.21.15.192:0/4292668991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c009400 con 0x7fd9200afbe0 2024-09-13T18:43:00.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.979+0000 7fd91e800640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 0x7fd9200b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd91de00640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c4b0 tx=0x7fd91000c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910005480 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9100035f0 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9100039e0 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9200cd630 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.980+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92013d7b0 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.981+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92015bc50 con 0x7fd9200afbe0 2024-09-13T18:43:00.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.982+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd910003b40 con 0x7fd9200afbe0 2024-09-13T18:43:00.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.983+0000 7fd916000640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 0x7fd90006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:00.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.983+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd910088910 con 0x7fd9200afbe0 2024-09-13T18:43:00.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.983+0000 7fd91d400640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 0x7fd90006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:00.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.984+0000 7fd91d400640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 0x7fd90006d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd90c034000 tx=0x7fd90c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:00.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:00.987+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd910053b00 con 0x7fd9200afbe0 2024-09-13T18:43:01.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.156+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd9200cd490 con 0x7fd9200afbe0 2024-09-13T18:43:01.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.158+0000 7fd916000640 1 -- 172.21.15.192:0/4292668991 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v152) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd9200cd490 con 0x7fd9200afbe0 2024-09-13T18:43:01.160 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:43:01.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 msgr2=0x7fd90006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 0x7fd90006d0f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fd90c034000 tx=0x7fd90c02e000 comp rx=0 tx=0).stop 2024-09-13T18:43:01.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 msgr2=0x7fd9200cca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c4b0 tx=0x7fd91000c970 comp rx=0 tx=0).stop 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 shutdown_connections 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd90006ac30 0x7fd90006d0f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd92015b810 0x7fd9200b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9201402c0 0x7fd92013d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 --2- 172.21.15.192:0/4292668991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9200afbe0 0x7fd9200cca90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.159+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 >> 172.21.15.192:0/4292668991 conn(0x7fd9200ae7f0 msgr2=0x7fd9201406a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.160+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 shutdown_connections 2024-09-13T18:43:01.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.160+0000 7fd91f200640 1 -- 172.21.15.192:0/4292668991 wait complete. 2024-09-13T18:43:01.178 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:43:01.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.331+0000 7f845f400640 1 Processor -- start 2024-09-13T18:43:01.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.331+0000 7f845f400640 1 -- start start 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.332+0000 7f845f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f845806c0b0 0x7f845806c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.332+0000 7f845f400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580b2000 con 0x7f84581589f0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.332+0000 7f845f400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84580b2ba0 con 0x7f84580b3af0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.332+0000 7f845f400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845806ca30 con 0x7f845806c0b0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f845ca00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f84581589f0 0x7f84580b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33692/0 (socket says 172.21.15.192:33692) 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f845ca00640 1 -- 172.21.15.192:0/2590298898 learned_addr learned my addr 172.21.15.192:0/2590298898 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f845d400640 1 --2- 172.21.15.192:0/2590298898 >> v2:172.21.15.194:3300/0 conn(0x7f845806c0b0 0x7f845806c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4124134119 0 0) 0x7f84580b2000 con 0x7f84581589f0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f843c003520 con 0x7f84581589f0 2024-09-13T18:43:01.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576489803 0 0) 0x7f84580b2ba0 con 0x7f84580b3af0 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84580b2000 con 0x7f84580b3af0 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1637808126 0 0) 0x7f843c003520 con 0x7f84581589f0 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 >> v2:172.21.15.194:3300/0 conn(0x7f845806c0b0 msgr2=0x7f845806c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 --2- 172.21.15.192:0/2590298898 >> v2:172.21.15.194:3300/0 conn(0x7f845806c0b0 0x7f845806c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.333+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 >> v1:172.21.15.194:6789/0 conn(0x7f84580b3af0 legacy=0x7f845815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845815b970 con 0x7f84581589f0 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f84480019f0 con 0x7f84581589f0 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 >> v1:172.21.15.192:6789/0 conn(0x7f84581589f0 legacy=0x7f84580b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f843c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0047c0 0x7f843c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f843c005180 0x7f843c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845806ca30 con 0x7f843c003b00 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00c0b0 con 0x7f843c0047c0 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843c00c270 con 0x7f843c005180 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845d400640 1 --2- 172.21.15.192:0/2590298898 >> v2:172.21.15.194:3300/0 conn(0x7f845806c0b0 0x7f845806c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f843c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f8457e00640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0047c0 0x7f843c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845d400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f843c005180 0x7f843c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 -- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f843c005180 msgr2=0x7f843c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f843c005180 0x7f843c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 -- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0047c0 msgr2=0x7f843c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:01.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f843c0047c0 0x7f843c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845ca00640 1 -- 172.21.15.192:0/2590298898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c003520 con 0x7f843c003b00 2024-09-13T18:43:01.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.334+0000 7f845d400640 1 -- 172.21.15.192:0/2590298898 reap_dead start 2024-09-13T18:43:01.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.335+0000 7f845ca00640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f843c003f00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f844800a7b0 tx=0x7f843c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f307e6f34edc63 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844802b9c0 con 0x7f843c003b00 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844802bb20 con 0x7f843c003b00 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f8457400640 1 -- 172.21.15.192:0/2590298898 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448034470 con 0x7f843c003b00 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 -- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 msgr2=0x7f843c003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f843c003f00 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f844800a7b0 tx=0x7f843c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 -- 172.21.15.192:0/2590298898 shutdown_connections 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 --2- 172.21.15.192:0/2590298898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f843c003f00 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 -- 172.21.15.192:0/2590298898 >> 172.21.15.192:0/2590298898 conn(0x7f84580b08f0 msgr2=0x7f84580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 -- 172.21.15.192:0/2590298898 shutdown_connections 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.336+0000 7f845f400640 1 -- 172.21.15.192:0/2590298898 wait complete. 2024-09-13T18:43:01.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.338+0000 7f845f400640 1 Processor -- start 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.338+0000 7f845f400640 1 -- start start 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 0x7f845806b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 0x7f84580ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8458145b00 con 0x7f843c003b00 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845806be90 con 0x7f8458070030 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845f400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845806ab90 con 0x7f845814d490 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48392/0 (socket says 172.21.15.192:48392) 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 -- 172.21.15.192:0/151719027 learned_addr learned my addr 172.21.15.192:0/151719027 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845d400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 0x7f84580ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f8457e00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 0x7f845806b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 -- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 msgr2=0x7f845806b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 0x7f845806b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 -- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 msgr2=0x7f84580ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 0x7f84580ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.339+0000 7f845ca00640 1 -- 172.21.15.192:0/151719027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845806ae70 con 0x7f843c003b00 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f8457e00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 0x7f845806b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f845d400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 0x7f84580ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f845ca00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f844800a7b0 tx=0x7f8448001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844803b040 con 0x7f843c003b00 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8448034880 con 0x7f843c003b00 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845806b150 con 0x7f843c003b00 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8448034bf0 con 0x7f843c003b00 2024-09-13T18:43:01.346 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.340+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845806a880 con 0x7f843c003b00 2024-09-13T18:43:01.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.341+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845806acd0 con 0x7f843c003b00 2024-09-13T18:43:01.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.342+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8448031070 con 0x7f843c003b00 2024-09-13T18:43:01.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.343+0000 7f8454c00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 0x7f843806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.343+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84480a9370 con 0x7f843c003b00 2024-09-13T18:43:01.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.343+0000 7f8457e00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 0x7f843806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.344+0000 7f8457e00640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 0x7f843806d0f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8444000c00 tx=0x7f8444009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.347+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f845806acd0 con 0x7f843c003b00 2024-09-13T18:43:01.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.513+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f845806acd0 con 0x7f843c003b00 2024-09-13T18:43:01.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.514+0000 7f8454c00640 1 -- 172.21.15.192:0/151719027 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v152) v1 ==== 100+0+11 (secure 0 0 0) 0x7f845806acd0 con 0x7f843c003b00 2024-09-13T18:43:01.517 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:43:01.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 msgr2=0x7f843806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 0x7f843806d0f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8444000c00 tx=0x7f8444009040 comp rx=0 tx=0).stop 2024-09-13T18:43:01.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 msgr2=0x7f84581455c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f844800a7b0 tx=0x7f8448001d00 comp rx=0 tx=0).stop 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 shutdown_connections 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f843806ac30 0x7f843806d0f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8458070030 0x7f84580ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f845814d490 0x7f845806b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 --2- 172.21.15.192:0/151719027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f843c003b00 0x7f84581455c0 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 >> 172.21.15.192:0/151719027 conn(0x7f84580b08f0 msgr2=0x7f84580ccf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 shutdown_connections 2024-09-13T18:43:01.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.516+0000 7f845f400640 1 -- 172.21.15.192:0/151719027 wait complete. 2024-09-13T18:43:01.535 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:43:01.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.687+0000 7fa84b200640 1 Processor -- start 2024-09-13T18:43:01.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.687+0000 7fa84b200640 1 -- start start 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 0x7fa84c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0cd390 0x7fa84c0b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa84c0b3330 0x7fa84c0b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0ce1a0 con 0x7fa84c0b3330 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa84c0cd900 con 0x7fa84c15cea0 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0cdbe0 con 0x7fa84c0cd390 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa84c0b3330 0x7fa84c0b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa84c0b3330 0x7fa84c0b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48406/0 (socket says 172.21.15.192:48406) 2024-09-13T18:43:01.692 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.688+0000 7fa84a800640 1 -- 172.21.15.192:0/1915672410 learned_addr learned my addr 172.21.15.192:0/1915672410 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa849e00640 1 --2- 172.21.15.192:0/1915672410 >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 0x7fa84c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa849400640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0cd390 0x7fa84c0b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa84a800640 1 -- 172.21.15.192:0/1915672410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0cd390 msgr2=0x7fa84c0b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa84a800640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0cd390 0x7fa84c0b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa84a800640 1 -- 172.21.15.192:0/1915672410 >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 msgr2=0x7fa84c0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa84a800640 1 --2- 172.21.15.192:0/1915672410 >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 0x7fa84c0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa84a800640 1 -- 172.21.15.192:0/1915672410 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c0cdec0 con 0x7fa84c0b3330 2024-09-13T18:43:01.693 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.689+0000 7fa849e00640 1 --2- 172.21.15.192:0/1915672410 >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 0x7fa84c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.690+0000 7fa84a800640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0b3330 0x7fa84c0b6160 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b54d0 tx=0x7fa84402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0050cd5773e49f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.690+0000 7fa848a00640 1 -- 172.21.15.192:0/1915672410 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84402ae90 con 0x7fa84c0b3330 2024-09-13T18:43:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.690+0000 7fa848a00640 1 -- 172.21.15.192:0/1915672410 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844032440 con 0x7fa84c0b3330 2024-09-13T18:43:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.690+0000 7fa848a00640 1 -- 172.21.15.192:0/1915672410 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440327d0 con 0x7fa84c0b3330 2024-09-13T18:43:01.695 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 -- 172.21.15.192:0/1915672410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0b3330 msgr2=0x7fa84c0b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0b3330 0x7fa84c0b6160 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b54d0 tx=0x7fa84402a140 comp rx=0 tx=0).stop 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 -- 172.21.15.192:0/1915672410 shutdown_connections 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0b3330 0x7fa84c0b6160 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 --2- 172.21.15.192:0/1915672410 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0cd390 0x7fa84c0b5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 --2- 172.21.15.192:0/1915672410 >> v2:172.21.15.194:3300/0 conn(0x7fa84c15cea0 0x7fa84c0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 -- 172.21.15.192:0/1915672410 >> 172.21.15.192:0/1915672410 conn(0x7fa84c0d2dd0 msgr2=0x7fa84c0d31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 -- 172.21.15.192:0/1915672410 shutdown_connections 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.691+0000 7fa84b200640 1 -- 172.21.15.192:0/1915672410 wait complete. 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.692+0000 7fa84b200640 1 Processor -- start 2024-09-13T18:43:01.696 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.692+0000 7fa84b200640 1 -- start start 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0b3330 0x7fa84c160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa84c15cea0 0x7fa84c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c1f3700 con 0x7fa84c0cd390 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c0ca0b0 con 0x7fa84c15cea0 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.693+0000 7fa84b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c1601f0 con 0x7fa84c0b3330 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48412/0 (socket says 172.21.15.192:48412) 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 -- 172.21.15.192:0/4151175477 learned_addr learned my addr 172.21.15.192:0/4151175477 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:01.699 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849e00640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0b3330 0x7fa84c160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa84a800640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa84c15cea0 0x7fa84c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 -- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0b3330 msgr2=0x7fa84c160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0b3330 0x7fa84c160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 -- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa84c15cea0 msgr2=0x7fa84c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa84c15cea0 0x7fa84c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 -- 172.21.15.192:0/4151175477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440094d0 con 0x7fa84c0cd390 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.694+0000 7fa849400640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fa83400e890 tx=0x7fa83400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.695+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400c940 con 0x7fa84c0cd390 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.695+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83400caa0 con 0x7fa84c0cd390 2024-09-13T18:43:01.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.695+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83400ce30 con 0x7fa84c0cd390 2024-09-13T18:43:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.695+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c1f2c30 con 0x7fa84c0cd390 2024-09-13T18:43:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.695+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c1f3140 con 0x7fa84c0cd390 2024-09-13T18:43:01.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.696+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa84c0d1f00 con 0x7fa84c0cd390 2024-09-13T18:43:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.697+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa834013470 con 0x7fa84c0cd390 2024-09-13T18:43:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.697+0000 7fa842000640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 0x7fa82806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.698+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa834089520 con 0x7fa84c0cd390 2024-09-13T18:43:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.698+0000 7fa849e00640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 0x7fa82806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:01.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.698+0000 7fa849e00640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 0x7fa82806d0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b4530 tx=0x7fa83c0097f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:01.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.702+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa8340547a0 con 0x7fa84c0cd390 2024-09-13T18:43:01.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.887+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa84c0b2e50 con 0x7fa84c0cd390 2024-09-13T18:43:01.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.887+0000 7fa842000640 1 -- 172.21.15.192:0/4151175477 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v153) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa834057dc0 con 0x7fa84c0cd390 2024-09-13T18:43:01.890 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 msgr2=0x7fa82806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 0x7fa82806d0c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0b4530 tx=0x7fa83c0097f0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 msgr2=0x7fa84c1f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7fa83400e890 tx=0x7fa83400ed50 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 shutdown_connections 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa82806ac00 0x7fa82806d0c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa84c15cea0 0x7fa84c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa84c0cd390 0x7fa84c1f26f0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 --2- 172.21.15.192:0/4151175477 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa84c0b3330 0x7fa84c160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 >> 172.21.15.192:0/4151175477 conn(0x7fa84c0d2dd0 msgr2=0x7fa84c0b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 shutdown_connections 2024-09-13T18:43:01.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:01.890+0000 7fa84b200640 1 -- 172.21.15.192:0/4151175477 wait complete. 2024-09-13T18:43:01.908 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:43:01.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:01.908 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:43:01.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:43:01.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:01.978 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:43:02.016 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:43:02.017 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:02.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:43:02.054 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:43:02.054 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:02.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:43:02.093 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:02.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.243+0000 7efdb1a00640 1 Processor -- start 2024-09-13T18:43:02.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.243+0000 7efdb1a00640 1 -- start start 2024-09-13T18:43:02.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdb1a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efdac0b0490 0x7efdac0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdb1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac15ec00 con 0x7efdac15e790 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdb1a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdac140480 con 0x7efdac0cacd0 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdb1a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdac0cb5f0 con 0x7efdac0b0490 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdaa000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efdac15e790 0x7efdac0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33706/0 (socket says 172.21.15.192:33706) 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdaa000640 1 -- 172.21.15.192:0/498678708 learned_addr learned my addr 172.21.15.192:0/498678708 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:02.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdab400640 1 --2- 172.21.15.192:0/498678708 >> v2:172.21.15.194:3300/0 conn(0x7efdac0b0490 0x7efdac0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 96117522 0 0) 0x7efdac15ec00 con 0x7efdac15e790 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efd90003520 con 0x7efdac15e790 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdab400640 1 -- 172.21.15.192:0/498678708 >> v1:172.21.15.194:6789/0 conn(0x7efdac0cacd0 legacy=0x7efdac140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2244755262 0 0) 0x7efdac140480 con 0x7efdac0cacd0 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdab400640 1 -- 172.21.15.192:0/498678708 >> v1:172.21.15.192:6789/0 conn(0x7efdac15e790 legacy=0x7efdac0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.245+0000 7efdab400640 1 -- 172.21.15.192:0/498678708 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdac15ee90 con 0x7efdac0b0490 2024-09-13T18:43:02.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.246+0000 7efdab400640 1 --2- 172.21.15.192:0/498678708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac0b0490 0x7efdac0cb0b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efda40097a0 tx=0x7efda402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2721b5a10fb08efa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.247+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4032440 con 0x7efdac0b0490 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.247+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda40325a0 con 0x7efdac0b0490 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.247+0000 7efda9600640 1 -- 172.21.15.192:0/498678708 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda4032910 con 0x7efdac0b0490 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.247+0000 7efdb1a00640 1 -- 172.21.15.192:0/498678708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac0b0490 msgr2=0x7efdac0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.247+0000 7efdb1a00640 1 --2- 172.21.15.192:0/498678708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac0b0490 0x7efdac0cb0b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7efda40097a0 tx=0x7efda402a230 comp rx=0 tx=0).stop 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.248+0000 7efdb1a00640 1 -- 172.21.15.192:0/498678708 shutdown_connections 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.248+0000 7efdb1a00640 1 --2- 172.21.15.192:0/498678708 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac0b0490 0x7efdac0cb0b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.248+0000 7efdb1a00640 1 -- 172.21.15.192:0/498678708 >> 172.21.15.192:0/498678708 conn(0x7efdac0ae960 msgr2=0x7efdac06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:02.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.248+0000 7efdb1a00640 1 -- 172.21.15.192:0/498678708 shutdown_connections 2024-09-13T18:43:02.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.248+0000 7efdb1a00640 1 -- 172.21.15.192:0/498678708 wait complete. 2024-09-13T18:43:02.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.249+0000 7efdb1a00640 1 Processor -- start 2024-09-13T18:43:02.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.249+0000 7efdb1a00640 1 -- start start 2024-09-13T18:43:02.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 0x7efdac154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac15e790 0x7efdac154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac157bb0 con 0x7efdac0b0490 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdac1530a0 con 0x7efdac15e790 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.250+0000 7efdb1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdac153380 con 0x7efdac0cacd0 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48418/0 (socket says 172.21.15.192:48418) 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 -- 172.21.15.192:0/636752449 learned_addr learned my addr 172.21.15.192:0/636752449 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdab400640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac15e790 0x7efdac154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaa000640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 0x7efdac154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 -- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 msgr2=0x7efdac154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 0x7efdac154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 -- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac15e790 msgr2=0x7efdac154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac15e790 0x7efdac154140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda4009400 con 0x7efdac0b0490 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaa000640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 0x7efdac154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efdaaa00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c7e0 tx=0x7efd9c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.251+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c003da0 con 0x7efdac0b0490 2024-09-13T18:43:02.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.252+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c005070 con 0x7efdac0b0490 2024-09-13T18:43:02.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.252+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdac153660 con 0x7efdac0b0490 2024-09-13T18:43:02.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.252+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c005420 con 0x7efdac0b0490 2024-09-13T18:43:02.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.252+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdac153c20 con 0x7efdac0b0490 2024-09-13T18:43:02.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.253+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdac153e40 con 0x7efdac0b0490 2024-09-13T18:43:02.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.254+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd9c005580 con 0x7efdac0b0490 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.254+0000 7efda2a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 0x7efd8c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.254+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd9c0891d0 con 0x7efdac0b0490 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.255+0000 7efdaa000640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 0x7efd8c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.255+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7efd8c072760 con 0x7efdac0b0490 2024-09-13T18:43:02.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.255+0000 7efdaa000640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 0x7efd8c06d0f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efd98007fd0 tx=0x7efd98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.259+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efd9c0543a0 con 0x7efdac0b0490 2024-09-13T18:43:02.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.458+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efdac0cb0b0 con 0x7efdac0b0490 2024-09-13T18:43:02.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.459+0000 7efda2a00640 1 -- 172.21.15.192:0/636752449 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7efd9c0579c0 con 0x7efdac0b0490 2024-09-13T18:43:02.462 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:02.462 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:43:02.462 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:43:02.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 msgr2=0x7efd8c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 0x7efd8c06d0f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7efd98007fd0 tx=0x7efd98009040 comp rx=0 tx=0).stop 2024-09-13T18:43:02.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 msgr2=0x7efdac13d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00c7e0 tx=0x7efd9c00cca0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 shutdown_connections 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd8c06ac30 0x7efd8c06d0f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efdac15e790 0x7efdac154140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efdac0cacd0 0x7efdac154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 --2- 172.21.15.192:0/636752449 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efdac0b0490 0x7efdac13d4a0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 >> 172.21.15.192:0/636752449 conn(0x7efdac0ae960 msgr2=0x7efdac13f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 shutdown_connections 2024-09-13T18:43:02.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.461+0000 7efdb1a00640 1 -- 172.21.15.192:0/636752449 wait complete. 2024-09-13T18:43:02.481 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:02.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.630+0000 7f85be600640 1 Processor -- start 2024-09-13T18:43:02.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.630+0000 7f85be600640 1 -- start start 2024-09-13T18:43:02.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.631+0000 7f85be600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f85b80b3f10 0x7f85b815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.631+0000 7f85be600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.631+0000 7f85be600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80b2f00 con 0x7f85b815dee0 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.631+0000 7f85be600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b815aec0 con 0x7f85b80b0490 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.631+0000 7f85be600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b80b3150 con 0x7f85b80b3f10 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48428/0 (socket says 172.21.15.192:48428) 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b7e00640 1 -- 172.21.15.192:0/3019674098 learned_addr learned my addr 172.21.15.192:0/3019674098 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:02.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3019674098 >> v2:172.21.15.194:3300/0 conn(0x7f85b80b3f10 0x7f85b815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b6a00640 1 -- 172.21.15.192:0/3019674098 >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 msgr2=0x7f85b815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3019674098 >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b6a00640 1 -- 172.21.15.192:0/3019674098 >> v1:172.21.15.194:6789/0 conn(0x7f85b815dee0 legacy=0x7f85b80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b6a00640 1 -- 172.21.15.192:0/3019674098 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80b3430 con 0x7f85b80b3f10 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.632+0000 7f85b7e00640 1 --2- 172.21.15.192:0/3019674098 >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:02.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.633+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3019674098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b80b3f10 0x7f85b815a440 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b4700 tx=0x7f85a402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa70cb08fc84919 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.633+0000 7f85b6000640 1 -- 172.21.15.192:0/3019674098 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4032440 con 0x7f85b80b3f10 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85b6000640 1 -- 172.21.15.192:0/3019674098 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a40325a0 con 0x7f85b80b3f10 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85b6000640 1 -- 172.21.15.192:0/3019674098 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a4032930 con 0x7f85b80b3f10 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 -- 172.21.15.192:0/3019674098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b80b3f10 msgr2=0x7f85b815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 --2- 172.21.15.192:0/3019674098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b80b3f10 0x7f85b815a440 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f85b80b4700 tx=0x7f85a402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 -- 172.21.15.192:0/3019674098 shutdown_connections 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 --2- 172.21.15.192:0/3019674098 >> v2:172.21.15.192:3300/0 conn(0x7f85b80b0490 0x7f85b815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 --2- 172.21.15.192:0/3019674098 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b80b3f10 0x7f85b815a440 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 -- 172.21.15.192:0/3019674098 >> 172.21.15.192:0/3019674098 conn(0x7f85b80ae960 msgr2=0x7f85b806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 -- 172.21.15.192:0/3019674098 shutdown_connections 2024-09-13T18:43:02.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.634+0000 7f85be600640 1 -- 172.21.15.192:0/3019674098 wait complete. 2024-09-13T18:43:02.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.636+0000 7f85be600640 1 Processor -- start 2024-09-13T18:43:02.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.636+0000 7f85be600640 1 -- start start 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 0x7f85b813ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b813ef70 0x7f85b814c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8139bb0 con 0x7f85b80b0490 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b81343a0 con 0x7f85b815dee0 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85be600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8138fc0 con 0x7f85b813ef70 2024-09-13T18:43:02.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85b7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85b7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48438/0 (socket says 172.21.15.192:48438) 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85b7400640 1 -- 172.21.15.192:0/3695529563 learned_addr learned my addr 172.21.15.192:0/3695529563 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.637+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 0x7f85b813ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 -- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b813ef70 msgr2=0x7f85b814c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b813ef70 0x7f85b814c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 -- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 msgr2=0x7f85b813ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 0x7f85b813ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0009b30 con 0x7f85b80b0490 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 0x7f85b813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:02.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85b7400640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c400 tx=0x7f85a800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a80052d0 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8005430 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8003830 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a4009400 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.638+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b81394f0 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.639+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b80afd80 con 0x7f85b80b0490 2024-09-13T18:43:02.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.640+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85a8003990 con 0x7f85b80b0490 2024-09-13T18:43:02.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.641+0000 7f85af400640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 0x7f859806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.641+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85a8088880 con 0x7f85b80b0490 2024-09-13T18:43:02.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.641+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 0x7f859806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.642+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f8598072760 con 0x7f85b80b0490 2024-09-13T18:43:02.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.642+0000 7f85b6a00640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 0x7f859806d0f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85a4034000 tx=0x7f85a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:02.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.646+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85a80539c0 con 0x7f85b80b0490 2024-09-13T18:43:02.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.815+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85b813ce40 con 0x7f85b80b0490 2024-09-13T18:43:02.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.816+0000 7f85af400640 1 -- 172.21.15.192:0/3695529563 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16670 (secure 0 0 0) 0x7f85a8017070 con 0x7f85b80b0490 2024-09-13T18:43:02.819 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:02.819 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":153,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:01.831440+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:02.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 msgr2=0x7f859806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 0x7f859806d0f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f85a4034000 tx=0x7f85a402e000 comp rx=0 tx=0).stop 2024-09-13T18:43:02.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 msgr2=0x7f85b813b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:02.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f85a800c400 tx=0x7f85a800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 shutdown_connections 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f859806ac30 0x7f859806d0f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f85b813ef70 0x7f85b814c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f85b815dee0 0x7f85b813ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 --2- 172.21.15.192:0/3695529563 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f85b80b0490 0x7f85b813b7a0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 >> 172.21.15.192:0/3695529563 conn(0x7f85b80ae960 msgr2=0x7f85b8158680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 shutdown_connections 2024-09-13T18:43:02.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.818+0000 7f85be600640 1 -- 172.21.15.192:0/3695529563 wait complete. 2024-09-13T18:43:02.837 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:42:24.548758+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '148', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:42:25.693389+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:43:02.838 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:02.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.992+0000 7f3af7e00640 1 Processor -- start 2024-09-13T18:43:02.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.993+0000 7f3af7e00640 1 -- start start 2024-09-13T18:43:02.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af7e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3af80b3480 0x7f3af8159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af7e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af815af60 con 0x7f3af8159b00 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af7e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af806b7a0 con 0x7f3af806bc30 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af7e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af815ac80 con 0x7f3af80b3480 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af6a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3af8159b00 0x7f3af80b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33714/0 (socket says 172.21.15.192:33714) 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af6a00640 1 -- 172.21.15.192:0/2325350005 learned_addr learned my addr 172.21.15.192:0/2325350005 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af6000640 1 --2- 172.21.15.192:0/2325350005 >> v2:172.21.15.194:3300/0 conn(0x7f3af80b3480 0x7f3af8159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792291271 0 0) 0x7f3af815af60 con 0x7f3af8159b00 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.994+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3adc005730 con 0x7f3af8159b00 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1183036569 0 0) 0x7f3adc005730 con 0x7f3af8159b00 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 >> v2:172.21.15.194:3300/0 conn(0x7f3af80b3480 msgr2=0x7f3af8159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:02.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 --2- 172.21.15.192:0/2325350005 >> v2:172.21.15.194:3300/0 conn(0x7f3af80b3480 0x7f3af8159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 >> v1:172.21.15.194:6789/0 conn(0x7f3af806bc30 legacy=0x7f3af815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af806b150 con 0x7f3af8159b00 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f3ae80019f0 con 0x7f3af8159b00 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 >> v1:172.21.15.192:6789/0 conn(0x7f3af8159b00 legacy=0x7f3af80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc005bd0 0x7f3adc005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 0x7f3adc006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0073e0 0x7f3adc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af815ac80 con 0x7f3adc0069d0 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc00e330 con 0x7f3adc0073e0 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc00e4f0 con 0x7f3adc005bd0 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af6000640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 0x7f3adc006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af7400640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0073e0 0x7f3adc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.995+0000 7f3af6a00640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc005bd0 0x7f3adc005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af6000640 1 -- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc005bd0 msgr2=0x7f3adc005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af6000640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc005bd0 0x7f3adc005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af6000640 1 -- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0073e0 msgr2=0x7f3adc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af6000640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3adc0073e0 0x7f3adc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af6000640 1 -- 172.21.15.192:0/2325350005 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc005730 con 0x7f3adc0069d0 2024-09-13T18:43:03.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.996+0000 7f3af7400640 1 -- 172.21.15.192:0/2325350005 reap_dead start 2024-09-13T18:43:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af6000640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 0x7f3adc006e50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009a90 tx=0x7f3adc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42a26b7f5ff65aa8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4031400 con 0x7f3adc0069d0 2024-09-13T18:43:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae402d050 con 0x7f3adc0069d0 2024-09-13T18:43:03.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af5600640 1 -- 172.21.15.192:0/2325350005 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4031780 con 0x7f3adc0069d0 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af7e00640 1 -- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 msgr2=0x7f3adc006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af7e00640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 0x7f3adc006e50 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009a90 tx=0x7f3adc007a00 comp rx=0 tx=0).stop 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af7e00640 1 -- 172.21.15.192:0/2325350005 shutdown_connections 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.997+0000 7f3af7e00640 1 --2- 172.21.15.192:0/2325350005 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3adc0069d0 0x7f3adc006e50 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.998+0000 7f3af7e00640 1 -- 172.21.15.192:0/2325350005 >> 172.21.15.192:0/2325350005 conn(0x7f3af80736d0 msgr2=0x7f3af80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.998+0000 7f3af7e00640 1 -- 172.21.15.192:0/2325350005 shutdown_connections 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.998+0000 7f3af7e00640 1 -- 172.21.15.192:0/2325350005 wait complete. 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.999+0000 7f3af7e00640 1 Processor -- start 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:02.999+0000 7f3af7e00640 1 -- start start 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc0069d0 0x7f3af813e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af8155120 0x7f3af81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af8151650 con 0x7f3af815b970 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af8155ae0 con 0x7f3af8155120 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af815c660 con 0x7f3adc0069d0 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.000+0000 7f3af7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48468/0 (socket says 172.21.15.192:48468) 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 -- 172.21.15.192:0/977126263 learned_addr learned my addr 172.21.15.192:0/977126263 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af6a00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc0069d0 0x7f3af813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af6000640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af8155120 0x7f3af81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 -- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc0069d0 msgr2=0x7f3af813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc0069d0 0x7f3af813e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 -- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af8155120 msgr2=0x7f3af81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af8155120 0x7f3af81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af815c940 con 0x7f3af815b970 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3af7400640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3af806cc60 tx=0x7f3af000f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.001+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0005280 con 0x7f3af815b970 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.002+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0005420 con 0x7f3af815b970 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.002+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0007270 con 0x7f3af815b970 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.002+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af8151830 con 0x7f3af815b970 2024-09-13T18:43:03.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.002+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af815c330 con 0x7f3af815b970 2024-09-13T18:43:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.003+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af815cb80 con 0x7f3af815b970 2024-09-13T18:43:03.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.003+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3af00073d0 con 0x7f3af815b970 2024-09-13T18:43:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.004+0000 7f3aeea00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 0x7f3ad806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.004+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3af00884b0 con 0x7f3af815b970 2024-09-13T18:43:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.004+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f3ad8072730 con 0x7f3af815b970 2024-09-13T18:43:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.004+0000 7f3af6a00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 0x7f3ad806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.005+0000 7f3af6a00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 0x7f3ad806d0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80013d0 tx=0x7f3ae8006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.008+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3af815cb80 con 0x7f3af815b970 2024-09-13T18:43:03.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.175+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3af806ec90 con 0x7f3af815b970 2024-09-13T18:43:03.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.176+0000 7f3aeea00640 1 -- 172.21.15.192:0/977126263 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v153) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3af001a070 con 0x7f3af815b970 2024-09-13T18:43:03.179 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 msgr2=0x7f3ad806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 0x7f3ad806d0c0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f3ae80013d0 tx=0x7f3ae8006040 comp rx=0 tx=0).stop 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 msgr2=0x7f3af815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f3af806cc60 tx=0x7f3af000f890 comp rx=0 tx=0).stop 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 shutdown_connections 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3ad806ac00 0x7f3ad806d0c0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3af815b970 0x7f3af815bdf0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3af8155120 0x7f3af81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 --2- 172.21.15.192:0/977126263 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3adc0069d0 0x7f3af813e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 >> 172.21.15.192:0/977126263 conn(0x7f3af80736d0 msgr2=0x7f3af8156b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 shutdown_connections 2024-09-13T18:43:03.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.178+0000 7f3af7e00640 1 -- 172.21.15.192:0/977126263 wait complete. 2024-09-13T18:43:03.197 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:43:03.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.350+0000 7fd4eea00640 1 Processor -- start 2024-09-13T18:43:03.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.350+0000 7fd4eea00640 1 -- start start 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4eea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd4e806c800 0x7fd4e80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4eea00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e806cc70 con 0x7fd4e81434c0 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4eea00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e806b480 con 0x7fd4e80b3bd0 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4eea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e80ce770 con 0x7fd4e806c800 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4e7e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd4e81434c0 0x7fd4e806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33720/0 (socket says 172.21.15.192:33720) 2024-09-13T18:43:03.354 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.351+0000 7fd4e7e00640 1 -- 172.21.15.192:0/3648005265 learned_addr learned my addr 172.21.15.192:0/3648005265 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3648005265 >> v2:172.21.15.194:3300/0 conn(0x7fd4e806c800 0x7fd4e80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698369302 0 0) 0x7fd4e806cc70 con 0x7fd4e81434c0 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4cc003520 con 0x7fd4e81434c0 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1512018502 0 0) 0x7fd4cc003520 con 0x7fd4e81434c0 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 >> v2:172.21.15.194:3300/0 conn(0x7fd4e806c800 msgr2=0x7fd4e80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 --2- 172.21.15.192:0/3648005265 >> v2:172.21.15.194:3300/0 conn(0x7fd4e806c800 0x7fd4e80b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 >> v1:172.21.15.194:6789/0 conn(0x7fd4e80b3bd0 legacy=0x7fd4e806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e806b760 con 0x7fd4e81434c0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fd4d8001670 con 0x7fd4e81434c0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 >> v1:172.21.15.192:6789/0 conn(0x7fd4e81434c0 legacy=0x7fd4e806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0039f0 0x7fd4cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 0x7fd4cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4cc0051f0 0x7fd4cc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e80ce770 con 0x7fd4cc0047c0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc00e360 con 0x7fd4cc0039f0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4cc00e520 con 0x7fd4cc0051f0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.352+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 0x7fd4cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7e00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0039f0 0x7fd4cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4eca00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4cc0051f0 0x7fd4cc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7400640 1 -- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4cc0051f0 msgr2=0x7fd4cc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4cc0051f0 0x7fd4cc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7400640 1 -- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0039f0 msgr2=0x7fd4cc003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0039f0 0x7fd4cc003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4e7400640 1 -- 172.21.15.192:0/3648005265 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc003520 con 0x7fd4cc0047c0 2024-09-13T18:43:03.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.353+0000 7fd4eca00640 1 -- 172.21.15.192:0/3648005265 reap_dead start 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.354+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 0x7fd4cc004c40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009ac0 tx=0x7fd4cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867e3309749c7cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.354+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4031400 con 0x7fd4cc0047c0 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.354+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d402d050 con 0x7fd4cc0047c0 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.354+0000 7fd4e6a00640 1 -- 172.21.15.192:0/3648005265 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4031780 con 0x7fd4cc0047c0 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 -- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 msgr2=0x7fd4cc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 0x7fd4cc004c40 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4009ac0 tx=0x7fd4cc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 -- 172.21.15.192:0/3648005265 shutdown_connections 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3648005265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4cc0047c0 0x7fd4cc004c40 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 -- 172.21.15.192:0/3648005265 >> 172.21.15.192:0/3648005265 conn(0x7fd4e80b08f0 msgr2=0x7fd4e80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 -- 172.21.15.192:0/3648005265 shutdown_connections 2024-09-13T18:43:03.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.355+0000 7fd4eea00640 1 -- 172.21.15.192:0/3648005265 wait complete. 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.356+0000 7fd4eea00640 1 Processor -- start 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 -- start start 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0047c0 0x7fd4e8156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4e8158760 0x7fd4e8158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8157050 con 0x7fd4e8156bd0 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e8139d70 con 0x7fd4cc0047c0 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.357+0000 7fd4eea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e81397f0 con 0x7fd4e8158760 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48478/0 (socket says 172.21.15.192:48478) 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 -- 172.21.15.192:0/3222936119 learned_addr learned my addr 172.21.15.192:0/3222936119 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:03.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7e00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0047c0 0x7fd4e8156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4eca00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4e8158760 0x7fd4e8158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 -- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4e8158760 msgr2=0x7fd4e8158be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4e8158760 0x7fd4e8158be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 -- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0047c0 msgr2=0x7fd4e8156260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0047c0 0x7fd4e8156260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.358+0000 7fd4e7400640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8157260 con 0x7fd4e8156bd0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4e7400640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4034040 tx=0x7fd4d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d4003e90 con 0x7fd4e8156bd0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4d403b400 con 0x7fd4e8156bd0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e815c4a0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4d403b790 con 0x7fd4e8156bd0 2024-09-13T18:43:03.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.359+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e815ca60 con 0x7fd4e8156bd0 2024-09-13T18:43:03.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.360+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e80cc7d0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.361+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd4d403b8f0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.362+0000 7fd4dfe00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 0x7fd4c806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.362+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4d40a95a0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.362+0000 7fd4e7e00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 0x7fd4c806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.362+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fd4c8072760 con 0x7fd4e8156bd0 2024-09-13T18:43:03.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.363+0000 7fd4e7e00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 0x7fd4c806d0f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8001b70 tx=0x7fd4d8001d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.366+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd4d4074820 con 0x7fd4e8156bd0 2024-09-13T18:43:03.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.531+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4e80af6f0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.531+0000 7fd4dfe00640 1 -- 172.21.15.192:0/3222936119 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v153) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4d40360a0 con 0x7fd4e8156bd0 2024-09-13T18:43:03.534 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.533+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 msgr2=0x7fd4c806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.533+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 0x7fd4c806d0f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8001b70 tx=0x7fd4d8001d50 comp rx=0 tx=0).stop 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.533+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 msgr2=0x7fd4e81392b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.533+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4034040 tx=0x7fd4d4004730 comp rx=0 tx=0).stop 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 shutdown_connections 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd4c806ac30 0x7fd4c806d0f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd4e8158760 0x7fd4e8158be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4e8156bd0 0x7fd4e81392b0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 --2- 172.21.15.192:0/3222936119 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd4cc0047c0 0x7fd4e8156260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 >> 172.21.15.192:0/3222936119 conn(0x7fd4e80b08f0 msgr2=0x7fd4e806ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 shutdown_connections 2024-09-13T18:43:03.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.534+0000 7fd4eea00640 1 -- 172.21.15.192:0/3222936119 wait complete. 2024-09-13T18:43:03.553 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:43:03.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.708+0000 7f8856000640 1 Processor -- start 2024-09-13T18:43:03.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.708+0000 7f8856000640 1 -- start start 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.709+0000 7f8856000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 0x7f88500b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.709+0000 7f8856000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88500b3bd0 0x7f885006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.709+0000 7f8856000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885006cc70 con 0x7f88501434c0 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.709+0000 7f8856000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500ce770 con 0x7f88500b3bd0 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.709+0000 7f8856000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500b4040 con 0x7f885006c800 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88500b3bd0 0x7f885006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f88500b3bd0 0x7f885006e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48488/0 (socket says 172.21.15.192:48488) 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 -- 172.21.15.192:0/1435101276 learned_addr learned my addr 172.21.15.192:0/1435101276 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:03.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f8846a00640 1 --2- 172.21.15.192:0/1435101276 >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 0x7f88500b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 -- 172.21.15.192:0/1435101276 >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 msgr2=0x7f88500b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 --2- 172.21.15.192:0/1435101276 >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 0x7f88500b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 -- 172.21.15.192:0/1435101276 >> v1:172.21.15.194:6789/0 conn(0x7f88501434c0 legacy=0x7f885006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:03.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f884fe00640 1 -- 172.21.15.192:0/1435101276 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885006b480 con 0x7f88500b3bd0 2024-09-13T18:43:03.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.710+0000 7f8846a00640 1 --2- 172.21.15.192:0/1435101276 >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 0x7f88500b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.711+0000 7f884fe00640 1 --2- 172.21.15.192:0/1435101276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88500b3bd0 0x7f885006e920 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e50 tx=0x7f884802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bd028868f05a13 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.711+0000 7f884ea00640 1 -- 172.21.15.192:0/1435101276 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848031600 con 0x7f88500b3bd0 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f884ea00640 1 -- 172.21.15.192:0/1435101276 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884802d050 con 0x7f88500b3bd0 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f884ea00640 1 -- 172.21.15.192:0/1435101276 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848031980 con 0x7f88500b3bd0 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 -- 172.21.15.192:0/1435101276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88500b3bd0 msgr2=0x7f885006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 --2- 172.21.15.192:0/1435101276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88500b3bd0 0x7f885006e920 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8848009e50 tx=0x7f884802a680 comp rx=0 tx=0).stop 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 -- 172.21.15.192:0/1435101276 shutdown_connections 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 --2- 172.21.15.192:0/1435101276 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88500b3bd0 0x7f885006e920 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 --2- 172.21.15.192:0/1435101276 >> v2:172.21.15.194:3300/0 conn(0x7f885006c800 0x7f88500b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 -- 172.21.15.192:0/1435101276 >> 172.21.15.192:0/1435101276 conn(0x7f88500b08f0 msgr2=0x7f88500b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 -- 172.21.15.192:0/1435101276 shutdown_connections 2024-09-13T18:43:03.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.712+0000 7f8856000640 1 -- 172.21.15.192:0/1435101276 wait complete. 2024-09-13T18:43:03.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.714+0000 7f8856000640 1 Processor -- start 2024-09-13T18:43:03.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.714+0000 7f8856000640 1 -- start start 2024-09-13T18:43:03.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88500b3bd0 0x7f885013bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88501434c0 0x7f885013c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885013d100 con 0x7f885006c800 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885006ee50 con 0x7f88500b3bd0 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8856000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f885013cb40 con 0x7f88501434c0 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f884f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f884f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48498/0 (socket says 172.21.15.192:48498) 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f884f400640 1 -- 172.21.15.192:0/979271439 learned_addr learned my addr 172.21.15.192:0/979271439 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f884fe00640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88501434c0 0x7f885013c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.715+0000 7f8846a00640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88500b3bd0 0x7f885013bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 -- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88501434c0 msgr2=0x7f885013c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88501434c0 0x7f885013c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 -- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88500b3bd0 msgr2=0x7f885013bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88500b3bd0 0x7f885013bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8848009b30 con 0x7f885006c800 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f884f400640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f884000b420 tx=0x7f884000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011830 con 0x7f885006c800 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840011990 con 0x7f885006c800 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011d40 con 0x7f885006c800 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f885013ce20 con 0x7f885006c800 2024-09-13T18:43:03.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.716+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88501577c0 con 0x7f885006c800 2024-09-13T18:43:03.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.717+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88500cc7d0 con 0x7f885006c800 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.718+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f884001b460 con 0x7f885006c800 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.719+0000 7f8847e00640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.719+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8840088d30 con 0x7f885006c800 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.719+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f882c072730 con 0x7f885006c800 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.719+0000 7f8846a00640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:03.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.720+0000 7f8846a00640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 0x7f882c06d0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f88500b2c50 tx=0x7f8838008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:03.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.723+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8840054030 con 0x7f885006c800 2024-09-13T18:43:03.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.893+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f885015d830 con 0x7f885006c800 2024-09-13T18:43:03.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.893+0000 7f8847e00640 1 -- 172.21.15.192:0/979271439 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v153) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8840057650 con 0x7f885006c800 2024-09-13T18:43:03.896 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:43:03.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 msgr2=0x7f882c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 0x7f882c06d0c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f88500b2c50 tx=0x7f8838008040 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 msgr2=0x7f885013fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f884000b420 tx=0x7f884000b8e0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 shutdown_connections 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f882c06ac00 0x7f882c06d0c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88501434c0 0x7f885013c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f88500b3bd0 0x7f885013bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 --2- 172.21.15.192:0/979271439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f885006c800 0x7f885013fd20 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.895+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 >> 172.21.15.192:0/979271439 conn(0x7f88500b08f0 msgr2=0x7f88500ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.896+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 shutdown_connections 2024-09-13T18:43:03.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:03.896+0000 7f8856000640 1 -- 172.21.15.192:0/979271439 wait complete. 2024-09-13T18:43:03.915 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.065+0000 7f25e6c00640 1 Processor -- start 2024-09-13T18:43:04.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.065+0000 7f25e6c00640 1 -- start start 2024-09-13T18:43:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.066+0000 7f25e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b3f10 0x7f25e015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.066+0000 7f25e6c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f25e00b0490 0x7f25e015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.066+0000 7f25e6c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25e00b2f00 con 0x7f25e015dee0 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.066+0000 7f25e6c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25e015aec0 con 0x7f25e00b0490 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.066+0000 7f25e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e00b3150 con 0x7f25e00b3f10 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25dfe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f25e015dee0 0x7f25e00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33724/0 (socket says 172.21.15.192:33724) 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25dfe00640 1 -- 172.21.15.192:0/105426691 learned_addr learned my addr 172.21.15.192:0/105426691 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25e4c00640 1 --2- 172.21.15.192:0/105426691 >> v2:172.21.15.194:3300/0 conn(0x7f25e00b0490 0x7f25e015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25df400640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b3f10 0x7f25e015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25dea00640 1 -- 172.21.15.192:0/105426691 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881105934 0 0) 0x7f25e00b2f00 con 0x7f25e015dee0 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25dea00640 1 -- 172.21.15.192:0/105426691 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25c4003520 con 0x7f25e015dee0 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25e4c00640 1 -- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b3f10 msgr2=0x7f25e015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25e4c00640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b3f10 0x7f25e015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25e4c00640 1 -- 172.21.15.192:0/105426691 >> v1:172.21.15.192:6789/0 conn(0x7f25e015dee0 legacy=0x7f25e00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.071 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.067+0000 7f25e4c00640 1 -- 172.21.15.192:0/105426691 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e00b3430 con 0x7f25e00b0490 2024-09-13T18:43:04.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.068+0000 7f25e4c00640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e00b0490 0x7f25e015a980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009d90 tx=0x7f25d802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1438493c25bf35bc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.068+0000 7f25dea00640 1 -- 172.21.15.192:0/105426691 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8007740 con 0x7f25e00b0490 2024-09-13T18:43:04.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25dea00640 1 -- 172.21.15.192:0/105426691 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d802d050 con 0x7f25e00b0490 2024-09-13T18:43:04.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25dea00640 1 -- 172.21.15.192:0/105426691 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d8007ac0 con 0x7f25e00b0490 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 -- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e00b0490 msgr2=0x7f25e015a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e00b0490 0x7f25e015a980 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009d90 tx=0x7f25d802a660 comp rx=0 tx=0).stop 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 -- 172.21.15.192:0/105426691 shutdown_connections 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e00b0490 0x7f25e015a980 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 --2- 172.21.15.192:0/105426691 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b3f10 0x7f25e015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 -- 172.21.15.192:0/105426691 >> 172.21.15.192:0/105426691 conn(0x7f25e00ae960 msgr2=0x7f25e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 -- 172.21.15.192:0/105426691 shutdown_connections 2024-09-13T18:43:04.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.069+0000 7f25e6c00640 1 -- 172.21.15.192:0/105426691 wait complete. 2024-09-13T18:43:04.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.071+0000 7f25e6c00640 1 Processor -- start 2024-09-13T18:43:04.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.071+0000 7f25e6c00640 1 -- start start 2024-09-13T18:43:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b0490 0x7f25e0137730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e015dee0 0x7f25e01364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0137c70 con 0x7f25e0140db0 2024-09-13T18:43:04.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25e01418c0 con 0x7f25e015dee0 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e6c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25e0141ba0 con 0x7f25e00b0490 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e4c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48504/0 (socket says 172.21.15.192:48504) 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25e4c00640 1 -- 172.21.15.192:0/1093826522 learned_addr learned my addr 172.21.15.192:0/1093826522 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25df400640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e015dee0 0x7f25e01364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.072+0000 7f25dfe00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b0490 0x7f25e0137730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 -- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b0490 msgr2=0x7f25e0137730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b0490 0x7f25e0137730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 -- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e015dee0 msgr2=0x7f25e01364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e015dee0 0x7f25e01364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d8009a70 con 0x7f25e0140db0 2024-09-13T18:43:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e4c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009eb0 tx=0x7f25d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d803c830 con 0x7f25e0140db0 2024-09-13T18:43:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25d803c990 con 0x7f25e0140db0 2024-09-13T18:43:04.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25d803cd00 con 0x7f25e0140db0 2024-09-13T18:43:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25e0136c50 con 0x7f25e0140db0 2024-09-13T18:43:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.073+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25e0137210 con 0x7f25e0140db0 2024-09-13T18:43:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.074+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25e00afd80 con 0x7f25e0140db0 2024-09-13T18:43:04.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.075+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25d8031400 con 0x7f25e0140db0 2024-09-13T18:43:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.076+0000 7f25d7e00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 0x7f25c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.076+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25d80aae30 con 0x7f25e0140db0 2024-09-13T18:43:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.076+0000 7f25dfe00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 0x7f25c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.076+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f25c0072730 con 0x7f25e0140db0 2024-09-13T18:43:04.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.077+0000 7f25dfe00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 0x7f25c006d0c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f25d00011e0 tx=0x7f25d0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.081+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25d8040060 con 0x7f25e0140db0 2024-09-13T18:43:04.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.281+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25e01373d0 con 0x7f25e0140db0 2024-09-13T18:43:04.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.281+0000 7f25d7e00640 1 -- 172.21.15.192:0/1093826522 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f25d804a030 con 0x7f25e0140db0 2024-09-13T18:43:04.284 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:04.284 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:43:04.285 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.283+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 msgr2=0x7f25c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 0x7f25c006d0c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f25d00011e0 tx=0x7f25d0007d30 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 msgr2=0x7f25e0141260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f25d8009eb0 tx=0x7f25d8004a40 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 shutdown_connections 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f25c006ac00 0x7f25c006d0c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25e0140db0 0x7f25e0141260 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25e015dee0 0x7f25e01364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 --2- 172.21.15.192:0/1093826522 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25e00b0490 0x7f25e0137730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 >> 172.21.15.192:0/1093826522 conn(0x7f25e00ae960 msgr2=0x7f25e006a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 shutdown_connections 2024-09-13T18:43:04.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.284+0000 7f25e6c00640 1 -- 172.21.15.192:0/1093826522 wait complete. 2024-09-13T18:43:04.304 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:04.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.454+0000 7f8ebb400640 1 Processor -- start 2024-09-13T18:43:04.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.454+0000 7f8ebb400640 1 -- start start 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.455+0000 7f8ebb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8eb415dee0 0x7f8eb40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.455+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb40b3f10 0x7f8eb40b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.455+0000 7f8ebb400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb40b2f00 con 0x7f8eb415e2c0 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.455+0000 7f8ebb400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40b3150 con 0x7f8eb415dee0 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.455+0000 7f8ebb400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb40b3430 con 0x7f8eb40b3f10 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8eb415dee0 0x7f8eb40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8eb415dee0 0x7f8eb40afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48514/0 (socket says 172.21.15.192:48514) 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 -- 172.21.15.192:0/1451120178 learned_addr learned my addr 172.21.15.192:0/1451120178 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:04.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb9400640 1 --1- 172.21.15.192:0/1451120178 >> v1:172.21.15.192:6789/0 conn(0x7f8eb415e2c0 0x7f8eb415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33738/0 (socket says 172.21.15.192:33738) 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb3e00640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb40b3f10 0x7f8eb40b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 -- 172.21.15.192:0/1451120178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb40b3f10 msgr2=0x7f8eb40b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb40b3f10 0x7f8eb40b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 -- 172.21.15.192:0/1451120178 >> v1:172.21.15.192:6789/0 conn(0x7f8eb415e2c0 legacy=0x7f8eb415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb8a00640 1 -- 172.21.15.192:0/1451120178 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40b3710 con 0x7f8eb415dee0 2024-09-13T18:43:04.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.456+0000 7f8eb3400640 1 -- 172.21.15.192:0/1451120178 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523760080 0 0) 0x7f8eb40b2f00 con 0x7f8eb415e2c0 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.457+0000 7f8eb8a00640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415dee0 0x7f8eb40afd80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009870 tx=0x7f8ea802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7982eaa19dea7db7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.457+0000 7f8eb3400640 1 -- 172.21.15.192:0/1451120178 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8032440 con 0x7f8eb415dee0 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.457+0000 7f8eb3400640 1 -- 172.21.15.192:0/1451120178 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea80325a0 con 0x7f8eb415dee0 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.457+0000 7f8eb3400640 1 -- 172.21.15.192:0/1451120178 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8032930 con 0x7f8eb415dee0 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 -- 172.21.15.192:0/1451120178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415dee0 msgr2=0x7f8eb40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415dee0 0x7f8eb40afd80 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8009870 tx=0x7f8ea802a250 comp rx=0 tx=0).stop 2024-09-13T18:43:04.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 -- 172.21.15.192:0/1451120178 shutdown_connections 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb40b3f10 0x7f8eb40b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 --2- 172.21.15.192:0/1451120178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415dee0 0x7f8eb40afd80 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 -- 172.21.15.192:0/1451120178 >> 172.21.15.192:0/1451120178 conn(0x7f8eb40ae960 msgr2=0x7f8eb406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 -- 172.21.15.192:0/1451120178 shutdown_connections 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.458+0000 7f8ebb400640 1 -- 172.21.15.192:0/1451120178 wait complete. 2024-09-13T18:43:04.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.459+0000 7f8ebb400640 1 Processor -- start 2024-09-13T18:43:04.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 -- start start 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb415dee0 0x7f8eb4142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb4069ea0 0x7f8eb4138160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4137cd0 con 0x7f8eb415e2c0 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.460+0000 7f8ebb400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41370c0 con 0x7f8eb415dee0 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8ebb400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41373a0 con 0x7f8eb4069ea0 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48526/0 (socket says 172.21.15.192:48526) 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 -- 172.21.15.192:0/2330772980 learned_addr learned my addr 172.21.15.192:0/2330772980 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb8a00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb415dee0 0x7f8eb4142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb9400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb4069ea0 0x7f8eb4138160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 -- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb4069ea0 msgr2=0x7f8eb4138160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb4069ea0 0x7f8eb4138160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 -- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb415dee0 msgr2=0x7f8eb4142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb415dee0 0x7f8eb4142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea80094d0 con 0x7f8eb415e2c0 2024-09-13T18:43:04.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.461+0000 7f8eb3e00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d800 tx=0x7f8ea000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.462+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000b6c0 con 0x7f8eb415e2c0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.462+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea000b820 con 0x7f8eb415e2c0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.462+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea000bbb0 con 0x7f8eb415e2c0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.462+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb4137680 con 0x7f8eb415e2c0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.462+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb4135960 con 0x7f8eb415e2c0 2024-09-13T18:43:04.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.463+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4137e80 con 0x7f8eb415e2c0 2024-09-13T18:43:04.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.464+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ea000bd10 con 0x7f8eb415e2c0 2024-09-13T18:43:04.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.465+0000 7f8eb0c00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 0x7f8e9406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.465+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ea0089820 con 0x7f8eb415e2c0 2024-09-13T18:43:04.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.465+0000 7f8eb8a00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 0x7f8e9406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.465+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f8e94072730 con 0x7f8eb415e2c0 2024-09-13T18:43:04.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.465+0000 7f8eb8a00640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 0x7f8e9406d0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8034000 tx=0x7f8ea802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.469+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8eb4137e80 con 0x7f8eb415e2c0 2024-09-13T18:43:04.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.640+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8eb415a440 con 0x7f8eb415e2c0 2024-09-13T18:43:04.643 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.641+0000 7f8eb0c00640 1 -- 172.21.15.192:0/2330772980 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16670 (secure 0 0 0) 0x7f8ea00584a0 con 0x7f8eb415e2c0 2024-09-13T18:43:04.644 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:04.644 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":153,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:01.831440+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:04.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 msgr2=0x7f8e9406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 0x7f8e9406d0c0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f8ea8034000 tx=0x7f8ea802e000 comp rx=0 tx=0).stop 2024-09-13T18:43:04.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 msgr2=0x7f8eb4135420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f8ea000d800 tx=0x7f8ea000dcc0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 shutdown_connections 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8e9406ac00 0x7f8e9406d0c0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8eb4069ea0 0x7f8eb4138160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8eb415e2c0 0x7f8eb4135420 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 --2- 172.21.15.192:0/2330772980 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8eb415dee0 0x7f8eb4142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 >> 172.21.15.192:0/2330772980 conn(0x7f8eb40ae960 msgr2=0x7f8eb40b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 shutdown_connections 2024-09-13T18:43:04.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.643+0000 7f8ebb400640 1 -- 172.21.15.192:0/2330772980 wait complete. 2024-09-13T18:43:04.663 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:43:04.663 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:04.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.814+0000 7f9f37200640 1 Processor -- start 2024-09-13T18:43:04.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.814+0000 7f9f37200640 1 -- start start 2024-09-13T18:43:04.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f37200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f3815ce00 0x7f9f380b65d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f37200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f9f380b7fe0 0x7f9f380b8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f37200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f380b6f40 con 0x7f9f380cd5f0 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f37200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380b7220 con 0x7f9f3815ce00 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f37200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f380b7500 con 0x7f9f380b7fe0 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f35e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f3815ce00 0x7f9f380b65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f35e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9f3815ce00 0x7f9f380b65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48532/0 (socket says 172.21.15.192:48532) 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.815+0000 7f9f35e00640 1 -- 172.21.15.192:0/2891673988 learned_addr learned my addr 172.21.15.192:0/2891673988 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.816+0000 7f9f35400640 1 --2- 172.21.15.192:0/2891673988 >> v2:172.21.15.194:3300/0 conn(0x7f9f380b7fe0 0x7f9f380b8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.816+0000 7f9f35e00640 1 -- 172.21.15.192:0/2891673988 >> v2:172.21.15.194:3300/0 conn(0x7f9f380b7fe0 msgr2=0x7f9f380b8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.816+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2891673988 >> v2:172.21.15.194:3300/0 conn(0x7f9f380b7fe0 0x7f9f380b8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.816+0000 7f9f35e00640 1 -- 172.21.15.192:0/2891673988 >> v1:172.21.15.194:6789/0 conn(0x7f9f380cd5f0 legacy=0x7f9f3815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.816+0000 7f9f35e00640 1 -- 172.21.15.192:0/2891673988 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f380b77e0 con 0x7f9f3815ce00 2024-09-13T18:43:04.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2891673988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3815ce00 0x7f9f380b65d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9f3804f170 tx=0x7f9f2802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a561cf715b6f807e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f34a00640 1 -- 172.21.15.192:0/2891673988 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28032440 con 0x7f9f3815ce00 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f34a00640 1 -- 172.21.15.192:0/2891673988 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f280325a0 con 0x7f9f3815ce00 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f34a00640 1 -- 172.21.15.192:0/2891673988 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f28032930 con 0x7f9f3815ce00 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 -- 172.21.15.192:0/2891673988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3815ce00 msgr2=0x7f9f380b65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 --2- 172.21.15.192:0/2891673988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3815ce00 0x7f9f380b65d0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f9f3804f170 tx=0x7f9f2802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 -- 172.21.15.192:0/2891673988 shutdown_connections 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 --2- 172.21.15.192:0/2891673988 >> v2:172.21.15.194:3300/0 conn(0x7f9f380b7fe0 0x7f9f380b8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 --2- 172.21.15.192:0/2891673988 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f3815ce00 0x7f9f380b65d0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 -- 172.21.15.192:0/2891673988 >> 172.21.15.192:0/2891673988 conn(0x7f9f380b4860 msgr2=0x7f9f380b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 -- 172.21.15.192:0/2891673988 shutdown_connections 2024-09-13T18:43:04.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.817+0000 7f9f37200640 1 -- 172.21.15.192:0/2891673988 wait complete. 2024-09-13T18:43:04.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.818+0000 7f9f37200640 1 Processor -- start 2024-09-13T18:43:04.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.818+0000 7f9f37200640 1 -- start start 2024-09-13T18:43:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 0x7f9f381f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f3815ce00 0x7f9f380a9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3814bb70 con 0x7f9f380cd5f0 2024-09-13T18:43:04.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3814b210 con 0x7f9f3815ce00 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.819+0000 7f9f37200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3814b4b0 con 0x7f9f380b7fe0 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48540/0 (socket says 172.21.15.192:48540) 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 -- 172.21.15.192:0/2831398740 learned_addr learned my addr 172.21.15.192:0/2831398740 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 0x7f9f381f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f36800640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f3815ce00 0x7f9f380a9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 -- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 msgr2=0x7f9f381f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 0x7f9f381f56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 -- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f3815ce00 msgr2=0x7f9f380a9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f3815ce00 0x7f9f380a9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f280094d0 con 0x7f9f380cd5f0 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 0x7f9f381f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:04.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f35400640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400d5f0 tx=0x7f9f2400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f240125f0 con 0x7f9f380cd5f0 2024-09-13T18:43:04.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f24012750 con 0x7f9f380cd5f0 2024-09-13T18:43:04.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.820+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f24012b00 con 0x7f9f380cd5f0 2024-09-13T18:43:04.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.822+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f3814b790 con 0x7f9f380cd5f0 2024-09-13T18:43:04.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.822+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f381f5be0 con 0x7f9f380cd5f0 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.823+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f380b65d0 con 0x7f9f380cd5f0 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.823+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9f24012c60 con 0x7f9f380cd5f0 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.824+0000 7f9f2e000640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 0x7f9f1806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.824+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f24089820 con 0x7f9f380cd5f0 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.824+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 0x7f9f1806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:04.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.824+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f9f18072730 con 0x7f9f380cd5f0 2024-09-13T18:43:04.827 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.824+0000 7f9f35e00640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 0x7f9f1806d0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9f28034000 tx=0x7f9f2802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:04.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:04.827+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9f240549f0 con 0x7f9f380cd5f0 2024-09-13T18:43:05.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.033+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f38071060 con 0x7f9f380cd5f0 2024-09-13T18:43:05.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.034+0000 7f9f2e000640 1 -- 172.21.15.192:0/2831398740 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f9f24058010 con 0x7f9f380cd5f0 2024-09-13T18:43:05.035 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:05.036 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:43:05.036 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 msgr2=0x7f9f1806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 0x7f9f1806d0c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f9f28034000 tx=0x7f9f2802e000 comp rx=0 tx=0).stop 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 msgr2=0x7f9f380a9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f9f2400d5f0 tx=0x7f9f2400dab0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 shutdown_connections 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9f1806ac00 0x7f9f1806d0c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9f3815ce00 0x7f9f380a9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9f380cd5f0 0x7f9f380a9900 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 --2- 172.21.15.192:0/2831398740 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9f380b7fe0 0x7f9f381f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 >> 172.21.15.192:0/2831398740 conn(0x7f9f380b4860 msgr2=0x7f9f38065bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 shutdown_connections 2024-09-13T18:43:05.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.036+0000 7f9f37200640 1 -- 172.21.15.192:0/2831398740 wait complete. 2024-09-13T18:43:05.054 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:05.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.203+0000 7f0380800640 1 Processor -- start 2024-09-13T18:43:05.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.203+0000 7f0380800640 1 -- start start 2024-09-13T18:43:05.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.204+0000 7f0380800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.204+0000 7f0380800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 0x7f03780b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.204+0000 7f0380800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03780b2f00 con 0x7f037815e2c0 2024-09-13T18:43:05.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.204+0000 7f0380800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03780b3150 con 0x7f037815dee0 2024-09-13T18:43:05.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.204+0000 7f0380800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03780b3430 con 0x7f03780b3f10 2024-09-13T18:43:05.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 0x7f03780b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41882/0 (socket says 172.21.15.192:41882) 2024-09-13T18:43:05.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037de00640 1 -- 172.21.15.192:0/681126163 learned_addr learned my addr 172.21.15.192:0/681126163 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037e800640 1 --1- 172.21.15.192:0/681126163 >> v1:172.21.15.194:6789/0 conn(0x7f037815e2c0 0x7f037815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:51134/0 (socket says 172.21.15.192:51134) 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037d400640 1 -- 172.21.15.192:0/681126163 >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 msgr2=0x7f03780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.205+0000 7f037d400640 1 --2- 172.21.15.192:0/681126163 >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.206+0000 7f037d400640 1 -- 172.21.15.192:0/681126163 >> v1:172.21.15.194:6789/0 conn(0x7f037815e2c0 legacy=0x7f037815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.206+0000 7f037d400640 1 -- 172.21.15.192:0/681126163 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03780b3710 con 0x7f03780b3f10 2024-09-13T18:43:05.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.206+0000 7f037de00640 1 --2- 172.21.15.192:0/681126163 >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:05.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.206+0000 7f037d400640 1 --2- 172.21.15.192:0/681126163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 0x7f03780b02c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f036800ba40 tx=0x7f036802c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=710bf25cca7b6216 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f037ca00640 1 -- 172.21.15.192:0/681126163 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368032750 con 0x7f03780b3f10 2024-09-13T18:43:05.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f037ca00640 1 -- 172.21.15.192:0/681126163 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03680328b0 con 0x7f03780b3f10 2024-09-13T18:43:05.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f037ca00640 1 -- 172.21.15.192:0/681126163 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368032c40 con 0x7f03780b3f10 2024-09-13T18:43:05.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 -- 172.21.15.192:0/681126163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 msgr2=0x7f03780b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 --2- 172.21.15.192:0/681126163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 0x7f03780b02c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f036800ba40 tx=0x7f036802c850 comp rx=0 tx=0).stop 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 -- 172.21.15.192:0/681126163 shutdown_connections 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 --2- 172.21.15.192:0/681126163 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f03780b3f10 0x7f03780b02c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 --2- 172.21.15.192:0/681126163 >> v2:172.21.15.194:3300/0 conn(0x7f037815dee0 0x7f03780afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.207+0000 7f0380800640 1 -- 172.21.15.192:0/681126163 >> 172.21.15.192:0/681126163 conn(0x7f03780ae960 msgr2=0x7f037806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.208+0000 7f0380800640 1 -- 172.21.15.192:0/681126163 shutdown_connections 2024-09-13T18:43:05.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.208+0000 7f0380800640 1 -- 172.21.15.192:0/681126163 wait complete. 2024-09-13T18:43:05.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.209+0000 7f0380800640 1 Processor -- start 2024-09-13T18:43:05.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.209+0000 7f0380800640 1 -- start start 2024-09-13T18:43:05.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f037815dee0 0x7f037813d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f037815e2c0 0x7f0378070970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037813ff90 con 0x7f037815c1d0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0378155c50 con 0x7f037815dee0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f0380800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037815c740 con 0x7f037815e2c0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f037e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f037de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f037815dee0 0x7f037813d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f037e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48550/0 (socket says 172.21.15.192:48550) 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f037e800640 1 -- 172.21.15.192:0/2824906912 learned_addr learned my addr 172.21.15.192:0/2824906912 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.210+0000 7f037d400640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f037815e2c0 0x7f0378070970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 -- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f037815e2c0 msgr2=0x7f0378070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f037815e2c0 0x7f0378070970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 -- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f037815dee0 msgr2=0x7f037813d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f037815dee0 0x7f037813d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c0094d0 con 0x7f037815c1d0 2024-09-13T18:43:05.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f037e800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f037400c730 tx=0x7f037400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400ce40 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f037400a640 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f036800b6a0 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.211+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f037400a9f0 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.212+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037813f790 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.213+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0378157860 con 0x7f037815c1d0 2024-09-13T18:43:05.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.213+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f037400ab50 con 0x7f037815c1d0 2024-09-13T18:43:05.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.214+0000 7f0372000640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 0x7f035c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.214+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0374088a80 con 0x7f037815c1d0 2024-09-13T18:43:05.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.214+0000 7f037de00640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 0x7f035c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.215+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f035c072730 con 0x7f037815c1d0 2024-09-13T18:43:05.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.215+0000 7f037de00640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 0x7f035c06d0c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f036c006ca0 tx=0x7f036c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.218+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0374017020 con 0x7f037815c1d0 2024-09-13T18:43:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.421+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f037815a440 con 0x7f037815c1d0 2024-09-13T18:43:05.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.422+0000 7f0372000640 1 -- 172.21.15.192:0/2824906912 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f0374053c70 con 0x7f037815c1d0 2024-09-13T18:43:05.424 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:05.424 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":62,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58}],"filesystems":[{"mdsmap":{"epoch":62,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:42:26.694601+0000","modified":"2024-09-13T18:42:29.709240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7710},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7710":{"gid":7710,"name":"c","rank":0,"incarnation":59,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3552139706","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":3552139706},{"type":"v1","addr":"172.21.15.192:6837","nonce":3552139706}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-09-13T18:43:05.424 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 62 2024-09-13T18:43:05.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 msgr2=0x7f035c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 0x7f035c06d0c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f036c006ca0 tx=0x7f036c009240 comp rx=0 tx=0).stop 2024-09-13T18:43:05.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 msgr2=0x7f0378070eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f037400c730 tx=0x7f037400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 shutdown_connections 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f035c06ac00 0x7f035c06d0c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f037815c1d0 0x7f0378070eb0 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f037815e2c0 0x7f0378070970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 --2- 172.21.15.192:0/2824906912 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f037815dee0 0x7f037813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 >> 172.21.15.192:0/2824906912 conn(0x7f03780ae960 msgr2=0x7f03780afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 shutdown_connections 2024-09-13T18:43:05.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.424+0000 7f0380800640 1 -- 172.21.15.192:0/2824906912 wait complete. 2024-09-13T18:43:05.443 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:05.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.593+0000 7fce08800640 1 Processor -- start 2024-09-13T18:43:05.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.593+0000 7fce08800640 1 -- start start 2024-09-13T18:43:05.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.594+0000 7fce08800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fce000b3f10 0x7fce0015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.594+0000 7fce08800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b2f00 con 0x7fce000b0490 2024-09-13T18:43:05.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.594+0000 7fce08800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce000b3150 con 0x7fce0015dee0 2024-09-13T18:43:05.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.594+0000 7fce08800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce000b3430 con 0x7fce000b3f10 2024-09-13T18:43:05.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce06800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fce000b0490 0x7fce0015a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33748/0 (socket says 172.21.15.192:33748) 2024-09-13T18:43:05.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce06800640 1 -- 172.21.15.192:0/1469860907 learned_addr learned my addr 172.21.15.192:0/1469860907 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce05400640 1 --2- 172.21.15.192:0/1469860907 >> v2:172.21.15.194:3300/0 conn(0x7fce000b3f10 0x7fce0015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794135147 0 0) 0x7fce000b2f00 con 0x7fce000b0490 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcde8003520 con 0x7fce000b0490 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1414872976 0 0) 0x7fcde8003520 con 0x7fce000b0490 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 >> v2:172.21.15.194:3300/0 conn(0x7fce000b3f10 msgr2=0x7fce0015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 --2- 172.21.15.192:0/1469860907 >> v2:172.21.15.194:3300/0 conn(0x7fce000b3f10 0x7fce0015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 >> v1:172.21.15.194:6789/0 conn(0x7fce0015dee0 legacy=0x7fce000afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce000b3710 con 0x7fce000b0490 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fcdfc0019f0 con 0x7fce000b0490 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 >> v1:172.21.15.192:6789/0 conn(0x7fce000b0490 legacy=0x7fce0015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8003970 0x7fcde8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde8004370 0x7fcde8004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.595+0000 7fce04a00640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fcde800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce000b3430 con 0x7fcde8005040 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde800bfa0 con 0x7fcde8003970 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde800c160 con 0x7fcde8004370 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fcde800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce05e00640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8003970 0x7fcde8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce05400640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde8004370 0x7fcde8004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 -- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde8004370 msgr2=0x7fcde8004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:05.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcde8004370 0x7fcde8004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 -- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8003970 msgr2=0x7fcde8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcde8003970 0x7fcde8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.596+0000 7fce06800640 1 -- 172.21.15.192:0/1469860907 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde8003520 con 0x7fcde8005040 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.597+0000 7fce06800640 1 -- 172.21.15.192:0/1469860907 reap_dead start 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.597+0000 7fce06800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fcde800b980 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a830 tx=0x7fcde80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7eed0f25ff84e0d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.597+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc02dc40 con 0x7fcde8005040 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.597+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdfc02ddc0 con 0x7fcde8005040 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.597+0000 7fce04a00640 1 -- 172.21.15.192:0/1469860907 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc0366b0 con 0x7fcde8005040 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 -- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 msgr2=0x7fcde800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fcde800b980 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc00a830 tx=0x7fcde80057f0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 -- 172.21.15.192:0/1469860907 shutdown_connections 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 --2- 172.21.15.192:0/1469860907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fcde800b980 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 -- 172.21.15.192:0/1469860907 >> 172.21.15.192:0/1469860907 conn(0x7fce000ae960 msgr2=0x7fce0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 -- 172.21.15.192:0/1469860907 shutdown_connections 2024-09-13T18:43:05.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.598+0000 7fce08800640 1 -- 172.21.15.192:0/1469860907 wait complete. 2024-09-13T18:43:05.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.600+0000 7fce08800640 1 Processor -- start 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.600+0000 7fce08800640 1 -- start start 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce001375d0 0x7fce0013dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 0x7fce000ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0013e400 con 0x7fcde8005040 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0013da30 con 0x7fce00142ca0 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce08800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce00137a50 con 0x7fce001375d0 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48568/0 (socket says 172.21.15.192:48568) 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 -- 172.21.15.192:0/1941239817 learned_addr learned my addr 172.21.15.192:0/1941239817 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05400640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce001375d0 0x7fce0013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce06800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 0x7fce000ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 -- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce001375d0 msgr2=0x7fce0013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce001375d0 0x7fce0013dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 -- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 msgr2=0x7fce000ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 0x7fce000ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce05e00640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0013d100 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.601+0000 7fce06800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 0x7fce000ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fce05e00640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400f7c0 tx=0x7fcdf400fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf40050d0 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf4005270 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400d730 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0013d3e0 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.602+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce00143430 con 0x7fcde8005040 2024-09-13T18:43:05.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.603+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce0015d940 con 0x7fcde8005040 2024-09-13T18:43:05.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.604+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcdf400d890 con 0x7fcde8005040 2024-09-13T18:43:05.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.605+0000 7fcdfa000640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 0x7fcde406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.605+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdf4089230 con 0x7fcde8005040 2024-09-13T18:43:05.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.605+0000 7fce05400640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 0x7fcde406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.605+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7fcde4072730 con 0x7fcde8005040 2024-09-13T18:43:05.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.606+0000 7fce05400640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 0x7fcde406d0c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fce001436a0 tx=0x7fcdf0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.609+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcdf40544a0 con 0x7fcde8005040 2024-09-13T18:43:05.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.779+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce000afd80 con 0x7fcde8005040 2024-09-13T18:43:05.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.780+0000 7fcdfa000640 1 -- 172.21.15.192:0/1941239817 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16670 (secure 0 0 0) 0x7fcdf4057ac0 con 0x7fcde8005040 2024-09-13T18:43:05.782 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:05.783 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":153,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:01.831440+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:42:24.548758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"148","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-13T18:42:25.693389+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:05.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 msgr2=0x7fcde406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 0x7fcde406d0c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fce001436a0 tx=0x7fcdf0009190 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 msgr2=0x7fce0013f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fcdf400f7c0 tx=0x7fcdf400fbc0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 shutdown_connections 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fcde406ac00 0x7fcde406d0c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fce00142ca0 0x7fce000ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fce001375d0 0x7fce0013dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 --2- 172.21.15.192:0/1941239817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcde8005040 0x7fce0013f880 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.782+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 >> 172.21.15.192:0/1941239817 conn(0x7fce000ae960 msgr2=0x7fce0006ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.783+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 shutdown_connections 2024-09-13T18:43:05.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.783+0000 7fce08800640 1 -- 172.21.15.192:0/1941239817 wait complete. 2024-09-13T18:43:05.800 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:43:05.955 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.953+0000 7f86ac000640 1 Processor -- start 2024-09-13T18:43:05.956 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.953+0000 7f86ac000640 1 -- start start 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86ac000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f86a40b0490 0x7f86a40cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86ac000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a415ec00 con 0x7f86a40cacd0 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86ac000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a4140480 con 0x7f86a415e790 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86ac000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a40cb5f0 con 0x7f86a40b0490 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a9600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f86a40cacd0 0x7f86a4140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33762/0 (socket says 172.21.15.192:33762) 2024-09-13T18:43:05.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a9600640 1 -- 172.21.15.192:0/2506543028 learned_addr learned my addr 172.21.15.192:0/2506543028 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86aa000640 1 --2- 172.21.15.192:0/2506543028 >> v2:172.21.15.194:3300/0 conn(0x7f86a40b0490 0x7f86a40cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148559952 0 0) 0x7f86a415ec00 con 0x7f86a40cacd0 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003520 con 0x7f86a40cacd0 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039572900 0 0) 0x7f86a4140480 con 0x7f86a415e790 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.955+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a415ec00 con 0x7f86a415e790 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.956+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 964011042 0 0) 0x7f868c003520 con 0x7f86a40cacd0 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.956+0000 7f86aa000640 1 -- 172.21.15.192:0/2506543028 >> v1:172.21.15.194:6789/0 conn(0x7f86a415e790 legacy=0x7f86a40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.956+0000 7f86aa000640 1 -- 172.21.15.192:0/2506543028 >> v1:172.21.15.192:6789/0 conn(0x7f86a40cacd0 legacy=0x7f86a4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.958 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.956+0000 7f86aa000640 1 -- 172.21.15.192:0/2506543028 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a415ee90 con 0x7f86a40b0490 2024-09-13T18:43:05.959 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86aa000640 1 --2- 172.21.15.192:0/2506543028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a40cb0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097a0 tx=0x7f869c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f27b919cd33f393f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86980019f0 con 0x7f86a40b0490 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c02ac50 con 0x7f86a40b0490 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86a3e00640 1 -- 172.21.15.192:0/2506543028 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c032440 con 0x7f86a40b0490 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86ac000640 1 -- 172.21.15.192:0/2506543028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 msgr2=0x7f86a40cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86ac000640 1 --2- 172.21.15.192:0/2506543028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a40cb0b0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f869c0097a0 tx=0x7f869c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86ac000640 1 -- 172.21.15.192:0/2506543028 shutdown_connections 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86ac000640 1 --2- 172.21.15.192:0/2506543028 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a40cb0b0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.957+0000 7f86ac000640 1 -- 172.21.15.192:0/2506543028 >> 172.21.15.192:0/2506543028 conn(0x7f86a40ae960 msgr2=0x7f86a406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.958+0000 7f86ac000640 1 -- 172.21.15.192:0/2506543028 shutdown_connections 2024-09-13T18:43:05.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.958+0000 7f86ac000640 1 -- 172.21.15.192:0/2506543028 wait complete. 2024-09-13T18:43:05.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.959+0000 7f86ac000640 1 Processor -- start 2024-09-13T18:43:05.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.959+0000 7f86ac000640 1 -- start start 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86a40cacd0 0x7f86a413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a413d3e0 con 0x7f86a415e790 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a4069ea0 con 0x7f86a40b0490 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.960+0000 7f86ac000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a406a180 con 0x7f86a40cacd0 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48572/0 (socket says 172.21.15.192:48572) 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 -- 172.21.15.192:0/3627485757 learned_addr learned my addr 172.21.15.192:0/3627485757 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:05.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86a9600640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86a8c00640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86a40cacd0 0x7f86a413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 -- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86a40cacd0 msgr2=0x7f86a413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86a40cacd0 0x7f86a413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 -- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 msgr2=0x7f86a415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869c009400 con 0x7f86a415e790 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86a9600640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:05.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.961+0000 7f86aa000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f869c035040 tx=0x7f869c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.962+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c006e10 con 0x7f86a415e790 2024-09-13T18:43:05.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.962+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869c03b610 con 0x7f86a415e790 2024-09-13T18:43:05.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.962+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869c03b9c0 con 0x7f86a415e790 2024-09-13T18:43:05.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.962+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a406a460 con 0x7f86a415e790 2024-09-13T18:43:05.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.962+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a406aa20 con 0x7f86a415e790 2024-09-13T18:43:05.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.963+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a40cb0b0 con 0x7f86a415e790 2024-09-13T18:43:05.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.963+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f869c039040 con 0x7f86a415e790 2024-09-13T18:43:05.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.964+0000 7f86a1600640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 0x7f868406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:05.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.964+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f869c0a96b0 con 0x7f86a415e790 2024-09-13T18:43:05.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.965+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=154}) v3 -- 0x7f8684072730 con 0x7f86a415e790 2024-09-13T18:43:05.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.965+0000 7f86a9600640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 0x7f868406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:05.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.965+0000 7f86a9600640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 0x7f868406d0c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f86980012e0 tx=0x7f8698009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:05.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:05.968+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f869c04c070 con 0x7f86a415e790 2024-09-13T18:43:06.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.171+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f86a406c6c0 con 0x7f86a415e790 2024-09-13T18:43:06.174 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:43:06.172+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:43:06.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.174+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(154..154 src has 1..154) v4 ==== 374+0+0 (secure 0 0 0) 0x7f869c0784b0 con 0x7f86a415e790 2024-09-13T18:43:06.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.174+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7f8684072fe0 con 0x7f86a415e790 2024-09-13T18:43:06.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.183+0000 7f86a1600640 1 -- 172.21.15.192:0/3627485757 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v63) v1 ==== 161+0+0 (secure 0 0 0) 0x7f869c037030 con 0x7f86a415e790 2024-09-13T18:43:06.185 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 msgr2=0x7f868406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 0x7f868406d0c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f86980012e0 tx=0x7f8698009040 comp rx=0 tx=0).stop 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 msgr2=0x7f86a40ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f869c035040 tx=0x7f869c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 shutdown_connections 2024-09-13T18:43:06.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f868406ac00 0x7f868406d0c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86a415e790 0x7f86a40ad840 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86a40cacd0 0x7f86a413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 --2- 172.21.15.192:0/3627485757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86a40b0490 0x7f86a415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 >> 172.21.15.192:0/3627485757 conn(0x7f86a40ae960 msgr2=0x7f86a4140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 shutdown_connections 2024-09-13T18:43:06.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.185+0000 7f86ac000640 1 -- 172.21.15.192:0/3627485757 wait complete. 2024-09-13T18:43:06.196 INFO:tasks.ceph.mds.c.smithi192.stderr: -9050> 2024-09-13T18:42:27.282+0000 7f9853000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:43:06.205 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:43:06.248 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:43:06.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.361+0000 7fe398a00640 1 Processor -- start 2024-09-13T18:43:06.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.361+0000 7fe398a00640 1 -- start start 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe398a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe39406c800 0x7fe3940b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe398a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe398a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39406cc70 con 0x7fe3941434c0 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe398a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3940b4060 con 0x7fe39406c800 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe398a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3940ce770 con 0x7fe3940b3bd0 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe39406c800 0x7fe3940b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe39406c800 0x7fe3940b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48598/0 (socket says 172.21.15.192:48598) 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 -- 172.21.15.192:0/3440987578 learned_addr learned my addr 172.21.15.192:0/3440987578 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe392800640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 -- 172.21.15.192:0/3440987578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 msgr2=0x7fe39406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 -- 172.21.15.192:0/3440987578 >> v1:172.21.15.192:6789/0 conn(0x7fe3941434c0 legacy=0x7fe39406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe391400640 1 -- 172.21.15.192:0/3440987578 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39406b480 con 0x7fe39406c800 2024-09-13T18:43:06.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.363+0000 7fe390a00640 1 -- 172.21.15.192:0/3440987578 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672442717 0 0) 0x7fe39406cc70 con 0x7fe3941434c0 2024-09-13T18:43:06.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.364+0000 7fe391400640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39406c800 0x7fe3940b3690 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098a0 tx=0x7fe38002a290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed1aca673f7ec8d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:06.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe390a00640 1 -- 172.21.15.192:0/3440987578 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380032440 con 0x7fe39406c800 2024-09-13T18:43:06.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe390a00640 1 -- 172.21.15.192:0/3440987578 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3800325a0 con 0x7fe39406c800 2024-09-13T18:43:06.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe390a00640 1 -- 172.21.15.192:0/3440987578 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe380032930 con 0x7fe39406c800 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 -- 172.21.15.192:0/3440987578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39406c800 msgr2=0x7fe3940b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39406c800 0x7fe3940b3690 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fe3800098a0 tx=0x7fe38002a290 comp rx=0 tx=0).stop 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 -- 172.21.15.192:0/3440987578 shutdown_connections 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 --2- 172.21.15.192:0/3440987578 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe39406c800 0x7fe3940b3690 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 -- 172.21.15.192:0/3440987578 >> 172.21.15.192:0/3440987578 conn(0x7fe3940b08f0 msgr2=0x7fe3940b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 -- 172.21.15.192:0/3440987578 shutdown_connections 2024-09-13T18:43:06.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.365+0000 7fe398a00640 1 -- 172.21.15.192:0/3440987578 wait complete. 2024-09-13T18:43:06.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.367+0000 7fe398a00640 1 Processor -- start 2024-09-13T18:43:06.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.367+0000 7fe398a00640 1 -- start start 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 0x7fe39413e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39413ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39413e8d0 con 0x7fe3941434c0 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe39413bae0 con 0x7fe39406c800 2024-09-13T18:43:06.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe398a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe39413b800 con 0x7fe3940b3bd0 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe392800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe392800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48608/0 (socket says 172.21.15.192:48608) 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe392800640 1 -- 172.21.15.192:0/2645997256 learned_addr learned my addr 172.21.15.192:0/2645997256 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.368+0000 7fe391400640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39413ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe391e00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 0x7fe39413e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 -- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 msgr2=0x7fe39413ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39413ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 -- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 msgr2=0x7fe39413e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 0x7fe39413e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3800094d0 con 0x7fe3941434c0 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe391400640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39413ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe391e00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 0x7fe39413e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:06.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe392800640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007e40 tx=0x7fe38c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:06.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c014620 con 0x7fe3941434c0 2024-09-13T18:43:06.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00ee90 con 0x7fe3941434c0 2024-09-13T18:43:06.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c0149e0 con 0x7fe3941434c0 2024-09-13T18:43:06.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe39406ea50 con 0x7fe3941434c0 2024-09-13T18:43:06.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.369+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39406f010 con 0x7fe3941434c0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.370+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe39406f200 con 0x7fe3941434c0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.371+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe38c014b40 con 0x7fe3941434c0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.372+0000 7fe38a000640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 0x7fe37406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.372+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe38c089da0 con 0x7fe3941434c0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.372+0000 7fe391e00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 0x7fe37406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.372+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7fe374072840 con 0x7fe3941434c0 2024-09-13T18:43:06.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.373+0000 7fe391e00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 0x7fe37406d0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe384000f60 tx=0x7fe384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:06.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.376+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe38c054f10 con 0x7fe3941434c0 2024-09-13T18:43:06.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:06.578+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe3940b3430 con 0x7fe3941434c0 2024-09-13T18:43:07.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.187+0000 7fe38a000640 1 -- 172.21.15.192:0/2645997256 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v64) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe38c058530 con 0x7fe3941434c0 2024-09-13T18:43:07.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.189+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 msgr2=0x7fe37406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 0x7fe37406d0c0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe384000f60 tx=0x7fe384009040 comp rx=0 tx=0).stop 2024-09-13T18:43:07.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 msgr2=0x7fe39413c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fe38c007e40 tx=0x7fe38c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 shutdown_connections 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe37406ac00 0x7fe37406d0c0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3941434c0 0x7fe39413c2a0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe3940b3bd0 0x7fe39413ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 --2- 172.21.15.192:0/2645997256 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe39406c800 0x7fe39413e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 >> 172.21.15.192:0/2645997256 conn(0x7fe3940b08f0 msgr2=0x7fe39415dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 shutdown_connections 2024-09-13T18:43:07.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.190+0000 7fe398a00640 1 -- 172.21.15.192:0/2645997256 wait complete. 2024-09-13T18:43:07.211 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:43:07.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.408+0000 7f6dc3000640 1 Processor -- start 2024-09-13T18:43:07.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.408+0000 7f6dc3000640 1 -- start start 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.409+0000 7f6dc3000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6dbc071b80 0x7f6dbc15f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.409+0000 7f6dc3000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc06a330 con 0x7f6dbc0cd9c0 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.409+0000 7f6dc3000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dbc15f840 con 0x7f6dbc1403e0 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.409+0000 7f6dc3000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dbc13e0f0 con 0x7f6dbc071b80 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dc1000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6dbc0cd9c0 0x7f6dbc15b800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33788/0 (socket says 172.21.15.192:33788) 2024-09-13T18:43:07.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dc1000640 1 -- 172.21.15.192:0/1637230596 learned_addr learned my addr 172.21.15.192:0/1637230596 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbbe00640 1 --2- 172.21.15.192:0/1637230596 >> v2:172.21.15.194:3300/0 conn(0x7f6dbc071b80 0x7f6dbc15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1705958667 0 0) 0x7f6db4001110 con 0x7f6dbc0cd9c0 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da0003520 con 0x7f6dbc0cd9c0 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbbe00640 1 -- 172.21.15.192:0/1637230596 >> v1:172.21.15.194:6789/0 conn(0x7f6dbc1403e0 legacy=0x7f6dbc070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554906004 0 0) 0x7f6da0003520 con 0x7f6dbc0cd9c0 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.410+0000 7f6dbbe00640 1 -- 172.21.15.192:0/1637230596 >> v1:172.21.15.192:6789/0 conn(0x7f6dbc0cd9c0 legacy=0x7f6dbc15b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.411+0000 7f6dbbe00640 1 -- 172.21.15.192:0/1637230596 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dbc15b300 con 0x7f6dbc071b80 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.411+0000 7f6dbbe00640 1 --2- 172.21.15.192:0/1637230596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc071b80 0x7f6dbc15f300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac02a5f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d333af38ff9e3a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db4001800 con 0x7f6dbc071b80 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac02d050 con 0x7f6dbc071b80 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dbaa00640 1 -- 172.21.15.192:0/1637230596 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac007760 con 0x7f6dbc071b80 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dc3000640 1 -- 172.21.15.192:0/1637230596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc071b80 msgr2=0x7f6dbc15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dc3000640 1 --2- 172.21.15.192:0/1637230596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc071b80 0x7f6dbc15f300 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac02a5f0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dc3000640 1 -- 172.21.15.192:0/1637230596 shutdown_connections 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dc3000640 1 --2- 172.21.15.192:0/1637230596 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc071b80 0x7f6dbc15f300 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.412+0000 7f6dc3000640 1 -- 172.21.15.192:0/1637230596 >> 172.21.15.192:0/1637230596 conn(0x7f6dbc0b0c40 msgr2=0x7f6dbc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.413+0000 7f6dc3000640 1 -- 172.21.15.192:0/1637230596 shutdown_connections 2024-09-13T18:43:07.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.413+0000 7f6dc3000640 1 -- 172.21.15.192:0/1637230596 wait complete. 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.414+0000 7f6dc3000640 1 Processor -- start 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.414+0000 7f6dc3000640 1 -- start start 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 0x7f6dbc1376b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc1403e0 0x7f6dbc138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c9140 con 0x7f6dbc071b80 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c8530 con 0x7f6dbc1403e0 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dc3000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dbc0c8810 con 0x7f6dbc0cd9c0 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:07.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48612/0 (socket says 172.21.15.192:48612) 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.415+0000 7f6dbbe00640 1 -- 172.21.15.192:0/3048721909 learned_addr learned my addr 172.21.15.192:0/3048721909 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dc1000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc1403e0 0x7f6dbc138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbb400640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 0x7f6dbc1376b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 -- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 msgr2=0x7f6dbc1376b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 0x7f6dbc1376b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 -- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc1403e0 msgr2=0x7f6dbc138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc1403e0 0x7f6dbc138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac009a70 con 0x7f6dbc071b80 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbb400640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 0x7f6dbc1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6dbbe00640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.416+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac03c830 con 0x7f6dbc071b80 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.417+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac03c990 con 0x7f6dbc071b80 2024-09-13T18:43:07.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.417+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac03cd00 con 0x7f6dbc071b80 2024-09-13T18:43:07.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.417+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dbc0c8af0 con 0x7f6dbc071b80 2024-09-13T18:43:07.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.417+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dbc0c80e0 con 0x7f6dbc071b80 2024-09-13T18:43:07.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.417+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dbc0c82c0 con 0x7f6dbc071b80 2024-09-13T18:43:07.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.418+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6dac02ad50 con 0x7f6dbc071b80 2024-09-13T18:43:07.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.420+0000 7f6db3e00640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 0x7f6d9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:07.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.420+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6dac0aadb0 con 0x7f6dbc071b80 2024-09-13T18:43:07.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.420+0000 7f6dbb400640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 0x7f6d9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:07.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.420+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=155}) v3 -- 0x7f6d9c072870 con 0x7f6dbc071b80 2024-09-13T18:43:07.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.421+0000 7f6dbb400640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 0x7f6d9c06d0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0cc2c0 tx=0x7f6da8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:07.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.424+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6dac040060 con 0x7f6dbc071b80 2024-09-13T18:43:07.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:07.598+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6dbc06b6c0 con 0x7f6dbc071b80 2024-09-13T18:43:08.064 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:43:08.069 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:43:08.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.193+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(155..155 src has 1..155) v4 ==== 296+0+0 (secure 0 0 0) 0x7f6dac030e20 con 0x7f6dbc071b80 2024-09-13T18:43:08.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.193+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7f6d9c070ca0 con 0x7f6dbc071b80 2024-09-13T18:43:08.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.196+0000 7f6db3e00640 1 -- 172.21.15.192:0/3048721909 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v155) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6dac04a030 con 0x7f6dbc071b80 2024-09-13T18:43:08.198 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:43:08.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 msgr2=0x7f6d9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 0x7f6d9c06d0f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0cc2c0 tx=0x7f6da8009040 comp rx=0 tx=0).stop 2024-09-13T18:43:08.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 msgr2=0x7f6dbc13aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009d90 tx=0x7f6dac004a40 comp rx=0 tx=0).stop 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 shutdown_connections 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6d9c06ac30 0x7f6d9c06d0f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dbc1403e0 0x7f6dbc138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dbc0cd9c0 0x7f6dbc1376b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 --2- 172.21.15.192:0/3048721909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dbc071b80 0x7f6dbc13aca0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 >> 172.21.15.192:0/3048721909 conn(0x7f6dbc0b0c40 msgr2=0x7f6dbc15eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 shutdown_connections 2024-09-13T18:43:08.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.198+0000 7f6dc3000640 1 -- 172.21.15.192:0/3048721909 wait complete. 2024-09-13T18:43:08.216 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:43:08.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.371+0000 7fd6c3a00640 1 Processor -- start 2024-09-13T18:43:08.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.372+0000 7fd6c3a00640 1 -- start start 2024-09-13T18:43:08.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c3a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6bc0cca60 0x7fd6bc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c3a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc15e110 con 0x7fd6bc0cb730 2024-09-13T18:43:08.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c3a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc15df20 con 0x7fd6bc0cca60 2024-09-13T18:43:08.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0cced0 con 0x7fd6bc0b3d90 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6bc0cca60 0x7fd6bc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd6bc0cca60 0x7fd6bc06fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48628/0 (socket says 172.21.15.192:48628) 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6c1a00640 1 -- 172.21.15.192:0/1508533574 learned_addr learned my addr 172.21.15.192:0/1508533574 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.373+0000 7fd6bbe00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.374+0000 7fd6c1a00640 1 -- 172.21.15.192:0/1508533574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 msgr2=0x7fd6bc0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.374+0000 7fd6c1a00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.374+0000 7fd6c1a00640 1 -- 172.21.15.192:0/1508533574 >> v1:172.21.15.194:6789/0 conn(0x7fd6bc0cb730 legacy=0x7fd6bc15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.374+0000 7fd6c1a00640 1 -- 172.21.15.192:0/1508533574 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc15e3f0 con 0x7fd6bc0cca60 2024-09-13T18:43:08.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.375+0000 7fd6c1a00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc06fa00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009e80 tx=0x7fd6b402c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde6844d1a70b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.375+0000 7fd6bb400640 1 -- 172.21.15.192:0/1508533574 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4032610 con 0x7fd6bc0cca60 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.375+0000 7fd6bb400640 1 -- 172.21.15.192:0/1508533574 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b402e040 con 0x7fd6bc0cca60 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.375+0000 7fd6bb400640 1 -- 172.21.15.192:0/1508533574 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4032990 con 0x7fd6bc0cca60 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1508533574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cca60 msgr2=0x7fd6bc06fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc06fa00 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4009e80 tx=0x7fd6b402c960 comp rx=0 tx=0).stop 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1508533574 shutdown_connections 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc06fa00 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1508533574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1508533574 >> 172.21.15.192:0/1508533574 conn(0x7fd6bc0b0c40 msgr2=0x7fd6bc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1508533574 shutdown_connections 2024-09-13T18:43:08.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.376+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1508533574 wait complete. 2024-09-13T18:43:08.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.377+0000 7fd6c3a00640 1 Processor -- start 2024-09-13T18:43:08.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.378+0000 7fd6c3a00640 1 -- start start 2024-09-13T18:43:08.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.378+0000 7fd6c3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc159840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.378+0000 7fd6c3a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c3a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc13f2e0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc13e710 con 0x7fd6bc0cca60 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc13e9b0 con 0x7fd6bc0b3d90 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48642/0 (socket says 172.21.15.192:48642) 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 -- 172.21.15.192:0/1386888944 learned_addr learned my addr 172.21.15.192:0/1386888944 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c1000640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc159840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c1a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 -- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 msgr2=0x7fd6bc159840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc159840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 -- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc0cca60 msgr2=0x7fd6bc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:08.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6bbe00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009b30 con 0x7fd6bc0cb730 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.379+0000 7fd6c1000640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6bbe00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800e9b0 tx=0x7fd6a800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8009670 con 0x7fd6bc0cb730 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a800c9a0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc13ec90 con 0x7fd6bc0cb730 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a800cd50 con 0x7fd6bc0cb730 2024-09-13T18:43:08.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.380+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc15c8a0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.381+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc0cc520 con 0x7fd6bc0cb730 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.382+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd6a8013470 con 0x7fd6bc0cb730 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.383+0000 7fd6b8c00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 0x7fd69c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.383+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd6a80893e0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.383+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=156}) v3 -- 0x7fd69c0719d0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.383+0000 7fd6c1000640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 0x7fd69c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:08.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.384+0000 7fd6c1000640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 0x7fd69c06d0c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007fd0 tx=0x7fd6b0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:08.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.387+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd6a80547c0 con 0x7fd6bc0cb730 2024-09-13T18:43:08.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:08.552+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd6bc0cd800 con 0x7fd6bc0cb730 2024-09-13T18:43:09.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.195+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(156..156 src has 1..156) v4 ==== 296+0+0 (secure 0 0 0) 0x7fd6a8058480 con 0x7fd6bc0cb730 2024-09-13T18:43:09.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.195+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=157}) v3 -- 0x7fd69c070760 con 0x7fd6bc0cb730 2024-09-13T18:43:09.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.198+0000 7fd6b8c00640 1 -- 172.21.15.192:0/1386888944 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v156) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd6a8021020 con 0x7fd6bc0cb730 2024-09-13T18:43:09.200 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 msgr2=0x7fd69c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 0x7fd69c06d0c0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0007fd0 tx=0x7fd6b0009040 comp rx=0 tx=0).stop 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 msgr2=0x7fd6bc0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800e9b0 tx=0x7fd6a800ee70 comp rx=0 tx=0).stop 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 shutdown_connections 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd69c06ac00 0x7fd69c06d0c0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6bc0cca60 0x7fd6bc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6bc0cb730 0x7fd6bc0ad840 secure :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fd6a800e9b0 tx=0x7fd6a800ee70 comp rx=0 tx=0).stop 2024-09-13T18:43:09.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 --2- 172.21.15.192:0/1386888944 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6bc0b3d90 0x7fd6bc159840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.204+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 >> 172.21.15.192:0/1386888944 conn(0x7fd6bc0b0c40 msgr2=0x7fd6bc0afdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:09.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.205+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 shutdown_connections 2024-09-13T18:43:09.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.205+0000 7fd6c3a00640 1 -- 172.21.15.192:0/1386888944 wait complete. 2024-09-13T18:43:09.228 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:43:09.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.381+0000 7f346ce00640 1 Processor -- start 2024-09-13T18:43:09.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.381+0000 7f346ce00640 1 -- start start 2024-09-13T18:43:09.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f346ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 0x7f346806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f346ce00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346806cc70 con 0x7f34681434c0 2024-09-13T18:43:09.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f346ce00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f346806b480 con 0x7f346806c800 2024-09-13T18:43:09.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f346ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34680ce770 con 0x7f34680b3da0 2024-09-13T18:43:09.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f3465e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f34681434c0 0x7f346806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33790/0 (socket says 172.21.15.192:33790) 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f3465e00640 1 -- 172.21.15.192:0/2799365145 learned_addr learned my addr 172.21.15.192:0/2799365145 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f3466800640 1 --2- 172.21.15.192:0/2799365145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 0x7f346806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821362525 0 0) 0x7f346806cc70 con 0x7f34681434c0 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.383+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f344c003520 con 0x7f34681434c0 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302199792 0 0) 0x7f346806b480 con 0x7f346806c800 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f346806cc70 con 0x7f346806c800 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3466800640 1 -- 172.21.15.192:0/2799365145 >> v1:172.21.15.194:6789/0 conn(0x7f346806c800 legacy=0x7f34680b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 363141373 0 0) 0x7f344c003520 con 0x7f34681434c0 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3466800640 1 -- 172.21.15.192:0/2799365145 >> v1:172.21.15.192:6789/0 conn(0x7f34681434c0 legacy=0x7f346806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.384+0000 7f3466800640 1 -- 172.21.15.192:0/2799365145 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346806b760 con 0x7f34680b3da0 2024-09-13T18:43:09.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.385+0000 7f3466800640 1 --2- 172.21.15.192:0/2799365145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 0x7f346806e920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3460009df0 tx=0x7f346002a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfa4640404b60892 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.385+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458001670 con 0x7f34680b3da0 2024-09-13T18:43:09.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.385+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346002d050 con 0x7f34680b3da0 2024-09-13T18:43:09.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.385+0000 7f3465400640 1 -- 172.21.15.192:0/2799365145 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460007540 con 0x7f34680b3da0 2024-09-13T18:43:09.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 -- 172.21.15.192:0/2799365145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 msgr2=0x7f346806e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 --2- 172.21.15.192:0/2799365145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 0x7f346806e920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3460009df0 tx=0x7f346002a6a0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 -- 172.21.15.192:0/2799365145 shutdown_connections 2024-09-13T18:43:09.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 --2- 172.21.15.192:0/2799365145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f34680b3da0 0x7f346806e920 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 -- 172.21.15.192:0/2799365145 >> 172.21.15.192:0/2799365145 conn(0x7f34680b08f0 msgr2=0x7f34680b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:09.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 -- 172.21.15.192:0/2799365145 shutdown_connections 2024-09-13T18:43:09.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.386+0000 7f346ce00640 1 -- 172.21.15.192:0/2799365145 wait complete. 2024-09-13T18:43:09.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.387+0000 7f346ce00640 1 Processor -- start 2024-09-13T18:43:09.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 -- start start 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f346806c800 0x7f3468071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680b3da0 0x7f346806fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34680ad9f0 con 0x7f34681434c0 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346806ec70 con 0x7f34680b3da0 2024-09-13T18:43:09.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.388+0000 7f346ce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346806ef50 con 0x7f346806c800 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48652/0 (socket says 172.21.15.192:48652) 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 -- 172.21.15.192:0/3807955994 learned_addr learned my addr 172.21.15.192:0/3807955994 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3465e00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f346806c800 0x7f3468071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f345fe00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680b3da0 0x7f346806fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 -- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f346806c800 msgr2=0x7f3468071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f346806c800 0x7f3468071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 -- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680b3da0 msgr2=0x7f346806fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680b3da0 0x7f346806fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.389+0000 7f3466800640 1 -- 172.21.15.192:0/3807955994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009a70 con 0x7f34681434c0 2024-09-13T18:43:09.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f3466800640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3460009f10 tx=0x7f3460004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460045660 con 0x7f34681434c0 2024-09-13T18:43:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600457c0 con 0x7f34681434c0 2024-09-13T18:43:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460045b30 con 0x7f34681434c0 2024-09-13T18:43:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f346806f230 con 0x7f34681434c0 2024-09-13T18:43:09.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.390+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346806f7f0 con 0x7f34681434c0 2024-09-13T18:43:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.391+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34680cc7d0 con 0x7f34681434c0 2024-09-13T18:43:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.392+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3460045c90 con 0x7f34681434c0 2024-09-13T18:43:09.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.393+0000 7f345e000640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.393+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f34600aa8b0 con 0x7f34681434c0 2024-09-13T18:43:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.393+0000 7f3465e00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.394+0000 7f3465e00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 0x7f344406d0c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3458000f60 tx=0x7f3458001670 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.397+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3460075da0 con 0x7f34681434c0 2024-09-13T18:43:09.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.564+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3468140c50 con 0x7f34681434c0 2024-09-13T18:43:09.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.568+0000 7f345e000640 1 -- 172.21.15.192:0/3807955994 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f34600400a0 con 0x7f34681434c0 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 msgr2=0x7f344406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 0x7f344406d0c0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3458000f60 tx=0x7f3458001670 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 msgr2=0x7f3468139fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f3460009f10 tx=0x7f3460004a40 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 shutdown_connections 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f344406ac00 0x7f344406d0c0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f34681434c0 0x7f3468139fb0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f34680b3da0 0x7f346806fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 --2- 172.21.15.192:0/3807955994 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f346806c800 0x7f3468071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 >> 172.21.15.192:0/3807955994 conn(0x7f34680b08f0 msgr2=0x7f34680af570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:09.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 shutdown_connections 2024-09-13T18:43:09.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.571+0000 7f346ce00640 1 -- 172.21.15.192:0/3807955994 wait complete. 2024-09-13T18:43:09.589 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2024-09-13T18:43:09.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.740+0000 7f72f8c00640 1 Processor -- start 2024-09-13T18:43:09.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.740+0000 7f72f8c00640 1 -- start start 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f8c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72f40cacd0 0x7f72f415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f8c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f72f40cb0b0 0x7f72f415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f8c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72f4140480 con 0x7f72f4140980 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f8c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f415c160 con 0x7f72f40cacd0 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f8c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f40cb520 con 0x7f72f40cb0b0 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72f40cacd0 0x7f72f415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f72f40cacd0 0x7f72f415e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48656/0 (socket says 172.21.15.192:48656) 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 -- 172.21.15.192:0/1841578041 learned_addr learned my addr 172.21.15.192:0/1841578041 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:09.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72ebe00640 1 --2- 172.21.15.192:0/1841578041 >> v2:172.21.15.194:3300/0 conn(0x7f72f40cb0b0 0x7f72f415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 -- 172.21.15.192:0/1841578041 >> v2:172.21.15.194:3300/0 conn(0x7f72f40cb0b0 msgr2=0x7f72f415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 --2- 172.21.15.192:0/1841578041 >> v2:172.21.15.194:3300/0 conn(0x7f72f40cb0b0 0x7f72f415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 -- 172.21.15.192:0/1841578041 >> v1:172.21.15.192:6789/0 conn(0x7f72f4140980 legacy=0x7f72f40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.742+0000 7f72f1e00640 1 -- 172.21.15.192:0/1841578041 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f415ee90 con 0x7f72f40cacd0 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.743+0000 7f72f1e00640 1 --2- 172.21.15.192:0/1841578041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f40cacd0 0x7f72f415e790 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f72f40ce9e0 tx=0x7f72e402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85aac9bc089bd8ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f1400640 1 -- 172.21.15.192:0/1841578041 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032440 con 0x7f72f40cacd0 2024-09-13T18:43:09.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f1400640 1 -- 172.21.15.192:0/1841578041 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e40325a0 con 0x7f72f40cacd0 2024-09-13T18:43:09.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f1400640 1 -- 172.21.15.192:0/1841578041 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e4032930 con 0x7f72f40cacd0 2024-09-13T18:43:09.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 -- 172.21.15.192:0/1841578041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f40cacd0 msgr2=0x7f72f415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 --2- 172.21.15.192:0/1841578041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f40cacd0 0x7f72f415e790 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f72f40ce9e0 tx=0x7f72e402a270 comp rx=0 tx=0).stop 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 -- 172.21.15.192:0/1841578041 shutdown_connections 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 --2- 172.21.15.192:0/1841578041 >> v2:172.21.15.194:3300/0 conn(0x7f72f40cb0b0 0x7f72f415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 --2- 172.21.15.192:0/1841578041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f40cacd0 0x7f72f415e790 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 -- 172.21.15.192:0/1841578041 >> 172.21.15.192:0/1841578041 conn(0x7f72f40ae960 msgr2=0x7f72f406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 -- 172.21.15.192:0/1841578041 shutdown_connections 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.744+0000 7f72f8c00640 1 -- 172.21.15.192:0/1841578041 wait complete. 2024-09-13T18:43:09.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.746+0000 7f72f8c00640 1 Processor -- start 2024-09-13T18:43:09.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.746+0000 7f72f8c00640 1 -- start start 2024-09-13T18:43:09.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72f40cacd0 0x7f72f4154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72f40cb0b0 0x7f72f40cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f40b2f60 con 0x7f72f4140980 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f40b3240 con 0x7f72f40cb0b0 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f8c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f40b3520 con 0x7f72f40cacd0 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48662/0 (socket says 172.21.15.192:48662) 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f2800640 1 -- 172.21.15.192:0/3089431395 learned_addr learned my addr 172.21.15.192:0/3089431395 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72ebe00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72f40cb0b0 0x7f72f40cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.747+0000 7f72f1e00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72f40cacd0 0x7f72f4154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 -- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72f40cacd0 msgr2=0x7f72f4154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72f40cacd0 0x7f72f4154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 -- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72f40cb0b0 msgr2=0x7f72f40cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72f40cb0b0 0x7f72f40cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:09.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 -- 172.21.15.192:0/3089431395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e40094d0 con 0x7f72f4140980 2024-09-13T18:43:09.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f2800640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c7a0 tx=0x7f72ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec003b70 con 0x7f72f4140980 2024-09-13T18:43:09.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec003cf0 con 0x7f72f4140980 2024-09-13T18:43:09.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f40b3800 con 0x7f72f4140980 2024-09-13T18:43:09.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec003ea0 con 0x7f72f4140980 2024-09-13T18:43:09.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.748+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f40b2b80 con 0x7f72f4140980 2024-09-13T18:43:09.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.749+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f415bc20 con 0x7f72f4140980 2024-09-13T18:43:09.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.750+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f72ec00aa90 con 0x7f72f4140980 2024-09-13T18:43:09.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.752+0000 7f72ea000640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 0x7f72d006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:09.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.752+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f72ec088d20 con 0x7f72f4140980 2024-09-13T18:43:09.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.752+0000 7f72f1e00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 0x7f72d006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:09.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.752+0000 7f72f1e00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 0x7f72d006d0f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:09.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.756+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f72ec0542a0 con 0x7f72f4140980 2024-09-13T18:43:09.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:09.986+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f72f41554a0 con 0x7f72f4140980 2024-09-13T18:43:10.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.199+0000 7f72ea000640 1 -- 172.21.15.192:0/3089431395 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v398) v1 ==== 140+0+0 (secure 0 0 0) 0x7f72ec0578c0 con 0x7f72f4140980 2024-09-13T18:43:10.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 msgr2=0x7f72d006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 0x7f72d006d0f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f72e4034000 tx=0x7f72e402e000 comp rx=0 tx=0).stop 2024-09-13T18:43:10.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 msgr2=0x7f72f40cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00c7a0 tx=0x7f72ec00cc60 comp rx=0 tx=0).stop 2024-09-13T18:43:10.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 shutdown_connections 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f72d006ac30 0x7f72d006d0f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f4140980 0x7f72f40cccb0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f72f40cb0b0 0x7f72f40cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 --2- 172.21.15.192:0/3089431395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f72f40cacd0 0x7f72f4154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 >> 172.21.15.192:0/3089431395 conn(0x7f72f40ae960 msgr2=0x7f72f415cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 shutdown_connections 2024-09-13T18:43:10.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.201+0000 7f72f8c00640 1 -- 172.21.15.192:0/3089431395 wait complete. 2024-09-13T18:43:10.219 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-13T18:43:10.220 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2024-09-13T18:43:10.220 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:10.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.371+0000 7f1e31e00640 1 Processor -- start 2024-09-13T18:43:10.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.372+0000 7f1e31e00640 1 -- start start 2024-09-13T18:43:10.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e31e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e2c15dee0 0x7f1e2c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e31e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1e2c15e2c0 0x7f1e2c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e31e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c0b2f00 con 0x7f1e2c0b3f10 2024-09-13T18:43:10.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e31e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b3150 con 0x7f1e2c15dee0 2024-09-13T18:43:10.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e31e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0b3430 con 0x7f1e2c15e2c0 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1e2c15dee0 0x7f1e2c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2a000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1e2c0b3f10 0x7f1e2c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49032/0 (socket says 172.21.15.192:49032) 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2a000640 1 -- 172.21.15.192:0/405275135 learned_addr learned my addr 172.21.15.192:0/405275135 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2b400640 1 --2- 172.21.15.192:0/405275135 >> v2:172.21.15.194:3300/0 conn(0x7f1e2c15e2c0 0x7f1e2c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2aa00640 1 -- 172.21.15.192:0/405275135 >> v2:172.21.15.194:3300/0 conn(0x7f1e2c15e2c0 msgr2=0x7f1e2c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.373+0000 7f1e2aa00640 1 --2- 172.21.15.192:0/405275135 >> v2:172.21.15.194:3300/0 conn(0x7f1e2c15e2c0 0x7f1e2c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.374+0000 7f1e2aa00640 1 -- 172.21.15.192:0/405275135 >> v1:172.21.15.192:6789/0 conn(0x7f1e2c0b3f10 legacy=0x7f1e2c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.374+0000 7f1e29600640 1 -- 172.21.15.192:0/405275135 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690600761 0 0) 0x7f1e2c0b2f00 con 0x7f1e2c0b3f10 2024-09-13T18:43:10.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.374+0000 7f1e2aa00640 1 -- 172.21.15.192:0/405275135 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c0b3710 con 0x7f1e2c15dee0 2024-09-13T18:43:10.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.374+0000 7f1e2aa00640 1 --2- 172.21.15.192:0/405275135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c0afd80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0cec10 tx=0x7f1e1c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa1bbb9b5d444fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e29600640 1 -- 172.21.15.192:0/405275135 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c032440 con 0x7f1e2c15dee0 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e29600640 1 -- 172.21.15.192:0/405275135 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c0325a0 con 0x7f1e2c15dee0 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e29600640 1 -- 172.21.15.192:0/405275135 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c032930 con 0x7f1e2c15dee0 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 -- 172.21.15.192:0/405275135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 msgr2=0x7f1e2c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 --2- 172.21.15.192:0/405275135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c0afd80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c0cec10 tx=0x7f1e1c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 -- 172.21.15.192:0/405275135 shutdown_connections 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 --2- 172.21.15.192:0/405275135 >> v2:172.21.15.194:3300/0 conn(0x7f1e2c15e2c0 0x7f1e2c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 --2- 172.21.15.192:0/405275135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c0afd80 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 -- 172.21.15.192:0/405275135 >> 172.21.15.192:0/405275135 conn(0x7f1e2c0ae960 msgr2=0x7f1e2c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 -- 172.21.15.192:0/405275135 shutdown_connections 2024-09-13T18:43:10.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.375+0000 7f1e31e00640 1 -- 172.21.15.192:0/405275135 wait complete. 2024-09-13T18:43:10.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.377+0000 7f1e31e00640 1 Processor -- start 2024-09-13T18:43:10.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.377+0000 7f1e31e00640 1 -- start start 2024-09-13T18:43:10.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2c15e2c0 0x7f1e2c13c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e2c13c5a0 0x7f1e2c1527a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c13ca30 con 0x7f1e2c15dee0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c153460 con 0x7f1e2c15e2c0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e31e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c153740 con 0x7f1e2c13c5a0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e2aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59298/0 (socket says 172.21.15.192:59298) 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e2aa00640 1 -- 172.21.15.192:0/817839249 learned_addr learned my addr 172.21.15.192:0/817839249 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e2b400640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e2c13c5a0 0x7f1e2c1527a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.378+0000 7f1e2a000640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2c15e2c0 0x7f1e2c13c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 -- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e2c13c5a0 msgr2=0x7f1e2c1527a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e2c13c5a0 0x7f1e2c1527a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 -- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2c15e2c0 msgr2=0x7f1e2c13c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2c15e2c0 0x7f1e2c13c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 -- 172.21.15.192:0/817839249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c009400 con 0x7f1e2c15dee0 2024-09-13T18:43:10.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e2aa00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c000c00 tx=0x7f1e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c032440 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e1c030ba0 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1c006e10 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c153a20 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.379+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c0a94d0 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.380+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c0afd80 con 0x7f1e2c15dee0 2024-09-13T18:43:10.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.381+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1e1c039040 con 0x7f1e2c15dee0 2024-09-13T18:43:10.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.382+0000 7f1e23400640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 0x7f1e0c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.382+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1e1c0a9b80 con 0x7f1e2c15dee0 2024-09-13T18:43:10.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.382+0000 7f1e2a000640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 0x7f1e0c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.383+0000 7f1e2a000640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 0x7f1e0c06d0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c1f39d0 tx=0x7f1e18007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.386+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1e1c075050 con 0x7f1e2c15dee0 2024-09-13T18:43:10.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.553+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e2c13ce20 con 0x7f1e2c15dee0 2024-09-13T18:43:10.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.554+0000 7f1e23400640 1 -- 172.21.15.192:0/817839249 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+13059 (secure 0 0 0) 0x7f1e1c078670 con 0x7f1e2c15dee0 2024-09-13T18:43:10.557 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:10.557 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":156,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:09.188178+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/3552139706":"2024-09-14T18:43:06.171918+0000","172.21.15.192:6835/3552139706":"2024-09-14T18:43:06.171918+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 msgr2=0x7f1e0c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 0x7f1e0c06d0c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c1f39d0 tx=0x7f1e18007b50 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 msgr2=0x7f1e2c13e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c000c00 tx=0x7f1e1c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 shutdown_connections 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1e0c06ac00 0x7f1e0c06d0c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1e2c13c5a0 0x7f1e2c1527a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1e2c15e2c0 0x7f1e2c13c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 --2- 172.21.15.192:0/817839249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1e2c15dee0 0x7f1e2c13e320 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 >> 172.21.15.192:0/817839249 conn(0x7f1e2c0ae960 msgr2=0x7f1e2c15a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:10.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 shutdown_connections 2024-09-13T18:43:10.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.556+0000 7f1e31e00640 1 -- 172.21.15.192:0/817839249 wait complete. 2024-09-13T18:43:10.575 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:43:10.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:10.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.727+0000 7fdad3200640 1 Processor -- start 2024-09-13T18:43:10.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.727+0000 7fdad3200640 1 -- start start 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.728+0000 7fdad3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.728+0000 7fdad3200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdacc06a8b0 0x7fdacc0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdad3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdacc06b480 con 0x7fdacc0b3bd0 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdad3200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdacc0b4060 con 0x7fdacc06a8b0 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdad3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc0ce770 con 0x7fdacc1434c0 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdac3400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fdacc06a8b0 0x7fdacc0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:47796/0 (socket says 172.21.15.192:47796) 2024-09-13T18:43:10.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.729+0000 7fdacbe00640 1 -- 172.21.15.192:0/3725134772 learned_addr learned my addr 172.21.15.192:0/3725134772 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:10.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.730+0000 7fdacbe00640 1 -- 172.21.15.192:0/3725134772 >> v2:172.21.15.194:3300/0 conn(0x7fdacc06a8b0 msgr2=0x7fdacc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:10.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.730+0000 7fdacbe00640 1 --2- 172.21.15.192:0/3725134772 >> v2:172.21.15.194:3300/0 conn(0x7fdacc06a8b0 0x7fdacc0b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.730+0000 7fdacbe00640 1 -- 172.21.15.192:0/3725134772 >> v1:172.21.15.194:6789/0 conn(0x7fdacc0b3bd0 legacy=0x7fdacc06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.730+0000 7fdacb400640 1 -- 172.21.15.192:0/3725134772 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 888499054 0 0) 0x7fdacc06b480 con 0x7fdacc0b3bd0 2024-09-13T18:43:10.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.730+0000 7fdacbe00640 1 -- 172.21.15.192:0/3725134772 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc06b760 con 0x7fdacc1434c0 2024-09-13T18:43:10.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.731+0000 7fdacbe00640 1 --2- 172.21.15.192:0/3725134772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0098a0 tx=0x7fdabc02a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5da27899b4af1129 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.731+0000 7fdacb400640 1 -- 172.21.15.192:0/3725134772 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc032440 con 0x7fdacc1434c0 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.731+0000 7fdacb400640 1 -- 172.21.15.192:0/3725134772 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdabc0325a0 con 0x7fdacc1434c0 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.731+0000 7fdacb400640 1 -- 172.21.15.192:0/3725134772 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdabc032930 con 0x7fdacc1434c0 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 -- 172.21.15.192:0/3725134772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 msgr2=0x7fdacc06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 --2- 172.21.15.192:0/3725134772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0098a0 tx=0x7fdabc02a290 comp rx=0 tx=0).stop 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 -- 172.21.15.192:0/3725134772 shutdown_connections 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 --2- 172.21.15.192:0/3725134772 >> v2:172.21.15.194:3300/0 conn(0x7fdacc06a8b0 0x7fdacc0b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 --2- 172.21.15.192:0/3725134772 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc1434c0 0x7fdacc06c800 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 -- 172.21.15.192:0/3725134772 >> 172.21.15.192:0/3725134772 conn(0x7fdacc0b08f0 msgr2=0x7fdacc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 -- 172.21.15.192:0/3725134772 shutdown_connections 2024-09-13T18:43:10.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.732+0000 7fdad3200640 1 -- 172.21.15.192:0/3725134772 wait complete. 2024-09-13T18:43:10.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.733+0000 7fdad3200640 1 Processor -- start 2024-09-13T18:43:10.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.734+0000 7fdad3200640 1 -- start start 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.734+0000 7fdad3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc06a8b0 0x7fdacc15c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.734+0000 7fdad3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdacc0b3bd0 0x7fdacc13acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc13b230 con 0x7fdacc1434c0 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc159c90 con 0x7fdacc0b3bd0 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc13b460 con 0x7fdacc06a8b0 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdacbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc06a8b0 0x7fdacc15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdac3400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdacc0b3bd0 0x7fdacc13acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59312/0 (socket says 172.21.15.192:59312) 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 -- 172.21.15.192:0/1132360581 learned_addr learned my addr 172.21.15.192:0/1132360581 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 -- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc06a8b0 msgr2=0x7fdacc15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc06a8b0 0x7fdacc15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 -- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdacc0b3bd0 msgr2=0x7fdacc13acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdacc0b3bd0 0x7fdacc13acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.735+0000 7fdad1200640 1 -- 172.21.15.192:0/1132360581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc0094d0 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdad1200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdac4001560 tx=0x7fdac400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4003da0 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4005070 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4005420 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdacc13b740 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.736+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdacc15a1c0 con 0x7fdacc1434c0 2024-09-13T18:43:10.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.737+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdacc15a3e0 con 0x7fdacc1434c0 2024-09-13T18:43:10.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.738+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdac4005580 con 0x7fdacc1434c0 2024-09-13T18:43:10.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.739+0000 7fdac8c00640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 0x7fdaa806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:10.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.739+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdac4088930 con 0x7fdacc1434c0 2024-09-13T18:43:10.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.739+0000 7fdacbe00640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 0x7fdaa806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:10.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.740+0000 7fdacbe00640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 0x7fdaa806d0c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdabc034000 tx=0x7fdabc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:10.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.743+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdac4053da0 con 0x7fdacc1434c0 2024-09-13T18:43:10.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.909+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdacc06acf0 con 0x7fdacc1434c0 2024-09-13T18:43:10.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.910+0000 7fdac8c00640 1 -- 172.21.15.192:0/1132360581 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v156) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdac40170a0 con 0x7fdacc1434c0 2024-09-13T18:43:10.913 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 msgr2=0x7fdaa806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 0x7fdaa806d0c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fdabc034000 tx=0x7fdabc02e000 comp rx=0 tx=0).stop 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 msgr2=0x7fdacc15cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdac4001560 tx=0x7fdac400cc70 comp rx=0 tx=0).stop 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 shutdown_connections 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdaa806ac00 0x7fdaa806d0c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdacc1434c0 0x7fdacc15cec0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdacc0b3bd0 0x7fdacc13acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 --2- 172.21.15.192:0/1132360581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdacc06a8b0 0x7fdacc15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:10.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 >> 172.21.15.192:0/1132360581 conn(0x7fdacc0b08f0 msgr2=0x7fdacc1555e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:10.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 shutdown_connections 2024-09-13T18:43:10.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:10.912+0000 7fdad3200640 1 -- 172.21.15.192:0/1132360581 wait complete. 2024-09-13T18:43:10.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-13T18:43:11.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.081+0000 7f28f8e00640 1 Processor -- start 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.081+0000 7f28f8e00640 1 -- start start 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f8e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f28f40cda20 0x7f28f4157380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f8e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28f41578c0 0x7f28f415c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f8e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f415bcf0 con 0x7f28f40cd640 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f8e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f415b0e0 con 0x7f28f41578c0 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f8e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f415b3c0 con 0x7f28f40cda20 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28f41578c0 0x7f28f415c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f28f41578c0 0x7f28f415c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59314/0 (socket says 172.21.15.192:59314) 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f3e00640 1 -- 172.21.15.192:0/2439262948 learned_addr learned my addr 172.21.15.192:0/2439262948 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:11.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.082+0000 7f28f2a00640 1 --2- 172.21.15.192:0/2439262948 >> v2:172.21.15.194:3300/0 conn(0x7f28f40cda20 0x7f28f4157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.083+0000 7f28f3e00640 1 -- 172.21.15.192:0/2439262948 >> v2:172.21.15.194:3300/0 conn(0x7f28f40cda20 msgr2=0x7f28f4157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.083+0000 7f28f3e00640 1 --2- 172.21.15.192:0/2439262948 >> v2:172.21.15.194:3300/0 conn(0x7f28f40cda20 0x7f28f4157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.083+0000 7f28f3e00640 1 -- 172.21.15.192:0/2439262948 >> v1:172.21.15.194:6789/0 conn(0x7f28f40cd640 legacy=0x7f28f415a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.083+0000 7f28f3e00640 1 -- 172.21.15.192:0/2439262948 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f415b6a0 con 0x7f28f41578c0 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f3e00640 1 --2- 172.21.15.192:0/2439262948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f41578c0 0x7f28f415c180 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f28f415b010 tx=0x7f28ec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1a7f6602dac87c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f2000640 1 -- 172.21.15.192:0/2439262948 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec032440 con 0x7f28f41578c0 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f2000640 1 -- 172.21.15.192:0/2439262948 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec0325a0 con 0x7f28f41578c0 2024-09-13T18:43:11.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f2000640 1 -- 172.21.15.192:0/2439262948 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec032930 con 0x7f28f41578c0 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 -- 172.21.15.192:0/2439262948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f41578c0 msgr2=0x7f28f415c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 --2- 172.21.15.192:0/2439262948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f41578c0 0x7f28f415c180 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f28f415b010 tx=0x7f28ec02a270 comp rx=0 tx=0).stop 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 -- 172.21.15.192:0/2439262948 shutdown_connections 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 --2- 172.21.15.192:0/2439262948 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f41578c0 0x7f28f415c180 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 --2- 172.21.15.192:0/2439262948 >> v2:172.21.15.194:3300/0 conn(0x7f28f40cda20 0x7f28f4157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:11.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.084+0000 7f28f8e00640 1 -- 172.21.15.192:0/2439262948 >> 172.21.15.192:0/2439262948 conn(0x7f28f40b09f0 msgr2=0x7f28f40b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.085+0000 7f28f8e00640 1 -- 172.21.15.192:0/2439262948 shutdown_connections 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.085+0000 7f28f8e00640 1 -- 172.21.15.192:0/2439262948 wait complete. 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.086+0000 7f28f8e00640 1 Processor -- start 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.086+0000 7f28f8e00640 1 -- start start 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28f40cd640 0x7f28f41672f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 0x7f28f414cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4155f90 con 0x7f28f414dc50 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4156540 con 0x7f28f40cda20 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f8e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f4166250 con 0x7f28f40cd640 2024-09-13T18:43:11.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59320/0 (socket says 172.21.15.192:59320) 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f3e00640 1 -- 172.21.15.192:0/447352305 learned_addr learned my addr 172.21.15.192:0/447352305 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.087+0000 7f28f3400640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28f40cd640 0x7f28f41672f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f2a00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 0x7f28f414cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 -- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28f40cd640 msgr2=0x7f28f41672f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28f40cd640 0x7f28f41672f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 -- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 msgr2=0x7f28f414cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 0x7f28f414cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 -- 172.21.15.192:0/447352305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0094d0 con 0x7f28f414dc50 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f2a00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 0x7f28f414cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f3e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0090b0 tx=0x7f28ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:11.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03d830 con 0x7f28f414dc50 2024-09-13T18:43:11.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ec03d9b0 con 0x7f28f414dc50 2024-09-13T18:43:11.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ec03dd60 con 0x7f28f414dc50 2024-09-13T18:43:11.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f4166530 con 0x7f28f414dc50 2024-09-13T18:43:11.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.088+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f4166af0 con 0x7f28f414dc50 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.090+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28f4157380 con 0x7f28f414dc50 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.090+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28ec039040 con 0x7f28f414dc50 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.091+0000 7f28eb400640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.091+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f28ec0a9ae0 con 0x7f28f414dc50 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.091+0000 7f28f3400640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:11.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.092+0000 7f28f3400640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 0x7f28d406d0c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f28e40012e0 tx=0x7f28e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:11.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.095+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28ec074fc0 con 0x7f28f414dc50 2024-09-13T18:43:11.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:11.324+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f28f40afe30 con 0x7f28f414dc50 2024-09-13T18:43:12.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.208+0000 7f28eb400640 1 -- 172.21.15.192:0/447352305 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v400) v1 ==== 135+0+0 (secure 0 0 0) 0x7f28ec0785e0 con 0x7f28f414dc50 2024-09-13T18:43:12.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 msgr2=0x7f28d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 0x7f28d406d0c0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f28e40012e0 tx=0x7f28e4009040 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 msgr2=0x7f28f4158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0090b0 tx=0x7f28ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 shutdown_connections 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28d406ac00 0x7f28d406d0c0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28f414dc50 0x7f28f4158e30 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28f40cda20 0x7f28f414cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 --2- 172.21.15.192:0/447352305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28f40cd640 0x7f28f41672f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 >> 172.21.15.192:0/447352305 conn(0x7f28f40b09f0 msgr2=0x7f28f40aec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 shutdown_connections 2024-09-13T18:43:12.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.211+0000 7f28f8e00640 1 -- 172.21.15.192:0/447352305 wait complete. 2024-09-13T18:43:12.233 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:43:12.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.405+0000 7f431be00640 1 Processor -- start 2024-09-13T18:43:12.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.405+0000 7f431be00640 1 -- start start 2024-09-13T18:43:12.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f431c156c10 0x7f431c0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:12.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431be00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431c0b2620 con 0x7f431c15d550 2024-09-13T18:43:12.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431be00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f431c0b2900 con 0x7f431c156ff0 2024-09-13T18:43:12.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431be00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f431c0b2be0 con 0x7f431c156c10 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f431c156c10 0x7f431c0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f431c15d550 0x7f431c15aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49042/0 (socket says 172.21.15.192:49042) 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.406+0000 7f431b400640 1 -- 172.21.15.192:0/36633225 learned_addr learned my addr 172.21.15.192:0/36633225 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.407+0000 7f431aa00640 1 -- 172.21.15.192:0/36633225 >> v1:172.21.15.194:6789/0 conn(0x7f431c156ff0 legacy=0x7f431c15ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.407+0000 7f431aa00640 1 -- 172.21.15.192:0/36633225 >> v1:172.21.15.192:6789/0 conn(0x7f431c15d550 legacy=0x7f431c15aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.407+0000 7f431aa00640 1 -- 172.21.15.192:0/36633225 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c0b2ec0 con 0x7f431c156c10 2024-09-13T18:43:12.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f431aa00640 1 --2- 172.21.15.192:0/36633225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c0b1b80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097d0 tx=0x7f430c02c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741b78d81ec935c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:12.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f4319600640 1 -- 172.21.15.192:0/36633225 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c034640 con 0x7f431c156c10 2024-09-13T18:43:12.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f4319600640 1 -- 172.21.15.192:0/36633225 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c0347a0 con 0x7f431c156c10 2024-09-13T18:43:12.411 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f4319600640 1 -- 172.21.15.192:0/36633225 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c034b30 con 0x7f431c156c10 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f431be00640 1 -- 172.21.15.192:0/36633225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 msgr2=0x7f431c0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.408+0000 7f431be00640 1 --2- 172.21.15.192:0/36633225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c0b1b80 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f430c0097d0 tx=0x7f430c02c3d0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.409+0000 7f431be00640 1 -- 172.21.15.192:0/36633225 shutdown_connections 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.409+0000 7f431be00640 1 --2- 172.21.15.192:0/36633225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c0b1b80 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.409+0000 7f431be00640 1 -- 172.21.15.192:0/36633225 >> 172.21.15.192:0/36633225 conn(0x7f431c0ae7f0 msgr2=0x7f431c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.409+0000 7f431be00640 1 -- 172.21.15.192:0/36633225 shutdown_connections 2024-09-13T18:43:12.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.409+0000 7f431be00640 1 -- 172.21.15.192:0/36633225 wait complete. 2024-09-13T18:43:12.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.410+0000 7f431be00640 1 Processor -- start 2024-09-13T18:43:12.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.410+0000 7f431be00640 1 -- start start 2024-09-13T18:43:12.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f431c156ff0 0x7f431c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f431c15d550 0x7f431c1557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c14c8a0 con 0x7f431c156c10 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f431c0c6000 con 0x7f431c156ff0 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.411+0000 7f431be00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f431c153af0 con 0x7f431c15d550 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59342/0 (socket says 172.21.15.192:59342) 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 -- 172.21.15.192:0/2101785726 learned_addr learned my addr 172.21.15.192:0/2101785726 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431a000640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f431c156ff0 0x7f431c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431b400640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f431c15d550 0x7f431c1557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:12.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 -- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f431c15d550 msgr2=0x7f431c1557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f431c15d550 0x7f431c1557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 -- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f431c156ff0 msgr2=0x7f431c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f431c156ff0 0x7f431c155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 -- 172.21.15.192:0/2101785726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c009400 con 0x7f431c156c10 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f431aa00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098f0 tx=0x7f430c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.412+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c032b80 con 0x7f431c156c10 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.413+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430c032d00 con 0x7f431c156c10 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.413+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c03e640 con 0x7f431c156c10 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.413+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f431c153dd0 con 0x7f431c156c10 2024-09-13T18:43:12.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.413+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f431c154390 con 0x7f431c156c10 2024-09-13T18:43:12.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.414+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f431c15ce40 con 0x7f431c156c10 2024-09-13T18:43:12.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.414+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f430c03e7a0 con 0x7f431c156c10 2024-09-13T18:43:12.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.415+0000 7f4312a00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 0x7f42fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:12.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.415+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f430c034e40 con 0x7f431c156c10 2024-09-13T18:43:12.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.416+0000 7f431a000640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 0x7f42fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:12.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.416+0000 7f431a000640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 0x7f42fc06d0c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f431c1529e0 tx=0x7f4308009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:12.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.420+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f430c075620 con 0x7f431c156c10 2024-09-13T18:43:12.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.587+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f431c0b3d60 con 0x7f431c156c10 2024-09-13T18:43:12.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.591+0000 7f4312a00640 1 -- 172.21.15.192:0/2101785726 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f430c078c40 con 0x7f431c156c10 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 msgr2=0x7f42fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 0x7f42fc06d0c0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f431c1529e0 tx=0x7f4308009040 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 msgr2=0x7f431c14c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098f0 tx=0x7f430c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 shutdown_connections 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f42fc06ac00 0x7f42fc06d0c0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f431c15d550 0x7f431c1557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f431c156ff0 0x7f431c155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 --2- 172.21.15.192:0/2101785726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f431c156c10 0x7f431c14c360 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 >> 172.21.15.192:0/2101785726 conn(0x7f431c0ae7f0 msgr2=0x7f431c158640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:12.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 shutdown_connections 2024-09-13T18:43:12.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:12.594+0000 7f431be00640 1 -- 172.21.15.192:0/2101785726 wait complete. 2024-09-13T18:43:12.613 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:43:12.613 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:43:12.702 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:43:12.789 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:43:12.789 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:43:12.789 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:12.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:43:12.826 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:43:12.826 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:12.864 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:43:12.864 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:43:12.864 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:12.903 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:43:12.903 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:43:12.903 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:12.943 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:43:12.943 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:43:12.943 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:13.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.096+0000 7f75f4600640 1 Processor -- start 2024-09-13T18:43:13.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.096+0000 7f75f4600640 1 -- start start 2024-09-13T18:43:13.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.097+0000 7f75f4600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f75ec0b0490 0x7f75ec0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.097+0000 7f75f4600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec15ec00 con 0x7f75ec0cacd0 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.097+0000 7f75f4600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75ec140480 con 0x7f75ec15e790 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.097+0000 7f75f4600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75ec0cb5f0 con 0x7f75ec0b0490 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f1c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f75ec0cacd0 0x7f75ec140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49052/0 (socket says 172.21.15.192:49052) 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f1c00640 1 -- 172.21.15.192:0/2622491331 learned_addr learned my addr 172.21.15.192:0/2622491331 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:13.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f2600640 1 --2- 172.21.15.192:0/2622491331 >> v2:172.21.15.192:3300/0 conn(0x7f75ec0b0490 0x7f75ec0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f2600640 1 -- 172.21.15.192:0/2622491331 >> v1:172.21.15.194:6789/0 conn(0x7f75ec15e790 legacy=0x7f75ec0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f2600640 1 -- 172.21.15.192:0/2622491331 >> v1:172.21.15.192:6789/0 conn(0x7f75ec0cacd0 legacy=0x7f75ec140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.098+0000 7f75f2600640 1 -- 172.21.15.192:0/2622491331 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec15ee90 con 0x7f75ec0b0490 2024-09-13T18:43:13.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.099+0000 7f75f2600640 1 --2- 172.21.15.192:0/2622491331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec0b0490 0x7f75ec0cb0b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009d90 tx=0x7f75e402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442bd3c1a20886f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.099+0000 7f75ebe00640 1 -- 172.21.15.192:0/2622491331 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4007740 con 0x7f75ec0b0490 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.099+0000 7f75ebe00640 1 -- 172.21.15.192:0/2622491331 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e402d050 con 0x7f75ec0b0490 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.099+0000 7f75ebe00640 1 -- 172.21.15.192:0/2622491331 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4007ac0 con 0x7f75ec0b0490 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 -- 172.21.15.192:0/2622491331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec0b0490 msgr2=0x7f75ec0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 --2- 172.21.15.192:0/2622491331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec0b0490 0x7f75ec0cb0b0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009d90 tx=0x7f75e402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 -- 172.21.15.192:0/2622491331 shutdown_connections 2024-09-13T18:43:13.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 --2- 172.21.15.192:0/2622491331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec0b0490 0x7f75ec0cb0b0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 -- 172.21.15.192:0/2622491331 >> 172.21.15.192:0/2622491331 conn(0x7f75ec0ae960 msgr2=0x7f75ec06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:13.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 -- 172.21.15.192:0/2622491331 shutdown_connections 2024-09-13T18:43:13.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.100+0000 7f75f4600640 1 -- 172.21.15.192:0/2622491331 wait complete. 2024-09-13T18:43:13.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.102+0000 7f75f4600640 1 Processor -- start 2024-09-13T18:43:13.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.102+0000 7f75f4600640 1 -- start start 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.102+0000 7f75f4600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75ec0b0490 0x7f75ec0b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f4600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75ec0cacd0 0x7f75ec1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f4600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f4600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0b3dc0 con 0x7f75ec15e790 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f4600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0b40a0 con 0x7f75ec0cacd0 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f4600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75ec0b4380 con 0x7f75ec0b0490 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59352/0 (socket says 172.21.15.192:59352) 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 -- 172.21.15.192:0/3355924451 learned_addr learned my addr 172.21.15.192:0/3355924451 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f1c00640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75ec0b0490 0x7f75ec0b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f1200640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75ec0cacd0 0x7f75ec1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 -- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75ec0b0490 msgr2=0x7f75ec0b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75ec0b0490 0x7f75ec0b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 -- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75ec0cacd0 msgr2=0x7f75ec1f5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75ec0cacd0 0x7f75ec1f5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.103+0000 7f75f2600640 1 -- 172.21.15.192:0/3355924451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e4009a70 con 0x7f75ec15e790 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75f2600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009eb0 tx=0x7f75e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4031910 con 0x7f75ec15e790 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4031a70 con 0x7f75ec15e790 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4031de0 con 0x7f75ec15e790 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75ec0b4660 con 0x7f75ec15e790 2024-09-13T18:43:13.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.104+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75ec0b3a00 con 0x7f75ec15e790 2024-09-13T18:43:13.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.105+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75ec0b4b80 con 0x7f75ec15e790 2024-09-13T18:43:13.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.106+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75e403b410 con 0x7f75ec15e790 2024-09-13T18:43:13.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.107+0000 7f75e9600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.107+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75e40aa950 con 0x7f75ec15e790 2024-09-13T18:43:13.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.107+0000 7f75f1c00640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.107+0000 7f75f1c00640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 0x7f75cc06d0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005880 tx=0x7f75e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.111+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75ec0b4b80 con 0x7f75ec15e790 2024-09-13T18:43:13.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.312+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75ec0b4b80 con 0x7f75ec15e790 2024-09-13T18:43:13.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.313+0000 7f75e9600640 1 -- 172.21.15.192:0/3355924451 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f75ec0b4b80 con 0x7f75ec15e790 2024-09-13T18:43:13.316 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:13.316 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":64,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6467,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/4291634851","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":4291634851},{"type":"v1","addr":"172.21.15.194:6834","nonce":4291634851}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7270,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/2411084494","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":2411084494},{"type":"v1","addr":"172.21.15.192:6836","nonce":2411084494}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":7279,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/928319241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":928319241},{"type":"v1","addr":"172.21.15.194:6835","nonce":928319241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":58},{"gid":8076,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/746447684","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":746447684},{"type":"v1","addr":"172.21.15.192:6837","nonce":746447684}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":64}],"filesystems":[]} 2024-09-13T18:43:13.316 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 64 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 msgr2=0x7f75cc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 0x7f75cc06d0c0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005880 tx=0x7f75e0009040 comp rx=0 tx=0).stop 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 msgr2=0x7f75ec13f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f75e4009eb0 tx=0x7f75e4004a40 comp rx=0 tx=0).stop 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 shutdown_connections 2024-09-13T18:43:13.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75cc06ac00 0x7f75cc06d0c0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75ec15e790 0x7f75ec13f600 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75ec0cacd0 0x7f75ec1f5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 --2- 172.21.15.192:0/3355924451 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75ec0b0490 0x7f75ec0b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 >> 172.21.15.192:0/3355924451 conn(0x7f75ec0ae960 msgr2=0x7f75ec0716d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 shutdown_connections 2024-09-13T18:43:13.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.315+0000 7f75f4600640 1 -- 172.21.15.192:0/3355924451 wait complete. 2024-09-13T18:43:13.338 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:43:13.338 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:43:13.338 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:43:13.338 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:43:13.338 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:43:13.338 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:43:13.339 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:43:13.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:43:13.339 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:43:13.339 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:43:13.339 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:43:13.339 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:43:13.339 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:43:13.339 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:43:13.340 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:43:13.340 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:43:13.352 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:43:13.353 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:43:13.354 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:43:13.354 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:43:13.355 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:43:13.355 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:43:13.356 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:43:13.356 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:43:13.398 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:43:13.398 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:13.400 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:43:13.400 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:13.401 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:43:13.402 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:13.404 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:43:13.404 DEBUG:teuthology.parallel:result is None 2024-09-13T18:43:13.405 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:43:13.527 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:43:13.533 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:43:13.535 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:43:13.551 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:43:13.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.569+0000 7f2d02400640 1 Processor -- start 2024-09-13T18:43:13.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.569+0000 7f2d02400640 1 -- start start 2024-09-13T18:43:13.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2d02400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2d02400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc1469f0 con 0x7f2cfc0ae200 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2d02400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cfc0ae9c0 con 0x7f2cfc0737b0 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2d02400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0b4270 con 0x7f2cfc146610 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2cfbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2cfc0ae200 0x7f2cfc0730a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49072/0 (socket says 172.21.15.192:49072) 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2cfbe00640 1 -- 172.21.15.192:0/3478488258 learned_addr learned my addr 172.21.15.192:0/3478488258 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.570+0000 7f2d01000640 1 --2- 172.21.15.192:0/3478488258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1161302647 0 0) 0x7f2cfc1469f0 con 0x7f2cfc0ae200 2024-09-13T18:43:13.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce4003520 con 0x7f2cfc0ae200 2024-09-13T18:43:13.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2531655604 0 0) 0x7f2ce4003520 con 0x7f2cfc0ae200 2024-09-13T18:43:13.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2d01000640 1 -- 172.21.15.192:0/3478488258 >> v1:172.21.15.194:6789/0 conn(0x7f2cfc0737b0 legacy=0x7f2cfc06c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2d01000640 1 -- 172.21.15.192:0/3478488258 >> v1:172.21.15.192:6789/0 conn(0x7f2cfc0ae200 legacy=0x7f2cfc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.571+0000 7f2d01000640 1 -- 172.21.15.192:0/3478488258 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cfc0aeca0 con 0x7f2cfc146610 2024-09-13T18:43:13.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.572+0000 7f2d01000640 1 --2- 172.21.15.192:0/3478488258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0b3d30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097d0 tx=0x7f2cf002a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f921c2044a321b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.572+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8001670 con 0x7f2cfc146610 2024-09-13T18:43:13.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.572+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf002acc0 con 0x7f2cfc146610 2024-09-13T18:43:13.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.572+0000 7f2cfb400640 1 -- 172.21.15.192:0/3478488258 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0032660 con 0x7f2cfc146610 2024-09-13T18:43:13.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 -- 172.21.15.192:0/3478488258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 msgr2=0x7f2cfc0b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 --2- 172.21.15.192:0/3478488258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0b3d30 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00097d0 tx=0x7f2cf002a230 comp rx=0 tx=0).stop 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 -- 172.21.15.192:0/3478488258 shutdown_connections 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 --2- 172.21.15.192:0/3478488258 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0b3d30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 -- 172.21.15.192:0/3478488258 >> 172.21.15.192:0/3478488258 conn(0x7f2cfc06a080 msgr2=0x7f2cfc06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 -- 172.21.15.192:0/3478488258 shutdown_connections 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.573+0000 7f2d02400640 1 -- 172.21.15.192:0/3478488258 wait complete. 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.575+0000 7f2d02400640 1 Processor -- start 2024-09-13T18:43:13.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.575+0000 7f2d02400640 1 -- start start 2024-09-13T18:43:13.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0ae200 0x7f2cfc0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c53d0 con 0x7f2cfc0737b0 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c5f50 con 0x7f2cfc0ae200 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d02400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cfc0c8950 con 0x7f2cfc146610 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d01000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d01000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59384/0 (socket says 172.21.15.192:59384) 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d01000640 1 -- 172.21.15.192:0/1965610210 learned_addr learned my addr 172.21.15.192:0/1965610210 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2cfbe00640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0ae200 0x7f2cfc0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.576+0000 7f2d01a00640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 -- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 msgr2=0x7f2cfc0cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 -- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0ae200 msgr2=0x7f2cfc0c6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0ae200 0x7f2cfc0c6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 -- 172.21.15.192:0/1965610210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf0009400 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d01000640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0035040 tx=0x7f2cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf003c820 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cf003c980 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cfc1f6b60 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.577+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf003cd30 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.578+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cfc0c55b0 con 0x7f2cfc0737b0 2024-09-13T18:43:13.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.579+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cfc0ae620 con 0x7f2cfc0737b0 2024-09-13T18:43:13.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.579+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2cf0039050 con 0x7f2cfc0737b0 2024-09-13T18:43:13.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.580+0000 7f2cf8c00640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 0x7f2cdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:13.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.580+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2cf00a9840 con 0x7f2cfc0737b0 2024-09-13T18:43:13.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.581+0000 7f2cfbe00640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 0x7f2cdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:13.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.581+0000 7f2cfbe00640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 0x7f2cdc06d0c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc073e10 tx=0x7f2ce8001dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:13.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.585+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2cfc0ae620 con 0x7f2cfc0737b0 2024-09-13T18:43:13.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:13.768+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2cfc0ae620 con 0x7f2cfc0737b0 2024-09-13T18:43:14.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.601+0000 7f2cf8c00640 1 -- 172.21.15.192:0/1965610210 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v161) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2cfc0ae620 con 0x7f2cfc0737b0 2024-09-13T18:43:14.604 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 msgr2=0x7f2cdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 0x7f2cdc06d0c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc073e10 tx=0x7f2ce8001dc0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 msgr2=0x7f2cfc160030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0035040 tx=0x7f2cf00046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 shutdown_connections 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2cdc06ac00 0x7f2cdc06d0c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2cfc146610 0x7f2cfc0cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2cfc0ae200 0x7f2cfc0c6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 --2- 172.21.15.192:0/1965610210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2cfc0737b0 0x7f2cfc160030 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 >> 172.21.15.192:0/1965610210 conn(0x7f2cfc06a080 msgr2=0x7f2cfc0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:14.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 shutdown_connections 2024-09-13T18:43:14.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.604+0000 7f2d02400640 1 -- 172.21.15.192:0/1965610210 wait complete. 2024-09-13T18:43:14.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:43:14.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.773+0000 7fa232200640 1 Processor -- start 2024-09-13T18:43:14.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.774+0000 7fa232200640 1 -- start start 2024-09-13T18:43:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.775+0000 7fa232200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa22c156e30 0x7fa22c157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:14.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.775+0000 7fa232200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0b3c90 con 0x7fa22c0adf50 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.775+0000 7fa232200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa22c0b3110 con 0x7fa22c161210 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.775+0000 7fa232200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa22c157750 con 0x7fa22c156e30 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa22c156e30 0x7fa22c157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa22c156e30 0x7fa22c157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59394/0 (socket says 172.21.15.192:59394) 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa231800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa22c0adf50 0x7fa22c15d5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49084/0 (socket says 172.21.15.192:49084) 2024-09-13T18:43:14.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 -- 172.21.15.192:0/3268802652 learned_addr learned my addr 172.21.15.192:0/3268802652 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 -- 172.21.15.192:0/3268802652 >> v1:172.21.15.194:6789/0 conn(0x7fa22c161210 legacy=0x7fa22c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 -- 172.21.15.192:0/3268802652 >> v1:172.21.15.192:6789/0 conn(0x7fa22c0adf50 legacy=0x7fa22c15d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa230e00640 1 -- 172.21.15.192:0/3268802652 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa22c0b33f0 con 0x7fa22c156e30 2024-09-13T18:43:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.776+0000 7fa22b400640 1 -- 172.21.15.192:0/3268802652 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489242267 0 0) 0x7fa22c0b3c90 con 0x7fa22c0adf50 2024-09-13T18:43:14.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.777+0000 7fa230e00640 1 --2- 172.21.15.192:0/3268802652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c156e30 0x7fa22c157210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009870 tx=0x7fa21c02a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8b372ca77d1bb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.777+0000 7fa22b400640 1 -- 172.21.15.192:0/3268802652 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c032640 con 0x7fa22c156e30 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.777+0000 7fa22b400640 1 -- 172.21.15.192:0/3268802652 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c0327a0 con 0x7fa22c156e30 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.777+0000 7fa22b400640 1 -- 172.21.15.192:0/3268802652 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c032b30 con 0x7fa22c156e30 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 -- 172.21.15.192:0/3268802652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c156e30 msgr2=0x7fa22c157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 --2- 172.21.15.192:0/3268802652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c156e30 0x7fa22c157210 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fa21c009870 tx=0x7fa21c02a300 comp rx=0 tx=0).stop 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 -- 172.21.15.192:0/3268802652 shutdown_connections 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 --2- 172.21.15.192:0/3268802652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c156e30 0x7fa22c157210 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 -- 172.21.15.192:0/3268802652 >> 172.21.15.192:0/3268802652 conn(0x7fa22c0736d0 msgr2=0x7fa22c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:14.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 -- 172.21.15.192:0/3268802652 shutdown_connections 2024-09-13T18:43:14.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.778+0000 7fa232200640 1 -- 172.21.15.192:0/3268802652 wait complete. 2024-09-13T18:43:14.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.780+0000 7fa232200640 1 Processor -- start 2024-09-13T18:43:14.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.780+0000 7fa232200640 1 -- start start 2024-09-13T18:43:14.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:14.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22c156e30 0x7fa22c15ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:14.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa22c161210 0x7fa22c144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c143da0 con 0x7fa22c0adf50 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c1f3060 con 0x7fa22c156e30 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa232200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa22c1436e0 con 0x7fa22c161210 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59396/0 (socket says 172.21.15.192:59396) 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 -- 172.21.15.192:0/120379319 learned_addr learned my addr 172.21.15.192:0/120379319 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa22be00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22c156e30 0x7fa22c15ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa231800640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa22c161210 0x7fa22c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 -- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa22c161210 msgr2=0x7fa22c144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa22c161210 0x7fa22c144b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 -- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22c156e30 msgr2=0x7fa22c15ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22c156e30 0x7fa22c15ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:14.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.781+0000 7fa230e00640 1 -- 172.21.15.192:0/120379319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21c0094d0 con 0x7fa22c0adf50 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa230e00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0090b0 tx=0x7fa21c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c004230 con 0x7fa22c0adf50 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa21c004390 con 0x7fa22c0adf50 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa21c03e960 con 0x7fa22c0adf50 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa22c1439c0 con 0x7fa22c0adf50 2024-09-13T18:43:14.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.782+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa22c1443a0 con 0x7fa22c0adf50 2024-09-13T18:43:14.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.783+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa22c143520 con 0x7fa22c0adf50 2024-09-13T18:43:14.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.784+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa21c03eac0 con 0x7fa22c0adf50 2024-09-13T18:43:14.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.785+0000 7fa228c00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 0x7fa20c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:14.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.785+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa21c0aa570 con 0x7fa22c0adf50 2024-09-13T18:43:14.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.785+0000 7fa22be00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 0x7fa20c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:14.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.785+0000 7fa22be00640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 0x7fa20c06d0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0cb060 tx=0x7fa218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:14.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:14.788+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa21c075bb0 con 0x7fa22c0adf50 2024-09-13T18:43:15.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.017+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fa22c0b2d70 con 0x7fa22c0adf50 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.018+0000 7fa228c00640 1 -- 172.21.15.192:0/120379319 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fa21c0aa030 con 0x7fa22c0adf50 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:43:15.021 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:43:15.022 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.023 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:43:15.024 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.025 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.026 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.027 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.028 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.029 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:43:15.030 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.031 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.032 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:43:15.034 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:43:15.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:15.035 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:43:15.035 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.020+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 msgr2=0x7fa20c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.020+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 0x7fa20c06d0c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa22c0cb060 tx=0x7fa218009040 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.020+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 msgr2=0x7fa22c15e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.020+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7fa21c0090b0 tx=0x7fa21c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 shutdown_connections 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa20c06ac00 0x7fa20c06d0c0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa22c161210 0x7fa22c144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa22c156e30 0x7fa22c15ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 --2- 172.21.15.192:0/120379319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa22c0adf50 0x7fa22c15e540 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 >> 172.21.15.192:0/120379319 conn(0x7fa22c0736d0 msgr2=0x7fa22c160620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 shutdown_connections 2024-09-13T18:43:15.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.021+0000 7fa232200640 1 -- 172.21.15.192:0/120379319 wait complete. 2024-09-13T18:43:15.039 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:15.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.187+0000 7f5c12600640 1 Processor -- start 2024-09-13T18:43:15.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.188+0000 7f5c12600640 1 -- start start 2024-09-13T18:43:15.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c15a9e0 0x7f5c0c06ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 0x7f5c0c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c0b3730 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c0c06c5d0 con 0x7f5c0c06e990 2024-09-13T18:43:15.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c12600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0b3920 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c03e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c03e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59408/0 (socket says 172.21.15.192:59408) 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c03e00640 1 -- 172.21.15.192:0/2029895095 learned_addr learned my addr 172.21.15.192:0/2029895095 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c11200640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c15a9e0 0x7f5c0c06ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.189+0000 7f5c11c00640 1 --2- 172.21.15.192:0/2029895095 >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 0x7f5c0c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c03e00640 1 -- 172.21.15.192:0/2029895095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c15a9e0 msgr2=0x7f5c0c06ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c03e00640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c15a9e0 0x7f5c0c06ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c03e00640 1 -- 172.21.15.192:0/2029895095 >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 msgr2=0x7f5c0c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:15.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c03e00640 1 --2- 172.21.15.192:0/2029895095 >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 0x7f5c0c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c03e00640 1 -- 172.21.15.192:0/2029895095 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0c0b3c00 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.190+0000 7f5c11c00640 1 --2- 172.21.15.192:0/2029895095 >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 0x7f5c0c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c03e00640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c15e580 tx=0x7f5bf402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1631703cb6ba010d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c0be00640 1 -- 172.21.15.192:0/2029895095 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4032440 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c0be00640 1 -- 172.21.15.192:0/2029895095 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf40325a0 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c0be00640 1 -- 172.21.15.192:0/2029895095 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4032930 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c12600640 1 -- 172.21.15.192:0/2029895095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c06b3d0 msgr2=0x7f5c0c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.191+0000 7f5c12600640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c15e580 tx=0x7f5bf402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 -- 172.21.15.192:0/2029895095 shutdown_connections 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 --2- 172.21.15.192:0/2029895095 >> v2:172.21.15.194:3300/0 conn(0x7f5c0c06e990 0x7f5c0c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c0cd8c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.195 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 --2- 172.21.15.192:0/2029895095 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c15a9e0 0x7f5c0c06ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 -- 172.21.15.192:0/2029895095 >> 172.21.15.192:0/2029895095 conn(0x7f5c0c0736d0 msgr2=0x7f5c0c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 -- 172.21.15.192:0/2029895095 shutdown_connections 2024-09-13T18:43:15.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.192+0000 7f5c12600640 1 -- 172.21.15.192:0/2029895095 wait complete. 2024-09-13T18:43:15.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.193+0000 7f5c12600640 1 Processor -- start 2024-09-13T18:43:15.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.193+0000 7f5c12600640 1 -- start start 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c06e990 0x7f5c0c153c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1509b0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c154680 con 0x7f5c0c06b3d0 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.194+0000 7f5c12600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c14fd30 con 0x7f5c0c06e990 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59410/0 (socket says 172.21.15.192:59410) 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 -- 172.21.15.192:0/2174921229 learned_addr learned my addr 172.21.15.192:0/2174921229 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:15.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11200640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c03e00640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c06e990 0x7f5c0c153c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 -- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c06e990 msgr2=0x7f5c0c153c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c06e990 0x7f5c0c153c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 -- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c0c06b3d0 msgr2=0x7f5c0c155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c155e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 -- 172.21.15.192:0/2174921229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf40094d0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c11c00640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5c04007e10 tx=0x7f5c0400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.195+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c04003b90 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.196+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400f040 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.196+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c150010 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.196+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400de80 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.196+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c1505d0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.197+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c150af0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.197+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5c04004030 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.199+0000 7f5c09600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 0x7f5be806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.199+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c04089380 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.199+0000 7f5c11200640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 0x7f5be806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.200+0000 7f5c11200640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 0x7f5be806d0c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009a30 tx=0x7f5bfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.203+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5c0c150af0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.377+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c0c150af0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.378+0000 7f5c09600640 1 -- 172.21.15.192:0/2174921229 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) v1 ==== 74+0+12928 (secure 0 0 0) 0x7f5c0c150af0 con 0x7f5c0c15a9e0 2024-09-13T18:43:15.381 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:15.381 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":161,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:14.594497+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":147,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:15.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 msgr2=0x7f5be806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 0x7f5be806d0c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc009a30 tx=0x7f5bfc008040 comp rx=0 tx=0).stop 2024-09-13T18:43:15.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 msgr2=0x7f5c0c154140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f5c04007e10 tx=0x7f5c0400d4a0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 shutdown_connections 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5be806ac00 0x7f5be806d0c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5c0c15a9e0 0x7f5c0c154140 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5c0c06e990 0x7f5c0c153c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.380+0000 7f5c12600640 1 --2- 172.21.15.192:0/2174921229 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5c0c06b3d0 0x7f5c0c155e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.381+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 >> 172.21.15.192:0/2174921229 conn(0x7f5c0c0736d0 msgr2=0x7f5c0c0af4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.381+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 shutdown_connections 2024-09-13T18:43:15.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.381+0000 7f5c12600640 1 -- 172.21.15.192:0/2174921229 wait complete. 2024-09-13T18:43:15.400 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:43:15.400 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:43:15.558 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.556+0000 7f2b05600640 1 Processor -- start 2024-09-13T18:43:15.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.556+0000 7f2b05600640 1 -- start start 2024-09-13T18:43:15.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2b05600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b000ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2b05600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b000b3470 0x7f2b000b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2b05600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b0015a8e0 con 0x7f2b000cb330 2024-09-13T18:43:15.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2b05600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b000b2fe0 con 0x7f2b000b3470 2024-09-13T18:43:15.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2b05600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b000b26b0 con 0x7f2b000cdf60 2024-09-13T18:43:15.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2aff400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b000b3470 0x7f2b000b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2afea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2b000cb330 0x7f2b0006ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49098/0 (socket says 172.21.15.192:49098) 2024-09-13T18:43:15.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2afea00640 1 -- 172.21.15.192:0/1409621561 learned_addr learned my addr 172.21.15.192:0/1409621561 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:15.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.557+0000 7f2aff400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b000b3470 0x7f2b000b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59412/0 (socket says 172.21.15.192:59412) 2024-09-13T18:43:15.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2af7e00640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b000ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2aff400640 1 -- 172.21.15.192:0/1409621561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 msgr2=0x7f2b000ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2aff400640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b000ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2aff400640 1 -- 172.21.15.192:0/1409621561 >> v1:172.21.15.192:6789/0 conn(0x7f2b000cb330 legacy=0x7f2b0006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2aff400640 1 -- 172.21.15.192:0/1409621561 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b000b2990 con 0x7f2b000b3470 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2afe000640 1 -- 172.21.15.192:0/1409621561 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737153014 0 0) 0x7f2b0015a8e0 con 0x7f2b000cb330 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.558+0000 7f2af7e00640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b000ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:15.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.559+0000 7f2aff400640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b000b38a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009d90 tx=0x7f2af802a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e6e8449f9b8cef server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.559+0000 7f2afe000640 1 -- 172.21.15.192:0/1409621561 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8007740 con 0x7f2b000b3470 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.559+0000 7f2afe000640 1 -- 172.21.15.192:0/1409621561 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af802d050 con 0x7f2b000b3470 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.559+0000 7f2afe000640 1 -- 172.21.15.192:0/1409621561 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8007ac0 con 0x7f2b000b3470 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 -- 172.21.15.192:0/1409621561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 msgr2=0x7f2b000b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b000b38a0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2af8009d90 tx=0x7f2af802a530 comp rx=0 tx=0).stop 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 -- 172.21.15.192:0/1409621561 shutdown_connections 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b000b38a0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 --2- 172.21.15.192:0/1409621561 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b000ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 -- 172.21.15.192:0/1409621561 >> 172.21.15.192:0/1409621561 conn(0x7f2b000b08f0 msgr2=0x7f2b000b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 -- 172.21.15.192:0/1409621561 shutdown_connections 2024-09-13T18:43:15.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.560+0000 7f2b05600640 1 -- 172.21.15.192:0/1409621561 wait complete. 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.561+0000 7f2b05600640 1 Processor -- start 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.561+0000 7f2b05600640 1 -- start start 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b000cb330 0x7f2b0015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b00158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00157ca0 con 0x7f2b000b3470 2024-09-13T18:43:15.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00157370 con 0x7f2b000cb330 2024-09-13T18:43:15.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2b05600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b00157650 con 0x7f2b000cdf60 2024-09-13T18:43:15.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.562+0000 7f2afea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59426/0 (socket says 172.21.15.192:59426) 2024-09-13T18:43:15.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 -- 172.21.15.192:0/682539754 learned_addr learned my addr 172.21.15.192:0/682539754 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2af7e00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b000cb330 0x7f2b0015aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2aff400640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b00158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 -- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 msgr2=0x7f2b00158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b00158130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 -- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b000cb330 msgr2=0x7f2b0015aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b000cb330 0x7f2b0015aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 -- 172.21.15.192:0/682539754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af8009a70 con 0x7f2b000b3470 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2afea00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c4d0 tx=0x7f2af000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af00074e0 con 0x7f2b000b3470 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af0007660 con 0x7f2b000b3470 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0004a20 con 0x7f2b000b3470 2024-09-13T18:43:15.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.563+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b00157930 con 0x7f2b000b3470 2024-09-13T18:43:15.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.564+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b00148a70 con 0x7f2b000b3470 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.565+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b000b38a0 con 0x7f2b000b3470 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.565+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2af0004b80 con 0x7f2b000b3470 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.566+0000 7f2af6a00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 0x7f2adc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.566+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2af0088220 con 0x7f2b000b3470 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.567+0000 7f2af7e00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 0x7f2adc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.567+0000 7f2af7e00640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 0x7f2adc06d0c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2b0015dcf0 tx=0x7f2ae8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.571+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2af0053740 con 0x7f2b000b3470 2024-09-13T18:43:15.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.743+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2b00157ac0 con 0x7f2b000b3470 2024-09-13T18:43:15.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.743+0000 7f2af6a00640 1 -- 172.21.15.192:0/682539754 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v161) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2af0018020 con 0x7f2b000b3470 2024-09-13T18:43:15.746 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 msgr2=0x7f2adc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 0x7f2adc06d0c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f2b0015dcf0 tx=0x7f2ae8008040 comp rx=0 tx=0).stop 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 msgr2=0x7f2b00148530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2af000c4d0 tx=0x7f2af000c990 comp rx=0 tx=0).stop 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 shutdown_connections 2024-09-13T18:43:15.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2adc06ac00 0x7f2adc06d0c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b000cdf60 0x7f2b00158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b000cb330 0x7f2b0015aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 --2- 172.21.15.192:0/682539754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b000b3470 0x7f2b00148530 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 >> 172.21.15.192:0/682539754 conn(0x7f2b000b08f0 msgr2=0x7f2b000716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 shutdown_connections 2024-09-13T18:43:15.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.746+0000 7f2b05600640 1 -- 172.21.15.192:0/682539754 wait complete. 2024-09-13T18:43:15.765 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:43:15.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.914+0000 7ffb12800640 1 Processor -- start 2024-09-13T18:43:15.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.915+0000 7ffb12800640 1 -- start start 2024-09-13T18:43:15.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb12800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15dee0 0x7ffb0c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb12800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb12800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c0b2f00 con 0x7ffb0c0b3f10 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb12800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c0b3150 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb12800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0b3430 con 0x7ffb0c15dee0 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb0be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb0be00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59436/0 (socket says 172.21.15.192:59436) 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb0be00640 1 -- 172.21.15.192:0/102204409 learned_addr learned my addr 172.21.15.192:0/102204409 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.916+0000 7ffb0b400640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15dee0 0x7ffb0c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.917+0000 7ffb0be00640 1 -- 172.21.15.192:0/102204409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15dee0 msgr2=0x7ffb0c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.917+0000 7ffb0be00640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15dee0 0x7ffb0c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.917+0000 7ffb0be00640 1 -- 172.21.15.192:0/102204409 >> v1:172.21.15.194:6789/0 conn(0x7ffb0c0b3f10 legacy=0x7ffb0c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.917+0000 7ffb0be00640 1 -- 172.21.15.192:0/102204409 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0b3710 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.917+0000 7ffb0aa00640 1 -- 172.21.15.192:0/102204409 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985064611 0 0) 0x7ffb0c0b2f00 con 0x7ffb0c0b3f10 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb0be00640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009e80 tx=0x7ffb0402a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156e54b2273be916 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb0aa00640 1 -- 172.21.15.192:0/102204409 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04031600 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb0aa00640 1 -- 172.21.15.192:0/102204409 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0402d050 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb0aa00640 1 -- 172.21.15.192:0/102204409 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04031980 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb12800640 1 -- 172.21.15.192:0/102204409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 msgr2=0x7ffb0c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.922 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.918+0000 7ffb12800640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009e80 tx=0x7ffb0402a750 comp rx=0 tx=0).stop 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 -- 172.21.15.192:0/102204409 shutdown_connections 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c15ab50 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 --2- 172.21.15.192:0/102204409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15dee0 0x7ffb0c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 -- 172.21.15.192:0/102204409 >> 172.21.15.192:0/102204409 conn(0x7ffb0c0ae960 msgr2=0x7ffb0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 -- 172.21.15.192:0/102204409 shutdown_connections 2024-09-13T18:43:15.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.919+0000 7ffb12800640 1 -- 172.21.15.192:0/102204409 wait complete. 2024-09-13T18:43:15.926 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.920+0000 7ffb12800640 1 Processor -- start 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.920+0000 7ffb12800640 1 -- start start 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 0x7ffb0c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15c4c0 0x7ffb0c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c155ef0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c155060 con 0x7ffb0c15dee0 2024-09-13T18:43:15.927 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb12800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c135350 con 0x7ffb0c15c4c0 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb02a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb02a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59446/0 (socket says 172.21.15.192:59446) 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.921+0000 7ffb02a00640 1 -- 172.21.15.192:0/1318922929 learned_addr learned my addr 172.21.15.192:0/1318922929 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb0be00640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15c4c0 0x7ffb0c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb0b400640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 0x7ffb0c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 -- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15c4c0 msgr2=0x7ffb0c06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15c4c0 0x7ffb0c06aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.928 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 -- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 msgr2=0x7ffb0c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 0x7ffb0c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 -- 172.21.15.192:0/1318922929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009b30 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb0b400640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 0x7ffb0c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb02a00640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c4e0 tx=0x7ffaf400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4005480 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf40035f0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf40039c0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.929 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.922+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c150410 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.923+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c1555c0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.930 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.924+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c15d9a0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.924+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ffaf4003b20 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.925+0000 7ffb03e00640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 0x7ffae806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:15.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.925+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ffaf40885b0 con 0x7ffb0c15e2c0 2024-09-13T18:43:15.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.926+0000 7ffb0b400640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 0x7ffae806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:15.931 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.926+0000 7ffb0b400640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 0x7ffae806d0c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009b90 tx=0x7ffafc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:15.932 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:15.929+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ffaf4053af0 con 0x7ffb0c15e2c0 2024-09-13T18:43:16.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.098+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ffb0c1560a0 con 0x7ffb0c15e2c0 2024-09-13T18:43:16.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.099+0000 7ffb03e00640 1 -- 172.21.15.192:0/1318922929 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v161) v1 ==== 84+0+65 (secure 0 0 0) 0x7ffb0c1560a0 con 0x7ffb0c15e2c0 2024-09-13T18:43:16.101 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:43:16.102 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.100+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 msgr2=0x7ffae806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.100+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 0x7ffae806d0c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009b90 tx=0x7ffafc008040 comp rx=0 tx=0).stop 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 msgr2=0x7ffb0c134e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c4e0 tx=0x7ffaf400c9a0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 shutdown_connections 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ffae806ac00 0x7ffae806d0c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ffb0c15c4c0 0x7ffb0c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ffb0c15e2c0 0x7ffb0c134e10 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 --2- 172.21.15.192:0/1318922929 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ffb0c15dee0 0x7ffb0c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 >> 172.21.15.192:0/1318922929 conn(0x7ffb0c0ae960 msgr2=0x7ffb0c158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:16.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 shutdown_connections 2024-09-13T18:43:16.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.101+0000 7ffb12800640 1 -- 172.21.15.192:0/1318922929 wait complete. 2024-09-13T18:43:16.120 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:43:16.121 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:43:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.276+0000 7feb19800640 1 Processor -- start 2024-09-13T18:43:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.276+0000 7feb19800640 1 -- start start 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.277+0000 7feb19800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb14071b80 0x7feb1415f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.277+0000 7feb19800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feb141403e0 0x7feb14070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.277+0000 7feb19800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb1406a330 con 0x7feb14071100 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.277+0000 7feb19800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1413e0f0 con 0x7feb14071b80 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.277+0000 7feb19800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb1415f840 con 0x7feb141403e0 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb14071b80 0x7feb1415f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb13400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7feb14071100 0x7feb140cd9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49112/0 (socket says 172.21.15.192:49112) 2024-09-13T18:43:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb13400640 1 -- 172.21.15.192:0/567361546 learned_addr learned my addr 172.21.15.192:0/567361546 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb14071b80 0x7feb1415f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59452/0 (socket says 172.21.15.192:59452) 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12000640 1 --2- 172.21.15.192:0/567361546 >> v2:172.21.15.194:3300/0 conn(0x7feb141403e0 0x7feb14070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 -- 172.21.15.192:0/567361546 >> v2:172.21.15.194:3300/0 conn(0x7feb141403e0 msgr2=0x7feb14070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 --2- 172.21.15.192:0/567361546 >> v2:172.21.15.194:3300/0 conn(0x7feb141403e0 0x7feb14070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 -- 172.21.15.192:0/567361546 >> v1:172.21.15.192:6789/0 conn(0x7feb14071100 legacy=0x7feb140cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb12a00640 1 -- 172.21.15.192:0/567361546 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb1415b300 con 0x7feb14071b80 2024-09-13T18:43:16.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.278+0000 7feb11600640 1 -- 172.21.15.192:0/567361546 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1822659510 0 0) 0x7feb0c001490 con 0x7feb14071100 2024-09-13T18:43:16.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.279+0000 7feb12a00640 1 --2- 172.21.15.192:0/567361546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071b80 0x7feb1415f300 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7feb140cb750 tx=0x7feb0402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e25a27dd93f26b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:16.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.279+0000 7feb11600640 1 -- 172.21.15.192:0/567361546 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb0402ae60 con 0x7feb14071b80 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.279+0000 7feb11600640 1 -- 172.21.15.192:0/567361546 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb04032440 con 0x7feb14071b80 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb11600640 1 -- 172.21.15.192:0/567361546 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb040327d0 con 0x7feb14071b80 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 -- 172.21.15.192:0/567361546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071b80 msgr2=0x7feb1415f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 --2- 172.21.15.192:0/567361546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071b80 0x7feb1415f300 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7feb140cb750 tx=0x7feb0402a110 comp rx=0 tx=0).stop 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 -- 172.21.15.192:0/567361546 shutdown_connections 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 --2- 172.21.15.192:0/567361546 >> v2:172.21.15.194:3300/0 conn(0x7feb141403e0 0x7feb14070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 --2- 172.21.15.192:0/567361546 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071b80 0x7feb1415f300 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 -- 172.21.15.192:0/567361546 >> 172.21.15.192:0/567361546 conn(0x7feb140b0c40 msgr2=0x7feb140b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 -- 172.21.15.192:0/567361546 shutdown_connections 2024-09-13T18:43:16.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.280+0000 7feb19800640 1 -- 172.21.15.192:0/567361546 wait complete. 2024-09-13T18:43:16.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.282+0000 7feb19800640 1 Processor -- start 2024-09-13T18:43:16.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.282+0000 7feb19800640 1 -- start start 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb14071b80 0x7feb140cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb141403e0 0x7feb140ccd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140a9560 con 0x7feb14071100 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb140acd00 con 0x7feb141403e0 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb19800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb140acfe0 con 0x7feb14071b80 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb12a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb12a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59464/0 (socket says 172.21.15.192:59464) 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.283+0000 7feb12a00640 1 -- 172.21.15.192:0/2170669694 learned_addr learned my addr 172.21.15.192:0/2170669694 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb13400640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb141403e0 0x7feb140ccd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12000640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb14071b80 0x7feb140cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 -- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb14071b80 msgr2=0x7feb140cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb14071b80 0x7feb140cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 -- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb141403e0 msgr2=0x7feb140ccd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb141403e0 0x7feb140ccd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 -- 172.21.15.192:0/2170669694 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb04009400 con 0x7feb14071100 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb12a00640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04004230 con 0x7feb14071100 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb040043b0 con 0x7feb14071100 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb04004520 con 0x7feb14071100 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb140ad2c0 con 0x7feb14071100 2024-09-13T18:43:16.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.284+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb140ac920 con 0x7feb14071100 2024-09-13T18:43:16.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.285+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb14071f60 con 0x7feb14071100 2024-09-13T18:43:16.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.286+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb04003850 con 0x7feb14071100 2024-09-13T18:43:16.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.287+0000 7feb0aa00640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 0x7feaf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:16.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.287+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 4857+0+0 (secure 0 0 0) 0x7feb040a9c20 con 0x7feb14071100 2024-09-13T18:43:16.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.287+0000 7feb12000640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 0x7feaf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:16.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.288+0000 7feb12000640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 0x7feaf406d0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb1413e9a0 tx=0x7feb00008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:16.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.291+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb040750b0 con 0x7feb14071100 2024-09-13T18:43:16.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:16.459+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7feb1406bf00 con 0x7feb14071100 2024-09-13T18:43:17.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.227+0000 7feb0aa00640 1 -- 172.21.15.192:0/2170669694 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v162) v1 ==== 138+0+0 (secure 0 0 0) 0x7feb04037020 con 0x7feb14071100 2024-09-13T18:43:17.231 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:43:17.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 msgr2=0x7feaf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 0x7feaf406d0c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb1413e9a0 tx=0x7feb00008040 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 msgr2=0x7feb140af9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7feb04000c00 tx=0x7feb040046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 shutdown_connections 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feaf406ac00 0x7feaf406d0c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb141403e0 0x7feb140ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb14071b80 0x7feb140cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 --2- 172.21.15.192:0/2170669694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb14071100 0x7feb140af9e0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.231+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 >> 172.21.15.192:0/2170669694 conn(0x7feb140b0c40 msgr2=0x7feb1415a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.232+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 shutdown_connections 2024-09-13T18:43:17.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.232+0000 7feb19800640 1 -- 172.21.15.192:0/2170669694 wait complete. 2024-09-13T18:43:17.253 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:43:17.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.412+0000 7fc6d4200640 1 Processor -- start 2024-09-13T18:43:17.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.412+0000 7fc6d4200640 1 -- start start 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d4200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc6cc0b4fa0 0x7fc6cc167a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d4200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0ad8e0 con 0x7fc6cc15cd40 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d4200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6cc0adbc0 con 0x7fc6cc0712b0 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d4200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b5380 con 0x7fc6cc0b4fa0 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d1800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc6cc15cd40 0x7fc6cc070ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49124/0 (socket says 172.21.15.192:49124) 2024-09-13T18:43:17.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.413+0000 7fc6d1800640 1 -- 172.21.15.192:0/1145137459 learned_addr learned my addr 172.21.15.192:0/1145137459 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:17.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615373054 0 0) 0x7fc6cc0ad8e0 con 0x7fc6cc15cd40 2024-09-13T18:43:17.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6d2200640 1 --2- 172.21.15.192:0/1145137459 >> v2:172.21.15.194:3300/0 conn(0x7fc6cc0b4fa0 0x7fc6cc167a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6b4003520 con 0x7fc6cc15cd40 2024-09-13T18:43:17.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174028020 0 0) 0x7fc6b4003520 con 0x7fc6cc15cd40 2024-09-13T18:43:17.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 >> v2:172.21.15.194:3300/0 conn(0x7fc6cc0b4fa0 msgr2=0x7fc6cc167a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 --2- 172.21.15.192:0/1145137459 >> v2:172.21.15.194:3300/0 conn(0x7fc6cc0b4fa0 0x7fc6cc167a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 >> v1:172.21.15.194:6789/0 conn(0x7fc6cc0712b0 legacy=0x7fc6cc0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc0adea0 con 0x7fc6cc15cd40 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fc6c0001670 con 0x7fc6cc15cd40 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 >> v1:172.21.15.192:6789/0 conn(0x7fc6cc15cd40 legacy=0x7fc6cc070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4003970 0x7fc6b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b4005180 0x7fc6b400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0b5380 con 0x7fc6b40047c0 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b400c020 con 0x7fc6b4003970 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.414+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6b400c1e0 con 0x7fc6b4005180 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d1800640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4003970 0x7fc6b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d2200640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b4005180 0x7fc6b400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 -- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b4005180 msgr2=0x7fc6b400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6b4005180 0x7fc6b400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 -- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4003970 msgr2=0x7fc6b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6b4003970 0x7fc6b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d0e00640 1 -- 172.21.15.192:0/1145137459 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b4003520 con 0x7fc6b40047c0 2024-09-13T18:43:17.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.415+0000 7fc6d2200640 1 -- 172.21.15.192:0/1145137459 reap_dead start 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.416+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8001750 tx=0x7fc6b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab4b46a509120ee server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.416+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b80052d0 con 0x7fc6b40047c0 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.416+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b8005430 con 0x7fc6b40047c0 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.416+0000 7fc6cbe00640 1 -- 172.21.15.192:0/1145137459 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802abc0 con 0x7fc6b40047c0 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 -- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 msgr2=0x7fc6b4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8001750 tx=0x7fc6b40057f0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 -- 172.21.15.192:0/1145137459 shutdown_connections 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 --2- 172.21.15.192:0/1145137459 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6b4004c40 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 -- 172.21.15.192:0/1145137459 >> 172.21.15.192:0/1145137459 conn(0x7fc6cc0b2af0 msgr2=0x7fc6cc0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 -- 172.21.15.192:0/1145137459 shutdown_connections 2024-09-13T18:43:17.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.417+0000 7fc6d4200640 1 -- 172.21.15.192:0/1145137459 wait complete. 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.419+0000 7fc6d4200640 1 Processor -- start 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.419+0000 7fc6d4200640 1 -- start start 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6cc0cf4f0 0x7fc6cc14d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6cc14e9f0 0x7fc6cc14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ce090 con 0x7fc6b40047c0 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc15d5a0 con 0x7fc6cc14e9f0 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d4200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6cc0ce330 con 0x7fc6cc0cf4f0 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59472/0 (socket says 172.21.15.192:59472) 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 -- 172.21.15.192:0/2333932792 learned_addr learned my addr 172.21.15.192:0/2333932792 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6cc0cf4f0 0x7fc6cc14d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d2200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6cc14e9f0 0x7fc6cc14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 -- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6cc0cf4f0 msgr2=0x7fc6cc14d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6cc0cf4f0 0x7fc6cc14d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 -- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6cc14e9f0 msgr2=0x7fc6cc14ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6cc14e9f0 0x7fc6cc14ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.420+0000 7fc6d1800640 1 -- 172.21.15.192:0/2333932792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc14df00 con 0x7fc6b40047c0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6d1800640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00011e0 tx=0x7fc6c0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0001650 con 0x7fc6b40047c0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c000f940 con 0x7fc6b40047c0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000fcd0 con 0x7fc6b40047c0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6cc15d880 con 0x7fc6b40047c0 2024-09-13T18:43:17.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.421+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6cc15b380 con 0x7fc6b40047c0 2024-09-13T18:43:17.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.422+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6cc158430 con 0x7fc6b40047c0 2024-09-13T18:43:17.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.423+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc6c001d460 con 0x7fc6b40047c0 2024-09-13T18:43:17.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.424+0000 7fc6c9600640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 0x7fc6ac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:17.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.424+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc6c0089d30 con 0x7fc6b40047c0 2024-09-13T18:43:17.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.424+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 0x7fc6ac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:17.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.425+0000 7fc6d0e00640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 0x7fc6ac06d0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8032000 tx=0x7fc6b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:17.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.428+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc6c00550d0 con 0x7fc6b40047c0 2024-09-13T18:43:17.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:17.597+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc6cc158150 con 0x7fc6b40047c0 2024-09-13T18:43:18.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.237+0000 7fc6c9600640 1 -- 172.21.15.192:0/2333932792 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v163) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc6c00586f0 con 0x7fc6b40047c0 2024-09-13T18:43:18.241 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:43:18.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.246+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 msgr2=0x7fc6ac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.246+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 0x7fc6ac06d0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8032000 tx=0x7fc6b802e000 comp rx=0 tx=0).stop 2024-09-13T18:43:18.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.246+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 msgr2=0x7fc6cc0b4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.246+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00011e0 tx=0x7fc6c0007720 comp rx=0 tx=0).stop 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 shutdown_connections 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc6ac06ac30 0x7fc6ac06d0f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6cc14e9f0 0x7fc6cc14ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6cc0cf4f0 0x7fc6cc14d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 --2- 172.21.15.192:0/2333932792 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6b40047c0 0x7fc6cc0b4a10 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.247+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 >> 172.21.15.192:0/2333932792 conn(0x7fc6cc0b2af0 msgr2=0x7fc6cc158fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:18.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.248+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 shutdown_connections 2024-09-13T18:43:18.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.249+0000 7fc6d4200640 1 -- 172.21.15.192:0/2333932792 wait complete. 2024-09-13T18:43:18.273 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:43:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.429+0000 7fc8e6e00640 1 Processor -- start 2024-09-13T18:43:18.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.430+0000 7fc8e6e00640 1 -- start start 2024-09-13T18:43:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8e0142e00 0x7fc8e00b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 0x7fc8e006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e006f940 con 0x7fc8e00b2d90 2024-09-13T18:43:18.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e006f610 con 0x7fc8e0142e00 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e00b3530 con 0x7fc8e00b02f0 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e5a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8e0142e00 0x7fc8e00b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e5a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc8e0142e00 0x7fc8e00b4910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59482/0 (socket says 172.21.15.192:59482) 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e5a00640 1 -- 172.21.15.192:0/2292540328 learned_addr learned my addr 172.21.15.192:0/2292540328 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.431+0000 7fc8e6400640 1 --2- 172.21.15.192:0/2292540328 >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 0x7fc8e006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.432+0000 7fc8e5a00640 1 -- 172.21.15.192:0/2292540328 >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 msgr2=0x7fc8e006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.432+0000 7fc8e5a00640 1 --2- 172.21.15.192:0/2292540328 >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 0x7fc8e006fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.432+0000 7fc8e5a00640 1 -- 172.21.15.192:0/2292540328 >> v1:172.21.15.192:6789/0 conn(0x7fc8e00b2d90 legacy=0x7fc8e00afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.432+0000 7fc8e5a00640 1 -- 172.21.15.192:0/2292540328 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00b3810 con 0x7fc8e0142e00 2024-09-13T18:43:18.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.432+0000 7fc8e6400640 1 --2- 172.21.15.192:0/2292540328 >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 0x7fc8e006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8e5a00640 1 --2- 172.21.15.192:0/2292540328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e00b4910 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc8e006cd50 tx=0x7fc8d402a280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=178e67322df905ea server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8dfe00640 1 -- 172.21.15.192:0/2292540328 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4032440 con 0x7fc8e0142e00 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8dfe00640 1 -- 172.21.15.192:0/2292540328 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d40325a0 con 0x7fc8e0142e00 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8dfe00640 1 -- 172.21.15.192:0/2292540328 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4032930 con 0x7fc8e0142e00 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8e6e00640 1 -- 172.21.15.192:0/2292540328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 msgr2=0x7fc8e00b4910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.433+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/2292540328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e00b4910 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fc8e006cd50 tx=0x7fc8d402a280 comp rx=0 tx=0).stop 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 -- 172.21.15.192:0/2292540328 shutdown_connections 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/2292540328 >> v2:172.21.15.194:3300/0 conn(0x7fc8e00b02f0 0x7fc8e006fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/2292540328 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e00b4910 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 -- 172.21.15.192:0/2292540328 >> 172.21.15.192:0/2292540328 conn(0x7fc8e00ae7f0 msgr2=0x7fc8e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:18.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 -- 172.21.15.192:0/2292540328 shutdown_connections 2024-09-13T18:43:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.434+0000 7fc8e6e00640 1 -- 172.21.15.192:0/2292540328 wait complete. 2024-09-13T18:43:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.435+0000 7fc8e6e00640 1 Processor -- start 2024-09-13T18:43:18.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.435+0000 7fc8e6e00640 1 -- start start 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e00b02f0 0x7fc8e013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8e00b2d90 0x7fc8e0158a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0141fc0 con 0x7fc8e0142e00 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e01416d0 con 0x7fc8e00b02f0 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0141970 con 0x7fc8e00b2d90 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.436+0000 7fc8e6400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59484/0 (socket says 172.21.15.192:59484) 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 -- 172.21.15.192:0/1395682317 learned_addr learned my addr 172.21.15.192:0/1395682317 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:18.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e5a00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e00b02f0 0x7fc8e013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e5000640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8e00b2d90 0x7fc8e0158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 -- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8e00b2d90 msgr2=0x7fc8e0158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8e00b2d90 0x7fc8e0158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 -- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e00b02f0 msgr2=0x7fc8e013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e00b02f0 0x7fc8e013f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 -- 172.21.15.192:0/1395682317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d40094d0 con 0x7fc8e0142e00 2024-09-13T18:43:18.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.437+0000 7fc8e6400640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009fa0 tx=0x7fc8d800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.438+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003b90 con 0x7fc8e0142e00 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.438+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d800f040 con 0x7fc8e0142e00 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.438+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8004030 con 0x7fc8e0142e00 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.438+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e0143360 con 0x7fc8e0142e00 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.438+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e0158f70 con 0x7fc8e0142e00 2024-09-13T18:43:18.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.439+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e0142170 con 0x7fc8e0142e00 2024-09-13T18:43:18.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.441+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc8d8004190 con 0x7fc8e0142e00 2024-09-13T18:43:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.442+0000 7fc8dd600640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 0x7fc8c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.442+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc8d80899e0 con 0x7fc8e0142e00 2024-09-13T18:43:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.442+0000 7fc8e5a00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 0x7fc8c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.442+0000 7fc8e5a00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 0x7fc8c006d0c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4034000 tx=0x7fc8d402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.445+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc8d8054cb0 con 0x7fc8e0142e00 2024-09-13T18:43:18.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.647+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc8e00b4910 con 0x7fc8e0142e00 2024-09-13T18:43:18.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.657+0000 7fc8dd600640 1 -- 172.21.15.192:0/1395682317 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v66) v1 ==== 174+0+0 (secure 0 0 0) 0x7fc8d80582d0 con 0x7fc8e0142e00 2024-09-13T18:43:18.660 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 18 and data pool 19 2024-09-13T18:43:18.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.663+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 msgr2=0x7fc8c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.663+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 0x7fc8c006d0c0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fc8d4034000 tx=0x7fc8d402e000 comp rx=0 tx=0).stop 2024-09-13T18:43:18.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.664+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 msgr2=0x7fc8e0139670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.664+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009fa0 tx=0x7fc8d800d560 comp rx=0 tx=0).stop 2024-09-13T18:43:18.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 shutdown_connections 2024-09-13T18:43:18.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc8c006ac00 0x7fc8c006d0c0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8e0142e00 0x7fc8e0139670 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc8e00b2d90 0x7fc8e0158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 --2- 172.21.15.192:0/1395682317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc8e00b02f0 0x7fc8e013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.665+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 >> 172.21.15.192:0/1395682317 conn(0x7fc8e00ae7f0 msgr2=0x7fc8e00aebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:18.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.666+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 shutdown_connections 2024-09-13T18:43:18.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.667+0000 7fc8e6e00640 1 -- 172.21.15.192:0/1395682317 wait complete. 2024-09-13T18:43:18.696 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:18.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.847+0000 7f3b81a00640 1 Processor -- start 2024-09-13T18:43:18.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.847+0000 7f3b81a00640 1 -- start start 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b81a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 0x7f3b7c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b81a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b81a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b7c140480 con 0x7f3b7c140980 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b81a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c15c160 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b81a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7c0cb520 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b7a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b7b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3b7c140980 0x7f3b7c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49138/0 (socket says 172.21.15.192:49138) 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b7b400640 1 -- 172.21.15.192:0/1420754530 learned_addr learned my addr 172.21.15.192:0/1420754530 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.848+0000 7f3b7a000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59496/0 (socket says 172.21.15.192:59496) 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7aa00640 1 --2- 172.21.15.192:0/1420754530 >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 0x7f3b7c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7a000640 1 -- 172.21.15.192:0/1420754530 >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 msgr2=0x7f3b7c15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7a000640 1 --2- 172.21.15.192:0/1420754530 >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 0x7f3b7c15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7a000640 1 -- 172.21.15.192:0/1420754530 >> v1:172.21.15.192:6789/0 conn(0x7f3b7c140980 legacy=0x7f3b7c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7a000640 1 -- 172.21.15.192:0/1420754530 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c15ee90 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b7aa00640 1 --2- 172.21.15.192:0/1420754530 >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 0x7f3b7c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:18.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.849+0000 7f3b79600640 1 -- 172.21.15.192:0/1420754530 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389860206 0 0) 0x7f3b7c140480 con 0x7f3b7c140980 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.850+0000 7f3b7a000640 1 --2- 172.21.15.192:0/1420754530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b2350 tx=0x7f3b6802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ccf52578b11450e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.850+0000 7f3b79600640 1 -- 172.21.15.192:0/1420754530 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68032440 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.850+0000 7f3b79600640 1 -- 172.21.15.192:0/1420754530 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b680325a0 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.850+0000 7f3b79600640 1 -- 172.21.15.192:0/1420754530 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68032930 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 -- 172.21.15.192:0/1420754530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cb0b0 msgr2=0x7f3b7c15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 --2- 172.21.15.192:0/1420754530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0b2350 tx=0x7f3b6802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 -- 172.21.15.192:0/1420754530 shutdown_connections 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 --2- 172.21.15.192:0/1420754530 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c15bc20 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 --2- 172.21.15.192:0/1420754530 >> v2:172.21.15.194:3300/0 conn(0x7f3b7c0cacd0 0x7f3b7c15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 -- 172.21.15.192:0/1420754530 >> 172.21.15.192:0/1420754530 conn(0x7f3b7c0ae960 msgr2=0x7f3b7c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:18.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 -- 172.21.15.192:0/1420754530 shutdown_connections 2024-09-13T18:43:18.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.851+0000 7f3b81a00640 1 -- 172.21.15.192:0/1420754530 wait complete. 2024-09-13T18:43:18.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.852+0000 7f3b81a00640 1 Processor -- start 2024-09-13T18:43:18.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 -- start start 2024-09-13T18:43:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b7c140980 0x7f3b7c159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c06a620 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c159020 con 0x7f3b7c0cb0b0 2024-09-13T18:43:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.853+0000 7f3b81a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c13a0f0 con 0x7f3b7c140980 2024-09-13T18:43:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59510/0 (socket says 172.21.15.192:59510) 2024-09-13T18:43:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 -- 172.21.15.192:0/3913205888 learned_addr learned my addr 172.21.15.192:0/3913205888 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:18.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7a000640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7b400640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b7c140980 0x7f3b7c159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 -- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b7c140980 msgr2=0x7f3b7c159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b7c140980 0x7f3b7c159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 -- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 msgr2=0x7f3b7c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:18.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 -- 172.21.15.192:0/3913205888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b68009400 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7a000640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.854+0000 7f3b7aa00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d800 tx=0x7f3b6c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.855+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c004030 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.855+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c004190 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.855+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7c06bc10 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.855+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c004520 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.855+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b7c06bed0 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.856+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7c15bc20 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.857+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3b6c0096a0 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.858+0000 7f3b72a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:18.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.858+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b6c0895f0 con 0x7f3b7c0cacd0 2024-09-13T18:43:18.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.858+0000 7f3b7a000640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:18.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.859+0000 7f3b7a000640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b68034000 tx=0x7f3b6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:18.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:18.862+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3b6c054730 con 0x7f3b7c0cacd0 2024-09-13T18:43:19.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.031+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b7c151c60 con 0x7f3b7c0cacd0 2024-09-13T18:43:19.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.033+0000 7f3b72a00640 1 -- 172.21.15.192:0/3913205888 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f3b6c057d50 con 0x7f3b7c0cacd0 2024-09-13T18:43:19.036 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:19.036 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":164,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:18.649078+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:19.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 msgr2=0x7f3b5c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f3b68034000 tx=0x7f3b6802e000 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 msgr2=0x7f3b7c139bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c00d800 tx=0x7f3b6c00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 shutdown_connections 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3b5c06ac00 0x7f3b5c06d0c0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3b7c140980 0x7f3b7c159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3b7c0cb0b0 0x7f3b7c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 --2- 172.21.15.192:0/3913205888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3b7c0cacd0 0x7f3b7c139bb0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 >> 172.21.15.192:0/3913205888 conn(0x7f3b7c0ae960 msgr2=0x7f3b7c0afbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.035+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 shutdown_connections 2024-09-13T18:43:19.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.036+0000 7f3b81a00640 1 -- 172.21.15.192:0/3913205888 wait complete. 2024-09-13T18:43:19.054 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:19.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.203+0000 7f19f9000640 1 Processor -- start 2024-09-13T18:43:19.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.203+0000 7f19f9000640 1 -- start start 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f9000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f19f4159b00 0x7f19f40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f9000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19f406bc30 0x7f19f40b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f9000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f415af60 con 0x7f19f4159ee0 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f9000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f415aa40 con 0x7f19f406bc30 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f9000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f406b7a0 con 0x7f19f4159b00 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f2a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f19f406bc30 0x7f19f40b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f19f4159ee0 0x7f19f415a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49140/0 (socket says 172.21.15.192:49140) 2024-09-13T18:43:19.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f3e00640 1 -- 172.21.15.192:0/824238902 learned_addr learned my addr 172.21.15.192:0/824238902 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.204+0000 7f19f3400640 1 --2- 172.21.15.192:0/824238902 >> v2:172.21.15.194:3300/0 conn(0x7f19f4159b00 0x7f19f40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2000640 1 -- 172.21.15.192:0/824238902 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3816656370 0 0) 0x7f19f415af60 con 0x7f19f4159ee0 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2000640 1 -- 172.21.15.192:0/824238902 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d8003520 con 0x7f19f4159ee0 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2a00640 1 -- 172.21.15.192:0/824238902 >> v2:172.21.15.194:3300/0 conn(0x7f19f4159b00 msgr2=0x7f19f40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2a00640 1 --2- 172.21.15.192:0/824238902 >> v2:172.21.15.194:3300/0 conn(0x7f19f4159b00 0x7f19f40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2a00640 1 -- 172.21.15.192:0/824238902 >> v1:172.21.15.192:6789/0 conn(0x7f19f4159ee0 legacy=0x7f19f415a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.205+0000 7f19f2a00640 1 -- 172.21.15.192:0/824238902 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f415ac80 con 0x7f19f406bc30 2024-09-13T18:43:19.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.206+0000 7f19f2a00640 1 --2- 172.21.15.192:0/824238902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f40b32b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f19f406cc90 tx=0x7f19e002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f477d73dfde6a55 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.206+0000 7f19f2000640 1 -- 172.21.15.192:0/824238902 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032440 con 0x7f19f406bc30 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.206+0000 7f19f2000640 1 -- 172.21.15.192:0/824238902 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00325a0 con 0x7f19f406bc30 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.206+0000 7f19f2000640 1 -- 172.21.15.192:0/824238902 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e0032910 con 0x7f19f406bc30 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 -- 172.21.15.192:0/824238902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 msgr2=0x7f19f40b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 --2- 172.21.15.192:0/824238902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f40b32b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f19f406cc90 tx=0x7f19e002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 -- 172.21.15.192:0/824238902 shutdown_connections 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 --2- 172.21.15.192:0/824238902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f40b32b0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 --2- 172.21.15.192:0/824238902 >> v2:172.21.15.194:3300/0 conn(0x7f19f4159b00 0x7f19f40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 -- 172.21.15.192:0/824238902 >> 172.21.15.192:0/824238902 conn(0x7f19f40736d0 msgr2=0x7f19f40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 -- 172.21.15.192:0/824238902 shutdown_connections 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.207+0000 7f19f9000640 1 -- 172.21.15.192:0/824238902 wait complete. 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.208+0000 7f19f9000640 1 Processor -- start 2024-09-13T18:43:19.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 -- start start 2024-09-13T18:43:19.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f4159b00 0x7f19f414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 0x7f19f4070de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f414ea00 con 0x7f19f406bc30 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f4150530 con 0x7f19f4159b00 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.209+0000 7f19f9000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f415ae10 con 0x7f19f4159ee0 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59522/0 (socket says 172.21.15.192:59522) 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 -- 172.21.15.192:0/2850652176 learned_addr learned my addr 172.21.15.192:0/2850652176 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f2a00640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f4159b00 0x7f19f414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3e00640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 0x7f19f4070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 -- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 msgr2=0x7f19f4070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 0x7f19f4070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 -- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f4159b00 msgr2=0x7f19f414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f4159b00 0x7f19f414e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 -- 172.21.15.192:0/2850652176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e0009400 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3e00640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 0x7f19f4070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.210+0000 7f19f3400640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e9b0 tx=0x7f19e400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.211+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e4009670 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.211+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e400c9a0 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.211+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e400cd50 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.211+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f415b0f0 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.211+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f415b6b0 con 0x7f19f406bc30 2024-09-13T18:43:19.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.212+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19f40b3a40 con 0x7f19f406bc30 2024-09-13T18:43:19.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.213+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f19e4013470 con 0x7f19f406bc30 2024-09-13T18:43:19.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.213+0000 7f19eb400640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 0x7f19d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.214+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19e4089590 con 0x7f19f406bc30 2024-09-13T18:43:19.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.214+0000 7f19f2a00640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 0x7f19d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.214+0000 7f19f2a00640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 0x7f19d406d0c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.217+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f19e4054780 con 0x7f19f406bc30 2024-09-13T18:43:19.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.391+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19f415a330 con 0x7f19f406bc30 2024-09-13T18:43:19.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.392+0000 7f19eb400640 1 -- 172.21.15.192:0/2850652176 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+16601 (secure 0 0 0) 0x7f19e4057da0 con 0x7f19f406bc30 2024-09-13T18:43:19.395 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:19.396 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":164,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:18.649078+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:19.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 msgr2=0x7f19d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 0x7f19d406d0c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f19e0034000 tx=0x7f19e002e000 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 msgr2=0x7f19f414fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f19e400e9b0 tx=0x7f19e400ee70 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 shutdown_connections 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f19d406ac00 0x7f19d406d0c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f19f4159ee0 0x7f19f4070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f19f4159b00 0x7f19f414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 --2- 172.21.15.192:0/2850652176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19f406bc30 0x7f19f414fea0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.394+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 >> 172.21.15.192:0/2850652176 conn(0x7f19f40736d0 msgr2=0x7f19f40cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.395+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 shutdown_connections 2024-09-13T18:43:19.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.395+0000 7f19f9000640 1 -- 172.21.15.192:0/2850652176 wait complete. 2024-09-13T18:43:19.414 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:43:19.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.565+0000 7fc617600640 1 Processor -- start 2024-09-13T18:43:19.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.565+0000 7fc617600640 1 -- start start 2024-09-13T18:43:19.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.566+0000 7fc617600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc6100adf50 0x7fc6100cc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.566+0000 7fc617600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc610161510 con 0x7fc6100b2600 2024-09-13T18:43:19.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.566+0000 7fc617600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6101617f0 con 0x7fc61015a910 2024-09-13T18:43:19.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.566+0000 7fc617600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100b21e0 con 0x7fc6100adf50 2024-09-13T18:43:19.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc60fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc6100b2600 0x7fc6100ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:49148/0 (socket says 172.21.15.192:49148) 2024-09-13T18:43:19.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc60fe00640 1 -- 172.21.15.192:0/3777847576 learned_addr learned my addr 172.21.15.192:0/3777847576 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:19.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc615600640 1 --2- 172.21.15.192:0/3777847576 >> v2:172.21.15.194:3300/0 conn(0x7fc6100adf50 0x7fc6100cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc60f400640 1 -- 172.21.15.192:0/3777847576 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761401127 0 0) 0x7fc610161510 con 0x7fc6100b2600 2024-09-13T18:43:19.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc60f400640 1 -- 172.21.15.192:0/3777847576 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5f4003520 con 0x7fc6100b2600 2024-09-13T18:43:19.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc615600640 1 -- 172.21.15.192:0/3777847576 >> v1:172.21.15.194:6789/0 conn(0x7fc61015a910 legacy=0x7fc610160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc615600640 1 -- 172.21.15.192:0/3777847576 >> v1:172.21.15.192:6789/0 conn(0x7fc6100b2600 legacy=0x7fc6100ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.567+0000 7fc615600640 1 -- 172.21.15.192:0/3777847576 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100b1e00 con 0x7fc6100adf50 2024-09-13T18:43:19.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.568+0000 7fc615600640 1 --2- 172.21.15.192:0/3777847576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6100adf50 0x7fc6100cc760 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc608009d90 tx=0x7fc60802a660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59f845968d6183e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.569+0000 7fc60f400640 1 -- 172.21.15.192:0/3777847576 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007740 con 0x7fc6100adf50 2024-09-13T18:43:19.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.569+0000 7fc60f400640 1 -- 172.21.15.192:0/3777847576 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60802d050 con 0x7fc6100adf50 2024-09-13T18:43:19.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.569+0000 7fc60f400640 1 -- 172.21.15.192:0/3777847576 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608007aa0 con 0x7fc6100adf50 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.569+0000 7fc617600640 1 -- 172.21.15.192:0/3777847576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6100adf50 msgr2=0x7fc6100cc760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.569+0000 7fc617600640 1 --2- 172.21.15.192:0/3777847576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6100adf50 0x7fc6100cc760 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fc608009d90 tx=0x7fc60802a660 comp rx=0 tx=0).stop 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.570+0000 7fc617600640 1 -- 172.21.15.192:0/3777847576 shutdown_connections 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.570+0000 7fc617600640 1 --2- 172.21.15.192:0/3777847576 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc6100adf50 0x7fc6100cc760 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.570+0000 7fc617600640 1 -- 172.21.15.192:0/3777847576 >> 172.21.15.192:0/3777847576 conn(0x7fc6100b08f0 msgr2=0x7fc6100b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.570+0000 7fc617600640 1 -- 172.21.15.192:0/3777847576 shutdown_connections 2024-09-13T18:43:19.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.570+0000 7fc617600640 1 -- 172.21.15.192:0/3777847576 wait complete. 2024-09-13T18:43:19.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.571+0000 7fc617600640 1 Processor -- start 2024-09-13T18:43:19.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.571+0000 7fc617600640 1 -- start start 2024-09-13T18:43:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 0x7fc610159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 0x7fc610154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc610158810 con 0x7fc6100adf50 2024-09-13T18:43:19.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100708e0 con 0x7fc61015a910 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc617600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61015a080 con 0x7fc6100b2600 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc614c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc614c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59536/0 (socket says 172.21.15.192:59536) 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.572+0000 7fc614c00640 1 -- 172.21.15.192:0/3436809876 learned_addr learned my addr 172.21.15.192:0/3436809876 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc615600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 0x7fc610154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc60fe00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 0x7fc610159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 -- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 msgr2=0x7fc610159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 0x7fc610159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 -- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 msgr2=0x7fc610154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 0x7fc610154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:19.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 -- 172.21.15.192:0/3436809876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc608009a70 con 0x7fc6100adf50 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc60fe00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 0x7fc610159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc615600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 0x7fc610154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc614c00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c400 tx=0x7fc60000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6000052d0 con 0x7fc6100adf50 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600005430 con 0x7fc6100adf50 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600003830 con 0x7fc6100adf50 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.573+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc610157f00 con 0x7fc6100adf50 2024-09-13T18:43:19.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.574+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc610070ad0 con 0x7fc6100adf50 2024-09-13T18:43:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.575+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc610158950 con 0x7fc6100adf50 2024-09-13T18:43:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.575+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc600003990 con 0x7fc6100adf50 2024-09-13T18:43:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.576+0000 7fc60cc00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 0x7fc5f006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:19.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.576+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6000888e0 con 0x7fc6100adf50 2024-09-13T18:43:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.577+0000 7fc60fe00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 0x7fc5f006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:19.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.577+0000 7fc60fe00640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 0x7fc5f006d0c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc6101f5c30 tx=0x7fc5fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:19.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.581+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc610158950 con 0x7fc6100adf50 2024-09-13T18:43:19.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:19.786+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc6100cb4e0 con 0x7fc6100adf50 2024-09-13T18:43:20.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.665+0000 7fc60cc00640 1 -- 172.21.15.192:0/3436809876 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc6000170b0 con 0x7fc6100adf50 2024-09-13T18:43:20.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 msgr2=0x7fc5f006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 0x7fc5f006d0c0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc6101f5c30 tx=0x7fc5fc009040 comp rx=0 tx=0).stop 2024-09-13T18:43:20.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 msgr2=0x7fc6100703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fc60000c400 tx=0x7fc60000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 shutdown_connections 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc5f006ac00 0x7fc5f006d0c0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc61015a910 0x7fc610154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc6100b2600 0x7fc610159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 --2- 172.21.15.192:0/3436809876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc6100adf50 0x7fc6100703a0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 >> 172.21.15.192:0/3436809876 conn(0x7fc6100b08f0 msgr2=0x7fc6100cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 shutdown_connections 2024-09-13T18:43:20.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.668+0000 7fc617600640 1 -- 172.21.15.192:0/3436809876 wait complete. 2024-09-13T18:43:20.689 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:43:20.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:43:20.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.845+0000 7fb77a400640 1 Processor -- start 2024-09-13T18:43:20.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.845+0000 7fb77a400640 1 -- start start 2024-09-13T18:43:20.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.846+0000 7fb77a400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7741434c0 0x7fb77406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.846+0000 7fb77a400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb7740b3da0 0x7fb77406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.846+0000 7fb77a400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb77406b480 con 0x7fb77406a8b0 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.846+0000 7fb77a400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740ce770 con 0x7fb7741434c0 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.846+0000 7fb77a400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb77406b760 con 0x7fb7740b3da0 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7741434c0 0x7fb77406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7741434c0 0x7fb77406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36250/0 (socket says 172.21.15.192:36250) 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb76aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb77406a8b0 0x7fb7740b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36868/0 (socket says 172.21.15.192:36868) 2024-09-13T18:43:20.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 -- 172.21.15.192:0/3117883274 learned_addr learned my addr 172.21.15.192:0/3117883274 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 -- 172.21.15.192:0/3117883274 >> v2:172.21.15.194:3300/0 conn(0x7fb7740b3da0 msgr2=0x7fb77406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 --2- 172.21.15.192:0/3117883274 >> v2:172.21.15.194:3300/0 conn(0x7fb7740b3da0 0x7fb77406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 -- 172.21.15.192:0/3117883274 >> v1:172.21.15.192:6789/0 conn(0x7fb77406a8b0 legacy=0x7fb7740b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb773400640 1 -- 172.21.15.192:0/3117883274 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77406ba40 con 0x7fb7741434c0 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.847+0000 7fb772a00640 1 -- 172.21.15.192:0/3117883274 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261380360 0 0) 0x7fb77406b480 con 0x7fb77406a8b0 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.848+0000 7fb773400640 1 --2- 172.21.15.192:0/3117883274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7741434c0 0x7fb77406c800 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cdd20 tx=0x7fb76402c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a70034216469c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:20.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.848+0000 7fb772a00640 1 -- 172.21.15.192:0/3117883274 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764031710 con 0x7fb7741434c0 2024-09-13T18:43:20.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.848+0000 7fb772a00640 1 -- 172.21.15.192:0/3117883274 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76402f050 con 0x7fb7741434c0 2024-09-13T18:43:20.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.848+0000 7fb772a00640 1 -- 172.21.15.192:0/3117883274 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764031a90 con 0x7fb7741434c0 2024-09-13T18:43:20.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 -- 172.21.15.192:0/3117883274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7741434c0 msgr2=0x7fb77406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 --2- 172.21.15.192:0/3117883274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7741434c0 0x7fb77406c800 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cdd20 tx=0x7fb76402c3f0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 -- 172.21.15.192:0/3117883274 shutdown_connections 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 --2- 172.21.15.192:0/3117883274 >> v2:172.21.15.194:3300/0 conn(0x7fb7740b3da0 0x7fb77406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 --2- 172.21.15.192:0/3117883274 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7741434c0 0x7fb77406c800 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 -- 172.21.15.192:0/3117883274 >> 172.21.15.192:0/3117883274 conn(0x7fb7740b08f0 msgr2=0x7fb7740b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 -- 172.21.15.192:0/3117883274 shutdown_connections 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.849+0000 7fb77a400640 1 -- 172.21.15.192:0/3117883274 wait complete. 2024-09-13T18:43:20.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.851+0000 7fb77a400640 1 Processor -- start 2024-09-13T18:43:20.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.851+0000 7fb77a400640 1 -- start start 2024-09-13T18:43:20.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77406a8b0 0x7fb7740adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 0x7fb7741f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774140d90 con 0x7fb7740b3da0 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb774140180 con 0x7fb7741434c0 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb77a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb774140460 con 0x7fb77406a8b0 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36266/0 (socket says 172.21.15.192:36266) 2024-09-13T18:43:20.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 -- 172.21.15.192:0/3329585574 learned_addr learned my addr 172.21.15.192:0/3329585574 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 -- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77406a8b0 msgr2=0x7fb7740adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77406a8b0 0x7fb7740adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 -- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 msgr2=0x7fb7741f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb773e00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 0x7fb7741f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 0x7fb7741f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb76aa00640 1 -- 172.21.15.192:0/3329585574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094d0 con 0x7fb7740b3da0 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.852+0000 7fb773e00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 0x7fb7741f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:20.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb76aa00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c4d0 tx=0x7fb75c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0074e0 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c007660 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb774140740 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c004a20 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.853+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb77413fe30 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.854+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7740cc7d0 con 0x7fb7740b3da0 2024-09-13T18:43:20.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.855+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb75c004b80 con 0x7fb7740b3da0 2024-09-13T18:43:20.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.856+0000 7fb76be00640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 0x7fb75006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:20.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.856+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb75c088980 con 0x7fb7740b3da0 2024-09-13T18:43:20.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.856+0000 7fb773400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 0x7fb75006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:20.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.857+0000 7fb773400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 0x7fb75006d0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb764035000 tx=0x7fb764030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:20.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:20.860+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb75c053a30 con 0x7fb7740b3da0 2024-09-13T18:43:21.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.059+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb774140ed0 con 0x7fb7740b3da0 2024-09-13T18:43:21.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.671+0000 7fb76be00640 1 -- 172.21.15.192:0/3329585574 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb774140ed0 con 0x7fb7740b3da0 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 msgr2=0x7fb75006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 0x7fb75006d0c0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb764035000 tx=0x7fb764030000 comp rx=0 tx=0).stop 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 msgr2=0x7fb774141ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fb75c00c4d0 tx=0x7fb75c00c990 comp rx=0 tx=0).stop 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 shutdown_connections 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb75006ac00 0x7fb75006d0c0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7741434c0 0x7fb7741f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7740b3da0 0x7fb774141ee0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 --2- 172.21.15.192:0/3329585574 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb77406a8b0 0x7fb7740adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 >> 172.21.15.192:0/3329585574 conn(0x7fb7740b08f0 msgr2=0x7fb77415aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 shutdown_connections 2024-09-13T18:43:21.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.674+0000 7fb77a400640 1 -- 172.21.15.192:0/3329585574 wait complete. 2024-09-13T18:43:21.695 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:43:21.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:21.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.846+0000 7f4e73e00640 1 Processor -- start 2024-09-13T18:43:21.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.846+0000 7f4e73e00640 1 -- start start 2024-09-13T18:43:21.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4e74159b00 0x7f4e740b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:21.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7415af60 con 0x7f4e7415a5f0 2024-09-13T18:43:21.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e7415aa40 con 0x7f4e7406bc30 2024-09-13T18:43:21.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e7406b7a0 con 0x7f4e74159b00 2024-09-13T18:43:21.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4e7415a5f0 0x7f4e740cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36876/0 (socket says 172.21.15.192:36876) 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e73400640 1 -- 172.21.15.192:0/365319429 learned_addr learned my addr 172.21.15.192:0/365319429 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e72a00640 1 --2- 172.21.15.192:0/365319429 >> v2:172.21.15.194:3300/0 conn(0x7f4e74159b00 0x7f4e740b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.848+0000 7f4e71600640 1 -- 172.21.15.192:0/365319429 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833691079 0 0) 0x7f4e7415af60 con 0x7f4e7415a5f0 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.849+0000 7f4e71600640 1 -- 172.21.15.192:0/365319429 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e58003520 con 0x7f4e7415a5f0 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.849+0000 7f4e72a00640 1 -- 172.21.15.192:0/365319429 >> v1:172.21.15.194:6789/0 conn(0x7f4e7406bc30 legacy=0x7f4e74159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.849+0000 7f4e72a00640 1 -- 172.21.15.192:0/365319429 >> v1:172.21.15.192:6789/0 conn(0x7f4e7415a5f0 legacy=0x7f4e740cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.849+0000 7f4e72a00640 1 -- 172.21.15.192:0/365319429 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e7415ac80 con 0x7f4e74159b00 2024-09-13T18:43:21.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.850+0000 7f4e72a00640 1 --2- 172.21.15.192:0/365319429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e74159b00 0x7f4e740b2d70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009d90 tx=0x7f4e6402a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bd5027c4bd92e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:21.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.850+0000 7f4e71600640 1 -- 172.21.15.192:0/365319429 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64007740 con 0x7f4e74159b00 2024-09-13T18:43:21.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.850+0000 7f4e71600640 1 -- 172.21.15.192:0/365319429 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e6402d050 con 0x7f4e74159b00 2024-09-13T18:43:21.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.850+0000 7f4e71600640 1 -- 172.21.15.192:0/365319429 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e64007aa0 con 0x7f4e74159b00 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 -- 172.21.15.192:0/365319429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e74159b00 msgr2=0x7f4e740b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 --2- 172.21.15.192:0/365319429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e74159b00 0x7f4e740b2d70 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009d90 tx=0x7f4e6402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 -- 172.21.15.192:0/365319429 shutdown_connections 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 --2- 172.21.15.192:0/365319429 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e74159b00 0x7f4e740b2d70 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 -- 172.21.15.192:0/365319429 >> 172.21.15.192:0/365319429 conn(0x7f4e740736d0 msgr2=0x7f4e740b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 -- 172.21.15.192:0/365319429 shutdown_connections 2024-09-13T18:43:21.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.851+0000 7f4e73e00640 1 -- 172.21.15.192:0/365319429 wait complete. 2024-09-13T18:43:21.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.852+0000 7f4e73e00640 1 Processor -- start 2024-09-13T18:43:21.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.852+0000 7f4e73e00640 1 -- start start 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 0x7f4e74143570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e7415a5f0 0x7f4e740add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e74143ab0 con 0x7f4e74159b00 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e740af800 con 0x7f4e7415a5f0 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e73e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7415d080 con 0x7f4e7406bc30 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.853+0000 7f4e72000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36282/0 (socket says 172.21.15.192:36282) 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 -- 172.21.15.192:0/4071170786 learned_addr learned my addr 172.21.15.192:0/4071170786 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:21.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e73400640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e7415a5f0 0x7f4e740add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72a00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 0x7f4e74143570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 -- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 msgr2=0x7f4e74143570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 0x7f4e74143570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 -- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e7415a5f0 msgr2=0x7f4e740add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e7415a5f0 0x7f4e740add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 -- 172.21.15.192:0/4071170786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009a70 con 0x7f4e74159b00 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72a00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 0x7f4e74143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:21.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.854+0000 7f4e72000640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c400 tx=0x7f4e6000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:21.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.855+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e600052d0 con 0x7f4e74159b00 2024-09-13T18:43:21.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.855+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e60005450 con 0x7f4e74159b00 2024-09-13T18:43:21.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.855+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7415cda0 con 0x7f4e74159b00 2024-09-13T18:43:21.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.855+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e60007260 con 0x7f4e74159b00 2024-09-13T18:43:21.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.855+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e741516a0 con 0x7f4e74159b00 2024-09-13T18:43:21.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.856+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e740b2d70 con 0x7f4e74159b00 2024-09-13T18:43:21.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.857+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4e600073c0 con 0x7f4e74159b00 2024-09-13T18:43:21.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.857+0000 7f4e6b400640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 0x7f4e5406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:21.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.857+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e60088500 con 0x7f4e74159b00 2024-09-13T18:43:21.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.858+0000 7f4e72a00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 0x7f4e5406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:21.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.858+0000 7f4e72a00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 0x7f4e5406d0c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:21.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:21.862+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4e60053780 con 0x7f4e74159b00 2024-09-13T18:43:22.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.066+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e7415aa40 con 0x7f4e74159b00 2024-09-13T18:43:22.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.067+0000 7f4e6b400640 1 -- 172.21.15.192:0/4071170786 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f4e7415aa40 con 0x7f4e74159b00 2024-09-13T18:43:22.070 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:22.070 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:43:22.070 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 msgr2=0x7f4e5406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 0x7f4e5406d0c0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f4e64034000 tx=0x7f4e6402f000 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 msgr2=0x7f4e740ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f4e6000c400 tx=0x7f4e6000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 shutdown_connections 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4e5406ac00 0x7f4e5406d0c0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4e7415a5f0 0x7f4e740add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e74159b00 0x7f4e740ad840 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 --2- 172.21.15.192:0/4071170786 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4e7406bc30 0x7f4e74143570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 >> 172.21.15.192:0/4071170786 conn(0x7f4e740736d0 msgr2=0x7f4e74155f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 shutdown_connections 2024-09-13T18:43:22.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.069+0000 7f4e73e00640 1 -- 172.21.15.192:0/4071170786 wait complete. 2024-09-13T18:43:22.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:43:22.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.239+0000 7ff95dc00640 1 Processor -- start 2024-09-13T18:43:22.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.239+0000 7ff95dc00640 1 -- start start 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff95dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff9580cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff95dc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff95815bc20 0x7ff9580afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff95dc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff958140480 con 0x7ff9580cacd0 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff95dc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9580cb5f0 con 0x7ff95815bc20 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff95dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815ebd0 con 0x7ff95815e790 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff956a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff9580cacd0 0x7ff958140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36882/0 (socket says 172.21.15.192:36882) 2024-09-13T18:43:22.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.240+0000 7ff956a00640 1 -- 172.21.15.192:0/3863136815 learned_addr learned my addr 172.21.15.192:0/3863136815 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff9580cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff957400640 1 --2- 172.21.15.192:0/3863136815 >> v2:172.21.15.194:3300/0 conn(0x7ff95815bc20 0x7ff9580afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2647003146 0 0) 0x7ff958140480 con 0x7ff9580cacd0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff93c003520 con 0x7ff9580cacd0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1008602450 0 0) 0x7ff93c003520 con 0x7ff9580cacd0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 msgr2=0x7ff9580cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff9580cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 >> v2:172.21.15.194:3300/0 conn(0x7ff95815bc20 msgr2=0x7ff9580afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 --2- 172.21.15.192:0/3863136815 >> v2:172.21.15.194:3300/0 conn(0x7ff95815bc20 0x7ff9580afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95815ee90 con 0x7ff9580cacd0 2024-09-13T18:43:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7ff948001670 con 0x7ff9580cacd0 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff9580cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 >> v1:172.21.15.192:6789/0 conn(0x7ff9580cacd0 legacy=0x7ff958140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff93c003970 0x7ff93c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff93c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff93c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95815ebd0 con 0x7ff93c0047c0 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c004630 con 0x7ff93c003970 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff93c00ba00 con 0x7ff95815e790 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.241+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff93c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff956a00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff93c003970 0x7ff93c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff957400640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff93c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff94fe00640 1 -- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 msgr2=0x7ff93c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:22.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff93c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff94fe00640 1 -- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff93c003970 msgr2=0x7ff93c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff93c003970 0x7ff93c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff94fe00640 1 -- 172.21.15.192:0/3863136815 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009400 con 0x7ff93c0047c0 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.242+0000 7ff957400640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff95815e790 0x7ff93c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.243+0000 7ff94fe00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff93c004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff940009c90 tx=0x7ff93c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727de16782bcdc1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.243+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940031400 con 0x7ff93c0047c0 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.243+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94002d050 con 0x7ff93c0047c0 2024-09-13T18:43:22.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.243+0000 7ff956000640 1 -- 172.21.15.192:0/3863136815 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff940031760 con 0x7ff93c0047c0 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 -- 172.21.15.192:0/3863136815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 msgr2=0x7ff93c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 --2- 172.21.15.192:0/3863136815 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff93c004c40 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7ff940009c90 tx=0x7ff93c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff957400640 1 -- 172.21.15.192:0/3863136815 reap_dead start 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 -- 172.21.15.192:0/3863136815 shutdown_connections 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 -- 172.21.15.192:0/3863136815 >> 172.21.15.192:0/3863136815 conn(0x7ff9580ae960 msgr2=0x7ff95806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 -- 172.21.15.192:0/3863136815 shutdown_connections 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.244+0000 7ff95dc00640 1 -- 172.21.15.192:0/3863136815 wait complete. 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.245+0000 7ff95dc00640 1 Processor -- start 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.246+0000 7ff95dc00640 1 -- start start 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.246+0000 7ff95dc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.246+0000 7ff95dc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9581f1020 0x7ff95813f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff95dc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9581ed640 0x7ff9581edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff95dc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95806ae70 con 0x7ff93c0047c0 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff95dc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9580a9970 con 0x7ff9581ed640 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff95dc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9581edfe0 con 0x7ff9581f1020 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36290/0 (socket says 172.21.15.192:36290) 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 -- 172.21.15.192:0/1009126031 learned_addr learned my addr 172.21.15.192:0/1009126031 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff94fe00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9581f1020 0x7ff95813f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff957400640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9581ed640 0x7ff9581edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 -- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9581f1020 msgr2=0x7ff95813f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9581f1020 0x7ff95813f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 -- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9581ed640 msgr2=0x7ff9581edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9581ed640 0x7ff9581edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 -- 172.21.15.192:0/1009126031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff95806b8c0 con 0x7ff93c0047c0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.247+0000 7ff956a00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff948007340 tx=0x7ff948007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.248+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800f860 con 0x7ff93c0047c0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.248+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff94800f9e0 con 0x7ff93c0047c0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.248+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95806a2f0 con 0x7ff93c0047c0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.248+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff94800fd90 con 0x7ff93c0047c0 2024-09-13T18:43:22.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.248+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95806a8b0 con 0x7ff93c0047c0 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.249+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9580cb0b0 con 0x7ff93c0047c0 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.250+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff94801d460 con 0x7ff93c0047c0 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.250+0000 7ff94ea00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 0x7ff93406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.251+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff948089500 con 0x7ff93c0047c0 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.251+0000 7ff94fe00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 0x7ff93406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.252+0000 7ff94fe00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 0x7ff93406d0f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff940033000 tx=0x7ff940008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.255+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff9480546e0 con 0x7ff93c0047c0 2024-09-13T18:43:22.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.423+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff95806c6c0 con 0x7ff93c0047c0 2024-09-13T18:43:22.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.424+0000 7ff94ea00640 1 -- 172.21.15.192:0/1009126031 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+16588 (secure 0 0 0) 0x7ff948057d00 con 0x7ff93c0047c0 2024-09-13T18:43:22.427 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:22.428 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":165,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:43:19.652275+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"165","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.426+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 msgr2=0x7ff93406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.426+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 0x7ff93406d0f0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff940033000 tx=0x7ff940008030 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.426+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 msgr2=0x7ff9580a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.426+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7ff948007340 tx=0x7ff948007800 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 shutdown_connections 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff93406ac30 0x7ff93406d0f0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff9581ed640 0x7ff9581edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff9581f1020 0x7ff95813f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 --2- 172.21.15.192:0/1009126031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff93c0047c0 0x7ff9580a9430 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 >> 172.21.15.192:0/1009126031 conn(0x7ff9580ae960 msgr2=0x7ff958070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:22.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 shutdown_connections 2024-09-13T18:43:22.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.427+0000 7ff95dc00640 1 -- 172.21.15.192:0/1009126031 wait complete. 2024-09-13T18:43:22.445 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:43:22.445 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:22.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.595+0000 7ff358600640 1 Processor -- start 2024-09-13T18:43:22.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.595+0000 7ff358600640 1 -- start start 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff358600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3500afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff358600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 0x7ff35015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff358600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3500b2f00 con 0x7ff3500b3f10 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff358600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3500b3150 con 0x7ff35015e2c0 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff358600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3500b3430 con 0x7ff35015dee0 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff355200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff3500b3f10 0x7ff35015a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36894/0 (socket says 172.21.15.192:36894) 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.596+0000 7ff355200640 1 -- 172.21.15.192:0/4019223377 learned_addr learned my addr 172.21.15.192:0/4019223377 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff355c00640 1 --2- 172.21.15.192:0/4019223377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3500afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff356600640 1 --2- 172.21.15.192:0/4019223377 >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 0x7ff35015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff34fe00640 1 -- 172.21.15.192:0/4019223377 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2203727461 0 0) 0x7ff3500b2f00 con 0x7ff3500b3f10 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff34fe00640 1 -- 172.21.15.192:0/4019223377 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff338003520 con 0x7ff3500b3f10 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff355c00640 1 -- 172.21.15.192:0/4019223377 >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 msgr2=0x7ff35015ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff355c00640 1 --2- 172.21.15.192:0/4019223377 >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 0x7ff35015ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff355c00640 1 -- 172.21.15.192:0/4019223377 >> v1:172.21.15.192:6789/0 conn(0x7ff3500b3f10 legacy=0x7ff35015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff355c00640 1 -- 172.21.15.192:0/4019223377 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3500b3710 con 0x7ff35015dee0 2024-09-13T18:43:22.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.597+0000 7ff356600640 1 --2- 172.21.15.192:0/4019223377 >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 0x7ff35015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:22.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.598+0000 7ff355c00640 1 --2- 172.21.15.192:0/4019223377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3500afd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff34400ba40 tx=0x7ff34402c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=761e067181fbb2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff34fe00640 1 -- 172.21.15.192:0/4019223377 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344032750 con 0x7ff35015dee0 2024-09-13T18:43:22.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff34fe00640 1 -- 172.21.15.192:0/4019223377 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3440328b0 con 0x7ff35015dee0 2024-09-13T18:43:22.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff34fe00640 1 -- 172.21.15.192:0/4019223377 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344032c40 con 0x7ff35015dee0 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 -- 172.21.15.192:0/4019223377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 msgr2=0x7ff3500afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 --2- 172.21.15.192:0/4019223377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3500afd80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff34400ba40 tx=0x7ff34402c850 comp rx=0 tx=0).stop 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 -- 172.21.15.192:0/4019223377 shutdown_connections 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 --2- 172.21.15.192:0/4019223377 >> v2:172.21.15.194:3300/0 conn(0x7ff35015e2c0 0x7ff35015ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 --2- 172.21.15.192:0/4019223377 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3500afd80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 -- 172.21.15.192:0/4019223377 >> 172.21.15.192:0/4019223377 conn(0x7ff3500ae960 msgr2=0x7ff35006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:22.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 -- 172.21.15.192:0/4019223377 shutdown_connections 2024-09-13T18:43:22.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.599+0000 7ff358600640 1 -- 172.21.15.192:0/4019223377 wait complete. 2024-09-13T18:43:22.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.601+0000 7ff358600640 1 Processor -- start 2024-09-13T18:43:22.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.601+0000 7ff358600640 1 -- start start 2024-09-13T18:43:22.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3501f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 0x7ff3501503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350136520 con 0x7ff35015e2c0 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff350136e80 con 0x7ff3501558b0 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff358600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3501560b0 con 0x7ff35015dee0 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff355200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff355200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36298/0 (socket says 172.21.15.192:36298) 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff355200640 1 -- 172.21.15.192:0/897250179 learned_addr learned my addr 172.21.15.192:0/897250179 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:22.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff355c00640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3501f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.602+0000 7ff356600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 0x7ff3501503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 -- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 msgr2=0x7ff3501f6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3501f6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 -- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 msgr2=0x7ff3501503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 0x7ff3501503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 -- 172.21.15.192:0/897250179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff348009a70 con 0x7ff35015e2c0 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff356600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 0x7ff3501503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff355200640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c500 tx=0x7ff33c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c005ce0 con 0x7ff35015e2c0 2024-09-13T18:43:22.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33c005e40 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33c007330 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34400b6a0 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.603+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff350136140 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.604+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff350136660 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.605+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff33c007550 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.606+0000 7ff34d600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 0x7ff33006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.606+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff33c088900 con 0x7ff35015e2c0 2024-09-13T18:43:22.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.606+0000 7ff355c00640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 0x7ff33006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:22.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.607+0000 7ff355c00640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 0x7ff33006d0c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff344037000 tx=0x7ff344032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:22.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.610+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff350136660 con 0x7ff35015e2c0 2024-09-13T18:43:22.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.777+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff35006c400 con 0x7ff33006ac00 2024-09-13T18:43:22.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.785+0000 7ff34d600640 1 -- 172.21.15.192:0/897250179 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285143 (secure 0 0 0) 0x7ff35006c400 con 0x7ff33006ac00 2024-09-13T18:43:22.790 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:22.793 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 msgr2=0x7ff33006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 0x7ff33006d0c0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff344037000 tx=0x7ff344032000 comp rx=0 tx=0).stop 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 msgr2=0x7ff350136940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ff33c00c500 tx=0x7ff33c00c9c0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 shutdown_connections 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff33006ac00 0x7ff33006d0c0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff3501558b0 0x7ff3501503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff35015e2c0 0x7ff350136940 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 --2- 172.21.15.192:0/897250179 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff35015dee0 0x7ff3501f6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:22.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 >> 172.21.15.192:0/897250179 conn(0x7ff3500ae960 msgr2=0x7ff35006f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:22.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 shutdown_connections 2024-09-13T18:43:22.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:22.791+0000 7ff358600640 1 -- 172.21.15.192:0/897250179 wait complete. 2024-09-13T18:43:22.810 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2024-09-13T18:43:20.834725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554239,"statfs":{"total":1600000000,"available":1591541640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000903"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.660692+0000","last_change":"2024-09-13T18:43:18.660574+0000","last_active":"2024-09-13T18:43:18.660692+0000","last_peered":"2024-09-13T18:43:18.660692+0000","last_clean":"2024-09-13T18:43:18.660692+0000","last_became_active":"2024-09-13T18:43:18.660302+0000","last_became_peered":"2024-09-13T18:43:18.660302+0000","last_unstale":"2024-09-13T18:43:18.660692+0000","last_undegraded":"2024-09-13T18:43:18.660692+0000","last_fullsized":"2024-09-13T18:43:18.660692+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671959+0000","last_change":"2024-09-13T18:43:18.671352+0000","last_active":"2024-09-13T18:43:18.671959+0000","last_peered":"2024-09-13T18:43:18.671959+0000","last_clean":"2024-09-13T18:43:18.671959+0000","last_became_active":"2024-09-13T18:43:18.670676+0000","last_became_peered":"2024-09-13T18:43:18.670676+0000","last_unstale":"2024-09-13T18:43:18.671959+0000","last_undegraded":"2024-09-13T18:43:18.671959+0000","last_fullsized":"2024-09-13T18:43:18.671959+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:42.416033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.676801+0000","last_change":"2024-09-13T18:43:18.675749+0000","last_active":"2024-09-13T18:43:18.676801+0000","last_peered":"2024-09-13T18:43:18.676801+0000","last_clean":"2024-09-13T18:43:18.676801+0000","last_became_active":"2024-09-13T18:43:18.675411+0000","last_became_peered":"2024-09-13T18:43:18.675411+0000","last_unstale":"2024-09-13T18:43:18.676801+0000","last_undegraded":"2024-09-13T18:43:18.676801+0000","last_fullsized":"2024-09-13T18:43:18.676801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:35.793772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660156+0000","last_change":"2024-09-13T18:43:18.657379+0000","last_active":"2024-09-13T18:43:19.660156+0000","last_peered":"2024-09-13T18:43:19.660156+0000","last_clean":"2024-09-13T18:43:19.660156+0000","last_became_active":"2024-09-13T18:43:18.657109+0000","last_became_peered":"2024-09-13T18:43:18.657109+0000","last_unstale":"2024-09-13T18:43:19.660156+0000","last_undegraded":"2024-09-13T18:43:19.660156+0000","last_fullsized":"2024-09-13T18:43:19.660156+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:43.310377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670140+0000","last_change":"2024-09-13T18:43:18.669932+0000","last_active":"2024-09-13T18:43:18.670140+0000","last_peered":"2024-09-13T18:43:18.670140+0000","last_clean":"2024-09-13T18:43:18.670140+0000","last_became_active":"2024-09-13T18:43:18.668741+0000","last_became_peered":"2024-09-13T18:43:18.668741+0000","last_unstale":"2024-09-13T18:43:18.670140+0000","last_undegraded":"2024-09-13T18:43:18.670140+0000","last_fullsized":"2024-09-13T18:43:18.670140+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:06.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661745+0000","last_change":"2024-09-13T18:43:18.661675+0000","last_active":"2024-09-13T18:43:18.661745+0000","last_peered":"2024-09-13T18:43:18.661745+0000","last_clean":"2024-09-13T18:43:18.661745+0000","last_became_active":"2024-09-13T18:43:18.661398+0000","last_became_peered":"2024-09-13T18:43:18.661398+0000","last_unstale":"2024-09-13T18:43:18.661745+0000","last_undegraded":"2024-09-13T18:43:18.661745+0000","last_fullsized":"2024-09-13T18:43:18.661745+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:42.214712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.668149+0000","last_change":"2024-09-13T18:43:18.667897+0000","last_active":"2024-09-13T18:43:18.668149+0000","last_peered":"2024-09-13T18:43:18.668149+0000","last_clean":"2024-09-13T18:43:18.668149+0000","last_became_active":"2024-09-13T18:43:18.666693+0000","last_became_peered":"2024-09-13T18:43:18.666693+0000","last_unstale":"2024-09-13T18:43:18.668149+0000","last_undegraded":"2024-09-13T18:43:18.668149+0000","last_fullsized":"2024-09-13T18:43:18.668149+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:39.566527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669883+0000","last_change":"2024-09-13T18:43:18.669103+0000","last_active":"2024-09-13T18:43:18.669883+0000","last_peered":"2024-09-13T18:43:18.669883+0000","last_clean":"2024-09-13T18:43:18.669883+0000","last_became_active":"2024-09-13T18:43:18.668194+0000","last_became_peered":"2024-09-13T18:43:18.668194+0000","last_unstale":"2024-09-13T18:43:18.669883+0000","last_undegraded":"2024-09-13T18:43:18.669883+0000","last_fullsized":"2024-09-13T18:43:18.669883+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:22.125005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674261+0000","last_change":"2024-09-13T18:43:18.672719+0000","last_active":"2024-09-13T18:43:18.674261+0000","last_peered":"2024-09-13T18:43:18.674261+0000","last_clean":"2024-09-13T18:43:18.674261+0000","last_became_active":"2024-09-13T18:43:18.670847+0000","last_became_peered":"2024-09-13T18:43:18.670847+0000","last_unstale":"2024-09-13T18:43:18.674261+0000","last_undegraded":"2024-09-13T18:43:18.674261+0000","last_fullsized":"2024-09-13T18:43:18.674261+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:19.483462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.659828+0000","last_change":"2024-09-13T18:43:18.659743+0000","last_active":"2024-09-13T18:43:18.659828+0000","last_peered":"2024-09-13T18:43:18.659828+0000","last_clean":"2024-09-13T18:43:18.659828+0000","last_became_active":"2024-09-13T18:43:18.659516+0000","last_became_peered":"2024-09-13T18:43:18.659516+0000","last_unstale":"2024-09-13T18:43:18.659828+0000","last_undegraded":"2024-09-13T18:43:18.659828+0000","last_fullsized":"2024-09-13T18:43:18.659828+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:34.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660389+0000","last_change":"2024-09-13T18:43:18.666387+0000","last_active":"2024-09-13T18:43:19.660389+0000","last_peered":"2024-09-13T18:43:19.660389+0000","last_clean":"2024-09-13T18:43:19.660389+0000","last_became_active":"2024-09-13T18:43:18.666148+0000","last_became_peered":"2024-09-13T18:43:18.666148+0000","last_unstale":"2024-09-13T18:43:19.660389+0000","last_undegraded":"2024-09-13T18:43:19.660389+0000","last_fullsized":"2024-09-13T18:43:19.660389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.781783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677035+0000","last_change":"2024-09-13T18:43:18.676918+0000","last_active":"2024-09-13T18:43:18.677035+0000","last_peered":"2024-09-13T18:43:18.677035+0000","last_clean":"2024-09-13T18:43:18.677035+0000","last_became_active":"2024-09-13T18:43:18.676489+0000","last_became_peered":"2024-09-13T18:43:18.676489+0000","last_unstale":"2024-09-13T18:43:18.677035+0000","last_undegraded":"2024-09-13T18:43:18.677035+0000","last_fullsized":"2024-09-13T18:43:18.677035+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660477+0000","last_change":"2024-09-13T18:43:18.676058+0000","last_active":"2024-09-13T18:43:19.660477+0000","last_peered":"2024-09-13T18:43:19.660477+0000","last_clean":"2024-09-13T18:43:19.660477+0000","last_became_active":"2024-09-13T18:43:18.675171+0000","last_became_peered":"2024-09-13T18:43:18.675171+0000","last_unstale":"2024-09-13T18:43:19.660477+0000","last_undegraded":"2024-09-13T18:43:19.660477+0000","last_fullsized":"2024-09-13T18:43:19.660477+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671222+0000","last_change":"2024-09-13T18:43:18.671109+0000","last_active":"2024-09-13T18:43:18.671222+0000","last_peered":"2024-09-13T18:43:18.671222+0000","last_clean":"2024-09-13T18:43:18.671222+0000","last_became_active":"2024-09-13T18:43:18.670268+0000","last_became_peered":"2024-09-13T18:43:18.670268+0000","last_unstale":"2024-09-13T18:43:18.671222+0000","last_undegraded":"2024-09-13T18:43:18.671222+0000","last_fullsized":"2024-09-13T18:43:18.671222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:35.084057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673019+0000","last_change":"2024-09-13T18:43:18.672663+0000","last_active":"2024-09-13T18:43:18.673019+0000","last_peered":"2024-09-13T18:43:18.673019+0000","last_clean":"2024-09-13T18:43:18.673019+0000","last_became_active":"2024-09-13T18:43:18.671632+0000","last_became_peered":"2024-09-13T18:43:18.671632+0000","last_unstale":"2024-09-13T18:43:18.673019+0000","last_undegraded":"2024-09-13T18:43:18.673019+0000","last_fullsized":"2024-09-13T18:43:18.673019+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:38.145667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673646+0000","last_change":"2024-09-13T18:43:18.672650+0000","last_active":"2024-09-13T18:43:18.673646+0000","last_peered":"2024-09-13T18:43:18.673646+0000","last_clean":"2024-09-13T18:43:18.673646+0000","last_became_active":"2024-09-13T18:43:18.672392+0000","last_became_peered":"2024-09-13T18:43:18.672392+0000","last_unstale":"2024-09-13T18:43:18.673646+0000","last_undegraded":"2024-09-13T18:43:18.673646+0000","last_fullsized":"2024-09-13T18:43:18.673646+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:51.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664790+0000","last_change":"2024-09-13T18:43:18.664732+0000","last_active":"2024-09-13T18:43:18.664790+0000","last_peered":"2024-09-13T18:43:18.664790+0000","last_clean":"2024-09-13T18:43:18.664790+0000","last_became_active":"2024-09-13T18:43:18.664159+0000","last_became_peered":"2024-09-13T18:43:18.664159+0000","last_unstale":"2024-09-13T18:43:18.664790+0000","last_undegraded":"2024-09-13T18:43:18.664790+0000","last_fullsized":"2024-09-13T18:43:18.664790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:50.383610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673521+0000","last_change":"2024-09-13T18:43:18.673462+0000","last_active":"2024-09-13T18:43:18.673521+0000","last_peered":"2024-09-13T18:43:18.673521+0000","last_clean":"2024-09-13T18:43:18.673521+0000","last_became_active":"2024-09-13T18:43:18.672691+0000","last_became_peered":"2024-09-13T18:43:18.672691+0000","last_unstale":"2024-09-13T18:43:18.673521+0000","last_undegraded":"2024-09-13T18:43:18.673521+0000","last_fullsized":"2024-09-13T18:43:18.673521+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:50.312249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669420+0000","last_change":"2024-09-13T18:43:18.668891+0000","last_active":"2024-09-13T18:43:18.669420+0000","last_peered":"2024-09-13T18:43:18.669420+0000","last_clean":"2024-09-13T18:43:18.669420+0000","last_became_active":"2024-09-13T18:43:18.668505+0000","last_became_peered":"2024-09-13T18:43:18.668505+0000","last_unstale":"2024-09-13T18:43:18.669420+0000","last_undegraded":"2024-09-13T18:43:18.669420+0000","last_fullsized":"2024-09-13T18:43:18.669420+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:54.299772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673002+0000","last_change":"2024-09-13T18:43:18.672428+0000","last_active":"2024-09-13T18:43:18.673002+0000","last_peered":"2024-09-13T18:43:18.673002+0000","last_clean":"2024-09-13T18:43:18.673002+0000","last_became_active":"2024-09-13T18:43:18.671291+0000","last_became_peered":"2024-09-13T18:43:18.671291+0000","last_unstale":"2024-09-13T18:43:18.673002+0000","last_undegraded":"2024-09-13T18:43:18.673002+0000","last_fullsized":"2024-09-13T18:43:18.673002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:31.728828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671032+0000","last_change":"2024-09-13T18:43:18.669816+0000","last_active":"2024-09-13T18:43:18.671032+0000","last_peered":"2024-09-13T18:43:18.671032+0000","last_clean":"2024-09-13T18:43:18.671032+0000","last_became_active":"2024-09-13T18:43:18.669511+0000","last_became_peered":"2024-09-13T18:43:18.669511+0000","last_unstale":"2024-09-13T18:43:18.671032+0000","last_undegraded":"2024-09-13T18:43:18.671032+0000","last_fullsized":"2024-09-13T18:43:18.671032+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.350192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.660801+0000","last_change":"2024-09-13T18:43:18.660673+0000","last_active":"2024-09-13T18:43:18.660801+0000","last_peered":"2024-09-13T18:43:18.660801+0000","last_clean":"2024-09-13T18:43:18.660801+0000","last_became_active":"2024-09-13T18:43:18.660098+0000","last_became_peered":"2024-09-13T18:43:18.660098+0000","last_unstale":"2024-09-13T18:43:18.660801+0000","last_undegraded":"2024-09-13T18:43:18.660801+0000","last_fullsized":"2024-09-13T18:43:18.660801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:57.589118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680133+0000","last_change":"2024-09-13T18:43:18.680038+0000","last_active":"2024-09-13T18:43:18.680133+0000","last_peered":"2024-09-13T18:43:18.680133+0000","last_clean":"2024-09-13T18:43:18.680133+0000","last_became_active":"2024-09-13T18:43:18.679701+0000","last_became_peered":"2024-09-13T18:43:18.679701+0000","last_unstale":"2024-09-13T18:43:18.680133+0000","last_undegraded":"2024-09-13T18:43:18.680133+0000","last_fullsized":"2024-09-13T18:43:18.680133+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:50.312249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672963+0000","last_change":"2024-09-13T18:43:18.671987+0000","last_active":"2024-09-13T18:43:18.672963+0000","last_peered":"2024-09-13T18:43:18.672963+0000","last_clean":"2024-09-13T18:43:18.672963+0000","last_became_active":"2024-09-13T18:43:18.671221+0000","last_became_peered":"2024-09-13T18:43:18.671221+0000","last_unstale":"2024-09-13T18:43:18.672963+0000","last_undegraded":"2024-09-13T18:43:18.672963+0000","last_fullsized":"2024-09-13T18:43:18.672963+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:10.866613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660483+0000","last_change":"2024-09-13T18:43:18.667648+0000","last_active":"2024-09-13T18:43:19.660483+0000","last_peered":"2024-09-13T18:43:19.660483+0000","last_clean":"2024-09-13T18:43:19.660483+0000","last_became_active":"2024-09-13T18:43:18.667348+0000","last_became_peered":"2024-09-13T18:43:18.667348+0000","last_unstale":"2024-09-13T18:43:19.660483+0000","last_undegraded":"2024-09-13T18:43:19.660483+0000","last_fullsized":"2024-09-13T18:43:19.660483+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670093+0000","last_change":"2024-09-13T18:43:18.669944+0000","last_active":"2024-09-13T18:43:18.670093+0000","last_peered":"2024-09-13T18:43:18.670093+0000","last_clean":"2024-09-13T18:43:18.670093+0000","last_became_active":"2024-09-13T18:43:18.669717+0000","last_became_peered":"2024-09-13T18:43:18.669717+0000","last_unstale":"2024-09-13T18:43:18.670093+0000","last_undegraded":"2024-09-13T18:43:18.670093+0000","last_fullsized":"2024-09-13T18:43:18.670093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.500554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669117+0000","last_change":"2024-09-13T18:43:18.668627+0000","last_active":"2024-09-13T18:43:18.669117+0000","last_peered":"2024-09-13T18:43:18.669117+0000","last_clean":"2024-09-13T18:43:18.669117+0000","last_became_active":"2024-09-13T18:43:18.668354+0000","last_became_peered":"2024-09-13T18:43:18.668354+0000","last_unstale":"2024-09-13T18:43:18.669117+0000","last_undegraded":"2024-09-13T18:43:18.669117+0000","last_fullsized":"2024-09-13T18:43:18.669117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:11.469759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.679121+0000","last_change":"2024-09-13T18:43:18.679037+0000","last_active":"2024-09-13T18:43:18.679121+0000","last_peered":"2024-09-13T18:43:18.679121+0000","last_clean":"2024-09-13T18:43:18.679121+0000","last_became_active":"2024-09-13T18:43:18.676076+0000","last_became_peered":"2024-09-13T18:43:18.676076+0000","last_unstale":"2024-09-13T18:43:18.679121+0000","last_undegraded":"2024-09-13T18:43:18.679121+0000","last_fullsized":"2024-09-13T18:43:18.679121+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:10.866613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664861+0000","last_change":"2024-09-13T18:43:18.664408+0000","last_active":"2024-09-13T18:43:18.664861+0000","last_peered":"2024-09-13T18:43:18.664861+0000","last_clean":"2024-09-13T18:43:18.664861+0000","last_became_active":"2024-09-13T18:43:18.664154+0000","last_became_peered":"2024-09-13T18:43:18.664154+0000","last_unstale":"2024-09-13T18:43:18.664861+0000","last_undegraded":"2024-09-13T18:43:18.664861+0000","last_fullsized":"2024-09-13T18:43:18.664861+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:03.756122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665255+0000","last_change":"2024-09-13T18:43:18.665179+0000","last_active":"2024-09-13T18:43:18.665255+0000","last_peered":"2024-09-13T18:43:18.665255+0000","last_clean":"2024-09-13T18:43:18.665255+0000","last_became_active":"2024-09-13T18:43:18.664850+0000","last_became_peered":"2024-09-13T18:43:18.664850+0000","last_unstale":"2024-09-13T18:43:18.665255+0000","last_undegraded":"2024-09-13T18:43:18.665255+0000","last_fullsized":"2024-09-13T18:43:18.665255+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:15.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.678529+0000","last_change":"2024-09-13T18:43:18.675784+0000","last_active":"2024-09-13T18:43:18.678529+0000","last_peered":"2024-09-13T18:43:18.678529+0000","last_clean":"2024-09-13T18:43:18.678529+0000","last_became_active":"2024-09-13T18:43:18.675548+0000","last_became_peered":"2024-09-13T18:43:18.675548+0000","last_unstale":"2024-09-13T18:43:18.678529+0000","last_undegraded":"2024-09-13T18:43:18.678529+0000","last_fullsized":"2024-09-13T18:43:18.678529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:11.790473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671538+0000","last_change":"2024-09-13T18:43:18.671310+0000","last_active":"2024-09-13T18:43:18.671538+0000","last_peered":"2024-09-13T18:43:18.671538+0000","last_clean":"2024-09-13T18:43:18.671538+0000","last_became_active":"2024-09-13T18:43:18.671094+0000","last_became_peered":"2024-09-13T18:43:18.671094+0000","last_unstale":"2024-09-13T18:43:18.671538+0000","last_undegraded":"2024-09-13T18:43:18.671538+0000","last_fullsized":"2024-09-13T18:43:18.671538+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:18.622360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669089+0000","last_change":"2024-09-13T18:43:18.667078+0000","last_active":"2024-09-13T18:43:18.669089+0000","last_peered":"2024-09-13T18:43:18.669089+0000","last_clean":"2024-09-13T18:43:18.669089+0000","last_became_active":"2024-09-13T18:43:18.666692+0000","last_became_peered":"2024-09-13T18:43:18.666692+0000","last_unstale":"2024-09-13T18:43:18.669089+0000","last_undegraded":"2024-09-13T18:43:18.669089+0000","last_fullsized":"2024-09-13T18:43:18.669089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:41.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680676+0000","last_change":"2024-09-13T18:43:18.252913+0000","last_active":"2024-09-13T18:43:18.680676+0000","last_peered":"2024-09-13T18:43:18.680676+0000","last_clean":"2024-09-13T18:43:18.680676+0000","last_became_active":"2024-09-13T18:43:18.250734+0000","last_became_peered":"2024-09-13T18:43:18.250734+0000","last_unstale":"2024-09-13T18:43:18.680676+0000","last_undegraded":"2024-09-13T18:43:18.680676+0000","last_fullsized":"2024-09-13T18:43:18.680676+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.602065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665081+0000","last_change":"2024-09-13T18:43:18.665025+0000","last_active":"2024-09-13T18:43:18.665081+0000","last_peered":"2024-09-13T18:43:18.665081+0000","last_clean":"2024-09-13T18:43:18.665081+0000","last_became_active":"2024-09-13T18:43:18.664829+0000","last_became_peered":"2024-09-13T18:43:18.664829+0000","last_unstale":"2024-09-13T18:43:18.665081+0000","last_undegraded":"2024-09-13T18:43:18.665081+0000","last_fullsized":"2024-09-13T18:43:18.665081+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:13.331869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680467+0000","last_change":"2024-09-13T18:43:18.248421+0000","last_active":"2024-09-13T18:43:18.680467+0000","last_peered":"2024-09-13T18:43:18.680467+0000","last_clean":"2024-09-13T18:43:18.680467+0000","last_became_active":"2024-09-13T18:43:18.247388+0000","last_became_peered":"2024-09-13T18:43:18.247388+0000","last_unstale":"2024-09-13T18:43:18.680467+0000","last_undegraded":"2024-09-13T18:43:18.680467+0000","last_fullsized":"2024-09-13T18:43:18.680467+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:28.122312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674281+0000","last_change":"2024-09-13T18:43:18.673737+0000","last_active":"2024-09-13T18:43:18.674281+0000","last_peered":"2024-09-13T18:43:18.674281+0000","last_clean":"2024-09-13T18:43:18.674281+0000","last_became_active":"2024-09-13T18:43:18.673528+0000","last_became_peered":"2024-09-13T18:43:18.673528+0000","last_unstale":"2024-09-13T18:43:18.674281+0000","last_undegraded":"2024-09-13T18:43:18.674281+0000","last_fullsized":"2024-09-13T18:43:18.674281+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:52.053617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"164'2","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660584+0000","last_change":"2024-09-13T18:43:18.250835+0000","last_active":"2024-09-13T18:43:19.660584+0000","last_peered":"2024-09-13T18:43:19.660584+0000","last_clean":"2024-09-13T18:43:19.660584+0000","last_became_active":"2024-09-13T18:43:18.250419+0000","last_became_peered":"2024-09-13T18:43:18.250419+0000","last_unstale":"2024-09-13T18:43:19.660584+0000","last_undegraded":"2024-09-13T18:43:19.660584+0000","last_fullsized":"2024-09-13T18:43:19.660584+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:06.162673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664744+0000","last_change":"2024-09-13T18:43:18.663913+0000","last_active":"2024-09-13T18:43:18.664744+0000","last_peered":"2024-09-13T18:43:18.664744+0000","last_clean":"2024-09-13T18:43:18.664744+0000","last_became_active":"2024-09-13T18:43:18.663704+0000","last_became_peered":"2024-09-13T18:43:18.663704+0000","last_unstale":"2024-09-13T18:43:18.664744+0000","last_undegraded":"2024-09-13T18:43:18.664744+0000","last_fullsized":"2024-09-13T18:43:18.664744+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.500554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675531+0000","last_change":"2024-09-13T18:43:18.244150+0000","last_active":"2024-09-13T18:43:18.675531+0000","last_peered":"2024-09-13T18:43:18.675531+0000","last_clean":"2024-09-13T18:43:18.675531+0000","last_became_active":"2024-09-13T18:43:18.243871+0000","last_became_peered":"2024-09-13T18:43:18.243871+0000","last_unstale":"2024-09-13T18:43:18.675531+0000","last_undegraded":"2024-09-13T18:43:18.675531+0000","last_fullsized":"2024-09-13T18:43:18.675531+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:04.387153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677200+0000","last_change":"2024-09-13T18:43:18.677077+0000","last_active":"2024-09-13T18:43:18.677200+0000","last_peered":"2024-09-13T18:43:18.677200+0000","last_clean":"2024-09-13T18:43:18.677200+0000","last_became_active":"2024-09-13T18:43:18.676369+0000","last_became_peered":"2024-09-13T18:43:18.676369+0000","last_unstale":"2024-09-13T18:43:18.677200+0000","last_undegraded":"2024-09-13T18:43:18.677200+0000","last_fullsized":"2024-09-13T18:43:18.677200+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:23.353114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675884+0000","last_change":"2024-09-13T18:43:18.249822+0000","last_active":"2024-09-13T18:43:18.675884+0000","last_peered":"2024-09-13T18:43:18.675884+0000","last_clean":"2024-09-13T18:43:18.675884+0000","last_became_active":"2024-09-13T18:43:18.249438+0000","last_became_peered":"2024-09-13T18:43:18.249438+0000","last_unstale":"2024-09-13T18:43:18.675884+0000","last_undegraded":"2024-09-13T18:43:18.675884+0000","last_fullsized":"2024-09-13T18:43:18.675884+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:11.052221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672488+0000","last_change":"2024-09-13T18:43:18.670162+0000","last_active":"2024-09-13T18:43:18.672488+0000","last_peered":"2024-09-13T18:43:18.672488+0000","last_clean":"2024-09-13T18:43:18.672488+0000","last_became_active":"2024-09-13T18:43:18.665906+0000","last_became_peered":"2024-09-13T18:43:18.665906+0000","last_unstale":"2024-09-13T18:43:18.672488+0000","last_undegraded":"2024-09-13T18:43:18.672488+0000","last_fullsized":"2024-09-13T18:43:18.672488+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.781783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675564+0000","last_change":"2024-09-13T18:43:18.241909+0000","last_active":"2024-09-13T18:43:18.675564+0000","last_peered":"2024-09-13T18:43:18.675564+0000","last_clean":"2024-09-13T18:43:18.675564+0000","last_became_active":"2024-09-13T18:43:18.241606+0000","last_became_peered":"2024-09-13T18:43:18.241606+0000","last_unstale":"2024-09-13T18:43:18.675564+0000","last_undegraded":"2024-09-13T18:43:18.675564+0000","last_fullsized":"2024-09-13T18:43:18.675564+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:59.763664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667638+0000","last_change":"2024-09-13T18:43:18.667573+0000","last_active":"2024-09-13T18:43:18.667638+0000","last_peered":"2024-09-13T18:43:18.667638+0000","last_clean":"2024-09-13T18:43:18.667638+0000","last_became_active":"2024-09-13T18:43:18.667340+0000","last_became_peered":"2024-09-13T18:43:18.667340+0000","last_unstale":"2024-09-13T18:43:18.667638+0000","last_undegraded":"2024-09-13T18:43:18.667638+0000","last_fullsized":"2024-09-13T18:43:18.667638+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:15.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662920+0000","last_change":"2024-09-13T18:43:18.246221+0000","last_active":"2024-09-13T18:43:18.662920+0000","last_peered":"2024-09-13T18:43:18.662920+0000","last_clean":"2024-09-13T18:43:18.662920+0000","last_became_active":"2024-09-13T18:43:18.245980+0000","last_became_peered":"2024-09-13T18:43:18.245980+0000","last_unstale":"2024-09-13T18:43:18.662920+0000","last_undegraded":"2024-09-13T18:43:18.662920+0000","last_fullsized":"2024-09-13T18:43:18.662920+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:32.723503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661780+0000","last_change":"2024-09-13T18:43:18.661584+0000","last_active":"2024-09-13T18:43:18.661780+0000","last_peered":"2024-09-13T18:43:18.661780+0000","last_clean":"2024-09-13T18:43:18.661780+0000","last_became_active":"2024-09-13T18:43:18.661355+0000","last_became_peered":"2024-09-13T18:43:18.661355+0000","last_unstale":"2024-09-13T18:43:18.661780+0000","last_undegraded":"2024-09-13T18:43:18.661780+0000","last_fullsized":"2024-09-13T18:43:18.661780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:03.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.658362+0000","last_change":"2024-09-13T18:43:18.246055+0000","last_active":"2024-09-13T18:43:18.658362+0000","last_peered":"2024-09-13T18:43:18.658362+0000","last_clean":"2024-09-13T18:43:18.658362+0000","last_became_active":"2024-09-13T18:43:18.245141+0000","last_became_peered":"2024-09-13T18:43:18.245141+0000","last_unstale":"2024-09-13T18:43:18.658362+0000","last_undegraded":"2024-09-13T18:43:18.658362+0000","last_fullsized":"2024-09-13T18:43:18.658362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:21.117811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661315+0000","last_change":"2024-09-13T18:43:18.660824+0000","last_active":"2024-09-13T18:43:18.661315+0000","last_peered":"2024-09-13T18:43:18.661315+0000","last_clean":"2024-09-13T18:43:18.661315+0000","last_became_active":"2024-09-13T18:43:18.660422+0000","last_became_peered":"2024-09-13T18:43:18.660422+0000","last_unstale":"2024-09-13T18:43:18.661315+0000","last_undegraded":"2024-09-13T18:43:18.661315+0000","last_fullsized":"2024-09-13T18:43:18.661315+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.655370+0000","last_change":"2024-09-13T18:43:18.248261+0000","last_active":"2024-09-13T18:43:18.655370+0000","last_peered":"2024-09-13T18:43:18.655370+0000","last_clean":"2024-09-13T18:43:18.655370+0000","last_became_active":"2024-09-13T18:43:18.247588+0000","last_became_peered":"2024-09-13T18:43:18.247588+0000","last_unstale":"2024-09-13T18:43:18.655370+0000","last_undegraded":"2024-09-13T18:43:18.655370+0000","last_fullsized":"2024-09-13T18:43:18.655370+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:05.335505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675874+0000","last_change":"2024-09-13T18:43:18.675391+0000","last_active":"2024-09-13T18:43:18.675874+0000","last_peered":"2024-09-13T18:43:18.675874+0000","last_clean":"2024-09-13T18:43:18.675874+0000","last_became_active":"2024-09-13T18:43:18.675185+0000","last_became_peered":"2024-09-13T18:43:18.675185+0000","last_unstale":"2024-09-13T18:43:18.675874+0000","last_undegraded":"2024-09-13T18:43:18.675874+0000","last_fullsized":"2024-09-13T18:43:18.675874+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:49.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667098+0000","last_change":"2024-09-13T18:43:18.249513+0000","last_active":"2024-09-13T18:43:18.667098+0000","last_peered":"2024-09-13T18:43:18.667098+0000","last_clean":"2024-09-13T18:43:18.667098+0000","last_became_active":"2024-09-13T18:43:18.249228+0000","last_became_peered":"2024-09-13T18:43:18.249228+0000","last_unstale":"2024-09-13T18:43:18.667098+0000","last_undegraded":"2024-09-13T18:43:18.667098+0000","last_fullsized":"2024-09-13T18:43:18.667098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:50.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.668862+0000","last_change":"2024-09-13T18:43:18.668351+0000","last_active":"2024-09-13T18:43:18.668862+0000","last_peered":"2024-09-13T18:43:18.668862+0000","last_clean":"2024-09-13T18:43:18.668862+0000","last_became_active":"2024-09-13T18:43:18.667449+0000","last_became_peered":"2024-09-13T18:43:18.667449+0000","last_unstale":"2024-09-13T18:43:18.668862+0000","last_undegraded":"2024-09-13T18:43:18.668862+0000","last_fullsized":"2024-09-13T18:43:18.668862+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:35.398963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680599+0000","last_change":"2024-09-13T18:43:18.250929+0000","last_active":"2024-09-13T18:43:18.680599+0000","last_peered":"2024-09-13T18:43:18.680599+0000","last_clean":"2024-09-13T18:43:18.680599+0000","last_became_active":"2024-09-13T18:43:18.250148+0000","last_became_peered":"2024-09-13T18:43:18.250148+0000","last_unstale":"2024-09-13T18:43:18.680599+0000","last_undegraded":"2024-09-13T18:43:18.680599+0000","last_fullsized":"2024-09-13T18:43:18.680599+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.179429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.678550+0000","last_change":"2024-09-13T18:43:18.677935+0000","last_active":"2024-09-13T18:43:18.678550+0000","last_peered":"2024-09-13T18:43:18.678550+0000","last_clean":"2024-09-13T18:43:18.678550+0000","last_became_active":"2024-09-13T18:43:18.673210+0000","last_became_peered":"2024-09-13T18:43:18.673210+0000","last_unstale":"2024-09-13T18:43:18.678550+0000","last_undegraded":"2024-09-13T18:43:18.678550+0000","last_fullsized":"2024-09-13T18:43:18.678550+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:56.705896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.681458+0000","last_change":"2024-09-13T18:43:18.250748+0000","last_active":"2024-09-13T18:43:18.681458+0000","last_peered":"2024-09-13T18:43:18.681458+0000","last_clean":"2024-09-13T18:43:18.681458+0000","last_became_active":"2024-09-13T18:43:18.249892+0000","last_became_peered":"2024-09-13T18:43:18.249892+0000","last_unstale":"2024-09-13T18:43:18.681458+0000","last_undegraded":"2024-09-13T18:43:18.681458+0000","last_fullsized":"2024-09-13T18:43:18.681458+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:06.438678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670843+0000","last_change":"2024-09-13T18:43:18.670175+0000","last_active":"2024-09-13T18:43:18.670843+0000","last_peered":"2024-09-13T18:43:18.670843+0000","last_clean":"2024-09-13T18:43:18.670843+0000","last_became_active":"2024-09-13T18:43:18.669935+0000","last_became_peered":"2024-09-13T18:43:18.669935+0000","last_unstale":"2024-09-13T18:43:18.670843+0000","last_undegraded":"2024-09-13T18:43:18.670843+0000","last_fullsized":"2024-09-13T18:43:18.670843+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:13.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.663684+0000","last_change":"2024-09-13T18:43:18.251196+0000","last_active":"2024-09-13T18:43:18.663684+0000","last_peered":"2024-09-13T18:43:18.663684+0000","last_clean":"2024-09-13T18:43:18.663684+0000","last_became_active":"2024-09-13T18:43:18.250921+0000","last_became_peered":"2024-09-13T18:43:18.250921+0000","last_unstale":"2024-09-13T18:43:18.663684+0000","last_undegraded":"2024-09-13T18:43:18.663684+0000","last_fullsized":"2024-09-13T18:43:18.663684+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:52.049987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669071+0000","last_change":"2024-09-13T18:43:18.666902+0000","last_active":"2024-09-13T18:43:18.669071+0000","last_peered":"2024-09-13T18:43:18.669071+0000","last_clean":"2024-09-13T18:43:18.669071+0000","last_became_active":"2024-09-13T18:43:18.666475+0000","last_became_peered":"2024-09-13T18:43:18.666475+0000","last_unstale":"2024-09-13T18:43:18.669071+0000","last_undegraded":"2024-09-13T18:43:18.669071+0000","last_fullsized":"2024-09-13T18:43:18.669071+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:44.028930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660374+0000","last_change":"2024-09-13T18:43:18.249202+0000","last_active":"2024-09-13T18:43:19.660374+0000","last_peered":"2024-09-13T18:43:19.660374+0000","last_clean":"2024-09-13T18:43:19.660374+0000","last_became_active":"2024-09-13T18:43:18.248936+0000","last_became_peered":"2024-09-13T18:43:18.248936+0000","last_unstale":"2024-09-13T18:43:19.660374+0000","last_undegraded":"2024-09-13T18:43:19.660374+0000","last_fullsized":"2024-09-13T18:43:19.660374+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:07.792924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677019+0000","last_change":"2024-09-13T18:43:18.676755+0000","last_active":"2024-09-13T18:43:18.677019+0000","last_peered":"2024-09-13T18:43:18.677019+0000","last_clean":"2024-09-13T18:43:18.677019+0000","last_became_active":"2024-09-13T18:43:18.676151+0000","last_became_peered":"2024-09-13T18:43:18.676151+0000","last_unstale":"2024-09-13T18:43:18.677019+0000","last_undegraded":"2024-09-13T18:43:18.677019+0000","last_fullsized":"2024-09-13T18:43:18.677019+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.681322+0000","last_change":"2024-09-13T18:43:18.243577+0000","last_active":"2024-09-13T18:43:18.681322+0000","last_peered":"2024-09-13T18:43:18.681322+0000","last_clean":"2024-09-13T18:43:18.681322+0000","last_became_active":"2024-09-13T18:43:18.243032+0000","last_became_peered":"2024-09-13T18:43:18.243032+0000","last_unstale":"2024-09-13T18:43:18.681322+0000","last_undegraded":"2024-09-13T18:43:18.681322+0000","last_fullsized":"2024-09-13T18:43:18.681322+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:05.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669899+0000","last_change":"2024-09-13T18:43:18.669794+0000","last_active":"2024-09-13T18:43:18.669899+0000","last_peered":"2024-09-13T18:43:18.669899+0000","last_clean":"2024-09-13T18:43:18.669899+0000","last_became_active":"2024-09-13T18:43:18.668444+0000","last_became_peered":"2024-09-13T18:43:18.668444+0000","last_unstale":"2024-09-13T18:43:18.669899+0000","last_undegraded":"2024-09-13T18:43:18.669899+0000","last_fullsized":"2024-09-13T18:43:18.669899+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:05.394347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675271+0000","last_change":"2024-09-13T18:43:18.251929+0000","last_active":"2024-09-13T18:43:18.675271+0000","last_peered":"2024-09-13T18:43:18.675271+0000","last_clean":"2024-09-13T18:43:18.675271+0000","last_became_active":"2024-09-13T18:43:18.251587+0000","last_became_peered":"2024-09-13T18:43:18.251587+0000","last_unstale":"2024-09-13T18:43:18.675271+0000","last_undegraded":"2024-09-13T18:43:18.675271+0000","last_fullsized":"2024-09-13T18:43:18.675271+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667608+0000","last_change":"2024-09-13T18:43:18.667244+0000","last_active":"2024-09-13T18:43:18.667608+0000","last_peered":"2024-09-13T18:43:18.667608+0000","last_clean":"2024-09-13T18:43:18.667608+0000","last_became_active":"2024-09-13T18:43:18.667015+0000","last_became_peered":"2024-09-13T18:43:18.667015+0000","last_unstale":"2024-09-13T18:43:18.667608+0000","last_undegraded":"2024-09-13T18:43:18.667608+0000","last_fullsized":"2024-09-13T18:43:18.667608+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:12.059415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"164'2","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660670+0000","last_change":"2024-09-13T18:43:18.250641+0000","last_active":"2024-09-13T18:43:19.660670+0000","last_peered":"2024-09-13T18:43:19.660670+0000","last_clean":"2024-09-13T18:43:19.660670+0000","last_became_active":"2024-09-13T18:43:18.249951+0000","last_became_peered":"2024-09-13T18:43:18.249951+0000","last_unstale":"2024-09-13T18:43:19.660670+0000","last_undegraded":"2024-09-13T18:43:19.660670+0000","last_fullsized":"2024-09-13T18:43:19.660670+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:50.543337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671941+0000","last_change":"2024-09-13T18:43:18.671129+0000","last_active":"2024-09-13T18:43:18.671941+0000","last_peered":"2024-09-13T18:43:18.671941+0000","last_clean":"2024-09-13T18:43:18.671941+0000","last_became_active":"2024-09-13T18:43:18.669640+0000","last_became_peered":"2024-09-13T18:43:18.669640+0000","last_unstale":"2024-09-13T18:43:18.671941+0000","last_undegraded":"2024-09-13T18:43:18.671941+0000","last_fullsized":"2024-09-13T18:43:18.671941+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:07.660809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.679544+0000","last_change":"2024-09-13T18:43:18.247732+0000","last_active":"2024-09-13T18:43:18.679544+0000","last_peered":"2024-09-13T18:43:18.679544+0000","last_clean":"2024-09-13T18:43:18.679544+0000","last_became_active":"2024-09-13T18:43:18.247422+0000","last_became_peered":"2024-09-13T18:43:18.247422+0000","last_unstale":"2024-09-13T18:43:18.679544+0000","last_undegraded":"2024-09-13T18:43:18.679544+0000","last_fullsized":"2024-09-13T18:43:18.679544+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.269575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666831+0000","last_change":"2024-09-13T18:43:18.666760+0000","last_active":"2024-09-13T18:43:18.666831+0000","last_peered":"2024-09-13T18:43:18.666831+0000","last_clean":"2024-09-13T18:43:18.666831+0000","last_became_active":"2024-09-13T18:43:18.664907+0000","last_became_peered":"2024-09-13T18:43:18.664907+0000","last_unstale":"2024-09-13T18:43:18.666831+0000","last_undegraded":"2024-09-13T18:43:18.666831+0000","last_fullsized":"2024-09-13T18:43:18.666831+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:48.922411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665361+0000","last_change":"2024-09-13T18:43:18.250797+0000","last_active":"2024-09-13T18:43:18.665361+0000","last_peered":"2024-09-13T18:43:18.665361+0000","last_clean":"2024-09-13T18:43:18.665361+0000","last_became_active":"2024-09-13T18:43:18.250599+0000","last_became_peered":"2024-09-13T18:43:18.250599+0000","last_unstale":"2024-09-13T18:43:18.665361+0000","last_undegraded":"2024-09-13T18:43:18.665361+0000","last_fullsized":"2024-09-13T18:43:18.665361+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:38.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669403+0000","last_change":"2024-09-13T18:43:18.668724+0000","last_active":"2024-09-13T18:43:18.669403+0000","last_peered":"2024-09-13T18:43:18.669403+0000","last_clean":"2024-09-13T18:43:18.669403+0000","last_became_active":"2024-09-13T18:43:18.667906+0000","last_became_peered":"2024-09-13T18:43:18.667906+0000","last_unstale":"2024-09-13T18:43:18.669403+0000","last_undegraded":"2024-09-13T18:43:18.669403+0000","last_fullsized":"2024-09-13T18:43:18.669403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680596+0000","last_change":"2024-09-13T18:43:18.246070+0000","last_active":"2024-09-13T18:43:18.680596+0000","last_peered":"2024-09-13T18:43:18.680596+0000","last_clean":"2024-09-13T18:43:18.680596+0000","last_became_active":"2024-09-13T18:43:18.244873+0000","last_became_peered":"2024-09-13T18:43:18.244873+0000","last_unstale":"2024-09-13T18:43:18.680596+0000","last_undegraded":"2024-09-13T18:43:18.680596+0000","last_fullsized":"2024-09-13T18:43:18.680596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:03.847257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680117+0000","last_change":"2024-09-13T18:43:18.679878+0000","last_active":"2024-09-13T18:43:18.680117+0000","last_peered":"2024-09-13T18:43:18.680117+0000","last_clean":"2024-09-13T18:43:18.680117+0000","last_became_active":"2024-09-13T18:43:18.678725+0000","last_became_peered":"2024-09-13T18:43:18.678725+0000","last_unstale":"2024-09-13T18:43:18.680117+0000","last_undegraded":"2024-09-13T18:43:18.680117+0000","last_fullsized":"2024-09-13T18:43:18.680117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:42.997626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666729+0000","last_change":"2024-09-13T18:43:18.247077+0000","last_active":"2024-09-13T18:43:18.666729+0000","last_peered":"2024-09-13T18:43:18.666729+0000","last_clean":"2024-09-13T18:43:18.666729+0000","last_became_active":"2024-09-13T18:43:18.246623+0000","last_became_peered":"2024-09-13T18:43:18.246623+0000","last_unstale":"2024-09-13T18:43:18.666729+0000","last_undegraded":"2024-09-13T18:43:18.666729+0000","last_fullsized":"2024-09-13T18:43:18.666729+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:39.856230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674259+0000","last_change":"2024-09-13T18:43:18.674164+0000","last_active":"2024-09-13T18:43:18.674259+0000","last_peered":"2024-09-13T18:43:18.674259+0000","last_clean":"2024-09-13T18:43:18.674259+0000","last_became_active":"2024-09-13T18:43:18.673930+0000","last_became_peered":"2024-09-13T18:43:18.673930+0000","last_unstale":"2024-09-13T18:43:18.674259+0000","last_undegraded":"2024-09-13T18:43:18.674259+0000","last_fullsized":"2024-09-13T18:43:18.674259+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:08.800118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662932+0000","last_change":"2024-09-13T18:43:18.251704+0000","last_active":"2024-09-13T18:43:18.662932+0000","last_peered":"2024-09-13T18:43:18.662932+0000","last_clean":"2024-09-13T18:43:18.662932+0000","last_became_active":"2024-09-13T18:43:18.251370+0000","last_became_peered":"2024-09-13T18:43:18.251370+0000","last_unstale":"2024-09-13T18:43:18.662932+0000","last_undegraded":"2024-09-13T18:43:18.662932+0000","last_fullsized":"2024-09-13T18:43:18.662932+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.540096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672509+0000","last_change":"2024-09-13T18:43:18.671243+0000","last_active":"2024-09-13T18:43:18.672509+0000","last_peered":"2024-09-13T18:43:18.672509+0000","last_clean":"2024-09-13T18:43:18.672509+0000","last_became_active":"2024-09-13T18:43:18.670972+0000","last_became_peered":"2024-09-13T18:43:18.670972+0000","last_unstale":"2024-09-13T18:43:18.672509+0000","last_undegraded":"2024-09-13T18:43:18.672509+0000","last_fullsized":"2024-09-13T18:43:18.672509+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:11.469759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660594+0000","last_change":"2024-09-13T18:43:18.249571+0000","last_active":"2024-09-13T18:43:19.660594+0000","last_peered":"2024-09-13T18:43:19.660594+0000","last_clean":"2024-09-13T18:43:19.660594+0000","last_became_active":"2024-09-13T18:43:18.249155+0000","last_became_peered":"2024-09-13T18:43:18.249155+0000","last_unstale":"2024-09-13T18:43:19.660594+0000","last_undegraded":"2024-09-13T18:43:19.660594+0000","last_fullsized":"2024-09-13T18:43:19.660594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:57.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673270+0000","last_change":"2024-09-13T18:43:18.672532+0000","last_active":"2024-09-13T18:43:18.673270+0000","last_peered":"2024-09-13T18:43:18.673270+0000","last_clean":"2024-09-13T18:43:18.673270+0000","last_became_active":"2024-09-13T18:43:18.672073+0000","last_became_peered":"2024-09-13T18:43:18.672073+0000","last_unstale":"2024-09-13T18:43:18.673270+0000","last_undegraded":"2024-09-13T18:43:18.673270+0000","last_fullsized":"2024-09-13T18:43:18.673270+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:56.861002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675060+0000","last_change":"2024-09-13T18:43:18.243508+0000","last_active":"2024-09-13T18:43:18.675060+0000","last_peered":"2024-09-13T18:43:18.675060+0000","last_clean":"2024-09-13T18:43:18.675060+0000","last_became_active":"2024-09-13T18:43:18.243237+0000","last_became_peered":"2024-09-13T18:43:18.243237+0000","last_unstale":"2024-09-13T18:43:18.675060+0000","last_undegraded":"2024-09-13T18:43:18.675060+0000","last_fullsized":"2024-09-13T18:43:18.675060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.693806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671025+0000","last_change":"2024-09-13T18:43:18.670902+0000","last_active":"2024-09-13T18:43:18.671025+0000","last_peered":"2024-09-13T18:43:18.671025+0000","last_clean":"2024-09-13T18:43:18.671025+0000","last_became_active":"2024-09-13T18:43:18.666782+0000","last_became_peered":"2024-09-13T18:43:18.666782+0000","last_unstale":"2024-09-13T18:43:18.671025+0000","last_undegraded":"2024-09-13T18:43:18.671025+0000","last_fullsized":"2024-09-13T18:43:18.671025+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:15.331296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666622+0000","last_change":"2024-09-13T18:43:18.245792+0000","last_active":"2024-09-13T18:43:18.666622+0000","last_peered":"2024-09-13T18:43:18.666622+0000","last_clean":"2024-09-13T18:43:18.666622+0000","last_became_active":"2024-09-13T18:43:18.245391+0000","last_became_peered":"2024-09-13T18:43:18.245391+0000","last_unstale":"2024-09-13T18:43:18.666622+0000","last_undegraded":"2024-09-13T18:43:18.666622+0000","last_fullsized":"2024-09-13T18:43:18.666622+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:41.148448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669103+0000","last_change":"2024-09-13T18:43:18.668129+0000","last_active":"2024-09-13T18:43:18.669103+0000","last_peered":"2024-09-13T18:43:18.669103+0000","last_clean":"2024-09-13T18:43:18.669103+0000","last_became_active":"2024-09-13T18:43:18.667842+0000","last_became_peered":"2024-09-13T18:43:18.667842+0000","last_unstale":"2024-09-13T18:43:18.669103+0000","last_undegraded":"2024-09-13T18:43:18.669103+0000","last_fullsized":"2024-09-13T18:43:18.669103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:07.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666824+0000","last_change":"2024-09-13T18:43:18.240487+0000","last_active":"2024-09-13T18:43:18.666824+0000","last_peered":"2024-09-13T18:43:18.666824+0000","last_clean":"2024-09-13T18:43:18.666824+0000","last_became_active":"2024-09-13T18:43:18.240229+0000","last_became_peered":"2024-09-13T18:43:18.240229+0000","last_unstale":"2024-09-13T18:43:18.666824+0000","last_undegraded":"2024-09-13T18:43:18.666824+0000","last_fullsized":"2024-09-13T18:43:18.666824+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:06.438678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672571+0000","last_change":"2024-09-13T18:43:18.671067+0000","last_active":"2024-09-13T18:43:18.672571+0000","last_peered":"2024-09-13T18:43:18.672571+0000","last_clean":"2024-09-13T18:43:18.672571+0000","last_became_active":"2024-09-13T18:43:18.670558+0000","last_became_peered":"2024-09-13T18:43:18.670558+0000","last_unstale":"2024-09-13T18:43:18.672571+0000","last_undegraded":"2024-09-13T18:43:18.672571+0000","last_fullsized":"2024-09-13T18:43:18.672571+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:33.953779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.663059+0000","last_change":"2024-09-13T18:43:18.251568+0000","last_active":"2024-09-13T18:43:18.663059+0000","last_peered":"2024-09-13T18:43:18.663059+0000","last_clean":"2024-09-13T18:43:18.663059+0000","last_became_active":"2024-09-13T18:43:18.251018+0000","last_became_peered":"2024-09-13T18:43:18.251018+0000","last_unstale":"2024-09-13T18:43:18.663059+0000","last_undegraded":"2024-09-13T18:43:18.663059+0000","last_fullsized":"2024-09-13T18:43:18.663059+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:09.261392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672528+0000","last_change":"2024-09-13T18:43:18.671330+0000","last_active":"2024-09-13T18:43:18.672528+0000","last_peered":"2024-09-13T18:43:18.672528+0000","last_clean":"2024-09-13T18:43:18.672528+0000","last_became_active":"2024-09-13T18:43:18.669948+0000","last_became_peered":"2024-09-13T18:43:18.669948+0000","last_unstale":"2024-09-13T18:43:18.672528+0000","last_undegraded":"2024-09-13T18:43:18.672528+0000","last_fullsized":"2024-09-13T18:43:18.672528+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:20.672236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.659949+0000","last_change":"2024-09-13T18:43:18.247987+0000","last_active":"2024-09-13T18:43:18.659949+0000","last_peered":"2024-09-13T18:43:18.659949+0000","last_clean":"2024-09-13T18:43:18.659949+0000","last_became_active":"2024-09-13T18:43:18.245245+0000","last_became_peered":"2024-09-13T18:43:18.245245+0000","last_unstale":"2024-09-13T18:43:18.659949+0000","last_undegraded":"2024-09-13T18:43:18.659949+0000","last_fullsized":"2024-09-13T18:43:18.659949+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:19.423726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.656917+0000","last_change":"2024-09-13T18:43:18.656847+0000","last_active":"2024-09-13T18:43:18.656917+0000","last_peered":"2024-09-13T18:43:18.656917+0000","last_clean":"2024-09-13T18:43:18.656917+0000","last_became_active":"2024-09-13T18:43:18.656632+0000","last_became_peered":"2024-09-13T18:43:18.656632+0000","last_unstale":"2024-09-13T18:43:18.656917+0000","last_undegraded":"2024-09-13T18:43:18.656917+0000","last_fullsized":"2024-09-13T18:43:18.656917+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:43.310377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.655633+0000","last_change":"2024-09-13T18:43:18.242234+0000","last_active":"2024-09-13T18:43:18.655633+0000","last_peered":"2024-09-13T18:43:18.655633+0000","last_clean":"2024-09-13T18:43:18.655633+0000","last_became_active":"2024-09-13T18:43:18.241592+0000","last_became_peered":"2024-09-13T18:43:18.241592+0000","last_unstale":"2024-09-13T18:43:18.655633+0000","last_undegraded":"2024-09-13T18:43:18.655633+0000","last_fullsized":"2024-09-13T18:43:18.655633+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672983+0000","last_change":"2024-09-13T18:43:18.672312+0000","last_active":"2024-09-13T18:43:18.672983+0000","last_peered":"2024-09-13T18:43:18.672983+0000","last_clean":"2024-09-13T18:43:18.672983+0000","last_became_active":"2024-09-13T18:43:18.671619+0000","last_became_peered":"2024-09-13T18:43:18.671619+0000","last_unstale":"2024-09-13T18:43:18.672983+0000","last_undegraded":"2024-09-13T18:43:18.672983+0000","last_fullsized":"2024-09-13T18:43:18.672983+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:42.997626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660557+0000","last_change":"2024-09-13T18:43:18.250721+0000","last_active":"2024-09-13T18:43:19.660557+0000","last_peered":"2024-09-13T18:43:19.660557+0000","last_clean":"2024-09-13T18:43:19.660557+0000","last_became_active":"2024-09-13T18:43:18.250233+0000","last_became_peered":"2024-09-13T18:43:18.250233+0000","last_unstale":"2024-09-13T18:43:19.660557+0000","last_undegraded":"2024-09-13T18:43:19.660557+0000","last_fullsized":"2024-09-13T18:43:19.660557+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:34.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677068+0000","last_change":"2024-09-13T18:43:18.676716+0000","last_active":"2024-09-13T18:43:18.677068+0000","last_peered":"2024-09-13T18:43:18.677068+0000","last_clean":"2024-09-13T18:43:18.677068+0000","last_became_active":"2024-09-13T18:43:18.676460+0000","last_became_peered":"2024-09-13T18:43:18.676460+0000","last_unstale":"2024-09-13T18:43:18.677068+0000","last_undegraded":"2024-09-13T18:43:18.677068+0000","last_fullsized":"2024-09-13T18:43:18.677068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:20.672236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662642+0000","last_change":"2024-09-13T18:43:18.252860+0000","last_active":"2024-09-13T18:43:18.662642+0000","last_peered":"2024-09-13T18:43:18.662642+0000","last_clean":"2024-09-13T18:43:18.662642+0000","last_became_active":"2024-09-13T18:43:18.252622+0000","last_became_peered":"2024-09-13T18:43:18.252622+0000","last_unstale":"2024-09-13T18:43:18.662642+0000","last_undegraded":"2024-09-13T18:43:18.662642+0000","last_fullsized":"2024-09-13T18:43:18.662642+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:41.223990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671814+0000","last_change":"2024-09-13T18:43:18.671720+0000","last_active":"2024-09-13T18:43:18.671814+0000","last_peered":"2024-09-13T18:43:18.671814+0000","last_clean":"2024-09-13T18:43:18.671814+0000","last_became_active":"2024-09-13T18:43:18.668662+0000","last_became_peered":"2024-09-13T18:43:18.668662+0000","last_unstale":"2024-09-13T18:43:18.671814+0000","last_undegraded":"2024-09-13T18:43:18.671814+0000","last_fullsized":"2024-09-13T18:43:18.671814+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.027841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674748+0000","last_change":"2024-09-13T18:43:18.240198+0000","last_active":"2024-09-13T18:43:18.674748+0000","last_peered":"2024-09-13T18:43:18.674748+0000","last_clean":"2024-09-13T18:43:18.674748+0000","last_became_active":"2024-09-13T18:43:18.239905+0000","last_became_peered":"2024-09-13T18:43:18.239905+0000","last_unstale":"2024-09-13T18:43:18.674748+0000","last_undegraded":"2024-09-13T18:43:18.674748+0000","last_fullsized":"2024-09-13T18:43:18.674748+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:38.559333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":296,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.249159+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:43:18.249159+0000","last_peered":"2024-09-13T18:43:18.249159+0000","last_clean":"2024-09-13T18:43:18.249159+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:43:18.249159+0000","last_undegraded":"2024-09-13T18:43:18.249159+0000","last_fullsized":"2024-09-13T18:43:18.249159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542242,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1473,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193838,"statfs":{"total":200000000,"available":198491061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.81999999999999995,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.63900000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.92100000000000004,"5min":1.014,"15min":1.014},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89800000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.94499999999999995},"last":1.004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.999,"15min":0.999},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.83099999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.90400000000000003,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.83199999999999996},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.91300000000000003,"15min":6.0890000000000004},"last":1.0880000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":1.036},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.1799999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.54200000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.0700000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.371},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.143},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98099999999999998,"5min":0.997,"15min":1.125},"last":0.81699999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194416,"statfs":{"total":200000000,"available":199082171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.665,"15min":1.665},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67500000000000004,"15min":0.63700000000000001},"min":{"1min":0.52300000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.65400000000000003},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.502,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79300000000000004,"5min":1.591,"15min":1.591},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.68100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85099999999999998,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.70399999999999996},"min":{"1min":0.58399999999999996,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.872,"5min":2.169,"15min":2.169},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.67700000000000005},"min":{"1min":0.57299999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90100000000000002,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.64900000000000002},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57099999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.69899999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":1.0840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.438,"5min":0.372,"15min":0.372},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.115},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.80900000000000005},"min":{"1min":0.50700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89900000000000002,"5min":1.696,"15min":6.4539999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":0.999,"15min":0.999},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69099999999999995,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85399999999999998,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68100000000000005,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70499999999999996,"15min":0.85999999999999999},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.87,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70099999999999996,"15min":0.80500000000000005},"min":{"1min":0.45900000000000002,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.004,"15min":6.2039999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.57399999999999995,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.747}]},{"osd":4,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.52100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79500000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.503,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.625},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":1.403,"15min":1.403},"last":0.439}]},{"osd":7,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.51300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45500000000000002},"max":{"1min":0.83699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.581,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2370000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.874},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71899999999999997,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6060000000000001,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.69999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5589999999999999,"5min":3.706,"15min":3.706},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.915,"5min":3.742,"15min":3.742},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.762,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72999999999999998,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.6870000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.66200000000000003,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84799999999999998,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.0620000000000003,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.748,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.36399999999999999},"max":{"1min":1.843,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.62},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":1.548,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.77800000000000002,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41799999999999998,"15min":0.443},"min":{"1min":0.32300000000000001,"5min":0.27800000000000002,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.72599999999999998},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":0.57599999999999996,"5min":1.546,"15min":8.1059999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.502}]},{"osd":2,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.59999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.496,"15min":0.68000000000000005},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.95399999999999996,"15min":7.798},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.58299999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0800000000000001,"15min":3.093},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.79900000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78100000000000003,"15min":0.95799999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1519999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.89400000000000002},"min":{"1min":0.55900000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.71599999999999997},"min":{"1min":0.56599999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0329999999999999,"5min":1.206,"15min":1.206},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":2.9900000000000002},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.27400000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.622,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.60999999999999999,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45100000000000001,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30499999999999999},"max":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":1.7030000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.71599999999999997},"min":{"1min":0.53700000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97199999999999998,"5min":1.075,"15min":1.1830000000000001},"last":1.034},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"max":{"1min":0.98499999999999999,"5min":1.006,"15min":1.02},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.72799999999999998},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.55500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.70399999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.016,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.022}]},{"osd":7,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.53900000000000003},"max":{"1min":0.90100000000000002,"5min":1.097,"15min":1.1419999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":0.77400000000000002},"min":{"1min":0.59699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.97799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193852,"statfs":{"total":200000000,"available":198504853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66500000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63300000000000001,"5min":1.036,"15min":1.036},"last":0.439},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.52300000000000002,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.73699999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57299999999999995,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78800000000000003,"15min":0.76100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.94999999999999996,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.628}]},{"osd":5,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.242,"15min":1.242},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.77500000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":1.278,"15min":1.278},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76400000000000001,"15min":0.748},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98999999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":1.149,"15min":1.1539999999999999},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.56799999999999995,"5min":0.76700000000000002,"15min":1.669},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.29899999999999999,"5min":0.27900000000000003,"15min":0.24099999999999999},"max":{"1min":0.53100000000000003,"5min":0.75800000000000001,"15min":0.874},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.591},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.47999999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69099999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.626,"5min":0.85899999999999999,"15min":1.637},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.97099999999999997,"5min":1.2,"15min":1.2},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98599999999999999,"5min":1.006,"15min":1.698},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:42:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.74299999999999999},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.96599999999999997,"5min":1.204,"15min":1.204},"last":0.624},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.92700000000000005,"5min":1.121,"15min":2.2589999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75800000000000001,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.876,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.69699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89800000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.52700000000000002}]}]}],"pool_statfs":[]}} 2024-09-13T18:43:22.816 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:43:23.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.000+0000 7f9072e00640 1 Processor -- start 2024-09-13T18:43:23.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.000+0000 7f9072e00640 1 -- start start 2024-09-13T18:43:23.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.001+0000 7f9072e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f906c15dee0 0x7f906c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.001+0000 7f9072e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f906c0b3f10 0x7f906c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.001+0000 7f9072e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0b2f00 con 0x7f906c15e2c0 2024-09-13T18:43:23.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.001+0000 7f9072e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0b3150 con 0x7f906c0b3f10 2024-09-13T18:43:23.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.001+0000 7f9072e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0b3430 con 0x7f906c15dee0 2024-09-13T18:43:23.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f906c0b3f10 0x7f906c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f906c0b3f10 0x7f906c0b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36306/0 (socket says 172.21.15.192:36306) 2024-09-13T18:43:23.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 -- 172.21.15.192:0/1499205388 learned_addr learned my addr 172.21.15.192:0/1499205388 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 -- 172.21.15.192:0/1499205388 >> v2:172.21.15.194:3300/0 conn(0x7f906c15dee0 msgr2=0x7f906c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906be00640 1 --2- 172.21.15.192:0/1499205388 >> v2:172.21.15.194:3300/0 conn(0x7f906c15dee0 0x7f906c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 --2- 172.21.15.192:0/1499205388 >> v2:172.21.15.194:3300/0 conn(0x7f906c15dee0 0x7f906c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 -- 172.21.15.192:0/1499205388 >> v1:172.21.15.194:6789/0 conn(0x7f906c15e2c0 legacy=0x7f906c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.002+0000 7f906b400640 1 -- 172.21.15.192:0/1499205388 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0b3710 con 0x7f906c0b3f10 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.003+0000 7f906b400640 1 --2- 172.21.15.192:0/1499205388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c0b3f10 0x7f906c0b02c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f906c06cd20 tx=0x7f905802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abe2dfeb482cb86e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.003+0000 7f906aa00640 1 -- 172.21.15.192:0/1499205388 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058032440 con 0x7f906c0b3f10 2024-09-13T18:43:23.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.003+0000 7f906aa00640 1 -- 172.21.15.192:0/1499205388 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90580325a0 con 0x7f906c0b3f10 2024-09-13T18:43:23.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.003+0000 7f906aa00640 1 -- 172.21.15.192:0/1499205388 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9058032930 con 0x7f906c0b3f10 2024-09-13T18:43:23.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 -- 172.21.15.192:0/1499205388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c0b3f10 msgr2=0x7f906c0b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 --2- 172.21.15.192:0/1499205388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c0b3f10 0x7f906c0b02c0 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f906c06cd20 tx=0x7f905802a230 comp rx=0 tx=0).stop 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 -- 172.21.15.192:0/1499205388 shutdown_connections 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 --2- 172.21.15.192:0/1499205388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c0b3f10 0x7f906c0b02c0 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 --2- 172.21.15.192:0/1499205388 >> v2:172.21.15.194:3300/0 conn(0x7f906c15dee0 0x7f906c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 -- 172.21.15.192:0/1499205388 >> 172.21.15.192:0/1499205388 conn(0x7f906c0ae960 msgr2=0x7f906c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 -- 172.21.15.192:0/1499205388 shutdown_connections 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.004+0000 7f9072e00640 1 -- 172.21.15.192:0/1499205388 wait complete. 2024-09-13T18:43:23.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.006+0000 7f9072e00640 1 Processor -- start 2024-09-13T18:43:23.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.006+0000 7f9072e00640 1 -- start start 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.006+0000 7f9072e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f906c15dee0 0x7f906c13c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.006+0000 7f9072e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f906c15e2c0 0x7f906c13f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9072e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9072e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c140380 con 0x7f906c150220 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9072e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c140620 con 0x7f906c15dee0 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9072e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c140900 con 0x7f906c15e2c0 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36308/0 (socket says 172.21.15.192:36308) 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 -- 172.21.15.192:0/601075443 learned_addr learned my addr 172.21.15.192:0/601075443 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f906be00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f906c15dee0 0x7f906c13c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f906b400640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f906c15e2c0 0x7f906c13f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 -- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f906c15e2c0 msgr2=0x7f906c13f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f906c15e2c0 0x7f906c13f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 -- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f906c15dee0 msgr2=0x7f906c13c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f906c15dee0 0x7f906c13c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.007+0000 7f9070e00640 1 -- 172.21.15.192:0/601075443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90580094d0 con 0x7f906c150220 2024-09-13T18:43:23.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9070e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f906400b990 tx=0x7f906400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f906400cba0 con 0x7f906c150220 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f906400cd00 con 0x7f906c150220 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9064014680 con 0x7f906c150220 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906c13d100 con 0x7f906c150220 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.008+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c13fed0 con 0x7f906c150220 2024-09-13T18:43:23.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.009+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c15a440 con 0x7f906c150220 2024-09-13T18:43:23.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.010+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f906401d3b0 con 0x7f906c150220 2024-09-13T18:43:23.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.011+0000 7f9063e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 0x7f904c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.013 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.011+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9064089180 con 0x7f906c150220 2024-09-13T18:43:23.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.011+0000 7f906be00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 0x7f904c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.012+0000 7f906be00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 0x7f904c06d0f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f906c0ae780 tx=0x7f905c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.015+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f90640544a0 con 0x7f906c150220 2024-09-13T18:43:23.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.182+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f906c0709f0 con 0x7f904c06ac30 2024-09-13T18:43:23.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.189+0000 7f9063e00640 1 -- 172.21.15.192:0/601075443 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285143 (secure 0 0 0) 0x7f906c0709f0 con 0x7f904c06ac30 2024-09-13T18:43:23.195 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:23.196 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 msgr2=0x7f904c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 0x7f904c06d0f0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f906c0ae780 tx=0x7f905c008040 comp rx=0 tx=0).stop 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 msgr2=0x7f906c155d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f906400b990 tx=0x7f906400be50 comp rx=0 tx=0).stop 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 shutdown_connections 2024-09-13T18:43:23.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f904c06ac30 0x7f904c06d0f0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f906c150220 0x7f906c155d20 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f906c15e2c0 0x7f906c13f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 --2- 172.21.15.192:0/601075443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f906c15dee0 0x7f906c13c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 >> 172.21.15.192:0/601075443 conn(0x7f906c0ae960 msgr2=0x7f906c159200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 shutdown_connections 2024-09-13T18:43:23.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.193+0000 7f9072e00640 1 -- 172.21.15.192:0/601075443 wait complete. 2024-09-13T18:43:23.211 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2024-09-13T18:43:22.835162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8260,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554239,"statfs":{"total":1600000000,"available":1591541640,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.608499"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.660692+0000","last_change":"2024-09-13T18:43:18.660574+0000","last_active":"2024-09-13T18:43:18.660692+0000","last_peered":"2024-09-13T18:43:18.660692+0000","last_clean":"2024-09-13T18:43:18.660692+0000","last_became_active":"2024-09-13T18:43:18.660302+0000","last_became_peered":"2024-09-13T18:43:18.660302+0000","last_unstale":"2024-09-13T18:43:18.660692+0000","last_undegraded":"2024-09-13T18:43:18.660692+0000","last_fullsized":"2024-09-13T18:43:18.660692+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671959+0000","last_change":"2024-09-13T18:43:18.671352+0000","last_active":"2024-09-13T18:43:18.671959+0000","last_peered":"2024-09-13T18:43:18.671959+0000","last_clean":"2024-09-13T18:43:18.671959+0000","last_became_active":"2024-09-13T18:43:18.670676+0000","last_became_peered":"2024-09-13T18:43:18.670676+0000","last_unstale":"2024-09-13T18:43:18.671959+0000","last_undegraded":"2024-09-13T18:43:18.671959+0000","last_fullsized":"2024-09-13T18:43:18.671959+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:09:42.416033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.676801+0000","last_change":"2024-09-13T18:43:18.675749+0000","last_active":"2024-09-13T18:43:18.676801+0000","last_peered":"2024-09-13T18:43:18.676801+0000","last_clean":"2024-09-13T18:43:18.676801+0000","last_became_active":"2024-09-13T18:43:18.675411+0000","last_became_peered":"2024-09-13T18:43:18.675411+0000","last_unstale":"2024-09-13T18:43:18.676801+0000","last_undegraded":"2024-09-13T18:43:18.676801+0000","last_fullsized":"2024-09-13T18:43:18.676801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:04:35.793772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660156+0000","last_change":"2024-09-13T18:43:18.657379+0000","last_active":"2024-09-13T18:43:19.660156+0000","last_peered":"2024-09-13T18:43:19.660156+0000","last_clean":"2024-09-13T18:43:19.660156+0000","last_became_active":"2024-09-13T18:43:18.657109+0000","last_became_peered":"2024-09-13T18:43:18.657109+0000","last_unstale":"2024-09-13T18:43:19.660156+0000","last_undegraded":"2024-09-13T18:43:19.660156+0000","last_fullsized":"2024-09-13T18:43:19.660156+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:43.310377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670140+0000","last_change":"2024-09-13T18:43:18.669932+0000","last_active":"2024-09-13T18:43:18.670140+0000","last_peered":"2024-09-13T18:43:18.670140+0000","last_clean":"2024-09-13T18:43:18.670140+0000","last_became_active":"2024-09-13T18:43:18.668741+0000","last_became_peered":"2024-09-13T18:43:18.668741+0000","last_unstale":"2024-09-13T18:43:18.670140+0000","last_undegraded":"2024-09-13T18:43:18.670140+0000","last_fullsized":"2024-09-13T18:43:18.670140+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:06.342699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661745+0000","last_change":"2024-09-13T18:43:18.661675+0000","last_active":"2024-09-13T18:43:18.661745+0000","last_peered":"2024-09-13T18:43:18.661745+0000","last_clean":"2024-09-13T18:43:18.661745+0000","last_became_active":"2024-09-13T18:43:18.661398+0000","last_became_peered":"2024-09-13T18:43:18.661398+0000","last_unstale":"2024-09-13T18:43:18.661745+0000","last_undegraded":"2024-09-13T18:43:18.661745+0000","last_fullsized":"2024-09-13T18:43:18.661745+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:16:42.214712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.668149+0000","last_change":"2024-09-13T18:43:18.667897+0000","last_active":"2024-09-13T18:43:18.668149+0000","last_peered":"2024-09-13T18:43:18.668149+0000","last_clean":"2024-09-13T18:43:18.668149+0000","last_became_active":"2024-09-13T18:43:18.666693+0000","last_became_peered":"2024-09-13T18:43:18.666693+0000","last_unstale":"2024-09-13T18:43:18.668149+0000","last_undegraded":"2024-09-13T18:43:18.668149+0000","last_fullsized":"2024-09-13T18:43:18.668149+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:39.566527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669883+0000","last_change":"2024-09-13T18:43:18.669103+0000","last_active":"2024-09-13T18:43:18.669883+0000","last_peered":"2024-09-13T18:43:18.669883+0000","last_clean":"2024-09-13T18:43:18.669883+0000","last_became_active":"2024-09-13T18:43:18.668194+0000","last_became_peered":"2024-09-13T18:43:18.668194+0000","last_unstale":"2024-09-13T18:43:18.669883+0000","last_undegraded":"2024-09-13T18:43:18.669883+0000","last_fullsized":"2024-09-13T18:43:18.669883+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:22.125005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674261+0000","last_change":"2024-09-13T18:43:18.672719+0000","last_active":"2024-09-13T18:43:18.674261+0000","last_peered":"2024-09-13T18:43:18.674261+0000","last_clean":"2024-09-13T18:43:18.674261+0000","last_became_active":"2024-09-13T18:43:18.670847+0000","last_became_peered":"2024-09-13T18:43:18.670847+0000","last_unstale":"2024-09-13T18:43:18.674261+0000","last_undegraded":"2024-09-13T18:43:18.674261+0000","last_fullsized":"2024-09-13T18:43:18.674261+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:19.483462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.659828+0000","last_change":"2024-09-13T18:43:18.659743+0000","last_active":"2024-09-13T18:43:18.659828+0000","last_peered":"2024-09-13T18:43:18.659828+0000","last_clean":"2024-09-13T18:43:18.659828+0000","last_became_active":"2024-09-13T18:43:18.659516+0000","last_became_peered":"2024-09-13T18:43:18.659516+0000","last_unstale":"2024-09-13T18:43:18.659828+0000","last_undegraded":"2024-09-13T18:43:18.659828+0000","last_fullsized":"2024-09-13T18:43:18.659828+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:58:34.486304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660389+0000","last_change":"2024-09-13T18:43:18.666387+0000","last_active":"2024-09-13T18:43:19.660389+0000","last_peered":"2024-09-13T18:43:19.660389+0000","last_clean":"2024-09-13T18:43:19.660389+0000","last_became_active":"2024-09-13T18:43:18.666148+0000","last_became_peered":"2024-09-13T18:43:18.666148+0000","last_unstale":"2024-09-13T18:43:19.660389+0000","last_undegraded":"2024-09-13T18:43:19.660389+0000","last_fullsized":"2024-09-13T18:43:19.660389+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.781783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677035+0000","last_change":"2024-09-13T18:43:18.676918+0000","last_active":"2024-09-13T18:43:18.677035+0000","last_peered":"2024-09-13T18:43:18.677035+0000","last_clean":"2024-09-13T18:43:18.677035+0000","last_became_active":"2024-09-13T18:43:18.676489+0000","last_became_peered":"2024-09-13T18:43:18.676489+0000","last_unstale":"2024-09-13T18:43:18.677035+0000","last_undegraded":"2024-09-13T18:43:18.677035+0000","last_fullsized":"2024-09-13T18:43:18.677035+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660477+0000","last_change":"2024-09-13T18:43:18.676058+0000","last_active":"2024-09-13T18:43:19.660477+0000","last_peered":"2024-09-13T18:43:19.660477+0000","last_clean":"2024-09-13T18:43:19.660477+0000","last_became_active":"2024-09-13T18:43:18.675171+0000","last_became_peered":"2024-09-13T18:43:18.675171+0000","last_unstale":"2024-09-13T18:43:19.660477+0000","last_undegraded":"2024-09-13T18:43:19.660477+0000","last_fullsized":"2024-09-13T18:43:19.660477+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671222+0000","last_change":"2024-09-13T18:43:18.671109+0000","last_active":"2024-09-13T18:43:18.671222+0000","last_peered":"2024-09-13T18:43:18.671222+0000","last_clean":"2024-09-13T18:43:18.671222+0000","last_became_active":"2024-09-13T18:43:18.670268+0000","last_became_peered":"2024-09-13T18:43:18.670268+0000","last_unstale":"2024-09-13T18:43:18.671222+0000","last_undegraded":"2024-09-13T18:43:18.671222+0000","last_fullsized":"2024-09-13T18:43:18.671222+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:35.084057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673019+0000","last_change":"2024-09-13T18:43:18.672663+0000","last_active":"2024-09-13T18:43:18.673019+0000","last_peered":"2024-09-13T18:43:18.673019+0000","last_clean":"2024-09-13T18:43:18.673019+0000","last_became_active":"2024-09-13T18:43:18.671632+0000","last_became_peered":"2024-09-13T18:43:18.671632+0000","last_unstale":"2024-09-13T18:43:18.673019+0000","last_undegraded":"2024-09-13T18:43:18.673019+0000","last_fullsized":"2024-09-13T18:43:18.673019+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:55:38.145667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673646+0000","last_change":"2024-09-13T18:43:18.672650+0000","last_active":"2024-09-13T18:43:18.673646+0000","last_peered":"2024-09-13T18:43:18.673646+0000","last_clean":"2024-09-13T18:43:18.673646+0000","last_became_active":"2024-09-13T18:43:18.672392+0000","last_became_peered":"2024-09-13T18:43:18.672392+0000","last_unstale":"2024-09-13T18:43:18.673646+0000","last_undegraded":"2024-09-13T18:43:18.673646+0000","last_fullsized":"2024-09-13T18:43:18.673646+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:51.550531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664790+0000","last_change":"2024-09-13T18:43:18.664732+0000","last_active":"2024-09-13T18:43:18.664790+0000","last_peered":"2024-09-13T18:43:18.664790+0000","last_clean":"2024-09-13T18:43:18.664790+0000","last_became_active":"2024-09-13T18:43:18.664159+0000","last_became_peered":"2024-09-13T18:43:18.664159+0000","last_unstale":"2024-09-13T18:43:18.664790+0000","last_undegraded":"2024-09-13T18:43:18.664790+0000","last_fullsized":"2024-09-13T18:43:18.664790+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:25:50.383610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673521+0000","last_change":"2024-09-13T18:43:18.673462+0000","last_active":"2024-09-13T18:43:18.673521+0000","last_peered":"2024-09-13T18:43:18.673521+0000","last_clean":"2024-09-13T18:43:18.673521+0000","last_became_active":"2024-09-13T18:43:18.672691+0000","last_became_peered":"2024-09-13T18:43:18.672691+0000","last_unstale":"2024-09-13T18:43:18.673521+0000","last_undegraded":"2024-09-13T18:43:18.673521+0000","last_fullsized":"2024-09-13T18:43:18.673521+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:50.312249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669420+0000","last_change":"2024-09-13T18:43:18.668891+0000","last_active":"2024-09-13T18:43:18.669420+0000","last_peered":"2024-09-13T18:43:18.669420+0000","last_clean":"2024-09-13T18:43:18.669420+0000","last_became_active":"2024-09-13T18:43:18.668505+0000","last_became_peered":"2024-09-13T18:43:18.668505+0000","last_unstale":"2024-09-13T18:43:18.669420+0000","last_undegraded":"2024-09-13T18:43:18.669420+0000","last_fullsized":"2024-09-13T18:43:18.669420+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:45:54.299772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673002+0000","last_change":"2024-09-13T18:43:18.672428+0000","last_active":"2024-09-13T18:43:18.673002+0000","last_peered":"2024-09-13T18:43:18.673002+0000","last_clean":"2024-09-13T18:43:18.673002+0000","last_became_active":"2024-09-13T18:43:18.671291+0000","last_became_peered":"2024-09-13T18:43:18.671291+0000","last_unstale":"2024-09-13T18:43:18.673002+0000","last_undegraded":"2024-09-13T18:43:18.673002+0000","last_fullsized":"2024-09-13T18:43:18.673002+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:10:31.728828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671032+0000","last_change":"2024-09-13T18:43:18.669816+0000","last_active":"2024-09-13T18:43:18.671032+0000","last_peered":"2024-09-13T18:43:18.671032+0000","last_clean":"2024-09-13T18:43:18.671032+0000","last_became_active":"2024-09-13T18:43:18.669511+0000","last_became_peered":"2024-09-13T18:43:18.669511+0000","last_unstale":"2024-09-13T18:43:18.671032+0000","last_undegraded":"2024-09-13T18:43:18.671032+0000","last_fullsized":"2024-09-13T18:43:18.671032+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:58:49.350192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.660801+0000","last_change":"2024-09-13T18:43:18.660673+0000","last_active":"2024-09-13T18:43:18.660801+0000","last_peered":"2024-09-13T18:43:18.660801+0000","last_clean":"2024-09-13T18:43:18.660801+0000","last_became_active":"2024-09-13T18:43:18.660098+0000","last_became_peered":"2024-09-13T18:43:18.660098+0000","last_unstale":"2024-09-13T18:43:18.660801+0000","last_undegraded":"2024-09-13T18:43:18.660801+0000","last_fullsized":"2024-09-13T18:43:18.660801+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:18:57.589118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680133+0000","last_change":"2024-09-13T18:43:18.680038+0000","last_active":"2024-09-13T18:43:18.680133+0000","last_peered":"2024-09-13T18:43:18.680133+0000","last_clean":"2024-09-13T18:43:18.680133+0000","last_became_active":"2024-09-13T18:43:18.679701+0000","last_became_peered":"2024-09-13T18:43:18.679701+0000","last_unstale":"2024-09-13T18:43:18.680133+0000","last_undegraded":"2024-09-13T18:43:18.680133+0000","last_fullsized":"2024-09-13T18:43:18.680133+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:50.312249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672963+0000","last_change":"2024-09-13T18:43:18.671987+0000","last_active":"2024-09-13T18:43:18.672963+0000","last_peered":"2024-09-13T18:43:18.672963+0000","last_clean":"2024-09-13T18:43:18.672963+0000","last_became_active":"2024-09-13T18:43:18.671221+0000","last_became_peered":"2024-09-13T18:43:18.671221+0000","last_unstale":"2024-09-13T18:43:18.672963+0000","last_undegraded":"2024-09-13T18:43:18.672963+0000","last_fullsized":"2024-09-13T18:43:18.672963+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:10.866613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660483+0000","last_change":"2024-09-13T18:43:18.667648+0000","last_active":"2024-09-13T18:43:19.660483+0000","last_peered":"2024-09-13T18:43:19.660483+0000","last_clean":"2024-09-13T18:43:19.660483+0000","last_became_active":"2024-09-13T18:43:18.667348+0000","last_became_peered":"2024-09-13T18:43:18.667348+0000","last_unstale":"2024-09-13T18:43:19.660483+0000","last_undegraded":"2024-09-13T18:43:19.660483+0000","last_fullsized":"2024-09-13T18:43:19.660483+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670093+0000","last_change":"2024-09-13T18:43:18.669944+0000","last_active":"2024-09-13T18:43:18.670093+0000","last_peered":"2024-09-13T18:43:18.670093+0000","last_clean":"2024-09-13T18:43:18.670093+0000","last_became_active":"2024-09-13T18:43:18.669717+0000","last_became_peered":"2024-09-13T18:43:18.669717+0000","last_unstale":"2024-09-13T18:43:18.670093+0000","last_undegraded":"2024-09-13T18:43:18.670093+0000","last_fullsized":"2024-09-13T18:43:18.670093+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.500554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669117+0000","last_change":"2024-09-13T18:43:18.668627+0000","last_active":"2024-09-13T18:43:18.669117+0000","last_peered":"2024-09-13T18:43:18.669117+0000","last_clean":"2024-09-13T18:43:18.669117+0000","last_became_active":"2024-09-13T18:43:18.668354+0000","last_became_peered":"2024-09-13T18:43:18.668354+0000","last_unstale":"2024-09-13T18:43:18.669117+0000","last_undegraded":"2024-09-13T18:43:18.669117+0000","last_fullsized":"2024-09-13T18:43:18.669117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:11.469759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.679121+0000","last_change":"2024-09-13T18:43:18.679037+0000","last_active":"2024-09-13T18:43:18.679121+0000","last_peered":"2024-09-13T18:43:18.679121+0000","last_clean":"2024-09-13T18:43:18.679121+0000","last_became_active":"2024-09-13T18:43:18.676076+0000","last_became_peered":"2024-09-13T18:43:18.676076+0000","last_unstale":"2024-09-13T18:43:18.679121+0000","last_undegraded":"2024-09-13T18:43:18.679121+0000","last_fullsized":"2024-09-13T18:43:18.679121+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:10:10.866613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664861+0000","last_change":"2024-09-13T18:43:18.664408+0000","last_active":"2024-09-13T18:43:18.664861+0000","last_peered":"2024-09-13T18:43:18.664861+0000","last_clean":"2024-09-13T18:43:18.664861+0000","last_became_active":"2024-09-13T18:43:18.664154+0000","last_became_peered":"2024-09-13T18:43:18.664154+0000","last_unstale":"2024-09-13T18:43:18.664861+0000","last_undegraded":"2024-09-13T18:43:18.664861+0000","last_fullsized":"2024-09-13T18:43:18.664861+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:29:03.756122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665255+0000","last_change":"2024-09-13T18:43:18.665179+0000","last_active":"2024-09-13T18:43:18.665255+0000","last_peered":"2024-09-13T18:43:18.665255+0000","last_clean":"2024-09-13T18:43:18.665255+0000","last_became_active":"2024-09-13T18:43:18.664850+0000","last_became_peered":"2024-09-13T18:43:18.664850+0000","last_unstale":"2024-09-13T18:43:18.665255+0000","last_undegraded":"2024-09-13T18:43:18.665255+0000","last_fullsized":"2024-09-13T18:43:18.665255+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:15.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.678529+0000","last_change":"2024-09-13T18:43:18.675784+0000","last_active":"2024-09-13T18:43:18.678529+0000","last_peered":"2024-09-13T18:43:18.678529+0000","last_clean":"2024-09-13T18:43:18.678529+0000","last_became_active":"2024-09-13T18:43:18.675548+0000","last_became_peered":"2024-09-13T18:43:18.675548+0000","last_unstale":"2024-09-13T18:43:18.678529+0000","last_undegraded":"2024-09-13T18:43:18.678529+0000","last_fullsized":"2024-09-13T18:43:18.678529+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:09:11.790473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671538+0000","last_change":"2024-09-13T18:43:18.671310+0000","last_active":"2024-09-13T18:43:18.671538+0000","last_peered":"2024-09-13T18:43:18.671538+0000","last_clean":"2024-09-13T18:43:18.671538+0000","last_became_active":"2024-09-13T18:43:18.671094+0000","last_became_peered":"2024-09-13T18:43:18.671094+0000","last_unstale":"2024-09-13T18:43:18.671538+0000","last_undegraded":"2024-09-13T18:43:18.671538+0000","last_fullsized":"2024-09-13T18:43:18.671538+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:18.622360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669089+0000","last_change":"2024-09-13T18:43:18.667078+0000","last_active":"2024-09-13T18:43:18.669089+0000","last_peered":"2024-09-13T18:43:18.669089+0000","last_clean":"2024-09-13T18:43:18.669089+0000","last_became_active":"2024-09-13T18:43:18.666692+0000","last_became_peered":"2024-09-13T18:43:18.666692+0000","last_unstale":"2024-09-13T18:43:18.669089+0000","last_undegraded":"2024-09-13T18:43:18.669089+0000","last_fullsized":"2024-09-13T18:43:18.669089+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:42:41.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1f","version":"164'4","reported_seq":14,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680676+0000","last_change":"2024-09-13T18:43:18.252913+0000","last_active":"2024-09-13T18:43:18.680676+0000","last_peered":"2024-09-13T18:43:18.680676+0000","last_clean":"2024-09-13T18:43:18.680676+0000","last_became_active":"2024-09-13T18:43:18.250734+0000","last_became_peered":"2024-09-13T18:43:18.250734+0000","last_unstale":"2024-09-13T18:43:18.680676+0000","last_undegraded":"2024-09-13T18:43:18.680676+0000","last_fullsized":"2024-09-13T18:43:18.680676+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:17:11.602065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665081+0000","last_change":"2024-09-13T18:43:18.665025+0000","last_active":"2024-09-13T18:43:18.665081+0000","last_peered":"2024-09-13T18:43:18.665081+0000","last_clean":"2024-09-13T18:43:18.665081+0000","last_became_active":"2024-09-13T18:43:18.664829+0000","last_became_peered":"2024-09-13T18:43:18.664829+0000","last_unstale":"2024-09-13T18:43:18.665081+0000","last_undegraded":"2024-09-13T18:43:18.665081+0000","last_fullsized":"2024-09-13T18:43:18.665081+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:30:13.331869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1e","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680467+0000","last_change":"2024-09-13T18:43:18.248421+0000","last_active":"2024-09-13T18:43:18.680467+0000","last_peered":"2024-09-13T18:43:18.680467+0000","last_clean":"2024-09-13T18:43:18.680467+0000","last_became_active":"2024-09-13T18:43:18.247388+0000","last_became_peered":"2024-09-13T18:43:18.247388+0000","last_unstale":"2024-09-13T18:43:18.680467+0000","last_undegraded":"2024-09-13T18:43:18.680467+0000","last_fullsized":"2024-09-13T18:43:18.680467+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:28.122312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674281+0000","last_change":"2024-09-13T18:43:18.673737+0000","last_active":"2024-09-13T18:43:18.674281+0000","last_peered":"2024-09-13T18:43:18.674281+0000","last_clean":"2024-09-13T18:43:18.674281+0000","last_became_active":"2024-09-13T18:43:18.673528+0000","last_became_peered":"2024-09-13T18:43:18.673528+0000","last_unstale":"2024-09-13T18:43:18.674281+0000","last_undegraded":"2024-09-13T18:43:18.674281+0000","last_fullsized":"2024-09-13T18:43:18.674281+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:52.053617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1d","version":"164'2","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660584+0000","last_change":"2024-09-13T18:43:18.250835+0000","last_active":"2024-09-13T18:43:19.660584+0000","last_peered":"2024-09-13T18:43:19.660584+0000","last_clean":"2024-09-13T18:43:19.660584+0000","last_became_active":"2024-09-13T18:43:18.250419+0000","last_became_peered":"2024-09-13T18:43:18.250419+0000","last_unstale":"2024-09-13T18:43:19.660584+0000","last_undegraded":"2024-09-13T18:43:19.660584+0000","last_fullsized":"2024-09-13T18:43:19.660584+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:06.162673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.664744+0000","last_change":"2024-09-13T18:43:18.663913+0000","last_active":"2024-09-13T18:43:18.664744+0000","last_peered":"2024-09-13T18:43:18.664744+0000","last_clean":"2024-09-13T18:43:18.664744+0000","last_became_active":"2024-09-13T18:43:18.663704+0000","last_became_peered":"2024-09-13T18:43:18.663704+0000","last_unstale":"2024-09-13T18:43:18.664744+0000","last_undegraded":"2024-09-13T18:43:18.664744+0000","last_fullsized":"2024-09-13T18:43:18.664744+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:34:40.500554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1c","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675531+0000","last_change":"2024-09-13T18:43:18.244150+0000","last_active":"2024-09-13T18:43:18.675531+0000","last_peered":"2024-09-13T18:43:18.675531+0000","last_clean":"2024-09-13T18:43:18.675531+0000","last_became_active":"2024-09-13T18:43:18.243871+0000","last_became_peered":"2024-09-13T18:43:18.243871+0000","last_unstale":"2024-09-13T18:43:18.675531+0000","last_undegraded":"2024-09-13T18:43:18.675531+0000","last_fullsized":"2024-09-13T18:43:18.675531+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:04.387153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677200+0000","last_change":"2024-09-13T18:43:18.677077+0000","last_active":"2024-09-13T18:43:18.677200+0000","last_peered":"2024-09-13T18:43:18.677200+0000","last_clean":"2024-09-13T18:43:18.677200+0000","last_became_active":"2024-09-13T18:43:18.676369+0000","last_became_peered":"2024-09-13T18:43:18.676369+0000","last_unstale":"2024-09-13T18:43:18.677200+0000","last_undegraded":"2024-09-13T18:43:18.677200+0000","last_fullsized":"2024-09-13T18:43:18.677200+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:53:23.353114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1b","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675884+0000","last_change":"2024-09-13T18:43:18.249822+0000","last_active":"2024-09-13T18:43:18.675884+0000","last_peered":"2024-09-13T18:43:18.675884+0000","last_clean":"2024-09-13T18:43:18.675884+0000","last_became_active":"2024-09-13T18:43:18.249438+0000","last_became_peered":"2024-09-13T18:43:18.249438+0000","last_unstale":"2024-09-13T18:43:18.675884+0000","last_undegraded":"2024-09-13T18:43:18.675884+0000","last_fullsized":"2024-09-13T18:43:18.675884+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:11.052221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672488+0000","last_change":"2024-09-13T18:43:18.670162+0000","last_active":"2024-09-13T18:43:18.672488+0000","last_peered":"2024-09-13T18:43:18.672488+0000","last_clean":"2024-09-13T18:43:18.672488+0000","last_became_active":"2024-09-13T18:43:18.665906+0000","last_became_peered":"2024-09-13T18:43:18.665906+0000","last_unstale":"2024-09-13T18:43:18.672488+0000","last_undegraded":"2024-09-13T18:43:18.672488+0000","last_fullsized":"2024-09-13T18:43:18.672488+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:30:29.781783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675564+0000","last_change":"2024-09-13T18:43:18.241909+0000","last_active":"2024-09-13T18:43:18.675564+0000","last_peered":"2024-09-13T18:43:18.675564+0000","last_clean":"2024-09-13T18:43:18.675564+0000","last_became_active":"2024-09-13T18:43:18.241606+0000","last_became_peered":"2024-09-13T18:43:18.241606+0000","last_unstale":"2024-09-13T18:43:18.675564+0000","last_undegraded":"2024-09-13T18:43:18.675564+0000","last_fullsized":"2024-09-13T18:43:18.675564+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:55:59.763664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667638+0000","last_change":"2024-09-13T18:43:18.667573+0000","last_active":"2024-09-13T18:43:18.667638+0000","last_peered":"2024-09-13T18:43:18.667638+0000","last_clean":"2024-09-13T18:43:18.667638+0000","last_became_active":"2024-09-13T18:43:18.667340+0000","last_became_peered":"2024-09-13T18:43:18.667340+0000","last_unstale":"2024-09-13T18:43:18.667638+0000","last_undegraded":"2024-09-13T18:43:18.667638+0000","last_fullsized":"2024-09-13T18:43:18.667638+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:33:15.618681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662920+0000","last_change":"2024-09-13T18:43:18.246221+0000","last_active":"2024-09-13T18:43:18.662920+0000","last_peered":"2024-09-13T18:43:18.662920+0000","last_clean":"2024-09-13T18:43:18.662920+0000","last_became_active":"2024-09-13T18:43:18.245980+0000","last_became_peered":"2024-09-13T18:43:18.245980+0000","last_unstale":"2024-09-13T18:43:18.662920+0000","last_undegraded":"2024-09-13T18:43:18.662920+0000","last_fullsized":"2024-09-13T18:43:18.662920+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:22:32.723503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661780+0000","last_change":"2024-09-13T18:43:18.661584+0000","last_active":"2024-09-13T18:43:18.661780+0000","last_peered":"2024-09-13T18:43:18.661780+0000","last_clean":"2024-09-13T18:43:18.661780+0000","last_became_active":"2024-09-13T18:43:18.661355+0000","last_became_peered":"2024-09-13T18:43:18.661355+0000","last_unstale":"2024-09-13T18:43:18.661780+0000","last_undegraded":"2024-09-13T18:43:18.661780+0000","last_fullsized":"2024-09-13T18:43:18.661780+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:22:03.636600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.658362+0000","last_change":"2024-09-13T18:43:18.246055+0000","last_active":"2024-09-13T18:43:18.658362+0000","last_peered":"2024-09-13T18:43:18.658362+0000","last_clean":"2024-09-13T18:43:18.658362+0000","last_became_active":"2024-09-13T18:43:18.245141+0000","last_became_peered":"2024-09-13T18:43:18.245141+0000","last_unstale":"2024-09-13T18:43:18.658362+0000","last_undegraded":"2024-09-13T18:43:18.658362+0000","last_fullsized":"2024-09-13T18:43:18.658362+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:30:21.117811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.661315+0000","last_change":"2024-09-13T18:43:18.660824+0000","last_active":"2024-09-13T18:43:18.661315+0000","last_peered":"2024-09-13T18:43:18.661315+0000","last_clean":"2024-09-13T18:43:18.661315+0000","last_became_active":"2024-09-13T18:43:18.660422+0000","last_became_peered":"2024-09-13T18:43:18.660422+0000","last_unstale":"2024-09-13T18:43:18.661315+0000","last_undegraded":"2024-09-13T18:43:18.661315+0000","last_fullsized":"2024-09-13T18:43:18.661315+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:42:52.820957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.655370+0000","last_change":"2024-09-13T18:43:18.248261+0000","last_active":"2024-09-13T18:43:18.655370+0000","last_peered":"2024-09-13T18:43:18.655370+0000","last_clean":"2024-09-13T18:43:18.655370+0000","last_became_active":"2024-09-13T18:43:18.247588+0000","last_became_peered":"2024-09-13T18:43:18.247588+0000","last_unstale":"2024-09-13T18:43:18.655370+0000","last_undegraded":"2024-09-13T18:43:18.655370+0000","last_fullsized":"2024-09-13T18:43:18.655370+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:07:05.335505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675874+0000","last_change":"2024-09-13T18:43:18.675391+0000","last_active":"2024-09-13T18:43:18.675874+0000","last_peered":"2024-09-13T18:43:18.675874+0000","last_clean":"2024-09-13T18:43:18.675874+0000","last_became_active":"2024-09-13T18:43:18.675185+0000","last_became_peered":"2024-09-13T18:43:18.675185+0000","last_unstale":"2024-09-13T18:43:18.675874+0000","last_undegraded":"2024-09-13T18:43:18.675874+0000","last_fullsized":"2024-09-13T18:43:18.675874+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:49.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667098+0000","last_change":"2024-09-13T18:43:18.249513+0000","last_active":"2024-09-13T18:43:18.667098+0000","last_peered":"2024-09-13T18:43:18.667098+0000","last_clean":"2024-09-13T18:43:18.667098+0000","last_became_active":"2024-09-13T18:43:18.249228+0000","last_became_peered":"2024-09-13T18:43:18.249228+0000","last_unstale":"2024-09-13T18:43:18.667098+0000","last_undegraded":"2024-09-13T18:43:18.667098+0000","last_fullsized":"2024-09-13T18:43:18.667098+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:38:50.443093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.668862+0000","last_change":"2024-09-13T18:43:18.668351+0000","last_active":"2024-09-13T18:43:18.668862+0000","last_peered":"2024-09-13T18:43:18.668862+0000","last_clean":"2024-09-13T18:43:18.668862+0000","last_became_active":"2024-09-13T18:43:18.667449+0000","last_became_peered":"2024-09-13T18:43:18.667449+0000","last_unstale":"2024-09-13T18:43:18.668862+0000","last_undegraded":"2024-09-13T18:43:18.668862+0000","last_fullsized":"2024-09-13T18:43:18.668862+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:35.398963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.15","version":"164'3","reported_seq":13,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680599+0000","last_change":"2024-09-13T18:43:18.250929+0000","last_active":"2024-09-13T18:43:18.680599+0000","last_peered":"2024-09-13T18:43:18.680599+0000","last_clean":"2024-09-13T18:43:18.680599+0000","last_became_active":"2024-09-13T18:43:18.250148+0000","last_became_peered":"2024-09-13T18:43:18.250148+0000","last_unstale":"2024-09-13T18:43:18.680599+0000","last_undegraded":"2024-09-13T18:43:18.680599+0000","last_fullsized":"2024-09-13T18:43:18.680599+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:47:11.179429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.678550+0000","last_change":"2024-09-13T18:43:18.677935+0000","last_active":"2024-09-13T18:43:18.678550+0000","last_peered":"2024-09-13T18:43:18.678550+0000","last_clean":"2024-09-13T18:43:18.678550+0000","last_became_active":"2024-09-13T18:43:18.673210+0000","last_became_peered":"2024-09-13T18:43:18.673210+0000","last_unstale":"2024-09-13T18:43:18.678550+0000","last_undegraded":"2024-09-13T18:43:18.678550+0000","last_fullsized":"2024-09-13T18:43:18.678550+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:56.705896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.14","version":"164'6","reported_seq":16,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.681458+0000","last_change":"2024-09-13T18:43:18.250748+0000","last_active":"2024-09-13T18:43:18.681458+0000","last_peered":"2024-09-13T18:43:18.681458+0000","last_clean":"2024-09-13T18:43:18.681458+0000","last_became_active":"2024-09-13T18:43:18.249892+0000","last_became_peered":"2024-09-13T18:43:18.249892+0000","last_unstale":"2024-09-13T18:43:18.681458+0000","last_undegraded":"2024-09-13T18:43:18.681458+0000","last_fullsized":"2024-09-13T18:43:18.681458+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:06.438678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.670843+0000","last_change":"2024-09-13T18:43:18.670175+0000","last_active":"2024-09-13T18:43:18.670843+0000","last_peered":"2024-09-13T18:43:18.670843+0000","last_clean":"2024-09-13T18:43:18.670843+0000","last_became_active":"2024-09-13T18:43:18.669935+0000","last_became_peered":"2024-09-13T18:43:18.669935+0000","last_unstale":"2024-09-13T18:43:18.670843+0000","last_undegraded":"2024-09-13T18:43:18.670843+0000","last_fullsized":"2024-09-13T18:43:18.670843+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:13.926773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.663684+0000","last_change":"2024-09-13T18:43:18.251196+0000","last_active":"2024-09-13T18:43:18.663684+0000","last_peered":"2024-09-13T18:43:18.663684+0000","last_clean":"2024-09-13T18:43:18.663684+0000","last_became_active":"2024-09-13T18:43:18.250921+0000","last_became_peered":"2024-09-13T18:43:18.250921+0000","last_unstale":"2024-09-13T18:43:18.663684+0000","last_undegraded":"2024-09-13T18:43:18.663684+0000","last_fullsized":"2024-09-13T18:43:18.663684+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:06:52.049987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669071+0000","last_change":"2024-09-13T18:43:18.666902+0000","last_active":"2024-09-13T18:43:18.669071+0000","last_peered":"2024-09-13T18:43:18.669071+0000","last_clean":"2024-09-13T18:43:18.669071+0000","last_became_active":"2024-09-13T18:43:18.666475+0000","last_became_peered":"2024-09-13T18:43:18.666475+0000","last_unstale":"2024-09-13T18:43:18.669071+0000","last_undegraded":"2024-09-13T18:43:18.669071+0000","last_fullsized":"2024-09-13T18:43:18.669071+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:19:44.028930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660374+0000","last_change":"2024-09-13T18:43:18.249202+0000","last_active":"2024-09-13T18:43:19.660374+0000","last_peered":"2024-09-13T18:43:19.660374+0000","last_clean":"2024-09-13T18:43:19.660374+0000","last_became_active":"2024-09-13T18:43:18.248936+0000","last_became_peered":"2024-09-13T18:43:18.248936+0000","last_unstale":"2024-09-13T18:43:19.660374+0000","last_undegraded":"2024-09-13T18:43:19.660374+0000","last_fullsized":"2024-09-13T18:43:19.660374+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:07.792924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677019+0000","last_change":"2024-09-13T18:43:18.676755+0000","last_active":"2024-09-13T18:43:18.677019+0000","last_peered":"2024-09-13T18:43:18.677019+0000","last_clean":"2024-09-13T18:43:18.677019+0000","last_became_active":"2024-09-13T18:43:18.676151+0000","last_became_peered":"2024-09-13T18:43:18.676151+0000","last_unstale":"2024-09-13T18:43:18.677019+0000","last_undegraded":"2024-09-13T18:43:18.677019+0000","last_fullsized":"2024-09-13T18:43:18.677019+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:46:51.613915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.10","version":"164'8","reported_seq":18,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.681322+0000","last_change":"2024-09-13T18:43:18.243577+0000","last_active":"2024-09-13T18:43:18.681322+0000","last_peered":"2024-09-13T18:43:18.681322+0000","last_clean":"2024-09-13T18:43:18.681322+0000","last_became_active":"2024-09-13T18:43:18.243032+0000","last_became_peered":"2024-09-13T18:43:18.243032+0000","last_unstale":"2024-09-13T18:43:18.681322+0000","last_undegraded":"2024-09-13T18:43:18.681322+0000","last_fullsized":"2024-09-13T18:43:18.681322+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:07:05.524549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669899+0000","last_change":"2024-09-13T18:43:18.669794+0000","last_active":"2024-09-13T18:43:18.669899+0000","last_peered":"2024-09-13T18:43:18.669899+0000","last_clean":"2024-09-13T18:43:18.669899+0000","last_became_active":"2024-09-13T18:43:18.668444+0000","last_became_peered":"2024-09-13T18:43:18.668444+0000","last_unstale":"2024-09-13T18:43:18.669899+0000","last_undegraded":"2024-09-13T18:43:18.669899+0000","last_fullsized":"2024-09-13T18:43:18.669899+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:49:05.394347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.f","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675271+0000","last_change":"2024-09-13T18:43:18.251929+0000","last_active":"2024-09-13T18:43:18.675271+0000","last_peered":"2024-09-13T18:43:18.675271+0000","last_clean":"2024-09-13T18:43:18.675271+0000","last_became_active":"2024-09-13T18:43:18.251587+0000","last_became_peered":"2024-09-13T18:43:18.251587+0000","last_unstale":"2024-09-13T18:43:18.675271+0000","last_undegraded":"2024-09-13T18:43:18.675271+0000","last_fullsized":"2024-09-13T18:43:18.675271+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:58.480846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.667608+0000","last_change":"2024-09-13T18:43:18.667244+0000","last_active":"2024-09-13T18:43:18.667608+0000","last_peered":"2024-09-13T18:43:18.667608+0000","last_clean":"2024-09-13T18:43:18.667608+0000","last_became_active":"2024-09-13T18:43:18.667015+0000","last_became_peered":"2024-09-13T18:43:18.667015+0000","last_unstale":"2024-09-13T18:43:18.667608+0000","last_undegraded":"2024-09-13T18:43:18.667608+0000","last_fullsized":"2024-09-13T18:43:18.667608+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:12.059415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"164'2","reported_seq":13,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660670+0000","last_change":"2024-09-13T18:43:18.250641+0000","last_active":"2024-09-13T18:43:19.660670+0000","last_peered":"2024-09-13T18:43:19.660670+0000","last_clean":"2024-09-13T18:43:19.660670+0000","last_became_active":"2024-09-13T18:43:18.249951+0000","last_became_peered":"2024-09-13T18:43:18.249951+0000","last_unstale":"2024-09-13T18:43:19.660670+0000","last_undegraded":"2024-09-13T18:43:19.660670+0000","last_fullsized":"2024-09-13T18:43:19.660670+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:49:50.543337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671941+0000","last_change":"2024-09-13T18:43:18.671129+0000","last_active":"2024-09-13T18:43:18.671941+0000","last_peered":"2024-09-13T18:43:18.671941+0000","last_clean":"2024-09-13T18:43:18.671941+0000","last_became_active":"2024-09-13T18:43:18.669640+0000","last_became_peered":"2024-09-13T18:43:18.669640+0000","last_unstale":"2024-09-13T18:43:18.671941+0000","last_undegraded":"2024-09-13T18:43:18.671941+0000","last_fullsized":"2024-09-13T18:43:18.671941+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:04:07.660809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.d","version":"164'1","reported_seq":11,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.679544+0000","last_change":"2024-09-13T18:43:18.247732+0000","last_active":"2024-09-13T18:43:18.679544+0000","last_peered":"2024-09-13T18:43:18.679544+0000","last_clean":"2024-09-13T18:43:18.679544+0000","last_became_active":"2024-09-13T18:43:18.247422+0000","last_became_peered":"2024-09-13T18:43:18.247422+0000","last_unstale":"2024-09-13T18:43:18.679544+0000","last_undegraded":"2024-09-13T18:43:18.679544+0000","last_fullsized":"2024-09-13T18:43:18.679544+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:19:01.269575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666831+0000","last_change":"2024-09-13T18:43:18.666760+0000","last_active":"2024-09-13T18:43:18.666831+0000","last_peered":"2024-09-13T18:43:18.666831+0000","last_clean":"2024-09-13T18:43:18.666831+0000","last_became_active":"2024-09-13T18:43:18.664907+0000","last_became_peered":"2024-09-13T18:43:18.664907+0000","last_unstale":"2024-09-13T18:43:18.666831+0000","last_undegraded":"2024-09-13T18:43:18.666831+0000","last_fullsized":"2024-09-13T18:43:18.666831+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:55:48.922411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.665361+0000","last_change":"2024-09-13T18:43:18.250797+0000","last_active":"2024-09-13T18:43:18.665361+0000","last_peered":"2024-09-13T18:43:18.665361+0000","last_clean":"2024-09-13T18:43:18.665361+0000","last_became_active":"2024-09-13T18:43:18.250599+0000","last_became_peered":"2024-09-13T18:43:18.250599+0000","last_unstale":"2024-09-13T18:43:18.665361+0000","last_undegraded":"2024-09-13T18:43:18.665361+0000","last_fullsized":"2024-09-13T18:43:18.665361+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:33:38.761720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669403+0000","last_change":"2024-09-13T18:43:18.668724+0000","last_active":"2024-09-13T18:43:18.669403+0000","last_peered":"2024-09-13T18:43:18.669403+0000","last_clean":"2024-09-13T18:43:18.669403+0000","last_became_active":"2024-09-13T18:43:18.667906+0000","last_became_peered":"2024-09-13T18:43:18.667906+0000","last_unstale":"2024-09-13T18:43:18.669403+0000","last_undegraded":"2024-09-13T18:43:18.669403+0000","last_fullsized":"2024-09-13T18:43:18.669403+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:21.978941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.b","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680596+0000","last_change":"2024-09-13T18:43:18.246070+0000","last_active":"2024-09-13T18:43:18.680596+0000","last_peered":"2024-09-13T18:43:18.680596+0000","last_clean":"2024-09-13T18:43:18.680596+0000","last_became_active":"2024-09-13T18:43:18.244873+0000","last_became_peered":"2024-09-13T18:43:18.244873+0000","last_unstale":"2024-09-13T18:43:18.680596+0000","last_undegraded":"2024-09-13T18:43:18.680596+0000","last_fullsized":"2024-09-13T18:43:18.680596+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:38:03.847257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.680117+0000","last_change":"2024-09-13T18:43:18.679878+0000","last_active":"2024-09-13T18:43:18.680117+0000","last_peered":"2024-09-13T18:43:18.680117+0000","last_clean":"2024-09-13T18:43:18.680117+0000","last_became_active":"2024-09-13T18:43:18.678725+0000","last_became_peered":"2024-09-13T18:43:18.678725+0000","last_unstale":"2024-09-13T18:43:18.680117+0000","last_undegraded":"2024-09-13T18:43:18.680117+0000","last_fullsized":"2024-09-13T18:43:18.680117+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:42.997626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666729+0000","last_change":"2024-09-13T18:43:18.247077+0000","last_active":"2024-09-13T18:43:18.666729+0000","last_peered":"2024-09-13T18:43:18.666729+0000","last_clean":"2024-09-13T18:43:18.666729+0000","last_became_active":"2024-09-13T18:43:18.246623+0000","last_became_peered":"2024-09-13T18:43:18.246623+0000","last_unstale":"2024-09-13T18:43:18.666729+0000","last_undegraded":"2024-09-13T18:43:18.666729+0000","last_fullsized":"2024-09-13T18:43:18.666729+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:38:39.856230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674259+0000","last_change":"2024-09-13T18:43:18.674164+0000","last_active":"2024-09-13T18:43:18.674259+0000","last_peered":"2024-09-13T18:43:18.674259+0000","last_clean":"2024-09-13T18:43:18.674259+0000","last_became_active":"2024-09-13T18:43:18.673930+0000","last_became_peered":"2024-09-13T18:43:18.673930+0000","last_unstale":"2024-09-13T18:43:18.674259+0000","last_undegraded":"2024-09-13T18:43:18.674259+0000","last_fullsized":"2024-09-13T18:43:18.674259+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:08.800118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662932+0000","last_change":"2024-09-13T18:43:18.251704+0000","last_active":"2024-09-13T18:43:18.662932+0000","last_peered":"2024-09-13T18:43:18.662932+0000","last_clean":"2024-09-13T18:43:18.662932+0000","last_became_active":"2024-09-13T18:43:18.251370+0000","last_became_peered":"2024-09-13T18:43:18.251370+0000","last_unstale":"2024-09-13T18:43:18.662932+0000","last_undegraded":"2024-09-13T18:43:18.662932+0000","last_fullsized":"2024-09-13T18:43:18.662932+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:36:49.540096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672509+0000","last_change":"2024-09-13T18:43:18.671243+0000","last_active":"2024-09-13T18:43:18.672509+0000","last_peered":"2024-09-13T18:43:18.672509+0000","last_clean":"2024-09-13T18:43:18.672509+0000","last_became_active":"2024-09-13T18:43:18.670972+0000","last_became_peered":"2024-09-13T18:43:18.670972+0000","last_unstale":"2024-09-13T18:43:18.672509+0000","last_undegraded":"2024-09-13T18:43:18.672509+0000","last_fullsized":"2024-09-13T18:43:18.672509+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:02:11.469759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660594+0000","last_change":"2024-09-13T18:43:18.249571+0000","last_active":"2024-09-13T18:43:19.660594+0000","last_peered":"2024-09-13T18:43:19.660594+0000","last_clean":"2024-09-13T18:43:19.660594+0000","last_became_active":"2024-09-13T18:43:18.249155+0000","last_became_peered":"2024-09-13T18:43:18.249155+0000","last_unstale":"2024-09-13T18:43:19.660594+0000","last_undegraded":"2024-09-13T18:43:19.660594+0000","last_fullsized":"2024-09-13T18:43:19.660594+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:22:57.903163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.673270+0000","last_change":"2024-09-13T18:43:18.672532+0000","last_active":"2024-09-13T18:43:18.673270+0000","last_peered":"2024-09-13T18:43:18.673270+0000","last_clean":"2024-09-13T18:43:18.673270+0000","last_became_active":"2024-09-13T18:43:18.672073+0000","last_became_peered":"2024-09-13T18:43:18.672073+0000","last_unstale":"2024-09-13T18:43:18.673270+0000","last_undegraded":"2024-09-13T18:43:18.673270+0000","last_fullsized":"2024-09-13T18:43:18.673270+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:13:56.861002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.7","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.675060+0000","last_change":"2024-09-13T18:43:18.243508+0000","last_active":"2024-09-13T18:43:18.675060+0000","last_peered":"2024-09-13T18:43:18.675060+0000","last_clean":"2024-09-13T18:43:18.675060+0000","last_became_active":"2024-09-13T18:43:18.243237+0000","last_became_peered":"2024-09-13T18:43:18.243237+0000","last_unstale":"2024-09-13T18:43:18.675060+0000","last_undegraded":"2024-09-13T18:43:18.675060+0000","last_fullsized":"2024-09-13T18:43:18.675060+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:43:30.693806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671025+0000","last_change":"2024-09-13T18:43:18.670902+0000","last_active":"2024-09-13T18:43:18.671025+0000","last_peered":"2024-09-13T18:43:18.671025+0000","last_clean":"2024-09-13T18:43:18.671025+0000","last_became_active":"2024-09-13T18:43:18.666782+0000","last_became_peered":"2024-09-13T18:43:18.666782+0000","last_unstale":"2024-09-13T18:43:18.671025+0000","last_undegraded":"2024-09-13T18:43:18.671025+0000","last_fullsized":"2024-09-13T18:43:18.671025+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:58:15.331296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666622+0000","last_change":"2024-09-13T18:43:18.245792+0000","last_active":"2024-09-13T18:43:18.666622+0000","last_peered":"2024-09-13T18:43:18.666622+0000","last_clean":"2024-09-13T18:43:18.666622+0000","last_became_active":"2024-09-13T18:43:18.245391+0000","last_became_peered":"2024-09-13T18:43:18.245391+0000","last_unstale":"2024-09-13T18:43:18.666622+0000","last_undegraded":"2024-09-13T18:43:18.666622+0000","last_fullsized":"2024-09-13T18:43:18.666622+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:37:41.148448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.669103+0000","last_change":"2024-09-13T18:43:18.668129+0000","last_active":"2024-09-13T18:43:18.669103+0000","last_peered":"2024-09-13T18:43:18.669103+0000","last_clean":"2024-09-13T18:43:18.669103+0000","last_became_active":"2024-09-13T18:43:18.667842+0000","last_became_peered":"2024-09-13T18:43:18.667842+0000","last_unstale":"2024-09-13T18:43:18.669103+0000","last_undegraded":"2024-09-13T18:43:18.669103+0000","last_fullsized":"2024-09-13T18:43:18.669103+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:59:07.169867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.666824+0000","last_change":"2024-09-13T18:43:18.240487+0000","last_active":"2024-09-13T18:43:18.666824+0000","last_peered":"2024-09-13T18:43:18.666824+0000","last_clean":"2024-09-13T18:43:18.666824+0000","last_became_active":"2024-09-13T18:43:18.240229+0000","last_became_peered":"2024-09-13T18:43:18.240229+0000","last_unstale":"2024-09-13T18:43:18.666824+0000","last_undegraded":"2024-09-13T18:43:18.666824+0000","last_fullsized":"2024-09-13T18:43:18.666824+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:06.438678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672571+0000","last_change":"2024-09-13T18:43:18.671067+0000","last_active":"2024-09-13T18:43:18.672571+0000","last_peered":"2024-09-13T18:43:18.672571+0000","last_clean":"2024-09-13T18:43:18.672571+0000","last_became_active":"2024-09-13T18:43:18.670558+0000","last_became_peered":"2024-09-13T18:43:18.670558+0000","last_unstale":"2024-09-13T18:43:18.672571+0000","last_undegraded":"2024-09-13T18:43:18.672571+0000","last_fullsized":"2024-09-13T18:43:18.672571+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:35:33.953779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.663059+0000","last_change":"2024-09-13T18:43:18.251568+0000","last_active":"2024-09-13T18:43:18.663059+0000","last_peered":"2024-09-13T18:43:18.663059+0000","last_clean":"2024-09-13T18:43:18.663059+0000","last_became_active":"2024-09-13T18:43:18.251018+0000","last_became_peered":"2024-09-13T18:43:18.251018+0000","last_unstale":"2024-09-13T18:43:18.663059+0000","last_undegraded":"2024-09-13T18:43:18.663059+0000","last_fullsized":"2024-09-13T18:43:18.663059+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:14:09.261392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672528+0000","last_change":"2024-09-13T18:43:18.671330+0000","last_active":"2024-09-13T18:43:18.672528+0000","last_peered":"2024-09-13T18:43:18.672528+0000","last_clean":"2024-09-13T18:43:18.672528+0000","last_became_active":"2024-09-13T18:43:18.669948+0000","last_became_peered":"2024-09-13T18:43:18.669948+0000","last_unstale":"2024-09-13T18:43:18.672528+0000","last_undegraded":"2024-09-13T18:43:18.672528+0000","last_fullsized":"2024-09-13T18:43:18.672528+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:20.672236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.659949+0000","last_change":"2024-09-13T18:43:18.247987+0000","last_active":"2024-09-13T18:43:18.659949+0000","last_peered":"2024-09-13T18:43:18.659949+0000","last_clean":"2024-09-13T18:43:18.659949+0000","last_became_active":"2024-09-13T18:43:18.245245+0000","last_became_peered":"2024-09-13T18:43:18.245245+0000","last_unstale":"2024-09-13T18:43:18.659949+0000","last_undegraded":"2024-09-13T18:43:18.659949+0000","last_fullsized":"2024-09-13T18:43:18.659949+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:14:19.423726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.656917+0000","last_change":"2024-09-13T18:43:18.656847+0000","last_active":"2024-09-13T18:43:18.656917+0000","last_peered":"2024-09-13T18:43:18.656917+0000","last_clean":"2024-09-13T18:43:18.656917+0000","last_became_active":"2024-09-13T18:43:18.656632+0000","last_became_peered":"2024-09-13T18:43:18.656632+0000","last_unstale":"2024-09-13T18:43:18.656917+0000","last_undegraded":"2024-09-13T18:43:18.656917+0000","last_fullsized":"2024-09-13T18:43:18.656917+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:02:43.310377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.655633+0000","last_change":"2024-09-13T18:43:18.242234+0000","last_active":"2024-09-13T18:43:18.655633+0000","last_peered":"2024-09-13T18:43:18.655633+0000","last_clean":"2024-09-13T18:43:18.655633+0000","last_became_active":"2024-09-13T18:43:18.241592+0000","last_became_peered":"2024-09-13T18:43:18.241592+0000","last_unstale":"2024-09-13T18:43:18.655633+0000","last_undegraded":"2024-09-13T18:43:18.655633+0000","last_fullsized":"2024-09-13T18:43:18.655633+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:19:48.068948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.672983+0000","last_change":"2024-09-13T18:43:18.672312+0000","last_active":"2024-09-13T18:43:18.672983+0000","last_peered":"2024-09-13T18:43:18.672983+0000","last_clean":"2024-09-13T18:43:18.672983+0000","last_became_active":"2024-09-13T18:43:18.671619+0000","last_became_peered":"2024-09-13T18:43:18.671619+0000","last_unstale":"2024-09-13T18:43:18.672983+0000","last_undegraded":"2024-09-13T18:43:18.672983+0000","last_fullsized":"2024-09-13T18:43:18.672983+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:52:42.997626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-13T18:43:19.660557+0000","last_change":"2024-09-13T18:43:18.250721+0000","last_active":"2024-09-13T18:43:19.660557+0000","last_peered":"2024-09-13T18:43:19.660557+0000","last_clean":"2024-09-13T18:43:19.660557+0000","last_became_active":"2024-09-13T18:43:18.250233+0000","last_became_peered":"2024-09-13T18:43:18.250233+0000","last_unstale":"2024-09-13T18:43:19.660557+0000","last_undegraded":"2024-09-13T18:43:19.660557+0000","last_fullsized":"2024-09-13T18:43:19.660557+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:34.076863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.677068+0000","last_change":"2024-09-13T18:43:18.676716+0000","last_active":"2024-09-13T18:43:18.677068+0000","last_peered":"2024-09-13T18:43:18.677068+0000","last_clean":"2024-09-13T18:43:18.677068+0000","last_became_active":"2024-09-13T18:43:18.676460+0000","last_became_peered":"2024-09-13T18:43:18.676460+0000","last_unstale":"2024-09-13T18:43:18.677068+0000","last_undegraded":"2024-09-13T18:43:18.677068+0000","last_fullsized":"2024-09-13T18:43:18.677068+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:26:20.672236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.662642+0000","last_change":"2024-09-13T18:43:18.252860+0000","last_active":"2024-09-13T18:43:18.662642+0000","last_peered":"2024-09-13T18:43:18.662642+0000","last_clean":"2024-09-13T18:43:18.662642+0000","last_became_active":"2024-09-13T18:43:18.252622+0000","last_became_peered":"2024-09-13T18:43:18.252622+0000","last_unstale":"2024-09-13T18:43:18.662642+0000","last_undegraded":"2024-09-13T18:43:18.662642+0000","last_fullsized":"2024-09-13T18:43:18.662642+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:29:41.223990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.671814+0000","last_change":"2024-09-13T18:43:18.671720+0000","last_active":"2024-09-13T18:43:18.671814+0000","last_peered":"2024-09-13T18:43:18.671814+0000","last_clean":"2024-09-13T18:43:18.671814+0000","last_became_active":"2024-09-13T18:43:18.668662+0000","last_became_peered":"2024-09-13T18:43:18.668662+0000","last_unstale":"2024-09-13T18:43:18.671814+0000","last_undegraded":"2024-09-13T18:43:18.671814+0000","last_fullsized":"2024-09-13T18:43:18.671814+0000","mapping_epoch":163,"log_start":"0'0","ondisk_log_start":"0'0","created":163,"last_epoch_clean":164,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:18.226439+0000","last_clean_scrub_stamp":"2024-09-13T18:43:18.226439+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:42:44.027841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.13","version":"164'2","reported_seq":12,"reported_epoch":164,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.674748+0000","last_change":"2024-09-13T18:43:18.240198+0000","last_active":"2024-09-13T18:43:18.674748+0000","last_peered":"2024-09-13T18:43:18.674748+0000","last_clean":"2024-09-13T18:43:18.674748+0000","last_became_active":"2024-09-13T18:43:18.239905+0000","last_became_peered":"2024-09-13T18:43:18.239905+0000","last_unstale":"2024-09-13T18:43:18.674748+0000","last_undegraded":"2024-09-13T18:43:18.674748+0000","last_fullsized":"2024-09-13T18:43:18.674748+0000","mapping_epoch":162,"log_start":"0'0","ondisk_log_start":"0'0","created":162,"last_epoch_clean":163,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:43:17.219244+0000","last_clean_scrub_stamp":"2024-09-13T18:43:17.219244+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:02:38.559333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":296,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-13T18:43:18.249159+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:43:18.249159+0000","last_peered":"2024-09-13T18:43:18.249159+0000","last_clean":"2024-09-13T18:43:18.249159+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:43:18.249159+0000","last_undegraded":"2024-09-13T18:43:18.249159+0000","last_fullsized":"2024-09-13T18:43:18.249159+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542242,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1473,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193838,"statfs":{"total":200000000,"available":198491061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.66500000000000004,"15min":0.63400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.81999999999999995,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68300000000000005,"15min":0.63900000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.92100000000000004,"5min":1.014,"15min":1.014},"last":0.84799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.89800000000000002,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.443,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.873,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.49399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.94499999999999995},"last":1.004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.67300000000000004,"15min":0.65100000000000002},"min":{"1min":0.46800000000000003,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.999,"15min":0.999},"last":0.93799999999999994}]},{"osd":3,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72799999999999998,"15min":0.83099999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.90400000000000003,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.71199999999999997,"15min":0.83199999999999996},"min":{"1min":0.48999999999999999,"5min":0.44,"15min":0.44},"max":{"1min":0.88300000000000001,"5min":0.91300000000000003,"15min":6.0890000000000004},"last":1.0880000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.56599999999999995},"min":{"1min":0.374,"5min":0.33600000000000002,"15min":0.313},"max":{"1min":0.80100000000000005,"5min":0.88800000000000001,"15min":1.036},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.63,"5min":0.624,"15min":0.61799999999999999},"min":{"1min":0.39300000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.875,"5min":0.94699999999999995,"15min":1.1799999999999999},"last":0.70499999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.67000000000000004,"15min":0.64800000000000002},"min":{"1min":0.54200000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":1.0700000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69199999999999995,"15min":0.71399999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":1.371},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:42:41 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.44800000000000001,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.90400000000000003,"5min":1.0349999999999999,"15min":1.143},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.69899999999999995,"15min":0.68400000000000005},"min":{"1min":0.47599999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.98099999999999998,"5min":0.997,"15min":1.125},"last":0.81699999999999995}]}]},{"osd":7,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":896,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194416,"statfs":{"total":200000000,"available":199082171,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.70399999999999996,"15min":0.64700000000000002},"min":{"1min":0.41599999999999998,"5min":0.38800000000000001,"15min":0.34699999999999998},"max":{"1min":0.91300000000000003,"5min":1.665,"15min":1.665},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.67500000000000004,"15min":0.63700000000000001},"min":{"1min":0.52300000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.88700000000000001,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71399999999999997,"15min":0.65400000000000003},"min":{"1min":0.46899999999999997,"5min":0.432,"15min":0.432},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.745},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67600000000000005,"15min":0.64700000000000002},"min":{"1min":0.502,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.79300000000000004,"5min":1.591,"15min":1.591},"last":0.86099999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.68100000000000005},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85099999999999998,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.73999999999999999,"15min":0.70399999999999996},"min":{"1min":0.58399999999999996,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.872,"5min":2.169,"15min":2.169},"last":0.76000000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.74199999999999999,"15min":0.67700000000000005},"min":{"1min":0.57299999999999995,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90100000000000002,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.68400000000000005,"15min":0.64900000000000002},"min":{"1min":0.45000000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.89000000000000001,"5min":0.96899999999999997,"15min":0.98799999999999999},"last":0.78600000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.57099999999999995,"15min":0.58999999999999997},"min":{"1min":0.39300000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.621,"15min":0.64700000000000002},"min":{"1min":0.40400000000000003,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58499999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.69899999999999995,"15min":0.68200000000000005},"min":{"1min":0.56699999999999995,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95799999999999996,"5min":0.96899999999999997,"15min":1.0840000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.438,"5min":0.372,"15min":0.372},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.115},"last":0.68100000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:42:38 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.51800000000000002,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.92500000000000004,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.74299999999999999,"15min":0.73999999999999999},"min":{"1min":0.52500000000000002,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.83199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.69499999999999995,"15min":0.80900000000000005},"min":{"1min":0.50700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.89900000000000002,"5min":1.696,"15min":6.4539999999999997},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.64800000000000002,"15min":0.63500000000000001},"min":{"1min":0.41599999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.86799999999999999,"5min":0.999,"15min":0.999},"last":0.64400000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.69099999999999995,"15min":0.82599999999999996},"min":{"1min":0.436,"5min":0.377,"15min":0.377},"max":{"1min":0.93500000000000005,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.67300000000000004,"15min":0.80800000000000005},"min":{"1min":0.48699999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.85399999999999998,"5min":1.1180000000000001,"15min":6.5019999999999998},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68100000000000005,"15min":0.65100000000000002},"min":{"1min":0.47399999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.94999999999999996,"5min":1.032,"15min":1.032},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.70499999999999996,"15min":0.85999999999999999},"min":{"1min":0.48599999999999999,"5min":0.441,"15min":0.441},"max":{"1min":0.87,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.60499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.70099999999999996,"15min":0.80500000000000005},"min":{"1min":0.45900000000000002,"5min":0.45000000000000001,"15min":0.39500000000000002},"max":{"1min":0.79600000000000004,"5min":1.004,"15min":6.2039999999999997},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.57399999999999995,"5min":0.45000000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.747}]},{"osd":4,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.66000000000000003,"15min":0.63400000000000001},"min":{"1min":0.52100000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.79500000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.625},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.68999999999999995,"15min":0.68700000000000006},"min":{"1min":0.503,"5min":0.38800000000000001,"15min":0.38400000000000001},"max":{"1min":0.85199999999999998,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.58299999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.40899999999999997,"5min":0.36499999999999999,"15min":0.36399999999999999},"max":{"1min":0.83599999999999997,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.65000000000000002,"15min":0.625},"min":{"1min":0.45500000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81299999999999994,"5min":1.403,"15min":1.403},"last":0.439}]},{"osd":7,"last update":"Fri Sep 13 18:42:36 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.51300000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.89500000000000002,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.45500000000000002},"max":{"1min":0.83699999999999997,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.57299999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70699999999999996,"15min":0.66900000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.581,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.69299999999999995,"15min":0.64900000000000002},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2370000000000001,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.72799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.70599999999999996,"15min":0.67700000000000005},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.874},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.71899999999999997,"15min":0.68600000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.6060000000000001,"5min":2.8180000000000001,"15min":2.8180000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.73999999999999999,"15min":0.69999999999999996},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.5589999999999999,"5min":3.706,"15min":3.706},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.754,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.915,"5min":3.742,"15min":3.742},"last":0.79400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.77000000000000002,"15min":0.71299999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.762,"5min":3.6909999999999998,"15min":3.6909999999999998},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72999999999999998,"15min":0.67800000000000005},"min":{"1min":0.47799999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64900000000000002,"15min":0.61499999999999999},"min":{"1min":0.41899999999999998,"5min":0.35799999999999998,"15min":0.32200000000000001},"max":{"1min":1.6870000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.66200000000000003,"15min":0.60999999999999999},"min":{"1min":0.48799999999999999,"5min":0.39800000000000002,"15min":0.37},"max":{"1min":4.4569999999999999,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.56599999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.84799999999999998,"15min":0.74399999999999999},"min":{"1min":0.58899999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":4.0620000000000003,"5min":8.5519999999999996,"15min":8.5519999999999996},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.748,"15min":0.69899999999999995},"min":{"1min":0.46800000000000003,"5min":0.46500000000000002,"15min":0.36399999999999999},"max":{"1min":1.843,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.66100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68999999999999995,"15min":0.62},"min":{"1min":0.48099999999999998,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":1.548,"5min":5.5069999999999997,"15min":5.5069999999999997},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.77800000000000002,"15min":0.70999999999999996},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":4.5259999999999998,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.93200000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":883,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194428,"statfs":{"total":200000000,"available":199095221,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41799999999999998,"15min":0.443},"min":{"1min":0.32300000000000001,"5min":0.27800000000000002,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.69799999999999995,"15min":0.83799999999999997},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.45500000000000002,"15min":0.44700000000000001},"min":{"1min":0.29599999999999999,"5min":0.25600000000000001,"15min":0.248},"max":{"1min":0.57799999999999996,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.39100000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.48799999999999999,"15min":0.72599999999999998},"min":{"1min":0.32200000000000001,"5min":0.29099999999999998,"15min":0.26800000000000002},"max":{"1min":0.57599999999999996,"5min":1.546,"15min":8.1059999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.56000000000000005},"min":{"1min":0.34100000000000003,"5min":0.32900000000000001,"15min":0.28299999999999997},"max":{"1min":0.73799999999999999,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.502}]},{"osd":2,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.59999999999999998},"min":{"1min":0.35899999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.496,"15min":0.68000000000000005},"min":{"1min":0.36399999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.58299999999999996,"5min":0.95399999999999996,"15min":7.798},"last":0.52900000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.77500000000000002,"15min":0.79600000000000004},"min":{"1min":0.58299999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0800000000000001,"15min":3.093},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.75700000000000001,"15min":0.73899999999999999},"min":{"1min":0.54200000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.2869999999999999,"15min":1.4039999999999999},"last":0.63300000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.78800000000000003,"15min":0.79900000000000004},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.745,"15min":0.71899999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.97799999999999998,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.68999999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.78100000000000003,"15min":0.95799999999999996},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1519999999999999,"5min":1.2649999999999999,"15min":7.9199999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.73999999999999999,"15min":0.89400000000000002},"min":{"1min":0.55900000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.97099999999999997,"5min":1.2430000000000001,"15min":8.0519999999999996},"last":0.86799999999999999}]},{"osd":7,"last update":"Fri Sep 13 18:42:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.77100000000000002,"15min":0.71599999999999997},"min":{"1min":0.56599999999999995,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0329999999999999,"5min":1.206,"15min":1.206},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.79100000000000004,"15min":0.83699999999999997},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.1200000000000001,"5min":1.218,"15min":2.9900000000000002},"last":0.91600000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574944,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.42799999999999999,"15min":0.42099999999999999},"min":{"1min":0.27400000000000002,"5min":0.255,"15min":0.21299999999999999},"max":{"1min":0.622,"5min":0.73199999999999998,"15min":1.2390000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.318,"5min":0.29799999999999999,"15min":0.253},"max":{"1min":0.60999999999999999,"5min":0.74299999999999999,"15min":0.93200000000000005},"last":0.51400000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.49199999999999999,"15min":0.48099999999999998},"min":{"1min":0.34399999999999997,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.45100000000000001,"15min":0.47699999999999998},"min":{"1min":0.31,"5min":0.30599999999999999,"15min":0.26100000000000001},"max":{"1min":0.57199999999999995,"5min":0.76000000000000001,"15min":1.3300000000000001},"last":0.499}]},{"osd":3,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.497,"15min":0.50700000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.30499999999999999},"max":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":1.5009999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.56299999999999994,"15min":0.57299999999999995},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.34499999999999997},"max":{"1min":0.77500000000000002,"5min":0.79500000000000004,"15min":1.7030000000000001},"last":0.61099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.73999999999999999,"15min":0.71599999999999997},"min":{"1min":0.53700000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97199999999999998,"5min":1.075,"15min":1.1830000000000001},"last":1.034},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.73099999999999998,"15min":0.70299999999999996},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48099999999999998},"max":{"1min":0.98499999999999999,"5min":1.006,"15min":1.02},"last":0.95199999999999996}]},{"osd":5,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.76400000000000001},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.77600000000000002,"15min":0.72799999999999998},"min":{"1min":0.54500000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.98799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.752,"15min":0.72499999999999998},"min":{"1min":0.55500000000000005,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.748,"15min":0.70399999999999996},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.016,"5min":1.6220000000000001,"15min":1.6220000000000001},"last":1.022}]},{"osd":7,"last update":"Fri Sep 13 18:42:45 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.77200000000000002,"15min":0.74199999999999999},"min":{"1min":0.56000000000000005,"5min":0.54300000000000004,"15min":0.53900000000000003},"max":{"1min":0.90100000000000002,"5min":1.097,"15min":1.1419999999999999},"last":0.96499999999999997},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.80400000000000005,"15min":0.77400000000000002},"min":{"1min":0.59699999999999998,"5min":0.502,"15min":0.502},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.97799999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1460,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193852,"statfs":{"total":200000000,"available":198504853,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.45500000000000002,"15min":0.437},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.73199999999999998,"15min":1.6000000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.495,"15min":0.47999999999999998},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.66500000000000004,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.45800000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.46500000000000002,"15min":0.45500000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63300000000000001,"5min":1.036,"15min":1.036},"last":0.439},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.52300000000000002,"15min":0.48099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.73699999999999999,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42999999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.55900000000000005,"15min":0.51800000000000002},"min":{"1min":0.38,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.70199999999999996,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.52300000000000002,"15min":0.50600000000000001},"min":{"1min":0.33000000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.57299999999999995,"5min":0.93600000000000005,"15min":1.1870000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.78800000000000003,"15min":0.76100000000000001},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.998,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.77500000000000002,"15min":0.76100000000000001},"min":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.94999999999999996,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.628}]},{"osd":5,"last update":"Fri Sep 13 18:42:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76200000000000001,"15min":0.73299999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.89000000000000001,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.74099999999999999,"15min":0.71499999999999997},"min":{"1min":0.53900000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.90000000000000002,"5min":1.242,"15min":1.242},"last":0.58199999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.92800000000000005,"5min":1.21,"15min":1.21},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.80400000000000005,"15min":0.77500000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.93700000000000006,"5min":1.278,"15min":1.278},"last":0.65100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:42:40 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.76400000000000001,"15min":0.748},"min":{"1min":0.498,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.98999999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.77500000000000002,"15min":0.76700000000000002},"min":{"1min":0.51500000000000001,"5min":0.5,"15min":0.5},"max":{"1min":0.91000000000000003,"5min":1.149,"15min":1.1539999999999999},"last":0.66300000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574944,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":889,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194422,"statfs":{"total":200000000,"available":199088946,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.438,"15min":0.45700000000000002},"min":{"1min":0.27900000000000003,"5min":0.25600000000000001,"15min":0.24099999999999999},"max":{"1min":0.56799999999999995,"5min":0.76700000000000002,"15min":1.669},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.29899999999999999,"5min":0.27900000000000003,"15min":0.24099999999999999},"max":{"1min":0.53100000000000003,"5min":0.75800000000000001,"15min":0.874},"last":0.42699999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.48799999999999999,"15min":0.502},"min":{"1min":0.34399999999999997,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63,"5min":0.76600000000000001,"15min":1.591},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.50900000000000001,"15min":0.47999999999999998},"min":{"1min":0.372,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.69099999999999995,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36199999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.46000000000000002},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.251},"max":{"1min":0.54100000000000004,"5min":0.78100000000000003,"15min":1.03},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.53100000000000003,"15min":0.53400000000000003},"min":{"1min":0.372,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.626,"5min":0.85899999999999999,"15min":1.637},"last":0.39400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.72899999999999998,"15min":0.70099999999999996},"min":{"1min":0.48899999999999999,"5min":0.47599999999999998,"15min":0.45200000000000001},"max":{"1min":0.97099999999999997,"5min":1.2,"15min":1.2},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.72299999999999998,"15min":0.70599999999999996},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.98599999999999999,"5min":1.006,"15min":1.698},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:42:47 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.79000000000000004,"15min":0.74299999999999999},"min":{"1min":0.53200000000000003,"5min":0.5,"15min":0.5},"max":{"1min":0.96599999999999997,"5min":1.204,"15min":1.204},"last":0.624},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.76600000000000001,"15min":0.77600000000000002},"min":{"1min":0.503,"5min":0.496,"15min":0.496},"max":{"1min":0.92700000000000005,"5min":1.121,"15min":2.2589999999999999},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.74199999999999999,"15min":0.75},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96799999999999997,"5min":1.1519999999999999,"15min":2.3010000000000002},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.75800000000000001,"15min":0.71199999999999997},"min":{"1min":0.496,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:42:42 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.73499999999999999,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.876,"5min":1.0780000000000001,"15min":2.3399999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76000000000000001,"15min":0.69699999999999995},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89800000000000002,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.52700000000000002}]}]}],"pool_statfs":[]}} 2024-09-13T18:43:23.216 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:43:23.216 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:43:23.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.407+0000 7fd769e00640 1 Processor -- start 2024-09-13T18:43:23.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.408+0000 7fd769e00640 1 -- start start 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd76406bc30 0x7fd7640b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76415af60 con 0x7fd764159ee0 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd76415aaa0 con 0x7fd76406bc30 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76406b7a0 con 0x7fd764159b00 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd763e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd76406bc30 0x7fd7640b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd764159ee0 0x7fd76415a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36900/0 (socket says 172.21.15.192:36900) 2024-09-13T18:43:23.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd769400640 1 -- 172.21.15.192:0/2752996415 learned_addr learned my addr 172.21.15.192:0/2752996415 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:23.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.409+0000 7fd768a00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.410+0000 7fd763e00640 1 -- 172.21.15.192:0/2752996415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 msgr2=0x7fd7640b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:23.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.410+0000 7fd763e00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.410+0000 7fd763e00640 1 -- 172.21.15.192:0/2752996415 >> v1:172.21.15.192:6789/0 conn(0x7fd764159ee0 legacy=0x7fd76415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.410+0000 7fd763e00640 1 -- 172.21.15.192:0/2752996415 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76415ac80 con 0x7fd76406bc30 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd763e00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd76406bc30 0x7fd7640b32b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097a0 tx=0x7fd75002c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7826df849fdc35a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd763400640 1 -- 172.21.15.192:0/2752996415 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750034640 con 0x7fd76406bc30 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd763400640 1 -- 172.21.15.192:0/2752996415 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7500347a0 con 0x7fd76406bc30 2024-09-13T18:43:23.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd763400640 1 -- 172.21.15.192:0/2752996415 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd750034b30 con 0x7fd76406bc30 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 -- 172.21.15.192:0/2752996415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd76406bc30 msgr2=0x7fd7640b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd76406bc30 0x7fd7640b32b0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd7500097a0 tx=0x7fd75002c390 comp rx=0 tx=0).stop 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 -- 172.21.15.192:0/2752996415 shutdown_connections 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd76406bc30 0x7fd7640b32b0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 --2- 172.21.15.192:0/2752996415 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.411+0000 7fd769e00640 1 -- 172.21.15.192:0/2752996415 >> 172.21.15.192:0/2752996415 conn(0x7fd7640736d0 msgr2=0x7fd7640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.412+0000 7fd769e00640 1 -- 172.21.15.192:0/2752996415 shutdown_connections 2024-09-13T18:43:23.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.412+0000 7fd769e00640 1 -- 172.21.15.192:0/2752996415 wait complete. 2024-09-13T18:43:23.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.413+0000 7fd769e00640 1 Processor -- start 2024-09-13T18:43:23.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.413+0000 7fd769e00640 1 -- start start 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76406bc30 0x7fd76414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76414ea60 con 0x7fd764159ee0 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640aeab0 con 0x7fd76406bc30 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640aed90 con 0x7fd764159b00 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36320/0 (socket says 172.21.15.192:36320) 2024-09-13T18:43:23.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.414+0000 7fd769400640 1 -- 172.21.15.192:0/194524526 learned_addr learned my addr 172.21.15.192:0/194524526 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd768a00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76406bc30 0x7fd76414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd763e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 -- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 msgr2=0x7fd7640afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 -- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76406bc30 msgr2=0x7fd76414e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76406bc30 0x7fd76414e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 -- 172.21.15.192:0/194524526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750009400 con 0x7fd764159ee0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769400640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00ca80 tx=0x7fd75c00cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00ac30 con 0x7fd764159ee0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00ad90 con 0x7fd764159ee0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c012600 con 0x7fd764159ee0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640af070 con 0x7fd764159ee0 2024-09-13T18:43:23.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.415+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7640af630 con 0x7fd764159ee0 2024-09-13T18:43:23.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.416+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd764067680 con 0x7fd764159ee0 2024-09-13T18:43:23.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.417+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd75c007070 con 0x7fd764159ee0 2024-09-13T18:43:23.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.418+0000 7fd760c00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 0x7fd74406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.418+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd75c0891f0 con 0x7fd764159ee0 2024-09-13T18:43:23.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.418+0000 7fd768a00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 0x7fd74406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.419+0000 7fd768a00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 0x7fd74406d0c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd758006fd0 tx=0x7fd758008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.422+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd75c0543e0 con 0x7fd764159ee0 2024-09-13T18:43:23.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.654+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd76415a390 con 0x7fd764159ee0 2024-09-13T18:43:23.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.659+0000 7fd760c00640 1 -- 172.21.15.192:0/194524526 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd75c057a00 con 0x7fd764159ee0 2024-09-13T18:43:23.662 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:43:23.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.661+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 msgr2=0x7fd74406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.661+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 0x7fd74406d0c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd758006fd0 tx=0x7fd758008040 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.661+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 msgr2=0x7fd764151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.661+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fd75c00ca80 tx=0x7fd75c00cf40 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 shutdown_connections 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd74406ac00 0x7fd74406d0c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd764159ee0 0x7fd764151a10 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd764159b00 0x7fd7640afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 --2- 172.21.15.192:0/194524526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd76406bc30 0x7fd76414e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 >> 172.21.15.192:0/194524526 conn(0x7fd7640736d0 msgr2=0x7fd7640b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 shutdown_connections 2024-09-13T18:43:23.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.662+0000 7fd769e00640 1 -- 172.21.15.192:0/194524526 wait complete. 2024-09-13T18:43:23.681 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:23.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.831+0000 7f44a5600640 1 Processor -- start 2024-09-13T18:43:23.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.831+0000 7f44a5600640 1 -- start start 2024-09-13T18:43:23.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a5600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f44a0156e30 0x7f44a0157210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a5600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00b3c90 con 0x7f44a0161210 2024-09-13T18:43:23.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a5600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a0157750 con 0x7f44a0156e30 2024-09-13T18:43:23.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a5600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00b3110 con 0x7f44a00adf50 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f449fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f44a0156e30 0x7f44a0157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f449fe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f44a0156e30 0x7f44a0157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44460/0 (socket says 172.21.15.192:44460) 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f449fe00640 1 -- 172.21.15.192:0/1303929192 learned_addr learned my addr 172.21.15.192:0/1303929192 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.832+0000 7f44a4c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:45794/0 (socket says 172.21.15.192:45794) 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.833+0000 7f449fe00640 1 -- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 msgr2=0x7f44a015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:23.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.833+0000 7f449fe00640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.833+0000 7f449fe00640 1 -- 172.21.15.192:0/1303929192 >> v1:172.21.15.194:6789/0 conn(0x7f44a0161210 legacy=0x7f44a00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.833+0000 7f449fe00640 1 -- 172.21.15.192:0/1303929192 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00b33f0 con 0x7f44a0156e30 2024-09-13T18:43:23.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.833+0000 7f44a4c00640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:23.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.834+0000 7f449fe00640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a0156e30 0x7f44a0157210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4490009870 tx=0x7f449002a250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6781a606c37103cb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.834+0000 7f449ea00640 1 -- 172.21.15.192:0/1303929192 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490032440 con 0x7f44a0156e30 2024-09-13T18:43:23.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.834+0000 7f449ea00640 1 -- 172.21.15.192:0/1303929192 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44900325a0 con 0x7f44a0156e30 2024-09-13T18:43:23.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.834+0000 7f449ea00640 1 -- 172.21.15.192:0/1303929192 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490032930 con 0x7f44a0156e30 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 -- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a0156e30 msgr2=0x7f44a0157210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a0156e30 0x7f44a0157210 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4490009870 tx=0x7f449002a250 comp rx=0 tx=0).stop 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 -- 172.21.15.192:0/1303929192 shutdown_connections 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a00adf50 0x7f44a015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 --2- 172.21.15.192:0/1303929192 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a0156e30 0x7f44a0157210 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 -- 172.21.15.192:0/1303929192 >> 172.21.15.192:0/1303929192 conn(0x7f44a00736d0 msgr2=0x7f44a00b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 -- 172.21.15.192:0/1303929192 shutdown_connections 2024-09-13T18:43:23.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.835+0000 7f44a5600640 1 -- 172.21.15.192:0/1303929192 wait complete. 2024-09-13T18:43:23.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.837+0000 7f44a5600640 1 Processor -- start 2024-09-13T18:43:23.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.837+0000 7f44a5600640 1 -- start start 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a00adf50 0x7f44a013f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a0161210 0x7f44a01f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0141e00 con 0x7f44a0156e30 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0146750 con 0x7f44a00adf50 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a5600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0146470 con 0x7f44a0161210 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36322/0 (socket says 172.21.15.192:36322) 2024-09-13T18:43:23.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 -- 172.21.15.192:0/1868643093 learned_addr learned my addr 172.21.15.192:0/1868643093 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f44a4c00640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a0161210 0x7f44a01f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449fe00640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a00adf50 0x7f44a013f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 -- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a0161210 msgr2=0x7f44a01f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a0161210 0x7f44a01f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 -- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a00adf50 msgr2=0x7f44a013f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a00adf50 0x7f44a013f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.838+0000 7f449f400640 1 -- 172.21.15.192:0/1868643093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009a70 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f449f400640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f448c00c400 tx=0x7f448c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c0052d0 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448c005430 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44900094d0 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c003830 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.839+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0141a90 con 0x7f44a0156e30 2024-09-13T18:43:23.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.840+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a0141f70 con 0x7f44a0156e30 2024-09-13T18:43:23.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.841+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f448c003990 con 0x7f44a0156e30 2024-09-13T18:43:23.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.842+0000 7f4497e00640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 0x7f448006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:23.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.842+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f448c0886e0 con 0x7f44a0156e30 2024-09-13T18:43:23.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.842+0000 7f449fe00640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 0x7f448006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:23.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.843+0000 7f449fe00640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 0x7f448006d0f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4490034000 tx=0x7f449002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:23.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:23.846+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f448c053a00 con 0x7f44a0156e30 2024-09-13T18:43:24.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.046+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44a00b2d70 con 0x7f44a0156e30 2024-09-13T18:43:24.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.047+0000 7f4497e00640 1 -- 172.21.15.192:0/1868643093 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f448c057020 con 0x7f44a0156e30 2024-09-13T18:43:24.050 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:24.050 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:43:24.050 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 msgr2=0x7f448006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 0x7f448006d0f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f4490034000 tx=0x7f449002e000 comp rx=0 tx=0).stop 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 msgr2=0x7f44a0144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f448c00c400 tx=0x7f448c00c800 comp rx=0 tx=0).stop 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 shutdown_connections 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f448006ac30 0x7f448006d0f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f44a0161210 0x7f44a01f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f44a0156e30 0x7f44a0144310 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 --2- 172.21.15.192:0/1868643093 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f44a00adf50 0x7f44a013f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 >> 172.21.15.192:0/1868643093 conn(0x7f44a00736d0 msgr2=0x7f44a00b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 shutdown_connections 2024-09-13T18:43:24.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.049+0000 7f44a5600640 1 -- 172.21.15.192:0/1868643093 wait complete. 2024-09-13T18:43:24.221 INFO:tasks.ceph.mds.c.smithi192.stderr:2024-09-13T18:43:24.218+0000 7f9f73600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:43:24.470 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:43:18.649430+0000', 'modified': '2024-09-13T18:43:21.664732+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8166}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8166': {'gid': 8166, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/3537056060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 3537056060}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 3537056060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:43:24.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:43:24.471 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-13T18:43:24.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.622+0000 7f43b9400640 1 Processor -- start 2024-09-13T18:43:24.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.622+0000 7f43b9400640 1 -- start start 2024-09-13T18:43:24.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b9400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43b40cacd0 0x7f43b415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b9400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b4140480 con 0x7f43b40cb0b0 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b9400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b40cb520 con 0x7f43b40cacd0 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b415ee90 con 0x7f43b415bc20 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43b2800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43b40cacd0 0x7f43b415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43abe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f43b40cb0b0 0x7f43b4140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36908/0 (socket says 172.21.15.192:36908) 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.623+0000 7f43abe00640 1 -- 172.21.15.192:0/3976960439 learned_addr learned my addr 172.21.15.192:0/3976960439 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:24.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b3200640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b1e00640 1 -- 172.21.15.192:0/3976960439 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163972669 0 0) 0x7f43b4140480 con 0x7f43b40cb0b0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b2800640 1 -- 172.21.15.192:0/3976960439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 msgr2=0x7f43b40afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b2800640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b2800640 1 -- 172.21.15.192:0/3976960439 >> v1:172.21.15.192:6789/0 conn(0x7f43b40cb0b0 legacy=0x7f43b4140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.624+0000 7f43b2800640 1 -- 172.21.15.192:0/3976960439 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b415f170 con 0x7f43b40cacd0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.625+0000 7f43b2800640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cacd0 0x7f43b415e790 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f43a40097a0 tx=0x7f43a402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=674918c742d0b0b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.625+0000 7f43b1e00640 1 -- 172.21.15.192:0/3976960439 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4032440 con 0x7f43b40cacd0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.625+0000 7f43b1e00640 1 -- 172.21.15.192:0/3976960439 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40325a0 con 0x7f43b40cacd0 2024-09-13T18:43:24.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.625+0000 7f43b1e00640 1 -- 172.21.15.192:0/3976960439 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4032930 con 0x7f43b40cacd0 2024-09-13T18:43:24.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 -- 172.21.15.192:0/3976960439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cacd0 msgr2=0x7f43b415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cacd0 0x7f43b415e790 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f43a40097a0 tx=0x7f43a402a180 comp rx=0 tx=0).stop 2024-09-13T18:43:24.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 -- 172.21.15.192:0/3976960439 shutdown_connections 2024-09-13T18:43:24.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 --2- 172.21.15.192:0/3976960439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cacd0 0x7f43b415e790 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 -- 172.21.15.192:0/3976960439 >> 172.21.15.192:0/3976960439 conn(0x7f43b40ae960 msgr2=0x7f43b406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 -- 172.21.15.192:0/3976960439 shutdown_connections 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.626+0000 7f43b9400640 1 -- 172.21.15.192:0/3976960439 wait complete. 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.628+0000 7f43b9400640 1 Processor -- start 2024-09-13T18:43:24.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.628+0000 7f43b9400640 1 -- start start 2024-09-13T18:43:24.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b40cacd0 0x7f43b4139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40712b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b413a380 con 0x7f43b40cb0b0 2024-09-13T18:43:24.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40b3ae0 con 0x7f43b40cacd0 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43b40b3dc0 con 0x7f43b415bc20 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36342/0 (socket says 172.21.15.192:36342) 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 -- 172.21.15.192:0/3437433741 learned_addr learned my addr 172.21.15.192:0/3437433741 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b2800640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b40cacd0 0x7f43b4139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43b3200640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 -- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 msgr2=0x7f43b40712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 -- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b40cacd0 msgr2=0x7f43b4139e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b40cacd0 0x7f43b4139e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.629+0000 7f43abe00640 1 -- 172.21.15.192:0/3437433741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a4009400 con 0x7f43b40cb0b0 2024-09-13T18:43:24.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43abe00640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c430 tx=0x7f439c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43aaa00640 1 -- 172.21.15.192:0/3437433741 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0074e0 con 0x7f43b40cb0b0 2024-09-13T18:43:24.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43aaa00640 1 -- 172.21.15.192:0/3437433741 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c007660 con 0x7f43b40cb0b0 2024-09-13T18:43:24.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b40b40a0 con 0x7f43b40cb0b0 2024-09-13T18:43:24.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43aaa00640 1 -- 172.21.15.192:0/3437433741 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c004a20 con 0x7f43b40cb0b0 2024-09-13T18:43:24.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.630+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b40b4660 con 0x7f43b40cb0b0 2024-09-13T18:43:24.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.633+0000 7f43aaa00640 1 -- 172.21.15.192:0/3437433741 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f439c004b80 con 0x7f43b40cb0b0 2024-09-13T18:43:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.634+0000 7f43aaa00640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 0x7f439006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.634+0000 7f43aaa00640 1 -- 172.21.15.192:0/3437433741 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c089060 con 0x7f43b40cb0b0 2024-09-13T18:43:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.634+0000 7f43b2800640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 0x7f439006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.634+0000 7f43bc275740 1 Processor -- start 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.634+0000 7f43bc275740 1 -- start start 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43b2800640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 0x7f439006d0c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f76d0 0x55b46b1f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b2450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b160ab0 con 0x55b46b1f4e90 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b15e240 con 0x55b46b1f76d0 2024-09-13T18:43:24.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b46b159b30 con 0x55b46b21eb80 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36352/0 (socket says 172.21.15.192:36352) 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.635+0000 7f43abe00640 1 -- 172.21.15.192:0/1438852456 learned_addr learned my addr 172.21.15.192:0/1438852456 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43b2800640 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f76d0 0x55b46b1f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43b3200640 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b2450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 -- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 msgr2=0x55b46b2450e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b2450e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 -- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f76d0 msgr2=0x55b46b1f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f76d0 0x55b46b1f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 -- 172.21.15.192:0/1438852456 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b46b124bd0 con 0x55b46b1f4e90 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43abe00640 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f439c001120 tx=0x7f439c004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3bfdd6003c0d2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43a3400640 1 -- 172.21.15.192:0/1438852456 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0602f0 con 0x55b46b1f4e90 2024-09-13T18:43:24.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43a3400640 1 -- 172.21.15.192:0/1438852456 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c059e90 con 0x55b46b1f4e90 2024-09-13T18:43:24.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.636+0000 7f43a3400640 1 -- 172.21.15.192:0/1438852456 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c054630 con 0x55b46b1f4e90 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 -- 172.21.15.192:0/1438852456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 msgr2=0x55b46b244ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f439c001120 tx=0x7f439c004f70 comp rx=0 tx=0).stop 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 -- 172.21.15.192:0/1438852456 shutdown_connections 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b2450e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f4e90 0x55b46b244ba0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 --2- 172.21.15.192:0/1438852456 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f76d0 0x55b46b1f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 -- 172.21.15.192:0/1438852456 >> 172.21.15.192:0/1438852456 conn(0x55b46b1f3e00 msgr2=0x55b46b23c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 -- 172.21.15.192:0/1438852456 shutdown_connections 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.637+0000 7f43bc275740 1 -- 172.21.15.192:0/1438852456 wait complete. 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.638+0000 7f43bc275740 1 -- start start 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.638+0000 7f43bc275740 1 Processor -- start 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b1f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b24f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b0fb260 con 0x55b46b21eb80 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b0faf00 con 0x55b46b1f1a10 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b46aec0f20 con 0x55b46b1f76d0 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43bc275740 10 client.0 _ll_register_callbacks cb 0x55b46b1531a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36366/0 (socket says 172.21.15.192:36366) 2024-09-13T18:43:24.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 -- 172.21.15.192:0/730528638 learned_addr learned my addr 172.21.15.192:0/730528638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43b2800640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b1f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43b3200640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b24f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 -- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 msgr2=0x55b46b1f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b1f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 -- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 msgr2=0x55b46b24f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b24f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.639+0000 7f43abe00640 1 -- 172.21.15.192:0/730528638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b40b4660 con 0x55b46b21eb80 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43abe00640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f439c00cdf0 tx=0x7f439c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=549edb6c40355043 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c05fe60 con 0x55b46b21eb80 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c05ffc0 con 0x55b46b21eb80 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b46b183cd0 con 0x55b46b21eb80 2024-09-13T18:43:24.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439c06fb10 con 0x55b46b21eb80 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 10 client.8319 fetch_fsmap learned FSMap version 70 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55b46b1581b0 con 0x55b46b21eb80 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b46b183cd0 con 0x55b46b21eb80 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f439c01b060 con 0x55b46b21eb80 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 10 client.8319 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 10 client.8319 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 20 client.8319 populate_metadata read hostname 'smithi192' 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b217780 0x55b46b217b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 4 client.8319 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.640+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 --> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b46ae4d3c0 con 0x55b46b217780 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.641+0000 7f43b2800640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b217780 0x55b46b217b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.641+0000 7f43b2800640 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b217780 0x55b46b217b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f21c52c4fa8e866d server_cookie=84216c5b4c1efb6 in_seq=0 out_seq=0 2024-09-13T18:43:24.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.641+0000 7f4397e00640 10 client.8319 ms_handle_connect on v2:172.21.15.192:6836/3537056060 2024-09-13T18:43:24.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f4397e00640 1 -- 172.21.15.192:0/730528638 <== mds.0 v2:172.21.15.192:6836/3537056060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55b46ae4d3c0 con 0x55b46b217780 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f4397e00640 10 client.8319 handle_command_reply: tid=0 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 client.8319 shutdown 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 msgr2=0x55b46b214db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f439c00cdf0 tx=0x7f439c000ed0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 shutdown_connections 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b217780 0x55b46b217b60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b24f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b21eb80 0x55b46b214db0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 --2- 172.21.15.192:0/730528638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b1f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f4397e00640 0 client.8319 ms_handle_reset on v2:172.21.15.192:6836/3537056060 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 >> 172.21.15.192:0/730528638 conn(0x55b46b1f4e90 msgr2=0x55b46b23a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 shutdown_connections 2024-09-13T18:43:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.642+0000 7f43bc275740 1 -- 172.21.15.192:0/730528638 wait complete. 2024-09-13T18:43:24.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.643+0000 7f43bc275740 20 client.8319 trim_cache size 0 max 16384 2024-09-13T18:43:24.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.658+0000 7f43bc275740 1 Processor -- start 2024-09-13T18:43:24.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.658+0000 7f43bc275740 1 -- start start 2024-09-13T18:43:24.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b239930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b215680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b25ee80 con 0x55b46b1f76d0 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b218380 con 0x55b46b1f1a10 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b46b214960 con 0x55b46b21eb80 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36376/0 (socket says 172.21.15.192:36376) 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 -- 172.21.15.192:0/2909962464 learned_addr learned my addr 172.21.15.192:0/2909962464 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 -- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 msgr2=0x55b46b215680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b215680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 -- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 msgr2=0x55b46b239930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b239930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 -- 172.21.15.192:0/2909962464 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b46b0fa470 con 0x55b46b1f76d0 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43abe00640 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f439c0542b0 tx=0x7f439c06e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7015cf660f70e0b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.659+0000 7f43a3e00640 1 -- 172.21.15.192:0/2909962464 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c00e040 con 0x55b46b1f76d0 2024-09-13T18:43:24.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43a3e00640 1 -- 172.21.15.192:0/2909962464 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0874d0 con 0x55b46b1f76d0 2024-09-13T18:43:24.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43a3e00640 1 -- 172.21.15.192:0/2909962464 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c087120 con 0x55b46b1f76d0 2024-09-13T18:43:24.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 -- 172.21.15.192:0/2909962464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 msgr2=0x55b46b1f3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f439c0542b0 tx=0x7f439c06e070 comp rx=0 tx=0).stop 2024-09-13T18:43:24.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 -- 172.21.15.192:0/2909962464 shutdown_connections 2024-09-13T18:43:24.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b21eb80 0x55b46b215680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f76d0 0x55b46b1f3630 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 --2- 172.21.15.192:0/2909962464 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b1f1a10 0x55b46b239930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 -- 172.21.15.192:0/2909962464 >> 172.21.15.192:0/2909962464 conn(0x55b46b1f4e90 msgr2=0x55b46b1ed300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 -- 172.21.15.192:0/2909962464 shutdown_connections 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.660+0000 7f43bc275740 1 -- 172.21.15.192:0/2909962464 wait complete. 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.661+0000 7f43bc275740 1 -- start start 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.661+0000 7f43bc275740 1 Processor -- start 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b2a92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 0x55b46b23b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b239c70 con 0x55b46b1f1a10 2024-09-13T18:43:24.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b46b2a9830 con 0x55b46b21eb80 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b46b1f2c50 con 0x55b46b1f76d0 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43bc275740 10 client.0 _ll_register_callbacks cb 0x7f439c06f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b2800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36386/0 (socket says 172.21.15.192:36386) 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b2800640 1 -- 172.21.15.192:0/1829855673 learned_addr learned my addr 172.21.15.192:0/1829855673 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b3200640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 0x55b46b23b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b2800640 1 -- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 msgr2=0x55b46b2a92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.662+0000 7f43b2800640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b2a92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43b2800640 1 -- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 msgr2=0x55b46b23b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43b2800640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 0x55b46b23b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43b2800640 1 -- 172.21.15.192:0/1829855673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b46b1581b0 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43b3200640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 0x55b46b23b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43b2800640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f43a4000c00 tx=0x7f43a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506348748ac7e83b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f4397e00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a404d040 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43a4054840 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f439c059e90 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43a403c440 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43bc275740 10 client.8325 fetch_fsmap learned FSMap version 70 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.663+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55b46b11f980 con 0x55b46b1f1a10 2024-09-13T18:43:24.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c059e90 con 0x55b46b1f1a10 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f43a4044040 con 0x55b46b1f1a10 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 10 client.8325 fetch_fsmap finished waiting for FSMap version 70 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 10 client.8325 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 20 client.8325 populate_metadata read hostname 'smithi192' 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b21dc70 0x55b46b21e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 4 client.8325 mds_command: new command op to 8166 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 --> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b46ae5e6c0 con 0x55b46b21dc70 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43abe00640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b21dc70 0x55b46b21e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f43abe00640 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b21dc70 0x55b46b21e050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f23bb7a61440d297 server_cookie=f519c08686fa47ed in_seq=0 out_seq=0 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.664+0000 7f4397e00640 10 client.8325 ms_handle_connect on v2:172.21.15.192:6836/3537056060 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f4397e00640 1 -- 172.21.15.192:0/1829855673 <== mds.0 v2:172.21.15.192:6836/3537056060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55b46ae5e6c0 con 0x55b46b21dc70 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f4397e00640 10 client.8325 handle_command_reply: tid=0 2024-09-13T18:43:24.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 client.8325 shutdown 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 msgr2=0x55b46b21bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f43a4000c00 tx=0x7f43a40046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 shutdown_connections 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:6836/3537056060,v1:172.21.15.192:6837/3537056060] conn(0x55b46b21dc70 0x55b46b21e050 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55b46b21eb80 0x55b46b23b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55b46b1f76d0 0x55b46b2a92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 --2- 172.21.15.192:0/1829855673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55b46b1f1a10 0x55b46b21bf40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 >> 172.21.15.192:0/1829855673 conn(0x55b46b1f4e90 msgr2=0x55b46b1ed300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f4397e00640 0 client.8325 ms_handle_reset on v2:172.21.15.192:6836/3537056060 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 shutdown_connections 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 1 -- 172.21.15.192:0/1829855673 wait complete. 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.665+0000 7f43bc275740 20 client.8325 trim_cache size 0 max 16384 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 8166, 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:43:24.675 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0136268680000002, 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 70, 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 165, 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 165, 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 11.130081197999999 2024-09-13T18:43:24.676 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 msgr2=0x7f439006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 0x7f439006d0c0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f43a4034000 tx=0x7f43a402e000 comp rx=0 tx=0).stop 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 msgr2=0x7f43b40b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c430 tx=0x7f439c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 shutdown_connections 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f439006ac00 0x7f439006d0c0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43b415bc20 0x7f43b40712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43b40cb0b0 0x7f43b40b31e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 --2- 172.21.15.192:0/3437433741 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43b40cacd0 0x7f43b4139e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 >> 172.21.15.192:0/3437433741 conn(0x7f43b40ae960 msgr2=0x7f43b40affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 shutdown_connections 2024-09-13T18:43:24.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.666+0000 7f43b9400640 1 -- 172.21.15.192:0/3437433741 wait complete. 2024-09-13T18:43:24.684 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:43:24.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.833+0000 7f0c6d600640 1 Processor -- start 2024-09-13T18:43:24.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.833+0000 7f0c6d600640 1 -- start start 2024-09-13T18:43:24.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c6d600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c68146610 0x7f0c680ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c6d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 0x7f0c680ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c6d600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c680ae770 con 0x7f0c680afd80 2024-09-13T18:43:24.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c6d600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680cd920 con 0x7f0c68146610 2024-09-13T18:43:24.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c6d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680cdb30 con 0x7f0c680b2780 2024-09-13T18:43:24.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.834+0000 7f0c66a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c68146610 0x7f0c680ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0c68146610 0x7f0c680ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36392/0 (socket says 172.21.15.192:36392) 2024-09-13T18:43:24.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 -- 172.21.15.192:0/3302729946 learned_addr learned my addr 172.21.15.192:0/3302729946 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c5e000640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 0x7f0c680ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 -- 172.21.15.192:0/3302729946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 msgr2=0x7f0c680ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 0x7f0c680ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 -- 172.21.15.192:0/3302729946 >> v1:172.21.15.194:6789/0 conn(0x7f0c680afd80 legacy=0x7f0c680b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c66a00640 1 -- 172.21.15.192:0/3302729946 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680ae1b0 con 0x7f0c68146610 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.835+0000 7f0c5e000640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 0x7f0c680ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.836+0000 7f0c66a00640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c68146610 0x7f0c680ce2f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009e50 tx=0x7f0c5802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2230332e8c4c9a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.836+0000 7f0c66000640 1 -- 172.21.15.192:0/3302729946 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58031600 con 0x7f0c68146610 2024-09-13T18:43:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.836+0000 7f0c66000640 1 -- 172.21.15.192:0/3302729946 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5802d050 con 0x7f0c68146610 2024-09-13T18:43:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.836+0000 7f0c66000640 1 -- 172.21.15.192:0/3302729946 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c58031980 con 0x7f0c68146610 2024-09-13T18:43:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 -- 172.21.15.192:0/3302729946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c68146610 msgr2=0x7f0c680ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c68146610 0x7f0c680ce2f0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0c58009e50 tx=0x7f0c5802a710 comp rx=0 tx=0).stop 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 -- 172.21.15.192:0/3302729946 shutdown_connections 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c680b2780 0x7f0c680ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 --2- 172.21.15.192:0/3302729946 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c68146610 0x7f0c680ce2f0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 -- 172.21.15.192:0/3302729946 >> 172.21.15.192:0/3302729946 conn(0x7f0c680ae960 msgr2=0x7f0c6806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 -- 172.21.15.192:0/3302729946 shutdown_connections 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.837+0000 7f0c6d600640 1 -- 172.21.15.192:0/3302729946 wait complete. 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.839+0000 7f0c6d600640 1 Processor -- start 2024-09-13T18:43:24.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.839+0000 7f0c6d600640 1 -- start start 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c680b2780 0x7f0c68145140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c68146610 0x7f0c681f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680c3cf0 con 0x7f0c680afd80 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68145680 con 0x7f0c680b2780 2024-09-13T18:43:24.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c6d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681f29c0 con 0x7f0c68146610 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36408/0 (socket says 172.21.15.192:36408) 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 -- 172.21.15.192:0/2259709879 learned_addr learned my addr 172.21.15.192:0/2259709879 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c67400640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c68146610 0x7f0c681f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c5e000640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c680b2780 0x7f0c68145140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 -- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c68146610 msgr2=0x7f0c681f5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c68146610 0x7f0c681f5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 -- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c680b2780 msgr2=0x7f0c68145140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c680b2780 0x7f0c68145140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.840+0000 7f0c66a00640 1 -- 172.21.15.192:0/2259709879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58009b30 con 0x7f0c680afd80 2024-09-13T18:43:24.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c66a00640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0c58034040 tx=0x7f0c58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5803b810 con 0x7f0c680afd80 2024-09-13T18:43:24.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c5803b970 con 0x7f0c680afd80 2024-09-13T18:43:24.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c5803bd20 con 0x7f0c680afd80 2024-09-13T18:43:24.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c681f66d0 con 0x7f0c680afd80 2024-09-13T18:43:24.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.841+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c681f2c30 con 0x7f0c680afd80 2024-09-13T18:43:24.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.842+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c680ce2f0 con 0x7f0c680afd80 2024-09-13T18:43:24.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.843+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0c5803a3a0 con 0x7f0c680afd80 2024-09-13T18:43:24.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.844+0000 7f0c5f400640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 0x7f0c4406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:24.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.844+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c580a9e90 con 0x7f0c680afd80 2024-09-13T18:43:24.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.844+0000 7f0c5e000640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 0x7f0c4406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:24.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.845+0000 7f0c5e000640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 0x7f0c4406d0c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0c68145cd0 tx=0x7f0c50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:24.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:24.848+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0c580751b0 con 0x7f0c680afd80 2024-09-13T18:43:25.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.048+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0c680b3310 con 0x7f0c680afd80 2024-09-13T18:43:25.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.049+0000 7f0c5f400640 1 -- 172.21.15.192:0/2259709879 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0c58049060 con 0x7f0c680afd80 2024-09-13T18:43:25.052 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 msgr2=0x7f0c4406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 0x7f0c4406d0c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f0c68145cd0 tx=0x7f0c50008040 comp rx=0 tx=0).stop 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 msgr2=0x7f0c6815bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0c58034040 tx=0x7f0c58004a40 comp rx=0 tx=0).stop 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 shutdown_connections 2024-09-13T18:43:25.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c4406ac00 0x7f0c4406d0c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0c68146610 0x7f0c681f5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0c680b2780 0x7f0c68145140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 --2- 172.21.15.192:0/2259709879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c680afd80 0x7f0c6815bbe0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 >> 172.21.15.192:0/2259709879 conn(0x7f0c680ae960 msgr2=0x7f0c680aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:25.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 shutdown_connections 2024-09-13T18:43:25.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:25.051+0000 7f0c6d600640 1 -- 172.21.15.192:0/2259709879 wait complete. 2024-09-13T18:43:25.070 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:43:25.070 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:43:25.070 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:43:25.070 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:43:25.070 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:43:25.071 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:43:25.071 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:43:25.071 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:43:25.071 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:43:25.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.071 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.108 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:25.109 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42304sec preferred_lft 42304sec 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.110 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:43:25.111 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:43:25.112 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:43:25.112 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:25.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.112 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:43:25.201 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:43:25.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.205 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:43:25.241 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:43:25.241 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:43:25.241 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:43:25.241 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:43:25.242 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:43:25.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.242 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:43:25.242 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:43:25.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:43:25.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:43:25.243 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:43:25.243 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:43:25.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.386 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:43:25.421 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:43:25.421 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:43:25.422 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:43:25.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:43:25.518 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:43:25.519 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:43:25.554 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:43:25.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:43:25.554 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:43:25.629 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:43:25.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:25.758 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:25.758 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:43:25.784 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:25.784 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:43:25.785 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:43:25.785 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:43:25.785 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:43:25.786 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:43:25.786 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:43:25.786 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:43:25.786 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:43:25.786 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:43:25.789 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:43:25.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.789 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:43:25.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:25.846 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:43:25.890 INFO:teuthology.orchestra.run.smithi192.stdout:client8334 2024-09-13T18:43:25.890 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:43:25.890 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:25.965 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:43:26.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.160+0000 7f9607e00640 1 Processor -- start 2024-09-13T18:43:26.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.161+0000 7f9607e00640 1 -- start start 2024-09-13T18:43:26.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9607e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f96080b3600 0x7f96080b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9607e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960806f830 con 0x7f96081592d0 2024-09-13T18:43:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9607e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960806fa80 con 0x7f960806bca0 2024-09-13T18:43:26.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9607e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9608071230 con 0x7f96080b3600 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9606a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f96081592d0 0x7f9608070b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36922/0 (socket says 172.21.15.192:36922) 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.163+0000 7f9606a00640 1 -- 172.21.15.192:0/441534603 learned_addr learned my addr 172.21.15.192:0/441534603 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f95ffe00640 1 --2- 172.21.15.192:0/441534603 >> v2:172.21.15.194:3300/0 conn(0x7f96080b3600 0x7f96080b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851274412 0 0) 0x7f960806f830 con 0x7f96081592d0 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ec003440 con 0x7f96081592d0 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2115679385 0 0) 0x7f960806fa80 con 0x7f960806bca0 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960806f830 con 0x7f960806bca0 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f95ffe00640 1 -- 172.21.15.192:0/441534603 >> v1:172.21.15.194:6789/0 conn(0x7f960806bca0 legacy=0x7f960806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f95ffe00640 1 -- 172.21.15.192:0/441534603 >> v1:172.21.15.192:6789/0 conn(0x7f96081592d0 legacy=0x7f9608070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.164+0000 7f95ffe00640 1 -- 172.21.15.192:0/441534603 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960806fd60 con 0x7f96080b3600 2024-09-13T18:43:26.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.165+0000 7f95ffe00640 1 --2- 172.21.15.192:0/441534603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b3600 0x7f96080b3a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097a0 tx=0x7f95f002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=148e73c056694de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:26.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.166+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0032440 con 0x7f96080b3600 2024-09-13T18:43:26.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.166+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f00325a0 con 0x7f96080b3600 2024-09-13T18:43:26.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.166+0000 7f9606000640 1 -- 172.21.15.192:0/441534603 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0032930 con 0x7f96080b3600 2024-09-13T18:43:26.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.166+0000 7f9607e00640 1 -- 172.21.15.192:0/441534603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b3600 msgr2=0x7f96080b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.166+0000 7f9607e00640 1 --2- 172.21.15.192:0/441534603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b3600 0x7f96080b3a70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f95f00097a0 tx=0x7f95f002a230 comp rx=0 tx=0).stop 2024-09-13T18:43:26.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.167+0000 7f9607e00640 1 -- 172.21.15.192:0/441534603 shutdown_connections 2024-09-13T18:43:26.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.167+0000 7f9607e00640 1 --2- 172.21.15.192:0/441534603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f96080b3600 0x7f96080b3a70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.167+0000 7f9607e00640 1 -- 172.21.15.192:0/441534603 >> 172.21.15.192:0/441534603 conn(0x7f96080736d0 msgr2=0x7f96080b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:26.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.167+0000 7f9607e00640 1 -- 172.21.15.192:0/441534603 shutdown_connections 2024-09-13T18:43:26.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.167+0000 7f9607e00640 1 -- 172.21.15.192:0/441534603 wait complete. 2024-09-13T18:43:26.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.169+0000 7f9607e00640 1 Processor -- start 2024-09-13T18:43:26.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.170+0000 7f9607e00640 1 -- start start 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f960806bca0 0x7f96081f24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96081592d0 0x7f96081de450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960814fa70 con 0x7f96080b3600 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96081dec80 con 0x7f960806bca0 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f9607e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96081def60 con 0x7f96081592d0 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f95ffe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f95ffe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36412/0 (socket says 172.21.15.192:36412) 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.171+0000 7f95ffe00640 1 -- 172.21.15.192:0/3728492898 learned_addr learned my addr 172.21.15.192:0/3728492898 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f9606a00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f960806bca0 0x7f96081f24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:26.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f9607400640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96081592d0 0x7f96081de450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 -- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96081592d0 msgr2=0x7f96081de450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96081592d0 0x7f96081de450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 -- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f960806bca0 msgr2=0x7f96081f24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f960806bca0 0x7f96081f24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 -- 172.21.15.192:0/3728492898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0009400 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95ffe00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f95f0035040 tx=0x7f95f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.172+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f003d8f0 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.173+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f003da70 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.173+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96081df240 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.173+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f003de20 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.173+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96081df800 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.174+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96081dfca0 con 0x7f96080b3600 2024-09-13T18:43:26.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.175+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95f0039040 con 0x7f96080b3600 2024-09-13T18:43:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.176+0000 7f95fea00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 0x7f95e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.176+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95f00a9d30 con 0x7f96080b3600 2024-09-13T18:43:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.176+0000 7f9606a00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 0x7f95e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:26.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.177+0000 7f9606a00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 0x7f95e406d0c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95f8000f60 tx=0x7f95f8007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:26.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.180+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f96081dfca0 con 0x7f96080b3600 2024-09-13T18:43:26.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.391+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f96081dfca0 con 0x7f96080b3600 2024-09-13T18:43:26.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.391+0000 7f95fea00640 1 -- 172.21.15.192:0/3728492898 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f96081dfca0 con 0x7f96080b3600 2024-09-13T18:43:26.394 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 msgr2=0x7f95e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 0x7f95e406d0c0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f95f8000f60 tx=0x7f95f8007d70 comp rx=0 tx=0).stop 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 msgr2=0x7f960814f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f95f0035040 tx=0x7f95f00046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 shutdown_connections 2024-09-13T18:43:26.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e406ac00 0x7f95e406d0c0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f96081592d0 0x7f96081de450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f96080b3600 0x7f960814f530 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 --2- 172.21.15.192:0/3728492898 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f960806bca0 0x7f96081f24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 >> 172.21.15.192:0/3728492898 conn(0x7f96080736d0 msgr2=0x7f9608158580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 shutdown_connections 2024-09-13T18:43:26.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:26.394+0000 7f9607e00640 1 -- 172.21.15.192:0/3728492898 wait complete. 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:43:26.413 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:43:26.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.414 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:43:26.455 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:26.456 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42308sec preferred_lft 42308sec 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:43:26.457 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:43:26.458 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:43:26.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.459 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:43:26.553 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:43:26.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.556 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:43:26.593 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:43:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:43:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:43:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:43:26.594 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:43:26.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.594 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:43:26.594 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:43:26.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:43:26.594 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:43:26.595 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:43:26.595 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:43:26.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.745 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:43:26.780 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:43:26.780 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:43:26.780 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:43:26.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.780 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:43:26.876 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:43:26.877 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:43:26.911 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:43:26.912 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:43:26.912 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:43:26.986 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:43:26.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:26.986 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:27.114 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:27.114 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:43:27.140 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:43:27.140 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:43:27.140 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:43:27.141 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:43:27.141 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:43:27.142 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:43:27.142 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:43:27.142 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:43:27.142 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:43:27.142 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:43:27.145 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:43:27.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:27.145 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:43:27.202 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:43:27.202 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:43:27.240 INFO:teuthology.orchestra.run.smithi194.stdout:client8343 2024-09-13T18:43:27.241 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:43:27.241 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:43:27.317 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:43:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.470+0000 7f165e400640 1 Processor -- start 2024-09-13T18:43:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.470+0000 7f165e400640 1 -- start start 2024-09-13T18:43:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 0x7f165806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 0x7f16580cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165e400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165806c5d0 con 0x7f165806e990 2024-09-13T18:43:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580b3730 con 0x7f165815a9e0 2024-09-13T18:43:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580b3920 con 0x7f165806b3d0 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165da00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f165806e990 0x7f1658070630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36932/0 (socket says 172.21.15.192:36932) 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165da00640 1 -- 172.21.15.192:0/2324241842 learned_addr learned my addr 172.21.15.192:0/2324241842 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f1657e00640 1 --2- 172.21.15.192:0/2324241842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 0x7f16580cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.471+0000 7f165d000640 1 --2- 172.21.15.192:0/2324241842 >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 0x7f165806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657400640 1 -- 172.21.15.192:0/2324241842 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 77771179 0 0) 0x7f165806c5d0 con 0x7f165806e990 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657400640 1 -- 172.21.15.192:0/2324241842 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1640003520 con 0x7f165806e990 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657e00640 1 -- 172.21.15.192:0/2324241842 >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 msgr2=0x7f165806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657e00640 1 --2- 172.21.15.192:0/2324241842 >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 0x7f165806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657e00640 1 -- 172.21.15.192:0/2324241842 >> v1:172.21.15.192:6789/0 conn(0x7f165806e990 legacy=0x7f1658070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f1657e00640 1 -- 172.21.15.192:0/2324241842 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580b3c00 con 0x7f165806b3d0 2024-09-13T18:43:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.472+0000 7f165d000640 1 --2- 172.21.15.192:0/2324241842 >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 0x7f165806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.473+0000 7f1657e00640 1 --2- 172.21.15.192:0/2324241842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 0x7f16580cd8c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f16440097a0 tx=0x7f164402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f47a7b145866de56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.473+0000 7f1657400640 1 -- 172.21.15.192:0/2324241842 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644032440 con 0x7f165806b3d0 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.473+0000 7f1657400640 1 -- 172.21.15.192:0/2324241842 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16440325a0 con 0x7f165806b3d0 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.473+0000 7f1657400640 1 -- 172.21.15.192:0/2324241842 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644032910 con 0x7f165806b3d0 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 -- 172.21.15.192:0/2324241842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 msgr2=0x7f16580cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 --2- 172.21.15.192:0/2324241842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 0x7f16580cd8c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f16440097a0 tx=0x7f164402a180 comp rx=0 tx=0).stop 2024-09-13T18:43:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 -- 172.21.15.192:0/2324241842 shutdown_connections 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 --2- 172.21.15.192:0/2324241842 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806b3d0 0x7f16580cd8c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 --2- 172.21.15.192:0/2324241842 >> v2:172.21.15.194:3300/0 conn(0x7f165815a9e0 0x7f165806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 -- 172.21.15.192:0/2324241842 >> 172.21.15.192:0/2324241842 conn(0x7f16580736d0 msgr2=0x7f16580b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 -- 172.21.15.192:0/2324241842 shutdown_connections 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.474+0000 7f165e400640 1 -- 172.21.15.192:0/2324241842 wait complete. 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.476+0000 7f165e400640 1 Processor -- start 2024-09-13T18:43:27.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.476+0000 7f165e400640 1 -- start start 2024-09-13T18:43:27.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 0x7f16581efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 0x7f1658154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581f0360 con 0x7f165815a9e0 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658150a80 con 0x7f165806b3d0 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1658150d60 con 0x7f165806e990 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 0x7f1658154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f1657e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 0x7f16581efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165d000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 0x7f16581efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44568/0 (socket says 172.21.15.192:44568) 2024-09-13T18:43:27.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 0x7f1658154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36414/0 (socket says 172.21.15.192:36414) 2024-09-13T18:43:27.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f165d000640 1 -- 172.21.15.192:0/3327542412 learned_addr learned my addr 172.21.15.192:0/3327542412 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:27.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.477+0000 7f1657e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:45898/0 (socket says 172.21.15.192:45898) 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 -- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 msgr2=0x7f16581efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 0x7f16581efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 -- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 msgr2=0x7f1658154190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 0x7f1658154190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 -- 172.21.15.192:0/3327542412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164c009400 con 0x7f165806e990 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1657e00640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1644031000 tx=0x7f16440046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644032440 con 0x7f165806e990 2024-09-13T18:43:27.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1644004500 con 0x7f165806e990 2024-09-13T18:43:27.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1644003850 con 0x7f165806e990 2024-09-13T18:43:27.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1644009400 con 0x7f165806e990 2024-09-13T18:43:27.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.478+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165815b260 con 0x7f165806e990 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.479+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f165815b0c0 con 0x7f165806e990 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.480+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f16440039b0 con 0x7f165806e990 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.481+0000 7f1654c00640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 0x7f163806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.481+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16440a9f60 con 0x7f165806e990 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.481+0000 7f165d000640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 0x7f163806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:27.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.482+0000 7f165d000640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 0x7f163806d0c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d30 tx=0x7f164c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:27.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.486+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f165815b0c0 con 0x7f165806e990 2024-09-13T18:43:27.694 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.691+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165815b0c0 con 0x7f165806e990 2024-09-13T18:43:27.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.705+0000 7f1654c00640 1 -- 172.21.15.192:0/3327542412 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f165815b0c0 con 0x7f165806e990 2024-09-13T18:43:27.708 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:43:27.708 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:43:27.708 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:43:27.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 msgr2=0x7f163806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 0x7f163806d0c0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f164c009d30 tx=0x7f164c009190 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 msgr2=0x7f1658150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1644031000 tx=0x7f16440046c0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 shutdown_connections 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f163806ac00 0x7f163806d0c0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f165815a9e0 0x7f1658154190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f165806e990 0x7f1658150180 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 --2- 172.21.15.192:0/3327542412 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f165806b3d0 0x7f16581efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.707+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 >> 172.21.15.192:0/3327542412 conn(0x7f16580736d0 msgr2=0x7f16580b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.708+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 shutdown_connections 2024-09-13T18:43:27.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:27.708+0000 7f165e400640 1 -- 172.21.15.192:0/3327542412 wait complete. 2024-09-13T18:43:27.727 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2024-09-13T18:43:27.897 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":8166,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.2313922730000009,"mdsmap_epoch":70,"osdmap_epoch":165,"osdmap_epoch_barrier":165,"uptime":14.347839520000001} 2024-09-13T18:43:27.898 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 8166, "mdsmap_epoch": 70, "osdmap_epoch": 165, "osdmap_epoch_barrier": 165, "rank_uptime": 9.231392273, "state": "up:active", "uptime": 14.34783952, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:43:27.898 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-13T18:43:28.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.050+0000 7fcead200640 1 Processor -- start 2024-09-13T18:43:28.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.050+0000 7fcead200640 1 -- start start 2024-09-13T18:43:28.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.051+0000 7fcead200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea8145c30 0x7fcea806bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.051+0000 7fcead200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcea80ad840 0x7fcea80adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.051+0000 7fcead200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcea8146010 con 0x7fcea80b3b90 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.051+0000 7fcead200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcea806ab60 con 0x7fcea80ad840 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.051+0000 7fcead200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea806b6e0 con 0x7fcea8145c30 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcea80ad840 0x7fcea80adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcea80ad840 0x7fcea80adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36416/0 (socket says 172.21.15.192:36416) 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 -- 172.21.15.192:0/3569518803 learned_addr learned my addr 172.21.15.192:0/3569518803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:28.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea5e00640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea8145c30 0x7fcea806bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 -- 172.21.15.192:0/3569518803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea8145c30 msgr2=0x7fcea806bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:43:28.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea8145c30 0x7fcea806bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 -- 172.21.15.192:0/3569518803 >> v1:172.21.15.194:6789/0 conn(0x7fcea80b3b90 legacy=0x7fcea806a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.052+0000 7fcea6800640 1 -- 172.21.15.192:0/3569518803 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea806c0b0 con 0x7fcea80ad840 2024-09-13T18:43:28.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.053+0000 7fcea6800640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80ad840 0x7fcea80adcb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea002a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352a81459e70a86c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:28.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.053+0000 7fcea4a00640 1 -- 172.21.15.192:0/3569518803 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea002aea0 con 0x7fcea80ad840 2024-09-13T18:43:28.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcea4a00640 1 -- 172.21.15.192:0/3569518803 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcea002d050 con 0x7fcea80ad840 2024-09-13T18:43:28.057 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcea4a00640 1 -- 172.21.15.192:0/3569518803 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcea0031820 con 0x7fcea80ad840 2024-09-13T18:43:28.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 -- 172.21.15.192:0/3569518803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80ad840 msgr2=0x7fcea80adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80ad840 0x7fcea80adcb0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fcea0009e50 tx=0x7fcea002a680 comp rx=0 tx=0).stop 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 -- 172.21.15.192:0/3569518803 shutdown_connections 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80ad840 0x7fcea80adcb0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 --2- 172.21.15.192:0/3569518803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea8145c30 0x7fcea806bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 -- 172.21.15.192:0/3569518803 >> 172.21.15.192:0/3569518803 conn(0x7fcea80b0c40 msgr2=0x7fcea80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 -- 172.21.15.192:0/3569518803 shutdown_connections 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.054+0000 7fcead200640 1 -- 172.21.15.192:0/3569518803 wait complete. 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.056+0000 7fcead200640 1 Processor -- start 2024-09-13T18:43:28.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.056+0000 7fcead200640 1 -- start start 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea80ad840 0x7fcea813ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8145c30 0x7fcea8154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea813d380 con 0x7fcea80b3b90 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcea813e1d0 con 0x7fcea8145c30 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcead200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcea8153ab0 con 0x7fcea80ad840 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36422/0 (socket says 172.21.15.192:36422) 2024-09-13T18:43:28.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 -- 172.21.15.192:0/2003187962 learned_addr learned my addr 172.21.15.192:0/2003187962 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5e00640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea80ad840 0x7fcea813ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea6800640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8145c30 0x7fcea8154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 -- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea80ad840 msgr2=0x7fcea813ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea80ad840 0x7fcea813ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 -- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8145c30 msgr2=0x7fcea8154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8145c30 0x7fcea8154050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.057+0000 7fcea5400640 1 -- 172.21.15.192:0/2003187962 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcea0009b30 con 0x7fcea80b3b90 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fcea5400640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c400 tx=0x7fce9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce940052d0 con 0x7fcea80b3b90 2024-09-13T18:43:28.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce94005450 con 0x7fcea80b3b90 2024-09-13T18:43:28.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce94007260 con 0x7fcea80b3b90 2024-09-13T18:43:28.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcea813d5c0 con 0x7fcea80b3b90 2024-09-13T18:43:28.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.058+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcea813db80 con 0x7fcea80b3b90 2024-09-13T18:43:28.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.059+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcea815d270 con 0x7fcea80b3b90 2024-09-13T18:43:28.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.060+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fce940073c0 con 0x7fcea80b3b90 2024-09-13T18:43:28.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.061+0000 7fce9e000640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 0x7fce8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:43:28.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.061+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce94088590 con 0x7fcea80b3b90 2024-09-13T18:43:28.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.061+0000 7fcea5e00640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 0x7fce8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:43:28.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.062+0000 7fcea5e00640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 0x7fce8806d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce98009aa0 tx=0x7fce98009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:43:28.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.065+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fce94053780 con 0x7fcea80b3b90 2024-09-13T18:43:28.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.235+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fcea8146010 con 0x7fcea80b3b90 2024-09-13T18:43:28.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.708+0000 7fce9e000640 1 -- 172.21.15.192:0/2003187962 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v166) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcea8146010 con 0x7fcea80b3b90 2024-09-13T18:43:28.712 INFO:teuthology.orchestra.run.smithi192.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-13T18:43:28.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 msgr2=0x7fce8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 0x7fce8806d0c0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fce98009aa0 tx=0x7fce98009190 comp rx=0 tx=0).stop 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 msgr2=0x7fcea8153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fce9400c400 tx=0x7fce9400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 shutdown_connections 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fce8806ac00 0x7fce8806d0c0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcea8145c30 0x7fcea8154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcea80b3b90 0x7fcea8153570 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 --2- 172.21.15.192:0/2003187962 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcea80ad840 0x7fcea813ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:43:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 >> 172.21.15.192:0/2003187962 conn(0x7fcea80b0c40 msgr2=0x7fcea80afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:43:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 shutdown_connections 2024-09-13T18:43:28.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:43:28.711+0000 7fcead200640 1 -- 172.21.15.192:0/2003187962 wait complete. 2024-09-13T18:43:28.731 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:43:28.900 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:43:28.900 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:43:28.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-13T18:43:29.062 INFO:teuthology.orchestra.run.smithi192.stdout:{"mon_tick_interval":"5"} 2024-09-13T18:43:29.062 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-13T18:43:29.063 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> import time 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> import datetime 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> # Write some buffered data through before going full, all should be well 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> print("writing some data through which we expect to succeed") 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> bytes = 0 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-13T18:43:29.063 DEBUG:teuthology.orchestra.run.smithi192:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> # buffered IO, the error should always only appear from fsync and not 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> # from write 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> full = False 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(32 * 0.9)): 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> print("done writing {0} bytes".format(bytes)) 2024-09-13T18:43:29.064 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> # OK, now we should sneak in under the full condition 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> # due to the time it takes the OSDs to report to the 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> # mons, and get a successful fsync on our full-making data 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> print("successfully fsync'"'"'ed prior to getting full state reported") 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> # buffered write, add more dirty data to the buffer 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> print("starting buffered write") 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(32 * 0.2)): 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(15.0) 2024-09-13T18:43:29.065 DEBUG:teuthology.orchestra.run.smithi192:> except OSError: 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> pass; 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> # Wait long enough for a background flush that should fail 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(30) 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> if False: 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> # ...and check that the failed background flush is reflected in fclose 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> except OSError: 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> print("close() returned an error as expected") 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:43:29.066 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("close() failed to raise error") 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> # The kernel cephfs client does not raise errors on fclose 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-13T18:43:29.067 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:43:38.170 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:43:38.176 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:08.268 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:08.274 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:38.390 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:44:38.395 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:08.495 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:08.500 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:writing some data through which we expect to succeed 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 1572864 bytes via buffered write, may repeat 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 2621440 bytes via buffered write, may repeat 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 3670016 bytes via buffered write, may repeat 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 4718592 bytes via buffered write, may repeat 2024-09-13T18:45:33.764 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 5767168 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 6815744 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 7864320 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 8912896 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 9961472 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 11010048 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 12058624 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 13107200 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 14155776 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 15204352 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 16252928 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 17301504 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 18350080 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 19398656 bytes via buffered write, may repeat 2024-09-13T18:45:33.765 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 20447232 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 21495808 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 22544384 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 23592960 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 24641536 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 25690112 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 26738688 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 27787264 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 28835840 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:wrote 29884416 bytes via buffered write, may repeat 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:done writing 29884416 bytes 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:successfully fsync'ed prior to getting full state reported 2024-09-13T18:45:33.766 INFO:teuthology.orchestra.run.smithi192.stdout:starting buffered write 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:45:33.767 INFO:teuthology.orchestra.run.smithi192.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2024-09-13T18:45:33.938 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:45:33.939 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:45:34.024 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:45:34.109 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:45:34.109 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:45:34.109 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:34.147 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:45:34.147 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:34.224 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.414+0000 7fb2a1000640 1 Processor -- start 2024-09-13T18:45:34.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.414+0000 7fb2a1000640 1 -- start start 2024-09-13T18:45:34.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.415+0000 7fb2a1000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb29c0b3f10 0x7fb29c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.415+0000 7fb2a1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb29c0b0490 0x7fb29c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.415+0000 7fb2a1000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb29c0b2f00 con 0x7fb29c15dee0 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.415+0000 7fb2a1000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c15aec0 con 0x7fb29c0b0490 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.415+0000 7fb2a1000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb29c0b3150 con 0x7fb29c0b3f10 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb29c0b0490 0x7fb29c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb29c0b0490 0x7fb29c15a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33308/0 (socket says 172.21.15.192:33308) 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 -- 172.21.15.192:0/2888145156 learned_addr learned my addr 172.21.15.192:0/2888145156 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:34.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb299400640 1 --2- 172.21.15.192:0/2888145156 >> v2:172.21.15.194:3300/0 conn(0x7fb29c0b3f10 0x7fb29c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 -- 172.21.15.192:0/2888145156 >> v2:172.21.15.194:3300/0 conn(0x7fb29c0b3f10 msgr2=0x7fb29c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 --2- 172.21.15.192:0/2888145156 >> v2:172.21.15.194:3300/0 conn(0x7fb29c0b3f10 0x7fb29c15a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 -- 172.21.15.192:0/2888145156 >> v1:172.21.15.194:6789/0 conn(0x7fb29c15dee0 legacy=0x7fb29c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.416+0000 7fb29a800640 1 -- 172.21.15.192:0/2888145156 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c0b3430 con 0x7fb29c0b0490 2024-09-13T18:45:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.417+0000 7fb29a800640 1 --2- 172.21.15.192:0/2888145156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c0b0490 0x7fb29c15a980 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b4700 tx=0x7fb29402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36abc275b250d16 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.417+0000 7fb298a00640 1 -- 172.21.15.192:0/2888145156 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294032440 con 0x7fb29c0b0490 2024-09-13T18:45:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb298a00640 1 -- 172.21.15.192:0/2888145156 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2940325a0 con 0x7fb29c0b0490 2024-09-13T18:45:34.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb298a00640 1 -- 172.21.15.192:0/2888145156 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294032930 con 0x7fb29c0b0490 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 -- 172.21.15.192:0/2888145156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c0b0490 msgr2=0x7fb29c15a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 --2- 172.21.15.192:0/2888145156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c0b0490 0x7fb29c15a980 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0b4700 tx=0x7fb29402a270 comp rx=0 tx=0).stop 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 -- 172.21.15.192:0/2888145156 shutdown_connections 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 --2- 172.21.15.192:0/2888145156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c0b0490 0x7fb29c15a980 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 --2- 172.21.15.192:0/2888145156 >> v2:172.21.15.194:3300/0 conn(0x7fb29c0b3f10 0x7fb29c15a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 -- 172.21.15.192:0/2888145156 >> 172.21.15.192:0/2888145156 conn(0x7fb29c0ae960 msgr2=0x7fb29c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 -- 172.21.15.192:0/2888145156 shutdown_connections 2024-09-13T18:45:34.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.418+0000 7fb2a1000640 1 -- 172.21.15.192:0/2888145156 wait complete. 2024-09-13T18:45:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.420+0000 7fb2a1000640 1 Processor -- start 2024-09-13T18:45:34.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.420+0000 7fb2a1000640 1 -- start start 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb29c0b0490 0x7fb29c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 0x7fb29c0b1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c141800 con 0x7fb29c15dee0 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c140bf0 con 0x7fb29c0b0490 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb2a1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb29c140ed0 con 0x7fb29c1401a0 2024-09-13T18:45:34.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33324/0 (socket says 172.21.15.192:33324) 2024-09-13T18:45:34.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299400640 1 -- 172.21.15.192:0/3185110634 learned_addr learned my addr 172.21.15.192:0/3185110634 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:34.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299e00640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb29c0b0490 0x7fb29c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb29a800640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 0x7fb29c0b1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299400640 1 -- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 msgr2=0x7fb29c0b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.421+0000 7fb299400640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 0x7fb29c0b1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb299400640 1 -- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb29c0b0490 msgr2=0x7fb29c141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb299400640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb29c0b0490 0x7fb29c141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb299400640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940094d0 con 0x7fb29c15dee0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb29a800640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 0x7fb29c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb299400640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e9b0 tx=0x7fb28800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288009670 con 0x7fb29c15dee0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb28800c9a0 con 0x7fb29c15dee0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29c1411b0 con 0x7fb29c15dee0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb28800cd50 con 0x7fb29c15dee0 2024-09-13T18:45:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.422+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29c1421d0 con 0x7fb29c15dee0 2024-09-13T18:45:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.423+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29c0b4a30 con 0x7fb29c15dee0 2024-09-13T18:45:34.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.424+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb288013470 con 0x7fb29c15dee0 2024-09-13T18:45:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.425+0000 7fb292000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 0x7fb27c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.426+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb2880895f0 con 0x7fb29c15dee0 2024-09-13T18:45:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.426+0000 7fb299e00640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 0x7fb27c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.426+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fb27c072730 con 0x7fb29c15dee0 2024-09-13T18:45:34.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.426+0000 7fb299e00640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 0x7fb27c06d0c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0012e0 tx=0x7fb28c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.430+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb2880547e0 con 0x7fb29c15dee0 2024-09-13T18:45:34.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.600+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb29c0afd80 con 0x7fb29c15dee0 2024-09-13T18:45:34.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.601+0000 7fb292000640 1 -- 172.21.15.192:0/3185110634 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16614 (secure 0 0 0) 0x7fb288021020 con 0x7fb29c15dee0 2024-09-13T18:45:34.604 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:34.604 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":167,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:44:56.855955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:34.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 msgr2=0x7fb27c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 0x7fb27c06d0c0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb28c0012e0 tx=0x7fb28c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 msgr2=0x7fb29c15cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fb28800e9b0 tx=0x7fb28800ee70 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 shutdown_connections 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb27c06ac00 0x7fb27c06d0c0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb29c1401a0 0x7fb29c0b1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb29c15dee0 0x7fb29c15cc70 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 --2- 172.21.15.192:0/3185110634 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb29c0b0490 0x7fb29c141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 >> 172.21.15.192:0/3185110634 conn(0x7fb29c0ae960 msgr2=0x7fb29c071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 shutdown_connections 2024-09-13T18:45:34.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.603+0000 7fb2a1000640 1 -- 172.21.15.192:0/3185110634 wait complete. 2024-09-13T18:45:34.622 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:43:16.500180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:43:17.638056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:34.623 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.776+0000 7f05e2600640 1 Processor -- start 2024-09-13T18:45:34.779 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.776+0000 7f05e2600640 1 -- start start 2024-09-13T18:45:34.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.777+0000 7f05e2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f05dc1434c0 0x7f05dc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05e2600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc06b480 con 0x7f05dc0b3da0 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05e2600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc06b760 con 0x7f05dc06a8b0 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05e2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc0ce770 con 0x7f05dc1434c0 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05dbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f05dc0b3da0 0x7f05dc06e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47960/0 (socket says 172.21.15.192:47960) 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05dbe00640 1 -- 172.21.15.192:0/3543725304 learned_addr learned my addr 172.21.15.192:0/3543725304 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:34.781 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05db400640 1 --2- 172.21.15.192:0/3543725304 >> v2:172.21.15.194:3300/0 conn(0x7f05dc1434c0 0x7f05dc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05da000640 1 -- 172.21.15.192:0/3543725304 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275891320 0 0) 0x7f05dc06b480 con 0x7f05dc0b3da0 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.778+0000 7f05da000640 1 -- 172.21.15.192:0/3543725304 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05c0005730 con 0x7f05dc0b3da0 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.779+0000 7f05db400640 1 -- 172.21.15.192:0/3543725304 >> v1:172.21.15.194:6789/0 conn(0x7f05dc06a8b0 legacy=0x7f05dc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.779+0000 7f05db400640 1 -- 172.21.15.192:0/3543725304 >> v1:172.21.15.192:6789/0 conn(0x7f05dc0b3da0 legacy=0x7f05dc06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.779+0000 7f05db400640 1 -- 172.21.15.192:0/3543725304 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc06ba40 con 0x7f05dc1434c0 2024-09-13T18:45:34.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05db400640 1 --2- 172.21.15.192:0/3543725304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc1434c0 0x7f05dc06c800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0097a0 tx=0x7f05cc02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5784ff73db2b93e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05da000640 1 -- 172.21.15.192:0/3543725304 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032440 con 0x7f05dc1434c0 2024-09-13T18:45:34.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05da000640 1 -- 172.21.15.192:0/3543725304 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc0325a0 con 0x7f05dc1434c0 2024-09-13T18:45:34.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05da000640 1 -- 172.21.15.192:0/3543725304 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032910 con 0x7f05dc1434c0 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05e2600640 1 -- 172.21.15.192:0/3543725304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc1434c0 msgr2=0x7f05dc06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05e2600640 1 --2- 172.21.15.192:0/3543725304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc1434c0 0x7f05dc06c800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f05cc0097a0 tx=0x7f05cc02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05e2600640 1 -- 172.21.15.192:0/3543725304 shutdown_connections 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.780+0000 7f05e2600640 1 --2- 172.21.15.192:0/3543725304 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc1434c0 0x7f05dc06c800 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.781+0000 7f05e2600640 1 -- 172.21.15.192:0/3543725304 >> 172.21.15.192:0/3543725304 conn(0x7f05dc0b08f0 msgr2=0x7f05dc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.781+0000 7f05e2600640 1 -- 172.21.15.192:0/3543725304 shutdown_connections 2024-09-13T18:45:34.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.781+0000 7f05e2600640 1 -- 172.21.15.192:0/3543725304 wait complete. 2024-09-13T18:45:34.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.782+0000 7f05e2600640 1 Processor -- start 2024-09-13T18:45:34.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.782+0000 7f05e2600640 1 -- start start 2024-09-13T18:45:34.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc0b3da0 0x7f05dc0aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05dc1434c0 0x7f05dc141c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0ae300 con 0x7f05dc06a8b0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0a9b00 con 0x7f05dc0b3da0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05e2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc0ab310 con 0x7f05dc1434c0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33330/0 (socket says 172.21.15.192:33330) 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.783+0000 7f05db400640 1 -- 172.21.15.192:0/117616604 learned_addr learned my addr 172.21.15.192:0/117616604 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05dbe00640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05dc1434c0 0x7f05dc141c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05daa00640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc0b3da0 0x7f05dc0aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 -- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05dc1434c0 msgr2=0x7f05dc141c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05dc1434c0 0x7f05dc141c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.787 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 -- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc0b3da0 msgr2=0x7f05dc0aadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc0b3da0 0x7f05dc0aadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05cc009400 con 0x7f05dc06a8b0 2024-09-13T18:45:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05db400640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc032440 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05cc004230 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc0a9d30 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.784+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05cc006e10 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.785+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc0aa2f0 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.786+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc069ea0 con 0x7f05dc06a8b0 2024-09-13T18:45:34.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.786+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f05cc039050 con 0x7f05dc06a8b0 2024-09-13T18:45:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.787+0000 7f05d3400640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 0x7f05bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.787+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05cc0a9cf0 con 0x7f05dc06a8b0 2024-09-13T18:45:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.788+0000 7f05daa00640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 0x7f05bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:34.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.788+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f05bc072730 con 0x7f05dc06a8b0 2024-09-13T18:45:34.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.788+0000 7f05daa00640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 0x7f05bc06d0c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ab730 tx=0x7f05c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:34.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.791+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f05cc04b020 con 0x7f05dc06a8b0 2024-09-13T18:45:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.959+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05dc15e460 con 0x7f05dc06a8b0 2024-09-13T18:45:34.962 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.960+0000 7f05d3400640 1 -- 172.21.15.192:0/117616604 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05cc037070 con 0x7f05dc06a8b0 2024-09-13T18:45:34.963 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 msgr2=0x7f05bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 0x7f05bc06d0c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f05dc0ab730 tx=0x7f05c8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 msgr2=0x7f05dc0a95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 shutdown_connections 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f05bc06ac00 0x7f05bc06d0c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f05dc1434c0 0x7f05dc141c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f05dc0b3da0 0x7f05dc0aadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 --2- 172.21.15.192:0/117616604 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f05dc06a8b0 0x7f05dc0a95c0 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:34.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 >> 172.21.15.192:0/117616604 conn(0x7f05dc0b08f0 msgr2=0x7f05dc15c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:34.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 shutdown_connections 2024-09-13T18:45:34.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:34.962+0000 7f05e2600640 1 -- 172.21.15.192:0/117616604 wait complete. 2024-09-13T18:45:34.980 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:35.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.132+0000 7f73d9600640 1 Processor -- start 2024-09-13T18:45:35.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.133+0000 7f73d9600640 1 -- start start 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d9600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f73d415b810 0x7f73d415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d9600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d415b070 con 0x7f73d40afbe0 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d9600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d415eba0 con 0x7f73d415b810 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d415ee20 con 0x7f73d41402c0 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73cb400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f73d415b810 0x7f73d415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73cb400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f73d415b810 0x7f73d415bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:52736/0 (socket says 172.21.15.192:52736) 2024-09-13T18:45:35.137 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.134+0000 7f73cb400640 1 -- 172.21.15.192:0/2113677174 learned_addr learned my addr 172.21.15.192:0/2113677174 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.135+0000 7f73cb400640 1 -- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 msgr2=0x7f73d415e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.135+0000 7f73cb400640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.135+0000 7f73cb400640 1 -- 172.21.15.192:0/2113677174 >> v1:172.21.15.194:6789/0 conn(0x7f73d40afbe0 legacy=0x7f73d41406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.135+0000 7f73cb400640 1 -- 172.21.15.192:0/2113677174 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d415f100 con 0x7f73d415b810 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.135+0000 7f73d3e00640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:35.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.136+0000 7f73cb400640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d415bc50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009870 tx=0x7f73bc02a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=111dc0fcac5b51b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.136+0000 7f73d3400640 1 -- 172.21.15.192:0/2113677174 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032440 con 0x7f73d415b810 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.136+0000 7f73d3400640 1 -- 172.21.15.192:0/2113677174 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0325a0 con 0x7f73d415b810 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.136+0000 7f73d3400640 1 -- 172.21.15.192:0/2113677174 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc032930 con 0x7f73d415b810 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 -- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 msgr2=0x7f73d415bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d415bc50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f73bc009870 tx=0x7f73bc02a270 comp rx=0 tx=0).stop 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 -- 172.21.15.192:0/2113677174 shutdown_connections 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d415bc50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 --2- 172.21.15.192:0/2113677174 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 -- 172.21.15.192:0/2113677174 >> 172.21.15.192:0/2113677174 conn(0x7f73d40ae7f0 msgr2=0x7f73d406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 -- 172.21.15.192:0/2113677174 shutdown_connections 2024-09-13T18:45:35.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.137+0000 7f73d9600640 1 -- 172.21.15.192:0/2113677174 wait complete. 2024-09-13T18:45:35.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.138+0000 7f73d9600640 1 Processor -- start 2024-09-13T18:45:35.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.138+0000 7f73d9600640 1 -- start start 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d413c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d413d840 con 0x7f73d40afbe0 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d41438a0 con 0x7f73d415b810 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d9600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d4144120 con 0x7f73d41402c0 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.139+0000 7f73d3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33344/0 (socket says 172.21.15.192:33344) 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 -- 172.21.15.192:0/2512302296 learned_addr learned my addr 172.21.15.192:0/2512302296 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73cb400640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.143 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d8c00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d413c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 -- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 msgr2=0x7f73d415a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 -- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 msgr2=0x7f73d413c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d413c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c4009400 con 0x7f73d40afbe0 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73cb400640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d8c00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d413c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.144 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d3e00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f73c400e960 tx=0x7f73c400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c400ca00 con 0x7f73d40afbe0 2024-09-13T18:45:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.140+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c400cb60 con 0x7f73d40afbe0 2024-09-13T18:45:35.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.141+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c4013470 con 0x7f73d40afbe0 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.141+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73bc0094d0 con 0x7f73d40afbe0 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.141+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d4143e40 con 0x7f73d40afbe0 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.142+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d415e660 con 0x7f73d40afbe0 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.142+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f73c40135d0 con 0x7f73d40afbe0 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.143+0000 7f73d0c00640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 0x7f73b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.146 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.143+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73c4089670 con 0x7f73d40afbe0 2024-09-13T18:45:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.144+0000 7f73cb400640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 0x7f73b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.144+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f73b0072730 con 0x7f73d40afbe0 2024-09-13T18:45:35.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.144+0000 7f73cb400640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 0x7f73b006d0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.148+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f73c40547b0 con 0x7f73d40afbe0 2024-09-13T18:45:35.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.315+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f73d4144420 con 0x7f73d40afbe0 2024-09-13T18:45:35.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.315+0000 7f73d0c00640 1 -- 172.21.15.192:0/2512302296 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7f73c4057dd0 con 0x7f73d40afbe0 2024-09-13T18:45:35.318 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:45:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 msgr2=0x7f73b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 0x7f73b006d0c0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f73bc034000 tx=0x7f73bc02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 msgr2=0x7f73d413cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f73c400e960 tx=0x7f73c400ee20 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 shutdown_connections 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f73b006ac00 0x7f73b006d0c0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f73d415b810 0x7f73d413c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f73d41402c0 0x7f73d415a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.317+0000 7f73d9600640 1 --2- 172.21.15.192:0/2512302296 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73d40afbe0 0x7f73d413cf70 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.318+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 >> 172.21.15.192:0/2512302296 conn(0x7f73d40ae7f0 msgr2=0x7f73d413f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.318+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 shutdown_connections 2024-09-13T18:45:35.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.318+0000 7f73d9600640 1 -- 172.21.15.192:0/2512302296 wait complete. 2024-09-13T18:45:35.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.490+0000 7f8b9d400640 1 Processor -- start 2024-09-13T18:45:35.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.490+0000 7f8b9d400640 1 -- start start 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b9d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8b980b3af0 0x7f8b9815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b9d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9806c0b0 0x7f8b9806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b9d400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b980b2000 con 0x7f8b981589f0 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b9d400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b9806ca80 con 0x7f8b980b3af0 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b9d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980b2ba0 con 0x7f8b9806c0b0 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.491+0000 7f8b96800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8b981589f0 0x7f8b980b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47966/0 (socket says 172.21.15.192:47966) 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b96800640 1 -- 172.21.15.192:0/1360653228 learned_addr learned my addr 172.21.15.192:0/1360653228 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95e00640 1 --2- 172.21.15.192:0/1360653228 >> v2:172.21.15.192:3300/0 conn(0x7f8b980b3af0 0x7f8b9815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b97200640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9806c0b0 0x7f8b9806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95e00640 1 -- 172.21.15.192:0/1360653228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9806c0b0 msgr2=0x7f8b9806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95e00640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9806c0b0 0x7f8b9806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95e00640 1 -- 172.21.15.192:0/1360653228 >> v1:172.21.15.192:6789/0 conn(0x7f8b981589f0 legacy=0x7f8b980b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95e00640 1 -- 172.21.15.192:0/1360653228 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9815bbd0 con 0x7f8b980b3af0 2024-09-13T18:45:35.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.492+0000 7f8b95400640 1 -- 172.21.15.192:0/1360653228 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544549437 0 0) 0x7f8b980b2000 con 0x7f8b981589f0 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.493+0000 7f8b95e00640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b980b3af0 0x7f8b9815b260 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f8b840097a0 tx=0x7f8b8402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6a5e60730ae23ce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.493+0000 7f8b95400640 1 -- 172.21.15.192:0/1360653228 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84032440 con 0x7f8b980b3af0 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.493+0000 7f8b95400640 1 -- 172.21.15.192:0/1360653228 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b840325a0 con 0x7f8b980b3af0 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.493+0000 7f8b95400640 1 -- 172.21.15.192:0/1360653228 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b84032930 con 0x7f8b980b3af0 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 -- 172.21.15.192:0/1360653228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b980b3af0 msgr2=0x7f8b9815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b980b3af0 0x7f8b9815b260 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f8b840097a0 tx=0x7f8b8402a180 comp rx=0 tx=0).stop 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 -- 172.21.15.192:0/1360653228 shutdown_connections 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b9806c0b0 0x7f8b9806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 --2- 172.21.15.192:0/1360653228 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b980b3af0 0x7f8b9815b260 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 -- 172.21.15.192:0/1360653228 >> 172.21.15.192:0/1360653228 conn(0x7f8b980b08f0 msgr2=0x7f8b980b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 -- 172.21.15.192:0/1360653228 shutdown_connections 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.494+0000 7f8b9d400640 1 -- 172.21.15.192:0/1360653228 wait complete. 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.495+0000 7f8b9d400640 1 Processor -- start 2024-09-13T18:45:35.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.496+0000 7f8b9d400640 1 -- start start 2024-09-13T18:45:35.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.496+0000 7f8b9d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.496+0000 7f8b9d400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 0x7f8b9814e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.496+0000 7f8b9d400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 0x7f8b980c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.496+0000 7f8b9d400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980ad8c0 con 0x7f8b9806c0b0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b9d400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980ae290 con 0x7f8b980b3af0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b9d400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b980accb0 con 0x7f8b981589f0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33356/0 (socket says 172.21.15.192:33356) 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 -- 172.21.15.192:0/3112594490 learned_addr learned my addr 172.21.15.192:0/3112594490 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b97200640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 0x7f8b980c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b95e00640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 0x7f8b9814e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 -- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 msgr2=0x7f8b980c4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 0x7f8b980c4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 -- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 msgr2=0x7f8b9814e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 0x7f8b9814e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b84009400 con 0x7f8b9806c0b0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b97200640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 0x7f8b980c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b95e00640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 0x7f8b9814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.497+0000 7f8b96800640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c4d0 tx=0x7f8b8800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.498+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b880074e0 con 0x7f8b9806c0b0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.498+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b88007660 con 0x7f8b9806c0b0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.498+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b88004a20 con 0x7f8b9806c0b0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.498+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b980acf90 con 0x7f8b9806c0b0 2024-09-13T18:45:35.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.498+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b980ad550 con 0x7f8b9806c0b0 2024-09-13T18:45:35.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.499+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b9806c540 con 0x7f8b9806c0b0 2024-09-13T18:45:35.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.500+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8b88004b80 con 0x7f8b9806c0b0 2024-09-13T18:45:35.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.501+0000 7f8b8ea00640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 0x7f8b7806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.501+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b88088550 con 0x7f8b9806c0b0 2024-09-13T18:45:35.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.501+0000 7f8b95e00640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 0x7f8b7806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.501+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f8b78072730 con 0x7f8b9806c0b0 2024-09-13T18:45:35.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.501+0000 7f8b95e00640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 0x7f8b7806d0c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8b84034000 tx=0x7f8b8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.507 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.505+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8b88018060 con 0x7f8b9806c0b0 2024-09-13T18:45:35.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.672+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8b980cb8f0 con 0x7f8b9806c0b0 2024-09-13T18:45:35.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.673+0000 7f8b8ea00640 1 -- 172.21.15.192:0/3112594490 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8b88053720 con 0x7f8b9806c0b0 2024-09-13T18:45:35.676 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 msgr2=0x7f8b7806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 0x7f8b7806d0c0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f8b84034000 tx=0x7f8b8402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 msgr2=0x7f8b980add50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8b8800c4d0 tx=0x7f8b8800c990 comp rx=0 tx=0).stop 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 shutdown_connections 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8b7806ac00 0x7f8b7806d0c0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8b981589f0 0x7f8b980c4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8b980b3af0 0x7f8b9814e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 --2- 172.21.15.192:0/3112594490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b9806c0b0 0x7f8b980add50 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 >> 172.21.15.192:0/3112594490 conn(0x7f8b980b08f0 msgr2=0x7f8b9815a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 shutdown_connections 2024-09-13T18:45:35.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.675+0000 7f8b9d400640 1 -- 172.21.15.192:0/3112594490 wait complete. 2024-09-13T18:45:35.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:35.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.846+0000 7f21d0400640 1 Processor -- start 2024-09-13T18:45:35.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.846+0000 7f21d0400640 1 -- start start 2024-09-13T18:45:35.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21d0400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21c8146610 0x7f21c80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21d0400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 0x7f21c80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21d0400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c80ae770 con 0x7f21c80afd80 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21d0400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cd920 con 0x7f21c8146610 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21d0400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c80cdb30 con 0x7f21c80b2780 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.847+0000 7f21cda00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21c8146610 0x7f21c80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f21c8146610 0x7f21c80ce2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33366/0 (socket says 172.21.15.192:33366) 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 -- 172.21.15.192:0/3768890545 learned_addr learned my addr 172.21.15.192:0/3768890545 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cd000640 1 --2- 172.21.15.192:0/3768890545 >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 0x7f21c80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 -- 172.21.15.192:0/3768890545 >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 msgr2=0x7f21c80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 --2- 172.21.15.192:0/3768890545 >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 0x7f21c80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 -- 172.21.15.192:0/3768890545 >> v1:172.21.15.194:6789/0 conn(0x7f21c80afd80 legacy=0x7f21c80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cda00640 1 -- 172.21.15.192:0/3768890545 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c80ae1b0 con 0x7f21c8146610 2024-09-13T18:45:35.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.848+0000 7f21cd000640 1 --2- 172.21.15.192:0/3768890545 >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 0x7f21c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.849+0000 7f21cda00640 1 --2- 172.21.15.192:0/3768890545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c8146610 0x7f21c80ce2f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f590ff282e90b96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.849+0000 7f21c7e00640 1 -- 172.21.15.192:0/3768890545 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc032440 con 0x7f21c8146610 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.849+0000 7f21c7e00640 1 -- 172.21.15.192:0/3768890545 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc0325a0 con 0x7f21c8146610 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.849+0000 7f21c7e00640 1 -- 172.21.15.192:0/3768890545 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc032930 con 0x7f21c8146610 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 -- 172.21.15.192:0/3768890545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c8146610 msgr2=0x7f21c80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 --2- 172.21.15.192:0/3768890545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c8146610 0x7f21c80ce2f0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f21bc009870 tx=0x7f21bc02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 -- 172.21.15.192:0/3768890545 shutdown_connections 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 --2- 172.21.15.192:0/3768890545 >> v2:172.21.15.194:3300/0 conn(0x7f21c80b2780 0x7f21c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 --2- 172.21.15.192:0/3768890545 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c8146610 0x7f21c80ce2f0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 -- 172.21.15.192:0/3768890545 >> 172.21.15.192:0/3768890545 conn(0x7f21c80ae960 msgr2=0x7f21c806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 -- 172.21.15.192:0/3768890545 shutdown_connections 2024-09-13T18:45:35.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.850+0000 7f21d0400640 1 -- 172.21.15.192:0/3768890545 wait complete. 2024-09-13T18:45:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.851+0000 7f21d0400640 1 Processor -- start 2024-09-13T18:45:35.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 -- start start 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 0x7f21c8140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 0x7f21c8143190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c8146610 0x7f21c8070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f2810 con 0x7f21c80b2780 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.852+0000 7f21d0400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f2a00 con 0x7f21c80afd80 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21d0400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c81f2ce0 con 0x7f21c8146610 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 0x7f21c8143190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cd000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 0x7f21c8143190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33370/0 (socket says 172.21.15.192:33370) 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 0x7f21c8140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cd000640 1 -- 172.21.15.192:0/2279186106 learned_addr learned my addr 172.21.15.192:0/2279186106 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21ce400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c8146610 0x7f21c8070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 -- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c8146610 msgr2=0x7f21c8070ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c8146610 0x7f21c8070ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 -- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 msgr2=0x7f21c8143190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 0x7f21c8143190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc0094d0 con 0x7f21c80afd80 2024-09-13T18:45:35.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.853+0000 7f21cda00640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 0x7f21c8140230 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f21bc031000 tx=0x7f21bc0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.854+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc032440 con 0x7f21c80afd80 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.854+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21bc030ba0 con 0x7f21c80afd80 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.854+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21bc004030 con 0x7f21c80afd80 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.854+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c81f2fc0 con 0x7f21c80afd80 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.854+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c81f3580 con 0x7f21c80afd80 2024-09-13T18:45:35.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.855+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c80cc960 con 0x7f21c80afd80 2024-09-13T18:45:35.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.856+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f21bc039040 con 0x7f21c80afd80 2024-09-13T18:45:35.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.857+0000 7f21c5600640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 0x7f21a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:35.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.857+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21bc0aa3a0 con 0x7f21c80afd80 2024-09-13T18:45:35.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.857+0000 7f21cd000640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 0x7f21a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:35.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.857+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f21a8072730 con 0x7f21c80afd80 2024-09-13T18:45:35.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.858+0000 7f21cd000640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 0x7f21a806d0c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b3c40 tx=0x7f21b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:35.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:35.861+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f21bc075730 con 0x7f21c80afd80 2024-09-13T18:45:36.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.040+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f21c80ce2f0 con 0x7f21c80afd80 2024-09-13T18:45:36.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.042+0000 7f21c5600640 1 -- 172.21.15.192:0/2279186106 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v167) v1 ==== 80+0+0 (secure 0 0 0) 0x7f21bc04a020 con 0x7f21c80afd80 2024-09-13T18:45:36.044 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:45:36.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 msgr2=0x7f21a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 0x7f21a806d0c0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f21c80b3c40 tx=0x7f21b4008040 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 msgr2=0x7f21c8140230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 0x7f21c8140230 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f21bc031000 tx=0x7f21bc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 shutdown_connections 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f21a806ac00 0x7f21a806d0c0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f21c8146610 0x7f21c8070ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21c80b2780 0x7f21c8143190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 --2- 172.21.15.192:0/2279186106 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f21c80afd80 0x7f21c8140230 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 >> 172.21.15.192:0/2279186106 conn(0x7f21c80ae960 msgr2=0x7f21c806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 shutdown_connections 2024-09-13T18:45:36.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.043+0000 7f21d0400640 1 -- 172.21.15.192:0/2279186106 wait complete. 2024-09-13T18:45:36.062 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:45:36.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:36.062 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:45:36.127 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:45:36.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:36.127 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:45:36.163 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:45:36.164 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:36.203 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:45:36.203 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:36.282 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.430+0000 7fd5dd400640 1 Processor -- start 2024-09-13T18:45:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.430+0000 7fd5dd400640 1 -- start start 2024-09-13T18:45:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5dd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5d80cacd0 0x7fd5d815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5dd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5d80cb0b0 0x7fd5d815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5dd400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d8140480 con 0x7fd5d8140980 2024-09-13T18:45:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5dd400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d815c160 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5dd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d80cb520 con 0x7fd5d80cacd0 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5d80cb0b0 0x7fd5d815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd5d80cb0b0 0x7fd5d815bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33376/0 (socket says 172.21.15.192:33376) 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 -- 172.21.15.192:0/3341915244 learned_addr learned my addr 172.21.15.192:0/3341915244 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d7200640 1 --1- 172.21.15.192:0/3341915244 >> v1:172.21.15.192:6789/0 conn(0x7fd5d8140980 0x7fd5d80afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47978/0 (socket says 172.21.15.192:47978) 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d6800640 1 --2- 172.21.15.192:0/3341915244 >> v2:172.21.15.194:3300/0 conn(0x7fd5d80cacd0 0x7fd5d815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 -- 172.21.15.192:0/3341915244 >> v2:172.21.15.194:3300/0 conn(0x7fd5d80cacd0 msgr2=0x7fd5d815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 --2- 172.21.15.192:0/3341915244 >> v2:172.21.15.194:3300/0 conn(0x7fd5d80cacd0 0x7fd5d815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 -- 172.21.15.192:0/3341915244 >> v1:172.21.15.192:6789/0 conn(0x7fd5d8140980 legacy=0x7fd5d80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5e00640 1 -- 172.21.15.192:0/3341915244 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d815ee90 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.432+0000 7fd5d5400640 1 -- 172.21.15.192:0/3341915244 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807773902 0 0) 0x7fd5d8140480 con 0x7fd5d8140980 2024-09-13T18:45:36.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.433+0000 7fd5d5e00640 1 --2- 172.21.15.192:0/3341915244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d80cb0b0 0x7fd5d815bc20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b2350 tx=0x7fd5c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa1634e7a7ab1f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5d5400640 1 -- 172.21.15.192:0/3341915244 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4032440 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5d5400640 1 -- 172.21.15.192:0/3341915244 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c40325a0 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5d5400640 1 -- 172.21.15.192:0/3341915244 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4032930 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 -- 172.21.15.192:0/3341915244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d80cb0b0 msgr2=0x7fd5d815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 --2- 172.21.15.192:0/3341915244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d80cb0b0 0x7fd5d815bc20 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fd5d80b2350 tx=0x7fd5c402a270 comp rx=0 tx=0).stop 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 -- 172.21.15.192:0/3341915244 shutdown_connections 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 --2- 172.21.15.192:0/3341915244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d80cb0b0 0x7fd5d815bc20 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 --2- 172.21.15.192:0/3341915244 >> v2:172.21.15.194:3300/0 conn(0x7fd5d80cacd0 0x7fd5d815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 -- 172.21.15.192:0/3341915244 >> 172.21.15.192:0/3341915244 conn(0x7fd5d80ae960 msgr2=0x7fd5d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 -- 172.21.15.192:0/3341915244 shutdown_connections 2024-09-13T18:45:36.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.434+0000 7fd5dd400640 1 -- 172.21.15.192:0/3341915244 wait complete. 2024-09-13T18:45:36.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.436+0000 7fd5dd400640 1 Processor -- start 2024-09-13T18:45:36.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.436+0000 7fd5dd400640 1 -- start start 2024-09-13T18:45:36.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 0x7fd5d813d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80cb0b0 0x7fd5d806b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d813dac0 con 0x7fd5d8140980 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d81567a0 con 0x7fd5d80cacd0 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5dd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d8156a80 con 0x7fd5d80cb0b0 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5d7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5d7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33380/0 (socket says 172.21.15.192:33380) 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5d7200640 1 -- 172.21.15.192:0/911171125 learned_addr learned my addr 172.21.15.192:0/911171125 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.437+0000 7fd5d6800640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 0x7fd5d813d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d5e00640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80cb0b0 0x7fd5d806b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 -- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80cb0b0 msgr2=0x7fd5d806b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80cb0b0 0x7fd5d806b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 -- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 msgr2=0x7fd5d813d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 0x7fd5d813d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c40094d0 con 0x7fd5d8140980 2024-09-13T18:45:36.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d6800640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 0x7fd5d813d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:36.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5d7200640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c7a0 tx=0x7fd5d000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000a640 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5d000a7a0 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5d000ab90 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d8156d60 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.438+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d8157320 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.439+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d8157510 con 0x7fd5d8140980 2024-09-13T18:45:36.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.440+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5d000acf0 con 0x7fd5d8140980 2024-09-13T18:45:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.441+0000 7fd5cea00640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 0x7fd5b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.441+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5d0088920 con 0x7fd5d8140980 2024-09-13T18:45:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.441+0000 7fd5d6800640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 0x7fd5b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.441+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fd5b8072730 con 0x7fd5d8140980 2024-09-13T18:45:36.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.442+0000 7fd5d6800640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 0x7fd5b806d0c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd5d81f3ad0 tx=0x7fd5c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.445+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5d0018070 con 0x7fd5d8140980 2024-09-13T18:45:36.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.614+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5d815bc20 con 0x7fd5d8140980 2024-09-13T18:45:36.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.615+0000 7fd5cea00640 1 -- 172.21.15.192:0/911171125 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16614 (secure 0 0 0) 0x7fd5d0053af0 con 0x7fd5d8140980 2024-09-13T18:45:36.618 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:36.618 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":167,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:44:56.855955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.617+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 msgr2=0x7fd5b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.617+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 0x7fd5b806d0c0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd5d81f3ad0 tx=0x7fd5c8008040 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.617+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 msgr2=0x7fd5d815c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.617+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fd5d000c7a0 tx=0x7fd5d000cc60 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 shutdown_connections 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5b806ac00 0x7fd5b806d0c0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5d8140980 0x7fd5d815c2a0 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5d80cb0b0 0x7fd5d806b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 --2- 172.21.15.192:0/911171125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5d80cacd0 0x7fd5d813d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 >> 172.21.15.192:0/911171125 conn(0x7fd5d80ae960 msgr2=0x7fd5d815e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 shutdown_connections 2024-09-13T18:45:36.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.618+0000 7fd5dd400640 1 -- 172.21.15.192:0/911171125 wait complete. 2024-09-13T18:45:36.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:43:16.500180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:43:17.638056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:36.636 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.795+0000 7f59a0e00640 1 Processor -- start 2024-09-13T18:45:36.798 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.796+0000 7f59a0e00640 1 -- start start 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f59a0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f599c15a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f59a0e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c15af60 con 0x7f599c0b3480 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f59a0e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f599c06b7a0 con 0x7f599c159b00 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f59a0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15ac80 con 0x7f599c06bc30 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f599c0b3480 0x7f599c159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47986/0 (socket says 172.21.15.192:47986) 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599aa00640 1 -- 172.21.15.192:0/2939169621 learned_addr learned my addr 172.21.15.192:0/2939169621 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599be00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f599c15a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994550383 0 0) 0x7f599c15af60 con 0x7f599c0b3480 2024-09-13T18:45:36.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5980003520 con 0x7f599c0b3480 2024-09-13T18:45:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1025357731 0 0) 0x7f5980003520 con 0x7f599c0b3480 2024-09-13T18:45:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 msgr2=0x7f599c15a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f599c15a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 >> v1:172.21.15.194:6789/0 conn(0x7f599c159b00 legacy=0x7f599c0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c06b150 con 0x7f599c0b3480 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f5988001670 con 0x7f599c0b3480 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 >> v1:172.21.15.192:6789/0 conn(0x7f599c0b3480 legacy=0x7f599c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f59800039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f59800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5980004d00 0x7f5980005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15ac80 con 0x7f5980003ee0 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598000b9e0 con 0x7f5980004d00 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598000bba0 con 0x7f599c06bc30 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599aa00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f59800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599b400640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f59800039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.798+0000 7f599be00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5980004d00 0x7f5980005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.799+0000 7f599aa00640 1 -- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 msgr2=0x7f59800039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.799+0000 7f599aa00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c06bc30 0x7f59800039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.799+0000 7f599aa00640 1 -- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5980004d00 msgr2=0x7f5980005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.799+0000 7f599aa00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5980004d00 0x7f5980005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.799+0000 7f599aa00640 1 -- 172.21.15.192:0/2939169621 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980003520 con 0x7f5980003ee0 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f599aa00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f59800047c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5988007cb0 tx=0x7f59800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=122428e0bf5f484d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59880058d0 con 0x7f5980003ee0 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988005a30 con 0x7f5980003ee0 2024-09-13T18:45:36.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f599a000640 1 -- 172.21.15.192:0/2939169621 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988005e20 con 0x7f5980003ee0 2024-09-13T18:45:36.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f59a0e00640 1 -- 172.21.15.192:0/2939169621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 msgr2=0x7f59800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f59a0e00640 1 --2- 172.21.15.192:0/2939169621 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f59800047c0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f5988007cb0 tx=0x7f59800057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f599be00640 1 -- 172.21.15.192:0/2939169621 reap_dead start 2024-09-13T18:45:36.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f59a0e00640 1 -- 172.21.15.192:0/2939169621 shutdown_connections 2024-09-13T18:45:36.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.800+0000 7f59a0e00640 1 -- 172.21.15.192:0/2939169621 >> 172.21.15.192:0/2939169621 conn(0x7f599c0736d0 msgr2=0x7f599c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.801+0000 7f59a0e00640 1 -- 172.21.15.192:0/2939169621 shutdown_connections 2024-09-13T18:45:36.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.801+0000 7f59a0e00640 1 -- 172.21.15.192:0/2939169621 wait complete. 2024-09-13T18:45:36.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.802+0000 7f59a0e00640 1 Processor -- start 2024-09-13T18:45:36.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.802+0000 7f59a0e00640 1 -- start start 2024-09-13T18:45:36.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 0x7f599c15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 0x7f599c1e4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c15c7d0 con 0x7f5980003ee0 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06f720 con 0x7f599c15c350 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f59a0e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f599c06fa00 con 0x7f599c155480 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f599b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f599b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33394/0 (socket says 172.21.15.192:33394) 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.803+0000 7f599b400640 1 -- 172.21.15.192:0/4092041861 learned_addr learned my addr 172.21.15.192:0/4092041861 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599be00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 0x7f599c1e4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599aa00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 0x7f599c15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 -- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 msgr2=0x7f599c15be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 0x7f599c15be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 -- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 msgr2=0x7f599c1e4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 0x7f599c1e4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f599c06fce0 con 0x7f5980003ee0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599be00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 0x7f599c1e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599aa00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 0x7f599c15be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f599b400640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f598c00f7c0 tx=0x7f598c00fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00fed0 con 0x7f5980003ee0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f598c0052e0 con 0x7f5980003ee0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598c00d970 con 0x7f5980003ee0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.804+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f599c06ffc0 con 0x7f5980003ee0 2024-09-13T18:45:36.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.805+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f599c1e5380 con 0x7f5980003ee0 2024-09-13T18:45:36.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.806+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f599c0cb4b0 con 0x7f5980003ee0 2024-09-13T18:45:36.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.806+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f598c00dad0 con 0x7f5980003ee0 2024-09-13T18:45:36.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.807+0000 7f5993400640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 0x7f597c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:36.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.807+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f598c0894d0 con 0x7f5980003ee0 2024-09-13T18:45:36.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.807+0000 7f599aa00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 0x7f597c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:36.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.808+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f597c072730 con 0x7f5980003ee0 2024-09-13T18:45:36.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.808+0000 7f599aa00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 0x7f597c06d0c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5988035000 tx=0x7f5988030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:36.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.811+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f598c054610 con 0x7f5980003ee0 2024-09-13T18:45:36.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.983+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f599c0704e0 con 0x7f5980003ee0 2024-09-13T18:45:36.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.983+0000 7f5993400640 1 -- 172.21.15.192:0/4092041861 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f599c0704e0 con 0x7f5980003ee0 2024-09-13T18:45:36.986 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:45:36.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 msgr2=0x7f597c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 0x7f597c06d0c0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f5988035000 tx=0x7f5988030000 comp rx=0 tx=0).stop 2024-09-13T18:45:36.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 msgr2=0x7f599c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f598c00f7c0 tx=0x7f598c00fc80 comp rx=0 tx=0).stop 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 shutdown_connections 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f597c06ac00 0x7f597c06d0c0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f599c15c350 0x7f599c1e4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f599c155480 0x7f599c15be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 --2- 172.21.15.192:0/4092041861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5980003ee0 0x7f599c154f40 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 >> 172.21.15.192:0/4092041861 conn(0x7f599c0736d0 msgr2=0x7f599c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 shutdown_connections 2024-09-13T18:45:36.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:36.985+0000 7f59a0e00640 1 -- 172.21.15.192:0/4092041861 wait complete. 2024-09-13T18:45:37.003 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:37.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.157+0000 7f57cd200640 1 Processor -- start 2024-09-13T18:45:37.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.157+0000 7f57cd200640 1 -- start start 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57cd200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57c80b3af0 0x7f57c815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57cd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c806c0b0 0x7f57c806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57cd200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c80b2000 con 0x7f57c81589f0 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57cd200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c806ca80 con 0x7f57c80b3af0 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57cd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c80b2ba0 con 0x7f57c806c0b0 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57bfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57c80b3af0 0x7f57c815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57bfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f57c80b3af0 0x7f57c815b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33396/0 (socket says 172.21.15.192:33396) 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.158+0000 7f57bfe00640 1 -- 172.21.15.192:0/2359474641 learned_addr learned my addr 172.21.15.192:0/2359474641 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.159+0000 7f57c6800640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c806c0b0 0x7f57c806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.159+0000 7f57bfe00640 1 -- 172.21.15.192:0/2359474641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c806c0b0 msgr2=0x7f57c806c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:37.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.159+0000 7f57bfe00640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c806c0b0 0x7f57c806c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.159+0000 7f57bfe00640 1 -- 172.21.15.192:0/2359474641 >> v1:172.21.15.192:6789/0 conn(0x7f57c81589f0 legacy=0x7f57c80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.159+0000 7f57bfe00640 1 -- 172.21.15.192:0/2359474641 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c815bbd0 con 0x7f57c80b3af0 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57bfe00640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c80b3af0 0x7f57c815b260 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009870 tx=0x7f57b002a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06c3ebbe3671880 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57c5400640 1 -- 172.21.15.192:0/2359474641 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0032440 con 0x7f57c80b3af0 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57c5400640 1 -- 172.21.15.192:0/2359474641 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b00325a0 con 0x7f57c80b3af0 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57c5400640 1 -- 172.21.15.192:0/2359474641 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b0032930 con 0x7f57c80b3af0 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57cd200640 1 -- 172.21.15.192:0/2359474641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c80b3af0 msgr2=0x7f57c815b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.160+0000 7f57cd200640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c80b3af0 0x7f57c815b260 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f57b0009870 tx=0x7f57b002a250 comp rx=0 tx=0).stop 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 -- 172.21.15.192:0/2359474641 shutdown_connections 2024-09-13T18:45:37.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c806c0b0 0x7f57c806c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 --2- 172.21.15.192:0/2359474641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c80b3af0 0x7f57c815b260 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 -- 172.21.15.192:0/2359474641 >> 172.21.15.192:0/2359474641 conn(0x7f57c80b08f0 msgr2=0x7f57c80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 -- 172.21.15.192:0/2359474641 shutdown_connections 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.161+0000 7f57cd200640 1 -- 172.21.15.192:0/2359474641 wait complete. 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.162+0000 7f57cd200640 1 Processor -- start 2024-09-13T18:45:37.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.162+0000 7f57cd200640 1 -- start start 2024-09-13T18:45:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 0x7f57c80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57c81589f0 0x7f57c80add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c814cd60 con 0x7f57c806c0b0 2024-09-13T18:45:37.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8154780 con 0x7f57c81589f0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57cd200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c8154a60 con 0x7f57c80b3af0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57c5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.163+0000 7f57c5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33404/0 (socket says 172.21.15.192:33404) 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 -- 172.21.15.192:0/1648756641 learned_addr learned my addr 172.21.15.192:0/1648756641 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57bfe00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 0x7f57c80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c6800640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57c81589f0 0x7f57c80add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 -- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 msgr2=0x7f57c80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 0x7f57c80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 -- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57c81589f0 msgr2=0x7f57c80add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57c81589f0 0x7f57c80add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b00094d0 con 0x7f57c806c0b0 2024-09-13T18:45:37.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57bfe00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 0x7f57c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57c5e00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c400 tx=0x7f57b800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b80052d0 con 0x7f57c806c0b0 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b8005430 con 0x7f57c806c0b0 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b8003830 con 0x7f57c806c0b0 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.164+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c8154d40 con 0x7f57c806c0b0 2024-09-13T18:45:37.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.165+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c8155300 con 0x7f57c806c0b0 2024-09-13T18:45:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.166+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c806c540 con 0x7f57c806c0b0 2024-09-13T18:45:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.166+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57b8003990 con 0x7f57c806c0b0 2024-09-13T18:45:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.167+0000 7f57be000640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 0x7f57a406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.167+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f57b8088970 con 0x7f57c806c0b0 2024-09-13T18:45:37.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.167+0000 7f57bfe00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 0x7f57a406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.168+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f57a4072730 con 0x7f57c806c0b0 2024-09-13T18:45:37.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.168+0000 7f57bfe00640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 0x7f57a406d0c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f57b0034000 tx=0x7f57b002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.172+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f57b8017060 con 0x7f57c806c0b0 2024-09-13T18:45:37.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.341+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57c80cb8f0 con 0x7f57c806c0b0 2024-09-13T18:45:37.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.342+0000 7f57be000640 1 -- 172.21.15.192:0/1648756641 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57b8053ab0 con 0x7f57c806c0b0 2024-09-13T18:45:37.345 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 msgr2=0x7f57a406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 0x7f57a406d0c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f57b0034000 tx=0x7f57b002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 msgr2=0x7f57c814c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f57b800c400 tx=0x7f57b800c8c0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 shutdown_connections 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f57a406ac00 0x7f57a406d0c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57c81589f0 0x7f57c80add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57c80b3af0 0x7f57c80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 --2- 172.21.15.192:0/1648756641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57c806c0b0 0x7f57c814c820 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 >> 172.21.15.192:0/1648756641 conn(0x7f57c80b08f0 msgr2=0x7f57c8159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 shutdown_connections 2024-09-13T18:45:37.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.344+0000 7f57cd200640 1 -- 172.21.15.192:0/1648756641 wait complete. 2024-09-13T18:45:37.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:37.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.515+0000 7f8e24a00640 1 Processor -- start 2024-09-13T18:45:37.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.515+0000 7f8e24a00640 1 -- start start 2024-09-13T18:45:37.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.516+0000 7f8e24a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8e201434c0 0x7f8e2006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e24a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 0x7f8e2006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e24a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2006b480 con 0x7f8e2006a8b0 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e24a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e200ce770 con 0x7f8e201434c0 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e24a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2006b760 con 0x7f8e200b3da0 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e15400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8e2006a8b0 0x7f8e200b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:47998/0 (socket says 172.21.15.192:47998) 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e15400640 1 -- 172.21.15.192:0/1133155531 learned_addr learned my addr 172.21.15.192:0/1133155531 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1de00640 1 --2- 172.21.15.192:0/1133155531 >> v2:172.21.15.194:3300/0 conn(0x7f8e201434c0 0x7f8e2006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.520 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1e800640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 0x7f8e2006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1d400640 1 -- 172.21.15.192:0/1133155531 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013285080 0 0) 0x7f8e2006b480 con 0x7f8e2006a8b0 2024-09-13T18:45:37.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1d400640 1 -- 172.21.15.192:0/1133155531 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e04003520 con 0x7f8e2006a8b0 2024-09-13T18:45:37.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1de00640 1 -- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 msgr2=0x7f8e2006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:37.521 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.517+0000 7f8e1de00640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 0x7f8e2006e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.518+0000 7f8e1de00640 1 -- 172.21.15.192:0/1133155531 >> v1:172.21.15.192:6789/0 conn(0x7f8e2006a8b0 legacy=0x7f8e200b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.518+0000 7f8e1de00640 1 -- 172.21.15.192:0/1133155531 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2006ba40 con 0x7f8e201434c0 2024-09-13T18:45:37.522 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.518+0000 7f8e1e800640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 0x7f8e2006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.519+0000 7f8e1de00640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e201434c0 0x7f8e2006c800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002a100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd5571fb1409c6aa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.519+0000 7f8e1d400640 1 -- 172.21.15.192:0/1133155531 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1002ae50 con 0x7f8e201434c0 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e1d400640 1 -- 172.21.15.192:0/1133155531 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e10032440 con 0x7f8e201434c0 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e1d400640 1 -- 172.21.15.192:0/1133155531 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e100327d0 con 0x7f8e201434c0 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 -- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e201434c0 msgr2=0x7f8e2006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e201434c0 0x7f8e2006c800 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f8e100097a0 tx=0x7f8e1002a100 comp rx=0 tx=0).stop 2024-09-13T18:45:37.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 -- 172.21.15.192:0/1133155531 shutdown_connections 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e200b3da0 0x7f8e2006e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 --2- 172.21.15.192:0/1133155531 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e201434c0 0x7f8e2006c800 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 -- 172.21.15.192:0/1133155531 >> 172.21.15.192:0/1133155531 conn(0x7f8e200b08f0 msgr2=0x7f8e200b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 -- 172.21.15.192:0/1133155531 shutdown_connections 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.520+0000 7f8e24a00640 1 -- 172.21.15.192:0/1133155531 wait complete. 2024-09-13T18:45:37.524 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.522+0000 7f8e24a00640 1 Processor -- start 2024-09-13T18:45:37.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.522+0000 7f8e24a00640 1 -- start start 2024-09-13T18:45:37.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e200b3da0 0x7f8e2013e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 0x7f8e200ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2015bcb0 con 0x7f8e2006a8b0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20141490 con 0x7f8e200b3da0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e24a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e20141770 con 0x7f8e201434c0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e1de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e1de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33408/0 (socket says 172.21.15.192:33408) 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e1de00640 1 -- 172.21.15.192:0/3181534201 learned_addr learned my addr 172.21.15.192:0/3181534201 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e15400640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e200b3da0 0x7f8e2013e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.523+0000 7f8e1e800640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 0x7f8e200ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 -- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 msgr2=0x7f8e200ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 0x7f8e200ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 -- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e200b3da0 msgr2=0x7f8e2013e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e200b3da0 0x7f8e2013e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e18009a70 con 0x7f8e2006a8b0 2024-09-13T18:45:37.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1e800640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 0x7f8e200ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:37.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e1de00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8e10035040 tx=0x7f8e100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1003d710 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1003d890 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1003dc40 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e10009400 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.524+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e20141d30 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.526+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e200cc7d0 con 0x7f8e2006a8b0 2024-09-13T18:45:37.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.526+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8e10039040 con 0x7f8e2006a8b0 2024-09-13T18:45:37.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.527+0000 7f8e16a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 0x7f8dfc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.527+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e100a9bb0 con 0x7f8e2006a8b0 2024-09-13T18:45:37.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.527+0000 7f8e15400640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 0x7f8dfc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.527+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f8dfc072730 con 0x7f8e2006a8b0 2024-09-13T18:45:37.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.529+0000 7f8e15400640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 0x7f8dfc06d0c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8e2014e240 tx=0x7f8e08007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.532+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8e10074f40 con 0x7f8e2006a8b0 2024-09-13T18:45:37.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.701+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e200b0500 con 0x7f8e2006a8b0 2024-09-13T18:45:37.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.701+0000 7f8e16a00640 1 -- 172.21.15.192:0/3181534201 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e10041020 con 0x7f8e2006a8b0 2024-09-13T18:45:37.703 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:45:37.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 msgr2=0x7f8dfc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 0x7f8dfc06d0c0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8e2014e240 tx=0x7f8e08007d30 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 msgr2=0x7f8e2013cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8e10035040 tx=0x7f8e100046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 shutdown_connections 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8dfc06ac00 0x7f8dfc06d0c0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8e201434c0 0x7f8e200ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8e200b3da0 0x7f8e2013e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 --2- 172.21.15.192:0/3181534201 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e2006a8b0 0x7f8e2013cd30 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.703+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 >> 172.21.15.192:0/3181534201 conn(0x7f8e200b08f0 msgr2=0x7f8e200ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.704+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 shutdown_connections 2024-09-13T18:45:37.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.704+0000 7f8e24a00640 1 -- 172.21.15.192:0/3181534201 wait complete. 2024-09-13T18:45:37.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:45:37.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.872+0000 7f13e1a00640 1 Processor -- start 2024-09-13T18:45:37.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.872+0000 7f13e1a00640 1 -- start start 2024-09-13T18:45:37.875 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13e1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13dc15dee0 0x7f13dc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 0x7f13dc15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13e1a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0b2f00 con 0x7f13dc0b3f10 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13e1a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc0b3150 con 0x7f13dc15dee0 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13e1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0b3430 con 0x7f13dc15e2c0 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13dc15dee0 0x7f13dc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f13dc15dee0 0x7f13dc0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33410/0 (socket says 172.21.15.192:33410) 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13da000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f13dc0b3f10 0x7f13dc15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48000/0 (socket says 172.21.15.192:48000) 2024-09-13T18:45:37.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 -- 172.21.15.192:0/3718334110 learned_addr learned my addr 172.21.15.192:0/3718334110 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13db400640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 0x7f13dc15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 -- 172.21.15.192:0/3718334110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 msgr2=0x7f13dc15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 0x7f13dc15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 -- 172.21.15.192:0/3718334110 >> v1:172.21.15.192:6789/0 conn(0x7f13dc0b3f10 legacy=0x7f13dc15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13daa00640 1 -- 172.21.15.192:0/3718334110 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0b3710 con 0x7f13dc15dee0 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13d9600640 1 -- 172.21.15.192:0/3718334110 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3203319355 0 0) 0x7f13dc0b2f00 con 0x7f13dc0b3f10 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.874+0000 7f13db400640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 0x7f13dc15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:37.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.875+0000 7f13daa00640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc0afd80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009870 tx=0x7f13cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fe6024debc97c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13d9600640 1 -- 172.21.15.192:0/3718334110 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc032440 con 0x7f13dc15dee0 2024-09-13T18:45:37.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13d9600640 1 -- 172.21.15.192:0/3718334110 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc0325a0 con 0x7f13dc15dee0 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13d9600640 1 -- 172.21.15.192:0/3718334110 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc032930 con 0x7f13dc15dee0 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 -- 172.21.15.192:0/3718334110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 msgr2=0x7f13dc0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc0afd80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009870 tx=0x7f13cc02a270 comp rx=0 tx=0).stop 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 -- 172.21.15.192:0/3718334110 shutdown_connections 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc15e2c0 0x7f13dc15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3718334110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc0afd80 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 -- 172.21.15.192:0/3718334110 >> 172.21.15.192:0/3718334110 conn(0x7f13dc0ae960 msgr2=0x7f13dc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 -- 172.21.15.192:0/3718334110 shutdown_connections 2024-09-13T18:45:37.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.876+0000 7f13e1a00640 1 -- 172.21.15.192:0/3718334110 wait complete. 2024-09-13T18:45:37.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.878+0000 7f13e1a00640 1 Processor -- start 2024-09-13T18:45:37.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.878+0000 7f13e1a00640 1 -- start start 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 0x7f13dc1420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc142620 0x7f13dc070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc141340 con 0x7f13dc15dee0 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc1406c0 con 0x7f13dc15e2c0 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13e1a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc1409a0 con 0x7f13dc142620 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13daa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33426/0 (socket says 172.21.15.192:33426) 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13daa00640 1 -- 172.21.15.192:0/3931540655 learned_addr learned my addr 172.21.15.192:0/3931540655 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:37.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13db400640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc142620 0x7f13dc070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.879+0000 7f13da000640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 0x7f13dc1420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 -- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc142620 msgr2=0x7f13dc070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc142620 0x7f13dc070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 -- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 msgr2=0x7f13dc1420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 0x7f13dc1420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13cc0094d0 con 0x7f13dc15dee0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13da000640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 0x7f13dc1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13daa00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f13cc000c00 tx=0x7f13cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc032440 con 0x7f13dc15dee0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc004030 con 0x7f13dc15dee0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc0043e0 con 0x7f13dc15dee0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc140c80 con 0x7f13dc15dee0 2024-09-13T18:45:37.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.880+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc1f3aa0 con 0x7f13dc15dee0 2024-09-13T18:45:37.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.881+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0afd80 con 0x7f13dc15dee0 2024-09-13T18:45:37.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.882+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f13cc039050 con 0x7f13dc15dee0 2024-09-13T18:45:37.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.883+0000 7f13d2a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 0x7f13bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:37.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.883+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13cc0a9bc0 con 0x7f13dc15dee0 2024-09-13T18:45:37.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.883+0000 7f13da000640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 0x7f13bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:37.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.883+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f13bc072730 con 0x7f13dc15dee0 2024-09-13T18:45:37.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.884+0000 7f13da000640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 0x7f13bc06d0c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0ae8d0 tx=0x7f13c8007ca0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:37.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:37.887+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f13cc04b020 con 0x7f13dc15dee0 2024-09-13T18:45:38.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.068+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f13dc06c030 con 0x7f13dc15dee0 2024-09-13T18:45:38.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.068+0000 7f13d2a00640 1 -- 172.21.15.192:0/3931540655 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v167) v1 ==== 80+0+0 (secure 0 0 0) 0x7f13cc037070 con 0x7f13dc15dee0 2024-09-13T18:45:38.070 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 msgr2=0x7f13bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 0x7f13bc06d0c0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0ae8d0 tx=0x7f13c8007ca0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 msgr2=0x7f13dc1f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f13cc000c00 tx=0x7f13cc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 shutdown_connections 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f13bc06ac00 0x7f13bc06d0c0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f13dc142620 0x7f13dc070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f13dc15e2c0 0x7f13dc1420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 --2- 172.21.15.192:0/3931540655 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f13dc15dee0 0x7f13dc1f3560 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 >> 172.21.15.192:0/3931540655 conn(0x7f13dc0ae960 msgr2=0x7f13dc069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 shutdown_connections 2024-09-13T18:45:38.074 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.071+0000 7f13e1a00640 1 -- 172.21.15.192:0/3931540655 wait complete. 2024-09-13T18:45:38.089 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:45:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:38.089 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:45:38.159 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:45:38.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:45:38.160 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:45:38.197 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:45:38.197 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:38.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:45:38.233 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:45:38.233 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:38.274 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:45:38.275 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:38.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.426+0000 7ff291e00640 1 Processor -- start 2024-09-13T18:45:38.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.426+0000 7ff291e00640 1 -- start start 2024-09-13T18:45:38.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff291e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff28c15dee0 0x7ff28c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff291e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff28c0b3f10 0x7ff28c0b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff291e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0b2f00 con 0x7ff28c15e2c0 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff291e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c0b3150 con 0x7ff28c15dee0 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff291e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff28c0b3430 con 0x7ff28c0b3f10 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff28aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff28c15dee0 0x7ff28c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff28aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff28c15dee0 0x7ff28c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33434/0 (socket says 172.21.15.192:33434) 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.427+0000 7ff28aa00640 1 -- 172.21.15.192:0/69771159 learned_addr learned my addr 172.21.15.192:0/69771159 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.428+0000 7ff28a000640 1 --2- 172.21.15.192:0/69771159 >> v2:172.21.15.194:3300/0 conn(0x7ff28c0b3f10 0x7ff28c0b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.428+0000 7ff28aa00640 1 -- 172.21.15.192:0/69771159 >> v2:172.21.15.194:3300/0 conn(0x7ff28c0b3f10 msgr2=0x7ff28c0b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.428+0000 7ff28aa00640 1 --2- 172.21.15.192:0/69771159 >> v2:172.21.15.194:3300/0 conn(0x7ff28c0b3f10 0x7ff28c0b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.428+0000 7ff28aa00640 1 -- 172.21.15.192:0/69771159 >> v1:172.21.15.192:6789/0 conn(0x7ff28c15e2c0 legacy=0x7ff28c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.428+0000 7ff28aa00640 1 -- 172.21.15.192:0/69771159 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c0b3710 con 0x7ff28c15dee0 2024-09-13T18:45:38.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.429+0000 7ff28aa00640 1 --2- 172.21.15.192:0/69771159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15dee0 0x7ff28c0afd80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0b4700 tx=0x7ff27c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480552480aa5f149 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.429+0000 7ff289600640 1 -- 172.21.15.192:0/69771159 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c032440 con 0x7ff28c15dee0 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.429+0000 7ff289600640 1 -- 172.21.15.192:0/69771159 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27c0325a0 con 0x7ff28c15dee0 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.429+0000 7ff289600640 1 -- 172.21.15.192:0/69771159 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27c032930 con 0x7ff28c15dee0 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 -- 172.21.15.192:0/69771159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15dee0 msgr2=0x7ff28c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 --2- 172.21.15.192:0/69771159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15dee0 0x7ff28c0afd80 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7ff28c0b4700 tx=0x7ff27c02a270 comp rx=0 tx=0).stop 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 -- 172.21.15.192:0/69771159 shutdown_connections 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 --2- 172.21.15.192:0/69771159 >> v2:172.21.15.194:3300/0 conn(0x7ff28c0b3f10 0x7ff28c0b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 --2- 172.21.15.192:0/69771159 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15dee0 0x7ff28c0afd80 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 -- 172.21.15.192:0/69771159 >> 172.21.15.192:0/69771159 conn(0x7ff28c0ae960 msgr2=0x7ff28c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 -- 172.21.15.192:0/69771159 shutdown_connections 2024-09-13T18:45:38.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.430+0000 7ff291e00640 1 -- 172.21.15.192:0/69771159 wait complete. 2024-09-13T18:45:38.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.431+0000 7ff291e00640 1 Processor -- start 2024-09-13T18:45:38.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.431+0000 7ff291e00640 1 -- start start 2024-09-13T18:45:38.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 0x7ff28c136e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 0x7ff28c138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c137430 con 0x7ff28c15c9f0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c1376d0 con 0x7ff28c15e2c0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.432+0000 7ff291e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c150c10 con 0x7ff28c15dee0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33448/0 (socket says 172.21.15.192:33448) 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 -- 172.21.15.192:0/1116826083 learned_addr learned my addr 172.21.15.192:0/1116826083 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28a000640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 0x7ff28c138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28aa00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 0x7ff28c136e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 -- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 msgr2=0x7ff28c136e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 0x7ff28c136e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 -- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 msgr2=0x7ff28c138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 0x7ff28c138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff27c0094d0 con 0x7ff28c15c9f0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28aa00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 0x7ff28c136e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28a000640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 0x7ff28c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff28b400640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c6e0 tx=0x7ff28400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.433+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284003b70 con 0x7ff28c15c9f0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.434+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff284003cf0 con 0x7ff28c15c9f0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.434+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284005310 con 0x7ff28c15c9f0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.434+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c139240 con 0x7ff28c15c9f0 2024-09-13T18:45:38.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.434+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c166390 con 0x7ff28c15c9f0 2024-09-13T18:45:38.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.435+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c137880 con 0x7ff28c15c9f0 2024-09-13T18:45:38.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.436+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff284005470 con 0x7ff28c15c9f0 2024-09-13T18:45:38.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.436+0000 7ff283400640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 0x7ff26c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.436+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff284089180 con 0x7ff28c15c9f0 2024-09-13T18:45:38.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.437+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7ff26c072730 con 0x7ff28c15c9f0 2024-09-13T18:45:38.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.437+0000 7ff28aa00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 0x7ff26c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.437+0000 7ff28aa00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 0x7ff26c06d0c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff27c034000 tx=0x7ff27c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.441+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff284003e60 con 0x7ff28c15c9f0 2024-09-13T18:45:38.610 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:38.614 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:45:38.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.645+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff28c15a440 con 0x7ff28c15c9f0 2024-09-13T18:45:38.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.645+0000 7ff283400640 1 -- 172.21.15.192:0/1116826083 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7ff284003e60 con 0x7ff28c15c9f0 2024-09-13T18:45:38.647 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:38.647 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:45:38.647 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:45:38.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 msgr2=0x7ff26c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 0x7ff26c06d0c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff27c034000 tx=0x7ff27c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:38.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 msgr2=0x7ff28c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7ff28400c6e0 tx=0x7ff28400cba0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 shutdown_connections 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff26c06ac00 0x7ff26c06d0c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff28c15c9f0 0x7ff28c0ad840 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff28c15e2c0 0x7ff28c138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 --2- 172.21.15.192:0/1116826083 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff28c15dee0 0x7ff28c136e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.647+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 >> 172.21.15.192:0/1116826083 conn(0x7ff28c0ae960 msgr2=0x7ff28c071530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.648+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 shutdown_connections 2024-09-13T18:45:38.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.648+0000 7ff291e00640 1 -- 172.21.15.192:0/1116826083 wait complete. 2024-09-13T18:45:38.665 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:38.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.889+0000 7f4376000640 1 Processor -- start 2024-09-13T18:45:38.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.889+0000 7f4376000640 1 -- start start 2024-09-13T18:45:38.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.890+0000 7f4376000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4370071810 0x7f43700b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.890+0000 7f4376000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4370071dd0 con 0x7f43700b2230 2024-09-13T18:45:38.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.890+0000 7f4376000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43700cb770 con 0x7f4370150480 2024-09-13T18:45:38.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.890+0000 7f4376000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43700cba50 con 0x7f4370071810 2024-09-13T18:45:38.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4370071810 0x7f43700b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f4370071810 0x7f43700b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33456/0 (socket says 172.21.15.192:33456) 2024-09-13T18:45:38.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f43700b2230 0x7f43700cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48024/0 (socket says 172.21.15.192:48024) 2024-09-13T18:45:38.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 -- 172.21.15.192:0/3195449497 learned_addr learned my addr 172.21.15.192:0/3195449497 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:38.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 -- 172.21.15.192:0/3195449497 >> v1:172.21.15.194:6789/0 conn(0x7f4370150480 legacy=0x7f437015a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 -- 172.21.15.192:0/3195449497 >> v1:172.21.15.192:6789/0 conn(0x7f43700b2230 legacy=0x7f43700cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.891+0000 7f436ea00640 1 -- 172.21.15.192:0/3195449497 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43700cbd30 con 0x7f4370071810 2024-09-13T18:45:38.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.892+0000 7f436ea00640 1 --2- 172.21.15.192:0/3195449497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370071810 0x7f43700b1cf0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f435c00aa10 tx=0x7f435c02b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd80ad2e1ffdb8e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.892+0000 7f436e000640 1 -- 172.21.15.192:0/3195449497 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c030710 con 0x7f4370071810 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.892+0000 7f436e000640 1 -- 172.21.15.192:0/3195449497 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c02e050 con 0x7f4370071810 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.892+0000 7f436e000640 1 -- 172.21.15.192:0/3195449497 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c030a90 con 0x7f4370071810 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 -- 172.21.15.192:0/3195449497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370071810 msgr2=0x7f43700b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 --2- 172.21.15.192:0/3195449497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370071810 0x7f43700b1cf0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f435c00aa10 tx=0x7f435c02b630 comp rx=0 tx=0).stop 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 -- 172.21.15.192:0/3195449497 shutdown_connections 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 --2- 172.21.15.192:0/3195449497 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370071810 0x7f43700b1cf0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 -- 172.21.15.192:0/3195449497 >> 172.21.15.192:0/3195449497 conn(0x7f43700ae960 msgr2=0x7f437006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:38.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 -- 172.21.15.192:0/3195449497 shutdown_connections 2024-09-13T18:45:38.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.893+0000 7f4376000640 1 -- 172.21.15.192:0/3195449497 wait complete. 2024-09-13T18:45:38.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.895+0000 7f4376000640 1 Processor -- start 2024-09-13T18:45:38.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.895+0000 7f4376000640 1 -- start start 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4370071810 0x7f437014df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 0x7f4370155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43701548d0 con 0x7f4370150480 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f437014e4c0 con 0x7f43700b2230 2024-09-13T18:45:38.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f4376000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43701566a0 con 0x7f4370071810 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33458/0 (socket says 172.21.15.192:33458) 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 0x7f4370155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436fe00640 1 -- 172.21.15.192:0/392106133 learned_addr learned my addr 172.21.15.192:0/392106133 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436f400640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4370071810 0x7f437014df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 -- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4370071810 msgr2=0x7f437014df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4370071810 0x7f437014df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 -- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 msgr2=0x7f4370155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436ea00640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c00a670 con 0x7f43700b2230 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.896+0000 7f436fe00640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:38.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f436ea00640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 0x7f4370155870 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f435c032000 tx=0x7f435c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c032c40 con 0x7f43700b2230 2024-09-13T18:45:38.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c032da0 con 0x7f43700b2230 2024-09-13T18:45:38.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c03b670 con 0x7f43700b2230 2024-09-13T18:45:38.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43701563c0 con 0x7f43700b2230 2024-09-13T18:45:38.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.897+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43701544f0 con 0x7f43700b2230 2024-09-13T18:45:38.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.898+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4370154070 con 0x7f43700b2230 2024-09-13T18:45:38.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.899+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f435c03b7d0 con 0x7f43700b2230 2024-09-13T18:45:38.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.900+0000 7f4367400640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 0x7f435006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:38.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.900+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f435c0aa1f0 con 0x7f43700b2230 2024-09-13T18:45:38.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.900+0000 7f436f400640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 0x7f435006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:38.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.900+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f4350072730 con 0x7f43700b2230 2024-09-13T18:45:38.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.901+0000 7f436f400640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 0x7f435006d0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f437006ee10 tx=0x7f4360009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:38.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:38.905+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4370154070 con 0x7f43700b2230 2024-09-13T18:45:39.075 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.074+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4370154a10 con 0x7f43700b2230 2024-09-13T18:45:39.077 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.075+0000 7f4367400640 1 -- 172.21.15.192:0/392106133 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16614 (secure 0 0 0) 0x7f4370154a10 con 0x7f43700b2230 2024-09-13T18:45:39.078 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:39.078 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":167,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:44:56.855955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 msgr2=0x7f435006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 0x7f435006d0c0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f437006ee10 tx=0x7f4360009040 comp rx=0 tx=0).stop 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 msgr2=0x7f4370155870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 0x7f4370155870 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f435c032000 tx=0x7f435c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 shutdown_connections 2024-09-13T18:45:39.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f435006ac00 0x7f435006d0c0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4370150480 0x7f4370155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43700b2230 0x7f4370155870 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 --2- 172.21.15.192:0/392106133 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4370071810 0x7f437014df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 >> 172.21.15.192:0/392106133 conn(0x7f43700ae960 msgr2=0x7f437015ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 shutdown_connections 2024-09-13T18:45:39.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.078+0000 7f4376000640 1 -- 172.21.15.192:0/392106133 wait complete. 2024-09-13T18:45:39.096 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:43:16.500180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '164', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:43:17.638056+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '167', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:39.097 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:39.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.250+0000 7f1d90e00640 1 Processor -- start 2024-09-13T18:45:39.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.251+0000 7f1d90e00640 1 -- start start 2024-09-13T18:45:39.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d90e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 0x7f1d8c0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d90e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c15af60 con 0x7f1d8c15a5f0 2024-09-13T18:45:39.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d90e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c06b7a0 con 0x7f1d8c06bc30 2024-09-13T18:45:39.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d90e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c15aaa0 con 0x7f1d8c159b00 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d8be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1d8c15a5f0 0x7f1d8c0cb640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48030/0 (socket says 172.21.15.192:48030) 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d8be00640 1 -- 172.21.15.192:0/3987135090 learned_addr learned my addr 172.21.15.192:0/3987135090 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d8b400640 1 --2- 172.21.15.192:0/3987135090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 0x7f1d8c0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780858761 0 0) 0x7f1d8c15af60 con 0x7f1d8c15a5f0 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.252+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d70003520 con 0x7f1d8c15a5f0 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.253+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415121367 0 0) 0x7f1d8c06b7a0 con 0x7f1d8c06bc30 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.253+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d8c15af60 con 0x7f1d8c06bc30 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.253+0000 7f1d8b400640 1 -- 172.21.15.192:0/3987135090 >> v1:172.21.15.194:6789/0 conn(0x7f1d8c06bc30 legacy=0x7f1d8c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.253+0000 7f1d8b400640 1 -- 172.21.15.192:0/3987135090 >> v1:172.21.15.192:6789/0 conn(0x7f1d8c15a5f0 legacy=0x7f1d8c0cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.253+0000 7f1d8b400640 1 -- 172.21.15.192:0/3987135090 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c15ac80 con 0x7f1d8c159b00 2024-09-13T18:45:39.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d8b400640 1 --2- 172.21.15.192:0/3987135090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 0x7f1d8c0b2d70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0097d0 tx=0x7f1d7c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=946682efdaa50d24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c032440 con 0x7f1d8c159b00 2024-09-13T18:45:39.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c0325a0 con 0x7f1d8c159b00 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d8a000640 1 -- 172.21.15.192:0/3987135090 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c032930 con 0x7f1d8c159b00 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d90e00640 1 -- 172.21.15.192:0/3987135090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 msgr2=0x7f1d8c0b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.254+0000 7f1d90e00640 1 --2- 172.21.15.192:0/3987135090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 0x7f1d8c0b2d70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c0097d0 tx=0x7f1d7c02a210 comp rx=0 tx=0).stop 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.255+0000 7f1d90e00640 1 -- 172.21.15.192:0/3987135090 shutdown_connections 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.255+0000 7f1d90e00640 1 --2- 172.21.15.192:0/3987135090 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c159b00 0x7f1d8c0b2d70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.255+0000 7f1d90e00640 1 -- 172.21.15.192:0/3987135090 >> 172.21.15.192:0/3987135090 conn(0x7f1d8c0736d0 msgr2=0x7f1d8c0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.255+0000 7f1d90e00640 1 -- 172.21.15.192:0/3987135090 shutdown_connections 2024-09-13T18:45:39.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.255+0000 7f1d90e00640 1 -- 172.21.15.192:0/3987135090 wait complete. 2024-09-13T18:45:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.256+0000 7f1d90e00640 1 Processor -- start 2024-09-13T18:45:39.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.256+0000 7f1d90e00640 1 -- start start 2024-09-13T18:45:39.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d8c06bc30 0x7f1d8c13cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c15a5f0 0x7f1d8c0adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c1680e0 con 0x7f1d8c159b00 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c168630 con 0x7f1d8c06bc30 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.257+0000 7f1d90e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c145190 con 0x7f1d8c15a5f0 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33468/0 (socket says 172.21.15.192:33468) 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 -- 172.21.15.192:0/1580759061 learned_addr learned my addr 172.21.15.192:0/1580759061 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8b400640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d8c06bc30 0x7f1d8c13cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8be00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c15a5f0 0x7f1d8c0adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 -- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c15a5f0 msgr2=0x7f1d8c0adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c15a5f0 0x7f1d8c0adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 -- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d8c06bc30 msgr2=0x7f1d8c13cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d8c06bc30 0x7f1d8c13cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d7c009400 con 0x7f1d8c159b00 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d8aa00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c3c0 tx=0x7f1d7800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.258+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d780052d0 con 0x7f1d8c159b00 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.259+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78005450 con 0x7f1d8c159b00 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.259+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78003830 con 0x7f1d8c159b00 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.259+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c145470 con 0x7f1d8c159b00 2024-09-13T18:45:39.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.259+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c1682c0 con 0x7f1d8c159b00 2024-09-13T18:45:39.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.260+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c145990 con 0x7f1d8c159b00 2024-09-13T18:45:39.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.261+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d78003990 con 0x7f1d8c159b00 2024-09-13T18:45:39.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.261+0000 7f1d83400640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 0x7f1d6c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.261+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d780888b0 con 0x7f1d8c159b00 2024-09-13T18:45:39.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.262+0000 7f1d8b400640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 0x7f1d6c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.262+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f1d6c072760 con 0x7f1d8c159b00 2024-09-13T18:45:39.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.262+0000 7f1d8b400640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 0x7f1d6c06d0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c034000 tx=0x7f1d7c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.265+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d78017020 con 0x7f1d8c159b00 2024-09-13T18:45:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.433+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1d8c1687a0 con 0x7f1d8c159b00 2024-09-13T18:45:39.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.433+0000 7f1d83400640 1 -- 172.21.15.192:0/1580759061 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v167) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1d8c145990 con 0x7f1d8c159b00 2024-09-13T18:45:39.435 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:45:39.437 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.435+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 msgr2=0x7f1d6c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 0x7f1d6c06d0f0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c034000 tx=0x7f1d7c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 msgr2=0x7f1d8c141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f1d7800c3c0 tx=0x7f1d7800c880 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 shutdown_connections 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1d6c06ac30 0x7f1d6c06d0f0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d8c15a5f0 0x7f1d8c0adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d8c159b00 0x7f1d8c141490 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 --2- 172.21.15.192:0/1580759061 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d8c06bc30 0x7f1d8c13cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 >> 172.21.15.192:0/1580759061 conn(0x7f1d8c0736d0 msgr2=0x7f1d8c069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 shutdown_connections 2024-09-13T18:45:39.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.436+0000 7f1d90e00640 1 -- 172.21.15.192:0/1580759061 wait complete. 2024-09-13T18:45:39.453 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:45:39.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.605+0000 7fd63b200640 1 Processor -- start 2024-09-13T18:45:39.607 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.605+0000 7fd63b200640 1 -- start start 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd63b200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd63406c800 0x7fd6340b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd63b200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63406cc70 con 0x7fd6341434c0 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd63b200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd63406b480 con 0x7fd6340b3bd0 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd63b200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6340ce770 con 0x7fd63406c800 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd633e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd6341434c0 0x7fd63406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:48036/0 (socket says 172.21.15.192:48036) 2024-09-13T18:45:39.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd633e00640 1 -- 172.21.15.192:0/45534702 learned_addr learned my addr 172.21.15.192:0/45534702 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd633400640 1 --2- 172.21.15.192:0/45534702 >> v2:172.21.15.194:3300/0 conn(0x7fd63406c800 0x7fd6340b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316075151 0 0) 0x7fd63406cc70 con 0x7fd6341434c0 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.607+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd618003520 con 0x7fd6341434c0 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.608+0000 7fd633400640 1 -- 172.21.15.192:0/45534702 >> v1:172.21.15.194:6789/0 conn(0x7fd6340b3bd0 legacy=0x7fd63406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.608+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3637958123 0 0) 0x7fd63406b480 con 0x7fd6340b3bd0 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.608+0000 7fd633400640 1 -- 172.21.15.192:0/45534702 >> v1:172.21.15.192:6789/0 conn(0x7fd6341434c0 legacy=0x7fd63406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.608+0000 7fd633400640 1 -- 172.21.15.192:0/45534702 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd63406b760 con 0x7fd63406c800 2024-09-13T18:45:39.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd633400640 1 --2- 172.21.15.192:0/45534702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63406c800 0x7fd6340b3690 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd6200097d0 tx=0x7fd62002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14107559b8cf5040 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620032440 con 0x7fd63406c800 2024-09-13T18:45:39.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6200325a0 con 0x7fd63406c800 2024-09-13T18:45:39.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd632a00640 1 -- 172.21.15.192:0/45534702 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd620032930 con 0x7fd63406c800 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd63b200640 1 -- 172.21.15.192:0/45534702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63406c800 msgr2=0x7fd6340b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd63b200640 1 --2- 172.21.15.192:0/45534702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63406c800 0x7fd6340b3690 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd6200097d0 tx=0x7fd62002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.609+0000 7fd63b200640 1 -- 172.21.15.192:0/45534702 shutdown_connections 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.610+0000 7fd63b200640 1 --2- 172.21.15.192:0/45534702 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd63406c800 0x7fd6340b3690 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.610+0000 7fd63b200640 1 -- 172.21.15.192:0/45534702 >> 172.21.15.192:0/45534702 conn(0x7fd6340b08f0 msgr2=0x7fd6340b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.610+0000 7fd63b200640 1 -- 172.21.15.192:0/45534702 shutdown_connections 2024-09-13T18:45:39.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.610+0000 7fd63b200640 1 -- 172.21.15.192:0/45534702 wait complete. 2024-09-13T18:45:39.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.611+0000 7fd63b200640 1 Processor -- start 2024-09-13T18:45:39.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.611+0000 7fd63b200640 1 -- start start 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6340b3bd0 0x7fd63414aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 0x7fd6341574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63414ded0 con 0x7fd63406c800 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63413ee60 con 0x7fd6341434c0 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd63b200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd63414afa0 con 0x7fd6340b3bd0 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd633e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd633e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33476/0 (socket says 172.21.15.192:33476) 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.612+0000 7fd633e00640 1 -- 172.21.15.192:0/805986963 learned_addr learned my addr 172.21.15.192:0/805986963 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633400640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6340b3bd0 0x7fd63414aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd639200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 0x7fd6341574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 -- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6340b3bd0 msgr2=0x7fd63414aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6340b3bd0 0x7fd63414aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 -- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 msgr2=0x7fd6341574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 0x7fd6341574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620009400 con 0x7fd63406c800 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd639200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 0x7fd6341574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:39.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd633e00640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c390 tx=0x7fd62400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.613+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd624005ce0 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.614+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd624005e40 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.614+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6240072f0 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.614+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd634155c70 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.614+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63413ddf0 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.615+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63413efd0 con 0x7fd63406c800 2024-09-13T18:45:39.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.616+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd624007450 con 0x7fd63406c800 2024-09-13T18:45:39.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.617+0000 7fd62be00640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 0x7fd61406d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.617+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd624088860 con 0x7fd63406c800 2024-09-13T18:45:39.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.617+0000 7fd633400640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 0x7fd61406d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.617+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fd6140727b0 con 0x7fd63406c800 2024-09-13T18:45:39.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.618+0000 7fd633400640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 0x7fd61406d140 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd620034000 tx=0x7fd62002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.621+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd624017060 con 0x7fd63406c800 2024-09-13T18:45:39.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.789+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd6340cc7d0 con 0x7fd63406c800 2024-09-13T18:45:39.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.790+0000 7fd62be00640 1 -- 172.21.15.192:0/805986963 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v167) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd624053b60 con 0x7fd63406c800 2024-09-13T18:45:39.791 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 msgr2=0x7fd61406d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 0x7fd61406d140 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fd620034000 tx=0x7fd62002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 msgr2=0x7fd63413d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fd62400c390 tx=0x7fd62400c850 comp rx=0 tx=0).stop 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 shutdown_connections 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd61406ac80 0x7fd61406d140 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.794 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd6341434c0 0x7fd6341574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd6340b3bd0 0x7fd63414aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 --2- 172.21.15.192:0/805986963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd63406c800 0x7fd63413d530 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 >> 172.21.15.192:0/805986963 conn(0x7fd6340b08f0 msgr2=0x7fd6340b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 shutdown_connections 2024-09-13T18:45:39.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.792+0000 7fd63b200640 1 -- 172.21.15.192:0/805986963 wait complete. 2024-09-13T18:45:39.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:45:39.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.963+0000 7f659e400640 1 Processor -- start 2024-09-13T18:45:39.965 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.963+0000 7f659e400640 1 -- start start 2024-09-13T18:45:39.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65981402c0 0x7f659815e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659e400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f659815b810 0x7f659815bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659e400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659815b070 con 0x7f65980afbe0 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659e400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659815eba0 con 0x7f659815b810 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659815ee20 con 0x7f65981402c0 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f6597e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f659815b810 0x7f659815bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f659d000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65981402c0 0x7f659815e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f6597e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f659815b810 0x7f659815bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:52898/0 (socket says 172.21.15.192:52898) 2024-09-13T18:45:39.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.965+0000 7f6597e00640 1 -- 172.21.15.192:0/3027759146 learned_addr learned my addr 172.21.15.192:0/3027759146 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:39.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.966+0000 7f6597e00640 1 -- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65981402c0 msgr2=0x7f659815e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:39.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.966+0000 7f6597e00640 1 --2- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65981402c0 0x7f659815e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.966+0000 7f6597e00640 1 -- 172.21.15.192:0/3027759146 >> v1:172.21.15.194:6789/0 conn(0x7f65980afbe0 legacy=0x7f65981406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.966+0000 7f6597e00640 1 -- 172.21.15.192:0/3027759146 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659815f100 con 0x7f659815b810 2024-09-13T18:45:39.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f6597e00640 1 --2- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f659815b810 0x7f659815bc50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6584009870 tx=0x7f658402a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27131cc0933d7c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f6597400640 1 -- 172.21.15.192:0/3027759146 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584032440 con 0x7f659815b810 2024-09-13T18:45:39.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f6597400640 1 -- 172.21.15.192:0/3027759146 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840325a0 con 0x7f659815b810 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f6597400640 1 -- 172.21.15.192:0/3027759146 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6584032930 con 0x7f659815b810 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f659e400640 1 -- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f659815b810 msgr2=0x7f659815bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.967+0000 7f659e400640 1 --2- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f659815b810 0x7f659815bc50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6584009870 tx=0x7f658402a270 comp rx=0 tx=0).stop 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 -- 172.21.15.192:0/3027759146 shutdown_connections 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 --2- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f659815b810 0x7f659815bc50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 --2- 172.21.15.192:0/3027759146 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65981402c0 0x7f659815e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 -- 172.21.15.192:0/3027759146 >> 172.21.15.192:0/3027759146 conn(0x7f65980ae7f0 msgr2=0x7f659806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 -- 172.21.15.192:0/3027759146 shutdown_connections 2024-09-13T18:45:39.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.968+0000 7f659e400640 1 -- 172.21.15.192:0/3027759146 wait complete. 2024-09-13T18:45:39.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.969+0000 7f659e400640 1 Processor -- start 2024-09-13T18:45:39.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.969+0000 7f659e400640 1 -- start start 2024-09-13T18:45:39.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 0x7f659813d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 0x7f65980cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659813d740 con 0x7f659815b810 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65980cd5c0 con 0x7f65981402c0 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659e400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65980cd2e0 con 0x7f65980afbe0 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.970+0000 7f659da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33490/0 (socket says 172.21.15.192:33490) 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 -- 172.21.15.192:0/4193184076 learned_addr learned my addr 172.21.15.192:0/4193184076 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659d000640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 0x7f659813d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f6597e00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 0x7f65980cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 -- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 msgr2=0x7f659813d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 0x7f659813d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 -- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 msgr2=0x7f65980cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 0x7f65980cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:39.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840094d0 con 0x7f659815b810 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659d000640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 0x7f659813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f6597e00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 0x7f65980cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.971+0000 7f659da00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f659000c6b0 tx=0x7f659000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.972+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590003b70 con 0x7f659815b810 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.972+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6590003cf0 con 0x7f659815b810 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.972+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6598152230 con 0x7f659815b810 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.972+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6590003ea0 con 0x7f659815b810 2024-09-13T18:45:39.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.972+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65981527f0 con 0x7f659815b810 2024-09-13T18:45:39.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.973+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659815e660 con 0x7f659815b810 2024-09-13T18:45:39.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.974+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6590005310 con 0x7f659815b810 2024-09-13T18:45:39.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.974+0000 7f6594c00640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:39.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.975+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6590089130 con 0x7f659815b810 2024-09-13T18:45:39.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.975+0000 7f659d000640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:39.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.975+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f6578072720 con 0x7f659815b810 2024-09-13T18:45:39.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.975+0000 7f659d000640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 0x7f657806d0c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6598071fc0 tx=0x7f6588008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:39.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:39.978+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6590054300 con 0x7f659815b810 2024-09-13T18:45:40.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.146+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6598071950 con 0x7f659815b810 2024-09-13T18:45:40.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.146+0000 7f6594c00640 1 -- 172.21.15.192:0/4193184076 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v167) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6590057920 con 0x7f659815b810 2024-09-13T18:45:40.148 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:45:40.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.148+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 msgr2=0x7f657806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.148+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 0x7f657806d0c0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f6598071fc0 tx=0x7f6588008040 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.148+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 msgr2=0x7f6598152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.148+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f659000c6b0 tx=0x7f659000cb70 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 shutdown_connections 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f657806ac00 0x7f657806d0c0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f659815b810 0x7f6598152d10 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65981402c0 0x7f65980cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 --2- 172.21.15.192:0/4193184076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65980afbe0 0x7f659813d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 >> 172.21.15.192:0/4193184076 conn(0x7f65980ae7f0 msgr2=0x7f659806e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 shutdown_connections 2024-09-13T18:45:40.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.149+0000 7f659e400640 1 -- 172.21.15.192:0/4193184076 wait complete. 2024-09-13T18:45:40.166 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:40.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.314+0000 7fbdbbe00640 1 Processor -- start 2024-09-13T18:45:40.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.314+0000 7fbdbbe00640 1 -- start start 2024-09-13T18:45:40.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdbbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0b3480 0x7fbdbc159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdbbe00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc15af60 con 0x7fbdbc159b00 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdbbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdbc06b7a0 con 0x7fbdbc06bc30 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdbbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdbc15ac80 con 0x7fbdbc0b3480 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0b3480 0x7fbdbc159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbdbc0b3480 0x7fbdbc159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33502/0 (socket says 172.21.15.192:33502) 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 -- 172.21.15.192:0/591536331 learned_addr learned my addr 172.21.15.192:0/591536331 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 -- 172.21.15.192:0/591536331 >> v1:172.21.15.194:6789/0 conn(0x7fbdbc06bc30 legacy=0x7fbdbc15a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 -- 172.21.15.192:0/591536331 >> v1:172.21.15.192:6789/0 conn(0x7fbdbc159b00 legacy=0x7fbdbc0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.316+0000 7fbdba000640 1 -- 172.21.15.192:0/591536331 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdbc06b150 con 0x7fbdbc0b3480 2024-09-13T18:45:40.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.317+0000 7fbdba000640 1 --2- 172.21.15.192:0/591536331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc159ee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009870 tx=0x7fbda802c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1de72f71f2453a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.317+0000 7fbdb9600640 1 -- 172.21.15.192:0/591536331 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8031710 con 0x7fbdbc0b3480 2024-09-13T18:45:40.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdb9600640 1 -- 172.21.15.192:0/591536331 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda802f050 con 0x7fbdbc0b3480 2024-09-13T18:45:40.319 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdb9600640 1 -- 172.21.15.192:0/591536331 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8031a90 con 0x7fbdbc0b3480 2024-09-13T18:45:40.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 -- 172.21.15.192:0/591536331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 msgr2=0x7fbdbc159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/591536331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc159ee0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fbda8009870 tx=0x7fbda802c490 comp rx=0 tx=0).stop 2024-09-13T18:45:40.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 -- 172.21.15.192:0/591536331 shutdown_connections 2024-09-13T18:45:40.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/591536331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc159ee0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 -- 172.21.15.192:0/591536331 >> 172.21.15.192:0/591536331 conn(0x7fbdbc0736d0 msgr2=0x7fbdbc0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 -- 172.21.15.192:0/591536331 shutdown_connections 2024-09-13T18:45:40.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.318+0000 7fbdbbe00640 1 -- 172.21.15.192:0/591536331 wait complete. 2024-09-13T18:45:40.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.320+0000 7fbdbbe00640 1 Processor -- start 2024-09-13T18:45:40.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.320+0000 7fbdbbe00640 1 -- start start 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc06bc30 0x7fbdbc1eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 0x7fbdbc070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc06fae0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0ae690 con 0x7fbdbc159b00 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdbc0714e0 con 0x7fbdbc06bc30 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33518/0 (socket says 172.21.15.192:33518) 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 -- 172.21.15.192:0/1521506887 learned_addr learned my addr 172.21.15.192:0/1521506887 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:40.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbb400640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 0x7fbdbc070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc06bc30 0x7fbdbc1eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 -- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc06bc30 msgr2=0x7fbdbc1eed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc06bc30 0x7fbdbc1eed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 -- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 msgr2=0x7fbdbc070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 0x7fbdbc070e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdba000640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda80094d0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.321+0000 7fbdbb400640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 0x7fbdbc070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdba000640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fbda8000c00 tx=0x7fbda80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8033890 con 0x7fbdbc0b3480 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda8033a10 con 0x7fbdbc0b3480 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda8033dc0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdbc0ae8e0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.325 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.322+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdbc0aeea0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.323+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdbc0af090 con 0x7fbdbc0b3480 2024-09-13T18:45:40.326 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.324+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbda803a070 con 0x7fbdbc0b3480 2024-09-13T18:45:40.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.325+0000 7fbdb2a00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.325+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda80aa4b0 con 0x7fbdbc0b3480 2024-09-13T18:45:40.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.325+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.326+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fbd9c072730 con 0x7fbdbc0b3480 2024-09-13T18:45:40.327 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.326+0000 7fbdbaa00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000f60 tx=0x7fbdac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.329+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbda8075720 con 0x7fbdbc0b3480 2024-09-13T18:45:40.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.530+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbdbc0b2d70 con 0x7fbdbc0b3480 2024-09-13T18:45:40.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.530+0000 7fbdb2a00640 1 -- 172.21.15.192:0/1521506887 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fbda8038070 con 0x7fbdbc0b3480 2024-09-13T18:45:40.532 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:40.532 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:45:40.533 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 msgr2=0x7fbd9c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fbdac000f60 tx=0x7fbdac009040 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 msgr2=0x7fbdbc0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fbda8000c00 tx=0x7fbda80046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 shutdown_connections 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd9c06ac00 0x7fbd9c06d0c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbdbc159b00 0x7fbdbc070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbdbc0b3480 0x7fbdbc0708d0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 --2- 172.21.15.192:0/1521506887 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbdbc06bc30 0x7fbdbc1eed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 >> 172.21.15.192:0/1521506887 conn(0x7fbdbc0736d0 msgr2=0x7fbdbc15c5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 shutdown_connections 2024-09-13T18:45:40.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.533+0000 7fbdbbe00640 1 -- 172.21.15.192:0/1521506887 wait complete. 2024-09-13T18:45:40.550 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:40.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.701+0000 7fda38c00640 1 Processor -- start 2024-09-13T18:45:40.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.701+0000 7fda38c00640 1 -- start start 2024-09-13T18:45:40.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.702+0000 7fda38c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda34150480 0x7fda3415a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda38c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda34071dd0 con 0x7fda34071810 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda38c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340cb770 con 0x7fda340cc530 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda38c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340cba50 con 0x7fda34150480 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda34150480 0x7fda3415a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fda34150480 0x7fda3415a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59660/0 (socket says 172.21.15.192:59660) 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 -- 172.21.15.192:0/1084069358 learned_addr learned my addr 172.21.15.192:0/1084069358 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:40.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31400640 1 --1- 172.21.15.192:0/1084069358 >> v1:172.21.15.192:6789/0 conn(0x7fda34071810 0x7fda340b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46526/0 (socket says 172.21.15.192:46526) 2024-09-13T18:45:40.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 -- 172.21.15.192:0/1084069358 >> v1:172.21.15.194:6789/0 conn(0x7fda340cc530 legacy=0x7fda340cd0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 -- 172.21.15.192:0/1084069358 >> v1:172.21.15.192:6789/0 conn(0x7fda34071810 legacy=0x7fda340b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.703+0000 7fda31e00640 1 -- 172.21.15.192:0/1084069358 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340cbd30 con 0x7fda34150480 2024-09-13T18:45:40.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.704+0000 7fda31e00640 1 --2- 172.21.15.192:0/1084069358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34150480 0x7fda3415a3e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fda2400bb00 tx=0x7fda2402c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19808be826fbc1b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda30a00640 1 -- 172.21.15.192:0/1084069358 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24032480 con 0x7fda34150480 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda30a00640 1 -- 172.21.15.192:0/1084069358 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2402f030 con 0x7fda34150480 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda30a00640 1 -- 172.21.15.192:0/1084069358 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24032800 con 0x7fda34150480 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 -- 172.21.15.192:0/1084069358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34150480 msgr2=0x7fda3415a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 --2- 172.21.15.192:0/1084069358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34150480 0x7fda3415a3e0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fda2400bb00 tx=0x7fda2402c700 comp rx=0 tx=0).stop 2024-09-13T18:45:40.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 -- 172.21.15.192:0/1084069358 shutdown_connections 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 --2- 172.21.15.192:0/1084069358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34150480 0x7fda3415a3e0 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 -- 172.21.15.192:0/1084069358 >> 172.21.15.192:0/1084069358 conn(0x7fda340ae960 msgr2=0x7fda3406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 -- 172.21.15.192:0/1084069358 shutdown_connections 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.705+0000 7fda38c00640 1 -- 172.21.15.192:0/1084069358 wait complete. 2024-09-13T18:45:40.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.707+0000 7fda38c00640 1 Processor -- start 2024-09-13T18:45:40.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.707+0000 7fda38c00640 1 -- start start 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 0x7fda34155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda34150480 0x7fda341f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3406a210 con 0x7fda34071810 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34156370 con 0x7fda340cc530 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda38c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda34156650 con 0x7fda34150480 2024-09-13T18:45:40.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda31e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda31e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59664/0 (socket says 172.21.15.192:59664) 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.708+0000 7fda31e00640 1 -- 172.21.15.192:0/2098734910 learned_addr learned my addr 172.21.15.192:0/2098734910 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 -- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda34150480 msgr2=0x7fda341f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda34150480 0x7fda341f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 -- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 msgr2=0x7fda34155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31400640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 0x7fda34155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 0x7fda34155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2400b760 con 0x7fda34071810 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31400640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 0x7fda34155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda31e00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fda24038040 tx=0x7fda240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24043070 con 0x7fda34071810 2024-09-13T18:45:40.712 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda24032070 con 0x7fda34071810 2024-09-13T18:45:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda34156930 con 0x7fda34071810 2024-09-13T18:45:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24035860 con 0x7fda34071810 2024-09-13T18:45:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.709+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34155fb0 con 0x7fda34071810 2024-09-13T18:45:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.711+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda34156b20 con 0x7fda34071810 2024-09-13T18:45:40.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.711+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fda240359c0 con 0x7fda34071810 2024-09-13T18:45:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.712+0000 7fda2a000640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.712+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda240a9e60 con 0x7fda34071810 2024-09-13T18:45:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.712+0000 7fda31400640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.712+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fda14072730 con 0x7fda34071810 2024-09-13T18:45:40.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.713+0000 7fda31400640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 0x7fda1406d0c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fda3406ba70 tx=0x7fda20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:40.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.716+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fda24075160 con 0x7fda34071810 2024-09-13T18:45:40.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.884+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda3415a3e0 con 0x7fda34071810 2024-09-13T18:45:40.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.885+0000 7fda2a000640 1 -- 172.21.15.192:0/2098734910 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+16614 (secure 0 0 0) 0x7fda2403a020 con 0x7fda34071810 2024-09-13T18:45:40.887 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:40.887 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":167,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:44:56.855955+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:40.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 msgr2=0x7fda1406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 0x7fda1406d0c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fda3406ba70 tx=0x7fda20009040 comp rx=0 tx=0).stop 2024-09-13T18:45:40.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 msgr2=0x7fda3414f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:40.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7fda24038040 tx=0x7fda240046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 shutdown_connections 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fda1406ac00 0x7fda1406d0c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fda34150480 0x7fda341f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fda340cc530 0x7fda34155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 --2- 172.21.15.192:0/2098734910 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda34071810 0x7fda3414f8e0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 >> 172.21.15.192:0/2098734910 conn(0x7fda340ae960 msgr2=0x7fda340ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 shutdown_connections 2024-09-13T18:45:40.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:40.887+0000 7fda38c00640 1 -- 172.21.15.192:0/2098734910 wait complete. 2024-09-13T18:45:40.904 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:45:40.905 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.057+0000 7fba8f000640 1 Processor -- start 2024-09-13T18:45:41.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.057+0000 7fba8f000640 1 -- start start 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba8f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fba880b0490 0x7fba880cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba8f000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8815ec00 con 0x7fba8815e790 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba8f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba88140480 con 0x7fba880cacd0 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba8f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880cb5f0 con 0x7fba880b0490 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba87400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fba8815e790 0x7fba880afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46538/0 (socket says 172.21.15.192:46538) 2024-09-13T18:45:41.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.058+0000 7fba87400640 1 -- 172.21.15.192:0/1144662324 learned_addr learned my addr 172.21.15.192:0/1144662324 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba8d000640 1 --2- 172.21.15.192:0/1144662324 >> v2:172.21.15.194:3300/0 conn(0x7fba880b0490 0x7fba880cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba86a00640 1 -- 172.21.15.192:0/1144662324 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2795148765 0 0) 0x7fba8815ec00 con 0x7fba8815e790 2024-09-13T18:45:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba86a00640 1 -- 172.21.15.192:0/1144662324 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba6c003520 con 0x7fba8815e790 2024-09-13T18:45:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba8d000640 1 -- 172.21.15.192:0/1144662324 >> v1:172.21.15.194:6789/0 conn(0x7fba880cacd0 legacy=0x7fba88140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba8d000640 1 -- 172.21.15.192:0/1144662324 >> v1:172.21.15.192:6789/0 conn(0x7fba8815e790 legacy=0x7fba880afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.059+0000 7fba8d000640 1 -- 172.21.15.192:0/1144662324 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8815ee90 con 0x7fba880b0490 2024-09-13T18:45:41.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.060+0000 7fba8d000640 1 --2- 172.21.15.192:0/1144662324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba880cb0b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fba80009d90 tx=0x7fba8002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=156e3cf21b0dcb96 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.060+0000 7fba86a00640 1 -- 172.21.15.192:0/1144662324 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80007740 con 0x7fba880b0490 2024-09-13T18:45:41.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.060+0000 7fba86a00640 1 -- 172.21.15.192:0/1144662324 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8002d050 con 0x7fba880b0490 2024-09-13T18:45:41.062 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.060+0000 7fba86a00640 1 -- 172.21.15.192:0/1144662324 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba80007ac0 con 0x7fba880b0490 2024-09-13T18:45:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 -- 172.21.15.192:0/1144662324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 msgr2=0x7fba880cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 --2- 172.21.15.192:0/1144662324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba880cb0b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fba80009d90 tx=0x7fba8002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 -- 172.21.15.192:0/1144662324 shutdown_connections 2024-09-13T18:45:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 --2- 172.21.15.192:0/1144662324 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba880cb0b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.063 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 -- 172.21.15.192:0/1144662324 >> 172.21.15.192:0/1144662324 conn(0x7fba880ae960 msgr2=0x7fba8806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 -- 172.21.15.192:0/1144662324 shutdown_connections 2024-09-13T18:45:41.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.061+0000 7fba8f000640 1 -- 172.21.15.192:0/1144662324 wait complete. 2024-09-13T18:45:41.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.063+0000 7fba8f000640 1 Processor -- start 2024-09-13T18:45:41.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.063+0000 7fba8f000640 1 -- start start 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba8806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 0x7fba88159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88158800 con 0x7fba880cacd0 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8813d600 con 0x7fba880b0490 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8806ae90 con 0x7fba8815e790 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59672/0 (socket says 172.21.15.192:59672) 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 -- 172.21.15.192:0/3333025637 learned_addr learned my addr 172.21.15.192:0/3333025637 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:41.067 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87e00640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba8806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8d000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 0x7fba88159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 -- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 msgr2=0x7fba88159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 0x7fba88159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 -- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 msgr2=0x7fba8806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba8806a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba87400640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba80009a70 con 0x7fba880cacd0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.064+0000 7fba8d000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 0x7fba88159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba87400640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c500 tx=0x7fba7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74005ce0 con 0x7fba880cacd0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74005e40 con 0x7fba880cacd0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8806b170 con 0x7fba880cacd0 2024-09-13T18:45:41.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba74007330 con 0x7fba880cacd0 2024-09-13T18:45:41.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.065+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8806b730 con 0x7fba880cacd0 2024-09-13T18:45:41.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.066+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8806bc50 con 0x7fba880cacd0 2024-09-13T18:45:41.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.067+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba74007550 con 0x7fba880cacd0 2024-09-13T18:45:41.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.068+0000 7fba7fe00640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 0x7fba6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.068+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba74088990 con 0x7fba880cacd0 2024-09-13T18:45:41.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.068+0000 7fba87e00640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 0x7fba6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.068+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7fba68072730 con 0x7fba880cacd0 2024-09-13T18:45:41.070 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.069+0000 7fba87e00640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 0x7fba6806d0c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fba78000f60 tx=0x7fba78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.072+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fba74017020 con 0x7fba880cacd0 2024-09-13T18:45:41.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.273+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8806fcf0 con 0x7fba880cacd0 2024-09-13T18:45:41.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.273+0000 7fba7fe00640 1 -- 172.21.15.192:0/3333025637 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7fba74053cd0 con 0x7fba880cacd0 2024-09-13T18:45:41.276 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:41.276 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:45:41.276 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 msgr2=0x7fba6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 0x7fba6806d0c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fba78000f60 tx=0x7fba78009040 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 msgr2=0x7fba8813d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fba7400c500 tx=0x7fba7400c9c0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 shutdown_connections 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba6806ac00 0x7fba6806d0c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba8815e790 0x7fba88159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba880cacd0 0x7fba8813d0c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 --2- 172.21.15.192:0/3333025637 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba880b0490 0x7fba8806a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 >> 172.21.15.192:0/3333025637 conn(0x7fba880ae960 msgr2=0x7fba880ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 shutdown_connections 2024-09-13T18:45:41.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.276+0000 7fba8f000640 1 -- 172.21.15.192:0/3333025637 wait complete. 2024-09-13T18:45:41.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:41.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.448+0000 7f6ae4000640 1 Processor -- start 2024-09-13T18:45:41.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.448+0000 7f6ae4000640 1 -- start start 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.449+0000 7f6ae4000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6adc0cacd0 0x7f6adc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.449+0000 7f6ae4000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc140480 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.449+0000 7f6ae4000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc0cb520 con 0x7f6adc15bc20 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.449+0000 7f6ae4000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc15ee90 con 0x7f6adc0cacd0 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6ae0c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6adc0cb0b0 0x7f6adc140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46548/0 (socket says 172.21.15.192:46548) 2024-09-13T18:45:41.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6ae0c00640 1 -- 172.21.15.192:0/4053687524 learned_addr learned my addr 172.21.15.192:0/4053687524 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6ae1600640 1 --2- 172.21.15.192:0/4053687524 >> v2:172.21.15.194:3300/0 conn(0x7f6adc0cacd0 0x7f6adc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225697452 0 0) 0x7f6adc140480 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac4003520 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 227693416 0 0) 0x7f6ac4003520 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 >> v2:172.21.15.194:3300/0 conn(0x7f6adc0cacd0 msgr2=0x7f6adc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 --2- 172.21.15.192:0/4053687524 >> v2:172.21.15.194:3300/0 conn(0x7f6adc0cacd0 0x7f6adc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 >> v1:172.21.15.194:6789/0 conn(0x7f6adc15bc20 legacy=0x7f6adc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc15f170 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6ae1600640 1 --2- 172.21.15.192:0/4053687524 >> v2:172.21.15.194:3300/0 conn(0x7f6adc0cacd0 0x7f6adc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f6ac8001670 con 0x7f6adc0cb0b0 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 >> v1:172.21.15.192:6789/0 conn(0x7f6adc0cb0b0 legacy=0x7f6adc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ac4003970 0x7f6ac4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.450+0000 7f6adbe00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 0x7f6ac4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6adbe00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac4005180 0x7f6ac400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc15ee90 con 0x7f6ac40047c0 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c020 con 0x7f6ac4005180 2024-09-13T18:45:41.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac400c1e0 con 0x7f6ac4003970 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 0x7f6ac4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae1600640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ac4003970 0x7f6ac4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae2000640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac4005180 0x7f6ac400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 -- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ac4003970 msgr2=0x7f6ac4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ac4003970 0x7f6ac4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 -- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac4005180 msgr2=0x7f6ac400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac4005180 0x7f6ac400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae0c00640 1 -- 172.21.15.192:0/4053687524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4003520 con 0x7f6ac40047c0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae2000640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac4005180 0x7f6ac400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.451+0000 7f6ae2000640 1 -- 172.21.15.192:0/4053687524 reap_dead start 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.452+0000 7f6ae0c00640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 0x7f6ac4004c40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c240 tx=0x7f6ac40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da071cd8a9f6ab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.452+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac802e070 con 0x7f6ac40047c0 2024-09-13T18:45:41.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.452+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac80058d0 con 0x7f6ac40047c0 2024-09-13T18:45:41.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.452+0000 7f6adbe00640 1 -- 172.21.15.192:0/4053687524 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8005d00 con 0x7f6ac40047c0 2024-09-13T18:45:41.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 -- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 msgr2=0x7f6ac4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 0x7f6ac4004c40 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f6ac800c240 tx=0x7f6ac40057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 -- 172.21.15.192:0/4053687524 shutdown_connections 2024-09-13T18:45:41.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 --2- 172.21.15.192:0/4053687524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ac40047c0 0x7f6ac4004c40 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 -- 172.21.15.192:0/4053687524 >> 172.21.15.192:0/4053687524 conn(0x7f6adc0ae960 msgr2=0x7f6adc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 -- 172.21.15.192:0/4053687524 shutdown_connections 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.453+0000 7f6ae4000640 1 -- 172.21.15.192:0/4053687524 wait complete. 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.455+0000 7f6ae4000640 1 Processor -- start 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.455+0000 7f6ae4000640 1 -- start start 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 0x7f6adc0b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6adc0b4640 0x7f6adc13d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ad6c0 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0b42e0 con 0x7f6ac40047c0 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae4000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc0ab630 con 0x7f6adc0b4640 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59702/0 (socket says 172.21.15.192:59702) 2024-09-13T18:45:41.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae2000640 1 -- 172.21.15.192:0/3398913900 learned_addr learned my addr 172.21.15.192:0/3398913900 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae1600640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 0x7f6adc0b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.456+0000 7f6ae0c00640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6adc0b4640 0x7f6adc13d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 -- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6adc0b4640 msgr2=0x7f6adc13d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6adc0b4640 0x7f6adc13d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 -- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 msgr2=0x7f6adc0b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 0x7f6adc0b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc0ab910 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae1600640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 0x7f6adc0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:41.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae2000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b4f30 tx=0x7f6ad400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4003b80 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4003ce0 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc0abbf0 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4005310 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.457+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc13d970 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.458+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0ac110 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.459+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6ad4005470 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.460+0000 7f6ad9600640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 0x7f6abc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.460+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ad4088af0 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.460+0000 7f6ae1600640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 0x7f6abc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.460+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f6abc072760 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.461+0000 7f6ae1600640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 0x7f6abc06d0f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00145a0 tx=0x7f6ad0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.464+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6ad4019020 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.666+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6adc140980 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.667+0000 7f6ad9600640 1 -- 172.21.15.192:0/3398913900 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4745 (secure 0 0 0) 0x7f6adc0ac110 con 0x7f6adc0ac3f0 2024-09-13T18:45:41.668 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:41.669 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":70,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:43:18.649430+0000","modified":"2024-09-13T18:43:21.664732+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8166},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8166":{"gid":8166,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/3537056060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3537056060},{"type":"v1","addr":"172.21.15.192:6837","nonce":3537056060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2024-09-13T18:45:41.669 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 70 2024-09-13T18:45:41.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 msgr2=0x7f6abc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 0x7f6abc06d0f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6ad00145a0 tx=0x7f6ad0009190 comp rx=0 tx=0).stop 2024-09-13T18:45:41.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 msgr2=0x7f6adc13f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b4f30 tx=0x7f6ad400e960 comp rx=0 tx=0).stop 2024-09-13T18:45:41.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 shutdown_connections 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6abc06ac30 0x7f6abc06d0f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6adc0ac3f0 0x7f6adc13f130 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6adc0b4640 0x7f6adc13d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 --2- 172.21.15.192:0/3398913900 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ac40047c0 0x7f6adc0b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 >> 172.21.15.192:0/3398913900 conn(0x7f6adc0ae960 msgr2=0x7f6adc070950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 shutdown_connections 2024-09-13T18:45:41.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.669+0000 7f6ae4000640 1 -- 172.21.15.192:0/3398913900 wait complete. 2024-09-13T18:45:41.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:41.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.837+0000 7f8cfc800640 1 Processor -- start 2024-09-13T18:45:41.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.837+0000 7f8cfc800640 1 -- start start 2024-09-13T18:45:41.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.838+0000 7f8cfc800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8cf40cc530 0x7f8cf40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.838+0000 7f8cfc800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf40ccec0 con 0x7f8cf4071810 2024-09-13T18:45:41.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.838+0000 7f8cfc800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf4071dd0 con 0x7f8cf4150480 2024-09-13T18:45:41.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.838+0000 7f8cfc800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf40cb770 con 0x7f8cf40cc530 2024-09-13T18:45:41.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf9400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8cf4071810 0x7f8cf40b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46552/0 (socket says 172.21.15.192:46552) 2024-09-13T18:45:41.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf9400640 1 -- 172.21.15.192:0/1032508784 learned_addr learned my addr 172.21.15.192:0/1032508784 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cfa800640 1 --2- 172.21.15.192:0/1032508784 >> v2:172.21.15.194:3300/0 conn(0x7f8cf40cc530 0x7f8cf40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096917226 0 0) 0x7f8cf40ccec0 con 0x7f8cf4071810 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cdc003440 con 0x7f8cf4071810 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 45217804 0 0) 0x7f8cdc003440 con 0x7f8cf4071810 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 >> v2:172.21.15.194:3300/0 conn(0x7f8cf40cc530 msgr2=0x7f8cf40cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 --2- 172.21.15.192:0/1032508784 >> v2:172.21.15.194:3300/0 conn(0x7f8cf40cc530 0x7f8cf40cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 >> v1:172.21.15.194:6789/0 conn(0x7f8cf4150480 legacy=0x7f8cf415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40cba50 con 0x7f8cf4071810 2024-09-13T18:45:41.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.839+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f8ce4001670 con 0x7f8cf4071810 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 >> v1:172.21.15.192:6789/0 conn(0x7f8cf4071810 legacy=0x7f8cf40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc003a60 0x7f8cdc003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cdc00d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc00d760 0x7f8cdc00fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf40cb770 con 0x7f8cdc00ac50 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc0104d0 con 0x7f8cdc003a60 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc010690 con 0x7f8cdc00d760 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cdc00d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9e00640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc003a60 0x7f8cdc003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cfa800640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc00d760 0x7f8cdc00fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 -- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc00d760 msgr2=0x7f8cdc00fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc00d760 0x7f8cdc00fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 -- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc003a60 msgr2=0x7f8cdc003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cdc003a60 0x7f8cdc003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cf9400640 1 -- 172.21.15.192:0/1032508784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cdc003440 con 0x7f8cdc00ac50 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cfa800640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cdc00d760 0x7f8cdc00fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.840+0000 7f8cfa800640 1 -- 172.21.15.192:0/1032508784 reap_dead start 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.841+0000 7f8cf9400640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cdc00d040 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c240 tx=0x7f8cdc0036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7223aacebeb90a29 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.841+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4005ad0 con 0x7f8cdc00ac50 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.841+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce402d070 con 0x7f8cdc00ac50 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.841+0000 7f8cf8a00640 1 -- 172.21.15.192:0/1032508784 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce4007070 con 0x7f8cdc00ac50 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 -- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 msgr2=0x7f8cdc00d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cdc00d040 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f8ce400c240 tx=0x7f8cdc0036f0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 -- 172.21.15.192:0/1032508784 shutdown_connections 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 --2- 172.21.15.192:0/1032508784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cdc00d040 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 -- 172.21.15.192:0/1032508784 >> 172.21.15.192:0/1032508784 conn(0x7f8cf40ae960 msgr2=0x7f8cf406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 -- 172.21.15.192:0/1032508784 shutdown_connections 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.842+0000 7f8cfc800640 1 -- 172.21.15.192:0/1032508784 wait complete. 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.844+0000 7f8cfc800640 1 Processor -- start 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.844+0000 7f8cfc800640 1 -- start start 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 0x7f8cf4143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf4143ad0 0x7f8cf4154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4157080 con 0x7f8cdc00ac50 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf4156da0 con 0x7f8cf4143ad0 2024-09-13T18:45:41.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf406fb90 con 0x7f8cf41567f0 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59716/0 (socket says 172.21.15.192:59716) 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 -- 172.21.15.192:0/149125855 learned_addr learned my addr 172.21.15.192:0/149125855 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cfa800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf4143ad0 0x7f8cf4154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9400640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 0x7f8cf4143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 -- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 msgr2=0x7f8cf4143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 0x7f8cf4143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 -- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf4143ad0 msgr2=0x7f8cf4154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf4143ad0 0x7f8cf4154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9e00640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf406fe70 con 0x7f8cdc00ac50 2024-09-13T18:45:41.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.845+0000 7f8cf9400640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 0x7f8cf4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cf9e00640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f5f0 tx=0x7f8ce800fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce80052e0 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8005440 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8003810 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf4070150 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.846+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf414ecd0 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.847+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf40cc940 con 0x7f8cdc00ac50 2024-09-13T18:45:41.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.848+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8ce8003970 con 0x7f8cdc00ac50 2024-09-13T18:45:41.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.849+0000 7f8cee000640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 0x7f8cd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:41.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.849+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce8089170 con 0x7f8cdc00ac50 2024-09-13T18:45:41.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.849+0000 7f8cf9400640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 0x7f8cd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:41.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.849+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=168}) v3 -- 0x7f8cd8072730 con 0x7f8cdc00ac50 2024-09-13T18:45:41.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.850+0000 7f8cf9400640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 0x7f8cd806d0c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4032000 tx=0x7f8ce402d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:41.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.853+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8ce8054350 con 0x7f8cdc00ac50 2024-09-13T18:45:41.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.869+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(168..168 src has 1..168) v4 ==== 679+0+0 (secure 0 0 0) 0x7f8ce8058710 con 0x7f8cdc00ac50 2024-09-13T18:45:41.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:41.869+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=169}) v3 -- 0x7f8cd80732c0 con 0x7f8cdc00ac50 2024-09-13T18:45:42.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.027+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cf40ccd10 con 0x7f8cdc00ac50 2024-09-13T18:45:42.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.028+0000 7f8cee000640 1 -- 172.21.15.192:0/149125855 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16595 (secure 0 0 0) 0x7f8ce8057970 con 0x7f8cdc00ac50 2024-09-13T18:45:42.030 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:42.030 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":168,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:41.864025+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:43:16.500180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"164","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-13T18:43:17.638056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.030+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 msgr2=0x7f8cd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.030+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 0x7f8cd806d0c0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4032000 tx=0x7f8ce402d000 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.030+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 msgr2=0x7f8cf4070670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.030+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800f5f0 tx=0x7f8ce800fab0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 shutdown_connections 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8cd806ac00 0x7f8cd806d0c0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8cf4143ad0 0x7f8cf4154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8cf41567f0 0x7f8cf4143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 --2- 172.21.15.192:0/149125855 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8cdc00ac50 0x7f8cf4070670 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 >> 172.21.15.192:0/149125855 conn(0x7f8cf40ae960 msgr2=0x7f8cf415b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 shutdown_connections 2024-09-13T18:45:42.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.031+0000 7f8cfc800640 1 -- 172.21.15.192:0/149125855 wait complete. 2024-09-13T18:45:42.050 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.201+0000 7fa76fa00640 1 Processor -- start 2024-09-13T18:45:42.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.201+0000 7fa76fa00640 1 -- start start 2024-09-13T18:45:42.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.202+0000 7fa76fa00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa7680cc530 0x7fa7680cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.202+0000 7fa76fa00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7680ccec0 con 0x7fa768150480 2024-09-13T18:45:42.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.202+0000 7fa76fa00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa768071dd0 con 0x7fa768071810 2024-09-13T18:45:42.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.202+0000 7fa76fa00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7680cb770 con 0x7fa7680cc530 2024-09-13T18:45:42.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa76d000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa768150480 0x7fa76815a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46558/0 (socket says 172.21.15.192:46558) 2024-09-13T18:45:42.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa76d000640 1 -- 172.21.15.192:0/406522883 learned_addr learned my addr 172.21.15.192:0/406522883 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:42.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa76da00640 1 --2- 172.21.15.192:0/406522883 >> v2:172.21.15.194:3300/0 conn(0x7fa7680cc530 0x7fa7680cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259555911 0 0) 0x7fa7680ccec0 con 0x7fa768150480 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa750003520 con 0x7fa768150480 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129622580 0 0) 0x7fa768071dd0 con 0x7fa768071810 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7680ccec0 con 0x7fa768071810 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3779141796 0 0) 0x7fa750003520 con 0x7fa768150480 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 >> v2:172.21.15.194:3300/0 conn(0x7fa7680cc530 msgr2=0x7fa7680cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:42.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 --2- 172.21.15.192:0/406522883 >> v2:172.21.15.194:3300/0 conn(0x7fa7680cc530 0x7fa7680cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 >> v1:172.21.15.194:6789/0 conn(0x7fa768071810 legacy=0x7fa7680b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7680cba50 con 0x7fa768150480 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fa75c001670 con 0x7fa768150480 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.203+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 >> v1:172.21.15.192:6789/0 conn(0x7fa768150480 legacy=0x7fa76815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750003b00 0x7fa750003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7500047c0 0x7fa750004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 0x7fa75000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7680cb770 con 0x7fa750005180 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000e2c0 con 0x7fa750003b00 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75000e480 con 0x7fa7500047c0 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 0x7fa75000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa767e00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7500047c0 0x7fa750004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76d000640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750003b00 0x7fa750003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 -- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7500047c0 msgr2=0x7fa750004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa7500047c0 0x7fa750004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 -- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750003b00 msgr2=0x7fa750003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750003b00 0x7fa750003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.204+0000 7fa76da00640 1 -- 172.21.15.192:0/406522883 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750003520 con 0x7fa750005180 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.205+0000 7fa76da00640 1 -- 172.21.15.192:0/406522883 reap_dead start 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.205+0000 7fa76da00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 0x7fa75000db90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa760009fc0 tx=0x7fa7500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11065e46ae15a6fe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.205+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760003b90 con 0x7fa750005180 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.205+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76000f040 con 0x7fa750005180 2024-09-13T18:45:42.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.205+0000 7fa767400640 1 -- 172.21.15.192:0/406522883 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa760004020 con 0x7fa750005180 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 -- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 msgr2=0x7fa75000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 0x7fa75000db90 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa760009fc0 tx=0x7fa7500057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 -- 172.21.15.192:0/406522883 shutdown_connections 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 --2- 172.21.15.192:0/406522883 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa750005180 0x7fa75000db90 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 -- 172.21.15.192:0/406522883 >> 172.21.15.192:0/406522883 conn(0x7fa7680ae960 msgr2=0x7fa76806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 -- 172.21.15.192:0/406522883 shutdown_connections 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.206+0000 7fa76fa00640 1 -- 172.21.15.192:0/406522883 wait complete. 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.208+0000 7fa76fa00640 1 Processor -- start 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.208+0000 7fa76fa00640 1 -- start start 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750005180 0x7fa76814ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa768152be0 0x7fa768158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76814f340 con 0x7fa7681517a0 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa768151310 con 0x7fa750005180 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76fa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa768153140 con 0x7fa768152be0 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa767e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa767e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59732/0 (socket says 172.21.15.192:59732) 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa767e00640 1 -- 172.21.15.192:0/3558174909 learned_addr learned my addr 172.21.15.192:0/3558174909 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:42.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76da00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa768152be0 0x7fa768158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.209+0000 7fa76d000640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750005180 0x7fa76814ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 -- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa768152be0 msgr2=0x7fa768158500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa768152be0 0x7fa768158500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 -- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750005180 msgr2=0x7fa76814ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750005180 0x7fa76814ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 -- 172.21.15.192:0/3558174909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7681509e0 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa767e00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa75400f7d0 tx=0x7fa75400fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75400fe80 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754005320 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa768150cc0 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754007290 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.210+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76814f6e0 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.211+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa768071dd0 con 0x7fa7681517a0 2024-09-13T18:45:42.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.212+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa7540073f0 con 0x7fa7681517a0 2024-09-13T18:45:42.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.213+0000 7fa764c00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 0x7fa74806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.213+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa754088c00 con 0x7fa7681517a0 2024-09-13T18:45:42.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.213+0000 7fa76d000640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 0x7fa74806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.215 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.214+0000 7fa76d000640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 0x7fa74806d0c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa7681f5b80 tx=0x7fa75c001e00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.219 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.217+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa754053e80 con 0x7fa7681517a0 2024-09-13T18:45:42.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.421+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fa7680b2930 con 0x7fa7681517a0 2024-09-13T18:45:42.681 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:45:42.422+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.431+0000 7fa764c00640 1 -- 172.21.15.192:0/3558174909 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7fa75401a090 con 0x7fa7681517a0 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 msgr2=0x7fa74806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 0x7fa74806d0c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa7681f5b80 tx=0x7fa75c001e00 comp rx=0 tx=0).stop 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 msgr2=0x7fa7681526a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fa75400f7d0 tx=0x7fa75400fc90 comp rx=0 tx=0).stop 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 shutdown_connections 2024-09-13T18:45:42.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa74806ac00 0x7fa74806d0c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa768152be0 0x7fa768158500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa7681517a0 0x7fa7681526a0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 --2- 172.21.15.192:0/3558174909 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa750005180 0x7fa76814ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.433+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 >> 172.21.15.192:0/3558174909 conn(0x7fa7680ae960 msgr2=0x7fa76815d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.434+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 shutdown_connections 2024-09-13T18:45:42.684 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.434+0000 7fa76fa00640 1 -- 172.21.15.192:0/3558174909 wait complete. 2024-09-13T18:45:42.684 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:45:42.685 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:45:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.837+0000 7f5ebf200640 1 Processor -- start 2024-09-13T18:45:42.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.837+0000 7f5ebf200640 1 -- start start 2024-09-13T18:45:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.838+0000 7f5ebf200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec0144730 0x7f5ec015b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.838+0000 7f5ebf200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ec00cdef0 0x7f5ec006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.838+0000 7f5ebf200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec0071ab0 con 0x7f5ec006e990 2024-09-13T18:45:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.838+0000 7f5ebf200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ec00714f0 con 0x7f5ec00cdef0 2024-09-13T18:45:42.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.838+0000 7f5ebf200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00717d0 con 0x7f5ec0144730 2024-09-13T18:45:42.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ec00cdef0 0x7f5ec006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f5ec00cdef0 0x7f5ec006edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59762/0 (socket says 172.21.15.192:59762) 2024-09-13T18:45:42.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 -- 172.21.15.192:0/267951916 learned_addr learned my addr 172.21.15.192:0/267951916 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:42.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebde00640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec0144730 0x7f5ec015b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 -- 172.21.15.192:0/267951916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec0144730 msgr2=0x7f5ec015b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec0144730 0x7f5ec015b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 -- 172.21.15.192:0/267951916 >> v1:172.21.15.194:6789/0 conn(0x7f5ec006e990 legacy=0x7f5ec00cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.839+0000 7f5ebe800640 1 -- 172.21.15.192:0/267951916 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec006a510 con 0x7f5ec00cdef0 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.840+0000 7f5ebe800640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec00cdef0 0x7f5ec006edb0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009870 tx=0x7f5eb802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aae49e0662f996a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.840+0000 7f5ebca00640 1 -- 172.21.15.192:0/267951916 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8032440 con 0x7f5ec00cdef0 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.840+0000 7f5ebca00640 1 -- 172.21.15.192:0/267951916 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb80325a0 con 0x7f5ec00cdef0 2024-09-13T18:45:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.840+0000 7f5ebca00640 1 -- 172.21.15.192:0/267951916 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8032930 con 0x7f5ec00cdef0 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 -- 172.21.15.192:0/267951916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec00cdef0 msgr2=0x7f5ec006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec00cdef0 0x7f5ec006edb0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009870 tx=0x7f5eb802a250 comp rx=0 tx=0).stop 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 -- 172.21.15.192:0/267951916 shutdown_connections 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec00cdef0 0x7f5ec006edb0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 --2- 172.21.15.192:0/267951916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec0144730 0x7f5ec015b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 -- 172.21.15.192:0/267951916 >> 172.21.15.192:0/267951916 conn(0x7f5ec00736d0 msgr2=0x7f5ec00b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 -- 172.21.15.192:0/267951916 shutdown_connections 2024-09-13T18:45:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.841+0000 7f5ebf200640 1 -- 172.21.15.192:0/267951916 wait complete. 2024-09-13T18:45:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.843+0000 7f5ebf200640 1 Processor -- start 2024-09-13T18:45:42.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.843+0000 7f5ebf200640 1 -- start start 2024-09-13T18:45:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.843+0000 7f5ebf200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ec006e990 0x7f5ec01f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.843+0000 7f5ebf200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec00cdef0 0x7f5ec0140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebf200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebf200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec012e260 con 0x7f5ec0144730 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebf200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec012eb00 con 0x7f5ec006e990 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebf200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec01e3060 con 0x7f5ec00cdef0 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59764/0 (socket says 172.21.15.192:59764) 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 -- 172.21.15.192:0/2766655897 learned_addr learned my addr 172.21.15.192:0/2766655897 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebde00640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ec006e990 0x7f5ec01f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebd400640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec00cdef0 0x7f5ec0140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 -- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec00cdef0 msgr2=0x7f5ec0140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec00cdef0 0x7f5ec0140e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 -- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ec006e990 msgr2=0x7f5ec01f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ec006e990 0x7f5ec01f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 -- 172.21.15.192:0/2766655897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80094d0 con 0x7f5ec0144730 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.844+0000 7f5ebe800640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5eb802a290 tx=0x7f5eb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.845+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb803d830 con 0x7f5ec0144730 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.845+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb803d9b0 con 0x7f5ec0144730 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.845+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb803dd60 con 0x7f5ec0144730 2024-09-13T18:45:42.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.845+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec01310d0 con 0x7f5ec0144730 2024-09-13T18:45:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.845+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec012e790 con 0x7f5ec0144730 2024-09-13T18:45:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.846+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec015b100 con 0x7f5ec0144730 2024-09-13T18:45:42.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.847+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5eb8039040 con 0x7f5ec0144730 2024-09-13T18:45:42.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.847+0000 7f5eb6000640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 0x7f5ea006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:42.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.848+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5eb80a9e30 con 0x7f5ec0144730 2024-09-13T18:45:42.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.848+0000 7f5ebde00640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 0x7f5ea006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:42.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.848+0000 7f5ebde00640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 0x7f5ea006d0f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ec01f5e20 tx=0x7f5eb000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:42.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:42.851+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5eb8074fc0 con 0x7f5ec0144730 2024-09-13T18:45:43.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.056+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5ec012e920 con 0x7f5ec0144730 2024-09-13T18:45:43.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.435+0000 7f5eb6000640 1 -- 172.21.15.192:0/2766655897 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5eb80785e0 con 0x7f5ec0144730 2024-09-13T18:45:43.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 msgr2=0x7f5ea006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 0x7f5ea006d0f0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ec01f5e20 tx=0x7f5eb000b040 comp rx=0 tx=0).stop 2024-09-13T18:45:43.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 msgr2=0x7f5ec0141350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f5eb802a290 tx=0x7f5eb80046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 shutdown_connections 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f5ea006ac30 0x7f5ea006d0f0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ec0144730 0x7f5ec0141350 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f5ec00cdef0 0x7f5ec0140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 --2- 172.21.15.192:0/2766655897 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f5ec006e990 0x7f5ec01f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 >> 172.21.15.192:0/2766655897 conn(0x7f5ec00736d0 msgr2=0x7f5ec00af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 shutdown_connections 2024-09-13T18:45:43.442 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.438+0000 7f5ebf200640 1 -- 172.21.15.192:0/2766655897 wait complete. 2024-09-13T18:45:43.457 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:45:43.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.612+0000 7fbaa6800640 1 Processor -- start 2024-09-13T18:45:43.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.612+0000 7fbaa6800640 1 -- start start 2024-09-13T18:45:43.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fbaa6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fbaa015f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fbaa6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbaa00cd9c0 0x7fbaa00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fbaa6800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa006a330 con 0x7fbaa01403e0 2024-09-13T18:45:43.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fbaa6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa013e0f0 con 0x7fbaa00cd9c0 2024-09-13T18:45:43.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fbaa6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00ce330 con 0x7fbaa0071b80 2024-09-13T18:45:43.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fba9ea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbaa01403e0 0x7fbaa0070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46572/0 (socket says 172.21.15.192:46572) 2024-09-13T18:45:43.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.613+0000 7fba9ea00640 1 -- 172.21.15.192:0/2475456625 learned_addr learned my addr 172.21.15.192:0/2475456625 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:43.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9fe00640 1 --2- 172.21.15.192:0/2475456625 >> v2:172.21.15.194:3300/0 conn(0x7fbaa00cd9c0 0x7fbaa00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9f400640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fbaa015f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 771353702 0 0) 0x7fba8c001110 con 0x7fbaa01403e0 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba84003520 con 0x7fbaa01403e0 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4222228805 0 0) 0x7fba84003520 con 0x7fbaa01403e0 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 msgr2=0x7fbaa015f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fbaa015f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 >> v2:172.21.15.194:3300/0 conn(0x7fbaa00cd9c0 msgr2=0x7fbaa00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 --2- 172.21.15.192:0/2475456625 >> v2:172.21.15.194:3300/0 conn(0x7fbaa00cd9c0 0x7fbaa00cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa015f840 con 0x7fbaa01403e0 2024-09-13T18:45:43.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fba8c001800 con 0x7fbaa01403e0 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 >> v1:172.21.15.192:6789/0 conn(0x7fbaa01403e0 legacy=0x7fbaa0070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fba84003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84003f40 0x7fba840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba84004d00 0x7fba84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa013e0f0 con 0x7fba84003f40 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa00ce330 con 0x7fba84004d00 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.614+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8400b980 con 0x7fbaa0071b80 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84003f40 0x7fba840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9f400640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fba84003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 -- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 msgr2=0x7fba84003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbaa0071b80 0x7fba84003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 -- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba84004d00 msgr2=0x7fba84005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:43.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9fe00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba84004d00 0x7fba84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba84004d00 0x7fba84005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9ea00640 1 -- 172.21.15.192:0/2475456625 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba84003520 con 0x7fba84003f40 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.615+0000 7fba9fe00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fba84004d00 0x7fba84005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.616+0000 7fba9ea00640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84003f40 0x7fba840047c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00c140 tx=0x7fba840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838c3219c42bda59 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.616+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c005ad0 con 0x7fba84003f40 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.616+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c02d070 con 0x7fba84003f40 2024-09-13T18:45:43.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.616+0000 7fba9e000640 1 -- 172.21.15.192:0/2475456625 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c007070 con 0x7fba84003f40 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 -- 172.21.15.192:0/2475456625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84003f40 msgr2=0x7fba840047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 --2- 172.21.15.192:0/2475456625 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fba84003f40 0x7fba840047c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00c140 tx=0x7fba840057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fba9fe00640 1 -- 172.21.15.192:0/2475456625 reap_dead start 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 -- 172.21.15.192:0/2475456625 shutdown_connections 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 -- 172.21.15.192:0/2475456625 >> 172.21.15.192:0/2475456625 conn(0x7fbaa00b0c40 msgr2=0x7fbaa00b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 -- 172.21.15.192:0/2475456625 shutdown_connections 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.617+0000 7fbaa6800640 1 -- 172.21.15.192:0/2475456625 wait complete. 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.619+0000 7fbaa6800640 1 Processor -- start 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.619+0000 7fbaa6800640 1 -- start start 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.619+0000 7fbaa6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba84003f40 0x7fbaa01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fbaa6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 0x7fbaa0138630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fbaa6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fbaa6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0153870 con 0x7fbaa015b700 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fbaa6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa0138b70 con 0x7fbaa0154ef0 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fbaa6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa015c0c0 con 0x7fba84003f40 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59786/0 (socket says 172.21.15.192:59786) 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 -- 172.21.15.192:0/1482908877 learned_addr learned my addr 172.21.15.192:0/1482908877 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9f400640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba84003f40 0x7fbaa01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9ea00640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 0x7fbaa0138630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 -- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba84003f40 msgr2=0x7fbaa01548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba84003f40 0x7fbaa01548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 -- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 msgr2=0x7fbaa0138630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 0x7fbaa0138630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9fe00640 1 -- 172.21.15.192:0/1482908877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa015dc60 con 0x7fbaa015b700 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.620+0000 7fba9ea00640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 0x7fbaa0138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fba9fe00640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006a300 tx=0x7fba98010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800e840 con 0x7fbaa015b700 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9800e9a0 con 0x7fbaa015b700 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa0152ed0 con 0x7fbaa015b700 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9800ed30 con 0x7fbaa015b700 2024-09-13T18:45:43.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.621+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa0153490 con 0x7fbaa015b700 2024-09-13T18:45:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.622+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbaa01539b0 con 0x7fbaa015b700 2024-09-13T18:45:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.623+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fba9801c400 con 0x7fbaa015b700 2024-09-13T18:45:43.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.624+0000 7fba97400640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.624+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fba98089610 con 0x7fbaa015b700 2024-09-13T18:45:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.624+0000 7fba9f400640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:43.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.625+0000 7fba9f400640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fba90003c60 tx=0x7fba9000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:43.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.628+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbaa01539b0 con 0x7fbaa015b700 2024-09-13T18:45:43.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:43.796+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbaa01539b0 con 0x7fbaa015b700 2024-09-13T18:45:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.438+0000 7fba97400640 1 -- 172.21.15.192:0/1482908877 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v170) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbaa01539b0 con 0x7fbaa015b700 2024-09-13T18:45:44.441 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:45:44.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 msgr2=0x7fba8006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fba90003c60 tx=0x7fba9000b040 comp rx=0 tx=0).stop 2024-09-13T18:45:44.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 msgr2=0x7fbaa015bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7fbaa006a300 tx=0x7fba98010c20 comp rx=0 tx=0).stop 2024-09-13T18:45:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 shutdown_connections 2024-09-13T18:45:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fba8006ac00 0x7fba8006d0c0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbaa015b700 0x7fbaa015bb80 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbaa0154ef0 0x7fbaa0138630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 --2- 172.21.15.192:0/1482908877 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fba84003f40 0x7fbaa01548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 >> 172.21.15.192:0/1482908877 conn(0x7fbaa00b0c40 msgr2=0x7fbaa0151690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 shutdown_connections 2024-09-13T18:45:44.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.441+0000 7fbaa6800640 1 -- 172.21.15.192:0/1482908877 wait complete. 2024-09-13T18:45:44.463 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:45:44.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.619+0000 7f25c2400640 1 Processor -- start 2024-09-13T18:45:44.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.619+0000 7f25c2400640 1 -- start start 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25bc0cb730 0x7f25bc15d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 0x7f25bc0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 0x7f25bc06fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc0cced0 con 0x7f25bc0cb730 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25bc15e110 con 0x7f25bc0cca60 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25c2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc15e3f0 con 0x7f25bc0b3d90 2024-09-13T18:45:44.623 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25bb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25bc0cb730 0x7f25bc15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.620+0000 7f25bb400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f25bc0cb730 0x7f25bc15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59788/0 (socket says 172.21.15.192:59788) 2024-09-13T18:45:44.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 -- 172.21.15.192:0/2510592570 learned_addr learned my addr 172.21.15.192:0/2510592570 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bbe00640 1 --2- 172.21.15.192:0/2510592570 >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 0x7f25bc06fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25baa00640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 0x7f25bc0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 -- 172.21.15.192:0/2510592570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 msgr2=0x7f25bc0cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 0x7f25bc0cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 -- 172.21.15.192:0/2510592570 >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 msgr2=0x7f25bc06fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 --2- 172.21.15.192:0/2510592570 >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 0x7f25bc06fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bb400640 1 -- 172.21.15.192:0/2510592570 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25bc15e6d0 con 0x7f25bc0cb730 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25bbe00640 1 --2- 172.21.15.192:0/2510592570 >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 0x7f25bc06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.621+0000 7f25baa00640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 0x7f25bc0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:44.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.622+0000 7f25bb400640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cb730 0x7f25bc15d810 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0b1df0 tx=0x7f25ac02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe854b6fc837a76 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.622+0000 7f25ba000640 1 -- 172.21.15.192:0/2510592570 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac032440 con 0x7f25bc0cb730 2024-09-13T18:45:44.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.622+0000 7f25ba000640 1 -- 172.21.15.192:0/2510592570 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0325a0 con 0x7f25bc0cb730 2024-09-13T18:45:44.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.622+0000 7f25ba000640 1 -- 172.21.15.192:0/2510592570 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac032930 con 0x7f25bc0cb730 2024-09-13T18:45:44.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 -- 172.21.15.192:0/2510592570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cb730 msgr2=0x7f25bc15d810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cb730 0x7f25bc15d810 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0b1df0 tx=0x7f25ac02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 -- 172.21.15.192:0/2510592570 shutdown_connections 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 --2- 172.21.15.192:0/2510592570 >> v2:172.21.15.194:3300/0 conn(0x7f25bc0cca60 0x7f25bc06fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0b3d90 0x7f25bc0cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 --2- 172.21.15.192:0/2510592570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cb730 0x7f25bc15d810 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 -- 172.21.15.192:0/2510592570 >> 172.21.15.192:0/2510592570 conn(0x7f25bc0b0c40 msgr2=0x7f25bc0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 -- 172.21.15.192:0/2510592570 shutdown_connections 2024-09-13T18:45:44.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.623+0000 7f25c2400640 1 -- 172.21.15.192:0/2510592570 wait complete. 2024-09-13T18:45:44.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.625+0000 7f25c2400640 1 Processor -- start 2024-09-13T18:45:44.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.625+0000 7f25c2400640 1 -- start start 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25bc0b3d90 0x7f25bc13f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 0x7f25bc152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc1403f0 con 0x7f25bc0cca60 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc159bc0 con 0x7f25bc0b3d90 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25c2400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25bc13f540 con 0x7f25bc0cb730 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59798/0 (socket says 172.21.15.192:59798) 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 -- 172.21.15.192:0/1525709681 learned_addr learned my addr 172.21.15.192:0/1525709681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bb400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25bc0b3d90 0x7f25bc13f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25baa00640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 0x7f25bc152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 -- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 msgr2=0x7f25bc152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 0x7f25bc152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 -- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25bc0b3d90 msgr2=0x7f25bc13f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25bc0b3d90 0x7f25bc13f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25bbe00640 1 -- 172.21.15.192:0/1525709681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac0094d0 con 0x7f25bc0cca60 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.626+0000 7f25baa00640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 0x7f25bc152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25bbe00640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f25b400cd80 tx=0x7f25b400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400f680 con 0x7f25bc0cca60 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b400f800 con 0x7f25bc0cca60 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25bc13f770 con 0x7f25bc0cca60 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400fbb0 con 0x7f25bc0cca60 2024-09-13T18:45:44.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.627+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25bc13fd30 con 0x7f25bc0cca60 2024-09-13T18:45:44.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.628+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25bc140530 con 0x7f25bc0cca60 2024-09-13T18:45:44.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.629+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f25b400b040 con 0x7f25bc0cca60 2024-09-13T18:45:44.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.630+0000 7f25b3400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 0x7f259c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:44.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.630+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f25b4089b40 con 0x7f25bc0cca60 2024-09-13T18:45:44.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.630+0000 7f25bb400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 0x7f259c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:44.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.631+0000 7f25bb400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 0x7f259c06d0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f25ac034000 tx=0x7f25ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:44.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.634+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f25b4054e70 con 0x7f25bc0cca60 2024-09-13T18:45:44.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:44.805+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f25bc0cc520 con 0x7f25bc0cca60 2024-09-13T18:45:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.444+0000 7f25b3400640 1 -- 172.21.15.192:0/1525709681 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v171) v1 ==== 169+0+0 (secure 0 0 0) 0x7f25b4058490 con 0x7f25bc0cca60 2024-09-13T18:45:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:45:45.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 msgr2=0x7f259c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 0x7f259c06d0c0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f25ac034000 tx=0x7f25ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 msgr2=0x7f25bc0ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f25b400cd80 tx=0x7f25b400a650 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 shutdown_connections 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f259c06ac00 0x7f259c06d0c0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f25bc0cca60 0x7f25bc0ca0f0 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f25bc0cb730 0x7f25bc152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 --2- 172.21.15.192:0/1525709681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f25bc0b3d90 0x7f25bc13f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 >> 172.21.15.192:0/1525709681 conn(0x7f25bc0b0c40 msgr2=0x7f25bc070240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 shutdown_connections 2024-09-13T18:45:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.447+0000 7f25c2400640 1 -- 172.21.15.192:0/1525709681 wait complete. 2024-09-13T18:45:45.468 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.621+0000 7f43e7400640 1 Processor -- start 2024-09-13T18:45:45.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.621+0000 7f43e7400640 1 -- start start 2024-09-13T18:45:45.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e01589f0 0x7f43e00b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43e00b3af0 0x7f43e015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f43e006c0b0 0x7f43e006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e006ca80 con 0x7f43e00b3af0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e00b2000 con 0x7f43e006c0b0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43e7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015bbd0 con 0x7f43e01589f0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43dfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43e00b3af0 0x7f43e015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43dfe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f43e00b3af0 0x7f43e015b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59810/0 (socket says 172.21.15.192:59810) 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.622+0000 7f43dfe00640 1 -- 172.21.15.192:0/1084902813 learned_addr learned my addr 172.21.15.192:0/1084902813 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43e4a00640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e01589f0 0x7f43e00b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43e5400640 1 --2- 172.21.15.192:0/1084902813 >> v2:172.21.15.194:3300/0 conn(0x7f43e006c0b0 0x7f43e006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43dfe00640 1 -- 172.21.15.192:0/1084902813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e01589f0 msgr2=0x7f43e00b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43dfe00640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e01589f0 0x7f43e00b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43dfe00640 1 -- 172.21.15.192:0/1084902813 >> v2:172.21.15.194:3300/0 conn(0x7f43e006c0b0 msgr2=0x7f43e006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43dfe00640 1 --2- 172.21.15.192:0/1084902813 >> v2:172.21.15.194:3300/0 conn(0x7f43e006c0b0 0x7f43e006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.623+0000 7f43dfe00640 1 -- 172.21.15.192:0/1084902813 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e015beb0 con 0x7f43e00b3af0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.624+0000 7f43dfe00640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e00b3af0 0x7f43e015b260 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b1f70 tx=0x7f43cc02a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1e9466c6ca0675 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.624+0000 7f43df400640 1 -- 172.21.15.192:0/1084902813 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc032440 con 0x7f43e00b3af0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.624+0000 7f43df400640 1 -- 172.21.15.192:0/1084902813 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc0325a0 con 0x7f43e00b3af0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.624+0000 7f43df400640 1 -- 172.21.15.192:0/1084902813 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc032930 con 0x7f43e00b3af0 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 -- 172.21.15.192:0/1084902813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e00b3af0 msgr2=0x7f43e015b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e00b3af0 0x7f43e015b260 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f43e00b1f70 tx=0x7f43cc02a1d0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 -- 172.21.15.192:0/1084902813 shutdown_connections 2024-09-13T18:45:45.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 --2- 172.21.15.192:0/1084902813 >> v2:172.21.15.194:3300/0 conn(0x7f43e006c0b0 0x7f43e006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e00b3af0 0x7f43e015b260 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 --2- 172.21.15.192:0/1084902813 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e01589f0 0x7f43e00b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 -- 172.21.15.192:0/1084902813 >> 172.21.15.192:0/1084902813 conn(0x7f43e00b08f0 msgr2=0x7f43e00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 -- 172.21.15.192:0/1084902813 shutdown_connections 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.625+0000 7f43e7400640 1 -- 172.21.15.192:0/1084902813 wait complete. 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.626+0000 7f43e7400640 1 Processor -- start 2024-09-13T18:45:45.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 -- start start 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e006c0b0 0x7f43e006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00b3af0 0x7f43e0152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015e580 con 0x7f43e01589f0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e015e370 con 0x7f43e00b3af0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.627+0000 7f43e7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e014eee0 con 0x7f43e006c0b0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59822/0 (socket says 172.21.15.192:59822) 2024-09-13T18:45:45.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 -- 172.21.15.192:0/23857828 learned_addr learned my addr 172.21.15.192:0/23857828 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e4a00640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e006c0b0 0x7f43e006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43dfe00640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00b3af0 0x7f43e0152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 -- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e006c0b0 msgr2=0x7f43e006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e006c0b0 0x7f43e006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 -- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00b3af0 msgr2=0x7f43e0152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00b3af0 0x7f43e0152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 -- 172.21.15.192:0/23857828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43cc0094d0 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.628+0000 7f43e5400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007e90 tx=0x7f43d800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.629+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8014420 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.629+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d80145a0 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.629+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8014950 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.629+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e015d230 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.629+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e015cf50 con 0x7f43e01589f0 2024-09-13T18:45:45.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.630+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e006c540 con 0x7f43e01589f0 2024-09-13T18:45:45.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.631+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f43d8014ab0 con 0x7f43e01589f0 2024-09-13T18:45:45.635 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.632+0000 7f43dcc00640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 0x7f43c006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.632+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f43d8089810 con 0x7f43e01589f0 2024-09-13T18:45:45.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.634+0000 7f43e4a00640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 0x7f43c006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.635+0000 7f43e4a00640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 0x7f43c006d0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f43d40079a0 tx=0x7f43d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.637+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f43d8054d90 con 0x7f43e01589f0 2024-09-13T18:45:45.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.804+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f43e00cb8f0 con 0x7f43e01589f0 2024-09-13T18:45:45.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.809+0000 7f43dcc00640 1 -- 172.21.15.192:0/23857828 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43d80583b0 con 0x7f43e01589f0 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 msgr2=0x7f43c006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 0x7f43c006d0f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f43d40079a0 tx=0x7f43d4008040 comp rx=0 tx=0).stop 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 msgr2=0x7f43e015de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f43d8007e90 tx=0x7f43d800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 shutdown_connections 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f43c006ac30 0x7f43c006d0f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f43e01589f0 0x7f43e015de30 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f43e00b3af0 0x7f43e0152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 --2- 172.21.15.192:0/23857828 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f43e006c0b0 0x7f43e006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 >> 172.21.15.192:0/23857828 conn(0x7f43e00b08f0 msgr2=0x7f43e0159120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 shutdown_connections 2024-09-13T18:45:45.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.811+0000 7f43e7400640 1 -- 172.21.15.192:0/23857828 wait complete. 2024-09-13T18:45:45.830 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.979+0000 7f6104c00640 1 Processor -- start 2024-09-13T18:45:45.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.980+0000 7f6104c00640 1 -- start start 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f6104c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61000cacd0 0x7f610015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f6104c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f610015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f6104c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6100140480 con 0x7f6100140980 2024-09-13T18:45:45.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f6104c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f610015c160 con 0x7f61000cacd0 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f6104c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f610015ee90 con 0x7f61000cb0b0 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f60fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61000cacd0 0x7f610015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f60fe800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6100140980 0x7f61000afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46586/0 (socket says 172.21.15.192:46586) 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f60fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f61000cacd0 0x7f610015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59836/0 (socket says 172.21.15.192:59836) 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f60fe800640 1 -- 172.21.15.192:0/449718642 learned_addr learned my addr 172.21.15.192:0/449718642 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.981+0000 7f60fd400640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f610015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fde00640 1 -- 172.21.15.192:0/449718642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 msgr2=0x7f610015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fde00640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f610015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fde00640 1 -- 172.21.15.192:0/449718642 >> v1:172.21.15.192:6789/0 conn(0x7f6100140980 legacy=0x7f61000afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fde00640 1 -- 172.21.15.192:0/449718642 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f610015f170 con 0x7f61000cacd0 2024-09-13T18:45:45.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fca00640 1 -- 172.21.15.192:0/449718642 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358214609 0 0) 0x7f6100140480 con 0x7f6100140980 2024-09-13T18:45:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.982+0000 7f60fde00640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61000cacd0 0x7f610015e790 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009d90 tx=0x7f60f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14a94f189c9f92 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f60fca00640 1 -- 172.21.15.192:0/449718642 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007740 con 0x7f61000cacd0 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f60fca00640 1 -- 172.21.15.192:0/449718642 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f002d050 con 0x7f61000cacd0 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f60fca00640 1 -- 172.21.15.192:0/449718642 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f0007ac0 con 0x7f61000cacd0 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 -- 172.21.15.192:0/449718642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61000cacd0 msgr2=0x7f610015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61000cacd0 0x7f610015e790 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f60f0009d90 tx=0x7f60f002a660 comp rx=0 tx=0).stop 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 -- 172.21.15.192:0/449718642 shutdown_connections 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f610015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 --2- 172.21.15.192:0/449718642 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f61000cacd0 0x7f610015e790 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.983+0000 7f6104c00640 1 -- 172.21.15.192:0/449718642 >> 172.21.15.192:0/449718642 conn(0x7f61000ae960 msgr2=0x7f610006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.984+0000 7f6104c00640 1 -- 172.21.15.192:0/449718642 shutdown_connections 2024-09-13T18:45:45.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.984+0000 7f6104c00640 1 -- 172.21.15.192:0/449718642 wait complete. 2024-09-13T18:45:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.985+0000 7f6104c00640 1 Processor -- start 2024-09-13T18:45:45.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.985+0000 7f6104c00640 1 -- start start 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000cacd0 0x7f6100154fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f6100157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61001561b0 con 0x7f6100140980 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6100156490 con 0x7f61000cacd0 2024-09-13T18:45:45.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f6104c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6100156770 con 0x7f61000cb0b0 2024-09-13T18:45:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f60fe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f60fe800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59850/0 (socket says 172.21.15.192:59850) 2024-09-13T18:45:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.986+0000 7f60fe800640 1 -- 172.21.15.192:0/1877571075 learned_addr learned my addr 172.21.15.192:0/1877571075 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fd400640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f6100157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fde00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000cacd0 0x7f6100154fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 -- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 msgr2=0x7f6100157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f6100157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 -- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000cacd0 msgr2=0x7f6100154fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000cacd0 0x7f6100154fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 -- 172.21.15.192:0/1877571075 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60f0009a70 con 0x7f6100140980 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60fe800640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c450 tx=0x7f60f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f80074e0 con 0x7f6100140980 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f8007660 con 0x7f6100140980 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f8004a20 con 0x7f6100140980 2024-09-13T18:45:45.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.987+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6100156a50 con 0x7f6100140980 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.988+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61001554e0 con 0x7f6100140980 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.989+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6100156f70 con 0x7f6100140980 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.989+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f60f8004b80 con 0x7f6100140980 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.990+0000 7f60f6000640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 0x7f60e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.990+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f60f8088160 con 0x7f6100140980 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.990+0000 7f60fde00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 0x7f60e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:45.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.991+0000 7f60fde00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 0x7f60e006d0c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f60f0034000 tx=0x7f60f002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:45.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:45.994+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6100156f70 con 0x7f6100140980 2024-09-13T18:45:46.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.221+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f6100156f70 con 0x7f6100140980 2024-09-13T18:45:46.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.446+0000 7f60f6000640 1 -- 172.21.15.192:0/1877571075 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v492) v1 ==== 132+0+0 (secure 0 0 0) 0x7f6100156f70 con 0x7f6100140980 2024-09-13T18:45:46.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.448+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 msgr2=0x7f60e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.448+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 0x7f60e006d0c0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f60f0034000 tx=0x7f60f002f000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.448+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 msgr2=0x7f61001557d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.448+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f60f800c450 tx=0x7f60f800c910 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 shutdown_connections 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f60e006ac00 0x7f60e006d0c0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6100140980 0x7f61001557d0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f61000cb0b0 0x7f6100157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 --2- 172.21.15.192:0/1877571075 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f61000cacd0 0x7f6100154fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 >> 172.21.15.192:0/1877571075 conn(0x7f61000ae960 msgr2=0x7f610013e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 shutdown_connections 2024-09-13T18:45:46.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.449+0000 7f6104c00640 1 -- 172.21.15.192:0/1877571075 wait complete. 2024-09-13T18:45:46.468 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-13T18:45:46.469 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2024-09-13T18:45:46.469 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2024-09-13T18:45:46.469 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:46.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.619+0000 7f6b90000640 1 Processor -- start 2024-09-13T18:45:46.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.619+0000 7f6b90000640 1 -- start start 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.620+0000 7f6b90000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 0x7f6b8815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b90000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880b2f00 con 0x7f6b880b0490 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b90000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b880b3150 con 0x7f6b8815dee0 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b90000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880b3430 con 0x7f6b880b3f10 2024-09-13T18:45:46.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b8e000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6b880b0490 0x7f6b8815a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46596/0 (socket says 172.21.15.192:46596) 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b8e000640 1 -- 172.21.15.192:0/422809829 learned_addr learned my addr 172.21.15.192:0/422809829 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/422809829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 0x7f6b8815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181624484 0 0) 0x7f6b880b2f00 con 0x7f6b880b0490 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b70005730 con 0x7f6b880b0490 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2835147487 0 0) 0x7f6b880b3150 con 0x7f6b8815dee0 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.621+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b880b2f00 con 0x7f6b8815dee0 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.622+0000 7f6b8cc00640 1 -- 172.21.15.192:0/422809829 >> v1:172.21.15.194:6789/0 conn(0x7f6b8815dee0 legacy=0x7f6b880afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.622+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 616075169 0 0) 0x7f6b70005730 con 0x7f6b880b0490 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.622+0000 7f6b8cc00640 1 -- 172.21.15.192:0/422809829 >> v1:172.21.15.192:6789/0 conn(0x7f6b880b0490 legacy=0x7f6b8815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.622+0000 7f6b8cc00640 1 -- 172.21.15.192:0/422809829 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b880b3710 con 0x7f6b880b3f10 2024-09-13T18:45:46.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/422809829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 0x7f6b8815a440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097d0 tx=0x7f6b7402a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=260cfb2524453206 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b800019f0 con 0x7f6b880b3f10 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7402ac30 con 0x7f6b880b3f10 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b87e00640 1 -- 172.21.15.192:0/422809829 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b74032440 con 0x7f6b880b3f10 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b90000640 1 -- 172.21.15.192:0/422809829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 msgr2=0x7f6b8815a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.623+0000 7f6b90000640 1 --2- 172.21.15.192:0/422809829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 0x7f6b8815a440 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097d0 tx=0x7f6b7402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.624+0000 7f6b90000640 1 -- 172.21.15.192:0/422809829 shutdown_connections 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.624+0000 7f6b90000640 1 --2- 172.21.15.192:0/422809829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880b3f10 0x7f6b8815a440 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.624+0000 7f6b90000640 1 -- 172.21.15.192:0/422809829 >> 172.21.15.192:0/422809829 conn(0x7f6b880ae960 msgr2=0x7f6b8806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.624+0000 7f6b90000640 1 -- 172.21.15.192:0/422809829 shutdown_connections 2024-09-13T18:45:46.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.624+0000 7f6b90000640 1 -- 172.21.15.192:0/422809829 wait complete. 2024-09-13T18:45:46.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.625+0000 7f6b90000640 1 Processor -- start 2024-09-13T18:45:46.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.625+0000 7f6b90000640 1 -- start start 2024-09-13T18:45:46.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 0x7f6b8813f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.629 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880ad840 0x7f6b880adcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b881f3df0 con 0x7f6b880b0490 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b880ae230 con 0x7f6b8815dee0 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.626+0000 7f6b90000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8813f430 con 0x7f6b880ad840 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59858/0 (socket says 172.21.15.192:59858) 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 -- 172.21.15.192:0/1052905647 learned_addr learned my addr 172.21.15.192:0/1052905647 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 0x7f6b8813f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8e000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880ad840 0x7f6b880adcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 -- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880ad840 msgr2=0x7f6b880adcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880ad840 0x7f6b880adcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 -- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 msgr2=0x7f6b8813f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 0x7f6b8813f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 -- 172.21.15.192:0/1052905647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b74009400 con 0x7f6b880b0490 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 0x7f6b8813f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.627+0000 7f6b8d600640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c430 tx=0x7f6b7c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.628+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c0052d0 con 0x7f6b880b0490 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.628+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7c005450 con 0x7f6b880b0490 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.628+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7c003830 con 0x7f6b880b0490 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.628+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8806bd70 con 0x7f6b880b0490 2024-09-13T18:45:46.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.628+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8813f0c0 con 0x7f6b880b0490 2024-09-13T18:45:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.629+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b880afd80 con 0x7f6b880b0490 2024-09-13T18:45:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.630+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6b7c003990 con 0x7f6b880b0490 2024-09-13T18:45:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.630+0000 7f6b85600640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 0x7f6b6806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.631+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6b7c088590 con 0x7f6b880b0490 2024-09-13T18:45:46.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.631+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 0x7f6b6806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.631+0000 7f6b8cc00640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 0x7f6b6806d0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b74034000 tx=0x7f6b7402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.634+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6b7c053b20 con 0x7f6b880b0490 2024-09-13T18:45:46.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.804+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b881598c0 con 0x7f6b880b0490 2024-09-13T18:45:46.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.805+0000 7f6b85600640 1 -- 172.21.15.192:0/1052905647 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+13059 (secure 0 0 0) 0x7f6b7c057140 con 0x7f6b880b0490 2024-09-13T18:45:46.808 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:46.808 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":171,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:45.437435+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/3537056060":"2024-09-14T18:45:42.422232+0000","172.21.15.192:6836/3537056060":"2024-09-14T18:45:42.422232+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 msgr2=0x7f6b6806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 0x7f6b6806d0c0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6b74034000 tx=0x7f6b7402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 msgr2=0x7f6b881f38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c00c430 tx=0x7f6b7c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 shutdown_connections 2024-09-13T18:45:46.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6b6806ac00 0x7f6b6806d0c0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6b880ad840 0x7f6b880adcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6b8815dee0 0x7f6b8813f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 --2- 172.21.15.192:0/1052905647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b880b0490 0x7f6b881f38b0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 >> 172.21.15.192:0/1052905647 conn(0x7f6b880ae960 msgr2=0x7f6b8815cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 shutdown_connections 2024-09-13T18:45:46.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.807+0000 7f6b90000640 1 -- 172.21.15.192:0/1052905647 wait complete. 2024-09-13T18:45:46.826 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:46.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:46.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.979+0000 7f8060400640 1 Processor -- start 2024-09-13T18:45:46.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.979+0000 7f8060400640 1 -- start start 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f8060400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f805806c800 0x7f80580b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f8060400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 0x7f805806e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f8060400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f805806cc70 con 0x7f80581434c0 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f8060400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580ce770 con 0x7f805806c800 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f8060400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80580b4040 con 0x7f80580b3bd0 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.980+0000 7f805d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f805806c800 0x7f80580b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f805806c800 0x7f80580b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59866/0 (socket says 172.21.15.192:59866) 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805da00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f80581434c0 0x7f805806a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46602/0 (socket says 172.21.15.192:46602) 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 -- 172.21.15.192:0/984757498 learned_addr learned my addr 172.21.15.192:0/984757498 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805e400640 1 --2- 172.21.15.192:0/984757498 >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 0x7f805806e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 -- 172.21.15.192:0/984757498 >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 msgr2=0x7f805806e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:46.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 --2- 172.21.15.192:0/984757498 >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 0x7f805806e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 -- 172.21.15.192:0/984757498 >> v1:172.21.15.192:6789/0 conn(0x7f80581434c0 legacy=0x7f805806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805d000640 1 -- 172.21.15.192:0/984757498 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f805806b480 con 0x7f805806c800 2024-09-13T18:45:46.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.981+0000 7f805e400640 1 --2- 172.21.15.192:0/984757498 >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 0x7f805806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.982+0000 7f805d000640 1 --2- 172.21.15.192:0/984757498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f805806c800 0x7f80580b3690 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8044009870 tx=0x7f804402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c5cf6b86544942 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.982+0000 7f8057e00640 1 -- 172.21.15.192:0/984757498 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044032440 con 0x7f805806c800 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.982+0000 7f8057e00640 1 -- 172.21.15.192:0/984757498 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80440325a0 con 0x7f805806c800 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.982+0000 7f8057e00640 1 -- 172.21.15.192:0/984757498 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044032930 con 0x7f805806c800 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 -- 172.21.15.192:0/984757498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f805806c800 msgr2=0x7f80580b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 --2- 172.21.15.192:0/984757498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f805806c800 0x7f80580b3690 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f8044009870 tx=0x7f804402a230 comp rx=0 tx=0).stop 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 -- 172.21.15.192:0/984757498 shutdown_connections 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 --2- 172.21.15.192:0/984757498 >> v2:172.21.15.194:3300/0 conn(0x7f80580b3bd0 0x7f805806e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 --2- 172.21.15.192:0/984757498 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f805806c800 0x7f80580b3690 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 -- 172.21.15.192:0/984757498 >> 172.21.15.192:0/984757498 conn(0x7f80580b08f0 msgr2=0x7f80580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:46.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 -- 172.21.15.192:0/984757498 shutdown_connections 2024-09-13T18:45:46.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.983+0000 7f8060400640 1 -- 172.21.15.192:0/984757498 wait complete. 2024-09-13T18:45:46.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.985+0000 7f8060400640 1 Processor -- start 2024-09-13T18:45:46.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.985+0000 7f8060400640 1 -- start start 2024-09-13T18:45:46.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 0x7f8058139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 0x7f80581eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80581f3880 con 0x7f80581434c0 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f805813a590 con 0x7f80580b3bd0 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f8060400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f805813a870 con 0x7f805806c800 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59876/0 (socket says 172.21.15.192:59876) 2024-09-13T18:45:46.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 -- 172.21.15.192:0/57193628 learned_addr learned my addr 172.21.15.192:0/57193628 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805da00640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 0x7f8058139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805d000640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 0x7f80581eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 -- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 msgr2=0x7f8058139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 0x7f8058139fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 -- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 msgr2=0x7f80581eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 0x7f80581eff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805e400640 1 -- 172.21.15.192:0/57193628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80440094d0 con 0x7f80581434c0 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805d000640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 0x7f80581eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.986+0000 7f805da00640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 0x7f8058139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f805e400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f805000cef0 tx=0x7f805000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805000d840 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f805000d9c0 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f805000dd70 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f805813ab50 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.987+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8058070af0 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.988+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80580cc7d0 con 0x7f80581434c0 2024-09-13T18:45:46.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.989+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f805001e3b0 con 0x7f80581434c0 2024-09-13T18:45:46.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.990+0000 7f8055600640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 0x7f803806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:46.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.990+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8050089b40 con 0x7f80581434c0 2024-09-13T18:45:46.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.990+0000 7f805da00640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 0x7f803806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:46.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.991+0000 7f805da00640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 0x7f803806d0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f804c000f60 tx=0x7f804c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:46.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:46.995+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f80500550d0 con 0x7f80581434c0 2024-09-13T18:45:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.163+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f805813cdc0 con 0x7f80581434c0 2024-09-13T18:45:47.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.163+0000 7f8055600640 1 -- 172.21.15.192:0/57193628 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v171) v1 ==== 93+0+10 (secure 0 0 0) 0x7f805001a020 con 0x7f80581434c0 2024-09-13T18:45:47.166 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 msgr2=0x7f803806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 0x7f803806d0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f804c000f60 tx=0x7f804c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 msgr2=0x7f80581f3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f805000cef0 tx=0x7f805000a710 comp rx=0 tx=0).stop 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 shutdown_connections 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f803806ac00 0x7f803806d0c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f80581434c0 0x7f80581f3340 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f80580b3bd0 0x7f80581eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 --2- 172.21.15.192:0/57193628 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f805806c800 0x7f8058139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 >> 172.21.15.192:0/57193628 conn(0x7f80580b08f0 msgr2=0x7f80580af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 shutdown_connections 2024-09-13T18:45:47.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.166+0000 7f8060400640 1 -- 172.21.15.192:0/57193628 wait complete. 2024-09-13T18:45:47.185 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-13T18:45:47.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.335+0000 7f8882000640 1 Processor -- start 2024-09-13T18:45:47.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.335+0000 7f8882000640 1 -- start start 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8882000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f887c0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8882000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0ccec0 con 0x7f887c071810 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8882000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c071dd0 con 0x7f887c150480 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8882000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0cb770 con 0x7f887c0cc530 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8873e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f887c071810 0x7f887c0b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46614/0 (socket says 172.21.15.192:46614) 2024-09-13T18:45:47.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.336+0000 7f8873e00640 1 -- 172.21.15.192:0/2281172194 learned_addr learned my addr 172.21.15.192:0/2281172194 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887be00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f887c0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630831663 0 0) 0x7f887c0ccec0 con 0x7f887c071810 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8860003520 con 0x7f887c071810 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3723522990 0 0) 0x7f8860003520 con 0x7f887c071810 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 msgr2=0x7f887c0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f887c0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 >> v1:172.21.15.194:6789/0 conn(0x7f887c150480 legacy=0x7f887c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c0cba50 con 0x7f887c071810 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f8864001670 con 0x7f887c071810 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 >> v1:172.21.15.192:6789/0 conn(0x7f887c071810 legacy=0x7f887c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88600039a0 0x7f8860003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860004350 0x7f8860004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f8860005120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0cb770 con 0x7f88600039a0 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886000ba60 con 0x7f8860004350 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.337+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886000de30 con 0x7f887c0cc530 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88600039a0 0x7f8860003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887be00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f8860005120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f8873e00640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860004350 0x7f8860004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 -- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 msgr2=0x7f8860005120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f887c0cc530 0x7f8860005120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 -- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860004350 msgr2=0x7f8860004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:47.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8860004350 0x7f8860004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.343 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.338+0000 7f887b400640 1 -- 172.21.15.192:0/2281172194 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8860003520 con 0x7f88600039a0 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.339+0000 7f887b400640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88600039a0 0x7f8860003d80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f886c001910 tx=0x7f88600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbf3c80813ef569 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.339+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c02ac60 con 0x7f88600039a0 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.339+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886c02adc0 con 0x7f88600039a0 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.339+0000 7f887aa00640 1 -- 172.21.15.192:0/2281172194 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886c032660 con 0x7f88600039a0 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 -- 172.21.15.192:0/2281172194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88600039a0 msgr2=0x7f8860003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 --2- 172.21.15.192:0/2281172194 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f88600039a0 0x7f8860003d80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f886c001910 tx=0x7f88600057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.344 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f887be00640 1 -- 172.21.15.192:0/2281172194 reap_dead start 2024-09-13T18:45:47.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 -- 172.21.15.192:0/2281172194 shutdown_connections 2024-09-13T18:45:47.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 -- 172.21.15.192:0/2281172194 >> 172.21.15.192:0/2281172194 conn(0x7f887c0ae960 msgr2=0x7f887c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:47.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 -- 172.21.15.192:0/2281172194 shutdown_connections 2024-09-13T18:45:47.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.340+0000 7f8882000640 1 -- 172.21.15.192:0/2281172194 wait complete. 2024-09-13T18:45:47.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.342+0000 7f8882000640 1 Processor -- start 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.342+0000 7f8882000640 1 -- start start 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88600039a0 0x7f887c14e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887c154ef0 0x7f887c06aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0ae200 con 0x7f887c0ad840 2024-09-13T18:45:47.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c156290 con 0x7f887c154ef0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8882000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c06b0e0 con 0x7f88600039a0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59896/0 (socket says 172.21.15.192:59896) 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 -- 172.21.15.192:0/158200025 learned_addr learned my addr 172.21.15.192:0/158200025 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887b400640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88600039a0 0x7f887c14e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f8873e00640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887c154ef0 0x7f887c06aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 -- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88600039a0 msgr2=0x7f887c14e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88600039a0 0x7f887c14e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 -- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887c154ef0 msgr2=0x7f887c06aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887c154ef0 0x7f887c06aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.343+0000 7f887be00640 1 -- 172.21.15.192:0/158200025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c155680 con 0x7f887c0ad840 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f887be00640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f887c0b4d40 tx=0x7f88740075c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874003990 con 0x7f887c0ad840 2024-09-13T18:45:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874010040 con 0x7f887c0ad840 2024-09-13T18:45:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874003d10 con 0x7f887c0ad840 2024-09-13T18:45:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c155960 con 0x7f887c0ad840 2024-09-13T18:45:47.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.344+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c155f20 con 0x7f887c0ad840 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.345+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c157230 con 0x7f887c0ad840 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.346+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8874004030 con 0x7f887c0ad840 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.347+0000 7f8873400640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 0x7f885806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.347+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8874089070 con 0x7f887c0ad840 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.347+0000 7f887b400640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 0x7f885806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:47.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.348+0000 7f887b400640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 0x7f885806d0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f886c034000 tx=0x7f886c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:47.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.351+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f887c157230 con 0x7f887c0ad840 2024-09-13T18:45:47.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:47.580+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f887c157230 con 0x7f887c0ad840 2024-09-13T18:45:48.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.458+0000 7f8873400640 1 -- 172.21.15.192:0/158200025 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v494) v1 ==== 134+0+0 (secure 0 0 0) 0x7f887c157230 con 0x7f887c0ad840 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 msgr2=0x7f885806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 0x7f885806d0f0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f886c034000 tx=0x7f886c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 msgr2=0x7f887c0adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7f887c0b4d40 tx=0x7f88740075c0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 shutdown_connections 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f885806ac30 0x7f885806d0f0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f887c0ad840 0x7f887c0adcc0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f887c154ef0 0x7f887c06aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 --2- 172.21.15.192:0/158200025 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f88600039a0 0x7f887c14e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 >> 172.21.15.192:0/158200025 conn(0x7f887c0ae960 msgr2=0x7f887c15abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 shutdown_connections 2024-09-13T18:45:48.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.461+0000 7f8882000640 1 -- 172.21.15.192:0/158200025 wait complete. 2024-09-13T18:45:48.483 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:45:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.643+0000 7f3d96800640 1 Processor -- start 2024-09-13T18:45:48.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.643+0000 7f3d96800640 1 -- start start 2024-09-13T18:45:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.644+0000 7f3d96800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3d901434c0 0x7f3d9006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.644+0000 7f3d96800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9006b480 con 0x7f3d900b3da0 2024-09-13T18:45:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.644+0000 7f3d96800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d9006b760 con 0x7f3d9006a8b0 2024-09-13T18:45:48.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.644+0000 7f3d96800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900ce770 con 0x7f3d901434c0 2024-09-13T18:45:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3d900b3da0 0x7f3d9006e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:46618/0 (socket says 172.21.15.192:46618) 2024-09-13T18:45:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8fe00640 1 -- 172.21.15.192:0/4218952337 learned_addr learned my addr 172.21.15.192:0/4218952337 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:48.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8f400640 1 --2- 172.21.15.192:0/4218952337 >> v2:172.21.15.194:3300/0 conn(0x7f3d901434c0 0x7f3d9006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142793160 0 0) 0x7f3d9006b480 con 0x7f3d900b3da0 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d74003520 con 0x7f3d900b3da0 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375327979 0 0) 0x7f3d9006b760 con 0x7f3d9006a8b0 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d9006b480 con 0x7f3d9006a8b0 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8f400640 1 -- 172.21.15.192:0/4218952337 >> v1:172.21.15.194:6789/0 conn(0x7f3d9006a8b0 legacy=0x7f3d900b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8f400640 1 -- 172.21.15.192:0/4218952337 >> v1:172.21.15.192:6789/0 conn(0x7f3d900b3da0 legacy=0x7f3d9006e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.645+0000 7f3d8f400640 1 -- 172.21.15.192:0/4218952337 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9006ba40 con 0x7f3d901434c0 2024-09-13T18:45:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.646+0000 7f3d8f400640 1 --2- 172.21.15.192:0/4218952337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d901434c0 0x7f3d9006c800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097a0 tx=0x7f3d8002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=842d5be66b25959b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.647+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80032440 con 0x7f3d901434c0 2024-09-13T18:45:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.647+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d800325a0 con 0x7f3d901434c0 2024-09-13T18:45:48.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.647+0000 7f3d8e000640 1 -- 172.21.15.192:0/4218952337 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80032930 con 0x7f3d901434c0 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.647+0000 7f3d96800640 1 -- 172.21.15.192:0/4218952337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d901434c0 msgr2=0x7f3d9006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.647+0000 7f3d96800640 1 --2- 172.21.15.192:0/4218952337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d901434c0 0x7f3d9006c800 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3d800097a0 tx=0x7f3d8002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.648+0000 7f3d96800640 1 -- 172.21.15.192:0/4218952337 shutdown_connections 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.648+0000 7f3d96800640 1 --2- 172.21.15.192:0/4218952337 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d901434c0 0x7f3d9006c800 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.648+0000 7f3d96800640 1 -- 172.21.15.192:0/4218952337 >> 172.21.15.192:0/4218952337 conn(0x7f3d900b08f0 msgr2=0x7f3d900b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.648+0000 7f3d96800640 1 -- 172.21.15.192:0/4218952337 shutdown_connections 2024-09-13T18:45:48.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.648+0000 7f3d96800640 1 -- 172.21.15.192:0/4218952337 wait complete. 2024-09-13T18:45:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.649+0000 7f3d96800640 1 Processor -- start 2024-09-13T18:45:48.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.649+0000 7f3d96800640 1 -- start start 2024-09-13T18:45:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 0x7f3d90153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 0x7f3d90150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9014f740 con 0x7f3d900b3da0 2024-09-13T18:45:48.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9014eb30 con 0x7f3d9006a8b0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d96800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9014ee10 con 0x7f3d901434c0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.650+0000 7f3d8ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59910/0 (socket says 172.21.15.192:59910) 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 -- 172.21.15.192:0/3415129444 learned_addr learned my addr 172.21.15.192:0/3415129444 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8fe00640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 0x7f3d90150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8f400640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 0x7f3d90153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 -- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 msgr2=0x7f3d90150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 0x7f3d90150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 -- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 msgr2=0x7f3d90153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 0x7f3d90153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 -- 172.21.15.192:0/3415129444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009400 con 0x7f3d900b3da0 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8fe00640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 0x7f3d90150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8f400640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 0x7f3d90153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:48.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d8ea00640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00c490 tx=0x7f3d7c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c0052d0 con 0x7f3d900b3da0 2024-09-13T18:45:48.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d7c005430 con 0x7f3d900b3da0 2024-09-13T18:45:48.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.651+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c012870 con 0x7f3d900b3da0 2024-09-13T18:45:48.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.652+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9014f0f0 con 0x7f3d900b3da0 2024-09-13T18:45:48.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.652+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d90150e50 con 0x7f3d900b3da0 2024-09-13T18:45:48.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.653+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d900cc7d0 con 0x7f3d900b3da0 2024-09-13T18:45:48.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.654+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3d7c0129d0 con 0x7f3d900b3da0 2024-09-13T18:45:48.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.654+0000 7f3d87400640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 0x7f3d7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:48.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.654+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3d7c088da0 con 0x7f3d900b3da0 2024-09-13T18:45:48.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.655+0000 7f3d8f400640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 0x7f3d7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:48.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.655+0000 7f3d8f400640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 0x7f3d7006d0c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3d80034000 tx=0x7f3d8002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:48.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.658+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3d7c054150 con 0x7f3d900b3da0 2024-09-13T18:45:48.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.827+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3d9015c880 con 0x7f3d900b3da0 2024-09-13T18:45:48.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.833+0000 7f3d87400640 1 -- 172.21.15.192:0/3415129444 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3d7c057770 con 0x7f3d900b3da0 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 msgr2=0x7f3d7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 0x7f3d7006d0c0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f3d80034000 tx=0x7f3d8002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 msgr2=0x7f3d9014e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c00c490 tx=0x7f3d7c00c950 comp rx=0 tx=0).stop 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 shutdown_connections 2024-09-13T18:45:48.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d7006ac00 0x7f3d7006d0c0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d901434c0 0x7f3d90150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d900b3da0 0x7f3d9014e070 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 --2- 172.21.15.192:0/3415129444 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d9006a8b0 0x7f3d90153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 >> 172.21.15.192:0/3415129444 conn(0x7f3d900b08f0 msgr2=0x7f3d900ae890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 shutdown_connections 2024-09-13T18:45:48.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:48.835+0000 7f3d96800640 1 -- 172.21.15.192:0/3415129444 wait complete. 2024-09-13T18:45:48.854 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:45:48.854 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:45:48.961 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:45:49.064 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:45:49.064 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:45:49.064 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:49.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:45:49.100 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:45:49.100 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:49.137 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:45:49.138 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:45:49.138 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:49.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:45:49.175 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:45:49.175 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:45:49.215 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:45:49.215 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:45:49.216 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:49.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.365+0000 7f080fa00640 1 Processor -- start 2024-09-13T18:45:49.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.365+0000 7f080fa00640 1 -- start start 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080fa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08080cacd0 0x7f080815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080fa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f08080afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080fa00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0808140480 con 0x7f08080cb0b0 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080fa00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08080cb520 con 0x7f08080cacd0 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080fa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080815ee90 con 0x7f080815bc20 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.366+0000 7f080d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08080cacd0 0x7f080815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f08080cacd0 0x7f080815e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59912/0 (socket says 172.21.15.192:59912) 2024-09-13T18:45:49.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 -- 172.21.15.192:0/4036266834 learned_addr learned my addr 172.21.15.192:0/4036266834 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:49.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080da00640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f08080afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 -- 172.21.15.192:0/4036266834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 msgr2=0x7f08080afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f08080afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 -- 172.21.15.192:0/4036266834 >> v1:172.21.15.194:6789/0 conn(0x7f08080cb0b0 legacy=0x7f0808140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.367+0000 7f080d000640 1 -- 172.21.15.192:0/4036266834 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080815f170 con 0x7f08080cacd0 2024-09-13T18:45:49.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.368+0000 7f080d000640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cacd0 0x7f080815e790 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009870 tx=0x7f07fc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e86c8052b571a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.368+0000 7f0807400640 1 -- 172.21.15.192:0/4036266834 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc032440 con 0x7f08080cacd0 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.368+0000 7f0807400640 1 -- 172.21.15.192:0/4036266834 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07fc0325a0 con 0x7f08080cacd0 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.368+0000 7f0807400640 1 -- 172.21.15.192:0/4036266834 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc032930 con 0x7f08080cacd0 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 -- 172.21.15.192:0/4036266834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cacd0 msgr2=0x7f080815e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cacd0 0x7f080815e790 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009870 tx=0x7f07fc02a270 comp rx=0 tx=0).stop 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 -- 172.21.15.192:0/4036266834 shutdown_connections 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f08080afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 --2- 172.21.15.192:0/4036266834 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cacd0 0x7f080815e790 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 -- 172.21.15.192:0/4036266834 >> 172.21.15.192:0/4036266834 conn(0x7f08080ae960 msgr2=0x7f080806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 -- 172.21.15.192:0/4036266834 shutdown_connections 2024-09-13T18:45:49.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.369+0000 7f080fa00640 1 -- 172.21.15.192:0/4036266834 wait complete. 2024-09-13T18:45:49.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.370+0000 7f080fa00640 1 Processor -- start 2024-09-13T18:45:49.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 -- start start 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08080cacd0 0x7f080806bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f080815a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080806a950 con 0x7f08080cb0b0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080806c010 con 0x7f08080cacd0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.371+0000 7f080fa00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080806a020 con 0x7f080815bc20 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59918/0 (socket says 172.21.15.192:59918) 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 -- 172.21.15.192:0/2749765712 learned_addr learned my addr 172.21.15.192:0/2749765712 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f080d000640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08080cacd0 0x7f080806bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f080da00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f080815a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 -- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 msgr2=0x7f080815a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f080815a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 -- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08080cacd0 msgr2=0x7f080806bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08080cacd0 0x7f080806bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 -- 172.21.15.192:0/2749765712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc0094d0 con 0x7f08080cb0b0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0807e00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c400 tx=0x7f07f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.372+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40052d0 con 0x7f08080cb0b0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.373+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4005430 con 0x7f08080cb0b0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.373+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4003830 con 0x7f08080cb0b0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.373+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080806a300 con 0x7f08080cb0b0 2024-09-13T18:45:49.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.373+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080806ade0 con 0x7f08080cb0b0 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.374+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f080806ab00 con 0x7f08080cb0b0 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.374+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07f4003990 con 0x7f08080cb0b0 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.375+0000 7f0804c00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 0x7f07e806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.375+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07f40885d0 con 0x7f08080cb0b0 2024-09-13T18:45:49.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.375+0000 7f080d000640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 0x7f07e806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.376+0000 7f080d000640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 0x7f07e806d0c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034000 tx=0x7f07fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.379+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f080806ab00 con 0x7f08080cb0b0 2024-09-13T18:45:49.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.581+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f080815e790 con 0x7f08080cb0b0 2024-09-13T18:45:49.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.581+0000 7f0804c00640 1 -- 172.21.15.192:0/2749765712 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f07f4017df0 con 0x7f08080cb0b0 2024-09-13T18:45:49.584 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:49.584 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6746,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6833/3122191019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3122191019},{"type":"v1","addr":"172.21.15.194:6833","nonce":3122191019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7705,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/330316445","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":330316445},{"type":"v1","addr":"172.21.15.192:6835","nonce":330316445}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":7714,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/3677695029","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6834","nonce":3677695029},{"type":"v1","addr":"172.21.15.194:6835","nonce":3677695029}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65},{"gid":8505,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/3973206110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":3973206110},{"type":"v1","addr":"172.21.15.192:6837","nonce":3973206110}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2024-09-13T18:45:49.585 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 72 2024-09-13T18:45:49.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 msgr2=0x7f07e806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 0x7f07e806d0c0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f07fc034000 tx=0x7f07fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 msgr2=0x7f080813c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f07f400c400 tx=0x7f07f400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 shutdown_connections 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e806ac00 0x7f07e806d0c0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080815bc20 0x7f080815a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08080cb0b0 0x7f080813c8b0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 --2- 172.21.15.192:0/2749765712 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08080cacd0 0x7f080806bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.583+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 >> 172.21.15.192:0/2749765712 conn(0x7f08080ae960 msgr2=0x7f0808071630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.584+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 shutdown_connections 2024-09-13T18:45:49.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.584+0000 7f080fa00640 1 -- 172.21.15.192:0/2749765712 wait complete. 2024-09-13T18:45:49.602 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:45:49.602 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:45:49.603 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:45:49.603 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:49.603 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:45:49.603 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:45:49.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:45:49.603 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:49.603 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:45:49.603 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:45:49.604 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:45:49.604 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:49.604 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:45:49.604 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:45:49.604 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:45:49.604 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:45:49.619 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:45:49.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:45:49.621 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:45:49.621 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:45:49.624 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:45:49.624 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:45:49.624 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:45:49.625 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:45:49.627 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:45:49.627 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.629 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:45:49.630 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.670 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:45:49.671 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.673 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:45:49.674 DEBUG:teuthology.parallel:result is None 2024-09-13T18:45:49.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:45:49.755 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:45:49.756 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:45:49.804 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:45:49.805 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:45:49.806 INFO:tasks.ceph.mds.d.smithi194.stderr:2024-09-13T18:45:49.804+0000 7f8838200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.834+0000 7feb84c00640 1 Processor -- start 2024-09-13T18:45:49.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.834+0000 7feb84c00640 1 -- start start 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb84c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb8015e790 0x7feb800cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb84c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb8015bc20 0x7feb800afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb84c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb8015ec00 con 0x7feb800cacd0 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb84c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb800cb5f0 con 0x7feb8015e790 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb84c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb80140480 con 0x7feb8015bc20 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb8015e790 0x7feb800cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb8015e790 0x7feb800cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:59942/0 (socket says 172.21.15.192:59942) 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 -- 172.21.15.192:0/3966082843 learned_addr learned my addr 172.21.15.192:0/3966082843 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb7e800640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb8015bc20 0x7feb800afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 -- 172.21.15.192:0/3966082843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb8015bc20 msgr2=0x7feb800afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb8015bc20 0x7feb800afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 -- 172.21.15.192:0/3966082843 >> v1:172.21.15.194:6789/0 conn(0x7feb800cacd0 legacy=0x7feb80140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.836+0000 7feb77e00640 1 -- 172.21.15.192:0/3966082843 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8015ee90 con 0x7feb8015e790 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.837+0000 7feb77e00640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb800cb0b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feb68009870 tx=0x7feb6802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da450e306e5e773 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.837+0000 7feb7d400640 1 -- 172.21.15.192:0/3966082843 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68032440 con 0x7feb8015e790 2024-09-13T18:45:49.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb7d400640 1 -- 172.21.15.192:0/3966082843 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb680325a0 con 0x7feb8015e790 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb7d400640 1 -- 172.21.15.192:0/3966082843 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb68032930 con 0x7feb8015e790 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 -- 172.21.15.192:0/3966082843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 msgr2=0x7feb800cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb800cb0b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7feb68009870 tx=0x7feb6802a270 comp rx=0 tx=0).stop 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 -- 172.21.15.192:0/3966082843 shutdown_connections 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb8015bc20 0x7feb800afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 --2- 172.21.15.192:0/3966082843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb800cb0b0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 -- 172.21.15.192:0/3966082843 >> 172.21.15.192:0/3966082843 conn(0x7feb800ae960 msgr2=0x7feb8006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 -- 172.21.15.192:0/3966082843 shutdown_connections 2024-09-13T18:45:49.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.838+0000 7feb84c00640 1 -- 172.21.15.192:0/3966082843 wait complete. 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.840+0000 7feb84c00640 1 Processor -- start 2024-09-13T18:45:49.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.840+0000 7feb84c00640 1 -- start start 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 0x7feb8006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb80159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8015a7c0 con 0x7feb8015e790 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb80159bb0 con 0x7feb8015bc20 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb84c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb80159e90 con 0x7feb800cacd0 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb7de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb7e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb80159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb77e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 0x7feb8006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb7de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:48692/0 (socket says 172.21.15.192:48692) 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.841+0000 7feb7de00640 1 -- 172.21.15.192:0/4044874374 learned_addr learned my addr 172.21.15.192:0/4044874374 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 -- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 msgr2=0x7feb8006a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 0x7feb8006a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 -- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 msgr2=0x7feb80159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb80159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 -- 172.21.15.192:0/4044874374 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb680094d0 con 0x7feb800cacd0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb77e00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 0x7feb8006a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb7de00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c400 tx=0x7feb7000c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700052d0 con 0x7feb800cacd0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb70005430 con 0x7feb800cacd0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb8015a170 con 0x7feb800cacd0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb70003830 con 0x7feb800cacd0 2024-09-13T18:45:49.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.842+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb8006adb0 con 0x7feb800cacd0 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.843+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb8006af40 con 0x7feb800cacd0 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.844+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb70003990 con 0x7feb800cacd0 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.845+0000 7feb76000640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 0x7feb5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.845+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 4943+0+0 (secure 0 0 0) 0x7feb700885b0 con 0x7feb800cacd0 2024-09-13T18:45:49.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.845+0000 7feb77e00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 0x7feb5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:49.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.846+0000 7feb77e00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 0x7feb5c06d0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb68034000 tx=0x7feb6802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:49.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:49.850+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb70053aa0 con 0x7feb800cacd0 2024-09-13T18:45:50.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.030+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7feb80159fd0 con 0x7feb800cacd0 2024-09-13T18:45:50.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.847+0000 7feb76000640 1 -- 172.21.15.192:0/4044874374 <== mon.2 v2:172.21.15.194:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v176) v1 ==== 97+0+0 (secure 0 0 0) 0x7feb80159fd0 con 0x7feb800cacd0 2024-09-13T18:45:50.851 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:45:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 msgr2=0x7feb5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 0x7feb5c06d0f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7feb68034000 tx=0x7feb6802e000 comp rx=0 tx=0).stop 2024-09-13T18:45:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 msgr2=0x7feb8015ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7feb7000c400 tx=0x7feb7000c8c0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 shutdown_connections 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb5c06ac30 0x7feb5c06d0f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb8015e790 0x7feb80159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb8015bc20 0x7feb8006a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 --2- 172.21.15.192:0/4044874374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb800cacd0 0x7feb8015ac50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 >> 172.21.15.192:0/4044874374 conn(0x7feb800ae960 msgr2=0x7feb80140980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 shutdown_connections 2024-09-13T18:45:50.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:50.850+0000 7feb84c00640 1 -- 172.21.15.192:0/4044874374 wait complete. 2024-09-13T18:45:50.871 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:45:51.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.023+0000 7f5588a00640 1 Processor -- start 2024-09-13T18:45:51.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.023+0000 7f5588a00640 1 -- start start 2024-09-13T18:45:51.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.024+0000 7f5588a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 0x7f55840afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.024+0000 7f5588a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f558415e2c0 0x7f558415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.024+0000 7f5588a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55840b2f00 con 0x7f55840b3f10 2024-09-13T18:45:51.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.024+0000 7f5588a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55840b3150 con 0x7f558415e2c0 2024-09-13T18:45:51.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.024+0000 7f5588a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55840b3430 con 0x7f558415dee0 2024-09-13T18:45:51.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.025+0000 7f5582800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f558415e2c0 0x7f558415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.025+0000 7f5581e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 0x7f55840afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.025+0000 7f5582800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f558415e2c0 0x7f558415ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44162/0 (socket says 172.21.15.192:44162) 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.025+0000 7f5582800640 1 -- 172.21.15.192:0/4272381120 learned_addr learned my addr 172.21.15.192:0/4272381120 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.026+0000 7f5582800640 1 -- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 msgr2=0x7f55840afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.026+0000 7f5582800640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 0x7f55840afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.026+0000 7f5582800640 1 -- 172.21.15.192:0/4272381120 >> v1:172.21.15.194:6789/0 conn(0x7f55840b3f10 legacy=0x7f558415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.026+0000 7f5582800640 1 -- 172.21.15.192:0/4272381120 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55840b3710 con 0x7f558415e2c0 2024-09-13T18:45:51.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.026+0000 7f5581e00640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 0x7f55840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:51.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5582800640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f558415ab50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f557c009e50 tx=0x7f557c02c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cab7406e5f17adc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5581400640 1 -- 172.21.15.192:0/4272381120 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c032610 con 0x7f558415e2c0 2024-09-13T18:45:51.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5581400640 1 -- 172.21.15.192:0/4272381120 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c02e040 con 0x7f558415e2c0 2024-09-13T18:45:51.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5581400640 1 -- 172.21.15.192:0/4272381120 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c032990 con 0x7f558415e2c0 2024-09-13T18:45:51.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 -- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 msgr2=0x7f558415ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f558415ab50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f557c009e50 tx=0x7f557c02c920 comp rx=0 tx=0).stop 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 -- 172.21.15.192:0/4272381120 shutdown_connections 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f558415ab50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 --2- 172.21.15.192:0/4272381120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f558415dee0 0x7f55840afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.027+0000 7f5588a00640 1 -- 172.21.15.192:0/4272381120 >> 172.21.15.192:0/4272381120 conn(0x7f55840ae960 msgr2=0x7f558406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.028+0000 7f5588a00640 1 -- 172.21.15.192:0/4272381120 shutdown_connections 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.028+0000 7f5588a00640 1 -- 172.21.15.192:0/4272381120 wait complete. 2024-09-13T18:45:51.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.029+0000 7f5588a00640 1 Processor -- start 2024-09-13T18:45:51.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.029+0000 7f5588a00640 1 -- start start 2024-09-13T18:45:51.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f55840ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55840add80 0x7f5584157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55840ae230 con 0x7f558415dee0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558413cbd0 con 0x7f558415e2c0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5588a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5584152ad0 con 0x7f55840add80 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5581e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5581e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37968/0 (socket says 172.21.15.192:37968) 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.030+0000 7f5581e00640 1 -- 172.21.15.192:0/1396536650 learned_addr learned my addr 172.21.15.192:0/1396536650 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5582800640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55840add80 0x7f5584157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5579400640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f55840ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 -- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55840add80 msgr2=0x7f5584157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55840add80 0x7f5584157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 -- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 msgr2=0x7f55840ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f55840ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 -- 172.21.15.192:0/1396536650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5574009400 con 0x7f558415dee0 2024-09-13T18:45:51.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5579400640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f55840ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5581e00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f557400ebe0 tx=0x7f557400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5574009760 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557400cbd0 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557400eee0 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.031+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f557c009b30 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.032+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5584153090 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.033+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55840afd80 con 0x7f558415dee0 2024-09-13T18:45:51.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.033+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5574013470 con 0x7f558415dee0 2024-09-13T18:45:51.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.034+0000 7f557aa00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 0x7f556006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.034+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55740892c0 con 0x7f558415dee0 2024-09-13T18:45:51.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.034+0000 7f5579400640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 0x7f556006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.035+0000 7f5579400640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 0x7f556006d0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.038+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5574054800 con 0x7f558415dee0 2024-09-13T18:45:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.265+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f558415cfd0 con 0x7f558415dee0 2024-09-13T18:45:51.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.266+0000 7f557aa00640 1 -- 172.21.15.192:0/1396536650 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5574057e20 con 0x7f558415dee0 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:45:51.269 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.270 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.271 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.272 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.273 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.274 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.275 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:45:51.276 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.277 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:45:51.278 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.279 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.280 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:45:51.281 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.282 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.283 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:45:51.283 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:45:51.283 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.283 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:45:51.283 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.284 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:45:51.285 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:45:51.286 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:45:51.287 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:45:51.288 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:45:51.288 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.288 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:51.288 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:45:51.288 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:45:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 msgr2=0x7f556006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 0x7f556006d0c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f556c007fd0 tx=0x7f556c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 msgr2=0x7f558413c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f557400ebe0 tx=0x7f557400c520 comp rx=0 tx=0).stop 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 shutdown_connections 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f556006ac00 0x7f556006d0c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55840add80 0x7f5584157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f558415e2c0 0x7f55840ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 --2- 172.21.15.192:0/1396536650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f558415dee0 0x7f558413c690 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 >> 172.21.15.192:0/1396536650 conn(0x7f55840ae960 msgr2=0x7f55840b25f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 shutdown_connections 2024-09-13T18:45:51.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.268+0000 7f5588a00640 1 -- 172.21.15.192:0/1396536650 wait complete. 2024-09-13T18:45:51.292 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:51.446 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.443+0000 7fb419c00640 1 Processor -- start 2024-09-13T18:45:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.444+0000 7fb419c00640 1 -- start start 2024-09-13T18:45:51.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb419c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb41406e990 0x7fb4140cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb419c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41406c5d0 con 0x7fb41415a9e0 2024-09-13T18:45:51.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb419c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4140b3920 con 0x7fb4140ce6c0 2024-09-13T18:45:51.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb419c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4140b3730 con 0x7fb41406e990 2024-09-13T18:45:51.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb413e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb41415a9e0 0x7fb41406ae90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45054/0 (socket says 172.21.15.192:45054) 2024-09-13T18:45:51.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb413e00640 1 -- 172.21.15.192:0/2306712204 learned_addr learned my addr 172.21.15.192:0/2306712204 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.445+0000 7fb413400640 1 --2- 172.21.15.192:0/2306712204 >> v2:172.21.15.194:3300/0 conn(0x7fb41406e990 0x7fb4140cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262989993 0 0) 0x7fb41406c5d0 con 0x7fb41415a9e0 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f8003520 con 0x7fb41415a9e0 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1959767529 0 0) 0x7fb3f8003520 con 0x7fb41415a9e0 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb413400640 1 -- 172.21.15.192:0/2306712204 >> v1:172.21.15.194:6789/0 conn(0x7fb4140ce6c0 legacy=0x7fb414070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb413400640 1 -- 172.21.15.192:0/2306712204 >> v1:172.21.15.192:6789/0 conn(0x7fb41415a9e0 legacy=0x7fb41406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.446+0000 7fb413400640 1 -- 172.21.15.192:0/2306712204 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4140b3c00 con 0x7fb41406e990 2024-09-13T18:45:51.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.447+0000 7fb413400640 1 --2- 172.21.15.192:0/2306712204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41406e990 0x7fb4140cd8c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb4000097a0 tx=0x7fb40002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac09f01cd0d6044 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.447+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4040019f0 con 0x7fb41406e990 2024-09-13T18:45:51.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.447+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40002ac50 con 0x7fb41406e990 2024-09-13T18:45:51.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.447+0000 7fb412a00640 1 -- 172.21.15.192:0/2306712204 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb400032440 con 0x7fb41406e990 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 -- 172.21.15.192:0/2306712204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41406e990 msgr2=0x7fb4140cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 --2- 172.21.15.192:0/2306712204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41406e990 0x7fb4140cd8c0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb4000097a0 tx=0x7fb40002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 -- 172.21.15.192:0/2306712204 shutdown_connections 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 --2- 172.21.15.192:0/2306712204 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41406e990 0x7fb4140cd8c0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 -- 172.21.15.192:0/2306712204 >> 172.21.15.192:0/2306712204 conn(0x7fb4140736d0 msgr2=0x7fb4140b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 -- 172.21.15.192:0/2306712204 shutdown_connections 2024-09-13T18:45:51.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.448+0000 7fb419c00640 1 -- 172.21.15.192:0/2306712204 wait complete. 2024-09-13T18:45:51.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.449+0000 7fb419c00640 1 Processor -- start 2024-09-13T18:45:51.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 -- start start 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb41406e990 0x7fb41415db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41415a9e0 0x7fb4141495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb414149af0 con 0x7fb4140ce6c0 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4140cb6b0 con 0x7fb41415a9e0 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.450+0000 7fb419c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41415e0f0 con 0x7fb41406e990 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37984/0 (socket says 172.21.15.192:37984) 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 -- 172.21.15.192:0/3944842963 learned_addr learned my addr 172.21.15.192:0/3944842963 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:51.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb419200640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41415a9e0 0x7fb4141495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413e00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb41406e990 0x7fb41415db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 -- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb41406e990 msgr2=0x7fb41415db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb41406e990 0x7fb41415db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 -- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41415a9e0 msgr2=0x7fb4141495b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41415a9e0 0x7fb4141495b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.451+0000 7fb413400640 1 -- 172.21.15.192:0/3944842963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb400009400 con 0x7fb4140ce6c0 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb413400640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fb400035040 tx=0x7fb4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40003c680 con 0x7fb4140ce6c0 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40003c7e0 con 0x7fb4140ce6c0 2024-09-13T18:45:51.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4140cb900 con 0x7fb4140ce6c0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40003cb70 con 0x7fb4140ce6c0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.452+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4140cbec0 con 0x7fb4140ce6c0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.453+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41415e3d0 con 0x7fb4140ce6c0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.454+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb400039040 con 0x7fb4140ce6c0 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.455+0000 7fb40be00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 0x7fb3f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.455+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb4000a97e0 con 0x7fb4140ce6c0 2024-09-13T18:45:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.455+0000 7fb413e00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 0x7fb3f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.455+0000 7fb413e00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 0x7fb3f406d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4040012e0 tx=0x7fb404009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.459+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb400074e40 con 0x7fb4140ce6c0 2024-09-13T18:45:51.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.629+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb41406f390 con 0x7fb4140ce6c0 2024-09-13T18:45:51.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.630+0000 7fb40be00640 1 -- 172.21.15.192:0/3944842963 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v176) v1 ==== 74+0+12928 (secure 0 0 0) 0x7fb400037090 con 0x7fb4140ce6c0 2024-09-13T18:45:51.633 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:51.633 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":176,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:50.839449+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":163,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.632+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 msgr2=0x7fb3f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.632+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 0x7fb3f406d0c0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb4040012e0 tx=0x7fb404009040 comp rx=0 tx=0).stop 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.632+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 msgr2=0x7fb4141548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.632+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7fb400035040 tx=0x7fb4000046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 shutdown_connections 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3f406ac00 0x7fb3f406d0c0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb41415a9e0 0x7fb4141495b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4140ce6c0 0x7fb4141548b0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 --2- 172.21.15.192:0/3944842963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb41406e990 0x7fb41415db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 >> 172.21.15.192:0/3944842963 conn(0x7fb4140736d0 msgr2=0x7fb414070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 shutdown_connections 2024-09-13T18:45:51.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.633+0000 7fb419c00640 1 -- 172.21.15.192:0/3944842963 wait complete. 2024-09-13T18:45:51.651 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:45:51.651 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:45:51.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.803+0000 7f6801400640 1 Processor -- start 2024-09-13T18:45:51.806 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.803+0000 7f6801400640 1 -- start start 2024-09-13T18:45:51.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.804+0000 7f6801400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 0x7f67fc06c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.804+0000 7f6801400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 0x7f67fc06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.804+0000 7f6801400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67fc06b480 con 0x7f67fc06a8b0 2024-09-13T18:45:51.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.804+0000 7f6801400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67fc0ce770 con 0x7f67fc0b3da0 2024-09-13T18:45:51.807 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.804+0000 7f6801400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc06b760 con 0x7f67fc1434c0 2024-09-13T18:45:51.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67f9e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f67fc06a8b0 0x7f67fc0b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:52638/0 (socket says 172.21.15.192:52638) 2024-09-13T18:45:51.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67f9e00640 1 -- 172.21.15.192:0/3163773435 learned_addr learned my addr 172.21.15.192:0/3163773435 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:51.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fb200640 1 --2- 172.21.15.192:0/3163773435 >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 0x7f67fc06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fa800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 0x7f67fc06c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67f9400640 1 -- 172.21.15.192:0/3163773435 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3130740587 0 0) 0x7f67fc06b480 con 0x7f67fc06a8b0 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67f9400640 1 -- 172.21.15.192:0/3163773435 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67e0003520 con 0x7f67fc06a8b0 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fa800640 1 -- 172.21.15.192:0/3163773435 >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 msgr2=0x7f67fc06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fa800640 1 --2- 172.21.15.192:0/3163773435 >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 0x7f67fc06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fa800640 1 -- 172.21.15.192:0/3163773435 >> v1:172.21.15.194:6789/0 conn(0x7f67fc06a8b0 legacy=0x7f67fc0b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fa800640 1 -- 172.21.15.192:0/3163773435 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67fc06ba40 con 0x7f67fc1434c0 2024-09-13T18:45:51.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.805+0000 7f67fb200640 1 --2- 172.21.15.192:0/3163773435 >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 0x7f67fc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:51.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.806+0000 7f67fa800640 1 --2- 172.21.15.192:0/3163773435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 0x7f67fc06c800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0097d0 tx=0x7f67ec02a130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11cf54eb3e63627f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f67f9400640 1 -- 172.21.15.192:0/3163773435 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec02ae40 con 0x7f67fc1434c0 2024-09-13T18:45:51.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f67f9400640 1 -- 172.21.15.192:0/3163773435 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec032440 con 0x7f67fc1434c0 2024-09-13T18:45:51.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f67f9400640 1 -- 172.21.15.192:0/3163773435 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0327d0 con 0x7f67fc1434c0 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 -- 172.21.15.192:0/3163773435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 msgr2=0x7f67fc06c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 --2- 172.21.15.192:0/3163773435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 0x7f67fc06c800 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0097d0 tx=0x7f67ec02a130 comp rx=0 tx=0).stop 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 -- 172.21.15.192:0/3163773435 shutdown_connections 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 --2- 172.21.15.192:0/3163773435 >> v2:172.21.15.194:3300/0 conn(0x7f67fc0b3da0 0x7f67fc06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 --2- 172.21.15.192:0/3163773435 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc1434c0 0x7f67fc06c800 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 -- 172.21.15.192:0/3163773435 >> 172.21.15.192:0/3163773435 conn(0x7f67fc0b08f0 msgr2=0x7f67fc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 -- 172.21.15.192:0/3163773435 shutdown_connections 2024-09-13T18:45:51.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.807+0000 7f6801400640 1 -- 172.21.15.192:0/3163773435 wait complete. 2024-09-13T18:45:51.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.809+0000 7f6801400640 1 Processor -- start 2024-09-13T18:45:51.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.809+0000 7f6801400640 1 -- start start 2024-09-13T18:45:51.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc0b3da0 0x7f67fc0c4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67fc1434c0 0x7f67fc142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc1f3860 con 0x7f67fc06a8b0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc0c4a90 con 0x7f67fc1434c0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f6801400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67fc1f3dc0 con 0x7f67fc0b3da0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f67fa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f67fa800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37986/0 (socket says 172.21.15.192:37986) 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.810+0000 7f67fa800640 1 -- 172.21.15.192:0/72130686 learned_addr learned my addr 172.21.15.192:0/72130686 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67f9e00640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc0b3da0 0x7f67fc0c4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fb200640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67fc1434c0 0x7f67fc142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 -- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc0b3da0 msgr2=0x7f67fc0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc0b3da0 0x7f67fc0c4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 -- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67fc1434c0 msgr2=0x7f67fc142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67fc1434c0 0x7f67fc142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 -- 172.21.15.192:0/72130686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f4009a70 con 0x7f67fc06a8b0 2024-09-13T18:45:51.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67fa800640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0098f0 tx=0x7f67ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec03d8f0 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec03da70 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec03de20 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.811+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67ec009400 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.812+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67fc0c3c00 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.813+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67fc0cc7d0 con 0x7f67fc06a8b0 2024-09-13T18:45:51.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.813+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f67ec039040 con 0x7f67fc06a8b0 2024-09-13T18:45:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.814+0000 7f67f2a00640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 0x7f67dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.814+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f67ec0a94d0 con 0x7f67fc06a8b0 2024-09-13T18:45:51.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.814+0000 7f67f9e00640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 0x7f67dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:51.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.815+0000 7f67f9e00640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 0x7f67dc06d0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f67fc15c1e0 tx=0x7f67e8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:51.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.819+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f67ec074960 con 0x7f67fc06a8b0 2024-09-13T18:45:51.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.987+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f67fc15db30 con 0x7f67fc06a8b0 2024-09-13T18:45:51.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.989+0000 7f67f2a00640 1 -- 172.21.15.192:0/72130686 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v176) v1 ==== 93+0+10 (secure 0 0 0) 0x7f67ec077f80 con 0x7f67fc06a8b0 2024-09-13T18:45:51.992 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 msgr2=0x7f67dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 0x7f67dc06d0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f67fc15c1e0 tx=0x7f67e8009040 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 msgr2=0x7f67fc1f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f67ec0098f0 tx=0x7f67ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 shutdown_connections 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f67dc06ac00 0x7f67dc06d0c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f67fc1434c0 0x7f67fc142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f67fc0b3da0 0x7f67fc0c4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 --2- 172.21.15.192:0/72130686 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f67fc06a8b0 0x7f67fc1f3320 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:51.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 >> 172.21.15.192:0/72130686 conn(0x7f67fc0b08f0 msgr2=0x7f67fc0b3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 shutdown_connections 2024-09-13T18:45:51.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:51.991+0000 7f6801400640 1 -- 172.21.15.192:0/72130686 wait complete. 2024-09-13T18:45:52.009 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:45:52.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.160+0000 7fac11c00640 1 Processor -- start 2024-09-13T18:45:52.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.160+0000 7fac11c00640 1 -- start start 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fac0c06b8d0 0x7fac0c06bd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c0b2100 con 0x7fac0c0b2590 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0c06c250 con 0x7fac0c15ad10 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0c150f10 con 0x7fac0c06b8d0 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac0b400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fac0c06b8d0 0x7fac0c06bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fac0c0b2590 0x7fac0c0b2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45058/0 (socket says 172.21.15.192:45058) 2024-09-13T18:45:52.164 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.161+0000 7fac11200640 1 -- 172.21.15.192:0/812304320 learned_addr learned my addr 172.21.15.192:0/812304320 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.162+0000 7fac0b400640 1 -- 172.21.15.192:0/812304320 >> v1:172.21.15.194:6789/0 conn(0x7fac0c15ad10 legacy=0x7fac0c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.162+0000 7fac0b400640 1 -- 172.21.15.192:0/812304320 >> v1:172.21.15.192:6789/0 conn(0x7fac0c0b2590 legacy=0x7fac0c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.162+0000 7fac0b400640 1 -- 172.21.15.192:0/812304320 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c15a2c0 con 0x7fac0c06b8d0 2024-09-13T18:45:52.165 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.162+0000 7fac0aa00640 1 -- 172.21.15.192:0/812304320 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658920626 0 0) 0x7fac0c0b2100 con 0x7fac0c0b2590 2024-09-13T18:45:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.163+0000 7fac0b400640 1 --2- 172.21.15.192:0/812304320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c06b8d0 0x7fac0c06bd10 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097a0 tx=0x7fabf802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43cd392b9dc2790 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.163+0000 7fac0aa00640 1 -- 172.21.15.192:0/812304320 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8032440 con 0x7fac0c06b8d0 2024-09-13T18:45:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.163+0000 7fac0aa00640 1 -- 172.21.15.192:0/812304320 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf80325a0 con 0x7fac0c06b8d0 2024-09-13T18:45:52.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.163+0000 7fac0aa00640 1 -- 172.21.15.192:0/812304320 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8032930 con 0x7fac0c06b8d0 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 -- 172.21.15.192:0/812304320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c06b8d0 msgr2=0x7fac0c06bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 --2- 172.21.15.192:0/812304320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c06b8d0 0x7fac0c06bd10 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fabf80097a0 tx=0x7fabf802a230 comp rx=0 tx=0).stop 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 -- 172.21.15.192:0/812304320 shutdown_connections 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 --2- 172.21.15.192:0/812304320 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c06b8d0 0x7fac0c06bd10 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 -- 172.21.15.192:0/812304320 >> 172.21.15.192:0/812304320 conn(0x7fac0c0b09f0 msgr2=0x7fac0c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 -- 172.21.15.192:0/812304320 shutdown_connections 2024-09-13T18:45:52.167 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.164+0000 7fac11c00640 1 -- 172.21.15.192:0/812304320 wait complete. 2024-09-13T18:45:52.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.165+0000 7fac11c00640 1 Processor -- start 2024-09-13T18:45:52.168 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.165+0000 7fac11c00640 1 -- start start 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac0c06b8d0 0x7fac0c14f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac0c15ad10 0x7fac0c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1f2c10 con 0x7fac0c0b2590 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1f2ef0 con 0x7fac0c06b8d0 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.166+0000 7fac11c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0c1f31d0 con 0x7fac0c15ad10 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38014/0 (socket says 172.21.15.192:38014) 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 -- 172.21.15.192:0/4129196009 learned_addr learned my addr 172.21.15.192:0/4129196009 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0be00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac0c06b8d0 0x7fac0c14f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac11200640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac0c15ad10 0x7fac0c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 -- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac0c15ad10 msgr2=0x7fac0c158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac0c15ad10 0x7fac0c158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 -- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac0c06b8d0 msgr2=0x7fac0c14f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac0c06b8d0 0x7fac0c14f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 -- 172.21.15.192:0/4129196009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabf8009400 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.167+0000 7fac0b400640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fabf8035040 tx=0x7fabf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.168+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8006e10 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.168+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf8030980 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.168+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0c1f34b0 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.168+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8030d50 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.168+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c1f3790 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.169+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac0c06bd10 con 0x7fac0c0b2590 2024-09-13T18:45:52.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.170+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabf8039040 con 0x7fac0c0b2590 2024-09-13T18:45:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.171+0000 7fac03e00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 0x7fabec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.171+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fabf80a9940 con 0x7fac0c0b2590 2024-09-13T18:45:52.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.171+0000 7fac0be00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 0x7fabec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.172+0000 7fac0be00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 0x7fabec06d0f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000f60 tx=0x7fabfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.175+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fabf8074f00 con 0x7fac0c0b2590 2024-09-13T18:45:52.349 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.347+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fac0c070700 con 0x7fac0c0b2590 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.347+0000 7fac03e00640 1 -- 172.21.15.192:0/4129196009 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v176) v1 ==== 84+0+65 (secure 0 0 0) 0x7fabf8078520 con 0x7fac0c0b2590 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:45:52.350 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:45:52.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 msgr2=0x7fabec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 0x7fabec06d0f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fabfc000f60 tx=0x7fabfc009040 comp rx=0 tx=0).stop 2024-09-13T18:45:52.352 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 msgr2=0x7fac0c1efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fabf8035040 tx=0x7fabf80046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 shutdown_connections 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabec06ac30 0x7fabec06d0f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fac0c15ad10 0x7fac0c158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fac0c0b2590 0x7fac0c1efc80 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 --2- 172.21.15.192:0/4129196009 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fac0c06b8d0 0x7fac0c14f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 >> 172.21.15.192:0/4129196009 conn(0x7fac0c0b09f0 msgr2=0x7fac0c15db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 shutdown_connections 2024-09-13T18:45:52.353 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.349+0000 7fac11c00640 1 -- 172.21.15.192:0/4129196009 wait complete. 2024-09-13T18:45:52.369 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:45:52.369 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:45:52.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.522+0000 7f606f200640 1 Processor -- start 2024-09-13T18:45:52.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.523+0000 7f606f200640 1 -- start start 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f60700cbfe0 0x7f60700ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 0x7f607006a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f607015d7f0 0x7f607015dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607013cfa0 con 0x7f607015d7f0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f607006aa30 con 0x7f60700cbfe0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60700cc3c0 con 0x7f607006a0b0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606e800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f607015d7f0 0x7f607015dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606e800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f607015d7f0 0x7f607015dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38026/0 (socket says 172.21.15.192:38026) 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.524+0000 7f606e800640 1 -- 172.21.15.192:0/1008101514 learned_addr learned my addr 172.21.15.192:0/1008101514 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606de00640 1 --2- 172.21.15.192:0/1008101514 >> v2:172.21.15.194:3300/0 conn(0x7f60700cbfe0 0x7f60700ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606d400640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 0x7f607006a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606e800640 1 -- 172.21.15.192:0/1008101514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 msgr2=0x7f607006a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606e800640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 0x7f607006a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606e800640 1 -- 172.21.15.192:0/1008101514 >> v2:172.21.15.194:3300/0 conn(0x7f60700cbfe0 msgr2=0x7f60700ce1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:52.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606e800640 1 --2- 172.21.15.192:0/1008101514 >> v2:172.21.15.194:3300/0 conn(0x7f60700cbfe0 0x7f60700ce1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606e800640 1 -- 172.21.15.192:0/1008101514 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700ce720 con 0x7f607015d7f0 2024-09-13T18:45:52.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.525+0000 7f606d400640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 0x7f607006a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606e800640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607015d7f0 0x7f607015dc80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f60700cc640 tx=0x7f606802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcee6b449de2063 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606ca00640 1 -- 172.21.15.192:0/1008101514 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068032440 con 0x7f607015d7f0 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606ca00640 1 -- 172.21.15.192:0/1008101514 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60680325a0 con 0x7f607015d7f0 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606ca00640 1 -- 172.21.15.192:0/1008101514 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068032930 con 0x7f607015d7f0 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606f200640 1 -- 172.21.15.192:0/1008101514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607015d7f0 msgr2=0x7f607015dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.526+0000 7f606f200640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607015d7f0 0x7f607015dc80 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f60700cc640 tx=0x7f606802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 -- 172.21.15.192:0/1008101514 shutdown_connections 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607015d7f0 0x7f607015dc80 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 --2- 172.21.15.192:0/1008101514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f607006a0b0 0x7f607006a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 --2- 172.21.15.192:0/1008101514 >> v2:172.21.15.194:3300/0 conn(0x7f60700cbfe0 0x7f60700ce1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 -- 172.21.15.192:0/1008101514 >> 172.21.15.192:0/1008101514 conn(0x7f6070073490 msgr2=0x7f60700b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 -- 172.21.15.192:0/1008101514 shutdown_connections 2024-09-13T18:45:52.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.527+0000 7f606f200640 1 -- 172.21.15.192:0/1008101514 wait complete. 2024-09-13T18:45:52.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.528+0000 7f606f200640 1 Processor -- start 2024-09-13T18:45:52.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.528+0000 7f606f200640 1 -- start start 2024-09-13T18:45:52.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60700cbfe0 0x7f60701f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f607015d7f0 0x7f607013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607006ebc0 con 0x7f607006a0b0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607006e8b0 con 0x7f607015d7f0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60701f62d0 con 0x7f60700cbfe0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38028/0 (socket says 172.21.15.192:38028) 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.529+0000 7f606de00640 1 -- 172.21.15.192:0/3153368458 learned_addr learned my addr 172.21.15.192:0/3153368458 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606d400640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60700cbfe0 0x7f60701f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606e800640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f607015d7f0 0x7f607013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 -- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60700cbfe0 msgr2=0x7f60701f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60700cbfe0 0x7f60701f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 -- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f607015d7f0 msgr2=0x7f607013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f607015d7f0 0x7f607013c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 -- 172.21.15.192:0/3153368458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60680094d0 con 0x7f607006a0b0 2024-09-13T18:45:52.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606de00640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6060007ef0 tx=0x7f606000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060014620 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6060014780 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060014b30 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.530+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60701f6570 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.531+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60701f6b30 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.532+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6070067b10 con 0x7f607006a0b0 2024-09-13T18:45:52.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.532+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6060014c90 con 0x7f607006a0b0 2024-09-13T18:45:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.533+0000 7f6066000640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 0x7f605006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.533+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6060089a10 con 0x7f607006a0b0 2024-09-13T18:45:52.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.534+0000 7f606d400640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 0x7f605006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:52.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.534+0000 7f606d400640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 0x7f605006d0c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f607013e7a0 tx=0x7f605c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:52.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.537+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6060054f30 con 0x7f607006a0b0 2024-09-13T18:45:52.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:52.706+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f60701f6cc0 con 0x7f607006a0b0 2024-09-13T18:45:53.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.479+0000 7f6066000640 1 -- 172.21.15.192:0/3153368458 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v177) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6060058550 con 0x7f607006a0b0 2024-09-13T18:45:53.482 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:45:53.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 msgr2=0x7f605006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 0x7f605006d0c0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f607013e7a0 tx=0x7f605c008040 comp rx=0 tx=0).stop 2024-09-13T18:45:53.486 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 msgr2=0x7f60701522f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7f6060007ef0 tx=0x7f606000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 shutdown_connections 2024-09-13T18:45:53.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f605006ac00 0x7f605006d0c0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f607015d7f0 0x7f607013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60700cbfe0 0x7f60701f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 --2- 172.21.15.192:0/3153368458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f607006a0b0 0x7f60701522f0 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.482+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 >> 172.21.15.192:0/3153368458 conn(0x7f6070073490 msgr2=0x7f60700af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.483+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 shutdown_connections 2024-09-13T18:45:53.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.483+0000 7f606f200640 1 -- 172.21.15.192:0/3153368458 wait complete. 2024-09-13T18:45:53.504 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:45:53.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.663+0000 7fab86e00640 1 Processor -- start 2024-09-13T18:45:53.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.663+0000 7fab86e00640 1 -- start start 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.664+0000 7fab86e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab801589f0 0x7fab800b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.664+0000 7fab86e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab8006c0b0 0x7fab8006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.664+0000 7fab86e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab800b2000 con 0x7fab800b3af0 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.664+0000 7fab86e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab8006ca80 con 0x7fab8006c0b0 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.664+0000 7fab86e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015b970 con 0x7fab801589f0 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab8006c0b0 0x7fab8006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fab8006c0b0 0x7fab8006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38032/0 (socket says 172.21.15.192:38032) 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 -- 172.21.15.192:0/2640545676 learned_addr learned my addr 172.21.15.192:0/2640545676 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:53.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab7fe00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab801589f0 0x7fab800b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 -- 172.21.15.192:0/2640545676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab801589f0 msgr2=0x7fab800b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:53.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab801589f0 0x7fab800b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 -- 172.21.15.192:0/2640545676 >> v1:172.21.15.194:6789/0 conn(0x7fab800b3af0 legacy=0x7fab8015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.665+0000 7fab84e00640 1 -- 172.21.15.192:0/2640545676 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8015bbd0 con 0x7fab8006c0b0 2024-09-13T18:45:53.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.666+0000 7fab84e00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8006c540 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e50 tx=0x7fab7802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b67446083d8ec38 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.666+0000 7fab7ea00640 1 -- 172.21.15.192:0/2640545676 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78031600 con 0x7fab8006c0b0 2024-09-13T18:45:53.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab7ea00640 1 -- 172.21.15.192:0/2640545676 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7802d050 con 0x7fab8006c0b0 2024-09-13T18:45:53.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab7ea00640 1 -- 172.21.15.192:0/2640545676 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78031980 con 0x7fab8006c0b0 2024-09-13T18:45:53.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 -- 172.21.15.192:0/2640545676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 msgr2=0x7fab8006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8006c540 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fab78009e50 tx=0x7fab7802a710 comp rx=0 tx=0).stop 2024-09-13T18:45:53.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 -- 172.21.15.192:0/2640545676 shutdown_connections 2024-09-13T18:45:53.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8006c540 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 --2- 172.21.15.192:0/2640545676 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab801589f0 0x7fab800b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 -- 172.21.15.192:0/2640545676 >> 172.21.15.192:0/2640545676 conn(0x7fab800b08f0 msgr2=0x7fab800b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:53.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 -- 172.21.15.192:0/2640545676 shutdown_connections 2024-09-13T18:45:53.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.667+0000 7fab86e00640 1 -- 172.21.15.192:0/2640545676 wait complete. 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.669+0000 7fab86e00640 1 Processor -- start 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.669+0000 7fab86e00640 1 -- start start 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 0x7fab80149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 0x7fab801f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015c940 con 0x7fab8006c0b0 2024-09-13T18:45:53.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015cbc0 con 0x7fab801589f0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab86e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015cea0 con 0x7fab800b3af0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38036/0 (socket says 172.21.15.192:38036) 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.670+0000 7fab7fe00640 1 -- 172.21.15.192:0/1612867357 learned_addr learned my addr 172.21.15.192:0/1612867357 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 -- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 msgr2=0x7fab80149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab84e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 0x7fab801f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7f400640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 0x7fab80149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 0x7fab80149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 -- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 msgr2=0x7fab801f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 0x7fab801f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 -- 172.21.15.192:0/1612867357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab78009b30 con 0x7fab8006c0b0 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab84e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 0x7fab801f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:53.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7f400640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 0x7fab80149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab7fe00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e870 tx=0x7fab7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700094f0 con 0x7fab8006c0b0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7000c940 con 0x7fab8006c0b0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000ccf0 con 0x7fab8006c0b0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8015d180 con 0x7fab8006c0b0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.671+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8015d740 con 0x7fab8006c0b0 2024-09-13T18:45:53.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.672+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8006c540 con 0x7fab8006c0b0 2024-09-13T18:45:53.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.673+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fab70013470 con 0x7fab8006c0b0 2024-09-13T18:45:53.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.674+0000 7fab77e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:53.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.674+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fab70089350 con 0x7fab8006c0b0 2024-09-13T18:45:53.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.674+0000 7fab7f400640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:53.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.675+0000 7fab7f400640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 0x7fab6006d0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fab80158030 tx=0x7fab6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:53.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.679+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fab70054670 con 0x7fab8006c0b0 2024-09-13T18:45:53.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:53.851+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fab800cb8f0 con 0x7fab8006c0b0 2024-09-13T18:45:54.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.484+0000 7fab77e00640 1 -- 172.21.15.192:0/1612867357 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v178) v1 ==== 170+0+0 (secure 0 0 0) 0x7fab70057c90 con 0x7fab8006c0b0 2024-09-13T18:45:54.488 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:45:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.492+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 msgr2=0x7fab6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.492+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 0x7fab6006d0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fab80158030 tx=0x7fab6c009040 comp rx=0 tx=0).stop 2024-09-13T18:45:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.492+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 msgr2=0x7fab8015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.492+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e870 tx=0x7fab7000ed30 comp rx=0 tx=0).stop 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 shutdown_connections 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fab6006ac00 0x7fab6006d0c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fab801589f0 0x7fab801f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fab800b3af0 0x7fab80149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 --2- 172.21.15.192:0/1612867357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fab8006c0b0 0x7fab8015c400 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.493+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 >> 172.21.15.192:0/1612867357 conn(0x7fab800b08f0 msgr2=0x7fab800ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.494+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 shutdown_connections 2024-09-13T18:45:54.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.494+0000 7fab86e00640 1 -- 172.21.15.192:0/1612867357 wait complete. 2024-09-13T18:45:54.515 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:45:54.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.668+0000 7fd5cd400640 1 Processor -- start 2024-09-13T18:45:54.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.668+0000 7fd5cd400640 1 -- start start 2024-09-13T18:45:54.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.669+0000 7fd5cd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5c80b3af0 0x7fd5c815b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.669+0000 7fd5cd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.669+0000 7fd5cd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c80b2000 con 0x7fd5c81589f0 2024-09-13T18:45:54.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.669+0000 7fd5cd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c806ca80 con 0x7fd5c80b3af0 2024-09-13T18:45:54.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.669+0000 7fd5cd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80b2ba0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c5e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5c80b3af0 0x7fd5c815b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:58964/0 (socket says 172.21.15.192:58964) 2024-09-13T18:45:54.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 -- 172.21.15.192:0/4123275957 learned_addr learned my addr 172.21.15.192:0/4123275957 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:54.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 -- 172.21.15.192:0/4123275957 >> v2:172.21.15.194:3300/0 conn(0x7fd5c80b3af0 msgr2=0x7fd5c815b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:54.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 --2- 172.21.15.192:0/4123275957 >> v2:172.21.15.194:3300/0 conn(0x7fd5c80b3af0 0x7fd5c815b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 -- 172.21.15.192:0/4123275957 >> v1:172.21.15.194:6789/0 conn(0x7fd5c81589f0 legacy=0x7fd5c80b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.670+0000 7fd5c7200640 1 -- 172.21.15.192:0/4123275957 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c815bbd0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.671+0000 7fd5c7200640 1 --2- 172.21.15.192:0/4123275957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e50 tx=0x7fd5c002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c98bbec4c5071186 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.671+0000 7fd5c5400640 1 -- 172.21.15.192:0/4123275957 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0031600 con 0x7fd5c806c0b0 2024-09-13T18:45:54.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5c5400640 1 -- 172.21.15.192:0/4123275957 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c002d050 con 0x7fd5c806c0b0 2024-09-13T18:45:54.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5c5400640 1 -- 172.21.15.192:0/4123275957 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0031980 con 0x7fd5c806c0b0 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 -- 172.21.15.192:0/4123275957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 msgr2=0x7fd5c806c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 --2- 172.21.15.192:0/4123275957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0009e50 tx=0x7fd5c002a710 comp rx=0 tx=0).stop 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 -- 172.21.15.192:0/4123275957 shutdown_connections 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 --2- 172.21.15.192:0/4123275957 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c806c0b0 0x7fd5c806c540 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 --2- 172.21.15.192:0/4123275957 >> v2:172.21.15.194:3300/0 conn(0x7fd5c80b3af0 0x7fd5c815b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 -- 172.21.15.192:0/4123275957 >> 172.21.15.192:0/4123275957 conn(0x7fd5c80b08f0 msgr2=0x7fd5c80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 -- 172.21.15.192:0/4123275957 shutdown_connections 2024-09-13T18:45:54.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.672+0000 7fd5cd400640 1 -- 172.21.15.192:0/4123275957 wait complete. 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.674+0000 7fd5cd400640 1 Processor -- start 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.674+0000 7fd5cd400640 1 -- start start 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c80b3af0 0x7fd5c8154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 0x7fd5c8155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8153670 con 0x7fd5c806c0b0 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8152ad0 con 0x7fd5c80b3af0 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5cd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c8152d40 con 0x7fd5c81589f0 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5c6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5c6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38040/0 (socket says 172.21.15.192:38040) 2024-09-13T18:45:54.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5c6800640 1 -- 172.21.15.192:0/1548771668 learned_addr learned my addr 172.21.15.192:0/1548771668 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5c7200640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 0x7fd5c8155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.675+0000 7fd5c5e00640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c80b3af0 0x7fd5c8154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 -- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 msgr2=0x7fd5c8155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 0x7fd5c8155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 -- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c80b3af0 msgr2=0x7fd5c8154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c80b3af0 0x7fd5c8154d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 -- 172.21.15.192:0/1548771668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c0009b30 con 0x7fd5c806c0b0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c7200640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 0x7fd5c8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5c6800640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c430 tx=0x7fd5b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b80052d0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b8005430 con 0x7fd5c806c0b0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8003830 con 0x7fd5c806c0b0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c8153020 con 0x7fd5c806c0b0 2024-09-13T18:45:54.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.676+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c814eaf0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.677+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c806c540 con 0x7fd5c806c0b0 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.678+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5b8003990 con 0x7fd5c806c0b0 2024-09-13T18:45:54.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.680+0000 7fd5bea00640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 0x7fd5a806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:54.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.680+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(178..178 src has 1..178) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd5b80887a0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.680+0000 7fd5c5e00640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 0x7fd5a806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:54.683 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.681+0000 7fd5c5e00640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 0x7fd5a806d0c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd5c81e7720 tx=0x7fd5b4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:54.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.685+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5b8053a90 con 0x7fd5c806c0b0 2024-09-13T18:45:54.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.888+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd5c80cb8f0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.896+0000 7fd5bea00640 1 -- 172.21.15.192:0/1548771668 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd5b80570b0 con 0x7fd5c806c0b0 2024-09-13T18:45:54.899 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 20 and data pool 21 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.901+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 msgr2=0x7fd5a806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.901+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 0x7fd5a806d0c0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd5c81e7720 tx=0x7fd5b4009190 comp rx=0 tx=0).stop 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.901+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 msgr2=0x7fd5c813b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.901+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800c430 tx=0x7fd5b800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 shutdown_connections 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5a806ac00 0x7fd5a806d0c0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5c81589f0 0x7fd5c8155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5c80b3af0 0x7fd5c8154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 --2- 172.21.15.192:0/1548771668 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5c806c0b0 0x7fd5c813b280 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:54.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.902+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 >> 172.21.15.192:0/1548771668 conn(0x7fd5c80b08f0 msgr2=0x7fd5c8159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:54.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.907+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 shutdown_connections 2024-09-13T18:45:54.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:54.910+0000 7fd5cd400640 1 -- 172.21.15.192:0/1548771668 wait complete. 2024-09-13T18:45:54.935 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:55.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.086+0000 7fb409c00640 1 Processor -- start 2024-09-13T18:45:55.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.086+0000 7fb409c00640 1 -- start start 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb409c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb40415e790 0x7fb4040cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb409c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb40415ec00 con 0x7fb40415bc20 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb409c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb404140480 con 0x7fb4040cacd0 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb409c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040cb5f0 con 0x7fb40415e790 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb403400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb40415bc20 0x7fb4040afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45068/0 (socket says 172.21.15.192:45068) 2024-09-13T18:45:55.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.087+0000 7fb403400640 1 -- 172.21.15.192:0/1297207781 learned_addr learned my addr 172.21.15.192:0/1297207781 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> v2:172.21.15.194:3300/0 conn(0x7fb40415e790 0x7fb4040cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 476470087 0 0) 0x7fb40415ec00 con 0x7fb40415bc20 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3e8003520 con 0x7fb40415bc20 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3793112734 0 0) 0x7fb404140480 con 0x7fb4040cacd0 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb40415ec00 con 0x7fb4040cacd0 2024-09-13T18:45:55.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647828906 0 0) 0x7fb3e8003520 con 0x7fb40415bc20 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 >> v2:172.21.15.194:3300/0 conn(0x7fb40415e790 msgr2=0x7fb4040cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 --2- 172.21.15.192:0/1297207781 >> v2:172.21.15.194:3300/0 conn(0x7fb40415e790 0x7fb4040cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 >> v1:172.21.15.194:6789/0 conn(0x7fb4040cacd0 legacy=0x7fb404140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40415ee90 con 0x7fb40415bc20 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fb3fc0019f0 con 0x7fb40415bc20 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> v2:172.21.15.194:3300/0 conn(0x7fb40415e790 0x7fb4040cb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 >> v1:172.21.15.192:6789/0 conn(0x7fb40415bc20 legacy=0x7fb4040afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e8003b00 0x7fb3e8003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 0x7fb3e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3e8005180 0x7fb3e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800bfd0 con 0x7fb3e80047c0 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800c140 con 0x7fb3e8003b00 2024-09-13T18:45:55.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.088+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e800c300 con 0x7fb3e8005180 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 0x7fb3e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402a00640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e8003b00 0x7fb3e8003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb403400640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3e8005180 0x7fb3e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 -- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3e8005180 msgr2=0x7fb3e800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3e8005180 0x7fb3e800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 -- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e8003b00 msgr2=0x7fb3e8003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e8003b00 0x7fb3e8003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb402000640 1 -- 172.21.15.192:0/1297207781 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e8003520 con 0x7fb3e80047c0 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb403400640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb3e8005180 0x7fb3e800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:55.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.089+0000 7fb403400640 1 -- 172.21.15.192:0/1297207781 reap_dead start 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.090+0000 7fb402000640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 0x7fb3e8004c40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009c90 tx=0x7fb3e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea62b67c43ed318 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.090+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0031400 con 0x7fb3e80047c0 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.090+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f002d050 con 0x7fb3e80047c0 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.090+0000 7fb401600640 1 -- 172.21.15.192:0/1297207781 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0031760 con 0x7fb3e80047c0 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 -- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 msgr2=0x7fb3e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 0x7fb3e8004c40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0009c90 tx=0x7fb3e80057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 -- 172.21.15.192:0/1297207781 shutdown_connections 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 --2- 172.21.15.192:0/1297207781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3e80047c0 0x7fb3e8004c40 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 -- 172.21.15.192:0/1297207781 >> 172.21.15.192:0/1297207781 conn(0x7fb4040ae960 msgr2=0x7fb40406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 -- 172.21.15.192:0/1297207781 shutdown_connections 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.091+0000 7fb409c00640 1 -- 172.21.15.192:0/1297207781 wait complete. 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.092+0000 7fb409c00640 1 Processor -- start 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 -- start start 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80047c0 0x7fb40413cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 0x7fb40406b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40413fb10 con 0x7fb40413f120 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040cd7b0 con 0x7fb3e80047c0 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.093+0000 7fb409c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40406b7d0 con 0x7fb4040cd330 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38054/0 (socket says 172.21.15.192:38054) 2024-09-13T18:45:55.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 -- 172.21.15.192:0/3780335480 learned_addr learned my addr 172.21.15.192:0/3780335480 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb402000640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 0x7fb40406b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb402a00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80047c0 0x7fb40413cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 -- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 msgr2=0x7fb40406b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 0x7fb40406b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 -- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80047c0 msgr2=0x7fb40413cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80047c0 0x7fb40413cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 -- 172.21.15.192:0/3780335480 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040cc290 con 0x7fb40413f120 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb402000640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 0x7fb40406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:55.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.094+0000 7fb403400640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001780 tx=0x7fb3fc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.095+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00eb90 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.095+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3fc00ecf0 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.095+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc013640 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.095+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040cc570 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.095+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040ccb30 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.096+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4040cb440 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.097+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb3fc0137a0 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.097+0000 7fb3faa00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.098+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3fc089590 con 0x7fb40413f120 2024-09-13T18:45:55.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.098+0000 7fb402a00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.098+0000 7fb402a00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb4040cbc30 tx=0x7fb3f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.102+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb3fc054760 con 0x7fb40413f120 2024-09-13T18:45:55.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.272+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb4040cb440 con 0x7fb40413f120 2024-09-13T18:45:55.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.274+0000 7fb3faa00640 1 -- 172.21.15.192:0/3780335480 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+16653 (secure 0 0 0) 0x7fb3fc05e020 con 0x7fb40413f120 2024-09-13T18:45:55.277 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:55.277 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":179,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:54.890430+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 msgr2=0x7fb3e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fb4040cbc30 tx=0x7fb3f4009040 comp rx=0 tx=0).stop 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 msgr2=0x7fb40413f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc001780 tx=0x7fb3fc00e530 comp rx=0 tx=0).stop 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 shutdown_connections 2024-09-13T18:45:55.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb3e406ac30 0x7fb3e406d0f0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb40413f120 0x7fb40413f5d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4040cd330 0x7fb40406b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 --2- 172.21.15.192:0/3780335480 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb3e80047c0 0x7fb40413cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 >> 172.21.15.192:0/3780335480 conn(0x7fb4040ae960 msgr2=0x7fb40415d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 shutdown_connections 2024-09-13T18:45:55.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.276+0000 7fb409c00640 1 -- 172.21.15.192:0/3780335480 wait complete. 2024-09-13T18:45:55.295 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:55.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.444+0000 7f1bda400640 1 Processor -- start 2024-09-13T18:45:55.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.444+0000 7f1bda400640 1 -- start start 2024-09-13T18:45:55.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bda400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bd415dee0 0x7f1bd40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bda400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40b2f00 con 0x7f1bd40b3f10 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bda400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd40b3150 con 0x7f1bd415e2c0 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bda400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd40b3430 con 0x7f1bd415dee0 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd3400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1bd415dee0 0x7f1bd40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd2a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1bd40b3f10 0x7f1bd415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45080/0 (socket says 172.21.15.192:45080) 2024-09-13T18:45:55.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd2a00640 1 -- 172.21.15.192:0/1141713182 learned_addr learned my addr 172.21.15.192:0/1141713182 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:55.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd3400640 1 -- 172.21.15.192:0/1141713182 >> v1:172.21.15.194:6789/0 conn(0x7f1bd415e2c0 legacy=0x7f1bd41637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd3400640 1 -- 172.21.15.192:0/1141713182 >> v1:172.21.15.192:6789/0 conn(0x7f1bd40b3f10 legacy=0x7f1bd415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.446+0000 7f1bd3400640 1 -- 172.21.15.192:0/1141713182 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd40b3710 con 0x7f1bd415dee0 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.447+0000 7f1bd3400640 1 --2- 172.21.15.192:0/1141713182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd40afd80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40097a0 tx=0x7f1bc402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5bf2580b9761b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bd2000640 1 -- 172.21.15.192:0/1141713182 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4032440 con 0x7f1bd415dee0 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bd2000640 1 -- 172.21.15.192:0/1141713182 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc40325a0 con 0x7f1bd415dee0 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bd2000640 1 -- 172.21.15.192:0/1141713182 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4032930 con 0x7f1bd415dee0 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 -- 172.21.15.192:0/1141713182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 msgr2=0x7f1bd40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 --2- 172.21.15.192:0/1141713182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd40afd80 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40097a0 tx=0x7f1bc402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 -- 172.21.15.192:0/1141713182 shutdown_connections 2024-09-13T18:45:55.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 --2- 172.21.15.192:0/1141713182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd40afd80 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 -- 172.21.15.192:0/1141713182 >> 172.21.15.192:0/1141713182 conn(0x7f1bd40ae960 msgr2=0x7f1bd406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 -- 172.21.15.192:0/1141713182 shutdown_connections 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.448+0000 7f1bda400640 1 -- 172.21.15.192:0/1141713182 wait complete. 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.450+0000 7f1bda400640 1 Processor -- start 2024-09-13T18:45:55.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.450+0000 7f1bda400640 1 -- start start 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 0x7f1bd41347e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 0x7f1bd4139ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd406a3d0 con 0x7f1bd415dee0 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd41427c0 con 0x7f1bd415e2c0 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bda400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4142a80 con 0x7f1bd4139630 2024-09-13T18:45:55.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bd3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38070/0 (socket says 172.21.15.192:38070) 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.451+0000 7f1bd3400640 1 -- 172.21.15.192:0/441940710 learned_addr learned my addr 172.21.15.192:0/441940710 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd2a00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 0x7f1bd41347e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3e00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 0x7f1bd4139ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 -- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 msgr2=0x7f1bd4139ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 0x7f1bd4139ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 -- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 msgr2=0x7f1bd41347e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 0x7f1bd41347e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 -- 172.21.15.192:0/441940710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4009400 con 0x7f1bd415dee0 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd2a00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 0x7f1bd41347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3e00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 0x7f1bd4139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bd3400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4030b80 con 0x7f1bd415dee0 2024-09-13T18:45:55.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4030ce0 con 0x7f1bd415dee0 2024-09-13T18:45:55.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd4142d60 con 0x7f1bd415dee0 2024-09-13T18:45:55.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc403d680 con 0x7f1bd415dee0 2024-09-13T18:45:55.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.452+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd4143320 con 0x7f1bd415dee0 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.453+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd415a440 con 0x7f1bd415dee0 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.454+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1bc4039040 con 0x7f1bd415dee0 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.455+0000 7f1bcb400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 0x7f1bb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.455+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bc40a9fb0 con 0x7f1bd415dee0 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.455+0000 7f1bd2a00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 0x7f1bb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.456+0000 7f1bd2a00640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 0x7f1bb406d0c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1bd413a970 tx=0x7f1bc0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.459+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1bc40751a0 con 0x7f1bd415dee0 2024-09-13T18:45:55.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.630+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd4150af0 con 0x7f1bd415dee0 2024-09-13T18:45:55.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.631+0000 7f1bcb400640 1 -- 172.21.15.192:0/441940710 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v179) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f1bc40787c0 con 0x7f1bd415dee0 2024-09-13T18:45:55.634 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:55.634 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":179,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:54.890430+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.633+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 msgr2=0x7f1bb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.633+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 0x7f1bb406d0c0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1bd413a970 tx=0x7f1bc0009040 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.633+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 msgr2=0x7f1bd41402e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.633+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4000c00 tx=0x7f1bc40046c0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 shutdown_connections 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1bb406ac00 0x7f1bb406d0c0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1bd4139630 0x7f1bd4139ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1bd415e2c0 0x7f1bd41347e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 --2- 172.21.15.192:0/441940710 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1bd415dee0 0x7f1bd41402e0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 >> 172.21.15.192:0/441940710 conn(0x7f1bd40ae960 msgr2=0x7f1bd406b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 shutdown_connections 2024-09-13T18:45:55.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.634+0000 7f1bda400640 1 -- 172.21.15.192:0/441940710 wait complete. 2024-09-13T18:45:55.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:45:55.808 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.806+0000 7f65bbe00640 1 Processor -- start 2024-09-13T18:45:55.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.806+0000 7f65bbe00640 1 -- start start 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f65bc15b810 0x7f65bc15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f65bc0afbe0 0x7f65bc0b0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bbe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc15b070 con 0x7f65bc1402c0 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0b0590 con 0x7f65bc15b810 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc15ee20 con 0x7f65bc0afbe0 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65b2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f65bc15b810 0x7f65bc15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65b2000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f65bc15b810 0x7f65bc15bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38084/0 (socket says 172.21.15.192:38084) 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65b2000640 1 -- 172.21.15.192:0/922801997 learned_addr learned my addr 172.21.15.192:0/922801997 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:55.810 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.807+0000 7f65bb400640 1 --2- 172.21.15.192:0/922801997 >> v2:172.21.15.194:3300/0 conn(0x7f65bc0afbe0 0x7f65bc0b0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.808+0000 7f65b2000640 1 -- 172.21.15.192:0/922801997 >> v2:172.21.15.194:3300/0 conn(0x7f65bc0afbe0 msgr2=0x7f65bc0b0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:55.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.808+0000 7f65b2000640 1 --2- 172.21.15.192:0/922801997 >> v2:172.21.15.194:3300/0 conn(0x7f65bc0afbe0 0x7f65bc0b0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.808+0000 7f65b2000640 1 -- 172.21.15.192:0/922801997 >> v1:172.21.15.194:6789/0 conn(0x7f65bc1402c0 legacy=0x7f65bc15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.808+0000 7f65b2000640 1 -- 172.21.15.192:0/922801997 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc15f100 con 0x7f65bc15b810 2024-09-13T18:45:55.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.809+0000 7f65b2000640 1 --2- 172.21.15.192:0/922801997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc15b810 0x7f65bc15bc50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f65bc06ce80 tx=0x7f65a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb6b81dab09fb73 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.809+0000 7f65ba000640 1 -- 172.21.15.192:0/922801997 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4032440 con 0x7f65bc15b810 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.809+0000 7f65ba000640 1 -- 172.21.15.192:0/922801997 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65a40325a0 con 0x7f65bc15b810 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.809+0000 7f65ba000640 1 -- 172.21.15.192:0/922801997 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a4032930 con 0x7f65bc15b810 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 -- 172.21.15.192:0/922801997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc15b810 msgr2=0x7f65bc15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 --2- 172.21.15.192:0/922801997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc15b810 0x7f65bc15bc50 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f65bc06ce80 tx=0x7f65a402a270 comp rx=0 tx=0).stop 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 -- 172.21.15.192:0/922801997 shutdown_connections 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 --2- 172.21.15.192:0/922801997 >> v2:172.21.15.194:3300/0 conn(0x7f65bc0afbe0 0x7f65bc0b0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 --2- 172.21.15.192:0/922801997 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc15b810 0x7f65bc15bc50 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 -- 172.21.15.192:0/922801997 >> 172.21.15.192:0/922801997 conn(0x7f65bc0ae7f0 msgr2=0x7f65bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 -- 172.21.15.192:0/922801997 shutdown_connections 2024-09-13T18:45:55.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.810+0000 7f65bbe00640 1 -- 172.21.15.192:0/922801997 wait complete. 2024-09-13T18:45:55.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.811+0000 7f65bbe00640 1 Processor -- start 2024-09-13T18:45:55.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 -- start start 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 0x7f65bc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 0x7f65bc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc13d9c0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc0ccf50 con 0x7f65bc15b810 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.812+0000 7f65bbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65bc143960 con 0x7f65bc1402c0 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38100/0 (socket says 172.21.15.192:38100) 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 -- 172.21.15.192:0/2775516309 learned_addr learned my addr 172.21.15.192:0/2775516309 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65bb400640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 0x7f65bc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65b2000640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 0x7f65bc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 -- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 msgr2=0x7f65bc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 0x7f65bc0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 -- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 msgr2=0x7f65bc0add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:55.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 0x7f65bc0add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:55.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 -- 172.21.15.192:0/2775516309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40094d0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65bb400640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 0x7f65bc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65b2000640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 0x7f65bc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.813+0000 7f65baa00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c450 tx=0x7f65ac00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.814+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0052d0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.814+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac005430 con 0x7f65bc0afbe0 2024-09-13T18:45:55.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.814+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65ac012870 con 0x7f65bc0afbe0 2024-09-13T18:45:55.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.814+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc0cd3e0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.814+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc0cc620 con 0x7f65bc0afbe0 2024-09-13T18:45:55.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.815+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc0b0050 con 0x7f65bc0afbe0 2024-09-13T18:45:55.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.816+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f65ac0129d0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.816+0000 7f65b3400640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 0x7f659806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:55.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.817+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(179..179 src has 1..179) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65ac088ee0 con 0x7f65bc0afbe0 2024-09-13T18:45:55.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.817+0000 7f65b2000640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 0x7f659806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:55.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.817+0000 7f65b2000640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 0x7f659806d0c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f65a4034000 tx=0x7f65a402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:55.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:55.821+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f65ac054020 con 0x7f65bc0afbe0 2024-09-13T18:45:56.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.024+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f65bc071a50 con 0x7f65bc0afbe0 2024-09-13T18:45:56.910 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.908+0000 7f65b3400640 1 -- 172.21.15.192:0/2775516309 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f65ac057640 con 0x7f65bc0afbe0 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 msgr2=0x7f659806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 0x7f659806d0c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f65a4034000 tx=0x7f65a402e000 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 msgr2=0x7f65bc13d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c450 tx=0x7f65ac00c910 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 shutdown_connections 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f659806ac00 0x7f659806d0c0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f65bc15b810 0x7f65bc0add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f65bc1402c0 0x7f65bc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 --2- 172.21.15.192:0/2775516309 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65bc0afbe0 0x7f65bc13d480 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:56.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 >> 172.21.15.192:0/2775516309 conn(0x7f65bc0ae7f0 msgr2=0x7f65bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:56.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 shutdown_connections 2024-09-13T18:45:56.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:56.911+0000 7f65bbe00640 1 -- 172.21.15.192:0/2775516309 wait complete. 2024-09-13T18:45:56.931 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:45:56.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:45:57.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.090+0000 7f1b47e00640 1 Processor -- start 2024-09-13T18:45:57.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.090+0000 7f1b47e00640 1 -- start start 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b480b6300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b48160890 0x7f1b480d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b480b75c0 con 0x7f1b480cf990 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b480d2570 con 0x7f1b48160890 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480b69b0 con 0x7f1b481604b0 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1b480cf990 0x7f1b480cd6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45082/0 (socket says 172.21.15.192:45082) 2024-09-13T18:45:57.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.091+0000 7f1b47400640 1 -- 172.21.15.192:0/3441434198 learned_addr learned my addr 172.21.15.192:0/3441434198 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3511372660 0 0) 0x7f1b480b75c0 con 0x7f1b480cf990 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b2c003520 con 0x7f1b480cf990 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46a00640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b480b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/3441434198 >> v2:172.21.15.194:3300/0 conn(0x7f1b48160890 0x7f1b480d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361046536 0 0) 0x7f1b2c003520 con 0x7f1b480cf990 2024-09-13T18:45:57.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 msgr2=0x7f1b480b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b480b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 >> v2:172.21.15.194:3300/0 conn(0x7f1b48160890 msgr2=0x7f1b480d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 --2- 172.21.15.192:0/3441434198 >> v2:172.21.15.194:3300/0 conn(0x7f1b48160890 0x7f1b480d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480b6c90 con 0x7f1b480cf990 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f1b400019f0 con 0x7f1b480cf990 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/3441434198 >> v2:172.21.15.194:3300/0 conn(0x7f1b48160890 0x7f1b480d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 >> v1:172.21.15.192:6789/0 conn(0x7f1b480cf990 legacy=0x7f1b480cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c003970 0x7f1b2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c004d00 0x7f1b2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480d2570 con 0x7f1b2c004d00 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480b69b0 con 0x7f1b2c003970 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2c00ba30 con 0x7f1b481604b0 2024-09-13T18:45:57.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b47400640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c004d00 0x7f1b2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.092+0000 7f1b46a00640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c003970 0x7f1b2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b47400640 1 -- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 msgr2=0x7f1b2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b47400640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b481604b0 0x7f1b2c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b47400640 1 -- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c003970 msgr2=0x7f1b2c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b47400640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c003970 0x7f1b2c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b47400640 1 -- 172.21.15.192:0/3441434198 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c003520 con 0x7f1b2c004d00 2024-09-13T18:45:57.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.093+0000 7f1b46a00640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c003970 0x7f1b2c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:45:57.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.094+0000 7f1b47400640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c004d00 0x7f1b2c005180 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000a890 tx=0x7f1b2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee5c47661f4c548 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:57.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.094+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4002ba60 con 0x7f1b2c004d00 2024-09-13T18:45:57.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.094+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4002bbc0 con 0x7f1b2c004d00 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.094+0000 7f1b46000640 1 -- 172.21.15.192:0/3441434198 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40034470 con 0x7f1b2c004d00 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 -- 172.21.15.192:0/3441434198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c004d00 msgr2=0x7f1b2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 --2- 172.21.15.192:0/3441434198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b2c004d00 0x7f1b2c005180 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000a890 tx=0x7f1b2c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47400640 1 -- 172.21.15.192:0/3441434198 reap_dead start 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 -- 172.21.15.192:0/3441434198 shutdown_connections 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 -- 172.21.15.192:0/3441434198 >> 172.21.15.192:0/3441434198 conn(0x7f1b480b4bb0 msgr2=0x7f1b480b4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 -- 172.21.15.192:0/3441434198 shutdown_connections 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.095+0000 7f1b47e00640 1 -- 172.21.15.192:0/3441434198 wait complete. 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.096+0000 7f1b47e00640 1 Processor -- start 2024-09-13T18:45:57.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.096+0000 7f1b47e00640 1 -- start start 2024-09-13T18:45:57.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c004d00 0x7f1b480c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 0x7f1b4814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480c7650 con 0x7f1b4815ef70 2024-09-13T18:45:57.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480c6a60 con 0x7f1b2c004d00 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.097+0000 7f1b47e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b480c6cb0 con 0x7f1b4815f3f0 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38128/0 (socket says 172.21.15.192:38128) 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 -- 172.21.15.192:0/1730705317 learned_addr learned my addr 172.21.15.192:0/1730705317 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b46a00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c004d00 0x7f1b480c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b47400640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 0x7f1b4814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 -- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 msgr2=0x7f1b4814e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 0x7f1b4814e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 -- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c004d00 msgr2=0x7f1b480c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c004d00 0x7f1b480c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 -- 172.21.15.192:0/1730705317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b480c6f90 con 0x7f1b4815ef70 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b47400640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 0x7f1b4814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3fe00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f1b300116f0 tx=0x7f1b30011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:57.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000c070 con 0x7f1b4815ef70 2024-09-13T18:45:57.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30004220 con 0x7f1b4815ef70 2024-09-13T18:45:57.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3000f7c0 con 0x7f1b4815ef70 2024-09-13T18:45:57.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.098+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b480c7270 con 0x7f1b4815ef70 2024-09-13T18:45:57.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.099+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b480c8960 con 0x7f1b4815ef70 2024-09-13T18:45:57.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.100+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b480c78c0 con 0x7f1b4815ef70 2024-09-13T18:45:57.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.100+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b3000f920 con 0x7f1b4815ef70 2024-09-13T18:45:57.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.101+0000 7f1b3ea00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 0x7f1b2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:57.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.101+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b30089420 con 0x7f1b4815ef70 2024-09-13T18:45:57.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.101+0000 7f1b46a00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 0x7f1b2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:57.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.102+0000 7f1b46a00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 0x7f1b2406d0c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b5d0 tx=0x7f1b38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:57.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.106+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b300546a0 con 0x7f1b4815ef70 2024-09-13T18:45:57.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.309+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1b48067450 con 0x7f1b4815ef70 2024-09-13T18:45:57.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.909+0000 7f1b3ea00640 1 -- 172.21.15.192:0/1730705317 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1b30057cc0 con 0x7f1b4815ef70 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.912+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 msgr2=0x7f1b2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.912+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 0x7f1b2406d0c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1b3800b5d0 tx=0x7f1b38008040 comp rx=0 tx=0).stop 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.912+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 msgr2=0x7f1b4814e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.912+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f1b300116f0 tx=0x7f1b30011bb0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 shutdown_connections 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b2406ac00 0x7f1b2406d0c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b4815f3f0 0x7f1b4814e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b4815ef70 0x7f1b4814e0d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 --2- 172.21.15.192:0/1730705317 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b2c004d00 0x7f1b480c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:57.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 >> 172.21.15.192:0/1730705317 conn(0x7f1b480b4bb0 msgr2=0x7f1b4815d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:57.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 shutdown_connections 2024-09-13T18:45:57.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:57.913+0000 7f1b47e00640 1 -- 172.21.15.192:0/1730705317 wait complete. 2024-09-13T18:45:57.933 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:45:57.933 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:45:58.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.082+0000 7f71b0200640 1 Processor -- start 2024-09-13T18:45:58.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.083+0000 7f71b0200640 1 -- start start 2024-09-13T18:45:58.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71b0200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f71a80afd80 0x7f71a80b0160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71b0200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a81586f0 con 0x7f71a80b2690 2024-09-13T18:45:58.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71b0200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a80b06a0 con 0x7f71a80b2b00 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71b0200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a81627f0 con 0x7f71a80afd80 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71ace00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f71a80b2690 0x7f71a8161790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45092/0 (socket says 172.21.15.192:45092) 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71ace00640 1 -- 172.21.15.192:0/340898433 learned_addr learned my addr 172.21.15.192:0/340898433 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71ad800640 1 --2- 172.21.15.192:0/340898433 >> v2:172.21.15.194:3300/0 conn(0x7f71a80afd80 0x7f71a80b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.084+0000 7f71a7e00640 1 -- 172.21.15.192:0/340898433 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 924944880 0 0) 0x7f71a81586f0 con 0x7f71a80b2690 2024-09-13T18:45:58.089 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.085+0000 7f71a7e00640 1 -- 172.21.15.192:0/340898433 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003520 con 0x7f71a80b2690 2024-09-13T18:45:58.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.085+0000 7f71ad800640 1 -- 172.21.15.192:0/340898433 >> v1:172.21.15.194:6789/0 conn(0x7f71a80b2b00 legacy=0x7f71a8162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.085+0000 7f71ad800640 1 -- 172.21.15.192:0/340898433 >> v1:172.21.15.192:6789/0 conn(0x7f71a80b2690 legacy=0x7f71a8161790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.085+0000 7f71ad800640 1 -- 172.21.15.192:0/340898433 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a8162230 con 0x7f71a80afd80 2024-09-13T18:45:58.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.086+0000 7f71ad800640 1 --2- 172.21.15.192:0/340898433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80b0160 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f719c0097d0 tx=0x7f719c02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83c2ad92b51a768b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71a7e00640 1 -- 172.21.15.192:0/340898433 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c032440 con 0x7f71a80afd80 2024-09-13T18:45:58.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71a7e00640 1 -- 172.21.15.192:0/340898433 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c0325a0 con 0x7f71a80afd80 2024-09-13T18:45:58.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71a7e00640 1 -- 172.21.15.192:0/340898433 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c032910 con 0x7f71a80afd80 2024-09-13T18:45:58.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 -- 172.21.15.192:0/340898433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 msgr2=0x7f71a80b0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 --2- 172.21.15.192:0/340898433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80b0160 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f719c0097d0 tx=0x7f719c02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 -- 172.21.15.192:0/340898433 shutdown_connections 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 --2- 172.21.15.192:0/340898433 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80b0160 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 -- 172.21.15.192:0/340898433 >> 172.21.15.192:0/340898433 conn(0x7f71a80ae960 msgr2=0x7f71a806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 -- 172.21.15.192:0/340898433 shutdown_connections 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.087+0000 7f71b0200640 1 -- 172.21.15.192:0/340898433 wait complete. 2024-09-13T18:45:58.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.089+0000 7f71b0200640 1 Processor -- start 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.089+0000 7f71b0200640 1 -- start start 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71a80b2b00 0x7f71a80ad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80ad9f0 con 0x7f71a80b2690 2024-09-13T18:45:58.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80adcd0 con 0x7f71a80afd80 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71b0200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80adfb0 con 0x7f71a80b2b00 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71ace00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71ace00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38140/0 (socket says 172.21.15.192:38140) 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71ace00640 1 -- 172.21.15.192:0/1603512575 learned_addr learned my addr 172.21.15.192:0/1603512575 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71ad800640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.090+0000 7f71ae200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71a80b2b00 0x7f71a80ad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 -- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71a80b2b00 msgr2=0x7f71a80ad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71a80b2b00 0x7f71a80ad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 -- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 msgr2=0x7f71a80aaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80aaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 -- 172.21.15.192:0/1603512575 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719c009400 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71ace00640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7194001eb0 tx=0x7f719400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194005ce0 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7194005e40 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7194007270 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a80ae290 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.091+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a8158170 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.092+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a81e97d0 con 0x7f71a80b2690 2024-09-13T18:45:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.093+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7194007490 con 0x7f71a80b2690 2024-09-13T18:45:58.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.094+0000 7f71a5600640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 0x7f718806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.095+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7194088900 con 0x7f71a80b2690 2024-09-13T18:45:58.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.095+0000 7f71ad800640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 0x7f718806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.095+0000 7f71ad800640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 0x7f718806d0c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f719c034000 tx=0x7f719c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.099+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f71a81e97d0 con 0x7f71a80b2690 2024-09-13T18:45:58.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.300+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71a81e97d0 con 0x7f71a80b2690 2024-09-13T18:45:58.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.300+0000 7f71a5600640 1 -- 172.21.15.192:0/1603512575 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f71a81e97d0 con 0x7f71a80b2690 2024-09-13T18:45:58.303 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:58.303 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:45:58.304 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:45:58.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.302+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 msgr2=0x7f718806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.302+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 0x7f718806d0c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f719c034000 tx=0x7f719c02e000 comp rx=0 tx=0).stop 2024-09-13T18:45:58.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.302+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 msgr2=0x7f71a80acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.302+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f7194001eb0 tx=0x7f719400c960 comp rx=0 tx=0).stop 2024-09-13T18:45:58.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 shutdown_connections 2024-09-13T18:45:58.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f718806ac00 0x7f718806d0c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.306 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71a80b2b00 0x7f71a80ad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71a80b2690 0x7f71a80acea0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 --2- 172.21.15.192:0/1603512575 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71a80afd80 0x7f71a80aaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 >> 172.21.15.192:0/1603512575 conn(0x7f71a80ae960 msgr2=0x7f71a806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 shutdown_connections 2024-09-13T18:45:58.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.303+0000 7f71b0200640 1 -- 172.21.15.192:0/1603512575 wait complete. 2024-09-13T18:45:58.322 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:45:58.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.470+0000 7f1b87a00640 1 Processor -- start 2024-09-13T18:45:58.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.470+0000 7f1b87a00640 1 -- start start 2024-09-13T18:45:58.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1b80146610 0x7f1b800ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b800ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1b800afd80 0x7f1b800b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800cd920 con 0x7f1b800afd80 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800b06f0 con 0x7f1b80146610 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.471+0000 7f1b87a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800ae770 con 0x7f1b800b2780 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1b800afd80 0x7f1b800b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1b800afd80 0x7f1b800b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38154/0 (socket says 172.21.15.192:38154) 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 -- 172.21.15.192:0/1402149267 learned_addr learned my addr 172.21.15.192:0/1402149267 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85000640 1 --2- 172.21.15.192:0/1402149267 >> v2:172.21.15.194:3300/0 conn(0x7f1b80146610 0x7f1b800ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b7fe00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b800ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 -- 172.21.15.192:0/1402149267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 msgr2=0x7f1b800ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:58.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b800ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 -- 172.21.15.192:0/1402149267 >> v2:172.21.15.194:3300/0 conn(0x7f1b80146610 msgr2=0x7f1b800ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:58.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 --2- 172.21.15.192:0/1402149267 >> v2:172.21.15.194:3300/0 conn(0x7f1b80146610 0x7f1b800ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.472+0000 7f1b85a00640 1 -- 172.21.15.192:0/1402149267 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800cdb30 con 0x7f1b800afd80 2024-09-13T18:45:58.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.473+0000 7f1b85a00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b800afd80 0x7f1b800b01b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1b8006cd20 tx=0x7f1b7802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f07c45071b558d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.473+0000 7f1b7f400640 1 -- 172.21.15.192:0/1402149267 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78031600 con 0x7f1b800afd80 2024-09-13T18:45:58.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.473+0000 7f1b7f400640 1 -- 172.21.15.192:0/1402149267 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7802d050 con 0x7f1b800afd80 2024-09-13T18:45:58.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.473+0000 7f1b7f400640 1 -- 172.21.15.192:0/1402149267 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b78031980 con 0x7f1b800afd80 2024-09-13T18:45:58.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 -- 172.21.15.192:0/1402149267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b800afd80 msgr2=0x7f1b800b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b800afd80 0x7f1b800b01b0 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f1b8006cd20 tx=0x7f1b7802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 -- 172.21.15.192:0/1402149267 shutdown_connections 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b800afd80 0x7f1b800b01b0 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 --2- 172.21.15.192:0/1402149267 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b800ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 --2- 172.21.15.192:0/1402149267 >> v2:172.21.15.194:3300/0 conn(0x7f1b80146610 0x7f1b800ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 -- 172.21.15.192:0/1402149267 >> 172.21.15.192:0/1402149267 conn(0x7f1b800ae960 msgr2=0x7f1b8006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 -- 172.21.15.192:0/1402149267 shutdown_connections 2024-09-13T18:45:58.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.474+0000 7f1b87a00640 1 -- 172.21.15.192:0/1402149267 wait complete. 2024-09-13T18:45:58.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.476+0000 7f1b87a00640 1 Processor -- start 2024-09-13T18:45:58.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.476+0000 7f1b87a00640 1 -- start start 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 0x7f1b8013e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b8006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8006fa20 con 0x7f1b80146610 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8006fd00 con 0x7f1b800afd80 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b87a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8006ffe0 con 0x7f1b800b2780 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b85a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b85a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38160/0 (socket says 172.21.15.192:38160) 2024-09-13T18:45:58.480 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.477+0000 7f1b85a00640 1 -- 172.21.15.192:0/313219145 learned_addr learned my addr 172.21.15.192:0/313219145 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85000640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 0x7f1b8013e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b7fe00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b8006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 -- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 msgr2=0x7f1b8006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b8006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 -- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 msgr2=0x7f1b8013e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 0x7f1b8013e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 -- 172.21.15.192:0/313219145 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b78009b30 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85000640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 0x7f1b8013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b7fe00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b8006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b85a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009f40 tx=0x7f1b78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7803d860 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7803d9c0 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7803dd70 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b800702c0 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.478+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b801f25f0 con 0x7f1b80146610 2024-09-13T18:45:58.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.479+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b800707e0 con 0x7f1b80146610 2024-09-13T18:45:58.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.480+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1b7803b400 con 0x7f1b80146610 2024-09-13T18:45:58.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.481+0000 7f1b7cc00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 0x7f1b6006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.481+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b780aa2f0 con 0x7f1b80146610 2024-09-13T18:45:58.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.481+0000 7f1b85000640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 0x7f1b6006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.482+0000 7f1b85000640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 0x7f1b6006d0c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009a20 tx=0x7f1b70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.485+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1b800707e0 con 0x7f1b80146610 2024-09-13T18:45:58.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.654+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b800707e0 con 0x7f1b80146610 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.655+0000 7f1b7cc00640 1 -- 172.21.15.192:0/313219145 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v180) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f1b800707e0 con 0x7f1b80146610 2024-09-13T18:45:58.658 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:58.659 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":180,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:45:55.894196+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"180","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 msgr2=0x7f1b6006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 0x7f1b6006d0c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009a20 tx=0x7f1b70008040 comp rx=0 tx=0).stop 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 msgr2=0x7f1b8006b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f1b78009f40 tx=0x7f1b78004a40 comp rx=0 tx=0).stop 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 shutdown_connections 2024-09-13T18:45:58.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1b6006ac00 0x7f1b6006d0c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b80146610 0x7f1b8006b430 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1b800b2780 0x7f1b8006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 --2- 172.21.15.192:0/313219145 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1b800afd80 0x7f1b8013e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 >> 172.21.15.192:0/313219145 conn(0x7f1b800ae960 msgr2=0x7f1b800aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 shutdown_connections 2024-09-13T18:45:58.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.657+0000 7f1b87a00640 1 -- 172.21.15.192:0/313219145 wait complete. 2024-09-13T18:45:58.677 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:45:58.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:58.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.826+0000 7ff2a3200640 1 Processor -- start 2024-09-13T18:45:58.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.826+0000 7ff2a3200640 1 -- start start 2024-09-13T18:45:58.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.827+0000 7ff2a3200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2a415a9e0 0x7ff2a406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.827+0000 7ff2a3200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a406c5d0 con 0x7ff2a406b3d0 2024-09-13T18:45:58.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.827+0000 7ff2a3200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2a40b3920 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.827+0000 7ff2a3200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2a40b3730 con 0x7ff2a415a9e0 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff2a415a9e0 0x7ff2a406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff2a406b3d0 0x7ff2a40cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45098/0 (socket says 172.21.15.192:45098) 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1400640 1 -- 172.21.15.192:0/865446694 learned_addr learned my addr 172.21.15.192:0/865446694 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1e00640 1 -- 172.21.15.192:0/865446694 >> v1:172.21.15.194:6789/0 conn(0x7ff2a40cdfd0 legacy=0x7ff2a4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1e00640 1 -- 172.21.15.192:0/865446694 >> v1:172.21.15.192:6789/0 conn(0x7ff2a406b3d0 legacy=0x7ff2a40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a1e00640 1 -- 172.21.15.192:0/865446694 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a40b3c00 con 0x7ff2a415a9e0 2024-09-13T18:45:58.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.828+0000 7ff2a0a00640 1 -- 172.21.15.192:0/865446694 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 655068868 0 0) 0x7ff2a406c5d0 con 0x7ff2a406b3d0 2024-09-13T18:45:58.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.829+0000 7ff2a1e00640 1 --2- 172.21.15.192:0/865446694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415a9e0 0x7ff2a406ae90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daccc1ca865e14f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.829+0000 7ff2a0a00640 1 -- 172.21.15.192:0/865446694 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294007740 con 0x7ff2a415a9e0 2024-09-13T18:45:58.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a0a00640 1 -- 172.21.15.192:0/865446694 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff29402d050 con 0x7ff2a415a9e0 2024-09-13T18:45:58.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a0a00640 1 -- 172.21.15.192:0/865446694 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff294007ac0 con 0x7ff2a415a9e0 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 -- 172.21.15.192:0/865446694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415a9e0 msgr2=0x7ff2a406ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 --2- 172.21.15.192:0/865446694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415a9e0 0x7ff2a406ae90 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7ff294009d90 tx=0x7ff29402a6f0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 -- 172.21.15.192:0/865446694 shutdown_connections 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 --2- 172.21.15.192:0/865446694 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a415a9e0 0x7ff2a406ae90 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 -- 172.21.15.192:0/865446694 >> 172.21.15.192:0/865446694 conn(0x7ff2a40736d0 msgr2=0x7ff2a40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:58.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 -- 172.21.15.192:0/865446694 shutdown_connections 2024-09-13T18:45:58.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.830+0000 7ff2a3200640 1 -- 172.21.15.192:0/865446694 wait complete. 2024-09-13T18:45:58.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.832+0000 7ff2a3200640 1 Processor -- start 2024-09-13T18:45:58.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.832+0000 7ff2a3200640 1 -- start start 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 0x7ff2a41f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 0x7ff2a414bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a414f590 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a414efd0 con 0x7ff2a415a9e0 2024-09-13T18:45:58.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a3200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a414f2b0 con 0x7ff2a406b3d0 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38180/0 (socket says 172.21.15.192:38180) 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 -- 172.21.15.192:0/1039428950 learned_addr learned my addr 172.21.15.192:0/1039428950 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1e00640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 0x7ff2a41f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a2800640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 0x7ff2a414bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 -- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 msgr2=0x7ff2a41f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 0x7ff2a41f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 -- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 msgr2=0x7ff2a414bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 0x7ff2a414bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a1400640 1 -- 172.21.15.192:0/1039428950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff294009a70 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.833+0000 7ff2a2800640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 0x7ff2a414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:58.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff2a1e00640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 0x7ff2a41f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:58.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff2a1400640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c3c0 tx=0x7ff29000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2900074e0 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff290007640 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a4150230 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff290004a20 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.834+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a414ec30 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.836+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a4150750 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.836+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff290004b80 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.837+0000 7ff29a000640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 0x7ff28406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:58.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.837+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2900890d0 con 0x7ff2a40cdfd0 2024-09-13T18:45:58.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.838+0000 7ff2a1e00640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 0x7ff28406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:58.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.838+0000 7ff2a1e00640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 0x7ff28406d0f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff294034000 tx=0x7ff29402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:58.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:58.841+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff2a4150750 con 0x7ff2a40cdfd0 2024-09-13T18:45:59.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.012+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2a406a970 con 0x7ff28406ac30 2024-09-13T18:45:59.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.020+0000 7ff29a000640 1 -- 172.21.15.192:0/1039428950 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284907 (secure 0 0 0) 0x7ff294041070 con 0x7ff28406ac30 2024-09-13T18:45:59.026 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:59.028 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 msgr2=0x7ff28406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 0x7ff28406d0f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff294034000 tx=0x7ff29402f000 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 msgr2=0x7ff2a414e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7ff29000c3c0 tx=0x7ff29000c880 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 shutdown_connections 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff28406ac30 0x7ff28406d0f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff2a415a9e0 0x7ff2a414bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2a40cdfd0 0x7ff2a414e6f0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 --2- 172.21.15.192:0/1039428950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff2a406b3d0 0x7ff2a41f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.024+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 >> 172.21.15.192:0/1039428950 conn(0x7ff2a40736d0 msgr2=0x7ff2a40b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.025+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 shutdown_connections 2024-09-13T18:45:59.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.025+0000 7ff2a3200640 1 -- 172.21.15.192:0/1039428950 wait complete. 2024-09-13T18:45:59.043 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T18:45:58.874687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553460,"statfs":{"total":1600000000,"available":1590743296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396870"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897776+0000","last_change":"2024-09-13T18:45:54.901750+0000","last_active":"2024-09-13T18:45:55.897776+0000","last_peered":"2024-09-13T18:45:55.897776+0000","last_clean":"2024-09-13T18:45:55.897776+0000","last_became_active":"2024-09-13T18:45:54.901533+0000","last_became_peered":"2024-09-13T18:45:54.901533+0000","last_unstale":"2024-09-13T18:45:55.897776+0000","last_undegraded":"2024-09-13T18:45:55.897776+0000","last_fullsized":"2024-09-13T18:45:55.897776+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.183202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010599+0000","last_change":"2024-09-13T18:45:54.902052+0000","last_active":"2024-09-13T18:45:56.010599+0000","last_peered":"2024-09-13T18:45:56.010599+0000","last_clean":"2024-09-13T18:45:56.010599+0000","last_became_active":"2024-09-13T18:45:54.901778+0000","last_became_peered":"2024-09-13T18:45:54.901778+0000","last_unstale":"2024-09-13T18:45:56.010599+0000","last_undegraded":"2024-09-13T18:45:56.010599+0000","last_fullsized":"2024-09-13T18:45:56.010599+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:43.473451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010448+0000","last_change":"2024-09-13T18:45:54.912065+0000","last_active":"2024-09-13T18:45:56.010448+0000","last_peered":"2024-09-13T18:45:56.010448+0000","last_clean":"2024-09-13T18:45:56.010448+0000","last_became_active":"2024-09-13T18:45:54.909940+0000","last_became_peered":"2024-09-13T18:45:54.909940+0000","last_unstale":"2024-09-13T18:45:56.010448+0000","last_undegraded":"2024-09-13T18:45:56.010448+0000","last_fullsized":"2024-09-13T18:45:56.010448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:47.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898616+0000","last_change":"2024-09-13T18:45:54.910427+0000","last_active":"2024-09-13T18:45:55.898616+0000","last_peered":"2024-09-13T18:45:55.898616+0000","last_clean":"2024-09-13T18:45:55.898616+0000","last_became_active":"2024-09-13T18:45:54.910087+0000","last_became_peered":"2024-09-13T18:45:54.910087+0000","last_unstale":"2024-09-13T18:45:55.898616+0000","last_undegraded":"2024-09-13T18:45:55.898616+0000","last_fullsized":"2024-09-13T18:45:55.898616+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:27.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011663+0000","last_change":"2024-09-13T18:45:54.910009+0000","last_active":"2024-09-13T18:45:56.011663+0000","last_peered":"2024-09-13T18:45:56.011663+0000","last_clean":"2024-09-13T18:45:56.011663+0000","last_became_active":"2024-09-13T18:45:54.909801+0000","last_became_peered":"2024-09-13T18:45:54.909801+0000","last_unstale":"2024-09-13T18:45:56.011663+0000","last_undegraded":"2024-09-13T18:45:56.011663+0000","last_fullsized":"2024-09-13T18:45:56.011663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:36.347672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011555+0000","last_change":"2024-09-13T18:45:54.911923+0000","last_active":"2024-09-13T18:45:56.011555+0000","last_peered":"2024-09-13T18:45:56.011555+0000","last_clean":"2024-09-13T18:45:56.011555+0000","last_became_active":"2024-09-13T18:45:54.911356+0000","last_became_peered":"2024-09-13T18:45:54.911356+0000","last_unstale":"2024-09-13T18:45:56.011555+0000","last_undegraded":"2024-09-13T18:45:56.011555+0000","last_fullsized":"2024-09-13T18:45:56.011555+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487850+0000","last_change":"2024-09-13T18:45:54.487850+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487850+0000","last_undegraded":"2024-09-13T18:45:54.487850+0000","last_fullsized":"2024-09-13T18:45:54.487850+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897854+0000","last_change":"2024-09-13T18:45:54.907913+0000","last_active":"2024-09-13T18:45:55.897854+0000","last_peered":"2024-09-13T18:45:55.897854+0000","last_clean":"2024-09-13T18:45:55.897854+0000","last_became_active":"2024-09-13T18:45:54.906386+0000","last_became_peered":"2024-09-13T18:45:54.906386+0000","last_unstale":"2024-09-13T18:45:55.897854+0000","last_undegraded":"2024-09-13T18:45:55.897854+0000","last_fullsized":"2024-09-13T18:45:55.897854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.005604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011137+0000","last_change":"2024-09-13T18:45:54.905215+0000","last_active":"2024-09-13T18:45:56.011137+0000","last_peered":"2024-09-13T18:45:56.011137+0000","last_clean":"2024-09-13T18:45:56.011137+0000","last_became_active":"2024-09-13T18:45:54.904546+0000","last_became_peered":"2024-09-13T18:45:54.904546+0000","last_unstale":"2024-09-13T18:45:56.011137+0000","last_undegraded":"2024-09-13T18:45:56.011137+0000","last_fullsized":"2024-09-13T18:45:56.011137+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011337+0000","last_change":"2024-09-13T18:45:54.920649+0000","last_active":"2024-09-13T18:45:56.011337+0000","last_peered":"2024-09-13T18:45:56.011337+0000","last_clean":"2024-09-13T18:45:56.011337+0000","last_became_active":"2024-09-13T18:45:54.919304+0000","last_became_peered":"2024-09-13T18:45:54.919304+0000","last_unstale":"2024-09-13T18:45:56.011337+0000","last_undegraded":"2024-09-13T18:45:56.011337+0000","last_fullsized":"2024-09-13T18:45:56.011337+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:37.311809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011203+0000","last_change":"2024-09-13T18:45:54.905859+0000","last_active":"2024-09-13T18:45:56.011203+0000","last_peered":"2024-09-13T18:45:56.011203+0000","last_clean":"2024-09-13T18:45:56.011203+0000","last_became_active":"2024-09-13T18:45:54.905045+0000","last_became_peered":"2024-09-13T18:45:54.905045+0000","last_unstale":"2024-09-13T18:45:56.011203+0000","last_undegraded":"2024-09-13T18:45:56.011203+0000","last_fullsized":"2024-09-13T18:45:56.011203+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010854+0000","last_change":"2024-09-13T18:45:54.916941+0000","last_active":"2024-09-13T18:45:56.010854+0000","last_peered":"2024-09-13T18:45:56.010854+0000","last_clean":"2024-09-13T18:45:56.010854+0000","last_became_active":"2024-09-13T18:45:54.916473+0000","last_became_peered":"2024-09-13T18:45:54.916473+0000","last_unstale":"2024-09-13T18:45:56.010854+0000","last_undegraded":"2024-09-13T18:45:56.010854+0000","last_fullsized":"2024-09-13T18:45:56.010854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010195+0000","last_change":"2024-09-13T18:45:54.909427+0000","last_active":"2024-09-13T18:45:56.010195+0000","last_peered":"2024-09-13T18:45:56.010195+0000","last_clean":"2024-09-13T18:45:56.010195+0000","last_became_active":"2024-09-13T18:45:54.909217+0000","last_became_peered":"2024-09-13T18:45:54.909217+0000","last_unstale":"2024-09-13T18:45:56.010195+0000","last_undegraded":"2024-09-13T18:45:56.010195+0000","last_fullsized":"2024-09-13T18:45:56.010195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:38.177689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010199+0000","last_change":"2024-09-13T18:45:54.906851+0000","last_active":"2024-09-13T18:45:56.010199+0000","last_peered":"2024-09-13T18:45:56.010199+0000","last_clean":"2024-09-13T18:45:56.010199+0000","last_became_active":"2024-09-13T18:45:54.906648+0000","last_became_peered":"2024-09-13T18:45:54.906648+0000","last_unstale":"2024-09-13T18:45:56.010199+0000","last_undegraded":"2024-09-13T18:45:56.010199+0000","last_fullsized":"2024-09-13T18:45:56.010199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011707+0000","last_change":"2024-09-13T18:45:54.908866+0000","last_active":"2024-09-13T18:45:56.011707+0000","last_peered":"2024-09-13T18:45:56.011707+0000","last_clean":"2024-09-13T18:45:56.011707+0000","last_became_active":"2024-09-13T18:45:54.908632+0000","last_became_peered":"2024-09-13T18:45:54.908632+0000","last_unstale":"2024-09-13T18:45:56.011707+0000","last_undegraded":"2024-09-13T18:45:56.011707+0000","last_fullsized":"2024-09-13T18:45:56.011707+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.121006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.488730+0000","last_change":"2024-09-13T18:45:54.488730+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.488730+0000","last_undegraded":"2024-09-13T18:45:54.488730+0000","last_fullsized":"2024-09-13T18:45:54.488730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010405+0000","last_change":"2024-09-13T18:45:54.918944+0000","last_active":"2024-09-13T18:45:56.010405+0000","last_peered":"2024-09-13T18:45:56.010405+0000","last_clean":"2024-09-13T18:45:56.010405+0000","last_became_active":"2024-09-13T18:45:54.917581+0000","last_became_peered":"2024-09-13T18:45:54.917581+0000","last_unstale":"2024-09-13T18:45:56.010405+0000","last_undegraded":"2024-09-13T18:45:56.010405+0000","last_fullsized":"2024-09-13T18:45:56.010405+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010281+0000","last_change":"2024-09-13T18:45:54.905549+0000","last_active":"2024-09-13T18:45:56.010281+0000","last_peered":"2024-09-13T18:45:56.010281+0000","last_clean":"2024-09-13T18:45:56.010281+0000","last_became_active":"2024-09-13T18:45:54.905342+0000","last_became_peered":"2024-09-13T18:45:54.905342+0000","last_unstale":"2024-09-13T18:45:56.010281+0000","last_undegraded":"2024-09-13T18:45:56.010281+0000","last_fullsized":"2024-09-13T18:45:56.010281+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:01.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898360+0000","last_change":"2024-09-13T18:45:54.902557+0000","last_active":"2024-09-13T18:45:55.898360+0000","last_peered":"2024-09-13T18:45:55.898360+0000","last_clean":"2024-09-13T18:45:55.898360+0000","last_became_active":"2024-09-13T18:45:54.902298+0000","last_became_peered":"2024-09-13T18:45:54.902298+0000","last_unstale":"2024-09-13T18:45:55.898360+0000","last_undegraded":"2024-09-13T18:45:55.898360+0000","last_fullsized":"2024-09-13T18:45:55.898360+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.144087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897970+0000","last_change":"2024-09-13T18:45:54.906737+0000","last_active":"2024-09-13T18:45:55.897970+0000","last_peered":"2024-09-13T18:45:55.897970+0000","last_clean":"2024-09-13T18:45:55.897970+0000","last_became_active":"2024-09-13T18:45:54.905140+0000","last_became_peered":"2024-09-13T18:45:54.905140+0000","last_unstale":"2024-09-13T18:45:55.897970+0000","last_undegraded":"2024-09-13T18:45:55.897970+0000","last_fullsized":"2024-09-13T18:45:55.897970+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:09.859640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010935+0000","last_change":"2024-09-13T18:45:54.920838+0000","last_active":"2024-09-13T18:45:56.010935+0000","last_peered":"2024-09-13T18:45:56.010935+0000","last_clean":"2024-09-13T18:45:56.010935+0000","last_became_active":"2024-09-13T18:45:54.920389+0000","last_became_peered":"2024-09-13T18:45:54.920389+0000","last_unstale":"2024-09-13T18:45:56.010935+0000","last_undegraded":"2024-09-13T18:45:56.010935+0000","last_fullsized":"2024-09-13T18:45:56.010935+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:04.690253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010936+0000","last_change":"2024-09-13T18:45:54.913459+0000","last_active":"2024-09-13T18:45:56.010936+0000","last_peered":"2024-09-13T18:45:56.010936+0000","last_clean":"2024-09-13T18:45:56.010936+0000","last_became_active":"2024-09-13T18:45:54.911505+0000","last_became_peered":"2024-09-13T18:45:54.911505+0000","last_unstale":"2024-09-13T18:45:56.010936+0000","last_undegraded":"2024-09-13T18:45:56.010936+0000","last_fullsized":"2024-09-13T18:45:56.010936+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898627+0000","last_change":"2024-09-13T18:45:54.905226+0000","last_active":"2024-09-13T18:45:55.898627+0000","last_peered":"2024-09-13T18:45:55.898627+0000","last_clean":"2024-09-13T18:45:55.898627+0000","last_became_active":"2024-09-13T18:45:54.904669+0000","last_became_peered":"2024-09-13T18:45:54.904669+0000","last_unstale":"2024-09-13T18:45:55.898627+0000","last_undegraded":"2024-09-13T18:45:55.898627+0000","last_fullsized":"2024-09-13T18:45:55.898627+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:06.638083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.009933+0000","last_change":"2024-09-13T18:45:54.916788+0000","last_active":"2024-09-13T18:45:56.009933+0000","last_peered":"2024-09-13T18:45:56.009933+0000","last_clean":"2024-09-13T18:45:56.009933+0000","last_became_active":"2024-09-13T18:45:54.916454+0000","last_became_peered":"2024-09-13T18:45:54.916454+0000","last_unstale":"2024-09-13T18:45:56.009933+0000","last_undegraded":"2024-09-13T18:45:56.009933+0000","last_fullsized":"2024-09-13T18:45:56.009933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:17.455557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010997+0000","last_change":"2024-09-13T18:45:54.907911+0000","last_active":"2024-09-13T18:45:56.010997+0000","last_peered":"2024-09-13T18:45:56.010997+0000","last_clean":"2024-09-13T18:45:56.010997+0000","last_became_active":"2024-09-13T18:45:54.907654+0000","last_became_peered":"2024-09-13T18:45:54.907654+0000","last_unstale":"2024-09-13T18:45:56.010997+0000","last_undegraded":"2024-09-13T18:45:56.010997+0000","last_fullsized":"2024-09-13T18:45:56.010997+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:57.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897669+0000","last_change":"2024-09-13T18:45:54.904016+0000","last_active":"2024-09-13T18:45:55.897669+0000","last_peered":"2024-09-13T18:45:55.897669+0000","last_clean":"2024-09-13T18:45:55.897669+0000","last_became_active":"2024-09-13T18:45:54.903783+0000","last_became_peered":"2024-09-13T18:45:54.903783+0000","last_unstale":"2024-09-13T18:45:55.897669+0000","last_undegraded":"2024-09-13T18:45:55.897669+0000","last_fullsized":"2024-09-13T18:45:55.897669+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:51.133236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010717+0000","last_change":"2024-09-13T18:45:54.907422+0000","last_active":"2024-09-13T18:45:56.010717+0000","last_peered":"2024-09-13T18:45:56.010717+0000","last_clean":"2024-09-13T18:45:56.010717+0000","last_became_active":"2024-09-13T18:45:54.907213+0000","last_became_peered":"2024-09-13T18:45:54.907213+0000","last_unstale":"2024-09-13T18:45:56.010717+0000","last_undegraded":"2024-09-13T18:45:56.010717+0000","last_fullsized":"2024-09-13T18:45:56.010717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:34.474938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010677+0000","last_change":"2024-09-13T18:45:54.902283+0000","last_active":"2024-09-13T18:45:56.010677+0000","last_peered":"2024-09-13T18:45:56.010677+0000","last_clean":"2024-09-13T18:45:56.010677+0000","last_became_active":"2024-09-13T18:45:54.901696+0000","last_became_peered":"2024-09-13T18:45:54.901696+0000","last_unstale":"2024-09-13T18:45:56.010677+0000","last_undegraded":"2024-09-13T18:45:56.010677+0000","last_fullsized":"2024-09-13T18:45:56.010677+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:07.263140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898174+0000","last_change":"2024-09-13T18:45:54.911220+0000","last_active":"2024-09-13T18:45:55.898174+0000","last_peered":"2024-09-13T18:45:55.898174+0000","last_clean":"2024-09-13T18:45:55.898174+0000","last_became_active":"2024-09-13T18:45:54.910394+0000","last_became_peered":"2024-09-13T18:45:54.910394+0000","last_unstale":"2024-09-13T18:45:55.898174+0000","last_undegraded":"2024-09-13T18:45:55.898174+0000","last_fullsized":"2024-09-13T18:45:55.898174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:51.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010800+0000","last_change":"2024-09-13T18:45:54.910226+0000","last_active":"2024-09-13T18:45:56.010800+0000","last_peered":"2024-09-13T18:45:56.010800+0000","last_clean":"2024-09-13T18:45:56.010800+0000","last_became_active":"2024-09-13T18:45:54.909900+0000","last_became_peered":"2024-09-13T18:45:54.909900+0000","last_unstale":"2024-09-13T18:45:56.010800+0000","last_undegraded":"2024-09-13T18:45:56.010800+0000","last_fullsized":"2024-09-13T18:45:56.010800+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010778+0000","last_change":"2024-09-13T18:45:54.906078+0000","last_active":"2024-09-13T18:45:56.010778+0000","last_peered":"2024-09-13T18:45:56.010778+0000","last_clean":"2024-09-13T18:45:56.010778+0000","last_became_active":"2024-09-13T18:45:54.905848+0000","last_became_peered":"2024-09-13T18:45:54.905848+0000","last_unstale":"2024-09-13T18:45:56.010778+0000","last_undegraded":"2024-09-13T18:45:56.010778+0000","last_fullsized":"2024-09-13T18:45:56.010778+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:00.941799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010831+0000","last_change":"2024-09-13T18:45:54.909954+0000","last_active":"2024-09-13T18:45:56.010831+0000","last_peered":"2024-09-13T18:45:56.010831+0000","last_clean":"2024-09-13T18:45:56.010831+0000","last_became_active":"2024-09-13T18:45:54.909730+0000","last_became_peered":"2024-09-13T18:45:54.909730+0000","last_unstale":"2024-09-13T18:45:56.010831+0000","last_undegraded":"2024-09-13T18:45:56.010831+0000","last_fullsized":"2024-09-13T18:45:56.010831+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:43.640922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010020+0000","last_change":"2024-09-13T18:45:54.916653+0000","last_active":"2024-09-13T18:45:56.010020+0000","last_peered":"2024-09-13T18:45:56.010020+0000","last_clean":"2024-09-13T18:45:56.010020+0000","last_became_active":"2024-09-13T18:45:54.916130+0000","last_became_peered":"2024-09-13T18:45:54.916130+0000","last_unstale":"2024-09-13T18:45:56.010020+0000","last_undegraded":"2024-09-13T18:45:56.010020+0000","last_fullsized":"2024-09-13T18:45:56.010020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:06.281655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"179'4","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921504+0000","last_change":"2024-09-13T18:45:54.496811+0000","last_active":"2024-09-13T18:45:54.921504+0000","last_peered":"2024-09-13T18:45:54.921504+0000","last_clean":"2024-09-13T18:45:54.921504+0000","last_became_active":"2024-09-13T18:45:54.496586+0000","last_became_peered":"2024-09-13T18:45:54.496586+0000","last_unstale":"2024-09-13T18:45:54.921504+0000","last_undegraded":"2024-09-13T18:45:54.921504+0000","last_fullsized":"2024-09-13T18:45:54.921504+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.492453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489531+0000","last_change":"2024-09-13T18:45:54.489531+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489531+0000","last_undegraded":"2024-09-13T18:45:54.489531+0000","last_fullsized":"2024-09-13T18:45:54.489531+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917380+0000","last_change":"2024-09-13T18:45:54.492450+0000","last_active":"2024-09-13T18:45:54.917380+0000","last_peered":"2024-09-13T18:45:54.917380+0000","last_clean":"2024-09-13T18:45:54.917380+0000","last_became_active":"2024-09-13T18:45:54.491715+0000","last_became_peered":"2024-09-13T18:45:54.491715+0000","last_unstale":"2024-09-13T18:45:54.917380+0000","last_undegraded":"2024-09-13T18:45:54.917380+0000","last_fullsized":"2024-09-13T18:45:54.917380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:37.803308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011301+0000","last_change":"2024-09-13T18:45:54.911792+0000","last_active":"2024-09-13T18:45:56.011301+0000","last_peered":"2024-09-13T18:45:56.011301+0000","last_clean":"2024-09-13T18:45:56.011301+0000","last_became_active":"2024-09-13T18:45:54.910953+0000","last_became_peered":"2024-09-13T18:45:54.910953+0000","last_unstale":"2024-09-13T18:45:56.011301+0000","last_undegraded":"2024-09-13T18:45:56.011301+0000","last_fullsized":"2024-09-13T18:45:56.011301+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918338+0000","last_change":"2024-09-13T18:45:54.495172+0000","last_active":"2024-09-13T18:45:54.918338+0000","last_peered":"2024-09-13T18:45:54.918338+0000","last_clean":"2024-09-13T18:45:54.918338+0000","last_became_active":"2024-09-13T18:45:54.494637+0000","last_became_peered":"2024-09-13T18:45:54.494637+0000","last_unstale":"2024-09-13T18:45:54.918338+0000","last_undegraded":"2024-09-13T18:45:54.918338+0000","last_fullsized":"2024-09-13T18:45:54.918338+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:28.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898980+0000","last_change":"2024-09-13T18:45:54.915501+0000","last_active":"2024-09-13T18:45:55.898980+0000","last_peered":"2024-09-13T18:45:55.898980+0000","last_clean":"2024-09-13T18:45:55.898980+0000","last_became_active":"2024-09-13T18:45:54.915141+0000","last_became_peered":"2024-09-13T18:45:54.915141+0000","last_unstale":"2024-09-13T18:45:55.898980+0000","last_undegraded":"2024-09-13T18:45:55.898980+0000","last_fullsized":"2024-09-13T18:45:55.898980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920696+0000","last_change":"2024-09-13T18:45:54.496083+0000","last_active":"2024-09-13T18:45:54.920696+0000","last_peered":"2024-09-13T18:45:54.920696+0000","last_clean":"2024-09-13T18:45:54.920696+0000","last_became_active":"2024-09-13T18:45:54.495784+0000","last_became_peered":"2024-09-13T18:45:54.495784+0000","last_unstale":"2024-09-13T18:45:54.920696+0000","last_undegraded":"2024-09-13T18:45:54.920696+0000","last_fullsized":"2024-09-13T18:45:54.920696+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:07.785392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010793+0000","last_change":"2024-09-13T18:45:54.907306+0000","last_active":"2024-09-13T18:45:56.010793+0000","last_peered":"2024-09-13T18:45:56.010793+0000","last_clean":"2024-09-13T18:45:56.010793+0000","last_became_active":"2024-09-13T18:45:54.907088+0000","last_became_peered":"2024-09-13T18:45:54.907088+0000","last_unstale":"2024-09-13T18:45:56.010793+0000","last_undegraded":"2024-09-13T18:45:56.010793+0000","last_fullsized":"2024-09-13T18:45:56.010793+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.319805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919010+0000","last_change":"2024-09-13T18:45:54.486281+0000","last_active":"2024-09-13T18:45:54.919010+0000","last_peered":"2024-09-13T18:45:54.919010+0000","last_clean":"2024-09-13T18:45:54.919010+0000","last_became_active":"2024-09-13T18:45:54.485730+0000","last_became_peered":"2024-09-13T18:45:54.485730+0000","last_unstale":"2024-09-13T18:45:54.919010+0000","last_undegraded":"2024-09-13T18:45:54.919010+0000","last_fullsized":"2024-09-13T18:45:54.919010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.176678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898569+0000","last_change":"2024-09-13T18:45:54.914232+0000","last_active":"2024-09-13T18:45:55.898569+0000","last_peered":"2024-09-13T18:45:55.898569+0000","last_clean":"2024-09-13T18:45:55.898569+0000","last_became_active":"2024-09-13T18:45:54.913955+0000","last_became_peered":"2024-09-13T18:45:54.913955+0000","last_unstale":"2024-09-13T18:45:55.898569+0000","last_undegraded":"2024-09-13T18:45:55.898569+0000","last_fullsized":"2024-09-13T18:45:55.898569+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920875+0000","last_change":"2024-09-13T18:45:54.494883+0000","last_active":"2024-09-13T18:45:54.920875+0000","last_peered":"2024-09-13T18:45:54.920875+0000","last_clean":"2024-09-13T18:45:54.920875+0000","last_became_active":"2024-09-13T18:45:54.494664+0000","last_became_peered":"2024-09-13T18:45:54.494664+0000","last_unstale":"2024-09-13T18:45:54.920875+0000","last_undegraded":"2024-09-13T18:45:54.920875+0000","last_fullsized":"2024-09-13T18:45:54.920875+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:34.997445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011108+0000","last_change":"2024-09-13T18:45:54.912604+0000","last_active":"2024-09-13T18:45:56.011108+0000","last_peered":"2024-09-13T18:45:56.011108+0000","last_clean":"2024-09-13T18:45:56.011108+0000","last_became_active":"2024-09-13T18:45:54.912148+0000","last_became_peered":"2024-09-13T18:45:54.912148+0000","last_unstale":"2024-09-13T18:45:56.011108+0000","last_undegraded":"2024-09-13T18:45:56.011108+0000","last_fullsized":"2024-09-13T18:45:56.011108+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:07.339063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899755+0000","last_change":"2024-09-13T18:45:54.496659+0000","last_active":"2024-09-13T18:45:54.899755+0000","last_peered":"2024-09-13T18:45:54.899755+0000","last_clean":"2024-09-13T18:45:54.899755+0000","last_became_active":"2024-09-13T18:45:54.492022+0000","last_became_peered":"2024-09-13T18:45:54.492022+0000","last_unstale":"2024-09-13T18:45:54.899755+0000","last_undegraded":"2024-09-13T18:45:54.899755+0000","last_fullsized":"2024-09-13T18:45:54.899755+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:51.428747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898877+0000","last_change":"2024-09-13T18:45:54.902303+0000","last_active":"2024-09-13T18:45:55.898877+0000","last_peered":"2024-09-13T18:45:55.898877+0000","last_clean":"2024-09-13T18:45:55.898877+0000","last_became_active":"2024-09-13T18:45:54.901738+0000","last_became_peered":"2024-09-13T18:45:54.901738+0000","last_unstale":"2024-09-13T18:45:55.898877+0000","last_undegraded":"2024-09-13T18:45:55.898877+0000","last_fullsized":"2024-09-13T18:45:55.898877+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.908844+0000","last_change":"2024-09-13T18:45:54.495032+0000","last_active":"2024-09-13T18:45:54.908844+0000","last_peered":"2024-09-13T18:45:54.908844+0000","last_clean":"2024-09-13T18:45:54.908844+0000","last_became_active":"2024-09-13T18:45:54.494407+0000","last_became_peered":"2024-09-13T18:45:54.494407+0000","last_unstale":"2024-09-13T18:45:54.908844+0000","last_undegraded":"2024-09-13T18:45:54.908844+0000","last_fullsized":"2024-09-13T18:45:54.908844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:12.756996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898654+0000","last_change":"2024-09-13T18:45:54.907873+0000","last_active":"2024-09-13T18:45:55.898654+0000","last_peered":"2024-09-13T18:45:55.898654+0000","last_clean":"2024-09-13T18:45:55.898654+0000","last_became_active":"2024-09-13T18:45:54.906361+0000","last_became_peered":"2024-09-13T18:45:54.906361+0000","last_unstale":"2024-09-13T18:45:55.898654+0000","last_undegraded":"2024-09-13T18:45:55.898654+0000","last_fullsized":"2024-09-13T18:45:55.898654+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899665+0000","last_change":"2024-09-13T18:45:54.486090+0000","last_active":"2024-09-13T18:45:54.899665+0000","last_peered":"2024-09-13T18:45:54.899665+0000","last_clean":"2024-09-13T18:45:54.899665+0000","last_became_active":"2024-09-13T18:45:54.485779+0000","last_became_peered":"2024-09-13T18:45:54.485779+0000","last_unstale":"2024-09-13T18:45:54.899665+0000","last_undegraded":"2024-09-13T18:45:54.899665+0000","last_fullsized":"2024-09-13T18:45:54.899665+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:50.156625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010952+0000","last_change":"2024-09-13T18:45:54.911423+0000","last_active":"2024-09-13T18:45:56.010952+0000","last_peered":"2024-09-13T18:45:56.010952+0000","last_clean":"2024-09-13T18:45:56.010952+0000","last_became_active":"2024-09-13T18:45:54.910239+0000","last_became_peered":"2024-09-13T18:45:54.910239+0000","last_unstale":"2024-09-13T18:45:56.010952+0000","last_undegraded":"2024-09-13T18:45:56.010952+0000","last_fullsized":"2024-09-13T18:45:56.010952+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.903358+0000","last_change":"2024-09-13T18:45:54.491468+0000","last_active":"2024-09-13T18:45:54.903358+0000","last_peered":"2024-09-13T18:45:54.903358+0000","last_clean":"2024-09-13T18:45:54.903358+0000","last_became_active":"2024-09-13T18:45:54.491217+0000","last_became_peered":"2024-09-13T18:45:54.491217+0000","last_unstale":"2024-09-13T18:45:54.903358+0000","last_undegraded":"2024-09-13T18:45:54.903358+0000","last_fullsized":"2024-09-13T18:45:54.903358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:35.312903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489173+0000","last_change":"2024-09-13T18:45:54.489173+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489173+0000","last_undegraded":"2024-09-13T18:45:54.489173+0000","last_fullsized":"2024-09-13T18:45:54.489173+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498794+0000","last_change":"2024-09-13T18:45:54.498701+0000","last_active":"2024-09-13T18:45:54.498794+0000","last_peered":"2024-09-13T18:45:54.498794+0000","last_clean":"2024-09-13T18:45:54.498794+0000","last_became_active":"2024-09-13T18:45:54.498477+0000","last_became_peered":"2024-09-13T18:45:54.498477+0000","last_unstale":"2024-09-13T18:45:54.498794+0000","last_undegraded":"2024-09-13T18:45:54.498794+0000","last_fullsized":"2024-09-13T18:45:54.498794+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:05.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898904+0000","last_change":"2024-09-13T18:45:54.916063+0000","last_active":"2024-09-13T18:45:55.898904+0000","last_peered":"2024-09-13T18:45:55.898904+0000","last_clean":"2024-09-13T18:45:55.898904+0000","last_became_active":"2024-09-13T18:45:54.914695+0000","last_became_peered":"2024-09-13T18:45:54.914695+0000","last_unstale":"2024-09-13T18:45:55.898904+0000","last_undegraded":"2024-09-13T18:45:55.898904+0000","last_fullsized":"2024-09-13T18:45:55.898904+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920376+0000","last_change":"2024-09-13T18:45:54.494893+0000","last_active":"2024-09-13T18:45:54.920376+0000","last_peered":"2024-09-13T18:45:54.920376+0000","last_clean":"2024-09-13T18:45:54.920376+0000","last_became_active":"2024-09-13T18:45:54.494123+0000","last_became_peered":"2024-09-13T18:45:54.494123+0000","last_unstale":"2024-09-13T18:45:54.920376+0000","last_undegraded":"2024-09-13T18:45:54.920376+0000","last_fullsized":"2024-09-13T18:45:54.920376+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:14.459115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898103+0000","last_change":"2024-09-13T18:45:54.911463+0000","last_active":"2024-09-13T18:45:55.898103+0000","last_peered":"2024-09-13T18:45:55.898103+0000","last_clean":"2024-09-13T18:45:55.898103+0000","last_became_active":"2024-09-13T18:45:54.910682+0000","last_became_peered":"2024-09-13T18:45:54.910682+0000","last_unstale":"2024-09-13T18:45:55.898103+0000","last_undegraded":"2024-09-13T18:45:55.898103+0000","last_fullsized":"2024-09-13T18:45:55.898103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:21.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.905155+0000","last_change":"2024-09-13T18:45:54.495200+0000","last_active":"2024-09-13T18:45:54.905155+0000","last_peered":"2024-09-13T18:45:54.905155+0000","last_clean":"2024-09-13T18:45:54.905155+0000","last_became_active":"2024-09-13T18:45:54.494927+0000","last_became_peered":"2024-09-13T18:45:54.494927+0000","last_unstale":"2024-09-13T18:45:54.905155+0000","last_undegraded":"2024-09-13T18:45:54.905155+0000","last_fullsized":"2024-09-13T18:45:54.905155+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898942+0000","last_change":"2024-09-13T18:45:54.912225+0000","last_active":"2024-09-13T18:45:55.898942+0000","last_peered":"2024-09-13T18:45:55.898942+0000","last_clean":"2024-09-13T18:45:55.898942+0000","last_became_active":"2024-09-13T18:45:54.911697+0000","last_became_peered":"2024-09-13T18:45:54.911697+0000","last_unstale":"2024-09-13T18:45:55.898942+0000","last_undegraded":"2024-09-13T18:45:55.898942+0000","last_fullsized":"2024-09-13T18:45:55.898942+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901469+0000","last_change":"2024-09-13T18:45:54.496453+0000","last_active":"2024-09-13T18:45:54.901469+0000","last_peered":"2024-09-13T18:45:54.901469+0000","last_clean":"2024-09-13T18:45:54.901469+0000","last_became_active":"2024-09-13T18:45:54.496187+0000","last_became_peered":"2024-09-13T18:45:54.496187+0000","last_unstale":"2024-09-13T18:45:54.901469+0000","last_undegraded":"2024-09-13T18:45:54.901469+0000","last_fullsized":"2024-09-13T18:45:54.901469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:34.536434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898899+0000","last_change":"2024-09-13T18:45:54.908004+0000","last_active":"2024-09-13T18:45:55.898899+0000","last_peered":"2024-09-13T18:45:55.898899+0000","last_clean":"2024-09-13T18:45:55.898899+0000","last_became_active":"2024-09-13T18:45:54.906642+0000","last_became_peered":"2024-09-13T18:45:54.906642+0000","last_unstale":"2024-09-13T18:45:55.898899+0000","last_undegraded":"2024-09-13T18:45:55.898899+0000","last_fullsized":"2024-09-13T18:45:55.898899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:32.003975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"179'8","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920589+0000","last_change":"2024-09-13T18:45:54.493489+0000","last_active":"2024-09-13T18:45:54.920589+0000","last_peered":"2024-09-13T18:45:54.920589+0000","last_clean":"2024-09-13T18:45:54.920589+0000","last_became_active":"2024-09-13T18:45:54.493186+0000","last_became_peered":"2024-09-13T18:45:54.493186+0000","last_unstale":"2024-09-13T18:45:54.920589+0000","last_undegraded":"2024-09-13T18:45:54.920589+0000","last_fullsized":"2024-09-13T18:45:54.920589+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:22.461942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011749+0000","last_change":"2024-09-13T18:45:54.914777+0000","last_active":"2024-09-13T18:45:56.011749+0000","last_peered":"2024-09-13T18:45:56.011749+0000","last_clean":"2024-09-13T18:45:56.011749+0000","last_became_active":"2024-09-13T18:45:54.914406+0000","last_became_peered":"2024-09-13T18:45:54.914406+0000","last_unstale":"2024-09-13T18:45:56.011749+0000","last_undegraded":"2024-09-13T18:45:56.011749+0000","last_fullsized":"2024-09-13T18:45:56.011749+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:40.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917253+0000","last_change":"2024-09-13T18:45:54.487283+0000","last_active":"2024-09-13T18:45:54.917253+0000","last_peered":"2024-09-13T18:45:54.917253+0000","last_clean":"2024-09-13T18:45:54.917253+0000","last_became_active":"2024-09-13T18:45:54.487060+0000","last_became_peered":"2024-09-13T18:45:54.487060+0000","last_unstale":"2024-09-13T18:45:54.917253+0000","last_undegraded":"2024-09-13T18:45:54.917253+0000","last_fullsized":"2024-09-13T18:45:54.917253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.256698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011050+0000","last_change":"2024-09-13T18:45:54.906614+0000","last_active":"2024-09-13T18:45:56.011050+0000","last_peered":"2024-09-13T18:45:56.011050+0000","last_clean":"2024-09-13T18:45:56.011050+0000","last_became_active":"2024-09-13T18:45:54.906390+0000","last_became_peered":"2024-09-13T18:45:54.906390+0000","last_unstale":"2024-09-13T18:45:56.011050+0000","last_undegraded":"2024-09-13T18:45:56.011050+0000","last_fullsized":"2024-09-13T18:45:56.011050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:11.921047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920922+0000","last_change":"2024-09-13T18:45:54.497640+0000","last_active":"2024-09-13T18:45:54.920922+0000","last_peered":"2024-09-13T18:45:54.920922+0000","last_clean":"2024-09-13T18:45:54.920922+0000","last_became_active":"2024-09-13T18:45:54.497203+0000","last_became_peered":"2024-09-13T18:45:54.497203+0000","last_unstale":"2024-09-13T18:45:54.920922+0000","last_undegraded":"2024-09-13T18:45:54.920922+0000","last_fullsized":"2024-09-13T18:45:54.920922+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010525+0000","last_change":"2024-09-13T18:45:54.913515+0000","last_active":"2024-09-13T18:45:56.010525+0000","last_peered":"2024-09-13T18:45:56.010525+0000","last_clean":"2024-09-13T18:45:56.010525+0000","last_became_active":"2024-09-13T18:45:54.913313+0000","last_became_peered":"2024-09-13T18:45:54.913313+0000","last_unstale":"2024-09-13T18:45:56.010525+0000","last_undegraded":"2024-09-13T18:45:56.010525+0000","last_fullsized":"2024-09-13T18:45:56.010525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:22.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.493480+0000","last_change":"2024-09-13T18:45:54.493113+0000","last_active":"2024-09-13T18:45:54.493480+0000","last_peered":"2024-09-13T18:45:54.493480+0000","last_clean":"2024-09-13T18:45:54.493480+0000","last_became_active":"2024-09-13T18:45:54.492826+0000","last_became_peered":"2024-09-13T18:45:54.492826+0000","last_unstale":"2024-09-13T18:45:54.493480+0000","last_undegraded":"2024-09-13T18:45:54.493480+0000","last_fullsized":"2024-09-13T18:45:54.493480+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011394+0000","last_change":"2024-09-13T18:45:54.911578+0000","last_active":"2024-09-13T18:45:56.011394+0000","last_peered":"2024-09-13T18:45:56.011394+0000","last_clean":"2024-09-13T18:45:56.011394+0000","last_became_active":"2024-09-13T18:45:54.909430+0000","last_became_peered":"2024-09-13T18:45:54.909430+0000","last_unstale":"2024-09-13T18:45:56.011394+0000","last_undegraded":"2024-09-13T18:45:56.011394+0000","last_fullsized":"2024-09-13T18:45:56.011394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901562+0000","last_change":"2024-09-13T18:45:54.493581+0000","last_active":"2024-09-13T18:45:54.901562+0000","last_peered":"2024-09-13T18:45:54.901562+0000","last_clean":"2024-09-13T18:45:54.901562+0000","last_became_active":"2024-09-13T18:45:54.493031+0000","last_became_peered":"2024-09-13T18:45:54.493031+0000","last_unstale":"2024-09-13T18:45:54.901562+0000","last_undegraded":"2024-09-13T18:45:54.901562+0000","last_fullsized":"2024-09-13T18:45:54.901562+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:42.168271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010050+0000","last_change":"2024-09-13T18:45:54.909801+0000","last_active":"2024-09-13T18:45:56.010050+0000","last_peered":"2024-09-13T18:45:56.010050+0000","last_clean":"2024-09-13T18:45:56.010050+0000","last_became_active":"2024-09-13T18:45:54.909522+0000","last_became_peered":"2024-09-13T18:45:54.909522+0000","last_unstale":"2024-09-13T18:45:56.010050+0000","last_undegraded":"2024-09-13T18:45:56.010050+0000","last_fullsized":"2024-09-13T18:45:56.010050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918423+0000","last_change":"2024-09-13T18:45:54.496005+0000","last_active":"2024-09-13T18:45:54.918423+0000","last_peered":"2024-09-13T18:45:54.918423+0000","last_clean":"2024-09-13T18:45:54.918423+0000","last_became_active":"2024-09-13T18:45:54.495771+0000","last_became_peered":"2024-09-13T18:45:54.495771+0000","last_unstale":"2024-09-13T18:45:54.918423+0000","last_undegraded":"2024-09-13T18:45:54.918423+0000","last_fullsized":"2024-09-13T18:45:54.918423+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:11.480554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010891+0000","last_change":"2024-09-13T18:45:54.906015+0000","last_active":"2024-09-13T18:45:56.010891+0000","last_peered":"2024-09-13T18:45:56.010891+0000","last_clean":"2024-09-13T18:45:56.010891+0000","last_became_active":"2024-09-13T18:45:54.905438+0000","last_became_peered":"2024-09-13T18:45:54.905438+0000","last_unstale":"2024-09-13T18:45:56.010891+0000","last_undegraded":"2024-09-13T18:45:56.010891+0000","last_fullsized":"2024-09-13T18:45:56.010891+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:44.251416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.897723+0000","last_change":"2024-09-13T18:45:54.493010+0000","last_active":"2024-09-13T18:45:54.897723+0000","last_peered":"2024-09-13T18:45:54.897723+0000","last_clean":"2024-09-13T18:45:54.897723+0000","last_became_active":"2024-09-13T18:45:54.492789+0000","last_became_peered":"2024-09-13T18:45:54.492789+0000","last_unstale":"2024-09-13T18:45:54.897723+0000","last_undegraded":"2024-09-13T18:45:54.897723+0000","last_fullsized":"2024-09-13T18:45:54.897723+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:24.312031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011028+0000","last_change":"2024-09-13T18:45:54.909680+0000","last_active":"2024-09-13T18:45:56.011028+0000","last_peered":"2024-09-13T18:45:56.011028+0000","last_clean":"2024-09-13T18:45:56.011028+0000","last_became_active":"2024-09-13T18:45:54.908615+0000","last_became_peered":"2024-09-13T18:45:54.908615+0000","last_unstale":"2024-09-13T18:45:56.011028+0000","last_undegraded":"2024-09-13T18:45:56.011028+0000","last_fullsized":"2024-09-13T18:45:56.011028+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.898386+0000","last_change":"2024-09-13T18:45:54.484614+0000","last_active":"2024-09-13T18:45:54.898386+0000","last_peered":"2024-09-13T18:45:54.898386+0000","last_clean":"2024-09-13T18:45:54.898386+0000","last_became_active":"2024-09-13T18:45:54.484384+0000","last_became_peered":"2024-09-13T18:45:54.484384+0000","last_unstale":"2024-09-13T18:45:54.898386+0000","last_undegraded":"2024-09-13T18:45:54.898386+0000","last_fullsized":"2024-09-13T18:45:54.898386+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:42.467009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011162+0000","last_change":"2024-09-13T18:45:54.912416+0000","last_active":"2024-09-13T18:45:56.011162+0000","last_peered":"2024-09-13T18:45:56.011162+0000","last_clean":"2024-09-13T18:45:56.011162+0000","last_became_active":"2024-09-13T18:45:54.910464+0000","last_became_peered":"2024-09-13T18:45:54.910464+0000","last_unstale":"2024-09-13T18:45:56.011162+0000","last_undegraded":"2024-09-13T18:45:56.011162+0000","last_fullsized":"2024-09-13T18:45:56.011162+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:39.075198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899634+0000","last_change":"2024-09-13T18:45:54.492800+0000","last_active":"2024-09-13T18:45:54.899634+0000","last_peered":"2024-09-13T18:45:54.899634+0000","last_clean":"2024-09-13T18:45:54.899634+0000","last_became_active":"2024-09-13T18:45:54.492257+0000","last_became_peered":"2024-09-13T18:45:54.492257+0000","last_unstale":"2024-09-13T18:45:54.899634+0000","last_undegraded":"2024-09-13T18:45:54.899634+0000","last_fullsized":"2024-09-13T18:45:54.899634+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:21.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899051+0000","last_change":"2024-09-13T18:45:54.912376+0000","last_active":"2024-09-13T18:45:55.899051+0000","last_peered":"2024-09-13T18:45:55.899051+0000","last_clean":"2024-09-13T18:45:55.899051+0000","last_became_active":"2024-09-13T18:45:54.911994+0000","last_became_peered":"2024-09-13T18:45:54.911994+0000","last_unstale":"2024-09-13T18:45:55.899051+0000","last_undegraded":"2024-09-13T18:45:55.899051+0000","last_fullsized":"2024-09-13T18:45:55.899051+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919785+0000","last_change":"2024-09-13T18:45:54.486957+0000","last_active":"2024-09-13T18:45:54.919785+0000","last_peered":"2024-09-13T18:45:54.919785+0000","last_clean":"2024-09-13T18:45:54.919785+0000","last_became_active":"2024-09-13T18:45:54.486740+0000","last_became_peered":"2024-09-13T18:45:54.486740+0000","last_unstale":"2024-09-13T18:45:54.919785+0000","last_undegraded":"2024-09-13T18:45:54.919785+0000","last_fullsized":"2024-09-13T18:45:54.919785+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:28.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899048+0000","last_change":"2024-09-13T18:45:54.911748+0000","last_active":"2024-09-13T18:45:55.899048+0000","last_peered":"2024-09-13T18:45:55.899048+0000","last_clean":"2024-09-13T18:45:55.899048+0000","last_became_active":"2024-09-13T18:45:54.911536+0000","last_became_peered":"2024-09-13T18:45:54.911536+0000","last_unstale":"2024-09-13T18:45:55.899048+0000","last_undegraded":"2024-09-13T18:45:55.899048+0000","last_fullsized":"2024-09-13T18:45:55.899048+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899403+0000","last_change":"2024-09-13T18:45:54.493256+0000","last_active":"2024-09-13T18:45:54.899403+0000","last_peered":"2024-09-13T18:45:54.899403+0000","last_clean":"2024-09-13T18:45:54.899403+0000","last_became_active":"2024-09-13T18:45:54.492757+0000","last_became_peered":"2024-09-13T18:45:54.492757+0000","last_unstale":"2024-09-13T18:45:54.899403+0000","last_undegraded":"2024-09-13T18:45:54.899403+0000","last_fullsized":"2024-09-13T18:45:54.899403+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:01.290718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898201+0000","last_change":"2024-09-13T18:45:54.906596+0000","last_active":"2024-09-13T18:45:55.898201+0000","last_peered":"2024-09-13T18:45:55.898201+0000","last_clean":"2024-09-13T18:45:55.898201+0000","last_became_active":"2024-09-13T18:45:54.904819+0000","last_became_peered":"2024-09-13T18:45:54.904819+0000","last_unstale":"2024-09-13T18:45:55.898201+0000","last_undegraded":"2024-09-13T18:45:55.898201+0000","last_fullsized":"2024-09-13T18:45:55.898201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:37.224895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498264+0000","last_change":"2024-09-13T18:45:54.498180+0000","last_active":"2024-09-13T18:45:54.498264+0000","last_peered":"2024-09-13T18:45:54.498264+0000","last_clean":"2024-09-13T18:45:54.498264+0000","last_became_active":"2024-09-13T18:45:54.497907+0000","last_became_peered":"2024-09-13T18:45:54.497907+0000","last_unstale":"2024-09-13T18:45:54.498264+0000","last_undegraded":"2024-09-13T18:45:54.498264+0000","last_fullsized":"2024-09-13T18:45:54.498264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:26.217332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898271+0000","last_change":"2024-09-13T18:45:54.900842+0000","last_active":"2024-09-13T18:45:55.898271+0000","last_peered":"2024-09-13T18:45:55.898271+0000","last_clean":"2024-09-13T18:45:55.898271+0000","last_became_active":"2024-09-13T18:45:54.900605+0000","last_became_peered":"2024-09-13T18:45:54.900605+0000","last_unstale":"2024-09-13T18:45:55.898271+0000","last_undegraded":"2024-09-13T18:45:55.898271+0000","last_fullsized":"2024-09-13T18:45:55.898271+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:40.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.495630+0000","last_change":"2024-09-13T18:45:54.495093+0000","last_active":"2024-09-13T18:45:54.495630+0000","last_peered":"2024-09-13T18:45:54.495630+0000","last_clean":"2024-09-13T18:45:54.495630+0000","last_became_active":"2024-09-13T18:45:54.494822+0000","last_became_peered":"2024-09-13T18:45:54.494822+0000","last_unstale":"2024-09-13T18:45:54.495630+0000","last_undegraded":"2024-09-13T18:45:54.495630+0000","last_fullsized":"2024-09-13T18:45:54.495630+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487336+0000","last_change":"2024-09-13T18:45:54.487336+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487336+0000","last_undegraded":"2024-09-13T18:45:54.487336+0000","last_fullsized":"2024-09-13T18:45:54.487336+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901165+0000","last_change":"2024-09-13T18:45:54.493395+0000","last_active":"2024-09-13T18:45:54.901165+0000","last_peered":"2024-09-13T18:45:54.901165+0000","last_clean":"2024-09-13T18:45:54.901165+0000","last_became_active":"2024-09-13T18:45:54.493125+0000","last_became_peered":"2024-09-13T18:45:54.493125+0000","last_unstale":"2024-09-13T18:45:54.901165+0000","last_undegraded":"2024-09-13T18:45:54.901165+0000","last_fullsized":"2024-09-13T18:45:54.901165+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:59.567811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898992+0000","last_change":"2024-09-13T18:45:54.910921+0000","last_active":"2024-09-13T18:45:55.898992+0000","last_peered":"2024-09-13T18:45:55.898992+0000","last_clean":"2024-09-13T18:45:55.898992+0000","last_became_active":"2024-09-13T18:45:54.909213+0000","last_became_peered":"2024-09-13T18:45:54.909213+0000","last_unstale":"2024-09-13T18:45:55.898992+0000","last_undegraded":"2024-09-13T18:45:55.898992+0000","last_fullsized":"2024-09-13T18:45:55.898992+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:19.183121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904368+0000","last_change":"2024-09-13T18:45:54.490731+0000","last_active":"2024-09-13T18:45:54.904368+0000","last_peered":"2024-09-13T18:45:54.904368+0000","last_clean":"2024-09-13T18:45:54.904368+0000","last_became_active":"2024-09-13T18:45:54.490352+0000","last_became_peered":"2024-09-13T18:45:54.490352+0000","last_unstale":"2024-09-13T18:45:54.904368+0000","last_undegraded":"2024-09-13T18:45:54.904368+0000","last_fullsized":"2024-09-13T18:45:54.904368+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:21.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898977+0000","last_change":"2024-09-13T18:45:54.902428+0000","last_active":"2024-09-13T18:45:55.898977+0000","last_peered":"2024-09-13T18:45:55.898977+0000","last_clean":"2024-09-13T18:45:55.898977+0000","last_became_active":"2024-09-13T18:45:54.902083+0000","last_became_peered":"2024-09-13T18:45:54.902083+0000","last_unstale":"2024-09-13T18:45:55.898977+0000","last_undegraded":"2024-09-13T18:45:55.898977+0000","last_fullsized":"2024-09-13T18:45:55.898977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902720+0000","last_change":"2024-09-13T18:45:54.491923+0000","last_active":"2024-09-13T18:45:54.902720+0000","last_peered":"2024-09-13T18:45:54.902720+0000","last_clean":"2024-09-13T18:45:54.902720+0000","last_became_active":"2024-09-13T18:45:54.491706+0000","last_became_peered":"2024-09-13T18:45:54.491706+0000","last_unstale":"2024-09-13T18:45:54.902720+0000","last_undegraded":"2024-09-13T18:45:54.902720+0000","last_fullsized":"2024-09-13T18:45:54.902720+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:14.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010210+0000","last_change":"2024-09-13T18:45:54.912208+0000","last_active":"2024-09-13T18:45:56.010210+0000","last_peered":"2024-09-13T18:45:56.010210+0000","last_clean":"2024-09-13T18:45:56.010210+0000","last_became_active":"2024-09-13T18:45:54.911794+0000","last_became_peered":"2024-09-13T18:45:54.911794+0000","last_unstale":"2024-09-13T18:45:56.010210+0000","last_undegraded":"2024-09-13T18:45:56.010210+0000","last_fullsized":"2024-09-13T18:45:56.010210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:02.923713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899848+0000","last_change":"2024-09-13T18:45:54.492315+0000","last_active":"2024-09-13T18:45:54.899848+0000","last_peered":"2024-09-13T18:45:54.899848+0000","last_clean":"2024-09-13T18:45:54.899848+0000","last_became_active":"2024-09-13T18:45:54.491338+0000","last_became_peered":"2024-09-13T18:45:54.491338+0000","last_unstale":"2024-09-13T18:45:54.899848+0000","last_undegraded":"2024-09-13T18:45:54.899848+0000","last_fullsized":"2024-09-13T18:45:54.899848+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.194286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487402+0000","last_change":"2024-09-13T18:45:54.487402+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487402+0000","last_undegraded":"2024-09-13T18:45:54.487402+0000","last_fullsized":"2024-09-13T18:45:54.487402+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"179'3","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917211+0000","last_change":"2024-09-13T18:45:54.492742+0000","last_active":"2024-09-13T18:45:54.917211+0000","last_peered":"2024-09-13T18:45:54.917211+0000","last_clean":"2024-09-13T18:45:54.917211+0000","last_became_active":"2024-09-13T18:45:54.492518+0000","last_became_peered":"2024-09-13T18:45:54.492518+0000","last_unstale":"2024-09-13T18:45:54.917211+0000","last_undegraded":"2024-09-13T18:45:54.917211+0000","last_fullsized":"2024-09-13T18:45:54.917211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902626+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:45:54.902626+0000","last_peered":"2024-09-13T18:45:54.902626+0000","last_clean":"2024-09-13T18:45:54.902626+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:45:54.902626+0000","last_undegraded":"2024-09-13T18:45:54.902626+0000","last_fullsized":"2024-09-13T18:45:54.902626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52100000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.441},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69299999999999995,"15min":0.65800000000000003},"min":{"1min":0.51800000000000002,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":1.014},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":1.004,"15min":1.004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.999},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71199999999999997,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80600000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46999999999999997,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.755},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.371},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":1.143},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":1.125},"last":0.79700000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":1.665},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.57799999999999996,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80300000000000005,"5min":0.96799999999999997,"15min":1.591},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":2.2709999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.0680000000000001,"15min":2.169},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97199999999999998,"15min":1.4450000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.45000000000000001,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.0840000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.504,"5min":0.438,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.0289999999999999,"15min":1.115},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70499999999999996,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.02,"15min":6.4539999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.52700000000000002,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.94199999999999995,"15min":6.5019999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.96399999999999997,"15min":1.032},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.68000000000000005},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":0.97199999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.41499999999999998,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":0.96199999999999997,"15min":1.5509999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.403},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"max":{"1min":0.89300000000000002,"5min":0.97199999999999998,"15min":1.6040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194322,"statfs":{"total":200000000,"available":198986288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.57299999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":1.581,"15min":2.0579999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95099999999999996,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":1.5589999999999999,"15min":3.706},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":2.915,"15min":3.742},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.762,"15min":3.6909999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.40799999999999997},"max":{"1min":0.95999999999999996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.91700000000000004,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.94799999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53500000000000003,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.745},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":1.843,"15min":3.7989999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.94599999999999995,"5min":1.548,"15min":5.5069999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.72499999999999998},"min":{"1min":0.624,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.95999999999999996,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198987840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.64300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.74099999999999999,"5min":1.546,"15min":8.1059999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.81399999999999995,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.626},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":7.798},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.502,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.93899999999999995,"5min":1.0669999999999999,"15min":3.093},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.022,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.84599999999999997},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.105,"5min":1.105,"15min":8.0519999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.64600000000000002,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.499,"15min":0.505},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.327,"5min":1.423,"15min":1.423},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.095,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.45800000000000002},"max":{"1min":1.266,"5min":1.329,"15min":1.329},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.876}]},{"osd":7,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.198,"5min":1.508,"15min":1.508},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1564,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193748,"statfs":{"total":200000000,"available":198398018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":1.6000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69899999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.5,"5min":0.63300000000000001,"15min":1.036},"last":0.372},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.86499999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.64900000000000002,"5min":0.80600000000000005,"15min":1.1870000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.70499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.98099999999999998,"5min":1.3,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:44:54 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":1.242,"15min":1.242},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.86499999999999999,"5min":1.123,"15min":1.21},"last":0.745},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":1.0580000000000001,"15min":1.278},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.498,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.1830000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.76400000000000001},"min":{"1min":0.59699999999999998,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":0.94999999999999996,"5min":1.1399999999999999,"15min":1.1539999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60199999999999998,"5min":0.76700000000000002,"15min":1.669},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.499},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.591},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":0.63700000000000001,"5min":0.70899999999999996,"15min":1.03},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":1.637},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.044,"5min":1.21,"15min":1.21},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.038,"5min":1.056,"15min":1.698},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79100000000000004,"15min":0.76200000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.204},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2190000000000001,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.67400000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.155,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.60899999999999999,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.745,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.165,"15min":2.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77300000000000002,"15min":0.72299999999999998},"min":{"1min":0.65300000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:45:59.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:59.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.233+0000 7f020e600640 1 Processor -- start 2024-09-13T18:45:59.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.233+0000 7f020e600640 1 -- start start 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f020e600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0208150480 0x7f020815a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f020e600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0208071810 0x7f02080b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f020e600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0208071dd0 con 0x7f02080b2230 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f020e600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080cb770 con 0x7f0208071810 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f020e600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02080cba50 con 0x7f0208150480 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f01ffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0208071810 0x7f02080b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f01ffe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0208071810 0x7f02080b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38194/0 (socket says 172.21.15.192:38194) 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.234+0000 7f01ffe00640 1 -- 172.21.15.192:0/1850892307 learned_addr learned my addr 172.21.15.192:0/1850892307 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:59.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.235+0000 7f0207400640 1 --2- 172.21.15.192:0/1850892307 >> v2:172.21.15.194:3300/0 conn(0x7f0208150480 0x7f020815a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.235+0000 7f01ffe00640 1 -- 172.21.15.192:0/1850892307 >> v2:172.21.15.194:3300/0 conn(0x7f0208150480 msgr2=0x7f020815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:59.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.235+0000 7f01ffe00640 1 --2- 172.21.15.192:0/1850892307 >> v2:172.21.15.194:3300/0 conn(0x7f0208150480 0x7f020815a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.235+0000 7f01ffe00640 1 -- 172.21.15.192:0/1850892307 >> v1:172.21.15.194:6789/0 conn(0x7f02080b2230 legacy=0x7f02080cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.235+0000 7f01ffe00640 1 -- 172.21.15.192:0/1850892307 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02080cbd30 con 0x7f0208071810 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.236+0000 7f01ffe00640 1 --2- 172.21.15.192:0/1850892307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f02080b1cf0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f02080b07c0 tx=0x7f01f002a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34907af320d8aad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.236+0000 7f0206a00640 1 -- 172.21.15.192:0/1850892307 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0032440 con 0x7f0208071810 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.236+0000 7f0206a00640 1 -- 172.21.15.192:0/1850892307 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f00325a0 con 0x7f0208071810 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.236+0000 7f0206a00640 1 -- 172.21.15.192:0/1850892307 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f0032930 con 0x7f0208071810 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 -- 172.21.15.192:0/1850892307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 msgr2=0x7f02080b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 --2- 172.21.15.192:0/1850892307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f02080b1cf0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f02080b07c0 tx=0x7f01f002a1e0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 -- 172.21.15.192:0/1850892307 shutdown_connections 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 --2- 172.21.15.192:0/1850892307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f02080b1cf0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 --2- 172.21.15.192:0/1850892307 >> v2:172.21.15.194:3300/0 conn(0x7f0208150480 0x7f020815a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 -- 172.21.15.192:0/1850892307 >> 172.21.15.192:0/1850892307 conn(0x7f02080ae960 msgr2=0x7f020806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.244 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 -- 172.21.15.192:0/1850892307 shutdown_connections 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.237+0000 7f020e600640 1 -- 172.21.15.192:0/1850892307 wait complete. 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.238+0000 7f020e600640 1 Processor -- start 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 -- start start 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 0x7f0208156e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0208150480 0x7f02081573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208153230 con 0x7f0208071810 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0208152620 con 0x7f02080b2230 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.239+0000 7f020e600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0208152900 con 0x7f0208150480 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38196/0 (socket says 172.21.15.192:38196) 2024-09-13T18:45:59.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 -- 172.21.15.192:0/908364404 learned_addr learned my addr 172.21.15.192:0/908364404 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f01ffe00640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 0x7f0208156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207e00640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0208150480 0x7f02081573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 -- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0208150480 msgr2=0x7f02081573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0208150480 0x7f02081573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 -- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 msgr2=0x7f0208156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 0x7f0208156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 -- 172.21.15.192:0/908364404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01f00094d0 con 0x7f0208071810 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f01ffe00640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 0x7f0208156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.240+0000 7f0207400640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d5f0 tx=0x7f01f800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.241+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f80125f0 con 0x7f0208071810 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.241+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01f8012750 con 0x7f0208071810 2024-09-13T18:45:59.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.241+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01f8012b00 con 0x7f0208071810 2024-09-13T18:45:59.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.241+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0208152be0 con 0x7f0208071810 2024-09-13T18:45:59.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.241+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02081520a0 con 0x7f0208071810 2024-09-13T18:45:59.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.242+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02080b1cf0 con 0x7f0208071810 2024-09-13T18:45:59.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.243+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f01f8012c60 con 0x7f0208071810 2024-09-13T18:45:59.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.244+0000 7f01ff400640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 0x7f01e406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.244+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01f80897f0 con 0x7f0208071810 2024-09-13T18:45:59.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.244+0000 7f01ffe00640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 0x7f01e406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.244+0000 7f01ffe00640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 0x7f01e406d0f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f01f0034000 tx=0x7f01f002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.248+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f01f80549c0 con 0x7f0208071810 2024-09-13T18:45:59.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.412+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f020815a920 con 0x7f01e406ac30 2024-09-13T18:45:59.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.419+0000 7f01ff400640 1 -- 172.21.15.192:0/908364404 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284907 (secure 0 0 0) 0x7f01f0042090 con 0x7f01e406ac30 2024-09-13T18:45:59.425 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:59.426 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:45:59.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 msgr2=0x7f01e406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 0x7f01e406d0f0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f01f0034000 tx=0x7f01f002e000 comp rx=0 tx=0).stop 2024-09-13T18:45:59.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 msgr2=0x7f0208151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f01f800d5f0 tx=0x7f01f800dab0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 shutdown_connections 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f01e406ac30 0x7f01e406d0f0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0208150480 0x7f02081573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f02080b2230 0x7f0208156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 --2- 172.21.15.192:0/908364404 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0208071810 0x7f0208151b60 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 >> 172.21.15.192:0/908364404 conn(0x7f02080ae960 msgr2=0x7f0208069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 shutdown_connections 2024-09-13T18:45:59.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.424+0000 7f020e600640 1 -- 172.21.15.192:0/908364404 wait complete. 2024-09-13T18:45:59.443 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T18:45:58.874687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553460,"statfs":{"total":1600000000,"available":1590743296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396870"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897776+0000","last_change":"2024-09-13T18:45:54.901750+0000","last_active":"2024-09-13T18:45:55.897776+0000","last_peered":"2024-09-13T18:45:55.897776+0000","last_clean":"2024-09-13T18:45:55.897776+0000","last_became_active":"2024-09-13T18:45:54.901533+0000","last_became_peered":"2024-09-13T18:45:54.901533+0000","last_unstale":"2024-09-13T18:45:55.897776+0000","last_undegraded":"2024-09-13T18:45:55.897776+0000","last_fullsized":"2024-09-13T18:45:55.897776+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.183202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010599+0000","last_change":"2024-09-13T18:45:54.902052+0000","last_active":"2024-09-13T18:45:56.010599+0000","last_peered":"2024-09-13T18:45:56.010599+0000","last_clean":"2024-09-13T18:45:56.010599+0000","last_became_active":"2024-09-13T18:45:54.901778+0000","last_became_peered":"2024-09-13T18:45:54.901778+0000","last_unstale":"2024-09-13T18:45:56.010599+0000","last_undegraded":"2024-09-13T18:45:56.010599+0000","last_fullsized":"2024-09-13T18:45:56.010599+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:43.473451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010448+0000","last_change":"2024-09-13T18:45:54.912065+0000","last_active":"2024-09-13T18:45:56.010448+0000","last_peered":"2024-09-13T18:45:56.010448+0000","last_clean":"2024-09-13T18:45:56.010448+0000","last_became_active":"2024-09-13T18:45:54.909940+0000","last_became_peered":"2024-09-13T18:45:54.909940+0000","last_unstale":"2024-09-13T18:45:56.010448+0000","last_undegraded":"2024-09-13T18:45:56.010448+0000","last_fullsized":"2024-09-13T18:45:56.010448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:47.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898616+0000","last_change":"2024-09-13T18:45:54.910427+0000","last_active":"2024-09-13T18:45:55.898616+0000","last_peered":"2024-09-13T18:45:55.898616+0000","last_clean":"2024-09-13T18:45:55.898616+0000","last_became_active":"2024-09-13T18:45:54.910087+0000","last_became_peered":"2024-09-13T18:45:54.910087+0000","last_unstale":"2024-09-13T18:45:55.898616+0000","last_undegraded":"2024-09-13T18:45:55.898616+0000","last_fullsized":"2024-09-13T18:45:55.898616+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:27.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011663+0000","last_change":"2024-09-13T18:45:54.910009+0000","last_active":"2024-09-13T18:45:56.011663+0000","last_peered":"2024-09-13T18:45:56.011663+0000","last_clean":"2024-09-13T18:45:56.011663+0000","last_became_active":"2024-09-13T18:45:54.909801+0000","last_became_peered":"2024-09-13T18:45:54.909801+0000","last_unstale":"2024-09-13T18:45:56.011663+0000","last_undegraded":"2024-09-13T18:45:56.011663+0000","last_fullsized":"2024-09-13T18:45:56.011663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:36.347672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011555+0000","last_change":"2024-09-13T18:45:54.911923+0000","last_active":"2024-09-13T18:45:56.011555+0000","last_peered":"2024-09-13T18:45:56.011555+0000","last_clean":"2024-09-13T18:45:56.011555+0000","last_became_active":"2024-09-13T18:45:54.911356+0000","last_became_peered":"2024-09-13T18:45:54.911356+0000","last_unstale":"2024-09-13T18:45:56.011555+0000","last_undegraded":"2024-09-13T18:45:56.011555+0000","last_fullsized":"2024-09-13T18:45:56.011555+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487850+0000","last_change":"2024-09-13T18:45:54.487850+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487850+0000","last_undegraded":"2024-09-13T18:45:54.487850+0000","last_fullsized":"2024-09-13T18:45:54.487850+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897854+0000","last_change":"2024-09-13T18:45:54.907913+0000","last_active":"2024-09-13T18:45:55.897854+0000","last_peered":"2024-09-13T18:45:55.897854+0000","last_clean":"2024-09-13T18:45:55.897854+0000","last_became_active":"2024-09-13T18:45:54.906386+0000","last_became_peered":"2024-09-13T18:45:54.906386+0000","last_unstale":"2024-09-13T18:45:55.897854+0000","last_undegraded":"2024-09-13T18:45:55.897854+0000","last_fullsized":"2024-09-13T18:45:55.897854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.005604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011137+0000","last_change":"2024-09-13T18:45:54.905215+0000","last_active":"2024-09-13T18:45:56.011137+0000","last_peered":"2024-09-13T18:45:56.011137+0000","last_clean":"2024-09-13T18:45:56.011137+0000","last_became_active":"2024-09-13T18:45:54.904546+0000","last_became_peered":"2024-09-13T18:45:54.904546+0000","last_unstale":"2024-09-13T18:45:56.011137+0000","last_undegraded":"2024-09-13T18:45:56.011137+0000","last_fullsized":"2024-09-13T18:45:56.011137+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011337+0000","last_change":"2024-09-13T18:45:54.920649+0000","last_active":"2024-09-13T18:45:56.011337+0000","last_peered":"2024-09-13T18:45:56.011337+0000","last_clean":"2024-09-13T18:45:56.011337+0000","last_became_active":"2024-09-13T18:45:54.919304+0000","last_became_peered":"2024-09-13T18:45:54.919304+0000","last_unstale":"2024-09-13T18:45:56.011337+0000","last_undegraded":"2024-09-13T18:45:56.011337+0000","last_fullsized":"2024-09-13T18:45:56.011337+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:37.311809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011203+0000","last_change":"2024-09-13T18:45:54.905859+0000","last_active":"2024-09-13T18:45:56.011203+0000","last_peered":"2024-09-13T18:45:56.011203+0000","last_clean":"2024-09-13T18:45:56.011203+0000","last_became_active":"2024-09-13T18:45:54.905045+0000","last_became_peered":"2024-09-13T18:45:54.905045+0000","last_unstale":"2024-09-13T18:45:56.011203+0000","last_undegraded":"2024-09-13T18:45:56.011203+0000","last_fullsized":"2024-09-13T18:45:56.011203+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010854+0000","last_change":"2024-09-13T18:45:54.916941+0000","last_active":"2024-09-13T18:45:56.010854+0000","last_peered":"2024-09-13T18:45:56.010854+0000","last_clean":"2024-09-13T18:45:56.010854+0000","last_became_active":"2024-09-13T18:45:54.916473+0000","last_became_peered":"2024-09-13T18:45:54.916473+0000","last_unstale":"2024-09-13T18:45:56.010854+0000","last_undegraded":"2024-09-13T18:45:56.010854+0000","last_fullsized":"2024-09-13T18:45:56.010854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010195+0000","last_change":"2024-09-13T18:45:54.909427+0000","last_active":"2024-09-13T18:45:56.010195+0000","last_peered":"2024-09-13T18:45:56.010195+0000","last_clean":"2024-09-13T18:45:56.010195+0000","last_became_active":"2024-09-13T18:45:54.909217+0000","last_became_peered":"2024-09-13T18:45:54.909217+0000","last_unstale":"2024-09-13T18:45:56.010195+0000","last_undegraded":"2024-09-13T18:45:56.010195+0000","last_fullsized":"2024-09-13T18:45:56.010195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:38.177689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010199+0000","last_change":"2024-09-13T18:45:54.906851+0000","last_active":"2024-09-13T18:45:56.010199+0000","last_peered":"2024-09-13T18:45:56.010199+0000","last_clean":"2024-09-13T18:45:56.010199+0000","last_became_active":"2024-09-13T18:45:54.906648+0000","last_became_peered":"2024-09-13T18:45:54.906648+0000","last_unstale":"2024-09-13T18:45:56.010199+0000","last_undegraded":"2024-09-13T18:45:56.010199+0000","last_fullsized":"2024-09-13T18:45:56.010199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011707+0000","last_change":"2024-09-13T18:45:54.908866+0000","last_active":"2024-09-13T18:45:56.011707+0000","last_peered":"2024-09-13T18:45:56.011707+0000","last_clean":"2024-09-13T18:45:56.011707+0000","last_became_active":"2024-09-13T18:45:54.908632+0000","last_became_peered":"2024-09-13T18:45:54.908632+0000","last_unstale":"2024-09-13T18:45:56.011707+0000","last_undegraded":"2024-09-13T18:45:56.011707+0000","last_fullsized":"2024-09-13T18:45:56.011707+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.121006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.488730+0000","last_change":"2024-09-13T18:45:54.488730+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.488730+0000","last_undegraded":"2024-09-13T18:45:54.488730+0000","last_fullsized":"2024-09-13T18:45:54.488730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010405+0000","last_change":"2024-09-13T18:45:54.918944+0000","last_active":"2024-09-13T18:45:56.010405+0000","last_peered":"2024-09-13T18:45:56.010405+0000","last_clean":"2024-09-13T18:45:56.010405+0000","last_became_active":"2024-09-13T18:45:54.917581+0000","last_became_peered":"2024-09-13T18:45:54.917581+0000","last_unstale":"2024-09-13T18:45:56.010405+0000","last_undegraded":"2024-09-13T18:45:56.010405+0000","last_fullsized":"2024-09-13T18:45:56.010405+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010281+0000","last_change":"2024-09-13T18:45:54.905549+0000","last_active":"2024-09-13T18:45:56.010281+0000","last_peered":"2024-09-13T18:45:56.010281+0000","last_clean":"2024-09-13T18:45:56.010281+0000","last_became_active":"2024-09-13T18:45:54.905342+0000","last_became_peered":"2024-09-13T18:45:54.905342+0000","last_unstale":"2024-09-13T18:45:56.010281+0000","last_undegraded":"2024-09-13T18:45:56.010281+0000","last_fullsized":"2024-09-13T18:45:56.010281+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:01.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898360+0000","last_change":"2024-09-13T18:45:54.902557+0000","last_active":"2024-09-13T18:45:55.898360+0000","last_peered":"2024-09-13T18:45:55.898360+0000","last_clean":"2024-09-13T18:45:55.898360+0000","last_became_active":"2024-09-13T18:45:54.902298+0000","last_became_peered":"2024-09-13T18:45:54.902298+0000","last_unstale":"2024-09-13T18:45:55.898360+0000","last_undegraded":"2024-09-13T18:45:55.898360+0000","last_fullsized":"2024-09-13T18:45:55.898360+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.144087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897970+0000","last_change":"2024-09-13T18:45:54.906737+0000","last_active":"2024-09-13T18:45:55.897970+0000","last_peered":"2024-09-13T18:45:55.897970+0000","last_clean":"2024-09-13T18:45:55.897970+0000","last_became_active":"2024-09-13T18:45:54.905140+0000","last_became_peered":"2024-09-13T18:45:54.905140+0000","last_unstale":"2024-09-13T18:45:55.897970+0000","last_undegraded":"2024-09-13T18:45:55.897970+0000","last_fullsized":"2024-09-13T18:45:55.897970+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:09.859640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010935+0000","last_change":"2024-09-13T18:45:54.920838+0000","last_active":"2024-09-13T18:45:56.010935+0000","last_peered":"2024-09-13T18:45:56.010935+0000","last_clean":"2024-09-13T18:45:56.010935+0000","last_became_active":"2024-09-13T18:45:54.920389+0000","last_became_peered":"2024-09-13T18:45:54.920389+0000","last_unstale":"2024-09-13T18:45:56.010935+0000","last_undegraded":"2024-09-13T18:45:56.010935+0000","last_fullsized":"2024-09-13T18:45:56.010935+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:04.690253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010936+0000","last_change":"2024-09-13T18:45:54.913459+0000","last_active":"2024-09-13T18:45:56.010936+0000","last_peered":"2024-09-13T18:45:56.010936+0000","last_clean":"2024-09-13T18:45:56.010936+0000","last_became_active":"2024-09-13T18:45:54.911505+0000","last_became_peered":"2024-09-13T18:45:54.911505+0000","last_unstale":"2024-09-13T18:45:56.010936+0000","last_undegraded":"2024-09-13T18:45:56.010936+0000","last_fullsized":"2024-09-13T18:45:56.010936+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898627+0000","last_change":"2024-09-13T18:45:54.905226+0000","last_active":"2024-09-13T18:45:55.898627+0000","last_peered":"2024-09-13T18:45:55.898627+0000","last_clean":"2024-09-13T18:45:55.898627+0000","last_became_active":"2024-09-13T18:45:54.904669+0000","last_became_peered":"2024-09-13T18:45:54.904669+0000","last_unstale":"2024-09-13T18:45:55.898627+0000","last_undegraded":"2024-09-13T18:45:55.898627+0000","last_fullsized":"2024-09-13T18:45:55.898627+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:06.638083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.009933+0000","last_change":"2024-09-13T18:45:54.916788+0000","last_active":"2024-09-13T18:45:56.009933+0000","last_peered":"2024-09-13T18:45:56.009933+0000","last_clean":"2024-09-13T18:45:56.009933+0000","last_became_active":"2024-09-13T18:45:54.916454+0000","last_became_peered":"2024-09-13T18:45:54.916454+0000","last_unstale":"2024-09-13T18:45:56.009933+0000","last_undegraded":"2024-09-13T18:45:56.009933+0000","last_fullsized":"2024-09-13T18:45:56.009933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:17.455557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010997+0000","last_change":"2024-09-13T18:45:54.907911+0000","last_active":"2024-09-13T18:45:56.010997+0000","last_peered":"2024-09-13T18:45:56.010997+0000","last_clean":"2024-09-13T18:45:56.010997+0000","last_became_active":"2024-09-13T18:45:54.907654+0000","last_became_peered":"2024-09-13T18:45:54.907654+0000","last_unstale":"2024-09-13T18:45:56.010997+0000","last_undegraded":"2024-09-13T18:45:56.010997+0000","last_fullsized":"2024-09-13T18:45:56.010997+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:57.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897669+0000","last_change":"2024-09-13T18:45:54.904016+0000","last_active":"2024-09-13T18:45:55.897669+0000","last_peered":"2024-09-13T18:45:55.897669+0000","last_clean":"2024-09-13T18:45:55.897669+0000","last_became_active":"2024-09-13T18:45:54.903783+0000","last_became_peered":"2024-09-13T18:45:54.903783+0000","last_unstale":"2024-09-13T18:45:55.897669+0000","last_undegraded":"2024-09-13T18:45:55.897669+0000","last_fullsized":"2024-09-13T18:45:55.897669+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:51.133236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010717+0000","last_change":"2024-09-13T18:45:54.907422+0000","last_active":"2024-09-13T18:45:56.010717+0000","last_peered":"2024-09-13T18:45:56.010717+0000","last_clean":"2024-09-13T18:45:56.010717+0000","last_became_active":"2024-09-13T18:45:54.907213+0000","last_became_peered":"2024-09-13T18:45:54.907213+0000","last_unstale":"2024-09-13T18:45:56.010717+0000","last_undegraded":"2024-09-13T18:45:56.010717+0000","last_fullsized":"2024-09-13T18:45:56.010717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:34.474938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010677+0000","last_change":"2024-09-13T18:45:54.902283+0000","last_active":"2024-09-13T18:45:56.010677+0000","last_peered":"2024-09-13T18:45:56.010677+0000","last_clean":"2024-09-13T18:45:56.010677+0000","last_became_active":"2024-09-13T18:45:54.901696+0000","last_became_peered":"2024-09-13T18:45:54.901696+0000","last_unstale":"2024-09-13T18:45:56.010677+0000","last_undegraded":"2024-09-13T18:45:56.010677+0000","last_fullsized":"2024-09-13T18:45:56.010677+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:07.263140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898174+0000","last_change":"2024-09-13T18:45:54.911220+0000","last_active":"2024-09-13T18:45:55.898174+0000","last_peered":"2024-09-13T18:45:55.898174+0000","last_clean":"2024-09-13T18:45:55.898174+0000","last_became_active":"2024-09-13T18:45:54.910394+0000","last_became_peered":"2024-09-13T18:45:54.910394+0000","last_unstale":"2024-09-13T18:45:55.898174+0000","last_undegraded":"2024-09-13T18:45:55.898174+0000","last_fullsized":"2024-09-13T18:45:55.898174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:51.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010800+0000","last_change":"2024-09-13T18:45:54.910226+0000","last_active":"2024-09-13T18:45:56.010800+0000","last_peered":"2024-09-13T18:45:56.010800+0000","last_clean":"2024-09-13T18:45:56.010800+0000","last_became_active":"2024-09-13T18:45:54.909900+0000","last_became_peered":"2024-09-13T18:45:54.909900+0000","last_unstale":"2024-09-13T18:45:56.010800+0000","last_undegraded":"2024-09-13T18:45:56.010800+0000","last_fullsized":"2024-09-13T18:45:56.010800+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010778+0000","last_change":"2024-09-13T18:45:54.906078+0000","last_active":"2024-09-13T18:45:56.010778+0000","last_peered":"2024-09-13T18:45:56.010778+0000","last_clean":"2024-09-13T18:45:56.010778+0000","last_became_active":"2024-09-13T18:45:54.905848+0000","last_became_peered":"2024-09-13T18:45:54.905848+0000","last_unstale":"2024-09-13T18:45:56.010778+0000","last_undegraded":"2024-09-13T18:45:56.010778+0000","last_fullsized":"2024-09-13T18:45:56.010778+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:00.941799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010831+0000","last_change":"2024-09-13T18:45:54.909954+0000","last_active":"2024-09-13T18:45:56.010831+0000","last_peered":"2024-09-13T18:45:56.010831+0000","last_clean":"2024-09-13T18:45:56.010831+0000","last_became_active":"2024-09-13T18:45:54.909730+0000","last_became_peered":"2024-09-13T18:45:54.909730+0000","last_unstale":"2024-09-13T18:45:56.010831+0000","last_undegraded":"2024-09-13T18:45:56.010831+0000","last_fullsized":"2024-09-13T18:45:56.010831+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:43.640922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010020+0000","last_change":"2024-09-13T18:45:54.916653+0000","last_active":"2024-09-13T18:45:56.010020+0000","last_peered":"2024-09-13T18:45:56.010020+0000","last_clean":"2024-09-13T18:45:56.010020+0000","last_became_active":"2024-09-13T18:45:54.916130+0000","last_became_peered":"2024-09-13T18:45:54.916130+0000","last_unstale":"2024-09-13T18:45:56.010020+0000","last_undegraded":"2024-09-13T18:45:56.010020+0000","last_fullsized":"2024-09-13T18:45:56.010020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:06.281655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"179'4","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921504+0000","last_change":"2024-09-13T18:45:54.496811+0000","last_active":"2024-09-13T18:45:54.921504+0000","last_peered":"2024-09-13T18:45:54.921504+0000","last_clean":"2024-09-13T18:45:54.921504+0000","last_became_active":"2024-09-13T18:45:54.496586+0000","last_became_peered":"2024-09-13T18:45:54.496586+0000","last_unstale":"2024-09-13T18:45:54.921504+0000","last_undegraded":"2024-09-13T18:45:54.921504+0000","last_fullsized":"2024-09-13T18:45:54.921504+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.492453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489531+0000","last_change":"2024-09-13T18:45:54.489531+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489531+0000","last_undegraded":"2024-09-13T18:45:54.489531+0000","last_fullsized":"2024-09-13T18:45:54.489531+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917380+0000","last_change":"2024-09-13T18:45:54.492450+0000","last_active":"2024-09-13T18:45:54.917380+0000","last_peered":"2024-09-13T18:45:54.917380+0000","last_clean":"2024-09-13T18:45:54.917380+0000","last_became_active":"2024-09-13T18:45:54.491715+0000","last_became_peered":"2024-09-13T18:45:54.491715+0000","last_unstale":"2024-09-13T18:45:54.917380+0000","last_undegraded":"2024-09-13T18:45:54.917380+0000","last_fullsized":"2024-09-13T18:45:54.917380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:37.803308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011301+0000","last_change":"2024-09-13T18:45:54.911792+0000","last_active":"2024-09-13T18:45:56.011301+0000","last_peered":"2024-09-13T18:45:56.011301+0000","last_clean":"2024-09-13T18:45:56.011301+0000","last_became_active":"2024-09-13T18:45:54.910953+0000","last_became_peered":"2024-09-13T18:45:54.910953+0000","last_unstale":"2024-09-13T18:45:56.011301+0000","last_undegraded":"2024-09-13T18:45:56.011301+0000","last_fullsized":"2024-09-13T18:45:56.011301+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918338+0000","last_change":"2024-09-13T18:45:54.495172+0000","last_active":"2024-09-13T18:45:54.918338+0000","last_peered":"2024-09-13T18:45:54.918338+0000","last_clean":"2024-09-13T18:45:54.918338+0000","last_became_active":"2024-09-13T18:45:54.494637+0000","last_became_peered":"2024-09-13T18:45:54.494637+0000","last_unstale":"2024-09-13T18:45:54.918338+0000","last_undegraded":"2024-09-13T18:45:54.918338+0000","last_fullsized":"2024-09-13T18:45:54.918338+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:28.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898980+0000","last_change":"2024-09-13T18:45:54.915501+0000","last_active":"2024-09-13T18:45:55.898980+0000","last_peered":"2024-09-13T18:45:55.898980+0000","last_clean":"2024-09-13T18:45:55.898980+0000","last_became_active":"2024-09-13T18:45:54.915141+0000","last_became_peered":"2024-09-13T18:45:54.915141+0000","last_unstale":"2024-09-13T18:45:55.898980+0000","last_undegraded":"2024-09-13T18:45:55.898980+0000","last_fullsized":"2024-09-13T18:45:55.898980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920696+0000","last_change":"2024-09-13T18:45:54.496083+0000","last_active":"2024-09-13T18:45:54.920696+0000","last_peered":"2024-09-13T18:45:54.920696+0000","last_clean":"2024-09-13T18:45:54.920696+0000","last_became_active":"2024-09-13T18:45:54.495784+0000","last_became_peered":"2024-09-13T18:45:54.495784+0000","last_unstale":"2024-09-13T18:45:54.920696+0000","last_undegraded":"2024-09-13T18:45:54.920696+0000","last_fullsized":"2024-09-13T18:45:54.920696+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:07.785392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010793+0000","last_change":"2024-09-13T18:45:54.907306+0000","last_active":"2024-09-13T18:45:56.010793+0000","last_peered":"2024-09-13T18:45:56.010793+0000","last_clean":"2024-09-13T18:45:56.010793+0000","last_became_active":"2024-09-13T18:45:54.907088+0000","last_became_peered":"2024-09-13T18:45:54.907088+0000","last_unstale":"2024-09-13T18:45:56.010793+0000","last_undegraded":"2024-09-13T18:45:56.010793+0000","last_fullsized":"2024-09-13T18:45:56.010793+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.319805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919010+0000","last_change":"2024-09-13T18:45:54.486281+0000","last_active":"2024-09-13T18:45:54.919010+0000","last_peered":"2024-09-13T18:45:54.919010+0000","last_clean":"2024-09-13T18:45:54.919010+0000","last_became_active":"2024-09-13T18:45:54.485730+0000","last_became_peered":"2024-09-13T18:45:54.485730+0000","last_unstale":"2024-09-13T18:45:54.919010+0000","last_undegraded":"2024-09-13T18:45:54.919010+0000","last_fullsized":"2024-09-13T18:45:54.919010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.176678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898569+0000","last_change":"2024-09-13T18:45:54.914232+0000","last_active":"2024-09-13T18:45:55.898569+0000","last_peered":"2024-09-13T18:45:55.898569+0000","last_clean":"2024-09-13T18:45:55.898569+0000","last_became_active":"2024-09-13T18:45:54.913955+0000","last_became_peered":"2024-09-13T18:45:54.913955+0000","last_unstale":"2024-09-13T18:45:55.898569+0000","last_undegraded":"2024-09-13T18:45:55.898569+0000","last_fullsized":"2024-09-13T18:45:55.898569+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920875+0000","last_change":"2024-09-13T18:45:54.494883+0000","last_active":"2024-09-13T18:45:54.920875+0000","last_peered":"2024-09-13T18:45:54.920875+0000","last_clean":"2024-09-13T18:45:54.920875+0000","last_became_active":"2024-09-13T18:45:54.494664+0000","last_became_peered":"2024-09-13T18:45:54.494664+0000","last_unstale":"2024-09-13T18:45:54.920875+0000","last_undegraded":"2024-09-13T18:45:54.920875+0000","last_fullsized":"2024-09-13T18:45:54.920875+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:34.997445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011108+0000","last_change":"2024-09-13T18:45:54.912604+0000","last_active":"2024-09-13T18:45:56.011108+0000","last_peered":"2024-09-13T18:45:56.011108+0000","last_clean":"2024-09-13T18:45:56.011108+0000","last_became_active":"2024-09-13T18:45:54.912148+0000","last_became_peered":"2024-09-13T18:45:54.912148+0000","last_unstale":"2024-09-13T18:45:56.011108+0000","last_undegraded":"2024-09-13T18:45:56.011108+0000","last_fullsized":"2024-09-13T18:45:56.011108+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:07.339063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899755+0000","last_change":"2024-09-13T18:45:54.496659+0000","last_active":"2024-09-13T18:45:54.899755+0000","last_peered":"2024-09-13T18:45:54.899755+0000","last_clean":"2024-09-13T18:45:54.899755+0000","last_became_active":"2024-09-13T18:45:54.492022+0000","last_became_peered":"2024-09-13T18:45:54.492022+0000","last_unstale":"2024-09-13T18:45:54.899755+0000","last_undegraded":"2024-09-13T18:45:54.899755+0000","last_fullsized":"2024-09-13T18:45:54.899755+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:51.428747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898877+0000","last_change":"2024-09-13T18:45:54.902303+0000","last_active":"2024-09-13T18:45:55.898877+0000","last_peered":"2024-09-13T18:45:55.898877+0000","last_clean":"2024-09-13T18:45:55.898877+0000","last_became_active":"2024-09-13T18:45:54.901738+0000","last_became_peered":"2024-09-13T18:45:54.901738+0000","last_unstale":"2024-09-13T18:45:55.898877+0000","last_undegraded":"2024-09-13T18:45:55.898877+0000","last_fullsized":"2024-09-13T18:45:55.898877+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.908844+0000","last_change":"2024-09-13T18:45:54.495032+0000","last_active":"2024-09-13T18:45:54.908844+0000","last_peered":"2024-09-13T18:45:54.908844+0000","last_clean":"2024-09-13T18:45:54.908844+0000","last_became_active":"2024-09-13T18:45:54.494407+0000","last_became_peered":"2024-09-13T18:45:54.494407+0000","last_unstale":"2024-09-13T18:45:54.908844+0000","last_undegraded":"2024-09-13T18:45:54.908844+0000","last_fullsized":"2024-09-13T18:45:54.908844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:12.756996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898654+0000","last_change":"2024-09-13T18:45:54.907873+0000","last_active":"2024-09-13T18:45:55.898654+0000","last_peered":"2024-09-13T18:45:55.898654+0000","last_clean":"2024-09-13T18:45:55.898654+0000","last_became_active":"2024-09-13T18:45:54.906361+0000","last_became_peered":"2024-09-13T18:45:54.906361+0000","last_unstale":"2024-09-13T18:45:55.898654+0000","last_undegraded":"2024-09-13T18:45:55.898654+0000","last_fullsized":"2024-09-13T18:45:55.898654+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899665+0000","last_change":"2024-09-13T18:45:54.486090+0000","last_active":"2024-09-13T18:45:54.899665+0000","last_peered":"2024-09-13T18:45:54.899665+0000","last_clean":"2024-09-13T18:45:54.899665+0000","last_became_active":"2024-09-13T18:45:54.485779+0000","last_became_peered":"2024-09-13T18:45:54.485779+0000","last_unstale":"2024-09-13T18:45:54.899665+0000","last_undegraded":"2024-09-13T18:45:54.899665+0000","last_fullsized":"2024-09-13T18:45:54.899665+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:50.156625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010952+0000","last_change":"2024-09-13T18:45:54.911423+0000","last_active":"2024-09-13T18:45:56.010952+0000","last_peered":"2024-09-13T18:45:56.010952+0000","last_clean":"2024-09-13T18:45:56.010952+0000","last_became_active":"2024-09-13T18:45:54.910239+0000","last_became_peered":"2024-09-13T18:45:54.910239+0000","last_unstale":"2024-09-13T18:45:56.010952+0000","last_undegraded":"2024-09-13T18:45:56.010952+0000","last_fullsized":"2024-09-13T18:45:56.010952+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.903358+0000","last_change":"2024-09-13T18:45:54.491468+0000","last_active":"2024-09-13T18:45:54.903358+0000","last_peered":"2024-09-13T18:45:54.903358+0000","last_clean":"2024-09-13T18:45:54.903358+0000","last_became_active":"2024-09-13T18:45:54.491217+0000","last_became_peered":"2024-09-13T18:45:54.491217+0000","last_unstale":"2024-09-13T18:45:54.903358+0000","last_undegraded":"2024-09-13T18:45:54.903358+0000","last_fullsized":"2024-09-13T18:45:54.903358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:35.312903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489173+0000","last_change":"2024-09-13T18:45:54.489173+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489173+0000","last_undegraded":"2024-09-13T18:45:54.489173+0000","last_fullsized":"2024-09-13T18:45:54.489173+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498794+0000","last_change":"2024-09-13T18:45:54.498701+0000","last_active":"2024-09-13T18:45:54.498794+0000","last_peered":"2024-09-13T18:45:54.498794+0000","last_clean":"2024-09-13T18:45:54.498794+0000","last_became_active":"2024-09-13T18:45:54.498477+0000","last_became_peered":"2024-09-13T18:45:54.498477+0000","last_unstale":"2024-09-13T18:45:54.498794+0000","last_undegraded":"2024-09-13T18:45:54.498794+0000","last_fullsized":"2024-09-13T18:45:54.498794+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:05.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898904+0000","last_change":"2024-09-13T18:45:54.916063+0000","last_active":"2024-09-13T18:45:55.898904+0000","last_peered":"2024-09-13T18:45:55.898904+0000","last_clean":"2024-09-13T18:45:55.898904+0000","last_became_active":"2024-09-13T18:45:54.914695+0000","last_became_peered":"2024-09-13T18:45:54.914695+0000","last_unstale":"2024-09-13T18:45:55.898904+0000","last_undegraded":"2024-09-13T18:45:55.898904+0000","last_fullsized":"2024-09-13T18:45:55.898904+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920376+0000","last_change":"2024-09-13T18:45:54.494893+0000","last_active":"2024-09-13T18:45:54.920376+0000","last_peered":"2024-09-13T18:45:54.920376+0000","last_clean":"2024-09-13T18:45:54.920376+0000","last_became_active":"2024-09-13T18:45:54.494123+0000","last_became_peered":"2024-09-13T18:45:54.494123+0000","last_unstale":"2024-09-13T18:45:54.920376+0000","last_undegraded":"2024-09-13T18:45:54.920376+0000","last_fullsized":"2024-09-13T18:45:54.920376+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:14.459115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898103+0000","last_change":"2024-09-13T18:45:54.911463+0000","last_active":"2024-09-13T18:45:55.898103+0000","last_peered":"2024-09-13T18:45:55.898103+0000","last_clean":"2024-09-13T18:45:55.898103+0000","last_became_active":"2024-09-13T18:45:54.910682+0000","last_became_peered":"2024-09-13T18:45:54.910682+0000","last_unstale":"2024-09-13T18:45:55.898103+0000","last_undegraded":"2024-09-13T18:45:55.898103+0000","last_fullsized":"2024-09-13T18:45:55.898103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:21.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.905155+0000","last_change":"2024-09-13T18:45:54.495200+0000","last_active":"2024-09-13T18:45:54.905155+0000","last_peered":"2024-09-13T18:45:54.905155+0000","last_clean":"2024-09-13T18:45:54.905155+0000","last_became_active":"2024-09-13T18:45:54.494927+0000","last_became_peered":"2024-09-13T18:45:54.494927+0000","last_unstale":"2024-09-13T18:45:54.905155+0000","last_undegraded":"2024-09-13T18:45:54.905155+0000","last_fullsized":"2024-09-13T18:45:54.905155+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898942+0000","last_change":"2024-09-13T18:45:54.912225+0000","last_active":"2024-09-13T18:45:55.898942+0000","last_peered":"2024-09-13T18:45:55.898942+0000","last_clean":"2024-09-13T18:45:55.898942+0000","last_became_active":"2024-09-13T18:45:54.911697+0000","last_became_peered":"2024-09-13T18:45:54.911697+0000","last_unstale":"2024-09-13T18:45:55.898942+0000","last_undegraded":"2024-09-13T18:45:55.898942+0000","last_fullsized":"2024-09-13T18:45:55.898942+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901469+0000","last_change":"2024-09-13T18:45:54.496453+0000","last_active":"2024-09-13T18:45:54.901469+0000","last_peered":"2024-09-13T18:45:54.901469+0000","last_clean":"2024-09-13T18:45:54.901469+0000","last_became_active":"2024-09-13T18:45:54.496187+0000","last_became_peered":"2024-09-13T18:45:54.496187+0000","last_unstale":"2024-09-13T18:45:54.901469+0000","last_undegraded":"2024-09-13T18:45:54.901469+0000","last_fullsized":"2024-09-13T18:45:54.901469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:34.536434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898899+0000","last_change":"2024-09-13T18:45:54.908004+0000","last_active":"2024-09-13T18:45:55.898899+0000","last_peered":"2024-09-13T18:45:55.898899+0000","last_clean":"2024-09-13T18:45:55.898899+0000","last_became_active":"2024-09-13T18:45:54.906642+0000","last_became_peered":"2024-09-13T18:45:54.906642+0000","last_unstale":"2024-09-13T18:45:55.898899+0000","last_undegraded":"2024-09-13T18:45:55.898899+0000","last_fullsized":"2024-09-13T18:45:55.898899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:32.003975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"179'8","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920589+0000","last_change":"2024-09-13T18:45:54.493489+0000","last_active":"2024-09-13T18:45:54.920589+0000","last_peered":"2024-09-13T18:45:54.920589+0000","last_clean":"2024-09-13T18:45:54.920589+0000","last_became_active":"2024-09-13T18:45:54.493186+0000","last_became_peered":"2024-09-13T18:45:54.493186+0000","last_unstale":"2024-09-13T18:45:54.920589+0000","last_undegraded":"2024-09-13T18:45:54.920589+0000","last_fullsized":"2024-09-13T18:45:54.920589+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:22.461942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011749+0000","last_change":"2024-09-13T18:45:54.914777+0000","last_active":"2024-09-13T18:45:56.011749+0000","last_peered":"2024-09-13T18:45:56.011749+0000","last_clean":"2024-09-13T18:45:56.011749+0000","last_became_active":"2024-09-13T18:45:54.914406+0000","last_became_peered":"2024-09-13T18:45:54.914406+0000","last_unstale":"2024-09-13T18:45:56.011749+0000","last_undegraded":"2024-09-13T18:45:56.011749+0000","last_fullsized":"2024-09-13T18:45:56.011749+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:40.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917253+0000","last_change":"2024-09-13T18:45:54.487283+0000","last_active":"2024-09-13T18:45:54.917253+0000","last_peered":"2024-09-13T18:45:54.917253+0000","last_clean":"2024-09-13T18:45:54.917253+0000","last_became_active":"2024-09-13T18:45:54.487060+0000","last_became_peered":"2024-09-13T18:45:54.487060+0000","last_unstale":"2024-09-13T18:45:54.917253+0000","last_undegraded":"2024-09-13T18:45:54.917253+0000","last_fullsized":"2024-09-13T18:45:54.917253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.256698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011050+0000","last_change":"2024-09-13T18:45:54.906614+0000","last_active":"2024-09-13T18:45:56.011050+0000","last_peered":"2024-09-13T18:45:56.011050+0000","last_clean":"2024-09-13T18:45:56.011050+0000","last_became_active":"2024-09-13T18:45:54.906390+0000","last_became_peered":"2024-09-13T18:45:54.906390+0000","last_unstale":"2024-09-13T18:45:56.011050+0000","last_undegraded":"2024-09-13T18:45:56.011050+0000","last_fullsized":"2024-09-13T18:45:56.011050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:11.921047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920922+0000","last_change":"2024-09-13T18:45:54.497640+0000","last_active":"2024-09-13T18:45:54.920922+0000","last_peered":"2024-09-13T18:45:54.920922+0000","last_clean":"2024-09-13T18:45:54.920922+0000","last_became_active":"2024-09-13T18:45:54.497203+0000","last_became_peered":"2024-09-13T18:45:54.497203+0000","last_unstale":"2024-09-13T18:45:54.920922+0000","last_undegraded":"2024-09-13T18:45:54.920922+0000","last_fullsized":"2024-09-13T18:45:54.920922+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010525+0000","last_change":"2024-09-13T18:45:54.913515+0000","last_active":"2024-09-13T18:45:56.010525+0000","last_peered":"2024-09-13T18:45:56.010525+0000","last_clean":"2024-09-13T18:45:56.010525+0000","last_became_active":"2024-09-13T18:45:54.913313+0000","last_became_peered":"2024-09-13T18:45:54.913313+0000","last_unstale":"2024-09-13T18:45:56.010525+0000","last_undegraded":"2024-09-13T18:45:56.010525+0000","last_fullsized":"2024-09-13T18:45:56.010525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:22.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.493480+0000","last_change":"2024-09-13T18:45:54.493113+0000","last_active":"2024-09-13T18:45:54.493480+0000","last_peered":"2024-09-13T18:45:54.493480+0000","last_clean":"2024-09-13T18:45:54.493480+0000","last_became_active":"2024-09-13T18:45:54.492826+0000","last_became_peered":"2024-09-13T18:45:54.492826+0000","last_unstale":"2024-09-13T18:45:54.493480+0000","last_undegraded":"2024-09-13T18:45:54.493480+0000","last_fullsized":"2024-09-13T18:45:54.493480+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011394+0000","last_change":"2024-09-13T18:45:54.911578+0000","last_active":"2024-09-13T18:45:56.011394+0000","last_peered":"2024-09-13T18:45:56.011394+0000","last_clean":"2024-09-13T18:45:56.011394+0000","last_became_active":"2024-09-13T18:45:54.909430+0000","last_became_peered":"2024-09-13T18:45:54.909430+0000","last_unstale":"2024-09-13T18:45:56.011394+0000","last_undegraded":"2024-09-13T18:45:56.011394+0000","last_fullsized":"2024-09-13T18:45:56.011394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901562+0000","last_change":"2024-09-13T18:45:54.493581+0000","last_active":"2024-09-13T18:45:54.901562+0000","last_peered":"2024-09-13T18:45:54.901562+0000","last_clean":"2024-09-13T18:45:54.901562+0000","last_became_active":"2024-09-13T18:45:54.493031+0000","last_became_peered":"2024-09-13T18:45:54.493031+0000","last_unstale":"2024-09-13T18:45:54.901562+0000","last_undegraded":"2024-09-13T18:45:54.901562+0000","last_fullsized":"2024-09-13T18:45:54.901562+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:42.168271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010050+0000","last_change":"2024-09-13T18:45:54.909801+0000","last_active":"2024-09-13T18:45:56.010050+0000","last_peered":"2024-09-13T18:45:56.010050+0000","last_clean":"2024-09-13T18:45:56.010050+0000","last_became_active":"2024-09-13T18:45:54.909522+0000","last_became_peered":"2024-09-13T18:45:54.909522+0000","last_unstale":"2024-09-13T18:45:56.010050+0000","last_undegraded":"2024-09-13T18:45:56.010050+0000","last_fullsized":"2024-09-13T18:45:56.010050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918423+0000","last_change":"2024-09-13T18:45:54.496005+0000","last_active":"2024-09-13T18:45:54.918423+0000","last_peered":"2024-09-13T18:45:54.918423+0000","last_clean":"2024-09-13T18:45:54.918423+0000","last_became_active":"2024-09-13T18:45:54.495771+0000","last_became_peered":"2024-09-13T18:45:54.495771+0000","last_unstale":"2024-09-13T18:45:54.918423+0000","last_undegraded":"2024-09-13T18:45:54.918423+0000","last_fullsized":"2024-09-13T18:45:54.918423+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:11.480554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010891+0000","last_change":"2024-09-13T18:45:54.906015+0000","last_active":"2024-09-13T18:45:56.010891+0000","last_peered":"2024-09-13T18:45:56.010891+0000","last_clean":"2024-09-13T18:45:56.010891+0000","last_became_active":"2024-09-13T18:45:54.905438+0000","last_became_peered":"2024-09-13T18:45:54.905438+0000","last_unstale":"2024-09-13T18:45:56.010891+0000","last_undegraded":"2024-09-13T18:45:56.010891+0000","last_fullsized":"2024-09-13T18:45:56.010891+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:44.251416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.897723+0000","last_change":"2024-09-13T18:45:54.493010+0000","last_active":"2024-09-13T18:45:54.897723+0000","last_peered":"2024-09-13T18:45:54.897723+0000","last_clean":"2024-09-13T18:45:54.897723+0000","last_became_active":"2024-09-13T18:45:54.492789+0000","last_became_peered":"2024-09-13T18:45:54.492789+0000","last_unstale":"2024-09-13T18:45:54.897723+0000","last_undegraded":"2024-09-13T18:45:54.897723+0000","last_fullsized":"2024-09-13T18:45:54.897723+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:24.312031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011028+0000","last_change":"2024-09-13T18:45:54.909680+0000","last_active":"2024-09-13T18:45:56.011028+0000","last_peered":"2024-09-13T18:45:56.011028+0000","last_clean":"2024-09-13T18:45:56.011028+0000","last_became_active":"2024-09-13T18:45:54.908615+0000","last_became_peered":"2024-09-13T18:45:54.908615+0000","last_unstale":"2024-09-13T18:45:56.011028+0000","last_undegraded":"2024-09-13T18:45:56.011028+0000","last_fullsized":"2024-09-13T18:45:56.011028+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.898386+0000","last_change":"2024-09-13T18:45:54.484614+0000","last_active":"2024-09-13T18:45:54.898386+0000","last_peered":"2024-09-13T18:45:54.898386+0000","last_clean":"2024-09-13T18:45:54.898386+0000","last_became_active":"2024-09-13T18:45:54.484384+0000","last_became_peered":"2024-09-13T18:45:54.484384+0000","last_unstale":"2024-09-13T18:45:54.898386+0000","last_undegraded":"2024-09-13T18:45:54.898386+0000","last_fullsized":"2024-09-13T18:45:54.898386+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:42.467009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011162+0000","last_change":"2024-09-13T18:45:54.912416+0000","last_active":"2024-09-13T18:45:56.011162+0000","last_peered":"2024-09-13T18:45:56.011162+0000","last_clean":"2024-09-13T18:45:56.011162+0000","last_became_active":"2024-09-13T18:45:54.910464+0000","last_became_peered":"2024-09-13T18:45:54.910464+0000","last_unstale":"2024-09-13T18:45:56.011162+0000","last_undegraded":"2024-09-13T18:45:56.011162+0000","last_fullsized":"2024-09-13T18:45:56.011162+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:39.075198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899634+0000","last_change":"2024-09-13T18:45:54.492800+0000","last_active":"2024-09-13T18:45:54.899634+0000","last_peered":"2024-09-13T18:45:54.899634+0000","last_clean":"2024-09-13T18:45:54.899634+0000","last_became_active":"2024-09-13T18:45:54.492257+0000","last_became_peered":"2024-09-13T18:45:54.492257+0000","last_unstale":"2024-09-13T18:45:54.899634+0000","last_undegraded":"2024-09-13T18:45:54.899634+0000","last_fullsized":"2024-09-13T18:45:54.899634+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:21.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899051+0000","last_change":"2024-09-13T18:45:54.912376+0000","last_active":"2024-09-13T18:45:55.899051+0000","last_peered":"2024-09-13T18:45:55.899051+0000","last_clean":"2024-09-13T18:45:55.899051+0000","last_became_active":"2024-09-13T18:45:54.911994+0000","last_became_peered":"2024-09-13T18:45:54.911994+0000","last_unstale":"2024-09-13T18:45:55.899051+0000","last_undegraded":"2024-09-13T18:45:55.899051+0000","last_fullsized":"2024-09-13T18:45:55.899051+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919785+0000","last_change":"2024-09-13T18:45:54.486957+0000","last_active":"2024-09-13T18:45:54.919785+0000","last_peered":"2024-09-13T18:45:54.919785+0000","last_clean":"2024-09-13T18:45:54.919785+0000","last_became_active":"2024-09-13T18:45:54.486740+0000","last_became_peered":"2024-09-13T18:45:54.486740+0000","last_unstale":"2024-09-13T18:45:54.919785+0000","last_undegraded":"2024-09-13T18:45:54.919785+0000","last_fullsized":"2024-09-13T18:45:54.919785+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:28.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899048+0000","last_change":"2024-09-13T18:45:54.911748+0000","last_active":"2024-09-13T18:45:55.899048+0000","last_peered":"2024-09-13T18:45:55.899048+0000","last_clean":"2024-09-13T18:45:55.899048+0000","last_became_active":"2024-09-13T18:45:54.911536+0000","last_became_peered":"2024-09-13T18:45:54.911536+0000","last_unstale":"2024-09-13T18:45:55.899048+0000","last_undegraded":"2024-09-13T18:45:55.899048+0000","last_fullsized":"2024-09-13T18:45:55.899048+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899403+0000","last_change":"2024-09-13T18:45:54.493256+0000","last_active":"2024-09-13T18:45:54.899403+0000","last_peered":"2024-09-13T18:45:54.899403+0000","last_clean":"2024-09-13T18:45:54.899403+0000","last_became_active":"2024-09-13T18:45:54.492757+0000","last_became_peered":"2024-09-13T18:45:54.492757+0000","last_unstale":"2024-09-13T18:45:54.899403+0000","last_undegraded":"2024-09-13T18:45:54.899403+0000","last_fullsized":"2024-09-13T18:45:54.899403+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:01.290718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898201+0000","last_change":"2024-09-13T18:45:54.906596+0000","last_active":"2024-09-13T18:45:55.898201+0000","last_peered":"2024-09-13T18:45:55.898201+0000","last_clean":"2024-09-13T18:45:55.898201+0000","last_became_active":"2024-09-13T18:45:54.904819+0000","last_became_peered":"2024-09-13T18:45:54.904819+0000","last_unstale":"2024-09-13T18:45:55.898201+0000","last_undegraded":"2024-09-13T18:45:55.898201+0000","last_fullsized":"2024-09-13T18:45:55.898201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:37.224895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498264+0000","last_change":"2024-09-13T18:45:54.498180+0000","last_active":"2024-09-13T18:45:54.498264+0000","last_peered":"2024-09-13T18:45:54.498264+0000","last_clean":"2024-09-13T18:45:54.498264+0000","last_became_active":"2024-09-13T18:45:54.497907+0000","last_became_peered":"2024-09-13T18:45:54.497907+0000","last_unstale":"2024-09-13T18:45:54.498264+0000","last_undegraded":"2024-09-13T18:45:54.498264+0000","last_fullsized":"2024-09-13T18:45:54.498264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:26.217332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898271+0000","last_change":"2024-09-13T18:45:54.900842+0000","last_active":"2024-09-13T18:45:55.898271+0000","last_peered":"2024-09-13T18:45:55.898271+0000","last_clean":"2024-09-13T18:45:55.898271+0000","last_became_active":"2024-09-13T18:45:54.900605+0000","last_became_peered":"2024-09-13T18:45:54.900605+0000","last_unstale":"2024-09-13T18:45:55.898271+0000","last_undegraded":"2024-09-13T18:45:55.898271+0000","last_fullsized":"2024-09-13T18:45:55.898271+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:40.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.495630+0000","last_change":"2024-09-13T18:45:54.495093+0000","last_active":"2024-09-13T18:45:54.495630+0000","last_peered":"2024-09-13T18:45:54.495630+0000","last_clean":"2024-09-13T18:45:54.495630+0000","last_became_active":"2024-09-13T18:45:54.494822+0000","last_became_peered":"2024-09-13T18:45:54.494822+0000","last_unstale":"2024-09-13T18:45:54.495630+0000","last_undegraded":"2024-09-13T18:45:54.495630+0000","last_fullsized":"2024-09-13T18:45:54.495630+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487336+0000","last_change":"2024-09-13T18:45:54.487336+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487336+0000","last_undegraded":"2024-09-13T18:45:54.487336+0000","last_fullsized":"2024-09-13T18:45:54.487336+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901165+0000","last_change":"2024-09-13T18:45:54.493395+0000","last_active":"2024-09-13T18:45:54.901165+0000","last_peered":"2024-09-13T18:45:54.901165+0000","last_clean":"2024-09-13T18:45:54.901165+0000","last_became_active":"2024-09-13T18:45:54.493125+0000","last_became_peered":"2024-09-13T18:45:54.493125+0000","last_unstale":"2024-09-13T18:45:54.901165+0000","last_undegraded":"2024-09-13T18:45:54.901165+0000","last_fullsized":"2024-09-13T18:45:54.901165+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:59.567811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898992+0000","last_change":"2024-09-13T18:45:54.910921+0000","last_active":"2024-09-13T18:45:55.898992+0000","last_peered":"2024-09-13T18:45:55.898992+0000","last_clean":"2024-09-13T18:45:55.898992+0000","last_became_active":"2024-09-13T18:45:54.909213+0000","last_became_peered":"2024-09-13T18:45:54.909213+0000","last_unstale":"2024-09-13T18:45:55.898992+0000","last_undegraded":"2024-09-13T18:45:55.898992+0000","last_fullsized":"2024-09-13T18:45:55.898992+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:19.183121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904368+0000","last_change":"2024-09-13T18:45:54.490731+0000","last_active":"2024-09-13T18:45:54.904368+0000","last_peered":"2024-09-13T18:45:54.904368+0000","last_clean":"2024-09-13T18:45:54.904368+0000","last_became_active":"2024-09-13T18:45:54.490352+0000","last_became_peered":"2024-09-13T18:45:54.490352+0000","last_unstale":"2024-09-13T18:45:54.904368+0000","last_undegraded":"2024-09-13T18:45:54.904368+0000","last_fullsized":"2024-09-13T18:45:54.904368+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:21.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898977+0000","last_change":"2024-09-13T18:45:54.902428+0000","last_active":"2024-09-13T18:45:55.898977+0000","last_peered":"2024-09-13T18:45:55.898977+0000","last_clean":"2024-09-13T18:45:55.898977+0000","last_became_active":"2024-09-13T18:45:54.902083+0000","last_became_peered":"2024-09-13T18:45:54.902083+0000","last_unstale":"2024-09-13T18:45:55.898977+0000","last_undegraded":"2024-09-13T18:45:55.898977+0000","last_fullsized":"2024-09-13T18:45:55.898977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902720+0000","last_change":"2024-09-13T18:45:54.491923+0000","last_active":"2024-09-13T18:45:54.902720+0000","last_peered":"2024-09-13T18:45:54.902720+0000","last_clean":"2024-09-13T18:45:54.902720+0000","last_became_active":"2024-09-13T18:45:54.491706+0000","last_became_peered":"2024-09-13T18:45:54.491706+0000","last_unstale":"2024-09-13T18:45:54.902720+0000","last_undegraded":"2024-09-13T18:45:54.902720+0000","last_fullsized":"2024-09-13T18:45:54.902720+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:14.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010210+0000","last_change":"2024-09-13T18:45:54.912208+0000","last_active":"2024-09-13T18:45:56.010210+0000","last_peered":"2024-09-13T18:45:56.010210+0000","last_clean":"2024-09-13T18:45:56.010210+0000","last_became_active":"2024-09-13T18:45:54.911794+0000","last_became_peered":"2024-09-13T18:45:54.911794+0000","last_unstale":"2024-09-13T18:45:56.010210+0000","last_undegraded":"2024-09-13T18:45:56.010210+0000","last_fullsized":"2024-09-13T18:45:56.010210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:02.923713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899848+0000","last_change":"2024-09-13T18:45:54.492315+0000","last_active":"2024-09-13T18:45:54.899848+0000","last_peered":"2024-09-13T18:45:54.899848+0000","last_clean":"2024-09-13T18:45:54.899848+0000","last_became_active":"2024-09-13T18:45:54.491338+0000","last_became_peered":"2024-09-13T18:45:54.491338+0000","last_unstale":"2024-09-13T18:45:54.899848+0000","last_undegraded":"2024-09-13T18:45:54.899848+0000","last_fullsized":"2024-09-13T18:45:54.899848+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.194286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487402+0000","last_change":"2024-09-13T18:45:54.487402+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487402+0000","last_undegraded":"2024-09-13T18:45:54.487402+0000","last_fullsized":"2024-09-13T18:45:54.487402+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"179'3","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917211+0000","last_change":"2024-09-13T18:45:54.492742+0000","last_active":"2024-09-13T18:45:54.917211+0000","last_peered":"2024-09-13T18:45:54.917211+0000","last_clean":"2024-09-13T18:45:54.917211+0000","last_became_active":"2024-09-13T18:45:54.492518+0000","last_became_peered":"2024-09-13T18:45:54.492518+0000","last_unstale":"2024-09-13T18:45:54.917211+0000","last_undegraded":"2024-09-13T18:45:54.917211+0000","last_fullsized":"2024-09-13T18:45:54.917211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902626+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:45:54.902626+0000","last_peered":"2024-09-13T18:45:54.902626+0000","last_clean":"2024-09-13T18:45:54.902626+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:45:54.902626+0000","last_undegraded":"2024-09-13T18:45:54.902626+0000","last_fullsized":"2024-09-13T18:45:54.902626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52100000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.441},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69299999999999995,"15min":0.65800000000000003},"min":{"1min":0.51800000000000002,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":1.014},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":1.004,"15min":1.004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.999},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71199999999999997,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80600000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46999999999999997,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.755},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.371},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":1.143},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":1.125},"last":0.79700000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":1.665},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.57799999999999996,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80300000000000005,"5min":0.96799999999999997,"15min":1.591},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":2.2709999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.0680000000000001,"15min":2.169},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97199999999999998,"15min":1.4450000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.45000000000000001,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.0840000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.504,"5min":0.438,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.0289999999999999,"15min":1.115},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70499999999999996,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.02,"15min":6.4539999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.52700000000000002,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.94199999999999995,"15min":6.5019999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.96399999999999997,"15min":1.032},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.68000000000000005},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":0.97199999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.41499999999999998,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":0.96199999999999997,"15min":1.5509999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.403},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"max":{"1min":0.89300000000000002,"5min":0.97199999999999998,"15min":1.6040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194322,"statfs":{"total":200000000,"available":198986288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.57299999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":1.581,"15min":2.0579999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95099999999999996,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":1.5589999999999999,"15min":3.706},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":2.915,"15min":3.742},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.762,"15min":3.6909999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.40799999999999997},"max":{"1min":0.95999999999999996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.91700000000000004,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.94799999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53500000000000003,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.745},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":1.843,"15min":3.7989999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.94599999999999995,"5min":1.548,"15min":5.5069999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.72499999999999998},"min":{"1min":0.624,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.95999999999999996,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198987840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.64300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.74099999999999999,"5min":1.546,"15min":8.1059999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.81399999999999995,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.626},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":7.798},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.502,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.93899999999999995,"5min":1.0669999999999999,"15min":3.093},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.022,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.84599999999999997},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.105,"5min":1.105,"15min":8.0519999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.64600000000000002,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.499,"15min":0.505},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.327,"5min":1.423,"15min":1.423},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.095,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.45800000000000002},"max":{"1min":1.266,"5min":1.329,"15min":1.329},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.876}]},{"osd":7,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.198,"5min":1.508,"15min":1.508},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1564,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193748,"statfs":{"total":200000000,"available":198398018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":1.6000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69899999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.5,"5min":0.63300000000000001,"15min":1.036},"last":0.372},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.86499999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.64900000000000002,"5min":0.80600000000000005,"15min":1.1870000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.70499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.98099999999999998,"5min":1.3,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:44:54 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":1.242,"15min":1.242},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.86499999999999999,"5min":1.123,"15min":1.21},"last":0.745},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":1.0580000000000001,"15min":1.278},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.498,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.1830000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.76400000000000001},"min":{"1min":0.59699999999999998,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":0.94999999999999996,"5min":1.1399999999999999,"15min":1.1539999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60199999999999998,"5min":0.76700000000000002,"15min":1.669},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.499},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.591},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":0.63700000000000001,"5min":0.70899999999999996,"15min":1.03},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":1.637},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.044,"5min":1.21,"15min":1.21},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.038,"5min":1.056,"15min":1.698},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79100000000000004,"15min":0.76200000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.204},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2190000000000001,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.67400000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.155,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.60899999999999999,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.745,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.165,"15min":2.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77300000000000002,"15min":0.72299999999999998},"min":{"1min":0.65300000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:45:59.449 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:45:59.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.633+0000 7f3cd4a00640 1 Processor -- start 2024-09-13T18:45:59.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.633+0000 7f3cd4a00640 1 -- start start 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 0x7f3cd00afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00b3f10 0x7f3cd00b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cd015e2c0 0x7f3cd015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00b2f00 con 0x7f3cd015e2c0 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd00b3150 con 0x7f3cd015dee0 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.634+0000 7f3cd4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b3430 con 0x7f3cd00b3f10 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cd015e2c0 0x7f3cd015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3cd015e2c0 0x7f3cd015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38204/0 (socket says 172.21.15.192:38204) 2024-09-13T18:45:59.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 -- 172.21.15.192:0/332254634 learned_addr learned my addr 172.21.15.192:0/332254634 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3ccde00640 1 --2- 172.21.15.192:0/332254634 >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 0x7f3cd00afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cc5400640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00b3f10 0x7f3cd00b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 -- 172.21.15.192:0/332254634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00b3f10 msgr2=0x7f3cd00b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00b3f10 0x7f3cd00b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 -- 172.21.15.192:0/332254634 >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 msgr2=0x7f3cd00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 --2- 172.21.15.192:0/332254634 >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 0x7f3cd00afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3cce800640 1 -- 172.21.15.192:0/332254634 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd00b3710 con 0x7f3cd015e2c0 2024-09-13T18:45:59.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.635+0000 7f3ccde00640 1 --2- 172.21.15.192:0/332254634 >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 0x7f3cd00afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:45:59.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.636+0000 7f3cce800640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd015a440 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3cd006cd20 tx=0x7f3cc802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180fcadf09615d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3ccd400640 1 -- 172.21.15.192:0/332254634 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8031600 con 0x7f3cd015e2c0 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3ccd400640 1 -- 172.21.15.192:0/332254634 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc802d050 con 0x7f3cd015e2c0 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3ccd400640 1 -- 172.21.15.192:0/332254634 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8031980 con 0x7f3cd015e2c0 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 -- 172.21.15.192:0/332254634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 msgr2=0x7f3cd015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd015a440 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3cd006cd20 tx=0x7f3cc802a6a0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 -- 172.21.15.192:0/332254634 shutdown_connections 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd015a440 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/332254634 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00b3f10 0x7f3cd00b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/332254634 >> v2:172.21.15.194:3300/0 conn(0x7f3cd015dee0 0x7f3cd00afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 -- 172.21.15.192:0/332254634 >> 172.21.15.192:0/332254634 conn(0x7f3cd00ae960 msgr2=0x7f3cd006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 -- 172.21.15.192:0/332254634 shutdown_connections 2024-09-13T18:45:59.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.637+0000 7f3cd4a00640 1 -- 172.21.15.192:0/332254634 wait complete. 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.639+0000 7f3cd4a00640 1 Processor -- start 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.639+0000 7f3cd4a00640 1 -- start start 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cd015dee0 0x7f3cd01f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00a9b10 0x7f3cd00add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00b0650 con 0x7f3cd015e2c0 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00aaea0 con 0x7f3cd015dee0 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cd4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd0136be0 con 0x7f3cd00a9b10 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38216/0 (socket says 172.21.15.192:38216) 2024-09-13T18:45:59.644 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 -- 172.21.15.192:0/1738893120 learned_addr learned my addr 172.21.15.192:0/1738893120 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3ccde00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cd015dee0 0x7f3cd01f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cce800640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00a9b10 0x7f3cd00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 -- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00a9b10 msgr2=0x7f3cd00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00a9b10 0x7f3cd00add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 -- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cd015dee0 msgr2=0x7f3cd01f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.640+0000 7f3cc5400640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cd015dee0 0x7f3cd01f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cc5400640 1 -- 172.21.15.192:0/1738893120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009b30 con 0x7f3cd015e2c0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cc5400640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d5d0 tx=0x7f3cb800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb80125f0 con 0x7f3cd015e2c0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb8012770 con 0x7f3cd015e2c0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb8012b20 con 0x7f3cd015e2c0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd00aa0e0 con 0x7f3cd015e2c0 2024-09-13T18:45:59.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.641+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd00aa6a0 con 0x7f3cd015e2c0 2024-09-13T18:45:59.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.642+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd0067490 con 0x7f3cd015e2c0 2024-09-13T18:45:59.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.643+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3cb8012c80 con 0x7f3cd015e2c0 2024-09-13T18:45:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.644+0000 7f3cc6a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 0x7f3cac06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:45:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.644+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3cb80896b0 con 0x7f3cd015e2c0 2024-09-13T18:45:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.644+0000 7f3ccde00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 0x7f3cac06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:45:59.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.645+0000 7f3ccde00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 0x7f3cac06d0f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00ce120 tx=0x7f3cc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:45:59.650 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.648+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3cb80549d0 con 0x7f3cd015e2c0 2024-09-13T18:45:59.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.811+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3cd015a440 con 0x7f3cac06ac30 2024-09-13T18:45:59.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.819+0000 7f3cc6a00640 1 -- 172.21.15.192:0/1738893120 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284907 (secure 0 0 0) 0x7f3cd015a440 con 0x7f3cac06ac30 2024-09-13T18:45:59.825 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:45:59.826 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 msgr2=0x7f3cac06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 0x7f3cac06d0f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00ce120 tx=0x7f3cc0008040 comp rx=0 tx=0).stop 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 msgr2=0x7f3cd00ad810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3cb800d5d0 tx=0x7f3cb800da90 comp rx=0 tx=0).stop 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 shutdown_connections 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3cac06ac30 0x7f3cac06d0f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3cd00a9b10 0x7f3cd00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3cd015e2c0 0x7f3cd00ad810 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 --2- 172.21.15.192:0/1738893120 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3cd015dee0 0x7f3cd01f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:45:59.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 >> 172.21.15.192:0/1738893120 conn(0x7f3cd00ae960 msgr2=0x7f3cd0136290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:45:59.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 shutdown_connections 2024-09-13T18:45:59.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:45:59.823+0000 7f3cd4a00640 1 -- 172.21.15.192:0/1738893120 wait complete. 2024-09-13T18:45:59.841 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T18:45:58.874687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553460,"statfs":{"total":1600000000,"available":1590743296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396870"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897776+0000","last_change":"2024-09-13T18:45:54.901750+0000","last_active":"2024-09-13T18:45:55.897776+0000","last_peered":"2024-09-13T18:45:55.897776+0000","last_clean":"2024-09-13T18:45:55.897776+0000","last_became_active":"2024-09-13T18:45:54.901533+0000","last_became_peered":"2024-09-13T18:45:54.901533+0000","last_unstale":"2024-09-13T18:45:55.897776+0000","last_undegraded":"2024-09-13T18:45:55.897776+0000","last_fullsized":"2024-09-13T18:45:55.897776+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.183202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010599+0000","last_change":"2024-09-13T18:45:54.902052+0000","last_active":"2024-09-13T18:45:56.010599+0000","last_peered":"2024-09-13T18:45:56.010599+0000","last_clean":"2024-09-13T18:45:56.010599+0000","last_became_active":"2024-09-13T18:45:54.901778+0000","last_became_peered":"2024-09-13T18:45:54.901778+0000","last_unstale":"2024-09-13T18:45:56.010599+0000","last_undegraded":"2024-09-13T18:45:56.010599+0000","last_fullsized":"2024-09-13T18:45:56.010599+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:43.473451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010448+0000","last_change":"2024-09-13T18:45:54.912065+0000","last_active":"2024-09-13T18:45:56.010448+0000","last_peered":"2024-09-13T18:45:56.010448+0000","last_clean":"2024-09-13T18:45:56.010448+0000","last_became_active":"2024-09-13T18:45:54.909940+0000","last_became_peered":"2024-09-13T18:45:54.909940+0000","last_unstale":"2024-09-13T18:45:56.010448+0000","last_undegraded":"2024-09-13T18:45:56.010448+0000","last_fullsized":"2024-09-13T18:45:56.010448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:47.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898616+0000","last_change":"2024-09-13T18:45:54.910427+0000","last_active":"2024-09-13T18:45:55.898616+0000","last_peered":"2024-09-13T18:45:55.898616+0000","last_clean":"2024-09-13T18:45:55.898616+0000","last_became_active":"2024-09-13T18:45:54.910087+0000","last_became_peered":"2024-09-13T18:45:54.910087+0000","last_unstale":"2024-09-13T18:45:55.898616+0000","last_undegraded":"2024-09-13T18:45:55.898616+0000","last_fullsized":"2024-09-13T18:45:55.898616+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:27.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011663+0000","last_change":"2024-09-13T18:45:54.910009+0000","last_active":"2024-09-13T18:45:56.011663+0000","last_peered":"2024-09-13T18:45:56.011663+0000","last_clean":"2024-09-13T18:45:56.011663+0000","last_became_active":"2024-09-13T18:45:54.909801+0000","last_became_peered":"2024-09-13T18:45:54.909801+0000","last_unstale":"2024-09-13T18:45:56.011663+0000","last_undegraded":"2024-09-13T18:45:56.011663+0000","last_fullsized":"2024-09-13T18:45:56.011663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:36.347672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011555+0000","last_change":"2024-09-13T18:45:54.911923+0000","last_active":"2024-09-13T18:45:56.011555+0000","last_peered":"2024-09-13T18:45:56.011555+0000","last_clean":"2024-09-13T18:45:56.011555+0000","last_became_active":"2024-09-13T18:45:54.911356+0000","last_became_peered":"2024-09-13T18:45:54.911356+0000","last_unstale":"2024-09-13T18:45:56.011555+0000","last_undegraded":"2024-09-13T18:45:56.011555+0000","last_fullsized":"2024-09-13T18:45:56.011555+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487850+0000","last_change":"2024-09-13T18:45:54.487850+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487850+0000","last_undegraded":"2024-09-13T18:45:54.487850+0000","last_fullsized":"2024-09-13T18:45:54.487850+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897854+0000","last_change":"2024-09-13T18:45:54.907913+0000","last_active":"2024-09-13T18:45:55.897854+0000","last_peered":"2024-09-13T18:45:55.897854+0000","last_clean":"2024-09-13T18:45:55.897854+0000","last_became_active":"2024-09-13T18:45:54.906386+0000","last_became_peered":"2024-09-13T18:45:54.906386+0000","last_unstale":"2024-09-13T18:45:55.897854+0000","last_undegraded":"2024-09-13T18:45:55.897854+0000","last_fullsized":"2024-09-13T18:45:55.897854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.005604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011137+0000","last_change":"2024-09-13T18:45:54.905215+0000","last_active":"2024-09-13T18:45:56.011137+0000","last_peered":"2024-09-13T18:45:56.011137+0000","last_clean":"2024-09-13T18:45:56.011137+0000","last_became_active":"2024-09-13T18:45:54.904546+0000","last_became_peered":"2024-09-13T18:45:54.904546+0000","last_unstale":"2024-09-13T18:45:56.011137+0000","last_undegraded":"2024-09-13T18:45:56.011137+0000","last_fullsized":"2024-09-13T18:45:56.011137+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011337+0000","last_change":"2024-09-13T18:45:54.920649+0000","last_active":"2024-09-13T18:45:56.011337+0000","last_peered":"2024-09-13T18:45:56.011337+0000","last_clean":"2024-09-13T18:45:56.011337+0000","last_became_active":"2024-09-13T18:45:54.919304+0000","last_became_peered":"2024-09-13T18:45:54.919304+0000","last_unstale":"2024-09-13T18:45:56.011337+0000","last_undegraded":"2024-09-13T18:45:56.011337+0000","last_fullsized":"2024-09-13T18:45:56.011337+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:37.311809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011203+0000","last_change":"2024-09-13T18:45:54.905859+0000","last_active":"2024-09-13T18:45:56.011203+0000","last_peered":"2024-09-13T18:45:56.011203+0000","last_clean":"2024-09-13T18:45:56.011203+0000","last_became_active":"2024-09-13T18:45:54.905045+0000","last_became_peered":"2024-09-13T18:45:54.905045+0000","last_unstale":"2024-09-13T18:45:56.011203+0000","last_undegraded":"2024-09-13T18:45:56.011203+0000","last_fullsized":"2024-09-13T18:45:56.011203+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010854+0000","last_change":"2024-09-13T18:45:54.916941+0000","last_active":"2024-09-13T18:45:56.010854+0000","last_peered":"2024-09-13T18:45:56.010854+0000","last_clean":"2024-09-13T18:45:56.010854+0000","last_became_active":"2024-09-13T18:45:54.916473+0000","last_became_peered":"2024-09-13T18:45:54.916473+0000","last_unstale":"2024-09-13T18:45:56.010854+0000","last_undegraded":"2024-09-13T18:45:56.010854+0000","last_fullsized":"2024-09-13T18:45:56.010854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010195+0000","last_change":"2024-09-13T18:45:54.909427+0000","last_active":"2024-09-13T18:45:56.010195+0000","last_peered":"2024-09-13T18:45:56.010195+0000","last_clean":"2024-09-13T18:45:56.010195+0000","last_became_active":"2024-09-13T18:45:54.909217+0000","last_became_peered":"2024-09-13T18:45:54.909217+0000","last_unstale":"2024-09-13T18:45:56.010195+0000","last_undegraded":"2024-09-13T18:45:56.010195+0000","last_fullsized":"2024-09-13T18:45:56.010195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:38.177689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010199+0000","last_change":"2024-09-13T18:45:54.906851+0000","last_active":"2024-09-13T18:45:56.010199+0000","last_peered":"2024-09-13T18:45:56.010199+0000","last_clean":"2024-09-13T18:45:56.010199+0000","last_became_active":"2024-09-13T18:45:54.906648+0000","last_became_peered":"2024-09-13T18:45:54.906648+0000","last_unstale":"2024-09-13T18:45:56.010199+0000","last_undegraded":"2024-09-13T18:45:56.010199+0000","last_fullsized":"2024-09-13T18:45:56.010199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011707+0000","last_change":"2024-09-13T18:45:54.908866+0000","last_active":"2024-09-13T18:45:56.011707+0000","last_peered":"2024-09-13T18:45:56.011707+0000","last_clean":"2024-09-13T18:45:56.011707+0000","last_became_active":"2024-09-13T18:45:54.908632+0000","last_became_peered":"2024-09-13T18:45:54.908632+0000","last_unstale":"2024-09-13T18:45:56.011707+0000","last_undegraded":"2024-09-13T18:45:56.011707+0000","last_fullsized":"2024-09-13T18:45:56.011707+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.121006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.488730+0000","last_change":"2024-09-13T18:45:54.488730+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.488730+0000","last_undegraded":"2024-09-13T18:45:54.488730+0000","last_fullsized":"2024-09-13T18:45:54.488730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010405+0000","last_change":"2024-09-13T18:45:54.918944+0000","last_active":"2024-09-13T18:45:56.010405+0000","last_peered":"2024-09-13T18:45:56.010405+0000","last_clean":"2024-09-13T18:45:56.010405+0000","last_became_active":"2024-09-13T18:45:54.917581+0000","last_became_peered":"2024-09-13T18:45:54.917581+0000","last_unstale":"2024-09-13T18:45:56.010405+0000","last_undegraded":"2024-09-13T18:45:56.010405+0000","last_fullsized":"2024-09-13T18:45:56.010405+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010281+0000","last_change":"2024-09-13T18:45:54.905549+0000","last_active":"2024-09-13T18:45:56.010281+0000","last_peered":"2024-09-13T18:45:56.010281+0000","last_clean":"2024-09-13T18:45:56.010281+0000","last_became_active":"2024-09-13T18:45:54.905342+0000","last_became_peered":"2024-09-13T18:45:54.905342+0000","last_unstale":"2024-09-13T18:45:56.010281+0000","last_undegraded":"2024-09-13T18:45:56.010281+0000","last_fullsized":"2024-09-13T18:45:56.010281+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:01.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898360+0000","last_change":"2024-09-13T18:45:54.902557+0000","last_active":"2024-09-13T18:45:55.898360+0000","last_peered":"2024-09-13T18:45:55.898360+0000","last_clean":"2024-09-13T18:45:55.898360+0000","last_became_active":"2024-09-13T18:45:54.902298+0000","last_became_peered":"2024-09-13T18:45:54.902298+0000","last_unstale":"2024-09-13T18:45:55.898360+0000","last_undegraded":"2024-09-13T18:45:55.898360+0000","last_fullsized":"2024-09-13T18:45:55.898360+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.144087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897970+0000","last_change":"2024-09-13T18:45:54.906737+0000","last_active":"2024-09-13T18:45:55.897970+0000","last_peered":"2024-09-13T18:45:55.897970+0000","last_clean":"2024-09-13T18:45:55.897970+0000","last_became_active":"2024-09-13T18:45:54.905140+0000","last_became_peered":"2024-09-13T18:45:54.905140+0000","last_unstale":"2024-09-13T18:45:55.897970+0000","last_undegraded":"2024-09-13T18:45:55.897970+0000","last_fullsized":"2024-09-13T18:45:55.897970+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:09.859640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010935+0000","last_change":"2024-09-13T18:45:54.920838+0000","last_active":"2024-09-13T18:45:56.010935+0000","last_peered":"2024-09-13T18:45:56.010935+0000","last_clean":"2024-09-13T18:45:56.010935+0000","last_became_active":"2024-09-13T18:45:54.920389+0000","last_became_peered":"2024-09-13T18:45:54.920389+0000","last_unstale":"2024-09-13T18:45:56.010935+0000","last_undegraded":"2024-09-13T18:45:56.010935+0000","last_fullsized":"2024-09-13T18:45:56.010935+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:04.690253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010936+0000","last_change":"2024-09-13T18:45:54.913459+0000","last_active":"2024-09-13T18:45:56.010936+0000","last_peered":"2024-09-13T18:45:56.010936+0000","last_clean":"2024-09-13T18:45:56.010936+0000","last_became_active":"2024-09-13T18:45:54.911505+0000","last_became_peered":"2024-09-13T18:45:54.911505+0000","last_unstale":"2024-09-13T18:45:56.010936+0000","last_undegraded":"2024-09-13T18:45:56.010936+0000","last_fullsized":"2024-09-13T18:45:56.010936+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898627+0000","last_change":"2024-09-13T18:45:54.905226+0000","last_active":"2024-09-13T18:45:55.898627+0000","last_peered":"2024-09-13T18:45:55.898627+0000","last_clean":"2024-09-13T18:45:55.898627+0000","last_became_active":"2024-09-13T18:45:54.904669+0000","last_became_peered":"2024-09-13T18:45:54.904669+0000","last_unstale":"2024-09-13T18:45:55.898627+0000","last_undegraded":"2024-09-13T18:45:55.898627+0000","last_fullsized":"2024-09-13T18:45:55.898627+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:06.638083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.009933+0000","last_change":"2024-09-13T18:45:54.916788+0000","last_active":"2024-09-13T18:45:56.009933+0000","last_peered":"2024-09-13T18:45:56.009933+0000","last_clean":"2024-09-13T18:45:56.009933+0000","last_became_active":"2024-09-13T18:45:54.916454+0000","last_became_peered":"2024-09-13T18:45:54.916454+0000","last_unstale":"2024-09-13T18:45:56.009933+0000","last_undegraded":"2024-09-13T18:45:56.009933+0000","last_fullsized":"2024-09-13T18:45:56.009933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:17.455557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010997+0000","last_change":"2024-09-13T18:45:54.907911+0000","last_active":"2024-09-13T18:45:56.010997+0000","last_peered":"2024-09-13T18:45:56.010997+0000","last_clean":"2024-09-13T18:45:56.010997+0000","last_became_active":"2024-09-13T18:45:54.907654+0000","last_became_peered":"2024-09-13T18:45:54.907654+0000","last_unstale":"2024-09-13T18:45:56.010997+0000","last_undegraded":"2024-09-13T18:45:56.010997+0000","last_fullsized":"2024-09-13T18:45:56.010997+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:57.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897669+0000","last_change":"2024-09-13T18:45:54.904016+0000","last_active":"2024-09-13T18:45:55.897669+0000","last_peered":"2024-09-13T18:45:55.897669+0000","last_clean":"2024-09-13T18:45:55.897669+0000","last_became_active":"2024-09-13T18:45:54.903783+0000","last_became_peered":"2024-09-13T18:45:54.903783+0000","last_unstale":"2024-09-13T18:45:55.897669+0000","last_undegraded":"2024-09-13T18:45:55.897669+0000","last_fullsized":"2024-09-13T18:45:55.897669+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:51.133236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010717+0000","last_change":"2024-09-13T18:45:54.907422+0000","last_active":"2024-09-13T18:45:56.010717+0000","last_peered":"2024-09-13T18:45:56.010717+0000","last_clean":"2024-09-13T18:45:56.010717+0000","last_became_active":"2024-09-13T18:45:54.907213+0000","last_became_peered":"2024-09-13T18:45:54.907213+0000","last_unstale":"2024-09-13T18:45:56.010717+0000","last_undegraded":"2024-09-13T18:45:56.010717+0000","last_fullsized":"2024-09-13T18:45:56.010717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:34.474938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010677+0000","last_change":"2024-09-13T18:45:54.902283+0000","last_active":"2024-09-13T18:45:56.010677+0000","last_peered":"2024-09-13T18:45:56.010677+0000","last_clean":"2024-09-13T18:45:56.010677+0000","last_became_active":"2024-09-13T18:45:54.901696+0000","last_became_peered":"2024-09-13T18:45:54.901696+0000","last_unstale":"2024-09-13T18:45:56.010677+0000","last_undegraded":"2024-09-13T18:45:56.010677+0000","last_fullsized":"2024-09-13T18:45:56.010677+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:07.263140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898174+0000","last_change":"2024-09-13T18:45:54.911220+0000","last_active":"2024-09-13T18:45:55.898174+0000","last_peered":"2024-09-13T18:45:55.898174+0000","last_clean":"2024-09-13T18:45:55.898174+0000","last_became_active":"2024-09-13T18:45:54.910394+0000","last_became_peered":"2024-09-13T18:45:54.910394+0000","last_unstale":"2024-09-13T18:45:55.898174+0000","last_undegraded":"2024-09-13T18:45:55.898174+0000","last_fullsized":"2024-09-13T18:45:55.898174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:51.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010800+0000","last_change":"2024-09-13T18:45:54.910226+0000","last_active":"2024-09-13T18:45:56.010800+0000","last_peered":"2024-09-13T18:45:56.010800+0000","last_clean":"2024-09-13T18:45:56.010800+0000","last_became_active":"2024-09-13T18:45:54.909900+0000","last_became_peered":"2024-09-13T18:45:54.909900+0000","last_unstale":"2024-09-13T18:45:56.010800+0000","last_undegraded":"2024-09-13T18:45:56.010800+0000","last_fullsized":"2024-09-13T18:45:56.010800+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010778+0000","last_change":"2024-09-13T18:45:54.906078+0000","last_active":"2024-09-13T18:45:56.010778+0000","last_peered":"2024-09-13T18:45:56.010778+0000","last_clean":"2024-09-13T18:45:56.010778+0000","last_became_active":"2024-09-13T18:45:54.905848+0000","last_became_peered":"2024-09-13T18:45:54.905848+0000","last_unstale":"2024-09-13T18:45:56.010778+0000","last_undegraded":"2024-09-13T18:45:56.010778+0000","last_fullsized":"2024-09-13T18:45:56.010778+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:00.941799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010831+0000","last_change":"2024-09-13T18:45:54.909954+0000","last_active":"2024-09-13T18:45:56.010831+0000","last_peered":"2024-09-13T18:45:56.010831+0000","last_clean":"2024-09-13T18:45:56.010831+0000","last_became_active":"2024-09-13T18:45:54.909730+0000","last_became_peered":"2024-09-13T18:45:54.909730+0000","last_unstale":"2024-09-13T18:45:56.010831+0000","last_undegraded":"2024-09-13T18:45:56.010831+0000","last_fullsized":"2024-09-13T18:45:56.010831+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:43.640922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010020+0000","last_change":"2024-09-13T18:45:54.916653+0000","last_active":"2024-09-13T18:45:56.010020+0000","last_peered":"2024-09-13T18:45:56.010020+0000","last_clean":"2024-09-13T18:45:56.010020+0000","last_became_active":"2024-09-13T18:45:54.916130+0000","last_became_peered":"2024-09-13T18:45:54.916130+0000","last_unstale":"2024-09-13T18:45:56.010020+0000","last_undegraded":"2024-09-13T18:45:56.010020+0000","last_fullsized":"2024-09-13T18:45:56.010020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:06.281655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"179'4","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921504+0000","last_change":"2024-09-13T18:45:54.496811+0000","last_active":"2024-09-13T18:45:54.921504+0000","last_peered":"2024-09-13T18:45:54.921504+0000","last_clean":"2024-09-13T18:45:54.921504+0000","last_became_active":"2024-09-13T18:45:54.496586+0000","last_became_peered":"2024-09-13T18:45:54.496586+0000","last_unstale":"2024-09-13T18:45:54.921504+0000","last_undegraded":"2024-09-13T18:45:54.921504+0000","last_fullsized":"2024-09-13T18:45:54.921504+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.492453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489531+0000","last_change":"2024-09-13T18:45:54.489531+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489531+0000","last_undegraded":"2024-09-13T18:45:54.489531+0000","last_fullsized":"2024-09-13T18:45:54.489531+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917380+0000","last_change":"2024-09-13T18:45:54.492450+0000","last_active":"2024-09-13T18:45:54.917380+0000","last_peered":"2024-09-13T18:45:54.917380+0000","last_clean":"2024-09-13T18:45:54.917380+0000","last_became_active":"2024-09-13T18:45:54.491715+0000","last_became_peered":"2024-09-13T18:45:54.491715+0000","last_unstale":"2024-09-13T18:45:54.917380+0000","last_undegraded":"2024-09-13T18:45:54.917380+0000","last_fullsized":"2024-09-13T18:45:54.917380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:37.803308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011301+0000","last_change":"2024-09-13T18:45:54.911792+0000","last_active":"2024-09-13T18:45:56.011301+0000","last_peered":"2024-09-13T18:45:56.011301+0000","last_clean":"2024-09-13T18:45:56.011301+0000","last_became_active":"2024-09-13T18:45:54.910953+0000","last_became_peered":"2024-09-13T18:45:54.910953+0000","last_unstale":"2024-09-13T18:45:56.011301+0000","last_undegraded":"2024-09-13T18:45:56.011301+0000","last_fullsized":"2024-09-13T18:45:56.011301+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918338+0000","last_change":"2024-09-13T18:45:54.495172+0000","last_active":"2024-09-13T18:45:54.918338+0000","last_peered":"2024-09-13T18:45:54.918338+0000","last_clean":"2024-09-13T18:45:54.918338+0000","last_became_active":"2024-09-13T18:45:54.494637+0000","last_became_peered":"2024-09-13T18:45:54.494637+0000","last_unstale":"2024-09-13T18:45:54.918338+0000","last_undegraded":"2024-09-13T18:45:54.918338+0000","last_fullsized":"2024-09-13T18:45:54.918338+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:28.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898980+0000","last_change":"2024-09-13T18:45:54.915501+0000","last_active":"2024-09-13T18:45:55.898980+0000","last_peered":"2024-09-13T18:45:55.898980+0000","last_clean":"2024-09-13T18:45:55.898980+0000","last_became_active":"2024-09-13T18:45:54.915141+0000","last_became_peered":"2024-09-13T18:45:54.915141+0000","last_unstale":"2024-09-13T18:45:55.898980+0000","last_undegraded":"2024-09-13T18:45:55.898980+0000","last_fullsized":"2024-09-13T18:45:55.898980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920696+0000","last_change":"2024-09-13T18:45:54.496083+0000","last_active":"2024-09-13T18:45:54.920696+0000","last_peered":"2024-09-13T18:45:54.920696+0000","last_clean":"2024-09-13T18:45:54.920696+0000","last_became_active":"2024-09-13T18:45:54.495784+0000","last_became_peered":"2024-09-13T18:45:54.495784+0000","last_unstale":"2024-09-13T18:45:54.920696+0000","last_undegraded":"2024-09-13T18:45:54.920696+0000","last_fullsized":"2024-09-13T18:45:54.920696+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:07.785392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010793+0000","last_change":"2024-09-13T18:45:54.907306+0000","last_active":"2024-09-13T18:45:56.010793+0000","last_peered":"2024-09-13T18:45:56.010793+0000","last_clean":"2024-09-13T18:45:56.010793+0000","last_became_active":"2024-09-13T18:45:54.907088+0000","last_became_peered":"2024-09-13T18:45:54.907088+0000","last_unstale":"2024-09-13T18:45:56.010793+0000","last_undegraded":"2024-09-13T18:45:56.010793+0000","last_fullsized":"2024-09-13T18:45:56.010793+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.319805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919010+0000","last_change":"2024-09-13T18:45:54.486281+0000","last_active":"2024-09-13T18:45:54.919010+0000","last_peered":"2024-09-13T18:45:54.919010+0000","last_clean":"2024-09-13T18:45:54.919010+0000","last_became_active":"2024-09-13T18:45:54.485730+0000","last_became_peered":"2024-09-13T18:45:54.485730+0000","last_unstale":"2024-09-13T18:45:54.919010+0000","last_undegraded":"2024-09-13T18:45:54.919010+0000","last_fullsized":"2024-09-13T18:45:54.919010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.176678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898569+0000","last_change":"2024-09-13T18:45:54.914232+0000","last_active":"2024-09-13T18:45:55.898569+0000","last_peered":"2024-09-13T18:45:55.898569+0000","last_clean":"2024-09-13T18:45:55.898569+0000","last_became_active":"2024-09-13T18:45:54.913955+0000","last_became_peered":"2024-09-13T18:45:54.913955+0000","last_unstale":"2024-09-13T18:45:55.898569+0000","last_undegraded":"2024-09-13T18:45:55.898569+0000","last_fullsized":"2024-09-13T18:45:55.898569+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920875+0000","last_change":"2024-09-13T18:45:54.494883+0000","last_active":"2024-09-13T18:45:54.920875+0000","last_peered":"2024-09-13T18:45:54.920875+0000","last_clean":"2024-09-13T18:45:54.920875+0000","last_became_active":"2024-09-13T18:45:54.494664+0000","last_became_peered":"2024-09-13T18:45:54.494664+0000","last_unstale":"2024-09-13T18:45:54.920875+0000","last_undegraded":"2024-09-13T18:45:54.920875+0000","last_fullsized":"2024-09-13T18:45:54.920875+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:34.997445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011108+0000","last_change":"2024-09-13T18:45:54.912604+0000","last_active":"2024-09-13T18:45:56.011108+0000","last_peered":"2024-09-13T18:45:56.011108+0000","last_clean":"2024-09-13T18:45:56.011108+0000","last_became_active":"2024-09-13T18:45:54.912148+0000","last_became_peered":"2024-09-13T18:45:54.912148+0000","last_unstale":"2024-09-13T18:45:56.011108+0000","last_undegraded":"2024-09-13T18:45:56.011108+0000","last_fullsized":"2024-09-13T18:45:56.011108+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:07.339063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899755+0000","last_change":"2024-09-13T18:45:54.496659+0000","last_active":"2024-09-13T18:45:54.899755+0000","last_peered":"2024-09-13T18:45:54.899755+0000","last_clean":"2024-09-13T18:45:54.899755+0000","last_became_active":"2024-09-13T18:45:54.492022+0000","last_became_peered":"2024-09-13T18:45:54.492022+0000","last_unstale":"2024-09-13T18:45:54.899755+0000","last_undegraded":"2024-09-13T18:45:54.899755+0000","last_fullsized":"2024-09-13T18:45:54.899755+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:51.428747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898877+0000","last_change":"2024-09-13T18:45:54.902303+0000","last_active":"2024-09-13T18:45:55.898877+0000","last_peered":"2024-09-13T18:45:55.898877+0000","last_clean":"2024-09-13T18:45:55.898877+0000","last_became_active":"2024-09-13T18:45:54.901738+0000","last_became_peered":"2024-09-13T18:45:54.901738+0000","last_unstale":"2024-09-13T18:45:55.898877+0000","last_undegraded":"2024-09-13T18:45:55.898877+0000","last_fullsized":"2024-09-13T18:45:55.898877+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.908844+0000","last_change":"2024-09-13T18:45:54.495032+0000","last_active":"2024-09-13T18:45:54.908844+0000","last_peered":"2024-09-13T18:45:54.908844+0000","last_clean":"2024-09-13T18:45:54.908844+0000","last_became_active":"2024-09-13T18:45:54.494407+0000","last_became_peered":"2024-09-13T18:45:54.494407+0000","last_unstale":"2024-09-13T18:45:54.908844+0000","last_undegraded":"2024-09-13T18:45:54.908844+0000","last_fullsized":"2024-09-13T18:45:54.908844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:12.756996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898654+0000","last_change":"2024-09-13T18:45:54.907873+0000","last_active":"2024-09-13T18:45:55.898654+0000","last_peered":"2024-09-13T18:45:55.898654+0000","last_clean":"2024-09-13T18:45:55.898654+0000","last_became_active":"2024-09-13T18:45:54.906361+0000","last_became_peered":"2024-09-13T18:45:54.906361+0000","last_unstale":"2024-09-13T18:45:55.898654+0000","last_undegraded":"2024-09-13T18:45:55.898654+0000","last_fullsized":"2024-09-13T18:45:55.898654+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899665+0000","last_change":"2024-09-13T18:45:54.486090+0000","last_active":"2024-09-13T18:45:54.899665+0000","last_peered":"2024-09-13T18:45:54.899665+0000","last_clean":"2024-09-13T18:45:54.899665+0000","last_became_active":"2024-09-13T18:45:54.485779+0000","last_became_peered":"2024-09-13T18:45:54.485779+0000","last_unstale":"2024-09-13T18:45:54.899665+0000","last_undegraded":"2024-09-13T18:45:54.899665+0000","last_fullsized":"2024-09-13T18:45:54.899665+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:50.156625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010952+0000","last_change":"2024-09-13T18:45:54.911423+0000","last_active":"2024-09-13T18:45:56.010952+0000","last_peered":"2024-09-13T18:45:56.010952+0000","last_clean":"2024-09-13T18:45:56.010952+0000","last_became_active":"2024-09-13T18:45:54.910239+0000","last_became_peered":"2024-09-13T18:45:54.910239+0000","last_unstale":"2024-09-13T18:45:56.010952+0000","last_undegraded":"2024-09-13T18:45:56.010952+0000","last_fullsized":"2024-09-13T18:45:56.010952+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.903358+0000","last_change":"2024-09-13T18:45:54.491468+0000","last_active":"2024-09-13T18:45:54.903358+0000","last_peered":"2024-09-13T18:45:54.903358+0000","last_clean":"2024-09-13T18:45:54.903358+0000","last_became_active":"2024-09-13T18:45:54.491217+0000","last_became_peered":"2024-09-13T18:45:54.491217+0000","last_unstale":"2024-09-13T18:45:54.903358+0000","last_undegraded":"2024-09-13T18:45:54.903358+0000","last_fullsized":"2024-09-13T18:45:54.903358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:35.312903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489173+0000","last_change":"2024-09-13T18:45:54.489173+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489173+0000","last_undegraded":"2024-09-13T18:45:54.489173+0000","last_fullsized":"2024-09-13T18:45:54.489173+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498794+0000","last_change":"2024-09-13T18:45:54.498701+0000","last_active":"2024-09-13T18:45:54.498794+0000","last_peered":"2024-09-13T18:45:54.498794+0000","last_clean":"2024-09-13T18:45:54.498794+0000","last_became_active":"2024-09-13T18:45:54.498477+0000","last_became_peered":"2024-09-13T18:45:54.498477+0000","last_unstale":"2024-09-13T18:45:54.498794+0000","last_undegraded":"2024-09-13T18:45:54.498794+0000","last_fullsized":"2024-09-13T18:45:54.498794+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:05.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898904+0000","last_change":"2024-09-13T18:45:54.916063+0000","last_active":"2024-09-13T18:45:55.898904+0000","last_peered":"2024-09-13T18:45:55.898904+0000","last_clean":"2024-09-13T18:45:55.898904+0000","last_became_active":"2024-09-13T18:45:54.914695+0000","last_became_peered":"2024-09-13T18:45:54.914695+0000","last_unstale":"2024-09-13T18:45:55.898904+0000","last_undegraded":"2024-09-13T18:45:55.898904+0000","last_fullsized":"2024-09-13T18:45:55.898904+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920376+0000","last_change":"2024-09-13T18:45:54.494893+0000","last_active":"2024-09-13T18:45:54.920376+0000","last_peered":"2024-09-13T18:45:54.920376+0000","last_clean":"2024-09-13T18:45:54.920376+0000","last_became_active":"2024-09-13T18:45:54.494123+0000","last_became_peered":"2024-09-13T18:45:54.494123+0000","last_unstale":"2024-09-13T18:45:54.920376+0000","last_undegraded":"2024-09-13T18:45:54.920376+0000","last_fullsized":"2024-09-13T18:45:54.920376+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:14.459115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898103+0000","last_change":"2024-09-13T18:45:54.911463+0000","last_active":"2024-09-13T18:45:55.898103+0000","last_peered":"2024-09-13T18:45:55.898103+0000","last_clean":"2024-09-13T18:45:55.898103+0000","last_became_active":"2024-09-13T18:45:54.910682+0000","last_became_peered":"2024-09-13T18:45:54.910682+0000","last_unstale":"2024-09-13T18:45:55.898103+0000","last_undegraded":"2024-09-13T18:45:55.898103+0000","last_fullsized":"2024-09-13T18:45:55.898103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:21.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.905155+0000","last_change":"2024-09-13T18:45:54.495200+0000","last_active":"2024-09-13T18:45:54.905155+0000","last_peered":"2024-09-13T18:45:54.905155+0000","last_clean":"2024-09-13T18:45:54.905155+0000","last_became_active":"2024-09-13T18:45:54.494927+0000","last_became_peered":"2024-09-13T18:45:54.494927+0000","last_unstale":"2024-09-13T18:45:54.905155+0000","last_undegraded":"2024-09-13T18:45:54.905155+0000","last_fullsized":"2024-09-13T18:45:54.905155+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898942+0000","last_change":"2024-09-13T18:45:54.912225+0000","last_active":"2024-09-13T18:45:55.898942+0000","last_peered":"2024-09-13T18:45:55.898942+0000","last_clean":"2024-09-13T18:45:55.898942+0000","last_became_active":"2024-09-13T18:45:54.911697+0000","last_became_peered":"2024-09-13T18:45:54.911697+0000","last_unstale":"2024-09-13T18:45:55.898942+0000","last_undegraded":"2024-09-13T18:45:55.898942+0000","last_fullsized":"2024-09-13T18:45:55.898942+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901469+0000","last_change":"2024-09-13T18:45:54.496453+0000","last_active":"2024-09-13T18:45:54.901469+0000","last_peered":"2024-09-13T18:45:54.901469+0000","last_clean":"2024-09-13T18:45:54.901469+0000","last_became_active":"2024-09-13T18:45:54.496187+0000","last_became_peered":"2024-09-13T18:45:54.496187+0000","last_unstale":"2024-09-13T18:45:54.901469+0000","last_undegraded":"2024-09-13T18:45:54.901469+0000","last_fullsized":"2024-09-13T18:45:54.901469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:34.536434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898899+0000","last_change":"2024-09-13T18:45:54.908004+0000","last_active":"2024-09-13T18:45:55.898899+0000","last_peered":"2024-09-13T18:45:55.898899+0000","last_clean":"2024-09-13T18:45:55.898899+0000","last_became_active":"2024-09-13T18:45:54.906642+0000","last_became_peered":"2024-09-13T18:45:54.906642+0000","last_unstale":"2024-09-13T18:45:55.898899+0000","last_undegraded":"2024-09-13T18:45:55.898899+0000","last_fullsized":"2024-09-13T18:45:55.898899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:32.003975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"179'8","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920589+0000","last_change":"2024-09-13T18:45:54.493489+0000","last_active":"2024-09-13T18:45:54.920589+0000","last_peered":"2024-09-13T18:45:54.920589+0000","last_clean":"2024-09-13T18:45:54.920589+0000","last_became_active":"2024-09-13T18:45:54.493186+0000","last_became_peered":"2024-09-13T18:45:54.493186+0000","last_unstale":"2024-09-13T18:45:54.920589+0000","last_undegraded":"2024-09-13T18:45:54.920589+0000","last_fullsized":"2024-09-13T18:45:54.920589+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:22.461942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011749+0000","last_change":"2024-09-13T18:45:54.914777+0000","last_active":"2024-09-13T18:45:56.011749+0000","last_peered":"2024-09-13T18:45:56.011749+0000","last_clean":"2024-09-13T18:45:56.011749+0000","last_became_active":"2024-09-13T18:45:54.914406+0000","last_became_peered":"2024-09-13T18:45:54.914406+0000","last_unstale":"2024-09-13T18:45:56.011749+0000","last_undegraded":"2024-09-13T18:45:56.011749+0000","last_fullsized":"2024-09-13T18:45:56.011749+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:40.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917253+0000","last_change":"2024-09-13T18:45:54.487283+0000","last_active":"2024-09-13T18:45:54.917253+0000","last_peered":"2024-09-13T18:45:54.917253+0000","last_clean":"2024-09-13T18:45:54.917253+0000","last_became_active":"2024-09-13T18:45:54.487060+0000","last_became_peered":"2024-09-13T18:45:54.487060+0000","last_unstale":"2024-09-13T18:45:54.917253+0000","last_undegraded":"2024-09-13T18:45:54.917253+0000","last_fullsized":"2024-09-13T18:45:54.917253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.256698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011050+0000","last_change":"2024-09-13T18:45:54.906614+0000","last_active":"2024-09-13T18:45:56.011050+0000","last_peered":"2024-09-13T18:45:56.011050+0000","last_clean":"2024-09-13T18:45:56.011050+0000","last_became_active":"2024-09-13T18:45:54.906390+0000","last_became_peered":"2024-09-13T18:45:54.906390+0000","last_unstale":"2024-09-13T18:45:56.011050+0000","last_undegraded":"2024-09-13T18:45:56.011050+0000","last_fullsized":"2024-09-13T18:45:56.011050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:11.921047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920922+0000","last_change":"2024-09-13T18:45:54.497640+0000","last_active":"2024-09-13T18:45:54.920922+0000","last_peered":"2024-09-13T18:45:54.920922+0000","last_clean":"2024-09-13T18:45:54.920922+0000","last_became_active":"2024-09-13T18:45:54.497203+0000","last_became_peered":"2024-09-13T18:45:54.497203+0000","last_unstale":"2024-09-13T18:45:54.920922+0000","last_undegraded":"2024-09-13T18:45:54.920922+0000","last_fullsized":"2024-09-13T18:45:54.920922+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010525+0000","last_change":"2024-09-13T18:45:54.913515+0000","last_active":"2024-09-13T18:45:56.010525+0000","last_peered":"2024-09-13T18:45:56.010525+0000","last_clean":"2024-09-13T18:45:56.010525+0000","last_became_active":"2024-09-13T18:45:54.913313+0000","last_became_peered":"2024-09-13T18:45:54.913313+0000","last_unstale":"2024-09-13T18:45:56.010525+0000","last_undegraded":"2024-09-13T18:45:56.010525+0000","last_fullsized":"2024-09-13T18:45:56.010525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:22.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.493480+0000","last_change":"2024-09-13T18:45:54.493113+0000","last_active":"2024-09-13T18:45:54.493480+0000","last_peered":"2024-09-13T18:45:54.493480+0000","last_clean":"2024-09-13T18:45:54.493480+0000","last_became_active":"2024-09-13T18:45:54.492826+0000","last_became_peered":"2024-09-13T18:45:54.492826+0000","last_unstale":"2024-09-13T18:45:54.493480+0000","last_undegraded":"2024-09-13T18:45:54.493480+0000","last_fullsized":"2024-09-13T18:45:54.493480+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011394+0000","last_change":"2024-09-13T18:45:54.911578+0000","last_active":"2024-09-13T18:45:56.011394+0000","last_peered":"2024-09-13T18:45:56.011394+0000","last_clean":"2024-09-13T18:45:56.011394+0000","last_became_active":"2024-09-13T18:45:54.909430+0000","last_became_peered":"2024-09-13T18:45:54.909430+0000","last_unstale":"2024-09-13T18:45:56.011394+0000","last_undegraded":"2024-09-13T18:45:56.011394+0000","last_fullsized":"2024-09-13T18:45:56.011394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901562+0000","last_change":"2024-09-13T18:45:54.493581+0000","last_active":"2024-09-13T18:45:54.901562+0000","last_peered":"2024-09-13T18:45:54.901562+0000","last_clean":"2024-09-13T18:45:54.901562+0000","last_became_active":"2024-09-13T18:45:54.493031+0000","last_became_peered":"2024-09-13T18:45:54.493031+0000","last_unstale":"2024-09-13T18:45:54.901562+0000","last_undegraded":"2024-09-13T18:45:54.901562+0000","last_fullsized":"2024-09-13T18:45:54.901562+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:42.168271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010050+0000","last_change":"2024-09-13T18:45:54.909801+0000","last_active":"2024-09-13T18:45:56.010050+0000","last_peered":"2024-09-13T18:45:56.010050+0000","last_clean":"2024-09-13T18:45:56.010050+0000","last_became_active":"2024-09-13T18:45:54.909522+0000","last_became_peered":"2024-09-13T18:45:54.909522+0000","last_unstale":"2024-09-13T18:45:56.010050+0000","last_undegraded":"2024-09-13T18:45:56.010050+0000","last_fullsized":"2024-09-13T18:45:56.010050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918423+0000","last_change":"2024-09-13T18:45:54.496005+0000","last_active":"2024-09-13T18:45:54.918423+0000","last_peered":"2024-09-13T18:45:54.918423+0000","last_clean":"2024-09-13T18:45:54.918423+0000","last_became_active":"2024-09-13T18:45:54.495771+0000","last_became_peered":"2024-09-13T18:45:54.495771+0000","last_unstale":"2024-09-13T18:45:54.918423+0000","last_undegraded":"2024-09-13T18:45:54.918423+0000","last_fullsized":"2024-09-13T18:45:54.918423+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:11.480554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010891+0000","last_change":"2024-09-13T18:45:54.906015+0000","last_active":"2024-09-13T18:45:56.010891+0000","last_peered":"2024-09-13T18:45:56.010891+0000","last_clean":"2024-09-13T18:45:56.010891+0000","last_became_active":"2024-09-13T18:45:54.905438+0000","last_became_peered":"2024-09-13T18:45:54.905438+0000","last_unstale":"2024-09-13T18:45:56.010891+0000","last_undegraded":"2024-09-13T18:45:56.010891+0000","last_fullsized":"2024-09-13T18:45:56.010891+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:44.251416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.897723+0000","last_change":"2024-09-13T18:45:54.493010+0000","last_active":"2024-09-13T18:45:54.897723+0000","last_peered":"2024-09-13T18:45:54.897723+0000","last_clean":"2024-09-13T18:45:54.897723+0000","last_became_active":"2024-09-13T18:45:54.492789+0000","last_became_peered":"2024-09-13T18:45:54.492789+0000","last_unstale":"2024-09-13T18:45:54.897723+0000","last_undegraded":"2024-09-13T18:45:54.897723+0000","last_fullsized":"2024-09-13T18:45:54.897723+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:24.312031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011028+0000","last_change":"2024-09-13T18:45:54.909680+0000","last_active":"2024-09-13T18:45:56.011028+0000","last_peered":"2024-09-13T18:45:56.011028+0000","last_clean":"2024-09-13T18:45:56.011028+0000","last_became_active":"2024-09-13T18:45:54.908615+0000","last_became_peered":"2024-09-13T18:45:54.908615+0000","last_unstale":"2024-09-13T18:45:56.011028+0000","last_undegraded":"2024-09-13T18:45:56.011028+0000","last_fullsized":"2024-09-13T18:45:56.011028+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.898386+0000","last_change":"2024-09-13T18:45:54.484614+0000","last_active":"2024-09-13T18:45:54.898386+0000","last_peered":"2024-09-13T18:45:54.898386+0000","last_clean":"2024-09-13T18:45:54.898386+0000","last_became_active":"2024-09-13T18:45:54.484384+0000","last_became_peered":"2024-09-13T18:45:54.484384+0000","last_unstale":"2024-09-13T18:45:54.898386+0000","last_undegraded":"2024-09-13T18:45:54.898386+0000","last_fullsized":"2024-09-13T18:45:54.898386+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:42.467009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011162+0000","last_change":"2024-09-13T18:45:54.912416+0000","last_active":"2024-09-13T18:45:56.011162+0000","last_peered":"2024-09-13T18:45:56.011162+0000","last_clean":"2024-09-13T18:45:56.011162+0000","last_became_active":"2024-09-13T18:45:54.910464+0000","last_became_peered":"2024-09-13T18:45:54.910464+0000","last_unstale":"2024-09-13T18:45:56.011162+0000","last_undegraded":"2024-09-13T18:45:56.011162+0000","last_fullsized":"2024-09-13T18:45:56.011162+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:39.075198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899634+0000","last_change":"2024-09-13T18:45:54.492800+0000","last_active":"2024-09-13T18:45:54.899634+0000","last_peered":"2024-09-13T18:45:54.899634+0000","last_clean":"2024-09-13T18:45:54.899634+0000","last_became_active":"2024-09-13T18:45:54.492257+0000","last_became_peered":"2024-09-13T18:45:54.492257+0000","last_unstale":"2024-09-13T18:45:54.899634+0000","last_undegraded":"2024-09-13T18:45:54.899634+0000","last_fullsized":"2024-09-13T18:45:54.899634+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:21.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899051+0000","last_change":"2024-09-13T18:45:54.912376+0000","last_active":"2024-09-13T18:45:55.899051+0000","last_peered":"2024-09-13T18:45:55.899051+0000","last_clean":"2024-09-13T18:45:55.899051+0000","last_became_active":"2024-09-13T18:45:54.911994+0000","last_became_peered":"2024-09-13T18:45:54.911994+0000","last_unstale":"2024-09-13T18:45:55.899051+0000","last_undegraded":"2024-09-13T18:45:55.899051+0000","last_fullsized":"2024-09-13T18:45:55.899051+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919785+0000","last_change":"2024-09-13T18:45:54.486957+0000","last_active":"2024-09-13T18:45:54.919785+0000","last_peered":"2024-09-13T18:45:54.919785+0000","last_clean":"2024-09-13T18:45:54.919785+0000","last_became_active":"2024-09-13T18:45:54.486740+0000","last_became_peered":"2024-09-13T18:45:54.486740+0000","last_unstale":"2024-09-13T18:45:54.919785+0000","last_undegraded":"2024-09-13T18:45:54.919785+0000","last_fullsized":"2024-09-13T18:45:54.919785+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:28.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899048+0000","last_change":"2024-09-13T18:45:54.911748+0000","last_active":"2024-09-13T18:45:55.899048+0000","last_peered":"2024-09-13T18:45:55.899048+0000","last_clean":"2024-09-13T18:45:55.899048+0000","last_became_active":"2024-09-13T18:45:54.911536+0000","last_became_peered":"2024-09-13T18:45:54.911536+0000","last_unstale":"2024-09-13T18:45:55.899048+0000","last_undegraded":"2024-09-13T18:45:55.899048+0000","last_fullsized":"2024-09-13T18:45:55.899048+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899403+0000","last_change":"2024-09-13T18:45:54.493256+0000","last_active":"2024-09-13T18:45:54.899403+0000","last_peered":"2024-09-13T18:45:54.899403+0000","last_clean":"2024-09-13T18:45:54.899403+0000","last_became_active":"2024-09-13T18:45:54.492757+0000","last_became_peered":"2024-09-13T18:45:54.492757+0000","last_unstale":"2024-09-13T18:45:54.899403+0000","last_undegraded":"2024-09-13T18:45:54.899403+0000","last_fullsized":"2024-09-13T18:45:54.899403+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:01.290718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898201+0000","last_change":"2024-09-13T18:45:54.906596+0000","last_active":"2024-09-13T18:45:55.898201+0000","last_peered":"2024-09-13T18:45:55.898201+0000","last_clean":"2024-09-13T18:45:55.898201+0000","last_became_active":"2024-09-13T18:45:54.904819+0000","last_became_peered":"2024-09-13T18:45:54.904819+0000","last_unstale":"2024-09-13T18:45:55.898201+0000","last_undegraded":"2024-09-13T18:45:55.898201+0000","last_fullsized":"2024-09-13T18:45:55.898201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:37.224895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498264+0000","last_change":"2024-09-13T18:45:54.498180+0000","last_active":"2024-09-13T18:45:54.498264+0000","last_peered":"2024-09-13T18:45:54.498264+0000","last_clean":"2024-09-13T18:45:54.498264+0000","last_became_active":"2024-09-13T18:45:54.497907+0000","last_became_peered":"2024-09-13T18:45:54.497907+0000","last_unstale":"2024-09-13T18:45:54.498264+0000","last_undegraded":"2024-09-13T18:45:54.498264+0000","last_fullsized":"2024-09-13T18:45:54.498264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:26.217332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898271+0000","last_change":"2024-09-13T18:45:54.900842+0000","last_active":"2024-09-13T18:45:55.898271+0000","last_peered":"2024-09-13T18:45:55.898271+0000","last_clean":"2024-09-13T18:45:55.898271+0000","last_became_active":"2024-09-13T18:45:54.900605+0000","last_became_peered":"2024-09-13T18:45:54.900605+0000","last_unstale":"2024-09-13T18:45:55.898271+0000","last_undegraded":"2024-09-13T18:45:55.898271+0000","last_fullsized":"2024-09-13T18:45:55.898271+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:40.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.495630+0000","last_change":"2024-09-13T18:45:54.495093+0000","last_active":"2024-09-13T18:45:54.495630+0000","last_peered":"2024-09-13T18:45:54.495630+0000","last_clean":"2024-09-13T18:45:54.495630+0000","last_became_active":"2024-09-13T18:45:54.494822+0000","last_became_peered":"2024-09-13T18:45:54.494822+0000","last_unstale":"2024-09-13T18:45:54.495630+0000","last_undegraded":"2024-09-13T18:45:54.495630+0000","last_fullsized":"2024-09-13T18:45:54.495630+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487336+0000","last_change":"2024-09-13T18:45:54.487336+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487336+0000","last_undegraded":"2024-09-13T18:45:54.487336+0000","last_fullsized":"2024-09-13T18:45:54.487336+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901165+0000","last_change":"2024-09-13T18:45:54.493395+0000","last_active":"2024-09-13T18:45:54.901165+0000","last_peered":"2024-09-13T18:45:54.901165+0000","last_clean":"2024-09-13T18:45:54.901165+0000","last_became_active":"2024-09-13T18:45:54.493125+0000","last_became_peered":"2024-09-13T18:45:54.493125+0000","last_unstale":"2024-09-13T18:45:54.901165+0000","last_undegraded":"2024-09-13T18:45:54.901165+0000","last_fullsized":"2024-09-13T18:45:54.901165+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:59.567811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898992+0000","last_change":"2024-09-13T18:45:54.910921+0000","last_active":"2024-09-13T18:45:55.898992+0000","last_peered":"2024-09-13T18:45:55.898992+0000","last_clean":"2024-09-13T18:45:55.898992+0000","last_became_active":"2024-09-13T18:45:54.909213+0000","last_became_peered":"2024-09-13T18:45:54.909213+0000","last_unstale":"2024-09-13T18:45:55.898992+0000","last_undegraded":"2024-09-13T18:45:55.898992+0000","last_fullsized":"2024-09-13T18:45:55.898992+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:19.183121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904368+0000","last_change":"2024-09-13T18:45:54.490731+0000","last_active":"2024-09-13T18:45:54.904368+0000","last_peered":"2024-09-13T18:45:54.904368+0000","last_clean":"2024-09-13T18:45:54.904368+0000","last_became_active":"2024-09-13T18:45:54.490352+0000","last_became_peered":"2024-09-13T18:45:54.490352+0000","last_unstale":"2024-09-13T18:45:54.904368+0000","last_undegraded":"2024-09-13T18:45:54.904368+0000","last_fullsized":"2024-09-13T18:45:54.904368+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:21.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898977+0000","last_change":"2024-09-13T18:45:54.902428+0000","last_active":"2024-09-13T18:45:55.898977+0000","last_peered":"2024-09-13T18:45:55.898977+0000","last_clean":"2024-09-13T18:45:55.898977+0000","last_became_active":"2024-09-13T18:45:54.902083+0000","last_became_peered":"2024-09-13T18:45:54.902083+0000","last_unstale":"2024-09-13T18:45:55.898977+0000","last_undegraded":"2024-09-13T18:45:55.898977+0000","last_fullsized":"2024-09-13T18:45:55.898977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902720+0000","last_change":"2024-09-13T18:45:54.491923+0000","last_active":"2024-09-13T18:45:54.902720+0000","last_peered":"2024-09-13T18:45:54.902720+0000","last_clean":"2024-09-13T18:45:54.902720+0000","last_became_active":"2024-09-13T18:45:54.491706+0000","last_became_peered":"2024-09-13T18:45:54.491706+0000","last_unstale":"2024-09-13T18:45:54.902720+0000","last_undegraded":"2024-09-13T18:45:54.902720+0000","last_fullsized":"2024-09-13T18:45:54.902720+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:14.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010210+0000","last_change":"2024-09-13T18:45:54.912208+0000","last_active":"2024-09-13T18:45:56.010210+0000","last_peered":"2024-09-13T18:45:56.010210+0000","last_clean":"2024-09-13T18:45:56.010210+0000","last_became_active":"2024-09-13T18:45:54.911794+0000","last_became_peered":"2024-09-13T18:45:54.911794+0000","last_unstale":"2024-09-13T18:45:56.010210+0000","last_undegraded":"2024-09-13T18:45:56.010210+0000","last_fullsized":"2024-09-13T18:45:56.010210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:02.923713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899848+0000","last_change":"2024-09-13T18:45:54.492315+0000","last_active":"2024-09-13T18:45:54.899848+0000","last_peered":"2024-09-13T18:45:54.899848+0000","last_clean":"2024-09-13T18:45:54.899848+0000","last_became_active":"2024-09-13T18:45:54.491338+0000","last_became_peered":"2024-09-13T18:45:54.491338+0000","last_unstale":"2024-09-13T18:45:54.899848+0000","last_undegraded":"2024-09-13T18:45:54.899848+0000","last_fullsized":"2024-09-13T18:45:54.899848+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.194286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487402+0000","last_change":"2024-09-13T18:45:54.487402+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487402+0000","last_undegraded":"2024-09-13T18:45:54.487402+0000","last_fullsized":"2024-09-13T18:45:54.487402+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"179'3","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917211+0000","last_change":"2024-09-13T18:45:54.492742+0000","last_active":"2024-09-13T18:45:54.917211+0000","last_peered":"2024-09-13T18:45:54.917211+0000","last_clean":"2024-09-13T18:45:54.917211+0000","last_became_active":"2024-09-13T18:45:54.492518+0000","last_became_peered":"2024-09-13T18:45:54.492518+0000","last_unstale":"2024-09-13T18:45:54.917211+0000","last_undegraded":"2024-09-13T18:45:54.917211+0000","last_fullsized":"2024-09-13T18:45:54.917211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902626+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:45:54.902626+0000","last_peered":"2024-09-13T18:45:54.902626+0000","last_clean":"2024-09-13T18:45:54.902626+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:45:54.902626+0000","last_undegraded":"2024-09-13T18:45:54.902626+0000","last_fullsized":"2024-09-13T18:45:54.902626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52100000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.441},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69299999999999995,"15min":0.65800000000000003},"min":{"1min":0.51800000000000002,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":1.014},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":1.004,"15min":1.004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.999},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71199999999999997,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80600000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46999999999999997,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.755},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.371},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":1.143},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":1.125},"last":0.79700000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":1.665},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.57799999999999996,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80300000000000005,"5min":0.96799999999999997,"15min":1.591},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":2.2709999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.0680000000000001,"15min":2.169},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97199999999999998,"15min":1.4450000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.45000000000000001,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.0840000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.504,"5min":0.438,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.0289999999999999,"15min":1.115},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70499999999999996,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.02,"15min":6.4539999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.52700000000000002,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.94199999999999995,"15min":6.5019999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.96399999999999997,"15min":1.032},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.68000000000000005},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":0.97199999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.41499999999999998,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":0.96199999999999997,"15min":1.5509999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.403},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"max":{"1min":0.89300000000000002,"5min":0.97199999999999998,"15min":1.6040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194322,"statfs":{"total":200000000,"available":198986288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.57299999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":1.581,"15min":2.0579999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95099999999999996,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":1.5589999999999999,"15min":3.706},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":2.915,"15min":3.742},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.762,"15min":3.6909999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.40799999999999997},"max":{"1min":0.95999999999999996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.91700000000000004,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.94799999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53500000000000003,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.745},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":1.843,"15min":3.7989999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.94599999999999995,"5min":1.548,"15min":5.5069999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.72499999999999998},"min":{"1min":0.624,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.95999999999999996,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198987840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.64300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.74099999999999999,"5min":1.546,"15min":8.1059999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.81399999999999995,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.626},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":7.798},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.502,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.93899999999999995,"5min":1.0669999999999999,"15min":3.093},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.022,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.84599999999999997},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.105,"5min":1.105,"15min":8.0519999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.64600000000000002,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.499,"15min":0.505},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.327,"5min":1.423,"15min":1.423},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.095,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.45800000000000002},"max":{"1min":1.266,"5min":1.329,"15min":1.329},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.876}]},{"osd":7,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.198,"5min":1.508,"15min":1.508},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1564,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193748,"statfs":{"total":200000000,"available":198398018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":1.6000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69899999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.5,"5min":0.63300000000000001,"15min":1.036},"last":0.372},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.86499999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.64900000000000002,"5min":0.80600000000000005,"15min":1.1870000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.70499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.98099999999999998,"5min":1.3,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:44:54 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":1.242,"15min":1.242},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.86499999999999999,"5min":1.123,"15min":1.21},"last":0.745},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":1.0580000000000001,"15min":1.278},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.498,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.1830000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.76400000000000001},"min":{"1min":0.59699999999999998,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":0.94999999999999996,"5min":1.1399999999999999,"15min":1.1539999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60199999999999998,"5min":0.76700000000000002,"15min":1.669},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.499},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.591},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":0.63700000000000001,"5min":0.70899999999999996,"15min":1.03},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":1.637},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.044,"5min":1.21,"15min":1.21},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.038,"5min":1.056,"15min":1.698},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79100000000000004,"15min":0.76200000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.204},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2190000000000001,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.67400000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.155,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.60899999999999999,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.745,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.165,"15min":2.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77300000000000002,"15min":0.72299999999999998},"min":{"1min":0.65300000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:45:59.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2024-09-13T18:45:59.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.487850+0000', 'last_change': '2024-09-13T18:45:54.487850+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.487850+0000', 'last_undegraded': '2024-09-13T18:45:54.487850+0000', 'last_fullsized': '2024-09-13T18:45:54.487850+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.488730+0000', 'last_change': '2024-09-13T18:45:54.488730+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.488730+0000', 'last_undegraded': '2024-09-13T18:45:54.488730+0000', 'last_fullsized': '2024-09-13T18:45:54.488730+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.489531+0000', 'last_change': '2024-09-13T18:45:54.489531+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.489531+0000', 'last_undegraded': '2024-09-13T18:45:54.489531+0000', 'last_fullsized': '2024-09-13T18:45:54.489531+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.489173+0000', 'last_change': '2024-09-13T18:45:54.489173+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.489173+0000', 'last_undegraded': '2024-09-13T18:45:54.489173+0000', 'last_fullsized': '2024-09-13T18:45:54.489173+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.487336+0000', 'last_change': '2024-09-13T18:45:54.487336+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.487336+0000', 'last_undegraded': '2024-09-13T18:45:54.487336+0000', 'last_fullsized': '2024-09-13T18:45:54.487336+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2024-09-13T18:45:59.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 178, 'state': 'creating+peering', 'last_fresh': '2024-09-13T18:45:54.487402+0000', 'last_change': '2024-09-13T18:45:54.487402+0000', 'last_active': '2024-09-13T18:45:54.474303+0000', 'last_peered': '2024-09-13T18:45:54.474303+0000', 'last_clean': '2024-09-13T18:45:54.474303+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-13T18:45:54.487402+0000', 'last_undegraded': '2024-09-13T18:45:54.487402+0000', 'last_fullsized': '2024-09-13T18:45:54.487402+0000', 'mapping_epoch': 178, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 178, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'last_clean_scrub_stamp': '2024-09-13T18:45:54.474303+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-13T18:45:59.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-13T18:46:00.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.030+0000 7f9c7bc00640 1 Processor -- start 2024-09-13T18:46:00.033 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.030+0000 7f9c7bc00640 1 -- start start 2024-09-13T18:46:00.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c7bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9c740b3f10 0x7f9c7415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c7bc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740b2f00 con 0x7f9c740b0490 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c7bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740b3150 con 0x7f9c7415dee0 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c7bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c740b3430 con 0x7f9c740b3f10 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c79c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9c740b0490 0x7f9c7415a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:45114/0 (socket says 172.21.15.192:45114) 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c79c00640 1 -- 172.21.15.192:0/448714421 learned_addr learned my addr 172.21.15.192:0/448714421 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c6be00640 1 --2- 172.21.15.192:0/448714421 >> v2:172.21.15.192:3300/0 conn(0x7f9c740b3f10 0x7f9c7415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c6be00640 1 -- 172.21.15.192:0/448714421 >> v1:172.21.15.194:6789/0 conn(0x7f9c7415dee0 legacy=0x7f9c740afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.035 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.032+0000 7f9c6be00640 1 -- 172.21.15.192:0/448714421 >> v1:172.21.15.192:6789/0 conn(0x7f9c740b0490 legacy=0x7f9c7415a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.033+0000 7f9c6be00640 1 -- 172.21.15.192:0/448714421 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c740b3710 con 0x7f9c740b3f10 2024-09-13T18:46:00.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.033+0000 7f9c73e00640 1 -- 172.21.15.192:0/448714421 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3690283014 0 0) 0x7f9c740b2f00 con 0x7f9c740b0490 2024-09-13T18:46:00.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.033+0000 7f9c6be00640 1 --2- 172.21.15.192:0/448714421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c740b3f10 0x7f9c7415a440 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0097a0 tx=0x7f9c5c02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca131ea032700e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c73e00640 1 -- 172.21.15.192:0/448714421 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c032440 con 0x7f9c740b3f10 2024-09-13T18:46:00.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c73e00640 1 -- 172.21.15.192:0/448714421 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c0325a0 con 0x7f9c740b3f10 2024-09-13T18:46:00.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c73e00640 1 -- 172.21.15.192:0/448714421 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c032930 con 0x7f9c740b3f10 2024-09-13T18:46:00.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 -- 172.21.15.192:0/448714421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c740b3f10 msgr2=0x7f9c7415a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/448714421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c740b3f10 0x7f9c7415a440 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c0097a0 tx=0x7f9c5c02a230 comp rx=0 tx=0).stop 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 -- 172.21.15.192:0/448714421 shutdown_connections 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/448714421 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c740b3f10 0x7f9c7415a440 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 -- 172.21.15.192:0/448714421 >> 172.21.15.192:0/448714421 conn(0x7f9c740ae960 msgr2=0x7f9c7406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 -- 172.21.15.192:0/448714421 shutdown_connections 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.034+0000 7f9c7bc00640 1 -- 172.21.15.192:0/448714421 wait complete. 2024-09-13T18:46:00.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.036+0000 7f9c7bc00640 1 Processor -- start 2024-09-13T18:46:00.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.036+0000 7f9c7bc00640 1 -- start start 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 0x7f9c74136850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 0x7f9c74134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7413e0b0 con 0x7f9c7415dee0 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7413e390 con 0x7f9c74135740 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c7bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7413e670 con 0x7f9c740b0490 2024-09-13T18:46:00.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c6be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38234/0 (socket says 172.21.15.192:38234) 2024-09-13T18:46:00.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c6be00640 1 -- 172.21.15.192:0/1927704734 learned_addr learned my addr 172.21.15.192:0/1927704734 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:00.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c79200640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 0x7f9c74136850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.037+0000 7f9c79c00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 0x7f9c74134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 -- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 msgr2=0x7f9c74136850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 0x7f9c74136850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 -- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 msgr2=0x7f9c74134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 0x7f9c74134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 -- 172.21.15.192:0/1927704734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5c009400 con 0x7f9c7415dee0 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c79200640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 0x7f9c74136850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c79c00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 0x7f9c74134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c6be00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c000c00 tx=0x7f9c5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c030b80 con 0x7f9c7415dee0 2024-09-13T18:46:00.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5c030ce0 con 0x7f9c7415dee0 2024-09-13T18:46:00.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5c03d680 con 0x7f9c7415dee0 2024-09-13T18:46:00.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.038+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7413e950 con 0x7f9c7415dee0 2024-09-13T18:46:00.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.039+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7413ef10 con 0x7f9c7415dee0 2024-09-13T18:46:00.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.039+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c740afd80 con 0x7f9c7415dee0 2024-09-13T18:46:00.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.040+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9c5c039040 con 0x7f9c7415dee0 2024-09-13T18:46:00.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.041+0000 7f9c71600640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 0x7f9c5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.041+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c5c0a9fb0 con 0x7f9c7415dee0 2024-09-13T18:46:00.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.041+0000 7f9c79200640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 0x7f9c5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.042+0000 7f9c79200640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 0x7f9c5006d0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.045+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9c5c0751a0 con 0x7f9c7415dee0 2024-09-13T18:46:00.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.278+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9c74067410 con 0x7f9c7415dee0 2024-09-13T18:46:00.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.278+0000 7f9c71600640 1 -- 172.21.15.192:0/1927704734 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1096 (secure 0 0 0) 0x7f9c5c041460 con 0x7f9c7415dee0 2024-09-13T18:46:00.281 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:46:00.281 INFO:teuthology.orchestra.run.smithi192.stdout:{"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":638,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":180,"num_osds":8,"num_up_osds":8,"osd_up_since":1726252529,"num_in_osds":8,"osd_in_since":1726252524,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":91},{"state_name":"creating+peering","count":6}],"num_pgs":97,"num_pools":3,"num_objects":18,"data_bytes":591096,"bytes_used":9256704,"bytes_avail":1590743296,"bytes_total":1600000000,"inactive_pgs_ratio":0.061855670064687729,"write_bytes_sec":1897,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":78,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8586}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-13T18:44:24.852028+0000","services":{}},"progress_events":{}} 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 msgr2=0x7f9c5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 0x7f9c5006d0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64009040 comp rx=0 tx=0).stop 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 msgr2=0x7f9c74151930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c000c00 tx=0x7f9c5c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 shutdown_connections 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9c5006ac00 0x7f9c5006d0c0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9c74135740 0x7f9c74134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9c7415dee0 0x7f9c74151930 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 --2- 172.21.15.192:0/1927704734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9c740b0490 0x7f9c74136850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 >> 172.21.15.192:0/1927704734 conn(0x7f9c740ae960 msgr2=0x7f9c740b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:00.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 shutdown_connections 2024-09-13T18:46:00.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.281+0000 7f9c7bc00640 1 -- 172.21.15.192:0/1927704734 wait complete. 2024-09-13T18:46:00.300 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-09-13T18:46:00.300 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:46:00.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.451+0000 7f45a2a00640 1 Processor -- start 2024-09-13T18:46:00.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.451+0000 7f45a2a00640 1 -- start start 2024-09-13T18:46:00.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c146850 0x7f459c15d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f459c0af2f0 0x7f459c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f459c0af730 0x7f459c0cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c15d810 con 0x7f459c0af2f0 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f459c0b46e0 con 0x7f459c0af730 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0d03c0 con 0x7f459c146850 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a0c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f459c0af2f0 0x7f459c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a0c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f459c0af2f0 0x7f459c0cf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33578/0 (socket says 172.21.15.192:33578) 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a0c00640 1 -- 172.21.15.192:0/1468949279 learned_addr learned my addr 172.21.15.192:0/1468949279 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.452+0000 7f45a2000640 1 --2- 172.21.15.192:0/1468949279 >> v2:172.21.15.194:3300/0 conn(0x7f459c0af730 0x7f459c0cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a1600640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c146850 0x7f459c15d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a0c00640 1 -- 172.21.15.192:0/1468949279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c146850 msgr2=0x7f459c15d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a0c00640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c146850 0x7f459c15d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a0c00640 1 -- 172.21.15.192:0/1468949279 >> v2:172.21.15.194:3300/0 conn(0x7f459c0af730 msgr2=0x7f459c0cfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a0c00640 1 --2- 172.21.15.192:0/1468949279 >> v2:172.21.15.194:3300/0 conn(0x7f459c0af730 0x7f459c0cfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.453+0000 7f45a0c00640 1 -- 172.21.15.192:0/1468949279 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f459c0b3db0 con 0x7f459c0af2f0 2024-09-13T18:46:00.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.454+0000 7f45a0c00640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0af2f0 0x7f459c0cf940 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f459c0cf6f0 tx=0x7f458802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fda493128c356e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.454+0000 7f459be00640 1 -- 172.21.15.192:0/1468949279 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458802ae90 con 0x7f459c0af2f0 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.454+0000 7f459be00640 1 -- 172.21.15.192:0/1468949279 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4588032440 con 0x7f459c0af2f0 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.454+0000 7f459be00640 1 -- 172.21.15.192:0/1468949279 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45880327d0 con 0x7f459c0af2f0 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 -- 172.21.15.192:0/1468949279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0af2f0 msgr2=0x7f459c0cf940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0af2f0 0x7f459c0cf940 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f459c0cf6f0 tx=0x7f458802a140 comp rx=0 tx=0).stop 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 -- 172.21.15.192:0/1468949279 shutdown_connections 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1468949279 >> v2:172.21.15.194:3300/0 conn(0x7f459c0af730 0x7f459c0cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c0af2f0 0x7f459c0cf940 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1468949279 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c146850 0x7f459c15d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 -- 172.21.15.192:0/1468949279 >> 172.21.15.192:0/1468949279 conn(0x7f459c0b2e30 msgr2=0x7f459c0b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 -- 172.21.15.192:0/1468949279 shutdown_connections 2024-09-13T18:46:00.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.455+0000 7f45a2a00640 1 -- 172.21.15.192:0/1468949279 wait complete. 2024-09-13T18:46:00.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.456+0000 7f45a2a00640 1 Processor -- start 2024-09-13T18:46:00.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 -- start start 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0af2f0 0x7f459c06dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0af730 0x7f459c145b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c13fde0 con 0x7f459c146850 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f459c146050 con 0x7f459c0af730 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.457+0000 7f45a2a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f459c0c82b0 con 0x7f459c0af2f0 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33594/0 (socket says 172.21.15.192:33594) 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 -- 172.21.15.192:0/1055169171 learned_addr learned my addr 172.21.15.192:0/1055169171 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:00.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a1600640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0af2f0 0x7f459c06dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a0c00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0af730 0x7f459c145b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 -- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0af2f0 msgr2=0x7f459c06dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0af2f0 0x7f459c06dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 -- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0af730 msgr2=0x7f459c145b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0af730 0x7f459c145b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 -- 172.21.15.192:0/1055169171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45880094d0 con 0x7f459c146850 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.458+0000 7f45a2000640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f459400eed0 tx=0x7f459400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.459+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594010040 con 0x7f459c146850 2024-09-13T18:46:00.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.459+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4594014400 con 0x7f459c146850 2024-09-13T18:46:00.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.459+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4594009ea0 con 0x7f459c146850 2024-09-13T18:46:00.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.459+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f459c06e630 con 0x7f459c146850 2024-09-13T18:46:00.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.459+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f459c06ebf0 con 0x7f459c146850 2024-09-13T18:46:00.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.460+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f459c071320 con 0x7f459c146850 2024-09-13T18:46:00.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.461+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f45940147b0 con 0x7f459c146850 2024-09-13T18:46:00.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.461+0000 7f4599600640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 0x7f457c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:00.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.462+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4594089980 con 0x7f459c146850 2024-09-13T18:46:00.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.462+0000 7f45a1600640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 0x7f457c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:00.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.462+0000 7f45a1600640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 0x7f457c06d0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:00.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.466+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4594054c00 con 0x7f459c146850 2024-09-13T18:46:00.473 INFO:tasks.ceph.mds.a.smithi192.stderr:2024-09-13T18:46:00.470+0000 7f2776a00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:46:00.634 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.631+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f459c0afcd0 con 0x7f457c06ac00 2024-09-13T18:46:00.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.639+0000 7f4599600640 1 -- 172.21.15.192:0/1055169171 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284907 (secure 0 0 0) 0x7f4590010990 con 0x7f457c06ac00 2024-09-13T18:46:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:46:00.646 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:46:00.647 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 msgr2=0x7f457c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 0x7f457c06d0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f4590006fd0 tx=0x7f4590008040 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 msgr2=0x7f459c0c7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f459400eed0 tx=0x7f459400b480 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 shutdown_connections 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f457c06ac00 0x7f457c06d0c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f459c146850 0x7f459c0c7d70 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f459c0af730 0x7f459c145b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 --2- 172.21.15.192:0/1055169171 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f459c0af2f0 0x7f459c06dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 >> 172.21.15.192:0/1055169171 conn(0x7f459c0b2e30 msgr2=0x7f459c070b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 shutdown_connections 2024-09-13T18:46:00.648 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:00.643+0000 7f45a2a00640 1 -- 172.21.15.192:0/1055169171 wait complete. 2024-09-13T18:46:00.661 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2024-09-13T18:45:58.874687+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591096,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":136,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9039,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553460,"statfs":{"total":1600000000,"available":1590743296,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.396870"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897776+0000","last_change":"2024-09-13T18:45:54.901750+0000","last_active":"2024-09-13T18:45:55.897776+0000","last_peered":"2024-09-13T18:45:55.897776+0000","last_clean":"2024-09-13T18:45:55.897776+0000","last_became_active":"2024-09-13T18:45:54.901533+0000","last_became_peered":"2024-09-13T18:45:54.901533+0000","last_unstale":"2024-09-13T18:45:55.897776+0000","last_undegraded":"2024-09-13T18:45:55.897776+0000","last_fullsized":"2024-09-13T18:45:55.897776+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.183202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010599+0000","last_change":"2024-09-13T18:45:54.902052+0000","last_active":"2024-09-13T18:45:56.010599+0000","last_peered":"2024-09-13T18:45:56.010599+0000","last_clean":"2024-09-13T18:45:56.010599+0000","last_became_active":"2024-09-13T18:45:54.901778+0000","last_became_peered":"2024-09-13T18:45:54.901778+0000","last_unstale":"2024-09-13T18:45:56.010599+0000","last_undegraded":"2024-09-13T18:45:56.010599+0000","last_fullsized":"2024-09-13T18:45:56.010599+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:43.473451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010448+0000","last_change":"2024-09-13T18:45:54.912065+0000","last_active":"2024-09-13T18:45:56.010448+0000","last_peered":"2024-09-13T18:45:56.010448+0000","last_clean":"2024-09-13T18:45:56.010448+0000","last_became_active":"2024-09-13T18:45:54.909940+0000","last_became_peered":"2024-09-13T18:45:54.909940+0000","last_unstale":"2024-09-13T18:45:56.010448+0000","last_undegraded":"2024-09-13T18:45:56.010448+0000","last_fullsized":"2024-09-13T18:45:56.010448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:47.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898616+0000","last_change":"2024-09-13T18:45:54.910427+0000","last_active":"2024-09-13T18:45:55.898616+0000","last_peered":"2024-09-13T18:45:55.898616+0000","last_clean":"2024-09-13T18:45:55.898616+0000","last_became_active":"2024-09-13T18:45:54.910087+0000","last_became_peered":"2024-09-13T18:45:54.910087+0000","last_unstale":"2024-09-13T18:45:55.898616+0000","last_undegraded":"2024-09-13T18:45:55.898616+0000","last_fullsized":"2024-09-13T18:45:55.898616+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:27.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011663+0000","last_change":"2024-09-13T18:45:54.910009+0000","last_active":"2024-09-13T18:45:56.011663+0000","last_peered":"2024-09-13T18:45:56.011663+0000","last_clean":"2024-09-13T18:45:56.011663+0000","last_became_active":"2024-09-13T18:45:54.909801+0000","last_became_peered":"2024-09-13T18:45:54.909801+0000","last_unstale":"2024-09-13T18:45:56.011663+0000","last_undegraded":"2024-09-13T18:45:56.011663+0000","last_fullsized":"2024-09-13T18:45:56.011663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:36.347672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011555+0000","last_change":"2024-09-13T18:45:54.911923+0000","last_active":"2024-09-13T18:45:56.011555+0000","last_peered":"2024-09-13T18:45:56.011555+0000","last_clean":"2024-09-13T18:45:56.011555+0000","last_became_active":"2024-09-13T18:45:54.911356+0000","last_became_peered":"2024-09-13T18:45:54.911356+0000","last_unstale":"2024-09-13T18:45:56.011555+0000","last_undegraded":"2024-09-13T18:45:56.011555+0000","last_fullsized":"2024-09-13T18:45:56.011555+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487850+0000","last_change":"2024-09-13T18:45:54.487850+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487850+0000","last_undegraded":"2024-09-13T18:45:54.487850+0000","last_fullsized":"2024-09-13T18:45:54.487850+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897854+0000","last_change":"2024-09-13T18:45:54.907913+0000","last_active":"2024-09-13T18:45:55.897854+0000","last_peered":"2024-09-13T18:45:55.897854+0000","last_clean":"2024-09-13T18:45:55.897854+0000","last_became_active":"2024-09-13T18:45:54.906386+0000","last_became_peered":"2024-09-13T18:45:54.906386+0000","last_unstale":"2024-09-13T18:45:55.897854+0000","last_undegraded":"2024-09-13T18:45:55.897854+0000","last_fullsized":"2024-09-13T18:45:55.897854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.005604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011137+0000","last_change":"2024-09-13T18:45:54.905215+0000","last_active":"2024-09-13T18:45:56.011137+0000","last_peered":"2024-09-13T18:45:56.011137+0000","last_clean":"2024-09-13T18:45:56.011137+0000","last_became_active":"2024-09-13T18:45:54.904546+0000","last_became_peered":"2024-09-13T18:45:54.904546+0000","last_unstale":"2024-09-13T18:45:56.011137+0000","last_undegraded":"2024-09-13T18:45:56.011137+0000","last_fullsized":"2024-09-13T18:45:56.011137+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011337+0000","last_change":"2024-09-13T18:45:54.920649+0000","last_active":"2024-09-13T18:45:56.011337+0000","last_peered":"2024-09-13T18:45:56.011337+0000","last_clean":"2024-09-13T18:45:56.011337+0000","last_became_active":"2024-09-13T18:45:54.919304+0000","last_became_peered":"2024-09-13T18:45:54.919304+0000","last_unstale":"2024-09-13T18:45:56.011337+0000","last_undegraded":"2024-09-13T18:45:56.011337+0000","last_fullsized":"2024-09-13T18:45:56.011337+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:37.311809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011203+0000","last_change":"2024-09-13T18:45:54.905859+0000","last_active":"2024-09-13T18:45:56.011203+0000","last_peered":"2024-09-13T18:45:56.011203+0000","last_clean":"2024-09-13T18:45:56.011203+0000","last_became_active":"2024-09-13T18:45:54.905045+0000","last_became_peered":"2024-09-13T18:45:54.905045+0000","last_unstale":"2024-09-13T18:45:56.011203+0000","last_undegraded":"2024-09-13T18:45:56.011203+0000","last_fullsized":"2024-09-13T18:45:56.011203+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010854+0000","last_change":"2024-09-13T18:45:54.916941+0000","last_active":"2024-09-13T18:45:56.010854+0000","last_peered":"2024-09-13T18:45:56.010854+0000","last_clean":"2024-09-13T18:45:56.010854+0000","last_became_active":"2024-09-13T18:45:54.916473+0000","last_became_peered":"2024-09-13T18:45:54.916473+0000","last_unstale":"2024-09-13T18:45:56.010854+0000","last_undegraded":"2024-09-13T18:45:56.010854+0000","last_fullsized":"2024-09-13T18:45:56.010854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010195+0000","last_change":"2024-09-13T18:45:54.909427+0000","last_active":"2024-09-13T18:45:56.010195+0000","last_peered":"2024-09-13T18:45:56.010195+0000","last_clean":"2024-09-13T18:45:56.010195+0000","last_became_active":"2024-09-13T18:45:54.909217+0000","last_became_peered":"2024-09-13T18:45:54.909217+0000","last_unstale":"2024-09-13T18:45:56.010195+0000","last_undegraded":"2024-09-13T18:45:56.010195+0000","last_fullsized":"2024-09-13T18:45:56.010195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:38.177689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010199+0000","last_change":"2024-09-13T18:45:54.906851+0000","last_active":"2024-09-13T18:45:56.010199+0000","last_peered":"2024-09-13T18:45:56.010199+0000","last_clean":"2024-09-13T18:45:56.010199+0000","last_became_active":"2024-09-13T18:45:54.906648+0000","last_became_peered":"2024-09-13T18:45:54.906648+0000","last_unstale":"2024-09-13T18:45:56.010199+0000","last_undegraded":"2024-09-13T18:45:56.010199+0000","last_fullsized":"2024-09-13T18:45:56.010199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011707+0000","last_change":"2024-09-13T18:45:54.908866+0000","last_active":"2024-09-13T18:45:56.011707+0000","last_peered":"2024-09-13T18:45:56.011707+0000","last_clean":"2024-09-13T18:45:56.011707+0000","last_became_active":"2024-09-13T18:45:54.908632+0000","last_became_peered":"2024-09-13T18:45:54.908632+0000","last_unstale":"2024-09-13T18:45:56.011707+0000","last_undegraded":"2024-09-13T18:45:56.011707+0000","last_fullsized":"2024-09-13T18:45:56.011707+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.121006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.488730+0000","last_change":"2024-09-13T18:45:54.488730+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.488730+0000","last_undegraded":"2024-09-13T18:45:54.488730+0000","last_fullsized":"2024-09-13T18:45:54.488730+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010405+0000","last_change":"2024-09-13T18:45:54.918944+0000","last_active":"2024-09-13T18:45:56.010405+0000","last_peered":"2024-09-13T18:45:56.010405+0000","last_clean":"2024-09-13T18:45:56.010405+0000","last_became_active":"2024-09-13T18:45:54.917581+0000","last_became_peered":"2024-09-13T18:45:54.917581+0000","last_unstale":"2024-09-13T18:45:56.010405+0000","last_undegraded":"2024-09-13T18:45:56.010405+0000","last_fullsized":"2024-09-13T18:45:56.010405+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010281+0000","last_change":"2024-09-13T18:45:54.905549+0000","last_active":"2024-09-13T18:45:56.010281+0000","last_peered":"2024-09-13T18:45:56.010281+0000","last_clean":"2024-09-13T18:45:56.010281+0000","last_became_active":"2024-09-13T18:45:54.905342+0000","last_became_peered":"2024-09-13T18:45:54.905342+0000","last_unstale":"2024-09-13T18:45:56.010281+0000","last_undegraded":"2024-09-13T18:45:56.010281+0000","last_fullsized":"2024-09-13T18:45:56.010281+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:01.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898360+0000","last_change":"2024-09-13T18:45:54.902557+0000","last_active":"2024-09-13T18:45:55.898360+0000","last_peered":"2024-09-13T18:45:55.898360+0000","last_clean":"2024-09-13T18:45:55.898360+0000","last_became_active":"2024-09-13T18:45:54.902298+0000","last_became_peered":"2024-09-13T18:45:54.902298+0000","last_unstale":"2024-09-13T18:45:55.898360+0000","last_undegraded":"2024-09-13T18:45:55.898360+0000","last_fullsized":"2024-09-13T18:45:55.898360+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.144087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897970+0000","last_change":"2024-09-13T18:45:54.906737+0000","last_active":"2024-09-13T18:45:55.897970+0000","last_peered":"2024-09-13T18:45:55.897970+0000","last_clean":"2024-09-13T18:45:55.897970+0000","last_became_active":"2024-09-13T18:45:54.905140+0000","last_became_peered":"2024-09-13T18:45:54.905140+0000","last_unstale":"2024-09-13T18:45:55.897970+0000","last_undegraded":"2024-09-13T18:45:55.897970+0000","last_fullsized":"2024-09-13T18:45:55.897970+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:09.859640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010935+0000","last_change":"2024-09-13T18:45:54.920838+0000","last_active":"2024-09-13T18:45:56.010935+0000","last_peered":"2024-09-13T18:45:56.010935+0000","last_clean":"2024-09-13T18:45:56.010935+0000","last_became_active":"2024-09-13T18:45:54.920389+0000","last_became_peered":"2024-09-13T18:45:54.920389+0000","last_unstale":"2024-09-13T18:45:56.010935+0000","last_undegraded":"2024-09-13T18:45:56.010935+0000","last_fullsized":"2024-09-13T18:45:56.010935+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:04.690253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010936+0000","last_change":"2024-09-13T18:45:54.913459+0000","last_active":"2024-09-13T18:45:56.010936+0000","last_peered":"2024-09-13T18:45:56.010936+0000","last_clean":"2024-09-13T18:45:56.010936+0000","last_became_active":"2024-09-13T18:45:54.911505+0000","last_became_peered":"2024-09-13T18:45:54.911505+0000","last_unstale":"2024-09-13T18:45:56.010936+0000","last_undegraded":"2024-09-13T18:45:56.010936+0000","last_fullsized":"2024-09-13T18:45:56.010936+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898627+0000","last_change":"2024-09-13T18:45:54.905226+0000","last_active":"2024-09-13T18:45:55.898627+0000","last_peered":"2024-09-13T18:45:55.898627+0000","last_clean":"2024-09-13T18:45:55.898627+0000","last_became_active":"2024-09-13T18:45:54.904669+0000","last_became_peered":"2024-09-13T18:45:54.904669+0000","last_unstale":"2024-09-13T18:45:55.898627+0000","last_undegraded":"2024-09-13T18:45:55.898627+0000","last_fullsized":"2024-09-13T18:45:55.898627+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:06.638083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.009933+0000","last_change":"2024-09-13T18:45:54.916788+0000","last_active":"2024-09-13T18:45:56.009933+0000","last_peered":"2024-09-13T18:45:56.009933+0000","last_clean":"2024-09-13T18:45:56.009933+0000","last_became_active":"2024-09-13T18:45:54.916454+0000","last_became_peered":"2024-09-13T18:45:54.916454+0000","last_unstale":"2024-09-13T18:45:56.009933+0000","last_undegraded":"2024-09-13T18:45:56.009933+0000","last_fullsized":"2024-09-13T18:45:56.009933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:17.455557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010997+0000","last_change":"2024-09-13T18:45:54.907911+0000","last_active":"2024-09-13T18:45:56.010997+0000","last_peered":"2024-09-13T18:45:56.010997+0000","last_clean":"2024-09-13T18:45:56.010997+0000","last_became_active":"2024-09-13T18:45:54.907654+0000","last_became_peered":"2024-09-13T18:45:54.907654+0000","last_unstale":"2024-09-13T18:45:56.010997+0000","last_undegraded":"2024-09-13T18:45:56.010997+0000","last_fullsized":"2024-09-13T18:45:56.010997+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:57.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897669+0000","last_change":"2024-09-13T18:45:54.904016+0000","last_active":"2024-09-13T18:45:55.897669+0000","last_peered":"2024-09-13T18:45:55.897669+0000","last_clean":"2024-09-13T18:45:55.897669+0000","last_became_active":"2024-09-13T18:45:54.903783+0000","last_became_peered":"2024-09-13T18:45:54.903783+0000","last_unstale":"2024-09-13T18:45:55.897669+0000","last_undegraded":"2024-09-13T18:45:55.897669+0000","last_fullsized":"2024-09-13T18:45:55.897669+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:51.133236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010717+0000","last_change":"2024-09-13T18:45:54.907422+0000","last_active":"2024-09-13T18:45:56.010717+0000","last_peered":"2024-09-13T18:45:56.010717+0000","last_clean":"2024-09-13T18:45:56.010717+0000","last_became_active":"2024-09-13T18:45:54.907213+0000","last_became_peered":"2024-09-13T18:45:54.907213+0000","last_unstale":"2024-09-13T18:45:56.010717+0000","last_undegraded":"2024-09-13T18:45:56.010717+0000","last_fullsized":"2024-09-13T18:45:56.010717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:34.474938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010677+0000","last_change":"2024-09-13T18:45:54.902283+0000","last_active":"2024-09-13T18:45:56.010677+0000","last_peered":"2024-09-13T18:45:56.010677+0000","last_clean":"2024-09-13T18:45:56.010677+0000","last_became_active":"2024-09-13T18:45:54.901696+0000","last_became_peered":"2024-09-13T18:45:54.901696+0000","last_unstale":"2024-09-13T18:45:56.010677+0000","last_undegraded":"2024-09-13T18:45:56.010677+0000","last_fullsized":"2024-09-13T18:45:56.010677+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:07.263140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898174+0000","last_change":"2024-09-13T18:45:54.911220+0000","last_active":"2024-09-13T18:45:55.898174+0000","last_peered":"2024-09-13T18:45:55.898174+0000","last_clean":"2024-09-13T18:45:55.898174+0000","last_became_active":"2024-09-13T18:45:54.910394+0000","last_became_peered":"2024-09-13T18:45:54.910394+0000","last_unstale":"2024-09-13T18:45:55.898174+0000","last_undegraded":"2024-09-13T18:45:55.898174+0000","last_fullsized":"2024-09-13T18:45:55.898174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:51.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010800+0000","last_change":"2024-09-13T18:45:54.910226+0000","last_active":"2024-09-13T18:45:56.010800+0000","last_peered":"2024-09-13T18:45:56.010800+0000","last_clean":"2024-09-13T18:45:56.010800+0000","last_became_active":"2024-09-13T18:45:54.909900+0000","last_became_peered":"2024-09-13T18:45:54.909900+0000","last_unstale":"2024-09-13T18:45:56.010800+0000","last_undegraded":"2024-09-13T18:45:56.010800+0000","last_fullsized":"2024-09-13T18:45:56.010800+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010778+0000","last_change":"2024-09-13T18:45:54.906078+0000","last_active":"2024-09-13T18:45:56.010778+0000","last_peered":"2024-09-13T18:45:56.010778+0000","last_clean":"2024-09-13T18:45:56.010778+0000","last_became_active":"2024-09-13T18:45:54.905848+0000","last_became_peered":"2024-09-13T18:45:54.905848+0000","last_unstale":"2024-09-13T18:45:56.010778+0000","last_undegraded":"2024-09-13T18:45:56.010778+0000","last_fullsized":"2024-09-13T18:45:56.010778+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:00.941799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010831+0000","last_change":"2024-09-13T18:45:54.909954+0000","last_active":"2024-09-13T18:45:56.010831+0000","last_peered":"2024-09-13T18:45:56.010831+0000","last_clean":"2024-09-13T18:45:56.010831+0000","last_became_active":"2024-09-13T18:45:54.909730+0000","last_became_peered":"2024-09-13T18:45:54.909730+0000","last_unstale":"2024-09-13T18:45:56.010831+0000","last_undegraded":"2024-09-13T18:45:56.010831+0000","last_fullsized":"2024-09-13T18:45:56.010831+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:43.640922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010020+0000","last_change":"2024-09-13T18:45:54.916653+0000","last_active":"2024-09-13T18:45:56.010020+0000","last_peered":"2024-09-13T18:45:56.010020+0000","last_clean":"2024-09-13T18:45:56.010020+0000","last_became_active":"2024-09-13T18:45:54.916130+0000","last_became_peered":"2024-09-13T18:45:54.916130+0000","last_unstale":"2024-09-13T18:45:56.010020+0000","last_undegraded":"2024-09-13T18:45:56.010020+0000","last_fullsized":"2024-09-13T18:45:56.010020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:06.281655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"179'4","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921504+0000","last_change":"2024-09-13T18:45:54.496811+0000","last_active":"2024-09-13T18:45:54.921504+0000","last_peered":"2024-09-13T18:45:54.921504+0000","last_clean":"2024-09-13T18:45:54.921504+0000","last_became_active":"2024-09-13T18:45:54.496586+0000","last_became_peered":"2024-09-13T18:45:54.496586+0000","last_unstale":"2024-09-13T18:45:54.921504+0000","last_undegraded":"2024-09-13T18:45:54.921504+0000","last_fullsized":"2024-09-13T18:45:54.921504+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.492453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489531+0000","last_change":"2024-09-13T18:45:54.489531+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489531+0000","last_undegraded":"2024-09-13T18:45:54.489531+0000","last_fullsized":"2024-09-13T18:45:54.489531+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917380+0000","last_change":"2024-09-13T18:45:54.492450+0000","last_active":"2024-09-13T18:45:54.917380+0000","last_peered":"2024-09-13T18:45:54.917380+0000","last_clean":"2024-09-13T18:45:54.917380+0000","last_became_active":"2024-09-13T18:45:54.491715+0000","last_became_peered":"2024-09-13T18:45:54.491715+0000","last_unstale":"2024-09-13T18:45:54.917380+0000","last_undegraded":"2024-09-13T18:45:54.917380+0000","last_fullsized":"2024-09-13T18:45:54.917380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:37.803308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011301+0000","last_change":"2024-09-13T18:45:54.911792+0000","last_active":"2024-09-13T18:45:56.011301+0000","last_peered":"2024-09-13T18:45:56.011301+0000","last_clean":"2024-09-13T18:45:56.011301+0000","last_became_active":"2024-09-13T18:45:54.910953+0000","last_became_peered":"2024-09-13T18:45:54.910953+0000","last_unstale":"2024-09-13T18:45:56.011301+0000","last_undegraded":"2024-09-13T18:45:56.011301+0000","last_fullsized":"2024-09-13T18:45:56.011301+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918338+0000","last_change":"2024-09-13T18:45:54.495172+0000","last_active":"2024-09-13T18:45:54.918338+0000","last_peered":"2024-09-13T18:45:54.918338+0000","last_clean":"2024-09-13T18:45:54.918338+0000","last_became_active":"2024-09-13T18:45:54.494637+0000","last_became_peered":"2024-09-13T18:45:54.494637+0000","last_unstale":"2024-09-13T18:45:54.918338+0000","last_undegraded":"2024-09-13T18:45:54.918338+0000","last_fullsized":"2024-09-13T18:45:54.918338+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:28.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898980+0000","last_change":"2024-09-13T18:45:54.915501+0000","last_active":"2024-09-13T18:45:55.898980+0000","last_peered":"2024-09-13T18:45:55.898980+0000","last_clean":"2024-09-13T18:45:55.898980+0000","last_became_active":"2024-09-13T18:45:54.915141+0000","last_became_peered":"2024-09-13T18:45:54.915141+0000","last_unstale":"2024-09-13T18:45:55.898980+0000","last_undegraded":"2024-09-13T18:45:55.898980+0000","last_fullsized":"2024-09-13T18:45:55.898980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920696+0000","last_change":"2024-09-13T18:45:54.496083+0000","last_active":"2024-09-13T18:45:54.920696+0000","last_peered":"2024-09-13T18:45:54.920696+0000","last_clean":"2024-09-13T18:45:54.920696+0000","last_became_active":"2024-09-13T18:45:54.495784+0000","last_became_peered":"2024-09-13T18:45:54.495784+0000","last_unstale":"2024-09-13T18:45:54.920696+0000","last_undegraded":"2024-09-13T18:45:54.920696+0000","last_fullsized":"2024-09-13T18:45:54.920696+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:07.785392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010793+0000","last_change":"2024-09-13T18:45:54.907306+0000","last_active":"2024-09-13T18:45:56.010793+0000","last_peered":"2024-09-13T18:45:56.010793+0000","last_clean":"2024-09-13T18:45:56.010793+0000","last_became_active":"2024-09-13T18:45:54.907088+0000","last_became_peered":"2024-09-13T18:45:54.907088+0000","last_unstale":"2024-09-13T18:45:56.010793+0000","last_undegraded":"2024-09-13T18:45:56.010793+0000","last_fullsized":"2024-09-13T18:45:56.010793+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.319805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919010+0000","last_change":"2024-09-13T18:45:54.486281+0000","last_active":"2024-09-13T18:45:54.919010+0000","last_peered":"2024-09-13T18:45:54.919010+0000","last_clean":"2024-09-13T18:45:54.919010+0000","last_became_active":"2024-09-13T18:45:54.485730+0000","last_became_peered":"2024-09-13T18:45:54.485730+0000","last_unstale":"2024-09-13T18:45:54.919010+0000","last_undegraded":"2024-09-13T18:45:54.919010+0000","last_fullsized":"2024-09-13T18:45:54.919010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.176678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898569+0000","last_change":"2024-09-13T18:45:54.914232+0000","last_active":"2024-09-13T18:45:55.898569+0000","last_peered":"2024-09-13T18:45:55.898569+0000","last_clean":"2024-09-13T18:45:55.898569+0000","last_became_active":"2024-09-13T18:45:54.913955+0000","last_became_peered":"2024-09-13T18:45:54.913955+0000","last_unstale":"2024-09-13T18:45:55.898569+0000","last_undegraded":"2024-09-13T18:45:55.898569+0000","last_fullsized":"2024-09-13T18:45:55.898569+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920875+0000","last_change":"2024-09-13T18:45:54.494883+0000","last_active":"2024-09-13T18:45:54.920875+0000","last_peered":"2024-09-13T18:45:54.920875+0000","last_clean":"2024-09-13T18:45:54.920875+0000","last_became_active":"2024-09-13T18:45:54.494664+0000","last_became_peered":"2024-09-13T18:45:54.494664+0000","last_unstale":"2024-09-13T18:45:54.920875+0000","last_undegraded":"2024-09-13T18:45:54.920875+0000","last_fullsized":"2024-09-13T18:45:54.920875+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:34.997445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011108+0000","last_change":"2024-09-13T18:45:54.912604+0000","last_active":"2024-09-13T18:45:56.011108+0000","last_peered":"2024-09-13T18:45:56.011108+0000","last_clean":"2024-09-13T18:45:56.011108+0000","last_became_active":"2024-09-13T18:45:54.912148+0000","last_became_peered":"2024-09-13T18:45:54.912148+0000","last_unstale":"2024-09-13T18:45:56.011108+0000","last_undegraded":"2024-09-13T18:45:56.011108+0000","last_fullsized":"2024-09-13T18:45:56.011108+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:07.339063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899755+0000","last_change":"2024-09-13T18:45:54.496659+0000","last_active":"2024-09-13T18:45:54.899755+0000","last_peered":"2024-09-13T18:45:54.899755+0000","last_clean":"2024-09-13T18:45:54.899755+0000","last_became_active":"2024-09-13T18:45:54.492022+0000","last_became_peered":"2024-09-13T18:45:54.492022+0000","last_unstale":"2024-09-13T18:45:54.899755+0000","last_undegraded":"2024-09-13T18:45:54.899755+0000","last_fullsized":"2024-09-13T18:45:54.899755+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:51.428747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898877+0000","last_change":"2024-09-13T18:45:54.902303+0000","last_active":"2024-09-13T18:45:55.898877+0000","last_peered":"2024-09-13T18:45:55.898877+0000","last_clean":"2024-09-13T18:45:55.898877+0000","last_became_active":"2024-09-13T18:45:54.901738+0000","last_became_peered":"2024-09-13T18:45:54.901738+0000","last_unstale":"2024-09-13T18:45:55.898877+0000","last_undegraded":"2024-09-13T18:45:55.898877+0000","last_fullsized":"2024-09-13T18:45:55.898877+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.908844+0000","last_change":"2024-09-13T18:45:54.495032+0000","last_active":"2024-09-13T18:45:54.908844+0000","last_peered":"2024-09-13T18:45:54.908844+0000","last_clean":"2024-09-13T18:45:54.908844+0000","last_became_active":"2024-09-13T18:45:54.494407+0000","last_became_peered":"2024-09-13T18:45:54.494407+0000","last_unstale":"2024-09-13T18:45:54.908844+0000","last_undegraded":"2024-09-13T18:45:54.908844+0000","last_fullsized":"2024-09-13T18:45:54.908844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:12.756996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898654+0000","last_change":"2024-09-13T18:45:54.907873+0000","last_active":"2024-09-13T18:45:55.898654+0000","last_peered":"2024-09-13T18:45:55.898654+0000","last_clean":"2024-09-13T18:45:55.898654+0000","last_became_active":"2024-09-13T18:45:54.906361+0000","last_became_peered":"2024-09-13T18:45:54.906361+0000","last_unstale":"2024-09-13T18:45:55.898654+0000","last_undegraded":"2024-09-13T18:45:55.898654+0000","last_fullsized":"2024-09-13T18:45:55.898654+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899665+0000","last_change":"2024-09-13T18:45:54.486090+0000","last_active":"2024-09-13T18:45:54.899665+0000","last_peered":"2024-09-13T18:45:54.899665+0000","last_clean":"2024-09-13T18:45:54.899665+0000","last_became_active":"2024-09-13T18:45:54.485779+0000","last_became_peered":"2024-09-13T18:45:54.485779+0000","last_unstale":"2024-09-13T18:45:54.899665+0000","last_undegraded":"2024-09-13T18:45:54.899665+0000","last_fullsized":"2024-09-13T18:45:54.899665+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:50.156625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010952+0000","last_change":"2024-09-13T18:45:54.911423+0000","last_active":"2024-09-13T18:45:56.010952+0000","last_peered":"2024-09-13T18:45:56.010952+0000","last_clean":"2024-09-13T18:45:56.010952+0000","last_became_active":"2024-09-13T18:45:54.910239+0000","last_became_peered":"2024-09-13T18:45:54.910239+0000","last_unstale":"2024-09-13T18:45:56.010952+0000","last_undegraded":"2024-09-13T18:45:56.010952+0000","last_fullsized":"2024-09-13T18:45:56.010952+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.903358+0000","last_change":"2024-09-13T18:45:54.491468+0000","last_active":"2024-09-13T18:45:54.903358+0000","last_peered":"2024-09-13T18:45:54.903358+0000","last_clean":"2024-09-13T18:45:54.903358+0000","last_became_active":"2024-09-13T18:45:54.491217+0000","last_became_peered":"2024-09-13T18:45:54.491217+0000","last_unstale":"2024-09-13T18:45:54.903358+0000","last_undegraded":"2024-09-13T18:45:54.903358+0000","last_fullsized":"2024-09-13T18:45:54.903358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:35.312903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.489173+0000","last_change":"2024-09-13T18:45:54.489173+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.489173+0000","last_undegraded":"2024-09-13T18:45:54.489173+0000","last_fullsized":"2024-09-13T18:45:54.489173+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498794+0000","last_change":"2024-09-13T18:45:54.498701+0000","last_active":"2024-09-13T18:45:54.498794+0000","last_peered":"2024-09-13T18:45:54.498794+0000","last_clean":"2024-09-13T18:45:54.498794+0000","last_became_active":"2024-09-13T18:45:54.498477+0000","last_became_peered":"2024-09-13T18:45:54.498477+0000","last_unstale":"2024-09-13T18:45:54.498794+0000","last_undegraded":"2024-09-13T18:45:54.498794+0000","last_fullsized":"2024-09-13T18:45:54.498794+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:05.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898904+0000","last_change":"2024-09-13T18:45:54.916063+0000","last_active":"2024-09-13T18:45:55.898904+0000","last_peered":"2024-09-13T18:45:55.898904+0000","last_clean":"2024-09-13T18:45:55.898904+0000","last_became_active":"2024-09-13T18:45:54.914695+0000","last_became_peered":"2024-09-13T18:45:54.914695+0000","last_unstale":"2024-09-13T18:45:55.898904+0000","last_undegraded":"2024-09-13T18:45:55.898904+0000","last_fullsized":"2024-09-13T18:45:55.898904+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920376+0000","last_change":"2024-09-13T18:45:54.494893+0000","last_active":"2024-09-13T18:45:54.920376+0000","last_peered":"2024-09-13T18:45:54.920376+0000","last_clean":"2024-09-13T18:45:54.920376+0000","last_became_active":"2024-09-13T18:45:54.494123+0000","last_became_peered":"2024-09-13T18:45:54.494123+0000","last_unstale":"2024-09-13T18:45:54.920376+0000","last_undegraded":"2024-09-13T18:45:54.920376+0000","last_fullsized":"2024-09-13T18:45:54.920376+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:14.459115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898103+0000","last_change":"2024-09-13T18:45:54.911463+0000","last_active":"2024-09-13T18:45:55.898103+0000","last_peered":"2024-09-13T18:45:55.898103+0000","last_clean":"2024-09-13T18:45:55.898103+0000","last_became_active":"2024-09-13T18:45:54.910682+0000","last_became_peered":"2024-09-13T18:45:54.910682+0000","last_unstale":"2024-09-13T18:45:55.898103+0000","last_undegraded":"2024-09-13T18:45:55.898103+0000","last_fullsized":"2024-09-13T18:45:55.898103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:21.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.905155+0000","last_change":"2024-09-13T18:45:54.495200+0000","last_active":"2024-09-13T18:45:54.905155+0000","last_peered":"2024-09-13T18:45:54.905155+0000","last_clean":"2024-09-13T18:45:54.905155+0000","last_became_active":"2024-09-13T18:45:54.494927+0000","last_became_peered":"2024-09-13T18:45:54.494927+0000","last_unstale":"2024-09-13T18:45:54.905155+0000","last_undegraded":"2024-09-13T18:45:54.905155+0000","last_fullsized":"2024-09-13T18:45:54.905155+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898942+0000","last_change":"2024-09-13T18:45:54.912225+0000","last_active":"2024-09-13T18:45:55.898942+0000","last_peered":"2024-09-13T18:45:55.898942+0000","last_clean":"2024-09-13T18:45:55.898942+0000","last_became_active":"2024-09-13T18:45:54.911697+0000","last_became_peered":"2024-09-13T18:45:54.911697+0000","last_unstale":"2024-09-13T18:45:55.898942+0000","last_undegraded":"2024-09-13T18:45:55.898942+0000","last_fullsized":"2024-09-13T18:45:55.898942+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901469+0000","last_change":"2024-09-13T18:45:54.496453+0000","last_active":"2024-09-13T18:45:54.901469+0000","last_peered":"2024-09-13T18:45:54.901469+0000","last_clean":"2024-09-13T18:45:54.901469+0000","last_became_active":"2024-09-13T18:45:54.496187+0000","last_became_peered":"2024-09-13T18:45:54.496187+0000","last_unstale":"2024-09-13T18:45:54.901469+0000","last_undegraded":"2024-09-13T18:45:54.901469+0000","last_fullsized":"2024-09-13T18:45:54.901469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:34.536434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898899+0000","last_change":"2024-09-13T18:45:54.908004+0000","last_active":"2024-09-13T18:45:55.898899+0000","last_peered":"2024-09-13T18:45:55.898899+0000","last_clean":"2024-09-13T18:45:55.898899+0000","last_became_active":"2024-09-13T18:45:54.906642+0000","last_became_peered":"2024-09-13T18:45:54.906642+0000","last_unstale":"2024-09-13T18:45:55.898899+0000","last_undegraded":"2024-09-13T18:45:55.898899+0000","last_fullsized":"2024-09-13T18:45:55.898899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:32.003975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"179'8","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920589+0000","last_change":"2024-09-13T18:45:54.493489+0000","last_active":"2024-09-13T18:45:54.920589+0000","last_peered":"2024-09-13T18:45:54.920589+0000","last_clean":"2024-09-13T18:45:54.920589+0000","last_became_active":"2024-09-13T18:45:54.493186+0000","last_became_peered":"2024-09-13T18:45:54.493186+0000","last_unstale":"2024-09-13T18:45:54.920589+0000","last_undegraded":"2024-09-13T18:45:54.920589+0000","last_fullsized":"2024-09-13T18:45:54.920589+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:22.461942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011749+0000","last_change":"2024-09-13T18:45:54.914777+0000","last_active":"2024-09-13T18:45:56.011749+0000","last_peered":"2024-09-13T18:45:56.011749+0000","last_clean":"2024-09-13T18:45:56.011749+0000","last_became_active":"2024-09-13T18:45:54.914406+0000","last_became_peered":"2024-09-13T18:45:54.914406+0000","last_unstale":"2024-09-13T18:45:56.011749+0000","last_undegraded":"2024-09-13T18:45:56.011749+0000","last_fullsized":"2024-09-13T18:45:56.011749+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:40.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917253+0000","last_change":"2024-09-13T18:45:54.487283+0000","last_active":"2024-09-13T18:45:54.917253+0000","last_peered":"2024-09-13T18:45:54.917253+0000","last_clean":"2024-09-13T18:45:54.917253+0000","last_became_active":"2024-09-13T18:45:54.487060+0000","last_became_peered":"2024-09-13T18:45:54.487060+0000","last_unstale":"2024-09-13T18:45:54.917253+0000","last_undegraded":"2024-09-13T18:45:54.917253+0000","last_fullsized":"2024-09-13T18:45:54.917253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.256698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011050+0000","last_change":"2024-09-13T18:45:54.906614+0000","last_active":"2024-09-13T18:45:56.011050+0000","last_peered":"2024-09-13T18:45:56.011050+0000","last_clean":"2024-09-13T18:45:56.011050+0000","last_became_active":"2024-09-13T18:45:54.906390+0000","last_became_peered":"2024-09-13T18:45:54.906390+0000","last_unstale":"2024-09-13T18:45:56.011050+0000","last_undegraded":"2024-09-13T18:45:56.011050+0000","last_fullsized":"2024-09-13T18:45:56.011050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:11.921047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920922+0000","last_change":"2024-09-13T18:45:54.497640+0000","last_active":"2024-09-13T18:45:54.920922+0000","last_peered":"2024-09-13T18:45:54.920922+0000","last_clean":"2024-09-13T18:45:54.920922+0000","last_became_active":"2024-09-13T18:45:54.497203+0000","last_became_peered":"2024-09-13T18:45:54.497203+0000","last_unstale":"2024-09-13T18:45:54.920922+0000","last_undegraded":"2024-09-13T18:45:54.920922+0000","last_fullsized":"2024-09-13T18:45:54.920922+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010525+0000","last_change":"2024-09-13T18:45:54.913515+0000","last_active":"2024-09-13T18:45:56.010525+0000","last_peered":"2024-09-13T18:45:56.010525+0000","last_clean":"2024-09-13T18:45:56.010525+0000","last_became_active":"2024-09-13T18:45:54.913313+0000","last_became_peered":"2024-09-13T18:45:54.913313+0000","last_unstale":"2024-09-13T18:45:56.010525+0000","last_undegraded":"2024-09-13T18:45:56.010525+0000","last_fullsized":"2024-09-13T18:45:56.010525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:22.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.493480+0000","last_change":"2024-09-13T18:45:54.493113+0000","last_active":"2024-09-13T18:45:54.493480+0000","last_peered":"2024-09-13T18:45:54.493480+0000","last_clean":"2024-09-13T18:45:54.493480+0000","last_became_active":"2024-09-13T18:45:54.492826+0000","last_became_peered":"2024-09-13T18:45:54.492826+0000","last_unstale":"2024-09-13T18:45:54.493480+0000","last_undegraded":"2024-09-13T18:45:54.493480+0000","last_fullsized":"2024-09-13T18:45:54.493480+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011394+0000","last_change":"2024-09-13T18:45:54.911578+0000","last_active":"2024-09-13T18:45:56.011394+0000","last_peered":"2024-09-13T18:45:56.011394+0000","last_clean":"2024-09-13T18:45:56.011394+0000","last_became_active":"2024-09-13T18:45:54.909430+0000","last_became_peered":"2024-09-13T18:45:54.909430+0000","last_unstale":"2024-09-13T18:45:56.011394+0000","last_undegraded":"2024-09-13T18:45:56.011394+0000","last_fullsized":"2024-09-13T18:45:56.011394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901562+0000","last_change":"2024-09-13T18:45:54.493581+0000","last_active":"2024-09-13T18:45:54.901562+0000","last_peered":"2024-09-13T18:45:54.901562+0000","last_clean":"2024-09-13T18:45:54.901562+0000","last_became_active":"2024-09-13T18:45:54.493031+0000","last_became_peered":"2024-09-13T18:45:54.493031+0000","last_unstale":"2024-09-13T18:45:54.901562+0000","last_undegraded":"2024-09-13T18:45:54.901562+0000","last_fullsized":"2024-09-13T18:45:54.901562+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:42.168271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010050+0000","last_change":"2024-09-13T18:45:54.909801+0000","last_active":"2024-09-13T18:45:56.010050+0000","last_peered":"2024-09-13T18:45:56.010050+0000","last_clean":"2024-09-13T18:45:56.010050+0000","last_became_active":"2024-09-13T18:45:54.909522+0000","last_became_peered":"2024-09-13T18:45:54.909522+0000","last_unstale":"2024-09-13T18:45:56.010050+0000","last_undegraded":"2024-09-13T18:45:56.010050+0000","last_fullsized":"2024-09-13T18:45:56.010050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918423+0000","last_change":"2024-09-13T18:45:54.496005+0000","last_active":"2024-09-13T18:45:54.918423+0000","last_peered":"2024-09-13T18:45:54.918423+0000","last_clean":"2024-09-13T18:45:54.918423+0000","last_became_active":"2024-09-13T18:45:54.495771+0000","last_became_peered":"2024-09-13T18:45:54.495771+0000","last_unstale":"2024-09-13T18:45:54.918423+0000","last_undegraded":"2024-09-13T18:45:54.918423+0000","last_fullsized":"2024-09-13T18:45:54.918423+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:11.480554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010891+0000","last_change":"2024-09-13T18:45:54.906015+0000","last_active":"2024-09-13T18:45:56.010891+0000","last_peered":"2024-09-13T18:45:56.010891+0000","last_clean":"2024-09-13T18:45:56.010891+0000","last_became_active":"2024-09-13T18:45:54.905438+0000","last_became_peered":"2024-09-13T18:45:54.905438+0000","last_unstale":"2024-09-13T18:45:56.010891+0000","last_undegraded":"2024-09-13T18:45:56.010891+0000","last_fullsized":"2024-09-13T18:45:56.010891+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:44.251416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.897723+0000","last_change":"2024-09-13T18:45:54.493010+0000","last_active":"2024-09-13T18:45:54.897723+0000","last_peered":"2024-09-13T18:45:54.897723+0000","last_clean":"2024-09-13T18:45:54.897723+0000","last_became_active":"2024-09-13T18:45:54.492789+0000","last_became_peered":"2024-09-13T18:45:54.492789+0000","last_unstale":"2024-09-13T18:45:54.897723+0000","last_undegraded":"2024-09-13T18:45:54.897723+0000","last_fullsized":"2024-09-13T18:45:54.897723+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:24.312031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011028+0000","last_change":"2024-09-13T18:45:54.909680+0000","last_active":"2024-09-13T18:45:56.011028+0000","last_peered":"2024-09-13T18:45:56.011028+0000","last_clean":"2024-09-13T18:45:56.011028+0000","last_became_active":"2024-09-13T18:45:54.908615+0000","last_became_peered":"2024-09-13T18:45:54.908615+0000","last_unstale":"2024-09-13T18:45:56.011028+0000","last_undegraded":"2024-09-13T18:45:56.011028+0000","last_fullsized":"2024-09-13T18:45:56.011028+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.898386+0000","last_change":"2024-09-13T18:45:54.484614+0000","last_active":"2024-09-13T18:45:54.898386+0000","last_peered":"2024-09-13T18:45:54.898386+0000","last_clean":"2024-09-13T18:45:54.898386+0000","last_became_active":"2024-09-13T18:45:54.484384+0000","last_became_peered":"2024-09-13T18:45:54.484384+0000","last_unstale":"2024-09-13T18:45:54.898386+0000","last_undegraded":"2024-09-13T18:45:54.898386+0000","last_fullsized":"2024-09-13T18:45:54.898386+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:42.467009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011162+0000","last_change":"2024-09-13T18:45:54.912416+0000","last_active":"2024-09-13T18:45:56.011162+0000","last_peered":"2024-09-13T18:45:56.011162+0000","last_clean":"2024-09-13T18:45:56.011162+0000","last_became_active":"2024-09-13T18:45:54.910464+0000","last_became_peered":"2024-09-13T18:45:54.910464+0000","last_unstale":"2024-09-13T18:45:56.011162+0000","last_undegraded":"2024-09-13T18:45:56.011162+0000","last_fullsized":"2024-09-13T18:45:56.011162+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:39.075198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899634+0000","last_change":"2024-09-13T18:45:54.492800+0000","last_active":"2024-09-13T18:45:54.899634+0000","last_peered":"2024-09-13T18:45:54.899634+0000","last_clean":"2024-09-13T18:45:54.899634+0000","last_became_active":"2024-09-13T18:45:54.492257+0000","last_became_peered":"2024-09-13T18:45:54.492257+0000","last_unstale":"2024-09-13T18:45:54.899634+0000","last_undegraded":"2024-09-13T18:45:54.899634+0000","last_fullsized":"2024-09-13T18:45:54.899634+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:21.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899051+0000","last_change":"2024-09-13T18:45:54.912376+0000","last_active":"2024-09-13T18:45:55.899051+0000","last_peered":"2024-09-13T18:45:55.899051+0000","last_clean":"2024-09-13T18:45:55.899051+0000","last_became_active":"2024-09-13T18:45:54.911994+0000","last_became_peered":"2024-09-13T18:45:54.911994+0000","last_unstale":"2024-09-13T18:45:55.899051+0000","last_undegraded":"2024-09-13T18:45:55.899051+0000","last_fullsized":"2024-09-13T18:45:55.899051+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919785+0000","last_change":"2024-09-13T18:45:54.486957+0000","last_active":"2024-09-13T18:45:54.919785+0000","last_peered":"2024-09-13T18:45:54.919785+0000","last_clean":"2024-09-13T18:45:54.919785+0000","last_became_active":"2024-09-13T18:45:54.486740+0000","last_became_peered":"2024-09-13T18:45:54.486740+0000","last_unstale":"2024-09-13T18:45:54.919785+0000","last_undegraded":"2024-09-13T18:45:54.919785+0000","last_fullsized":"2024-09-13T18:45:54.919785+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:28.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899048+0000","last_change":"2024-09-13T18:45:54.911748+0000","last_active":"2024-09-13T18:45:55.899048+0000","last_peered":"2024-09-13T18:45:55.899048+0000","last_clean":"2024-09-13T18:45:55.899048+0000","last_became_active":"2024-09-13T18:45:54.911536+0000","last_became_peered":"2024-09-13T18:45:54.911536+0000","last_unstale":"2024-09-13T18:45:55.899048+0000","last_undegraded":"2024-09-13T18:45:55.899048+0000","last_fullsized":"2024-09-13T18:45:55.899048+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899403+0000","last_change":"2024-09-13T18:45:54.493256+0000","last_active":"2024-09-13T18:45:54.899403+0000","last_peered":"2024-09-13T18:45:54.899403+0000","last_clean":"2024-09-13T18:45:54.899403+0000","last_became_active":"2024-09-13T18:45:54.492757+0000","last_became_peered":"2024-09-13T18:45:54.492757+0000","last_unstale":"2024-09-13T18:45:54.899403+0000","last_undegraded":"2024-09-13T18:45:54.899403+0000","last_fullsized":"2024-09-13T18:45:54.899403+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:01.290718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898201+0000","last_change":"2024-09-13T18:45:54.906596+0000","last_active":"2024-09-13T18:45:55.898201+0000","last_peered":"2024-09-13T18:45:55.898201+0000","last_clean":"2024-09-13T18:45:55.898201+0000","last_became_active":"2024-09-13T18:45:54.904819+0000","last_became_peered":"2024-09-13T18:45:54.904819+0000","last_unstale":"2024-09-13T18:45:55.898201+0000","last_undegraded":"2024-09-13T18:45:55.898201+0000","last_fullsized":"2024-09-13T18:45:55.898201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:37.224895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.498264+0000","last_change":"2024-09-13T18:45:54.498180+0000","last_active":"2024-09-13T18:45:54.498264+0000","last_peered":"2024-09-13T18:45:54.498264+0000","last_clean":"2024-09-13T18:45:54.498264+0000","last_became_active":"2024-09-13T18:45:54.497907+0000","last_became_peered":"2024-09-13T18:45:54.497907+0000","last_unstale":"2024-09-13T18:45:54.498264+0000","last_undegraded":"2024-09-13T18:45:54.498264+0000","last_fullsized":"2024-09-13T18:45:54.498264+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:26.217332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898271+0000","last_change":"2024-09-13T18:45:54.900842+0000","last_active":"2024-09-13T18:45:55.898271+0000","last_peered":"2024-09-13T18:45:55.898271+0000","last_clean":"2024-09-13T18:45:55.898271+0000","last_became_active":"2024-09-13T18:45:54.900605+0000","last_became_peered":"2024-09-13T18:45:54.900605+0000","last_unstale":"2024-09-13T18:45:55.898271+0000","last_undegraded":"2024-09-13T18:45:55.898271+0000","last_fullsized":"2024-09-13T18:45:55.898271+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:40.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":9,"reported_epoch":178,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.495630+0000","last_change":"2024-09-13T18:45:54.495093+0000","last_active":"2024-09-13T18:45:54.495630+0000","last_peered":"2024-09-13T18:45:54.495630+0000","last_clean":"2024-09-13T18:45:54.495630+0000","last_became_active":"2024-09-13T18:45:54.494822+0000","last_became_peered":"2024-09-13T18:45:54.494822+0000","last_unstale":"2024-09-13T18:45:54.495630+0000","last_undegraded":"2024-09-13T18:45:54.495630+0000","last_fullsized":"2024-09-13T18:45:54.495630+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487336+0000","last_change":"2024-09-13T18:45:54.487336+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487336+0000","last_undegraded":"2024-09-13T18:45:54.487336+0000","last_fullsized":"2024-09-13T18:45:54.487336+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901165+0000","last_change":"2024-09-13T18:45:54.493395+0000","last_active":"2024-09-13T18:45:54.901165+0000","last_peered":"2024-09-13T18:45:54.901165+0000","last_clean":"2024-09-13T18:45:54.901165+0000","last_became_active":"2024-09-13T18:45:54.493125+0000","last_became_peered":"2024-09-13T18:45:54.493125+0000","last_unstale":"2024-09-13T18:45:54.901165+0000","last_undegraded":"2024-09-13T18:45:54.901165+0000","last_fullsized":"2024-09-13T18:45:54.901165+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:59.567811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898992+0000","last_change":"2024-09-13T18:45:54.910921+0000","last_active":"2024-09-13T18:45:55.898992+0000","last_peered":"2024-09-13T18:45:55.898992+0000","last_clean":"2024-09-13T18:45:55.898992+0000","last_became_active":"2024-09-13T18:45:54.909213+0000","last_became_peered":"2024-09-13T18:45:54.909213+0000","last_unstale":"2024-09-13T18:45:55.898992+0000","last_undegraded":"2024-09-13T18:45:55.898992+0000","last_fullsized":"2024-09-13T18:45:55.898992+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:19.183121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904368+0000","last_change":"2024-09-13T18:45:54.490731+0000","last_active":"2024-09-13T18:45:54.904368+0000","last_peered":"2024-09-13T18:45:54.904368+0000","last_clean":"2024-09-13T18:45:54.904368+0000","last_became_active":"2024-09-13T18:45:54.490352+0000","last_became_peered":"2024-09-13T18:45:54.490352+0000","last_unstale":"2024-09-13T18:45:54.904368+0000","last_undegraded":"2024-09-13T18:45:54.904368+0000","last_fullsized":"2024-09-13T18:45:54.904368+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:21.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898977+0000","last_change":"2024-09-13T18:45:54.902428+0000","last_active":"2024-09-13T18:45:55.898977+0000","last_peered":"2024-09-13T18:45:55.898977+0000","last_clean":"2024-09-13T18:45:55.898977+0000","last_became_active":"2024-09-13T18:45:54.902083+0000","last_became_peered":"2024-09-13T18:45:54.902083+0000","last_unstale":"2024-09-13T18:45:55.898977+0000","last_undegraded":"2024-09-13T18:45:55.898977+0000","last_fullsized":"2024-09-13T18:45:55.898977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902720+0000","last_change":"2024-09-13T18:45:54.491923+0000","last_active":"2024-09-13T18:45:54.902720+0000","last_peered":"2024-09-13T18:45:54.902720+0000","last_clean":"2024-09-13T18:45:54.902720+0000","last_became_active":"2024-09-13T18:45:54.491706+0000","last_became_peered":"2024-09-13T18:45:54.491706+0000","last_unstale":"2024-09-13T18:45:54.902720+0000","last_undegraded":"2024-09-13T18:45:54.902720+0000","last_fullsized":"2024-09-13T18:45:54.902720+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:14.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010210+0000","last_change":"2024-09-13T18:45:54.912208+0000","last_active":"2024-09-13T18:45:56.010210+0000","last_peered":"2024-09-13T18:45:56.010210+0000","last_clean":"2024-09-13T18:45:56.010210+0000","last_became_active":"2024-09-13T18:45:54.911794+0000","last_became_peered":"2024-09-13T18:45:54.911794+0000","last_unstale":"2024-09-13T18:45:56.010210+0000","last_undegraded":"2024-09-13T18:45:56.010210+0000","last_fullsized":"2024-09-13T18:45:56.010210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:02.923713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899848+0000","last_change":"2024-09-13T18:45:54.492315+0000","last_active":"2024-09-13T18:45:54.899848+0000","last_peered":"2024-09-13T18:45:54.899848+0000","last_clean":"2024-09-13T18:45:54.899848+0000","last_became_active":"2024-09-13T18:45:54.491338+0000","last_became_peered":"2024-09-13T18:45:54.491338+0000","last_unstale":"2024-09-13T18:45:54.899848+0000","last_undegraded":"2024-09-13T18:45:54.899848+0000","last_fullsized":"2024-09-13T18:45:54.899848+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.194286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":1,"reported_epoch":178,"state":"creating+peering","last_fresh":"2024-09-13T18:45:54.487402+0000","last_change":"2024-09-13T18:45:54.487402+0000","last_active":"2024-09-13T18:45:54.474303+0000","last_peered":"2024-09-13T18:45:54.474303+0000","last_clean":"2024-09-13T18:45:54.474303+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:45:54.487402+0000","last_undegraded":"2024-09-13T18:45:54.487402+0000","last_fullsized":"2024-09-13T18:45:54.487402+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"179'3","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917211+0000","last_change":"2024-09-13T18:45:54.492742+0000","last_active":"2024-09-13T18:45:54.917211+0000","last_peered":"2024-09-13T18:45:54.917211+0000","last_clean":"2024-09-13T18:45:54.917211+0000","last_became_active":"2024-09-13T18:45:54.492518+0000","last_became_peered":"2024-09-13T18:45:54.492518+0000","last_unstale":"2024-09-13T18:45:54.917211+0000","last_undegraded":"2024-09-13T18:45:54.917211+0000","last_fullsized":"2024-09-13T18:45:54.917211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902626+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:45:54.902626+0000","last_peered":"2024-09-13T18:45:54.902626+0000","last_clean":"2024-09-13T18:45:54.902626+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:45:54.902626+0000","last_undegraded":"2024-09-13T18:45:54.902626+0000","last_fullsized":"2024-09-13T18:45:54.902626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":728,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542273,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1545,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193767,"statfs":{"total":200000000,"available":198417438,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52100000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.441},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69299999999999995,"15min":0.65800000000000003},"min":{"1min":0.51800000000000002,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":1.014},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.53800000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":1.004,"15min":1.004},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.999},"last":0.504}]},{"osd":3,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71199999999999997,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.036},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80600000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.63700000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46999999999999997,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.755},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.371},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":1.143},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":1.125},"last":0.79700000000000004}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":1.665},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.57799999999999996,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80300000000000005,"5min":0.96799999999999997,"15min":1.591},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":2.2709999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.0680000000000001,"15min":2.169},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97199999999999998,"15min":1.4450000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.45000000000000001,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.0840000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.504,"5min":0.438,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.0289999999999999,"15min":1.115},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70499999999999996,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.02,"15min":6.4539999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.52700000000000002,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.94199999999999995,"15min":6.5019999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.96399999999999997,"15min":1.032},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.68000000000000005},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":0.97199999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.41499999999999998,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":0.96199999999999997,"15min":1.5509999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.403},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"max":{"1min":0.89300000000000002,"5min":0.97199999999999998,"15min":1.6040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194322,"statfs":{"total":200000000,"available":198986288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.57299999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":1.581,"15min":2.0579999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95099999999999996,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":1.5589999999999999,"15min":3.706},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":2.915,"15min":3.742},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.762,"15min":3.6909999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.40799999999999997},"max":{"1min":0.95999999999999996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.91700000000000004,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.94799999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53500000000000003,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.745},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":1.843,"15min":3.7989999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.94599999999999995,"5min":1.548,"15min":5.5069999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.72499999999999998},"min":{"1min":0.624,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.95999999999999996,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198987840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.64300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.74099999999999999,"5min":1.546,"15min":8.1059999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.81399999999999995,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.626},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":7.798},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.502,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.93899999999999995,"5min":1.0669999999999999,"15min":3.093},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.022,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.84599999999999997},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.105,"5min":1.105,"15min":8.0519999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.64600000000000002,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.499,"15min":0.505},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.327,"5min":1.423,"15min":1.423},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.095,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.45800000000000002},"max":{"1min":1.266,"5min":1.329,"15min":1.329},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.876}]},{"osd":7,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.198,"5min":1.508,"15min":1.508},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1564,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193748,"statfs":{"total":200000000,"available":198398018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":1.6000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69899999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.5,"5min":0.63300000000000001,"15min":1.036},"last":0.372},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.86499999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.64900000000000002,"5min":0.80600000000000005,"15min":1.1870000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.70499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.98099999999999998,"5min":1.3,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:44:54 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":1.242,"15min":1.242},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.86499999999999999,"5min":1.123,"15min":1.21},"last":0.745},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":1.0580000000000001,"15min":1.278},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.498,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.1830000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.76400000000000001},"min":{"1min":0.59699999999999998,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":0.94999999999999996,"5min":1.1399999999999999,"15min":1.1539999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60199999999999998,"5min":0.76700000000000002,"15min":1.669},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.499},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.591},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":0.63700000000000001,"5min":0.70899999999999996,"15min":1.03},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":1.637},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.044,"5min":1.21,"15min":1.21},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.038,"5min":1.056,"15min":1.698},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79100000000000004,"15min":0.76200000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.204},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2190000000000001,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.67400000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.155,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.60899999999999999,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.745,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.165,"15min":2.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77300000000000002,"15min":0.72299999999999998},"min":{"1min":0.65300000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:46:03.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:46:03.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.826+0000 7f3d30c00640 1 Processor -- start 2024-09-13T18:46:03.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.827+0000 7f3d30c00640 1 -- start start 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d30c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3d2c071810 0x7f3d2c0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d30c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3d2c0b2230 0x7f3d2c0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d30c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d2c071dd0 con 0x7f3d2c150480 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d30c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0cb770 con 0x7f3d2c0b2230 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d30c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d2c0cba50 con 0x7f3d2c071810 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d29e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f3d2c150480 0x7f3d2c15a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56348/0 (socket says 172.21.15.192:56348) 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d29e00640 1 -- 172.21.15.192:0/3894708224 learned_addr learned my addr 172.21.15.192:0/3894708224 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:46:03.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d2a800640 1 --2- 172.21.15.192:0/3894708224 >> v2:172.21.15.192:3300/0 conn(0x7f3d2c0b2230 0x7f3d2c0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.828+0000 7f3d21400640 1 --2- 172.21.15.192:0/3894708224 >> v2:172.21.15.194:3300/0 conn(0x7f3d2c071810 0x7f3d2c0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d29400640 1 -- 172.21.15.192:0/3894708224 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747255088 0 0) 0x7f3d2c071dd0 con 0x7f3d2c150480 2024-09-13T18:46:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d29400640 1 -- 172.21.15.192:0/3894708224 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d10003440 con 0x7f3d2c150480 2024-09-13T18:46:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d2a800640 1 -- 172.21.15.192:0/3894708224 >> v2:172.21.15.194:3300/0 conn(0x7f3d2c071810 msgr2=0x7f3d2c0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:03.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d2a800640 1 --2- 172.21.15.192:0/3894708224 >> v2:172.21.15.194:3300/0 conn(0x7f3d2c071810 0x7f3d2c0b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d2a800640 1 -- 172.21.15.192:0/3894708224 >> v1:172.21.15.192:6789/0 conn(0x7f3d2c150480 legacy=0x7f3d2c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.829+0000 7f3d2a800640 1 -- 172.21.15.192:0/3894708224 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d2c0cbd30 con 0x7f3d2c0b2230 2024-09-13T18:46:03.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d2a800640 1 --2- 172.21.15.192:0/3894708224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c0cc530 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c06cb50 tx=0x7f3d2402a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=382603a8aedd46bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d29400640 1 -- 172.21.15.192:0/3894708224 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24007740 con 0x7f3d2c0b2230 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d29400640 1 -- 172.21.15.192:0/3894708224 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d2402d050 con 0x7f3d2c0b2230 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d29400640 1 -- 172.21.15.192:0/3894708224 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d24007ac0 con 0x7f3d2c0b2230 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d30c00640 1 -- 172.21.15.192:0/3894708224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 msgr2=0x7f3d2c0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.830+0000 7f3d30c00640 1 --2- 172.21.15.192:0/3894708224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c0cc530 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f3d2c06cb50 tx=0x7f3d2402a5f0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 -- 172.21.15.192:0/3894708224 shutdown_connections 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 --2- 172.21.15.192:0/3894708224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c0cc530 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 --2- 172.21.15.192:0/3894708224 >> v2:172.21.15.194:3300/0 conn(0x7f3d2c071810 0x7f3d2c0b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 -- 172.21.15.192:0/3894708224 >> 172.21.15.192:0/3894708224 conn(0x7f3d2c0ae960 msgr2=0x7f3d2c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:03.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 -- 172.21.15.192:0/3894708224 shutdown_connections 2024-09-13T18:46:03.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.831+0000 7f3d30c00640 1 -- 172.21.15.192:0/3894708224 wait complete. 2024-09-13T18:46:03.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.832+0000 7f3d30c00640 1 Processor -- start 2024-09-13T18:46:03.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.832+0000 7f3d30c00640 1 -- start start 2024-09-13T18:46:03.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 0x7f3d2c070f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 0x7f3d2c142b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c06f080 con 0x7f3d2c0b2230 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c06f360 con 0x7f3d2c150480 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.833+0000 7f3d30c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d2c06f640 con 0x7f3d2c071810 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33614/0 (socket says 172.21.15.192:33614) 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 -- 172.21.15.192:0/2447072869 learned_addr learned my addr 172.21.15.192:0/2447072869 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d29e00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 0x7f3d2c070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d2a800640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 0x7f3d2c142b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 -- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 msgr2=0x7f3d2c070f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 0x7f3d2c070f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 -- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 msgr2=0x7f3d2c142b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 0x7f3d2c142b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 -- 172.21.15.192:0/2447072869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d24009a70 con 0x7f3d2c0b2230 2024-09-13T18:46:03.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d29e00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 0x7f3d2c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d2a800640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 0x7f3d2c142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.834+0000 7f3d21400640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400e9b0 tx=0x7f3d1400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.835+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d14009670 con 0x7f3d2c0b2230 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.835+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1400c9a0 con 0x7f3d2c0b2230 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.835+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d2c06f920 con 0x7f3d2c0b2230 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.835+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400cd50 con 0x7f3d2c0b2230 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.835+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d2c0714c0 con 0x7f3d2c0b2230 2024-09-13T18:46:03.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.836+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d2c071dd0 con 0x7f3d2c0b2230 2024-09-13T18:46:03.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.836+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3d14013470 con 0x7f3d2c0b2230 2024-09-13T18:46:03.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.837+0000 7f3d22a00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 0x7f3d0806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:03.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.837+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d14089640 con 0x7f3d2c0b2230 2024-09-13T18:46:03.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.838+0000 7f3d29e00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 0x7f3d0806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:03.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.838+0000 7f3d29e00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 0x7f3d0806d0c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0011e0 tx=0x7f3d1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:03.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:03.842+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3d14054780 con 0x7f3d2c0b2230 2024-09-13T18:46:04.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.008+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d2c150860 con 0x7f3d0806ac00 2024-09-13T18:46:04.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.016+0000 7f3d22a00640 1 -- 172.21.15.192:0/2447072869 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285220 (secure 0 0 0) 0x7f3d1c0013d0 con 0x7f3d0806ac00 2024-09-13T18:46:04.022 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:46:04.023 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 msgr2=0x7f3d0806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 0x7f3d0806d0c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c0011e0 tx=0x7f3d1c009040 comp rx=0 tx=0).stop 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 msgr2=0x7f3d2c1f2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3d1400e9b0 tx=0x7f3d1400ee70 comp rx=0 tx=0).stop 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 shutdown_connections 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3d0806ac00 0x7f3d0806d0c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3d2c150480 0x7f3d2c142b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d2c0b2230 0x7f3d2c1f2c30 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 --2- 172.21.15.192:0/2447072869 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3d2c071810 0x7f3d2c070f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 >> 172.21.15.192:0/2447072869 conn(0x7f3d2c0ae960 msgr2=0x7f3d2c158b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 shutdown_connections 2024-09-13T18:46:04.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.020+0000 7f3d30c00640 1 -- 172.21.15.192:0/2447072869 wait complete. 2024-09-13T18:46:04.039 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":489,"stamp":"2024-09-13T18:46:02.875626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553439,"statfs":{"total":1600000000,"available":1590722188,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001846"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897776+0000","last_change":"2024-09-13T18:45:54.901750+0000","last_active":"2024-09-13T18:45:55.897776+0000","last_peered":"2024-09-13T18:45:55.897776+0000","last_clean":"2024-09-13T18:45:55.897776+0000","last_became_active":"2024-09-13T18:45:54.901533+0000","last_became_peered":"2024-09-13T18:45:54.901533+0000","last_unstale":"2024-09-13T18:45:55.897776+0000","last_undegraded":"2024-09-13T18:45:55.897776+0000","last_fullsized":"2024-09-13T18:45:55.897776+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:47:01.183202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010599+0000","last_change":"2024-09-13T18:45:54.902052+0000","last_active":"2024-09-13T18:45:56.010599+0000","last_peered":"2024-09-13T18:45:56.010599+0000","last_clean":"2024-09-13T18:45:56.010599+0000","last_became_active":"2024-09-13T18:45:54.901778+0000","last_became_peered":"2024-09-13T18:45:54.901778+0000","last_unstale":"2024-09-13T18:45:56.010599+0000","last_undegraded":"2024-09-13T18:45:56.010599+0000","last_fullsized":"2024-09-13T18:45:56.010599+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:43.473451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010448+0000","last_change":"2024-09-13T18:45:54.912065+0000","last_active":"2024-09-13T18:45:56.010448+0000","last_peered":"2024-09-13T18:45:56.010448+0000","last_clean":"2024-09-13T18:45:56.010448+0000","last_became_active":"2024-09-13T18:45:54.909940+0000","last_became_peered":"2024-09-13T18:45:54.909940+0000","last_unstale":"2024-09-13T18:45:56.010448+0000","last_undegraded":"2024-09-13T18:45:56.010448+0000","last_fullsized":"2024-09-13T18:45:56.010448+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:16:47.687307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898616+0000","last_change":"2024-09-13T18:45:54.910427+0000","last_active":"2024-09-13T18:45:55.898616+0000","last_peered":"2024-09-13T18:45:55.898616+0000","last_clean":"2024-09-13T18:45:55.898616+0000","last_became_active":"2024-09-13T18:45:54.910087+0000","last_became_peered":"2024-09-13T18:45:54.910087+0000","last_unstale":"2024-09-13T18:45:55.898616+0000","last_undegraded":"2024-09-13T18:45:55.898616+0000","last_fullsized":"2024-09-13T18:45:55.898616+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:27.223775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011663+0000","last_change":"2024-09-13T18:45:54.910009+0000","last_active":"2024-09-13T18:45:56.011663+0000","last_peered":"2024-09-13T18:45:56.011663+0000","last_clean":"2024-09-13T18:45:56.011663+0000","last_became_active":"2024-09-13T18:45:54.909801+0000","last_became_peered":"2024-09-13T18:45:54.909801+0000","last_unstale":"2024-09-13T18:45:56.011663+0000","last_undegraded":"2024-09-13T18:45:56.011663+0000","last_fullsized":"2024-09-13T18:45:56.011663+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:34:36.347672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011555+0000","last_change":"2024-09-13T18:45:54.911923+0000","last_active":"2024-09-13T18:45:56.011555+0000","last_peered":"2024-09-13T18:45:56.011555+0000","last_clean":"2024-09-13T18:45:56.011555+0000","last_became_active":"2024-09-13T18:45:54.911356+0000","last_became_peered":"2024-09-13T18:45:54.911356+0000","last_unstale":"2024-09-13T18:45:56.011555+0000","last_undegraded":"2024-09-13T18:45:56.011555+0000","last_fullsized":"2024-09-13T18:45:56.011555+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.910102+0000","last_change":"2024-09-13T18:45:54.910021+0000","last_active":"2024-09-13T18:45:54.910102+0000","last_peered":"2024-09-13T18:45:54.910102+0000","last_clean":"2024-09-13T18:45:54.910102+0000","last_became_active":"2024-09-13T18:45:54.908643+0000","last_became_peered":"2024-09-13T18:45:54.908643+0000","last_unstale":"2024-09-13T18:45:54.910102+0000","last_undegraded":"2024-09-13T18:45:54.910102+0000","last_fullsized":"2024-09-13T18:45:54.910102+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897854+0000","last_change":"2024-09-13T18:45:54.907913+0000","last_active":"2024-09-13T18:45:55.897854+0000","last_peered":"2024-09-13T18:45:55.897854+0000","last_clean":"2024-09-13T18:45:55.897854+0000","last_became_active":"2024-09-13T18:45:54.906386+0000","last_became_peered":"2024-09-13T18:45:54.906386+0000","last_unstale":"2024-09-13T18:45:55.897854+0000","last_undegraded":"2024-09-13T18:45:55.897854+0000","last_fullsized":"2024-09-13T18:45:55.897854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:13:36.005604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011137+0000","last_change":"2024-09-13T18:45:54.905215+0000","last_active":"2024-09-13T18:45:56.011137+0000","last_peered":"2024-09-13T18:45:56.011137+0000","last_clean":"2024-09-13T18:45:56.011137+0000","last_became_active":"2024-09-13T18:45:54.904546+0000","last_became_peered":"2024-09-13T18:45:54.904546+0000","last_unstale":"2024-09-13T18:45:56.011137+0000","last_undegraded":"2024-09-13T18:45:56.011137+0000","last_fullsized":"2024-09-13T18:45:56.011137+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011337+0000","last_change":"2024-09-13T18:45:54.920649+0000","last_active":"2024-09-13T18:45:56.011337+0000","last_peered":"2024-09-13T18:45:56.011337+0000","last_clean":"2024-09-13T18:45:56.011337+0000","last_became_active":"2024-09-13T18:45:54.919304+0000","last_became_peered":"2024-09-13T18:45:54.919304+0000","last_unstale":"2024-09-13T18:45:56.011337+0000","last_undegraded":"2024-09-13T18:45:56.011337+0000","last_fullsized":"2024-09-13T18:45:56.011337+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:41:37.311809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011203+0000","last_change":"2024-09-13T18:45:54.905859+0000","last_active":"2024-09-13T18:45:56.011203+0000","last_peered":"2024-09-13T18:45:56.011203+0000","last_clean":"2024-09-13T18:45:56.011203+0000","last_became_active":"2024-09-13T18:45:54.905045+0000","last_became_peered":"2024-09-13T18:45:54.905045+0000","last_unstale":"2024-09-13T18:45:56.011203+0000","last_undegraded":"2024-09-13T18:45:56.011203+0000","last_fullsized":"2024-09-13T18:45:56.011203+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010854+0000","last_change":"2024-09-13T18:45:54.916941+0000","last_active":"2024-09-13T18:45:56.010854+0000","last_peered":"2024-09-13T18:45:56.010854+0000","last_clean":"2024-09-13T18:45:56.010854+0000","last_became_active":"2024-09-13T18:45:54.916473+0000","last_became_peered":"2024-09-13T18:45:54.916473+0000","last_unstale":"2024-09-13T18:45:56.010854+0000","last_undegraded":"2024-09-13T18:45:56.010854+0000","last_fullsized":"2024-09-13T18:45:56.010854+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010195+0000","last_change":"2024-09-13T18:45:54.909427+0000","last_active":"2024-09-13T18:45:56.010195+0000","last_peered":"2024-09-13T18:45:56.010195+0000","last_clean":"2024-09-13T18:45:56.010195+0000","last_became_active":"2024-09-13T18:45:54.909217+0000","last_became_peered":"2024-09-13T18:45:54.909217+0000","last_unstale":"2024-09-13T18:45:56.010195+0000","last_undegraded":"2024-09-13T18:45:56.010195+0000","last_fullsized":"2024-09-13T18:45:56.010195+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:38.177689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010199+0000","last_change":"2024-09-13T18:45:54.906851+0000","last_active":"2024-09-13T18:45:56.010199+0000","last_peered":"2024-09-13T18:45:56.010199+0000","last_clean":"2024-09-13T18:45:56.010199+0000","last_became_active":"2024-09-13T18:45:54.906648+0000","last_became_peered":"2024-09-13T18:45:54.906648+0000","last_unstale":"2024-09-13T18:45:56.010199+0000","last_undegraded":"2024-09-13T18:45:56.010199+0000","last_fullsized":"2024-09-13T18:45:56.010199+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011707+0000","last_change":"2024-09-13T18:45:54.908866+0000","last_active":"2024-09-13T18:45:56.011707+0000","last_peered":"2024-09-13T18:45:56.011707+0000","last_clean":"2024-09-13T18:45:56.011707+0000","last_became_active":"2024-09-13T18:45:54.908632+0000","last_became_peered":"2024-09-13T18:45:54.908632+0000","last_unstale":"2024-09-13T18:45:56.011707+0000","last_undegraded":"2024-09-13T18:45:56.011707+0000","last_fullsized":"2024-09-13T18:45:56.011707+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:27:42.121006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.909550+0000","last_change":"2024-09-13T18:45:54.909291+0000","last_active":"2024-09-13T18:45:54.909550+0000","last_peered":"2024-09-13T18:45:54.909550+0000","last_clean":"2024-09-13T18:45:54.909550+0000","last_became_active":"2024-09-13T18:45:54.908967+0000","last_became_peered":"2024-09-13T18:45:54.908967+0000","last_unstale":"2024-09-13T18:45:54.909550+0000","last_undegraded":"2024-09-13T18:45:54.909550+0000","last_fullsized":"2024-09-13T18:45:54.909550+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010405+0000","last_change":"2024-09-13T18:45:54.918944+0000","last_active":"2024-09-13T18:45:56.010405+0000","last_peered":"2024-09-13T18:45:56.010405+0000","last_clean":"2024-09-13T18:45:56.010405+0000","last_became_active":"2024-09-13T18:45:54.917581+0000","last_became_peered":"2024-09-13T18:45:54.917581+0000","last_unstale":"2024-09-13T18:45:56.010405+0000","last_undegraded":"2024-09-13T18:45:56.010405+0000","last_fullsized":"2024-09-13T18:45:56.010405+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:32.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010281+0000","last_change":"2024-09-13T18:45:54.905549+0000","last_active":"2024-09-13T18:45:56.010281+0000","last_peered":"2024-09-13T18:45:56.010281+0000","last_clean":"2024-09-13T18:45:56.010281+0000","last_became_active":"2024-09-13T18:45:54.905342+0000","last_became_peered":"2024-09-13T18:45:54.905342+0000","last_unstale":"2024-09-13T18:45:56.010281+0000","last_undegraded":"2024-09-13T18:45:56.010281+0000","last_fullsized":"2024-09-13T18:45:56.010281+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:29:01.893841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898360+0000","last_change":"2024-09-13T18:45:54.902557+0000","last_active":"2024-09-13T18:45:55.898360+0000","last_peered":"2024-09-13T18:45:55.898360+0000","last_clean":"2024-09-13T18:45:55.898360+0000","last_became_active":"2024-09-13T18:45:54.902298+0000","last_became_peered":"2024-09-13T18:45:54.902298+0000","last_unstale":"2024-09-13T18:45:55.898360+0000","last_undegraded":"2024-09-13T18:45:55.898360+0000","last_fullsized":"2024-09-13T18:45:55.898360+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:59.144087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897970+0000","last_change":"2024-09-13T18:45:54.906737+0000","last_active":"2024-09-13T18:45:55.897970+0000","last_peered":"2024-09-13T18:45:55.897970+0000","last_clean":"2024-09-13T18:45:55.897970+0000","last_became_active":"2024-09-13T18:45:54.905140+0000","last_became_peered":"2024-09-13T18:45:54.905140+0000","last_unstale":"2024-09-13T18:45:55.897970+0000","last_undegraded":"2024-09-13T18:45:55.897970+0000","last_fullsized":"2024-09-13T18:45:55.897970+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:35:09.859640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010935+0000","last_change":"2024-09-13T18:45:54.920838+0000","last_active":"2024-09-13T18:45:56.010935+0000","last_peered":"2024-09-13T18:45:56.010935+0000","last_clean":"2024-09-13T18:45:56.010935+0000","last_became_active":"2024-09-13T18:45:54.920389+0000","last_became_peered":"2024-09-13T18:45:54.920389+0000","last_unstale":"2024-09-13T18:45:56.010935+0000","last_undegraded":"2024-09-13T18:45:56.010935+0000","last_fullsized":"2024-09-13T18:45:56.010935+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:08:04.690253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010936+0000","last_change":"2024-09-13T18:45:54.913459+0000","last_active":"2024-09-13T18:45:56.010936+0000","last_peered":"2024-09-13T18:45:56.010936+0000","last_clean":"2024-09-13T18:45:56.010936+0000","last_became_active":"2024-09-13T18:45:54.911505+0000","last_became_peered":"2024-09-13T18:45:54.911505+0000","last_unstale":"2024-09-13T18:45:56.010936+0000","last_undegraded":"2024-09-13T18:45:56.010936+0000","last_fullsized":"2024-09-13T18:45:56.010936+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898627+0000","last_change":"2024-09-13T18:45:54.905226+0000","last_active":"2024-09-13T18:45:55.898627+0000","last_peered":"2024-09-13T18:45:55.898627+0000","last_clean":"2024-09-13T18:45:55.898627+0000","last_became_active":"2024-09-13T18:45:54.904669+0000","last_became_peered":"2024-09-13T18:45:54.904669+0000","last_unstale":"2024-09-13T18:45:55.898627+0000","last_undegraded":"2024-09-13T18:45:55.898627+0000","last_fullsized":"2024-09-13T18:45:55.898627+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:06.638083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.009933+0000","last_change":"2024-09-13T18:45:54.916788+0000","last_active":"2024-09-13T18:45:56.009933+0000","last_peered":"2024-09-13T18:45:56.009933+0000","last_clean":"2024-09-13T18:45:56.009933+0000","last_became_active":"2024-09-13T18:45:54.916454+0000","last_became_peered":"2024-09-13T18:45:54.916454+0000","last_unstale":"2024-09-13T18:45:56.009933+0000","last_undegraded":"2024-09-13T18:45:56.009933+0000","last_fullsized":"2024-09-13T18:45:56.009933+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:10:17.455557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010997+0000","last_change":"2024-09-13T18:45:54.907911+0000","last_active":"2024-09-13T18:45:56.010997+0000","last_peered":"2024-09-13T18:45:56.010997+0000","last_clean":"2024-09-13T18:45:56.010997+0000","last_became_active":"2024-09-13T18:45:54.907654+0000","last_became_peered":"2024-09-13T18:45:54.907654+0000","last_unstale":"2024-09-13T18:45:56.010997+0000","last_undegraded":"2024-09-13T18:45:56.010997+0000","last_fullsized":"2024-09-13T18:45:56.010997+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:05:57.052574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.897669+0000","last_change":"2024-09-13T18:45:54.904016+0000","last_active":"2024-09-13T18:45:55.897669+0000","last_peered":"2024-09-13T18:45:55.897669+0000","last_clean":"2024-09-13T18:45:55.897669+0000","last_became_active":"2024-09-13T18:45:54.903783+0000","last_became_peered":"2024-09-13T18:45:54.903783+0000","last_unstale":"2024-09-13T18:45:55.897669+0000","last_undegraded":"2024-09-13T18:45:55.897669+0000","last_fullsized":"2024-09-13T18:45:55.897669+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:39:51.133236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010717+0000","last_change":"2024-09-13T18:45:54.907422+0000","last_active":"2024-09-13T18:45:56.010717+0000","last_peered":"2024-09-13T18:45:56.010717+0000","last_clean":"2024-09-13T18:45:56.010717+0000","last_became_active":"2024-09-13T18:45:54.907213+0000","last_became_peered":"2024-09-13T18:45:54.907213+0000","last_unstale":"2024-09-13T18:45:56.010717+0000","last_undegraded":"2024-09-13T18:45:56.010717+0000","last_fullsized":"2024-09-13T18:45:56.010717+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:27:34.474938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010677+0000","last_change":"2024-09-13T18:45:54.902283+0000","last_active":"2024-09-13T18:45:56.010677+0000","last_peered":"2024-09-13T18:45:56.010677+0000","last_clean":"2024-09-13T18:45:56.010677+0000","last_became_active":"2024-09-13T18:45:54.901696+0000","last_became_peered":"2024-09-13T18:45:54.901696+0000","last_unstale":"2024-09-13T18:45:56.010677+0000","last_undegraded":"2024-09-13T18:45:56.010677+0000","last_fullsized":"2024-09-13T18:45:56.010677+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:07.263140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898174+0000","last_change":"2024-09-13T18:45:54.911220+0000","last_active":"2024-09-13T18:45:55.898174+0000","last_peered":"2024-09-13T18:45:55.898174+0000","last_clean":"2024-09-13T18:45:55.898174+0000","last_became_active":"2024-09-13T18:45:54.910394+0000","last_became_peered":"2024-09-13T18:45:54.910394+0000","last_unstale":"2024-09-13T18:45:55.898174+0000","last_undegraded":"2024-09-13T18:45:55.898174+0000","last_fullsized":"2024-09-13T18:45:55.898174+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:53:51.141776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010800+0000","last_change":"2024-09-13T18:45:54.910226+0000","last_active":"2024-09-13T18:45:56.010800+0000","last_peered":"2024-09-13T18:45:56.010800+0000","last_clean":"2024-09-13T18:45:56.010800+0000","last_became_active":"2024-09-13T18:45:54.909900+0000","last_became_peered":"2024-09-13T18:45:54.909900+0000","last_unstale":"2024-09-13T18:45:56.010800+0000","last_undegraded":"2024-09-13T18:45:56.010800+0000","last_fullsized":"2024-09-13T18:45:56.010800+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010778+0000","last_change":"2024-09-13T18:45:54.906078+0000","last_active":"2024-09-13T18:45:56.010778+0000","last_peered":"2024-09-13T18:45:56.010778+0000","last_clean":"2024-09-13T18:45:56.010778+0000","last_became_active":"2024-09-13T18:45:54.905848+0000","last_became_peered":"2024-09-13T18:45:54.905848+0000","last_unstale":"2024-09-13T18:45:56.010778+0000","last_undegraded":"2024-09-13T18:45:56.010778+0000","last_fullsized":"2024-09-13T18:45:56.010778+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:30:00.941799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010831+0000","last_change":"2024-09-13T18:45:54.909954+0000","last_active":"2024-09-13T18:45:56.010831+0000","last_peered":"2024-09-13T18:45:56.010831+0000","last_clean":"2024-09-13T18:45:56.010831+0000","last_became_active":"2024-09-13T18:45:54.909730+0000","last_became_peered":"2024-09-13T18:45:54.909730+0000","last_unstale":"2024-09-13T18:45:56.010831+0000","last_undegraded":"2024-09-13T18:45:56.010831+0000","last_fullsized":"2024-09-13T18:45:56.010831+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:56:43.640922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010020+0000","last_change":"2024-09-13T18:45:54.916653+0000","last_active":"2024-09-13T18:45:56.010020+0000","last_peered":"2024-09-13T18:45:56.010020+0000","last_clean":"2024-09-13T18:45:56.010020+0000","last_became_active":"2024-09-13T18:45:54.916130+0000","last_became_peered":"2024-09-13T18:45:54.916130+0000","last_unstale":"2024-09-13T18:45:56.010020+0000","last_undegraded":"2024-09-13T18:45:56.010020+0000","last_fullsized":"2024-09-13T18:45:56.010020+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:15:06.281655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1f","version":"179'4","reported_seq":15,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921504+0000","last_change":"2024-09-13T18:45:54.496811+0000","last_active":"2024-09-13T18:45:54.921504+0000","last_peered":"2024-09-13T18:45:54.921504+0000","last_clean":"2024-09-13T18:45:54.921504+0000","last_became_active":"2024-09-13T18:45:54.496586+0000","last_became_peered":"2024-09-13T18:45:54.496586+0000","last_unstale":"2024-09-13T18:45:54.921504+0000","last_undegraded":"2024-09-13T18:45:54.921504+0000","last_fullsized":"2024-09-13T18:45:54.921504+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:42:48.492453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.910890+0000","last_change":"2024-09-13T18:45:54.910261+0000","last_active":"2024-09-13T18:45:54.910890+0000","last_peered":"2024-09-13T18:45:54.910890+0000","last_clean":"2024-09-13T18:45:54.910890+0000","last_became_active":"2024-09-13T18:45:54.909909+0000","last_became_peered":"2024-09-13T18:45:54.909909+0000","last_unstale":"2024-09-13T18:45:54.910890+0000","last_undegraded":"2024-09-13T18:45:54.910890+0000","last_fullsized":"2024-09-13T18:45:54.910890+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.1e","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917380+0000","last_change":"2024-09-13T18:45:54.492450+0000","last_active":"2024-09-13T18:45:54.917380+0000","last_peered":"2024-09-13T18:45:54.917380+0000","last_clean":"2024-09-13T18:45:54.917380+0000","last_became_active":"2024-09-13T18:45:54.491715+0000","last_became_peered":"2024-09-13T18:45:54.491715+0000","last_unstale":"2024-09-13T18:45:54.917380+0000","last_undegraded":"2024-09-13T18:45:54.917380+0000","last_fullsized":"2024-09-13T18:45:54.917380+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:10:37.803308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011301+0000","last_change":"2024-09-13T18:45:54.911792+0000","last_active":"2024-09-13T18:45:56.011301+0000","last_peered":"2024-09-13T18:45:56.011301+0000","last_clean":"2024-09-13T18:45:56.011301+0000","last_became_active":"2024-09-13T18:45:54.910953+0000","last_became_peered":"2024-09-13T18:45:54.910953+0000","last_unstale":"2024-09-13T18:45:56.011301+0000","last_undegraded":"2024-09-13T18:45:56.011301+0000","last_fullsized":"2024-09-13T18:45:56.011301+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.1d","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918338+0000","last_change":"2024-09-13T18:45:54.495172+0000","last_active":"2024-09-13T18:45:54.918338+0000","last_peered":"2024-09-13T18:45:54.918338+0000","last_clean":"2024-09-13T18:45:54.918338+0000","last_became_active":"2024-09-13T18:45:54.494637+0000","last_became_peered":"2024-09-13T18:45:54.494637+0000","last_unstale":"2024-09-13T18:45:54.918338+0000","last_undegraded":"2024-09-13T18:45:54.918338+0000","last_fullsized":"2024-09-13T18:45:54.918338+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:56:28.259271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898980+0000","last_change":"2024-09-13T18:45:54.915501+0000","last_active":"2024-09-13T18:45:55.898980+0000","last_peered":"2024-09-13T18:45:55.898980+0000","last_clean":"2024-09-13T18:45:55.898980+0000","last_became_active":"2024-09-13T18:45:54.915141+0000","last_became_peered":"2024-09-13T18:45:54.915141+0000","last_unstale":"2024-09-13T18:45:55.898980+0000","last_undegraded":"2024-09-13T18:45:55.898980+0000","last_fullsized":"2024-09-13T18:45:55.898980+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:04.085442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1c","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920696+0000","last_change":"2024-09-13T18:45:54.496083+0000","last_active":"2024-09-13T18:45:54.920696+0000","last_peered":"2024-09-13T18:45:54.920696+0000","last_clean":"2024-09-13T18:45:54.920696+0000","last_became_active":"2024-09-13T18:45:54.495784+0000","last_became_peered":"2024-09-13T18:45:54.495784+0000","last_unstale":"2024-09-13T18:45:54.920696+0000","last_undegraded":"2024-09-13T18:45:54.920696+0000","last_fullsized":"2024-09-13T18:45:54.920696+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:57:07.785392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010793+0000","last_change":"2024-09-13T18:45:54.907306+0000","last_active":"2024-09-13T18:45:56.010793+0000","last_peered":"2024-09-13T18:45:56.010793+0000","last_clean":"2024-09-13T18:45:56.010793+0000","last_became_active":"2024-09-13T18:45:54.907088+0000","last_became_peered":"2024-09-13T18:45:54.907088+0000","last_unstale":"2024-09-13T18:45:56.010793+0000","last_undegraded":"2024-09-13T18:45:56.010793+0000","last_fullsized":"2024-09-13T18:45:56.010793+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:00:48.319805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1b","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919010+0000","last_change":"2024-09-13T18:45:54.486281+0000","last_active":"2024-09-13T18:45:54.919010+0000","last_peered":"2024-09-13T18:45:54.919010+0000","last_clean":"2024-09-13T18:45:54.919010+0000","last_became_active":"2024-09-13T18:45:54.485730+0000","last_became_peered":"2024-09-13T18:45:54.485730+0000","last_unstale":"2024-09-13T18:45:54.919010+0000","last_undegraded":"2024-09-13T18:45:54.919010+0000","last_fullsized":"2024-09-13T18:45:54.919010+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:18.176678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898569+0000","last_change":"2024-09-13T18:45:54.914232+0000","last_active":"2024-09-13T18:45:55.898569+0000","last_peered":"2024-09-13T18:45:55.898569+0000","last_clean":"2024-09-13T18:45:55.898569+0000","last_became_active":"2024-09-13T18:45:54.913955+0000","last_became_peered":"2024-09-13T18:45:54.913955+0000","last_unstale":"2024-09-13T18:45:55.898569+0000","last_undegraded":"2024-09-13T18:45:55.898569+0000","last_fullsized":"2024-09-13T18:45:55.898569+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:23.468384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1a","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920875+0000","last_change":"2024-09-13T18:45:54.494883+0000","last_active":"2024-09-13T18:45:54.920875+0000","last_peered":"2024-09-13T18:45:54.920875+0000","last_clean":"2024-09-13T18:45:54.920875+0000","last_became_active":"2024-09-13T18:45:54.494664+0000","last_became_peered":"2024-09-13T18:45:54.494664+0000","last_unstale":"2024-09-13T18:45:54.920875+0000","last_undegraded":"2024-09-13T18:45:54.920875+0000","last_fullsized":"2024-09-13T18:45:54.920875+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:22:34.997445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011108+0000","last_change":"2024-09-13T18:45:54.912604+0000","last_active":"2024-09-13T18:45:56.011108+0000","last_peered":"2024-09-13T18:45:56.011108+0000","last_clean":"2024-09-13T18:45:56.011108+0000","last_became_active":"2024-09-13T18:45:54.912148+0000","last_became_peered":"2024-09-13T18:45:54.912148+0000","last_unstale":"2024-09-13T18:45:56.011108+0000","last_undegraded":"2024-09-13T18:45:56.011108+0000","last_fullsized":"2024-09-13T18:45:56.011108+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:42:07.339063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899755+0000","last_change":"2024-09-13T18:45:54.496659+0000","last_active":"2024-09-13T18:45:54.899755+0000","last_peered":"2024-09-13T18:45:54.899755+0000","last_clean":"2024-09-13T18:45:54.899755+0000","last_became_active":"2024-09-13T18:45:54.492022+0000","last_became_peered":"2024-09-13T18:45:54.492022+0000","last_unstale":"2024-09-13T18:45:54.899755+0000","last_undegraded":"2024-09-13T18:45:54.899755+0000","last_fullsized":"2024-09-13T18:45:54.899755+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:20:51.428747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898877+0000","last_change":"2024-09-13T18:45:54.902303+0000","last_active":"2024-09-13T18:45:55.898877+0000","last_peered":"2024-09-13T18:45:55.898877+0000","last_clean":"2024-09-13T18:45:55.898877+0000","last_became_active":"2024-09-13T18:45:54.901738+0000","last_became_peered":"2024-09-13T18:45:54.901738+0000","last_unstale":"2024-09-13T18:45:55.898877+0000","last_undegraded":"2024-09-13T18:45:55.898877+0000","last_fullsized":"2024-09-13T18:45:55.898877+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:48:25.332252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.908844+0000","last_change":"2024-09-13T18:45:54.495032+0000","last_active":"2024-09-13T18:45:54.908844+0000","last_peered":"2024-09-13T18:45:54.908844+0000","last_clean":"2024-09-13T18:45:54.908844+0000","last_became_active":"2024-09-13T18:45:54.494407+0000","last_became_peered":"2024-09-13T18:45:54.494407+0000","last_unstale":"2024-09-13T18:45:54.908844+0000","last_undegraded":"2024-09-13T18:45:54.908844+0000","last_fullsized":"2024-09-13T18:45:54.908844+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:36:12.756996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898654+0000","last_change":"2024-09-13T18:45:54.907873+0000","last_active":"2024-09-13T18:45:55.898654+0000","last_peered":"2024-09-13T18:45:55.898654+0000","last_clean":"2024-09-13T18:45:55.898654+0000","last_became_active":"2024-09-13T18:45:54.906361+0000","last_became_peered":"2024-09-13T18:45:54.906361+0000","last_unstale":"2024-09-13T18:45:55.898654+0000","last_undegraded":"2024-09-13T18:45:55.898654+0000","last_fullsized":"2024-09-13T18:45:55.898654+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:58:33.691271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899665+0000","last_change":"2024-09-13T18:45:54.486090+0000","last_active":"2024-09-13T18:45:54.899665+0000","last_peered":"2024-09-13T18:45:54.899665+0000","last_clean":"2024-09-13T18:45:54.899665+0000","last_became_active":"2024-09-13T18:45:54.485779+0000","last_became_peered":"2024-09-13T18:45:54.485779+0000","last_unstale":"2024-09-13T18:45:54.899665+0000","last_undegraded":"2024-09-13T18:45:54.899665+0000","last_fullsized":"2024-09-13T18:45:54.899665+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:28:50.156625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010952+0000","last_change":"2024-09-13T18:45:54.911423+0000","last_active":"2024-09-13T18:45:56.010952+0000","last_peered":"2024-09-13T18:45:56.010952+0000","last_clean":"2024-09-13T18:45:56.010952+0000","last_became_active":"2024-09-13T18:45:54.910239+0000","last_became_peered":"2024-09-13T18:45:54.910239+0000","last_unstale":"2024-09-13T18:45:56.010952+0000","last_undegraded":"2024-09-13T18:45:56.010952+0000","last_fullsized":"2024-09-13T18:45:56.010952+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:04:56.176422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.903358+0000","last_change":"2024-09-13T18:45:54.491468+0000","last_active":"2024-09-13T18:45:54.903358+0000","last_peered":"2024-09-13T18:45:54.903358+0000","last_clean":"2024-09-13T18:45:54.903358+0000","last_became_active":"2024-09-13T18:45:54.491217+0000","last_became_peered":"2024-09-13T18:45:54.491217+0000","last_unstale":"2024-09-13T18:45:54.903358+0000","last_undegraded":"2024-09-13T18:45:54.903358+0000","last_fullsized":"2024-09-13T18:45:54.903358+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:13:35.312903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.910874+0000","last_change":"2024-09-13T18:45:54.910118+0000","last_active":"2024-09-13T18:45:54.910874+0000","last_peered":"2024-09-13T18:45:54.910874+0000","last_clean":"2024-09-13T18:45:54.910874+0000","last_became_active":"2024-09-13T18:45:54.909572+0000","last_became_peered":"2024-09-13T18:45:54.909572+0000","last_unstale":"2024-09-13T18:45:54.910874+0000","last_undegraded":"2024-09-13T18:45:54.910874+0000","last_fullsized":"2024-09-13T18:45:54.910874+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:45:48.403689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.14","version":"179'6","reported_seq":17,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.921940+0000","last_change":"2024-09-13T18:45:54.498701+0000","last_active":"2024-09-13T18:45:54.921940+0000","last_peered":"2024-09-13T18:45:54.921940+0000","last_clean":"2024-09-13T18:45:54.921940+0000","last_became_active":"2024-09-13T18:45:54.498477+0000","last_became_peered":"2024-09-13T18:45:54.498477+0000","last_unstale":"2024-09-13T18:45:54.921940+0000","last_undegraded":"2024-09-13T18:45:54.921940+0000","last_fullsized":"2024-09-13T18:45:54.921940+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:25:05.631641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898904+0000","last_change":"2024-09-13T18:45:54.916063+0000","last_active":"2024-09-13T18:45:55.898904+0000","last_peered":"2024-09-13T18:45:55.898904+0000","last_clean":"2024-09-13T18:45:55.898904+0000","last_became_active":"2024-09-13T18:45:54.914695+0000","last_became_peered":"2024-09-13T18:45:54.914695+0000","last_unstale":"2024-09-13T18:45:55.898904+0000","last_undegraded":"2024-09-13T18:45:55.898904+0000","last_fullsized":"2024-09-13T18:45:55.898904+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.13","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920376+0000","last_change":"2024-09-13T18:45:54.494893+0000","last_active":"2024-09-13T18:45:54.920376+0000","last_peered":"2024-09-13T18:45:54.920376+0000","last_clean":"2024-09-13T18:45:54.920376+0000","last_became_active":"2024-09-13T18:45:54.494123+0000","last_became_peered":"2024-09-13T18:45:54.494123+0000","last_unstale":"2024-09-13T18:45:54.920376+0000","last_undegraded":"2024-09-13T18:45:54.920376+0000","last_fullsized":"2024-09-13T18:45:54.920376+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:55:14.459115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898103+0000","last_change":"2024-09-13T18:45:54.911463+0000","last_active":"2024-09-13T18:45:55.898103+0000","last_peered":"2024-09-13T18:45:55.898103+0000","last_clean":"2024-09-13T18:45:55.898103+0000","last_became_active":"2024-09-13T18:45:54.910682+0000","last_became_peered":"2024-09-13T18:45:54.910682+0000","last_unstale":"2024-09-13T18:45:55.898103+0000","last_undegraded":"2024-09-13T18:45:55.898103+0000","last_fullsized":"2024-09-13T18:45:55.898103+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:40:21.560322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.905155+0000","last_change":"2024-09-13T18:45:54.495200+0000","last_active":"2024-09-13T18:45:54.905155+0000","last_peered":"2024-09-13T18:45:54.905155+0000","last_clean":"2024-09-13T18:45:54.905155+0000","last_became_active":"2024-09-13T18:45:54.494927+0000","last_became_peered":"2024-09-13T18:45:54.494927+0000","last_unstale":"2024-09-13T18:45:54.905155+0000","last_undegraded":"2024-09-13T18:45:54.905155+0000","last_fullsized":"2024-09-13T18:45:54.905155+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898942+0000","last_change":"2024-09-13T18:45:54.912225+0000","last_active":"2024-09-13T18:45:55.898942+0000","last_peered":"2024-09-13T18:45:55.898942+0000","last_clean":"2024-09-13T18:45:55.898942+0000","last_became_active":"2024-09-13T18:45:54.911697+0000","last_became_peered":"2024-09-13T18:45:54.911697+0000","last_unstale":"2024-09-13T18:45:55.898942+0000","last_undegraded":"2024-09-13T18:45:55.898942+0000","last_fullsized":"2024-09-13T18:45:55.898942+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:06:53.252061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901469+0000","last_change":"2024-09-13T18:45:54.496453+0000","last_active":"2024-09-13T18:45:54.901469+0000","last_peered":"2024-09-13T18:45:54.901469+0000","last_clean":"2024-09-13T18:45:54.901469+0000","last_became_active":"2024-09-13T18:45:54.496187+0000","last_became_peered":"2024-09-13T18:45:54.496187+0000","last_unstale":"2024-09-13T18:45:54.901469+0000","last_undegraded":"2024-09-13T18:45:54.901469+0000","last_fullsized":"2024-09-13T18:45:54.901469+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:37:34.536434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898899+0000","last_change":"2024-09-13T18:45:54.908004+0000","last_active":"2024-09-13T18:45:55.898899+0000","last_peered":"2024-09-13T18:45:55.898899+0000","last_clean":"2024-09-13T18:45:55.898899+0000","last_became_active":"2024-09-13T18:45:54.906642+0000","last_became_peered":"2024-09-13T18:45:54.906642+0000","last_unstale":"2024-09-13T18:45:55.898899+0000","last_undegraded":"2024-09-13T18:45:55.898899+0000","last_fullsized":"2024-09-13T18:45:55.898899+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:45:32.003975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.10","version":"179'8","reported_seq":19,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920589+0000","last_change":"2024-09-13T18:45:54.493489+0000","last_active":"2024-09-13T18:45:54.920589+0000","last_peered":"2024-09-13T18:45:54.920589+0000","last_clean":"2024-09-13T18:45:54.920589+0000","last_became_active":"2024-09-13T18:45:54.493186+0000","last_became_peered":"2024-09-13T18:45:54.493186+0000","last_unstale":"2024-09-13T18:45:54.920589+0000","last_undegraded":"2024-09-13T18:45:54.920589+0000","last_fullsized":"2024-09-13T18:45:54.920589+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:03:22.461942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011749+0000","last_change":"2024-09-13T18:45:54.914777+0000","last_active":"2024-09-13T18:45:56.011749+0000","last_peered":"2024-09-13T18:45:56.011749+0000","last_clean":"2024-09-13T18:45:56.011749+0000","last_became_active":"2024-09-13T18:45:54.914406+0000","last_became_peered":"2024-09-13T18:45:54.914406+0000","last_unstale":"2024-09-13T18:45:56.011749+0000","last_undegraded":"2024-09-13T18:45:56.011749+0000","last_fullsized":"2024-09-13T18:45:56.011749+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:11:40.429267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.f","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917253+0000","last_change":"2024-09-13T18:45:54.487283+0000","last_active":"2024-09-13T18:45:54.917253+0000","last_peered":"2024-09-13T18:45:54.917253+0000","last_clean":"2024-09-13T18:45:54.917253+0000","last_became_active":"2024-09-13T18:45:54.487060+0000","last_became_peered":"2024-09-13T18:45:54.487060+0000","last_unstale":"2024-09-13T18:45:54.917253+0000","last_undegraded":"2024-09-13T18:45:54.917253+0000","last_fullsized":"2024-09-13T18:45:54.917253+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:35:06.256698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011050+0000","last_change":"2024-09-13T18:45:54.906614+0000","last_active":"2024-09-13T18:45:56.011050+0000","last_peered":"2024-09-13T18:45:56.011050+0000","last_clean":"2024-09-13T18:45:56.011050+0000","last_became_active":"2024-09-13T18:45:54.906390+0000","last_became_peered":"2024-09-13T18:45:54.906390+0000","last_unstale":"2024-09-13T18:45:56.011050+0000","last_undegraded":"2024-09-13T18:45:56.011050+0000","last_fullsized":"2024-09-13T18:45:56.011050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:35:11.921047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.e","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.920922+0000","last_change":"2024-09-13T18:45:54.497640+0000","last_active":"2024-09-13T18:45:54.920922+0000","last_peered":"2024-09-13T18:45:54.920922+0000","last_clean":"2024-09-13T18:45:54.920922+0000","last_became_active":"2024-09-13T18:45:54.497203+0000","last_became_peered":"2024-09-13T18:45:54.497203+0000","last_unstale":"2024-09-13T18:45:54.920922+0000","last_undegraded":"2024-09-13T18:45:54.920922+0000","last_fullsized":"2024-09-13T18:45:54.920922+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:56:03.079000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010525+0000","last_change":"2024-09-13T18:45:54.913515+0000","last_active":"2024-09-13T18:45:56.010525+0000","last_peered":"2024-09-13T18:45:56.010525+0000","last_clean":"2024-09-13T18:45:56.010525+0000","last_became_active":"2024-09-13T18:45:54.913313+0000","last_became_peered":"2024-09-13T18:45:54.913313+0000","last_unstale":"2024-09-13T18:45:56.010525+0000","last_undegraded":"2024-09-13T18:45:56.010525+0000","last_fullsized":"2024-09-13T18:45:56.010525+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:08:22.154645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.d","version":"179'1","reported_seq":12,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919011+0000","last_change":"2024-09-13T18:45:54.493113+0000","last_active":"2024-09-13T18:45:54.919011+0000","last_peered":"2024-09-13T18:45:54.919011+0000","last_clean":"2024-09-13T18:45:54.919011+0000","last_became_active":"2024-09-13T18:45:54.492826+0000","last_became_peered":"2024-09-13T18:45:54.492826+0000","last_unstale":"2024-09-13T18:45:54.919011+0000","last_undegraded":"2024-09-13T18:45:54.919011+0000","last_fullsized":"2024-09-13T18:45:54.919011+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:19.676676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011394+0000","last_change":"2024-09-13T18:45:54.911578+0000","last_active":"2024-09-13T18:45:56.011394+0000","last_peered":"2024-09-13T18:45:56.011394+0000","last_clean":"2024-09-13T18:45:56.011394+0000","last_became_active":"2024-09-13T18:45:54.909430+0000","last_became_peered":"2024-09-13T18:45:54.909430+0000","last_unstale":"2024-09-13T18:45:56.011394+0000","last_undegraded":"2024-09-13T18:45:56.011394+0000","last_fullsized":"2024-09-13T18:45:56.011394+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:14:24.084827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901562+0000","last_change":"2024-09-13T18:45:54.493581+0000","last_active":"2024-09-13T18:45:54.901562+0000","last_peered":"2024-09-13T18:45:54.901562+0000","last_clean":"2024-09-13T18:45:54.901562+0000","last_became_active":"2024-09-13T18:45:54.493031+0000","last_became_peered":"2024-09-13T18:45:54.493031+0000","last_unstale":"2024-09-13T18:45:54.901562+0000","last_undegraded":"2024-09-13T18:45:54.901562+0000","last_fullsized":"2024-09-13T18:45:54.901562+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:36:42.168271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010050+0000","last_change":"2024-09-13T18:45:54.909801+0000","last_active":"2024-09-13T18:45:56.010050+0000","last_peered":"2024-09-13T18:45:56.010050+0000","last_clean":"2024-09-13T18:45:56.010050+0000","last_became_active":"2024-09-13T18:45:54.909522+0000","last_became_peered":"2024-09-13T18:45:54.909522+0000","last_unstale":"2024-09-13T18:45:56.010050+0000","last_undegraded":"2024-09-13T18:45:56.010050+0000","last_fullsized":"2024-09-13T18:45:56.010050+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.b","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.918423+0000","last_change":"2024-09-13T18:45:54.496005+0000","last_active":"2024-09-13T18:45:54.918423+0000","last_peered":"2024-09-13T18:45:54.918423+0000","last_clean":"2024-09-13T18:45:54.918423+0000","last_became_active":"2024-09-13T18:45:54.495771+0000","last_became_peered":"2024-09-13T18:45:54.495771+0000","last_unstale":"2024-09-13T18:45:54.918423+0000","last_undegraded":"2024-09-13T18:45:54.918423+0000","last_fullsized":"2024-09-13T18:45:54.918423+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:29:11.480554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010891+0000","last_change":"2024-09-13T18:45:54.906015+0000","last_active":"2024-09-13T18:45:56.010891+0000","last_peered":"2024-09-13T18:45:56.010891+0000","last_clean":"2024-09-13T18:45:56.010891+0000","last_became_active":"2024-09-13T18:45:54.905438+0000","last_became_peered":"2024-09-13T18:45:54.905438+0000","last_unstale":"2024-09-13T18:45:56.010891+0000","last_undegraded":"2024-09-13T18:45:56.010891+0000","last_fullsized":"2024-09-13T18:45:56.010891+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:50:44.251416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.897723+0000","last_change":"2024-09-13T18:45:54.493010+0000","last_active":"2024-09-13T18:45:54.897723+0000","last_peered":"2024-09-13T18:45:54.897723+0000","last_clean":"2024-09-13T18:45:54.897723+0000","last_became_active":"2024-09-13T18:45:54.492789+0000","last_became_peered":"2024-09-13T18:45:54.492789+0000","last_unstale":"2024-09-13T18:45:54.897723+0000","last_undegraded":"2024-09-13T18:45:54.897723+0000","last_fullsized":"2024-09-13T18:45:54.897723+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:02:24.312031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011028+0000","last_change":"2024-09-13T18:45:54.909680+0000","last_active":"2024-09-13T18:45:56.011028+0000","last_peered":"2024-09-13T18:45:56.011028+0000","last_clean":"2024-09-13T18:45:56.011028+0000","last_became_active":"2024-09-13T18:45:54.908615+0000","last_became_peered":"2024-09-13T18:45:54.908615+0000","last_unstale":"2024-09-13T18:45:56.011028+0000","last_undegraded":"2024-09-13T18:45:56.011028+0000","last_fullsized":"2024-09-13T18:45:56.011028+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:56:06.040898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.898386+0000","last_change":"2024-09-13T18:45:54.484614+0000","last_active":"2024-09-13T18:45:54.898386+0000","last_peered":"2024-09-13T18:45:54.898386+0000","last_clean":"2024-09-13T18:45:54.898386+0000","last_became_active":"2024-09-13T18:45:54.484384+0000","last_became_peered":"2024-09-13T18:45:54.484384+0000","last_unstale":"2024-09-13T18:45:54.898386+0000","last_undegraded":"2024-09-13T18:45:54.898386+0000","last_fullsized":"2024-09-13T18:45:54.898386+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:34:42.467009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.011162+0000","last_change":"2024-09-13T18:45:54.912416+0000","last_active":"2024-09-13T18:45:56.011162+0000","last_peered":"2024-09-13T18:45:56.011162+0000","last_clean":"2024-09-13T18:45:56.011162+0000","last_became_active":"2024-09-13T18:45:54.910464+0000","last_became_peered":"2024-09-13T18:45:54.910464+0000","last_unstale":"2024-09-13T18:45:56.011162+0000","last_undegraded":"2024-09-13T18:45:56.011162+0000","last_fullsized":"2024-09-13T18:45:56.011162+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:19:39.075198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899634+0000","last_change":"2024-09-13T18:45:54.492800+0000","last_active":"2024-09-13T18:45:54.899634+0000","last_peered":"2024-09-13T18:45:54.899634+0000","last_clean":"2024-09-13T18:45:54.899634+0000","last_became_active":"2024-09-13T18:45:54.492257+0000","last_became_peered":"2024-09-13T18:45:54.492257+0000","last_unstale":"2024-09-13T18:45:54.899634+0000","last_undegraded":"2024-09-13T18:45:54.899634+0000","last_fullsized":"2024-09-13T18:45:54.899634+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:49:21.668105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899051+0000","last_change":"2024-09-13T18:45:54.912376+0000","last_active":"2024-09-13T18:45:55.899051+0000","last_peered":"2024-09-13T18:45:55.899051+0000","last_clean":"2024-09-13T18:45:55.899051+0000","last_became_active":"2024-09-13T18:45:54.911994+0000","last_became_peered":"2024-09-13T18:45:54.911994+0000","last_unstale":"2024-09-13T18:45:55.899051+0000","last_undegraded":"2024-09-13T18:45:55.899051+0000","last_fullsized":"2024-09-13T18:45:55.899051+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.7","version":"179'2","reported_seq":13,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.919785+0000","last_change":"2024-09-13T18:45:54.486957+0000","last_active":"2024-09-13T18:45:54.919785+0000","last_peered":"2024-09-13T18:45:54.919785+0000","last_clean":"2024-09-13T18:45:54.919785+0000","last_became_active":"2024-09-13T18:45:54.486740+0000","last_became_peered":"2024-09-13T18:45:54.486740+0000","last_unstale":"2024-09-13T18:45:54.919785+0000","last_undegraded":"2024-09-13T18:45:54.919785+0000","last_fullsized":"2024-09-13T18:45:54.919785+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:37:28.842927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.899048+0000","last_change":"2024-09-13T18:45:54.911748+0000","last_active":"2024-09-13T18:45:55.899048+0000","last_peered":"2024-09-13T18:45:55.899048+0000","last_clean":"2024-09-13T18:45:55.899048+0000","last_became_active":"2024-09-13T18:45:54.911536+0000","last_became_peered":"2024-09-13T18:45:54.911536+0000","last_unstale":"2024-09-13T18:45:55.899048+0000","last_undegraded":"2024-09-13T18:45:55.899048+0000","last_fullsized":"2024-09-13T18:45:55.899048+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:19:16.604849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899403+0000","last_change":"2024-09-13T18:45:54.493256+0000","last_active":"2024-09-13T18:45:54.899403+0000","last_peered":"2024-09-13T18:45:54.899403+0000","last_clean":"2024-09-13T18:45:54.899403+0000","last_became_active":"2024-09-13T18:45:54.492757+0000","last_became_peered":"2024-09-13T18:45:54.492757+0000","last_unstale":"2024-09-13T18:45:54.899403+0000","last_undegraded":"2024-09-13T18:45:54.899403+0000","last_fullsized":"2024-09-13T18:45:54.899403+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:29:01.290718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898201+0000","last_change":"2024-09-13T18:45:54.906596+0000","last_active":"2024-09-13T18:45:55.898201+0000","last_peered":"2024-09-13T18:45:55.898201+0000","last_clean":"2024-09-13T18:45:55.898201+0000","last_became_active":"2024-09-13T18:45:54.904819+0000","last_became_peered":"2024-09-13T18:45:54.904819+0000","last_unstale":"2024-09-13T18:45:55.898201+0000","last_undegraded":"2024-09-13T18:45:55.898201+0000","last_fullsized":"2024-09-13T18:45:55.898201+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:15:37.224895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904789+0000","last_change":"2024-09-13T18:45:54.498180+0000","last_active":"2024-09-13T18:45:54.904789+0000","last_peered":"2024-09-13T18:45:54.904789+0000","last_clean":"2024-09-13T18:45:54.904789+0000","last_became_active":"2024-09-13T18:45:54.497907+0000","last_became_peered":"2024-09-13T18:45:54.497907+0000","last_unstale":"2024-09-13T18:45:54.904789+0000","last_undegraded":"2024-09-13T18:45:54.904789+0000","last_fullsized":"2024-09-13T18:45:54.904789+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:14:26.217332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898271+0000","last_change":"2024-09-13T18:45:54.900842+0000","last_active":"2024-09-13T18:45:55.898271+0000","last_peered":"2024-09-13T18:45:55.898271+0000","last_clean":"2024-09-13T18:45:55.898271+0000","last_became_active":"2024-09-13T18:45:54.900605+0000","last_became_peered":"2024-09-13T18:45:54.900605+0000","last_unstale":"2024-09-13T18:45:55.898271+0000","last_undegraded":"2024-09-13T18:45:55.898271+0000","last_fullsized":"2024-09-13T18:45:55.898271+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:32:40.536131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902290+0000","last_change":"2024-09-13T18:45:54.495093+0000","last_active":"2024-09-13T18:45:54.902290+0000","last_peered":"2024-09-13T18:45:54.902290+0000","last_clean":"2024-09-13T18:45:54.902290+0000","last_became_active":"2024-09-13T18:45:54.494822+0000","last_became_peered":"2024-09-13T18:45:54.494822+0000","last_unstale":"2024-09-13T18:45:54.902290+0000","last_undegraded":"2024-09-13T18:45:54.902290+0000","last_fullsized":"2024-09-13T18:45:54.902290+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.913136+0000","last_change":"2024-09-13T18:45:54.913053+0000","last_active":"2024-09-13T18:45:54.913136+0000","last_peered":"2024-09-13T18:45:54.913136+0000","last_clean":"2024-09-13T18:45:54.913136+0000","last_became_active":"2024-09-13T18:45:54.912692+0000","last_became_peered":"2024-09-13T18:45:54.912692+0000","last_unstale":"2024-09-13T18:45:54.913136+0000","last_undegraded":"2024-09-13T18:45:54.913136+0000","last_fullsized":"2024-09-13T18:45:54.913136+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:59:36.333124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.901165+0000","last_change":"2024-09-13T18:45:54.493395+0000","last_active":"2024-09-13T18:45:54.901165+0000","last_peered":"2024-09-13T18:45:54.901165+0000","last_clean":"2024-09-13T18:45:54.901165+0000","last_became_active":"2024-09-13T18:45:54.493125+0000","last_became_peered":"2024-09-13T18:45:54.493125+0000","last_unstale":"2024-09-13T18:45:54.901165+0000","last_undegraded":"2024-09-13T18:45:54.901165+0000","last_fullsized":"2024-09-13T18:45:54.901165+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:20:59.567811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898992+0000","last_change":"2024-09-13T18:45:54.910921+0000","last_active":"2024-09-13T18:45:55.898992+0000","last_peered":"2024-09-13T18:45:55.898992+0000","last_clean":"2024-09-13T18:45:55.898992+0000","last_became_active":"2024-09-13T18:45:54.909213+0000","last_became_peered":"2024-09-13T18:45:54.909213+0000","last_unstale":"2024-09-13T18:45:55.898992+0000","last_undegraded":"2024-09-13T18:45:55.898992+0000","last_fullsized":"2024-09-13T18:45:55.898992+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:19.183121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.904368+0000","last_change":"2024-09-13T18:45:54.490731+0000","last_active":"2024-09-13T18:45:54.904368+0000","last_peered":"2024-09-13T18:45:54.904368+0000","last_clean":"2024-09-13T18:45:54.904368+0000","last_became_active":"2024-09-13T18:45:54.490352+0000","last_became_peered":"2024-09-13T18:45:54.490352+0000","last_unstale":"2024-09-13T18:45:54.904368+0000","last_undegraded":"2024-09-13T18:45:54.904368+0000","last_fullsized":"2024-09-13T18:45:54.904368+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:25:21.701213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:55.898977+0000","last_change":"2024-09-13T18:45:54.902428+0000","last_active":"2024-09-13T18:45:55.898977+0000","last_peered":"2024-09-13T18:45:55.898977+0000","last_clean":"2024-09-13T18:45:55.898977+0000","last_became_active":"2024-09-13T18:45:54.902083+0000","last_became_peered":"2024-09-13T18:45:54.902083+0000","last_unstale":"2024-09-13T18:45:55.898977+0000","last_undegraded":"2024-09-13T18:45:55.898977+0000","last_fullsized":"2024-09-13T18:45:55.898977+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902720+0000","last_change":"2024-09-13T18:45:54.491923+0000","last_active":"2024-09-13T18:45:54.902720+0000","last_peered":"2024-09-13T18:45:54.902720+0000","last_clean":"2024-09-13T18:45:54.902720+0000","last_became_active":"2024-09-13T18:45:54.491706+0000","last_became_peered":"2024-09-13T18:45:54.491706+0000","last_unstale":"2024-09-13T18:45:54.902720+0000","last_undegraded":"2024-09-13T18:45:54.902720+0000","last_fullsized":"2024-09-13T18:45:54.902720+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:45:14.409981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":180,"state":"active+clean","last_fresh":"2024-09-13T18:45:56.010210+0000","last_change":"2024-09-13T18:45:54.912208+0000","last_active":"2024-09-13T18:45:56.010210+0000","last_peered":"2024-09-13T18:45:56.010210+0000","last_clean":"2024-09-13T18:45:56.010210+0000","last_became_active":"2024-09-13T18:45:54.911794+0000","last_became_peered":"2024-09-13T18:45:54.911794+0000","last_unstale":"2024-09-13T18:45:56.010210+0000","last_undegraded":"2024-09-13T18:45:56.010210+0000","last_fullsized":"2024-09-13T18:45:56.010210+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:17:02.923713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.899848+0000","last_change":"2024-09-13T18:45:54.492315+0000","last_active":"2024-09-13T18:45:54.899848+0000","last_peered":"2024-09-13T18:45:54.899848+0000","last_clean":"2024-09-13T18:45:54.899848+0000","last_became_active":"2024-09-13T18:45:54.491338+0000","last_became_peered":"2024-09-13T18:45:54.491338+0000","last_unstale":"2024-09-13T18:45:54.899848+0000","last_undegraded":"2024-09-13T18:45:54.899848+0000","last_fullsized":"2024-09-13T18:45:54.899848+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:41:12.194286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.907792+0000","last_change":"2024-09-13T18:45:54.907717+0000","last_active":"2024-09-13T18:45:54.907792+0000","last_peered":"2024-09-13T18:45:54.907792+0000","last_clean":"2024-09-13T18:45:54.907792+0000","last_became_active":"2024-09-13T18:45:54.907492+0000","last_became_peered":"2024-09-13T18:45:54.907492+0000","last_unstale":"2024-09-13T18:45:54.907792+0000","last_undegraded":"2024-09-13T18:45:54.907792+0000","last_fullsized":"2024-09-13T18:45:54.907792+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":178,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:54.474303+0000","last_clean_scrub_stamp":"2024-09-13T18:45:54.474303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:54:13.028623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.15","version":"179'3","reported_seq":14,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.917211+0000","last_change":"2024-09-13T18:45:54.492742+0000","last_active":"2024-09-13T18:45:54.917211+0000","last_peered":"2024-09-13T18:45:54.917211+0000","last_clean":"2024-09-13T18:45:54.917211+0000","last_became_active":"2024-09-13T18:45:54.492518+0000","last_became_peered":"2024-09-13T18:45:54.492518+0000","last_unstale":"2024-09-13T18:45:54.917211+0000","last_undegraded":"2024-09-13T18:45:54.917211+0000","last_fullsized":"2024-09-13T18:45:54.917211+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":177,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:45:53.467861+0000","last_clean_scrub_stamp":"2024-09-13T18:45:53.467861+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:23:03.317210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":312,"reported_epoch":179,"state":"active+clean","last_fresh":"2024-09-13T18:45:54.902626+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:45:54.902626+0000","last_peered":"2024-09-13T18:45:54.902626+0000","last_clean":"2024-09-13T18:45:54.902626+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:45:54.902626+0000","last_undegraded":"2024-09-13T18:45:54.902626+0000","last_fullsized":"2024-09-13T18:45:54.902626+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542274,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1566,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193746,"statfs":{"total":200000000,"available":198396330,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67200000000000004,"15min":0.64500000000000002},"min":{"1min":0.52100000000000002,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69299999999999995,"15min":0.65800000000000003},"min":{"1min":0.51800000000000002,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.94199999999999995,"5min":0.94799999999999995,"15min":1.014},"last":0.44600000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70399999999999996,"15min":0.68000000000000005},"min":{"1min":0.57499999999999996,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.90700000000000003,"5min":1.0589999999999999,"15min":1.0589999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.66200000000000003},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.871,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68899999999999995,"15min":0.67100000000000004},"min":{"1min":0.495,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.85199999999999998,"5min":1.004,"15min":1.004},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.54500000000000004,"5min":0.437,"15min":0.41599999999999998},"max":{"1min":0.81000000000000005,"5min":0.93799999999999994,"15min":0.999},"last":0.71499999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.73599999999999999,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.94199999999999995,"5min":2.4169999999999998,"15min":6.1040000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.71199999999999997,"15min":0.79300000000000004},"min":{"1min":0.61499999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92600000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.70199999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57099999999999995,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.35899999999999999,"15min":0.313},"max":{"1min":0.91500000000000004,"5min":0.97599999999999998,"15min":1.036},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.624,"15min":0.61599999999999999},"min":{"1min":0.49399999999999999,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80600000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.46999999999999997,"5min":0.39200000000000002,"15min":0.38300000000000001},"max":{"1min":0.88500000000000001,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.69999999999999996,"15min":0.70799999999999996},"min":{"1min":0.52300000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.94799999999999995,"5min":0.98299999999999998,"15min":1.371},"last":0.78100000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:45:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.67800000000000005},"min":{"1min":0.55900000000000005,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.86699999999999999,"5min":0.94399999999999995,"15min":1.143},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71199999999999997,"15min":0.68899999999999995},"min":{"1min":0.52100000000000002,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.95699999999999996,"5min":0.99399999999999999,"15min":1.125},"last":0.73299999999999998}]}]},{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.69799999999999995,"15min":0.66800000000000004},"min":{"1min":0.47999999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.93200000000000005,"5min":0.93300000000000005,"15min":1.665},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.68799999999999994,"15min":0.65600000000000003},"min":{"1min":0.503,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92300000000000004,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.73399999999999999,"15min":0.68200000000000005},"min":{"1min":0.57799999999999996,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97199999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67300000000000004,"15min":0.65800000000000003},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.80300000000000005,"5min":0.96799999999999997,"15min":1.591},"last":0.622}]},{"osd":2,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.71899999999999997,"15min":0.70099999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":0.89100000000000001,"5min":1.016,"15min":2.2709999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.73099999999999998,"15min":0.71599999999999997},"min":{"1min":0.54900000000000004,"5min":0.47599999999999998,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":1.0680000000000001,"15min":2.169},"last":0.64500000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.747,"15min":0.70099999999999996},"min":{"1min":0.55900000000000005,"5min":0.46000000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.97199999999999998,"15min":1.4450000000000001},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.66400000000000003},"min":{"1min":0.56200000000000006,"5min":0.45000000000000001,"15min":0.42199999999999999},"max":{"1min":0.86899999999999999,"5min":1.071,"15min":1.071},"last":0.66700000000000004}]},{"osd":4,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.58999999999999997,"15min":0.58699999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.34000000000000002},"max":{"1min":0.86099999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.627,"15min":0.63700000000000001},"min":{"1min":0.41599999999999998,"5min":0.38500000000000001,"15min":0.35199999999999998},"max":{"1min":0.81499999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.745}]},{"osd":5,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71799999999999997,"15min":0.69099999999999995},"min":{"1min":0.42899999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.92200000000000004,"5min":0.97399999999999998,"15min":1.0840000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68999999999999995,"15min":0.66200000000000003},"min":{"1min":0.504,"5min":0.438,"15min":0.372},"max":{"1min":0.95199999999999996,"5min":1.0289999999999999,"15min":1.115},"last":0.73799999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:45:43 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.73299999999999998,"15min":0.71199999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.97799999999999998,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78000000000000003,"15min":0.748},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":0.95799999999999996,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.78500000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574976,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988456,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70499999999999996,"15min":0.77600000000000002},"min":{"1min":0.48099999999999998,"5min":0.39300000000000002,"15min":0.32400000000000001},"max":{"1min":0.84799999999999998,"5min":1.02,"15min":6.4539999999999997},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67200000000000004,"15min":0.65000000000000002},"min":{"1min":0.52700000000000002,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.89300000000000002,"5min":1.01,"15min":1.01},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.69899999999999995,"15min":0.78600000000000003},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.377},"max":{"1min":0.83399999999999996,"5min":1.0069999999999999,"15min":6.3890000000000002},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.68700000000000006,"15min":0.77100000000000002},"min":{"1min":0.58599999999999997,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.93100000000000005,"5min":0.94199999999999995,"15min":6.5019999999999998},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.69099999999999995,"15min":0.66500000000000004},"min":{"1min":0.48699999999999999,"5min":0.46600000000000003,"15min":0.41599999999999998},"max":{"1min":0.88400000000000001,"5min":0.96399999999999997,"15min":1.032},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71599999999999997,"15min":0.81100000000000005},"min":{"1min":0.53200000000000003,"5min":0.45500000000000002,"15min":0.441},"max":{"1min":0.91000000000000003,"5min":1.0740000000000001,"15min":6.3310000000000004},"last":0.70499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.45900000000000002,"15min":0.39500000000000002},"max":{"1min":0.90700000000000003,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72399999999999998,"15min":0.68000000000000005},"min":{"1min":0.53200000000000003,"5min":0.46800000000000003,"15min":0.44},"max":{"1min":0.95399999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.84999999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64600000000000002,"15min":0.63500000000000001},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.85199999999999998,"5min":0.94499999999999995,"15min":0.97199999999999998},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.68500000000000005},"min":{"1min":0.47199999999999998,"5min":0.41499999999999998,"15min":0.38400000000000001},"max":{"1min":0.85799999999999998,"5min":0.95099999999999996,"15min":0.96399999999999997},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.59799999999999998},"min":{"1min":0.372,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78700000000000003,"5min":0.96199999999999997,"15min":1.5509999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63400000000000001,"15min":0.628},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":1.403},"last":0.52300000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:41 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.50800000000000001,"5min":0.41699999999999998,"15min":0.41099999999999998},"max":{"1min":0.89300000000000002,"5min":0.97199999999999998,"15min":1.6040000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.54300000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.57699999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":989,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194322,"statfs":{"total":200000000,"available":198986288,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70199999999999996,"15min":0.68100000000000005},"min":{"1min":0.57299999999999995,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98899999999999999,"5min":1.581,"15min":2.0579999999999998},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.68000000000000005,"15min":0.66500000000000004},"min":{"1min":0.53900000000000003,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95099999999999996,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.72699999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.69899999999999995,"15min":0.68899999999999995},"min":{"1min":0.54900000000000004,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.89600000000000002,"5min":1.48,"15min":1.48},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69599999999999995,"15min":0.69399999999999995},"min":{"1min":0.45700000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97099999999999997,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69899999999999995,"15min":0.70699999999999996},"min":{"1min":0.50600000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.90300000000000002,"5min":1.5589999999999999,"15min":3.706},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.71299999999999997,"15min":0.70199999999999996},"min":{"1min":0.48699999999999999,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":0.875,"5min":2.915,"15min":3.742},"last":0.67900000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.72599999999999998,"15min":0.72199999999999998},"min":{"1min":0.52700000000000002,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":0.90900000000000003,"5min":1.762,"15min":3.6909999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.71999999999999997,"15min":0.69399999999999995},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.40799999999999997},"max":{"1min":0.95999999999999996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.66600000000000004}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.623,"15min":0.61299999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.91700000000000004,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.66900000000000004,"15min":0.61699999999999999},"min":{"1min":0.45200000000000001,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.94799999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.72999999999999998,"15min":0.74399999999999999},"min":{"1min":0.53500000000000003,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.93000000000000005,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.745},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71199999999999997,"15min":0.70099999999999996},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.97099999999999997,"5min":1.843,"15min":3.7989999999999999},"last":0.84099999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.63300000000000001},"min":{"1min":0.44800000000000001,"5min":0.41499999999999998,"15min":0.34499999999999997},"max":{"1min":0.94599999999999995,"5min":1.548,"15min":5.5069999999999997},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.78200000000000003,"15min":0.72499999999999998},"min":{"1min":0.624,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.95999999999999996,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.87}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":988,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198987840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.437,"15min":0.44},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.23699999999999999},"max":{"1min":0.64300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45000000000000001,"15min":0.45300000000000001},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.73499999999999999,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48799999999999999,"15min":0.64500000000000002},"min":{"1min":0.33300000000000002,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.74099999999999999,"5min":1.546,"15min":8.1059999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.48299999999999998,"15min":0.53300000000000003},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.81399999999999995,"5min":0.84699999999999998,"15min":4.8310000000000004},"last":0.44}]},{"osd":2,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.52400000000000002,"15min":0.57699999999999996},"min":{"1min":0.39800000000000002,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.76600000000000001,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.50900000000000001,"15min":0.626},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.314},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":7.798},"last":0.5}]},{"osd":4,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74399999999999999,"15min":0.78400000000000003},"min":{"1min":0.502,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.93899999999999995,"5min":1.0669999999999999,"15min":3.093},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.73899999999999999,"15min":0.74399999999999999},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.76000000000000001,"15min":0.78900000000000003},"min":{"1min":0.57699999999999996,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0700000000000001,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.625},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.72299999999999998,"15min":0.72899999999999998},"min":{"1min":0.53700000000000003,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.72599999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.748,"15min":0.89500000000000002},"min":{"1min":0.56399999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.022,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.84599999999999997},"min":{"1min":0.505,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.105,"5min":1.105,"15min":8.0519999999999996},"last":0.76000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:55 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.73299999999999998},"min":{"1min":0.55900000000000005,"5min":0.503,"15min":0.503},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.78600000000000003,"15min":0.82599999999999996},"min":{"1min":0.63200000000000001,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.131,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988434,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.41899999999999998,"15min":0.41999999999999998},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.53700000000000003,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.32300000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.64600000000000002,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.495,"15min":0.48599999999999999},"min":{"1min":0.40100000000000002,"5min":0.32000000000000001,"15min":0.31900000000000001},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.45500000000000002,"15min":0.46999999999999997},"min":{"1min":0.34000000000000002,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.62,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.45800000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.499,"15min":0.505},"min":{"1min":0.39300000000000002,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.61599999999999999,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.71499999999999997},"min":{"1min":0.52500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0580000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.78600000000000003,"15min":0.77500000000000002},"min":{"1min":0.60199999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.327,"5min":1.423,"15min":1.423},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.77000000000000002,"15min":0.746},"min":{"1min":0.58399999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.095,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.92900000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.73499999999999999},"min":{"1min":0.54500000000000004,"5min":0.48899999999999999,"15min":0.45800000000000002},"max":{"1min":1.266,"5min":1.329,"15min":1.329},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.72499999999999998,"15min":0.71399999999999997},"min":{"1min":0.56699999999999995,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0049999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.876}]},{"osd":7,"last update":"Fri Sep 13 18:45:56 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.76900000000000002,"15min":0.75600000000000001},"min":{"1min":0.61399999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79900000000000004,"15min":0.78500000000000003},"min":{"1min":0.65500000000000003,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.198,"5min":1.508,"15min":1.508},"last":0.93999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1564,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193748,"statfs":{"total":200000000,"available":198398018,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.43099999999999999,"15min":0.438},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.64700000000000002,"5min":0.67100000000000004,"15min":1.6000000000000001},"last":0.308},{"interface":"front","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.47899999999999998},"min":{"1min":0.316,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69899999999999995,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.51100000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.435,"15min":0.45300000000000001},"min":{"1min":0.34200000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.5,"5min":0.63300000000000001,"15min":1.036},"last":0.372},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.502,"15min":0.49199999999999999},"min":{"1min":0.41899999999999998,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.68999999999999995,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.38700000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.47299999999999998,"5min":0.38,"15min":0.36599999999999999},"max":{"1min":0.72999999999999998,"5min":0.82499999999999996,"15min":0.86499999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.50900000000000001,"15min":0.51000000000000001},"min":{"1min":0.41099999999999998,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.64900000000000002,"5min":0.80600000000000005,"15min":1.1870000000000001},"last":0.46400000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.77800000000000002,"15min":0.77100000000000002},"min":{"1min":0.70499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93799999999999994,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.74099999999999999,"15min":0.76100000000000001},"min":{"1min":0.52200000000000002,"5min":0.47699999999999998,"15min":0.45500000000000002},"max":{"1min":0.98099999999999998,"5min":1.3,"15min":1.3029999999999999},"last":0.71599999999999997}]},{"osd":5,"last update":"Fri Sep 13 18:44:54 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.76000000000000001,"15min":0.73699999999999999},"min":{"1min":0.56599999999999995,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":0.97999999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.72999999999999998,"15min":0.71599999999999997},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.41899999999999998},"max":{"1min":0.91700000000000004,"5min":1.242,"15min":1.242},"last":0.66100000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.76900000000000002,"15min":0.78000000000000003},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":0.86499999999999999,"5min":1.123,"15min":1.21},"last":0.745},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.77100000000000002,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95499999999999996,"5min":1.0580000000000001,"15min":1.278},"last":0.76600000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:45:44 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.75,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.498,"15min":0.46999999999999997},"max":{"1min":0.94999999999999996,"5min":1.0069999999999999,"15min":1.1830000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.746,"5min":0.747,"15min":0.76400000000000001},"min":{"1min":0.59699999999999998,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":0.94999999999999996,"5min":1.1399999999999999,"15min":1.1539999999999999},"last":0.69799999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":987,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194324,"statfs":{"total":200000000,"available":198988366,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42899999999999999,"15min":0.44700000000000001},"min":{"1min":0.31900000000000001,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.60199999999999998,"5min":0.76700000000000002,"15min":1.669},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45100000000000001},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72499999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.379}]},{"osd":2,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.49099999999999999,"15min":0.499},"min":{"1min":0.42099999999999999,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.591},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.49199999999999999},"min":{"1min":0.40100000000000002,"5min":0.36199999999999999,"15min":0.32000000000000001},"max":{"1min":0.66800000000000004,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.42599999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.47099999999999997,"15min":0.46600000000000003},"min":{"1min":0.42299999999999999,"5min":0.32100000000000001,"15min":0.251},"max":{"1min":0.63700000000000001,"5min":0.70899999999999996,"15min":1.03},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.52700000000000002,"15min":0.53500000000000003},"min":{"1min":0.48899999999999999,"5min":0.34499999999999997,"15min":0.315},"max":{"1min":0.66900000000000004,"5min":0.75800000000000001,"15min":1.637},"last":0.68000000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.73299999999999998,"15min":0.71399999999999997},"min":{"1min":0.55800000000000005,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":1.044,"5min":1.21,"15min":1.21},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.73299999999999998,"15min":0.71599999999999997},"min":{"1min":0.54000000000000004,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.038,"5min":1.056,"15min":1.698},"last":0.72799999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:45:49 2024","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.79100000000000004,"15min":0.76200000000000001},"min":{"1min":0.63100000000000001,"5min":0.5,"15min":0.5},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.204},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76300000000000001,"15min":0.77500000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.2190000000000001,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.64600000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.76000000000000001,"15min":0.755},"min":{"1min":0.67400000000000004,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.155,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.76100000000000001,"15min":0.72999999999999998},"min":{"1min":0.60899999999999999,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":0.52700000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:45:45 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.745,"15min":0.754},"min":{"1min":0.57599999999999996,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.97799999999999998,"5min":1.165,"15min":2.3399999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.77300000000000002,"15min":0.72299999999999998},"min":{"1min":0.65300000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":1.0940000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.66500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:46:04.044 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:46:04.044 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:46:04.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.235+0000 7f4c2a600640 1 Processor -- start 2024-09-13T18:46:04.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.236+0000 7f4c2a600640 1 -- start start 2024-09-13T18:46:04.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c2a600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f4c2406bc30 0x7f4c2415a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c2a600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2415af60 con 0x7f4c24159b00 2024-09-13T18:46:04.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c2a600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2406b7a0 con 0x7f4c240b3480 2024-09-13T18:46:04.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c2a600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2415ac80 con 0x7f4c2406bc30 2024-09-13T18:46:04.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c29200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f4c24159b00 0x7f4c240b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56352/0 (socket says 172.21.15.192:56352) 2024-09-13T18:46:04.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c29200640 1 -- 172.21.15.192:0/3815160902 learned_addr learned my addr 172.21.15.192:0/3815160902 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:46:04.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c29c00640 1 --2- 172.21.15.192:0/3815160902 >> v2:172.21.15.194:3300/0 conn(0x7f4c2406bc30 0x7f4c2415a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1712864157 0 0) 0x7f4c2415af60 con 0x7f4c24159b00 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.237+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c08005730 con 0x7f4c24159b00 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1471216276 0 0) 0x7f4c08005730 con 0x7f4c24159b00 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 >> v2:172.21.15.194:3300/0 conn(0x7f4c2406bc30 msgr2=0x7f4c2415a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 --2- 172.21.15.192:0/3815160902 >> v2:172.21.15.194:3300/0 conn(0x7f4c2406bc30 0x7f4c2415a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 >> v1:172.21.15.194:6789/0 conn(0x7f4c240b3480 legacy=0x7f4c24159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2406b150 con 0x7f4c24159b00 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f4c14001670 con 0x7f4c24159b00 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 >> v1:172.21.15.192:6789/0 conn(0x7f4c24159b00 legacy=0x7f4c240b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c08005b80 0x7f4c08005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c080069d0 0x7f4c08006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 0x7f4c0800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.242 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2415ac80 con 0x7f4c08007390 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0800e330 con 0x7f4c08005b80 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0800e4f0 con 0x7f4c080069d0 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c29200640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c08005b80 0x7f4c08005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c29c00640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 0x7f4c0800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.238+0000 7f4c23e00640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c080069d0 0x7f4c08006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 -- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c080069d0 msgr2=0x7f4c08006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c080069d0 0x7f4c08006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 -- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c08005b80 msgr2=0x7f4c08005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c08005b80 0x7f4c08005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.243 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 -- 172.21.15.192:0/3815160902 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c08005730 con 0x7f4c08007390 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.239+0000 7f4c29c00640 1 -- 172.21.15.192:0/3815160902 reap_dead start 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c29c00640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 0x7f4c0800db90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fc0 tx=0x7f4c08007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b0c1a5622fb135 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c003b90 con 0x7f4c08007390 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c00f040 con 0x7f4c08007390 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c23400640 1 -- 172.21.15.192:0/3815160902 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c004020 con 0x7f4c08007390 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 -- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 msgr2=0x7f4c0800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 0x7f4c0800db90 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009fc0 tx=0x7f4c08007a00 comp rx=0 tx=0).stop 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 -- 172.21.15.192:0/3815160902 shutdown_connections 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 --2- 172.21.15.192:0/3815160902 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c08007390 0x7f4c0800db90 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 -- 172.21.15.192:0/3815160902 >> 172.21.15.192:0/3815160902 conn(0x7f4c240736d0 msgr2=0x7f4c240b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.240+0000 7f4c2a600640 1 -- 172.21.15.192:0/3815160902 shutdown_connections 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.241+0000 7f4c2a600640 1 -- 172.21.15.192:0/3815160902 wait complete. 2024-09-13T18:46:04.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.242+0000 7f4c2a600640 1 Processor -- start 2024-09-13T18:46:04.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.242+0000 7f4c2a600640 1 -- start start 2024-09-13T18:46:04.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c08007390 0x7f4c24152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c24150fc0 0x7f4c2414d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24157120 con 0x7f4c240ad840 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c240ae200 con 0x7f4c24150fc0 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c2a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c24156c90 con 0x7f4c08007390 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.243+0000 7f4c29c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33638/0 (socket says 172.21.15.192:33638) 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 -- 172.21.15.192:0/2727186224 learned_addr learned my addr 172.21.15.192:0/2727186224 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29200640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c08007390 0x7f4c24152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c23e00640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c24150fc0 0x7f4c2414d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 -- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c08007390 msgr2=0x7f4c24152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c08007390 0x7f4c24152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 -- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c24150fc0 msgr2=0x7f4c2414d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c24150fc0 0x7f4c2414d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 -- 172.21.15.192:0/2727186224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c24153530 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c29c00640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00e230 tx=0x7f4c1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.244+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c03c470 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.245+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c03c5f0 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.245+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c03c9a0 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.245+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c24156640 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.245+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c241562f0 con 0x7f4c240ad840 2024-09-13T18:46:04.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.246+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c241564b0 con 0x7f4c240ad840 2024-09-13T18:46:04.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.247+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4c1c03cb00 con 0x7f4c240ad840 2024-09-13T18:46:04.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.248+0000 7f4c20c00640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 0x7f4c0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.248+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c1c0aa1c0 con 0x7f4c240ad840 2024-09-13T18:46:04.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.248+0000 7f4c29200640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 0x7f4c0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.249+0000 7f4c29200640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 0x7f4c0406d0c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4c14001c90 tx=0x7f4c14000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.252+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4c1c075570 con 0x7f4c240ad840 2024-09-13T18:46:04.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.480+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f4c24159ee0 con 0x7f4c240ad840 2024-09-13T18:46:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.486+0000 7f4c20c00640 1 -- 172.21.15.192:0/2727186224 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4c1c078b90 con 0x7f4c240ad840 2024-09-13T18:46:04.489 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 msgr2=0x7f4c0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 0x7f4c0406d0c0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f4c14001c90 tx=0x7f4c14000ed0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 msgr2=0x7f4c240adcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c00e230 tx=0x7f4c1c009750 comp rx=0 tx=0).stop 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 shutdown_connections 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f4c0406ac00 0x7f4c0406d0c0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4c240ad840 0x7f4c240adcc0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f4c24150fc0 0x7f4c2414d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 --2- 172.21.15.192:0/2727186224 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4c08007390 0x7f4c24152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 >> 172.21.15.192:0/2727186224 conn(0x7f4c240736d0 msgr2=0x7f4c240cbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 shutdown_connections 2024-09-13T18:46:04.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.488+0000 7f4c2a600640 1 -- 172.21.15.192:0/2727186224 wait complete. 2024-09-13T18:46:04.506 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:46:04.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.656+0000 7fcd07400640 1 Processor -- start 2024-09-13T18:46:04.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.656+0000 7fcd07400640 1 -- start start 2024-09-13T18:46:04.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fcd000cacd0 0x7fcd0015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd000cb0b0 0x7fcd0015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd00140980 0x7fcd00140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd0015c160 con 0x7fcd00140980 2024-09-13T18:46:04.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd00140480 con 0x7fcd000cacd0 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd07400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd0015ee90 con 0x7fcd000cb0b0 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd00140980 0x7fcd00140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fcd00140980 0x7fcd00140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33642/0 (socket says 172.21.15.192:33642) 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 -- 172.21.15.192:0/4167607191 learned_addr learned my addr 172.21.15.192:0/4167607191 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fccf7e00640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd000cb0b0 0x7fcd0015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd04a00640 1 --2- 172.21.15.192:0/4167607191 >> v2:172.21.15.194:3300/0 conn(0x7fcd000cacd0 0x7fcd0015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 -- 172.21.15.192:0/4167607191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd000cb0b0 msgr2=0x7fcd0015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd000cb0b0 0x7fcd0015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 -- 172.21.15.192:0/4167607191 >> v2:172.21.15.194:3300/0 conn(0x7fcd000cacd0 msgr2=0x7fcd0015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 --2- 172.21.15.192:0/4167607191 >> v2:172.21.15.194:3300/0 conn(0x7fcd000cacd0 0x7fcd0015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.658+0000 7fcd05400640 1 -- 172.21.15.192:0/4167607191 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0015f170 con 0x7fcd00140980 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.659+0000 7fcd05400640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd00140980 0x7fcd00140df0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcd000b2350 tx=0x7fccf802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee3556fba6f19dad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fccffe00640 1 -- 172.21.15.192:0/4167607191 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8031600 con 0x7fcd00140980 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fccffe00640 1 -- 172.21.15.192:0/4167607191 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf802d050 con 0x7fcd00140980 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fccffe00640 1 -- 172.21.15.192:0/4167607191 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf8031980 con 0x7fcd00140980 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 -- 172.21.15.192:0/4167607191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd00140980 msgr2=0x7fcd00140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd00140980 0x7fcd00140df0 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fcd000b2350 tx=0x7fccf802a610 comp rx=0 tx=0).stop 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 -- 172.21.15.192:0/4167607191 shutdown_connections 2024-09-13T18:46:04.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd00140980 0x7fcd00140df0 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 --2- 172.21.15.192:0/4167607191 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd000cb0b0 0x7fcd0015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 --2- 172.21.15.192:0/4167607191 >> v2:172.21.15.194:3300/0 conn(0x7fcd000cacd0 0x7fcd0015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 -- 172.21.15.192:0/4167607191 >> 172.21.15.192:0/4167607191 conn(0x7fcd000ae960 msgr2=0x7fcd0006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 -- 172.21.15.192:0/4167607191 shutdown_connections 2024-09-13T18:46:04.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.660+0000 7fcd07400640 1 -- 172.21.15.192:0/4167607191 wait complete. 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.662+0000 7fcd07400640 1 Processor -- start 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.662+0000 7fcd07400640 1 -- start start 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 0x7fcd0006ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd00140980 0x7fcd0013d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00156280 con 0x7fcd000cb0b0 2024-09-13T18:46:04.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00156560 con 0x7fcd000cacd0 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fcd07400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd00156840 con 0x7fcd00140980 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fccf7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33652/0 (socket says 172.21.15.192:33652) 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.663+0000 7fccf7e00640 1 -- 172.21.15.192:0/629319673 learned_addr learned my addr 172.21.15.192:0/629319673 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fcd05400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd00140980 0x7fcd0013d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fcd04a00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 0x7fcd0006ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 -- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd00140980 msgr2=0x7fcd0013d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd00140980 0x7fcd0013d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 -- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 msgr2=0x7fcd0006ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 0x7fcd0006ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 -- 172.21.15.192:0/629319673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf8009b30 con 0x7fcd000cb0b0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fcd04a00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 0x7fcd0006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccf7e00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9b0 tx=0x7fcce800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8009670 con 0x7fcd000cb0b0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce800c9a0 con 0x7fcd000cb0b0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce800cd50 con 0x7fcd000cb0b0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd00156b20 con 0x7fcd000cb0b0 2024-09-13T18:46:04.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.664+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd0006bf80 con 0x7fcd000cb0b0 2024-09-13T18:46:04.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.665+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd000b0490 con 0x7fcd000cb0b0 2024-09-13T18:46:04.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.666+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fcce8013470 con 0x7fcd000cb0b0 2024-09-13T18:46:04.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.667+0000 7fccfd600640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 0x7fccdc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:04.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.667+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcce8089600 con 0x7fcd000cb0b0 2024-09-13T18:46:04.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.667+0000 7fcd04a00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 0x7fccdc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:04.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.668+0000 7fcd04a00640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 0x7fccdc06d0c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcd001f5f00 tx=0x7fccf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:04.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.671+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fcce80547d0 con 0x7fcd000cb0b0 2024-09-13T18:46:04.873 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.870+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd0006c6c0 con 0x7fcd000cb0b0 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.871+0000 7fccfd600640 1 -- 172.21.15.192:0/629319673 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fcce8057df0 con 0x7fcd000cb0b0 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:46:04.874 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:46:04.876 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.873+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 msgr2=0x7fccdc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.873+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 0x7fccdc06d0c0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fcd001f5f00 tx=0x7fccf0008040 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 msgr2=0x7fcd0013d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fcce800e9b0 tx=0x7fcce800ee70 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 shutdown_connections 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fccdc06ac00 0x7fccdc06d0c0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fcd00140980 0x7fcd0013d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcd000cb0b0 0x7fcd0013d150 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 --2- 172.21.15.192:0/629319673 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fcd000cacd0 0x7fcd0006ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 >> 172.21.15.192:0/629319673 conn(0x7fcd000ae960 msgr2=0x7fcd00159570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 shutdown_connections 2024-09-13T18:46:04.877 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:04.874+0000 7fcd07400640 1 -- 172.21.15.192:0/629319673 wait complete. 2024-09-13T18:46:05.295 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:45:54.890757+0000', 'modified': '2024-09-13T18:45:57.906830+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8586}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8586': {'gid': 8586, 'name': 'a', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.192:6837/2926352862', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.192:6836', 'nonce': 2926352862}, {'type': 'v1', 'addr': '172.21.15.192:6837', 'nonce': 2926352862}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:46:05.296 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:46:05.296 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-13T18:46:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.448+0000 7ff652400640 1 Processor -- start 2024-09-13T18:46:05.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.448+0000 7ff652400640 1 -- start start 2024-09-13T18:46:05.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.449+0000 7ff652400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 0x7ff64c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.449+0000 7ff652400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 0x7ff64c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.449+0000 7ff652400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64c0b2f00 con 0x7ff64c0b3f10 2024-09-13T18:46:05.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.449+0000 7ff652400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff64c0b3150 con 0x7ff64c15dee0 2024-09-13T18:46:05.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.449+0000 7ff652400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c0b3430 con 0x7ff64c15e2c0 2024-09-13T18:46:05.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64b400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 0x7ff64c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff643e00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7ff64c0b3f10 0x7ff64c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:49062/0 (socket says 172.21.15.192:49062) 2024-09-13T18:46:05.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff643e00640 1 -- 172.21.15.192:0/2471573307 learned_addr learned my addr 172.21.15.192:0/2471573307 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:46:05.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 0x7ff64c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64aa00640 1 -- 172.21.15.192:0/2471573307 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2098330436 0 0) 0x7ff64c0b2f00 con 0x7ff64c0b3f10 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64aa00640 1 -- 172.21.15.192:0/2471573307 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff630003520 con 0x7ff64c0b3f10 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64be00640 1 -- 172.21.15.192:0/2471573307 >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 msgr2=0x7ff64c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64be00640 1 --2- 172.21.15.192:0/2471573307 >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 0x7ff64c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64be00640 1 -- 172.21.15.192:0/2471573307 >> v1:172.21.15.194:6789/0 conn(0x7ff64c0b3f10 legacy=0x7ff64c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64be00640 1 -- 172.21.15.192:0/2471573307 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c0b3710 con 0x7ff64c15e2c0 2024-09-13T18:46:05.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.450+0000 7ff64b400640 1 --2- 172.21.15.192:0/2471573307 >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 0x7ff64c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:46:05.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.451+0000 7ff64be00640 1 --2- 172.21.15.192:0/2471573307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 0x7ff64c15ab50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff644009d90 tx=0x7ff64402a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37b123b43e7a6c1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff64aa00640 1 -- 172.21.15.192:0/2471573307 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644007740 con 0x7ff64c15e2c0 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff64aa00640 1 -- 172.21.15.192:0/2471573307 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64402d050 con 0x7ff64c15e2c0 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff64aa00640 1 -- 172.21.15.192:0/2471573307 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644007ac0 con 0x7ff64c15e2c0 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 -- 172.21.15.192:0/2471573307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 msgr2=0x7ff64c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 --2- 172.21.15.192:0/2471573307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 0x7ff64c15ab50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ff644009d90 tx=0x7ff64402a660 comp rx=0 tx=0).stop 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 -- 172.21.15.192:0/2471573307 shutdown_connections 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 --2- 172.21.15.192:0/2471573307 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c15e2c0 0x7ff64c15ab50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 --2- 172.21.15.192:0/2471573307 >> v2:172.21.15.194:3300/0 conn(0x7ff64c15dee0 0x7ff64c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.452+0000 7ff652400640 1 -- 172.21.15.192:0/2471573307 >> 172.21.15.192:0/2471573307 conn(0x7ff64c0ae960 msgr2=0x7ff64c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.453+0000 7ff652400640 1 -- 172.21.15.192:0/2471573307 shutdown_connections 2024-09-13T18:46:05.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.453+0000 7ff652400640 1 -- 172.21.15.192:0/2471573307 wait complete. 2024-09-13T18:46:05.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.454+0000 7ff652400640 1 Processor -- start 2024-09-13T18:46:05.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.454+0000 7ff652400640 1 -- start start 2024-09-13T18:46:05.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 0x7ff64c142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c150010 0x7ff64c13bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c142780 con 0x7ff64c15dee0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c141b70 con 0x7ff64c15e2c0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff652400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff64c141e50 con 0x7ff64c150010 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33658/0 (socket says 172.21.15.192:33658) 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.455+0000 7ff64b400640 1 -- 172.21.15.192:0/1401706031 learned_addr learned my addr 172.21.15.192:0/1401706031 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff643e00640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 0x7ff64c142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64be00640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c150010 0x7ff64c13bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 -- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c150010 msgr2=0x7ff64c13bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c150010 0x7ff64c13bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 -- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 msgr2=0x7ff64c142c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 0x7ff64c142c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 -- 172.21.15.192:0/1401706031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c009400 con 0x7ff64c15dee0 2024-09-13T18:46:05.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff643e00640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 0x7ff64c142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:05.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff64b400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00ebe0 tx=0x7ff63c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.460 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff643400640 1 -- 172.21.15.192:0/1401706031 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c009760 con 0x7ff64c15dee0 2024-09-13T18:46:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff643400640 1 -- 172.21.15.192:0/1401706031 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c00cc30 con 0x7ff64c15dee0 2024-09-13T18:46:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff643400640 1 -- 172.21.15.192:0/1401706031 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00eee0 con 0x7ff64c15dee0 2024-09-13T18:46:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff644009a70 con 0x7ff64c15dee0 2024-09-13T18:46:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.456+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c142410 con 0x7ff64c15dee0 2024-09-13T18:46:05.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.458+0000 7ff643400640 1 -- 172.21.15.192:0/1401706031 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff63c013470 con 0x7ff64c15dee0 2024-09-13T18:46:05.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.460+0000 7ff643400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.460+0000 7ff643400640 1 -- 172.21.15.192:0/1401706031 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff63c089710 con 0x7ff64c15dee0 2024-09-13T18:46:05.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.460+0000 7ff643e00640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.460+0000 7ff65526a740 1 Processor -- start 2024-09-13T18:46:05.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 -- start start 2024-09-13T18:46:05.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff643e00640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff64c137220 tx=0x7ff634009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 0x55599e892ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e8930e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e7aeab0 con 0x55599e8456d0 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e7ac240 con 0x55599e842e90 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.461+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55599e7a7b30 con 0x55599e86cb80 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33664/0 (socket says 172.21.15.192:33664) 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 -- 172.21.15.192:0/4053872570 learned_addr learned my addr 172.21.15.192:0/4053872570 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff643e00640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 0x55599e892ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64be00640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e8930e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 -- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 msgr2=0x55599e8930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e8930e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 -- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 msgr2=0x55599e892ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 0x55599e892ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 -- 172.21.15.192:0/4053872570 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599e772bd0 con 0x55599e8456d0 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff643e00640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 0x55599e892ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:05.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.462+0000 7ff64b400640 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0603d0 tx=0x7ff63c058cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439eb9adc4e6c09c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff63be00640 1 -- 172.21.15.192:0/4053872570 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c05c170 con 0x55599e8456d0 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff63be00640 1 -- 172.21.15.192:0/4053872570 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c060900 con 0x55599e8456d0 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff63be00640 1 -- 172.21.15.192:0/4053872570 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c054c20 con 0x55599e8456d0 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 -- 172.21.15.192:0/4053872570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 msgr2=0x55599e845ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0603d0 tx=0x7ff63c058cd0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 -- 172.21.15.192:0/4053872570 shutdown_connections 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e8930e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e842e90 0x55599e892ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 --2- 172.21.15.192:0/4053872570 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e845ab0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 -- 172.21.15.192:0/4053872570 >> 172.21.15.192:0/4053872570 conn(0x55599e841e00 msgr2=0x55599e88a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 -- 172.21.15.192:0/4053872570 shutdown_connections 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.463+0000 7ff65526a740 1 -- 172.21.15.192:0/4053872570 wait complete. 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.464+0000 7ff65526a740 1 -- start start 2024-09-13T18:46:05.470 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.464+0000 7ff65526a740 1 Processor -- start 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e856ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e86b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e749260 con 0x55599e8456d0 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e748f00 con 0x55599e859520 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55599e50ef20 con 0x55599e86cb80 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff65526a740 10 client.0 _ll_register_callbacks cb 0x55599e7a11a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff64b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33676/0 (socket says 172.21.15.192:33676) 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff64b400640 1 -- 172.21.15.192:0/125364854 learned_addr learned my addr 172.21.15.192:0/125364854 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.465+0000 7ff643e00640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e856ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64be00640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e86b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.471 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 -- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 msgr2=0x55599e856ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e856ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 -- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 msgr2=0x55599e86b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e86b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 -- 172.21.15.192:0/125364854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64c142410 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff64b400640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0586d0 tx=0x7ff63c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990bdbba4ee05bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff638c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c060670 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff63c05e2d0 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55599e7d1cd0 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c05e490 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff65526a740 10 client.8745 fetch_fsmap learned FSMap version 78 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55599e7a61b0 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.466+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55599e7d1cd0 con 0x55599e8456d0 2024-09-13T18:46:05.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff63c074020 con 0x55599e8456d0 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 10 client.8745 fetch_fsmap finished waiting for FSMap version 78 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 10 client.8745 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 20 client.8745 populate_metadata read hostname 'smithi192' 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e888ae0 0x55599e86e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 4 client.8745 mds_command: new command op to 8586 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 --> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55599e49b3c0 con 0x55599e888ae0 2024-09-13T18:46:05.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff643e00640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e888ae0 0x55599e86e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff643e00640 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e888ae0 0x55599e86e0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ded9b771d3f3286 server_cookie=811c1a9c33bfd512 in_seq=0 out_seq=0 2024-09-13T18:46:05.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.467+0000 7ff638c00640 10 client.8745 ms_handle_connect on v2:172.21.15.192:6836/2926352862 2024-09-13T18:46:05.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.468+0000 7ff638c00640 1 -- 172.21.15.192:0/125364854 <== mds.0 v2:172.21.15.192:6836/2926352862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x55599e49b3c0 con 0x55599e888ae0 2024-09-13T18:46:05.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.468+0000 7ff638c00640 10 client.8745 handle_command_reply: tid=0 2024-09-13T18:46:05.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.468+0000 7ff65526a740 1 client.8745 shutdown 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.468+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 msgr2=0x55599e8878b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.468+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7ff63c0586d0 tx=0x7ff63c000bc0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 shutdown_connections 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e86b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e856ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e888ae0 0x55599e86e0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 --2- 172.21.15.192:0/125364854 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e8456d0 0x55599e8878b0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff638c00640 0 client.8745 ms_handle_reset on v2:172.21.15.192:6836/2926352862 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 >> 172.21.15.192:0/125364854 conn(0x55599e842e90 msgr2=0x55599e88dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 shutdown_connections 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 1 -- 172.21.15.192:0/125364854 wait complete. 2024-09-13T18:46:05.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.469+0000 7ff65526a740 20 client.8745 trim_cache size 0 max 16384 2024-09-13T18:46:05.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.484+0000 7ff65526a740 1 Processor -- start 2024-09-13T18:46:05.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.484+0000 7ff65526a740 1 -- start start 2024-09-13T18:46:05.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e8456d0 0x55599e8ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e86f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e89ca20 con 0x55599e859520 2024-09-13T18:46:05.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e8718c0 con 0x55599e8456d0 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55599e8713f0 con 0x55599e86cb80 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.485+0000 7ff643e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33682/0 (socket says 172.21.15.192:33682) 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 -- 172.21.15.192:0/258936474 learned_addr learned my addr 172.21.15.192:0/258936474 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff64be00640 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e86f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff64b400640 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e8456d0 0x55599e8ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 -- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 msgr2=0x55599e86f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e86f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 -- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e8456d0 msgr2=0x55599e8ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e8456d0 0x55599e8ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 -- 172.21.15.192:0/258936474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599e7db170 con 0x55599e859520 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.486+0000 7ff643e00640 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff64c06c0c0 tx=0x7ff634012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21fa5c6fefac6ce1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.487+0000 7ff640c00640 1 -- 172.21.15.192:0/258936474 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6340258e0 con 0x55599e859520 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.487+0000 7ff640c00640 1 -- 172.21.15.192:0/258936474 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6340070d0 con 0x55599e859520 2024-09-13T18:46:05.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.487+0000 7ff640c00640 1 -- 172.21.15.192:0/258936474 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff634007240 con 0x55599e859520 2024-09-13T18:46:05.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 -- 172.21.15.192:0/258936474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 msgr2=0x55599e891c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7ff64c06c0c0 tx=0x7ff634012000 comp rx=0 tx=0).stop 2024-09-13T18:46:05.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 -- 172.21.15.192:0/258936474 shutdown_connections 2024-09-13T18:46:05.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e86cb80 0x55599e86f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e859520 0x55599e891c90 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 --2- 172.21.15.192:0/258936474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e8456d0 0x55599e8ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 -- 172.21.15.192:0/258936474 >> 172.21.15.192:0/258936474 conn(0x55599e842e90 msgr2=0x55599e858a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 -- 172.21.15.192:0/258936474 shutdown_connections 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.488+0000 7ff65526a740 1 -- 172.21.15.192:0/258936474 wait complete. 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.489+0000 7ff65526a740 1 -- start start 2024-09-13T18:46:05.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.489+0000 7ff65526a740 1 Processor -- start 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e8456d0 0x55599e8e6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e8a9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e857f30 con 0x55599e86cb80 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599e8e7350 con 0x55599e859520 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x55599e8a9bb0 con 0x55599e8456d0 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff65526a740 10 client.0 _ll_register_callbacks cb 0x7ff6300036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33698/0 (socket says 172.21.15.192:33698) 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 -- 172.21.15.192:0/3697160591 learned_addr learned my addr 172.21.15.192:0/3697160591 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64b400640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e8456d0 0x55599e8e6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff643e00640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e8a9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 -- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e8456d0 msgr2=0x55599e8e6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e8456d0 0x55599e8e6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 -- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 msgr2=0x55599e8a9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e8a9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.490+0000 7ff64be00640 1 -- 172.21.15.192:0/3697160591 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63401d040 con 0x55599e86cb80 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff64be00640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ff64402ac50 tx=0x7ff64402c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d07fdd7fb3547de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff638c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644044040 con 0x55599e86cb80 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff644049680 con 0x55599e86cb80 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff63c060900 con 0x55599e86cb80 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff644049840 con 0x55599e86cb80 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff65526a740 10 client.8751 fetch_fsmap learned FSMap version 78 2024-09-13T18:46:05.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x55599e748470 con 0x55599e86cb80 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.491+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c060900 con 0x55599e86cb80 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff644038040 con 0x55599e86cb80 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 10 client.8751 fetch_fsmap finished waiting for FSMap version 78 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 10 client.8751 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 20 client.8751 populate_metadata read hostname 'smithi192' 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e8e79a0 0x55599e8e7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 4 client.8751 mds_command: new command op to 8586 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 --> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55599e4ac6c0 con 0x55599e8e79a0 2024-09-13T18:46:05.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff64b400640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e8e79a0 0x55599e8e7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff64b400640 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e8e79a0 0x55599e8e7d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a5a42a60e32f523 server_cookie=e29e1d78eacce8eb in_seq=0 out_seq=0 2024-09-13T18:46:05.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.492+0000 7ff638c00640 10 client.8751 ms_handle_connect on v2:172.21.15.192:6836/2926352862 2024-09-13T18:46:05.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff638c00640 1 -- 172.21.15.192:0/3697160591 <== mds.0 v2:172.21.15.192:6836/2926352862 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55599e4ac6c0 con 0x55599e8e79a0 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff638c00640 10 client.8751 handle_command_reply: tid=0 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 client.8751 shutdown 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 msgr2=0x55599e8589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7ff64402ac50 tx=0x7ff64402c000 comp rx=0 tx=0).stop 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 shutdown_connections 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:6836/2926352862,v1:172.21.15.192:6837/2926352862] conn(0x55599e8e79a0 0x55599e8e7d80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x55599e86cb80 0x55599e8589d0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x55599e859520 0x55599e8a9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 --2- 172.21.15.192:0/3697160591 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x55599e8456d0 0x55599e8e6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff638c00640 0 client.8751 ms_handle_reset on v2:172.21.15.192:6836/2926352862 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 >> 172.21.15.192:0/3697160591 conn(0x55599e842e90 msgr2=0x55599e8e8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 shutdown_connections 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 1 -- 172.21.15.192:0/3697160591 wait complete. 2024-09-13T18:46:05.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.493+0000 7ff65526a740 20 client.8751 trim_cache size 0 max 16384 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 8586, 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 10.599067112, 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 78, 2024-09-13T18:46:05.500 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 180, 2024-09-13T18:46:05.501 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 180, 2024-09-13T18:46:05.501 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 15.733523677000001 2024-09-13T18:46:05.501 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:46:05.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 msgr2=0x7ff62806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7ff64c137220 tx=0x7ff634009040 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 msgr2=0x7ff64c141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7ff63c00ebe0 tx=0x7ff63c00c520 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 shutdown_connections 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff62806ac00 0x7ff62806d0c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff64c150010 0x7ff64c13bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff64c15e2c0 0x7ff64c142c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 --2- 172.21.15.192:0/1401706031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff64c15dee0 0x7ff64c141590 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 >> 172.21.15.192:0/1401706031 conn(0x7ff64c0ae960 msgr2=0x7ff64c1366c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 shutdown_connections 2024-09-13T18:46:05.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.494+0000 7ff652400640 1 -- 172.21.15.192:0/1401706031 wait complete. 2024-09-13T18:46:05.512 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:46:05.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.661+0000 7f6edd800640 1 Processor -- start 2024-09-13T18:46:05.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.661+0000 7f6edd800640 1 -- start start 2024-09-13T18:46:05.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.662+0000 7f6edd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.662+0000 7f6edd800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 0x7f6ed80ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.662+0000 7f6edd800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ed80ada70 con 0x7f6ed80afc70 2024-09-13T18:46:05.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.662+0000 7f6edd800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ed80d0560 con 0x7f6ed80adf00 2024-09-13T18:46:05.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.662+0000 7f6edd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed80cfcc0 con 0x7f6ed80af890 2024-09-13T18:46:05.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6edce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 0x7f6ed80ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:34376/0 (socket says 172.21.15.192:34376) 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6edce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 0x7f6ed80ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:54494/0 (socket says 172.21.15.192:54494) 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 -- 172.21.15.192:0/2941540130 learned_addr learned my addr 172.21.15.192:0/2941540130 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 -- 172.21.15.192:0/2941540130 >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 msgr2=0x7f6ed80ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/2941540130 >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 0x7f6ed80ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 -- 172.21.15.192:0/2941540130 >> v1:172.21.15.194:6789/0 conn(0x7f6ed80afc70 legacy=0x7f6ed80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7e00640 1 -- 172.21.15.192:0/2941540130 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed80cffa0 con 0x7f6ed80af890 2024-09-13T18:46:05.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.663+0000 7f6ed7400640 1 -- 172.21.15.192:0/2941540130 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810065004 0 0) 0x7f6ed80ada70 con 0x7f6ed80afc70 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.664+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/2941540130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80098a0 tx=0x7f6ec802a290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bc7d50ae9c8e663 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.664+0000 7f6ed7400640 1 -- 172.21.15.192:0/2941540130 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8032440 con 0x7f6ed80af890 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6ed7400640 1 -- 172.21.15.192:0/2941540130 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80325a0 con 0x7f6ed80af890 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6ed7400640 1 -- 172.21.15.192:0/2941540130 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8032930 con 0x7f6ed80af890 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 -- 172.21.15.192:0/2941540130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 msgr2=0x7f6ed80b6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 --2- 172.21.15.192:0/2941540130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6ec80098a0 tx=0x7f6ec802a290 comp rx=0 tx=0).stop 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 -- 172.21.15.192:0/2941540130 shutdown_connections 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 --2- 172.21.15.192:0/2941540130 >> v2:172.21.15.194:3300/0 conn(0x7f6ed80adf00 0x7f6ed80ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 --2- 172.21.15.192:0/2941540130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed80b6160 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 -- 172.21.15.192:0/2941540130 >> 172.21.15.192:0/2941540130 conn(0x7f6ed80cd660 msgr2=0x7f6ed80cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 -- 172.21.15.192:0/2941540130 shutdown_connections 2024-09-13T18:46:05.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.665+0000 7f6edd800640 1 -- 172.21.15.192:0/2941540130 wait complete. 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.667+0000 7f6edd800640 1 Processor -- start 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.667+0000 7f6edd800640 1 -- start start 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80adf00 0x7f6ed80cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed8144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8145b40 con 0x7f6ed80afc70 2024-09-13T18:46:05.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8145580 con 0x7f6ed80adf00 2024-09-13T18:46:05.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edd800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ed8145860 con 0x7f6ed80af890 2024-09-13T18:46:05.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33710/0 (socket says 172.21.15.192:33710) 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edce00640 1 -- 172.21.15.192:0/2874174495 learned_addr learned my addr 172.21.15.192:0/2874174495 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80adf00 0x7f6ed80cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6ecfe00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed8144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edce00640 1 -- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 msgr2=0x7f6ed8144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.668+0000 7f6edce00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed8144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edce00640 1 -- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80adf00 msgr2=0x7f6ed80cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edce00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80adf00 0x7f6ed80cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edce00640 1 -- 172.21.15.192:0/2874174495 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec80094d0 con 0x7f6ed80afc70 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edce00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000efc0 tx=0x7f6ed000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0014480 con 0x7f6ed80afc70 2024-09-13T18:46:05.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000f040 con 0x7f6ed80afc70 2024-09-13T18:46:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ed806b170 con 0x7f6ed80afc70 2024-09-13T18:46:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed0014820 con 0x7f6ed80afc70 2024-09-13T18:46:05.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.669+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ed81f23b0 con 0x7f6ed80afc70 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.670+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ed806afd0 con 0x7f6ed80afc70 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.671+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6ed0014980 con 0x7f6ed80afc70 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.672+0000 7f6ed4c00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.672+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ed008a220 con 0x7f6ed80afc70 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.672+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:05.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.673+0000 7f6ed7e00640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8034000 tx=0x7f6ec802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:05.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.676+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6ed806afd0 con 0x7f6ed80afc70 2024-09-13T18:46:05.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.877+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6ed806afd0 con 0x7f6ed80afc70 2024-09-13T18:46:05.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.877+0000 7f6ed4c00640 1 -- 172.21.15.192:0/2874174495 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6ed806afd0 con 0x7f6ed80afc70 2024-09-13T18:46:05.880 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:46:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 msgr2=0x7f6eb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f6ec8034000 tx=0x7f6ec802e000 comp rx=0 tx=0).stop 2024-09-13T18:46:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 msgr2=0x7f6ed806d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f6ed000efc0 tx=0x7f6ed000c490 comp rx=0 tx=0).stop 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 shutdown_connections 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6eb406ac00 0x7f6eb406d0c0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ed80afc70 0x7f6ed806d660 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6ed80af890 0x7f6ed8144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 --2- 172.21.15.192:0/2874174495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6ed80adf00 0x7f6ed80cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 >> 172.21.15.192:0/2874174495 conn(0x7f6ed80cd660 msgr2=0x7f6ed80b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 shutdown_connections 2024-09-13T18:46:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:05.879+0000 7f6edd800640 1 -- 172.21.15.192:0/2874174495 wait complete. 2024-09-13T18:46:05.898 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:46:05.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:46:05.899 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:46:05.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:05.899 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:46:05.935 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:46:05.935 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:46:05.936 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42143sec preferred_lft 42143sec 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:05.937 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:46:05.938 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:05.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:05.939 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:46:06.029 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:46:06.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.033 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:46:06.069 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:46:06.069 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:46:06.069 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:46:06.069 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:46:06.069 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:46:06.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:46:06.070 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:46:06.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.216 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:46:06.251 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:46:06.251 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:46:06.252 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:46:06.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.252 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:46:06.347 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:46:06.347 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:46:06.383 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:46:06.383 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:46:06.383 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:46:06.457 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:46:06.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.457 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:06.585 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:06.585 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:46:06.613 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:06.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:46:06.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:46:06.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:46:06.613 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:46:06.615 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:46:06.615 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:46:06.615 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:46:06.616 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:46:06.616 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:46:06.618 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:46:06.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.619 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:46:06.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:06.676 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:46:06.721 INFO:teuthology.orchestra.run.smithi192.stdout:client8239 2024-09-13T18:46:06.722 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:46:06.722 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:46:06.797 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:46:06.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.986+0000 7f04a8000640 1 Processor -- start 2024-09-13T18:46:06.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.986+0000 7f04a8000640 1 -- start start 2024-09-13T18:46:06.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04a015dee0 0x7f04a00afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f04a00b3f10 0x7f04a00b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00b2f00 con 0x7f04a015dee0 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a00b3150 con 0x7f04a00b3f10 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.987+0000 7f04a8000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00b3430 con 0x7f04a015e2c0 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04a015dee0 0x7f04a00afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f04a015dee0 0x7f04a00afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33714/0 (socket says 172.21.15.192:33714) 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 -- 172.21.15.192:0/2151373483 learned_addr learned my addr 172.21.15.192:0/2151373483 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a4c00640 1 --2- 172.21.15.192:0/2151373483 >> v2:172.21.15.194:3300/0 conn(0x7f04a00b3f10 0x7f04a00b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.991 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a6000640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 -- 172.21.15.192:0/2151373483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 msgr2=0x7f04a015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 -- 172.21.15.192:0/2151373483 >> v2:172.21.15.194:3300/0 conn(0x7f04a00b3f10 msgr2=0x7f04a00b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 --2- 172.21.15.192:0/2151373483 >> v2:172.21.15.194:3300/0 conn(0x7f04a00b3f10 0x7f04a00b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.988+0000 7f04a5600640 1 -- 172.21.15.192:0/2151373483 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00b3710 con 0x7f04a015dee0 2024-09-13T18:46:06.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.989+0000 7f04a5600640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a00afd80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f04a00b4700 tx=0x7f049402c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6338ca143dd453cd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.989+0000 7f049fe00640 1 -- 172.21.15.192:0/2151373483 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494032790 con 0x7f04a015dee0 2024-09-13T18:46:06.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.989+0000 7f049fe00640 1 -- 172.21.15.192:0/2151373483 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04940328f0 con 0x7f04a015dee0 2024-09-13T18:46:06.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.989+0000 7f049fe00640 1 -- 172.21.15.192:0/2151373483 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494032c80 con 0x7f04a015dee0 2024-09-13T18:46:06.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 -- 172.21.15.192:0/2151373483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 msgr2=0x7f04a00afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a00afd80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f04a00b4700 tx=0x7f049402c890 comp rx=0 tx=0).stop 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 -- 172.21.15.192:0/2151373483 shutdown_connections 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 --2- 172.21.15.192:0/2151373483 >> v2:172.21.15.194:3300/0 conn(0x7f04a00b3f10 0x7f04a00b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 --2- 172.21.15.192:0/2151373483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a00afd80 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 -- 172.21.15.192:0/2151373483 >> 172.21.15.192:0/2151373483 conn(0x7f04a00ae960 msgr2=0x7f04a006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 -- 172.21.15.192:0/2151373483 shutdown_connections 2024-09-13T18:46:06.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.990+0000 7f04a8000640 1 -- 172.21.15.192:0/2151373483 wait complete. 2024-09-13T18:46:06.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.992+0000 7f04a8000640 1 Processor -- start 2024-09-13T18:46:06.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.992+0000 7f04a8000640 1 -- start start 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a0155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04a0153230 0x7f04a01536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0153c00 con 0x7f04a015dee0 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a012f470 con 0x7f04a0153230 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a8000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a01302d0 con 0x7f04a015e2c0 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33724/0 (socket says 172.21.15.192:33724) 2024-09-13T18:46:06.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 -- 172.21.15.192:0/1014486950 learned_addr learned my addr 172.21.15.192:0/1014486950 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a4c00640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a0155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a6000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04a0153230 0x7f04a01536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 -- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 msgr2=0x7f04a0155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a0155ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 -- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04a0153230 msgr2=0x7f04a01536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04a0153230 0x7f04a01536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.993+0000 7f04a5600640 1 -- 172.21.15.192:0/1014486950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049400b770 con 0x7f04a015dee0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f04a5600640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049403c830 con 0x7f04a015dee0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494032e90 con 0x7f04a015dee0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a01f2a90 con 0x7f04a015dee0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049403cbb0 con 0x7f04a015dee0 2024-09-13T18:46:06.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.994+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a012f9a0 con 0x7f04a015dee0 2024-09-13T18:46:06.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.995+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a00b2a10 con 0x7f04a015dee0 2024-09-13T18:46:06.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.996+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f049403cd10 con 0x7f04a015dee0 2024-09-13T18:46:07.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.997+0000 7f049d600640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 0x7f048006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:07.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.997+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04940aa070 con 0x7f04a015dee0 2024-09-13T18:46:07.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.997+0000 7f04a4c00640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 0x7f048006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:07.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:06.998+0000 7f04a4c00640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 0x7f048006d0c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f04a0153f10 tx=0x7f048c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:07.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.001+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f04940dd9c0 con 0x7f04a015dee0 2024-09-13T18:46:07.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.202+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f04a00b2730 con 0x7f04a015dee0 2024-09-13T18:46:07.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.202+0000 7f049d600640 1 -- 172.21.15.192:0/1014486950 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f049404d070 con 0x7f04a015dee0 2024-09-13T18:46:07.205 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 msgr2=0x7f048006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 0x7f048006d0c0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f04a0153f10 tx=0x7f048c009190 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 msgr2=0x7f04a01f2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494004730 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 shutdown_connections 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f048006ac00 0x7f048006d0c0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f04a0153230 0x7f04a01536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f04a015e2c0 0x7f04a0155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 --2- 172.21.15.192:0/1014486950 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04a015dee0 0x7f04a01f2550 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 >> 172.21.15.192:0/1014486950 conn(0x7f04a00ae960 msgr2=0x7f04a00702d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 shutdown_connections 2024-09-13T18:46:07.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:07.205+0000 7f04a8000640 1 -- 172.21.15.192:0/1014486950 wait complete. 2024-09-13T18:46:07.223 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:46:07.223 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:46:07.223 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:46:07.224 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:46:07.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.224 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.265 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42147sec preferred_lft 42147sec 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.266 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:46:07.267 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:46:07.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.268 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:46:07.363 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:46:07.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.366 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:46:07.403 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:46:07.403 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:46:07.403 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:46:07.404 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:46:07.404 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:46:07.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.404 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:46:07.404 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:46:07.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:46:07.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:46:07.404 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:46:07.405 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:46:07.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.548 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:46:07.584 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:46:07.584 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:46:07.584 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:46:07.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.584 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:46:07.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:46:07.680 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:46:07.715 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:46:07.715 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:46:07.715 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:46:07.790 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:46:07.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.790 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:07.918 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:07.919 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:46:07.945 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:46:07.945 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:46:07.945 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:46:07.946 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:46:07.946 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:46:07.947 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:46:07.947 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:46:07.947 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:46:07.947 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:46:07.947 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:46:07.950 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:46:07.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:07.950 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:46:08.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:46:08.006 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:46:08.044 INFO:teuthology.orchestra.run.smithi194.stdout:client8248 2024-09-13T18:46:08.045 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:46:08.045 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:46:08.120 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:46:08.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.274+0000 7f30e1c00640 1 Processor -- start 2024-09-13T18:46:08.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.274+0000 7f30e1c00640 1 -- start start 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30e1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30e1c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 0x7f30dc0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30e1c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30dc071dd0 con 0x7f30dc150480 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30e1c00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30dc0cb770 con 0x7f30dc0b2230 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30e1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc0cba50 con 0x7f30dc071810 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30db400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 0x7f30dc0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30db400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 0x7f30dc0cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33732/0 (socket says 172.21.15.192:33732) 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:34414/0 (socket says 172.21.15.192:34414) 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 -- 172.21.15.192:0/146760571 learned_addr learned my addr 172.21.15.192:0/146760571 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:08.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30daa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f30dc150480 0x7f30dc15a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:49086/0 (socket says 172.21.15.192:49086) 2024-09-13T18:46:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 -- 172.21.15.192:0/146760571 >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 msgr2=0x7f30dc0cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:46:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 --2- 172.21.15.192:0/146760571 >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 0x7f30dc0cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 -- 172.21.15.192:0/146760571 >> v1:172.21.15.194:6789/0 conn(0x7f30dc150480 legacy=0x7f30dc15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30da000640 1 -- 172.21.15.192:0/146760571 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30dc0cbd30 con 0x7f30dc071810 2024-09-13T18:46:08.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.276+0000 7f30d9600640 1 -- 172.21.15.192:0/146760571 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420252357 0 0) 0x7f30dc071dd0 con 0x7f30dc150480 2024-09-13T18:46:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.277+0000 7f30da000640 1 --2- 172.21.15.192:0/146760571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30c800bb00 tx=0x7f30c802c650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eae65ca0c800aafa server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30d9600640 1 -- 172.21.15.192:0/146760571 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8032480 con 0x7f30dc071810 2024-09-13T18:46:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30d9600640 1 -- 172.21.15.192:0/146760571 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c802f030 con 0x7f30dc071810 2024-09-13T18:46:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30d9600640 1 -- 172.21.15.192:0/146760571 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c8032800 con 0x7f30dc071810 2024-09-13T18:46:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 -- 172.21.15.192:0/146760571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 msgr2=0x7f30dc0b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 --2- 172.21.15.192:0/146760571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f30c800bb00 tx=0x7f30c802c650 comp rx=0 tx=0).stop 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 -- 172.21.15.192:0/146760571 shutdown_connections 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 --2- 172.21.15.192:0/146760571 >> v2:172.21.15.192:3300/0 conn(0x7f30dc0b2230 0x7f30dc0cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 --2- 172.21.15.192:0/146760571 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc0b1cf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 -- 172.21.15.192:0/146760571 >> 172.21.15.192:0/146760571 conn(0x7f30dc0ae960 msgr2=0x7f30dc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 -- 172.21.15.192:0/146760571 shutdown_connections 2024-09-13T18:46:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.278+0000 7f30e1c00640 1 -- 172.21.15.192:0/146760571 wait complete. 2024-09-13T18:46:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.280+0000 7f30e1c00640 1 Processor -- start 2024-09-13T18:46:08.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.280+0000 7f30e1c00640 1 -- start start 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc14f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30dc0b2230 0x7f30dc15d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc15b560 con 0x7f30dc150480 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc14f940 con 0x7f30dc0b2230 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30e1c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30dc15b770 con 0x7f30dc071810 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33736/0 (socket says 172.21.15.192:33736) 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30db400640 1 -- 172.21.15.192:0/4203715441 learned_addr learned my addr 172.21.15.192:0/4203715441 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30da000640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30dc0b2230 0x7f30dc15d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.281+0000 7f30daa00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc14f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 -- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 msgr2=0x7f30dc14f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc14f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 -- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30dc0b2230 msgr2=0x7f30dc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30dc0b2230 0x7f30dc15d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 -- 172.21.15.192:0/4203715441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c800b760 con 0x7f30dc150480 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30daa00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30db400640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f30d400e850 tx=0x7f30d400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4009630 con 0x7f30dc150480 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30d400c940 con 0x7f30dc150480 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d400ccf0 con 0x7f30dc150480 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30dc15ba50 con 0x7f30dc150480 2024-09-13T18:46:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.282+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30dc15c010 con 0x7f30dc150480 2024-09-13T18:46:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.283+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30dc071dd0 con 0x7f30dc150480 2024-09-13T18:46:08.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.284+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f30d4013470 con 0x7f30dc150480 2024-09-13T18:46:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.285+0000 7f30d2a00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 0x7f30bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.285+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30d4089490 con 0x7f30dc150480 2024-09-13T18:46:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.285+0000 7f30daa00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 0x7f30bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.286+0000 7f30daa00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 0x7f30bc06d0c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0012e0 tx=0x7f30cc005bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.289+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f30d40547b0 con 0x7f30dc150480 2024-09-13T18:46:08.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.490+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30dc158cf0 con 0x7f30dc150480 2024-09-13T18:46:08.494 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.491+0000 7f30d2a00640 1 -- 172.21.15.192:0/4203715441 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f30d4057dd0 con 0x7f30dc150480 2024-09-13T18:46:08.494 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:46:08.494 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:46:08.494 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 msgr2=0x7f30bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 0x7f30bc06d0c0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0012e0 tx=0x7f30cc005bb0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 msgr2=0x7f30dc152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f30d400e850 tx=0x7f30d400ed10 comp rx=0 tx=0).stop 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 shutdown_connections 2024-09-13T18:46:08.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f30bc06ac00 0x7f30bc06d0c0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f30dc150480 0x7f30dc152860 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f30dc0b2230 0x7f30dc15d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 --2- 172.21.15.192:0/4203715441 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f30dc071810 0x7f30dc14f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 >> 172.21.15.192:0/4203715441 conn(0x7f30dc0ae960 msgr2=0x7f30dc070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 shutdown_connections 2024-09-13T18:46:08.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.493+0000 7f30e1c00640 1 -- 172.21.15.192:0/4203715441 wait complete. 2024-09-13T18:46:08.512 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2024-09-13T18:46:08.682 INFO:teuthology.orchestra.run.smithi192.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":8586,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.773139029999999,"mdsmap_epoch":78,"osdmap_epoch":180,"osdmap_epoch_barrier":180,"uptime":18.907589313999999} 2024-09-13T18:46:08.683 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 8586, "mdsmap_epoch": 78, "osdmap_epoch": 180, "osdmap_epoch_barrier": 180, "rank_uptime": 13.77313903, "state": "up:active", "uptime": 18.907589314, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:46:08.683 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-13T18:46:08.701 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:08.732 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:08.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.840+0000 7fb800200640 1 Processor -- start 2024-09-13T18:46:08.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.840+0000 7fb800200640 1 -- start start 2024-09-13T18:46:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb800200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cd9c0 0x7fb7f80cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb800200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f806a330 con 0x7fb7f81403e0 2024-09-13T18:46:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb800200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f815b300 con 0x7fb7f8071b80 2024-09-13T18:46:08.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb800200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f813e0f0 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb7fe200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb7f80cd9c0 0x7fb7f80cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb7fce00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb7f81403e0 0x7fb7f8070bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56364/0 (socket says 172.21.15.192:56364) 2024-09-13T18:46:08.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.841+0000 7fb7fce00640 1 -- 172.21.15.192:0/138962305 learned_addr learned my addr 172.21.15.192:0/138962305 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:46:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.842+0000 7fb7fe200640 1 -- 172.21.15.192:0/138962305 >> v1:172.21.15.194:6789/0 conn(0x7fb7f8071b80 legacy=0x7fb7f815f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.842+0000 7fb7fe200640 1 -- 172.21.15.192:0/138962305 >> v1:172.21.15.192:6789/0 conn(0x7fb7f81403e0 legacy=0x7fb7f8070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.842+0000 7fb7fe200640 1 -- 172.21.15.192:0/138962305 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f81408a0 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.842+0000 7fb7f7e00640 1 -- 172.21.15.192:0/138962305 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104623621 0 0) 0x7fb7e4001110 con 0x7fb7f81403e0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.843+0000 7fb7fe200640 1 --2- 172.21.15.192:0/138962305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f80cde30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009d90 tx=0x7fb7f002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd6f669363c4ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.843+0000 7fb7f7e00640 1 -- 172.21.15.192:0/138962305 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0007740 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.843+0000 7fb7f7e00640 1 -- 172.21.15.192:0/138962305 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f002d050 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.843+0000 7fb7f7e00640 1 -- 172.21.15.192:0/138962305 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0007ac0 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 -- 172.21.15.192:0/138962305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 msgr2=0x7fb7f80cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 --2- 172.21.15.192:0/138962305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f80cde30 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009d90 tx=0x7fb7f002a660 comp rx=0 tx=0).stop 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 -- 172.21.15.192:0/138962305 shutdown_connections 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 --2- 172.21.15.192:0/138962305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f80cde30 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 -- 172.21.15.192:0/138962305 >> 172.21.15.192:0/138962305 conn(0x7fb7f80b0c40 msgr2=0x7fb7f80b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 -- 172.21.15.192:0/138962305 shutdown_connections 2024-09-13T18:46:08.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.844+0000 7fb800200640 1 -- 172.21.15.192:0/138962305 wait complete. 2024-09-13T18:46:08.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.845+0000 7fb800200640 1 Processor -- start 2024-09-13T18:46:08.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.845+0000 7fb800200640 1 -- start start 2024-09-13T18:46:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7f8071b80 0x7fb7f81f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7f81403e0 0x7fb7f80c5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f80c4e30 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f81f4e80 con 0x7fb7f81403e0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.846+0000 7fb800200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f813d6b0 con 0x7fb7f8071b80 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:33742/0 (socket says 172.21.15.192:33742) 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 -- 172.21.15.192:0/901127722 learned_addr learned my addr 172.21.15.192:0/901127722 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fe200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7f81403e0 0x7fb7f80c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fd800640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7f8071b80 0x7fb7f81f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 -- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7f8071b80 msgr2=0x7fb7f81f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7f8071b80 0x7fb7f81f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 -- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7f81403e0 msgr2=0x7fb7f80c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:08.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7f81403e0 0x7fb7f80c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 -- 172.21.15.192:0/901127722 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f0009a70 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7fce00640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c420 tx=0x7fb7e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.847+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e40074e0 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.848+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e4007640 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.848+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4004a00 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.848+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f80c4190 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.848+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f80c4770 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.849+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f80c4f70 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.850+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7e4004b60 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.850+0000 7fb7f5600640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 0x7fb7d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:46:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.851+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(180..180 src has 1..180) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7e4088e20 con 0x7fb7f80cd9c0 2024-09-13T18:46:08.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.851+0000 7fb7fd800640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 0x7fb7d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:46:08.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.851+0000 7fb7fd800640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 0x7fb7d806d0c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000f60 tx=0x7fb7ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:46:08.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:08.855+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7f80c4f70 con 0x7fb7f80cd9c0 2024-09-13T18:46:09.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.026+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fb7f806a330 con 0x7fb7f80cd9c0 2024-09-13T18:46:09.957 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.954+0000 7fb7f5600640 1 -- 172.21.15.192:0/901127722 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v181) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb7f806a330 con 0x7fb7f80cd9c0 2024-09-13T18:46:09.958 INFO:teuthology.orchestra.run.smithi192.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-13T18:46:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.957+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 msgr2=0x7fb7d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:09.960 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.957+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 0x7fb7d806d0c0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec000f60 tx=0x7fb7ec009040 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.957+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 msgr2=0x7fb7f8150e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.957+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c420 tx=0x7fb7e400c8e0 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 shutdown_connections 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7d806ac00 0x7fb7d806d0c0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb7f81403e0 0x7fb7f80c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7f80cd9c0 0x7fb7f8150e20 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 --2- 172.21.15.192:0/901127722 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb7f8071b80 0x7fb7f81f4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 >> 172.21.15.192:0/901127722 conn(0x7fb7f80b0c40 msgr2=0x7fb7f815e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 shutdown_connections 2024-09-13T18:46:09.961 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:46:09.958+0000 7fb800200640 1 -- 172.21.15.192:0/901127722 wait complete. 2024-09-13T18:46:09.980 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:46:10.190 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:46:10.190 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:46:10.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2024-09-13T18:46:10.351 INFO:teuthology.orchestra.run.smithi192.stdout:{"mon_tick_interval":"5"} 2024-09-13T18:46:10.352 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2024-09-13T18:46:10.352 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> adjust-ulimits daemon-helper kill python3 -c ' 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> import time 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> import datetime 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> # Write some buffered data through before going full, all should be well 2024-09-13T18:46:10.352 DEBUG:teuthology.orchestra.run.smithi192:> print("writing some data through which we expect to succeed") 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> bytes = 0 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> # writing until we see an error from fsync. As long as we'"'"'re doing 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> # buffered IO, the error should always only appear from fsync and not 2024-09-13T18:46:10.353 DEBUG:teuthology.orchestra.run.smithi192:> # from write 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> full = False 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> for n in range(0, int(32 * 1.1)): 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> print("wrote bytes via buffered write, moving on to fsync") 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> except OSError as e: 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> if False: 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> print("Unexpected error %s from write() instead of fsync()" % e) 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> raise 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:46:10.354 DEBUG:teuthology.orchestra.run.smithi192:> full = True 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> break 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> try: 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> os.fsync(f) 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> print("fsync'"'"'ed successfully") 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> except OSError as e: 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> full = True 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> break 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> else: 2024-09-13T18:46:10.355 DEBUG:teuthology.orchestra.run.smithi192:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> if n > 32 * 0.9: 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> # Be cautious in the last region where we expect to hit 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> # the full condition, so that we don'"'"'t overshoot too dramatically 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> time.sleep(15.0) 2024-09-13T18:46:10.356 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> if not full: 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> # close() should not raise an error because we already caught it in 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> # fsync. There shouldn'"'"'t have been any more writeback errors 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> # since then because all IOs got cancelled on the full flag. 2024-09-13T18:46:10.357 DEBUG:teuthology.orchestra.run.smithi192:> print("calling close") 2024-09-13T18:46:10.358 DEBUG:teuthology.orchestra.run.smithi192:> os.close(f) 2024-09-13T18:46:10.358 DEBUG:teuthology.orchestra.run.smithi192:> print("close() did not raise error") 2024-09-13T18:46:10.358 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-13T18:46:10.358 DEBUG:teuthology.orchestra.run.smithi192:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2024-09-13T18:46:10.358 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-13T18:46:38.829 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:46:38.835 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:08.927 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:08.932 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:writing some data through which we expect to succeed 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed data successfully, will now attempt to fill fs 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 1.00 MB 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 2.00 MB 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.054 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 3.00 MB 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 4.00 MB 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 5.00 MB 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 6.00 MB 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 7.00 MB 2024-09-13T18:47:15.055 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 8.00 MB 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 9.00 MB 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 10.00 MB 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.056 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 11.00 MB 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 12.00 MB 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 13.00 MB 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 14.00 MB 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 15.00 MB 2024-09-13T18:47:15.057 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 16.00 MB 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 17.00 MB 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 18.00 MB 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.058 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 19.00 MB 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 20.00 MB 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 21.00 MB 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 22.00 MB 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.059 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 23.00 MB 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 24.00 MB 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 25.00 MB 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 26.00 MB 2024-09-13T18:47:15.060 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 27.00 MB 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 28.00 MB 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 29.00 MB 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 30.00 MB 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:47:15.061 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 31.00 MB 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 32.00 MB 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:wrote bytes via buffered write, moving on to fsync 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:fsync'ed successfully 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:Not full yet after 33.00 MB 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:Reached fullness after 33.00 MB 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:calling close 2024-09-13T18:47:15.062 INFO:teuthology.orchestra.run.smithi192.stdout:close() did not raise error 2024-09-13T18:47:15.142 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:47:15.142 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:47:15.238 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:47:15.346 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:47:15.346 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:15.346 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:15.383 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:15.384 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:15.461 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.653+0000 7f86e2600640 1 Processor -- start 2024-09-13T18:47:15.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.653+0000 7f86e2600640 1 -- start start 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86e2600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 0x7f86dc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86e2600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86dc0afd80 0x7f86dc0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86e2600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86dc0ae770 con 0x7f86dc146610 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86e2600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0cd920 con 0x7f86dc0afd80 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86e2600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86dc0b0730 con 0x7f86dc0b2780 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86dbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f86dc0afd80 0x7f86dc0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.654+0000 7f86db400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f86dc146610 0x7f86dc0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37382/0 (socket says 172.21.15.192:37382) 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86db400640 1 -- 172.21.15.192:0/684638684 learned_addr learned my addr 172.21.15.192:0/684638684 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86dbe00640 1 -- 172.21.15.192:0/684638684 >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 msgr2=0x7f86dc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86daa00640 1 --2- 172.21.15.192:0/684638684 >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 0x7f86dc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86da000640 1 -- 172.21.15.192:0/684638684 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1298732712 0 0) 0x7f86dc0ae770 con 0x7f86dc146610 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86dbe00640 1 --2- 172.21.15.192:0/684638684 >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 0x7f86dc0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86dbe00640 1 -- 172.21.15.192:0/684638684 >> v1:172.21.15.192:6789/0 conn(0x7f86dc146610 legacy=0x7f86dc0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86dbe00640 1 -- 172.21.15.192:0/684638684 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86dc0cdb30 con 0x7f86dc0afd80 2024-09-13T18:47:15.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.655+0000 7f86daa00640 1 --2- 172.21.15.192:0/684638684 >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 0x7f86dc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.656+0000 7f86dbe00640 1 --2- 172.21.15.192:0/684638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc0b01f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d402a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29bc0dbdcb649f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.656+0000 7f86da000640 1 -- 172.21.15.192:0/684638684 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4031600 con 0x7f86dc0afd80 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.656+0000 7f86da000640 1 -- 172.21.15.192:0/684638684 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d402d050 con 0x7f86dc0afd80 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.656+0000 7f86da000640 1 -- 172.21.15.192:0/684638684 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4031980 con 0x7f86dc0afd80 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 -- 172.21.15.192:0/684638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 msgr2=0x7f86dc0b01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 --2- 172.21.15.192:0/684638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc0b01f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f86d4009d90 tx=0x7f86d402a610 comp rx=0 tx=0).stop 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 -- 172.21.15.192:0/684638684 shutdown_connections 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 --2- 172.21.15.192:0/684638684 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc0b01f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 --2- 172.21.15.192:0/684638684 >> v2:172.21.15.194:3300/0 conn(0x7f86dc0b2780 0x7f86dc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 -- 172.21.15.192:0/684638684 >> 172.21.15.192:0/684638684 conn(0x7f86dc0ae960 msgr2=0x7f86dc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 -- 172.21.15.192:0/684638684 shutdown_connections 2024-09-13T18:47:15.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.657+0000 7f86e2600640 1 -- 172.21.15.192:0/684638684 wait complete. 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.658+0000 7f86e2600640 1 Processor -- start 2024-09-13T18:47:15.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 -- start start 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86dc0b2780 0x7f86dc0711a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86dc146610 0x7f86dc15b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc158df0 con 0x7f86dc0afd80 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1590d0 con 0x7f86dc146610 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.659+0000 7f86e2600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86dc1593b0 con 0x7f86dc0b2780 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37850/0 (socket says 172.21.15.192:37850) 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 -- 172.21.15.192:0/1359307609 learned_addr learned my addr 172.21.15.192:0/1359307609 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86daa00640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86dc0b2780 0x7f86dc0711a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86dbe00640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86dc146610 0x7f86dc15b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 -- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86dc0b2780 msgr2=0x7f86dc0711a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86dc0b2780 0x7f86dc0711a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 -- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86dc146610 msgr2=0x7f86dc15b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86dc146610 0x7f86dc15b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009a70 con 0x7f86dc0afd80 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.660+0000 7f86db400640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c430 tx=0x7f86cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.661+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc0074e0 con 0x7f86dc0afd80 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.661+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc007660 con 0x7f86dc0afd80 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.661+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc004a20 con 0x7f86dc0afd80 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.661+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86dc159690 con 0x7f86dc0afd80 2024-09-13T18:47:15.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.661+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86dc142400 con 0x7f86dc0afd80 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.662+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86dc159bb0 con 0x7f86dc0afd80 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.663+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f86cc004b80 con 0x7f86dc0afd80 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.664+0000 7f86d3400640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 0x7f86bc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.664+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f86cc089060 con 0x7f86dc0afd80 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.664+0000 7f86daa00640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 0x7f86bc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.664+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f86bc0727f0 con 0x7f86dc0afd80 2024-09-13T18:47:15.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.665+0000 7f86daa00640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 0x7f86bc06d0c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f86dc067350 tx=0x7f86c8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:15.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.668+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f86cc0bc9c0 con 0x7f86dc0afd80 2024-09-13T18:47:15.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.838+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86dc0b01f0 con 0x7f86dc0afd80 2024-09-13T18:47:15.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.839+0000 7f86d3400640 1 -- 172.21.15.192:0/1359307609 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f86dc159bb0 con 0x7f86dc0afd80 2024-09-13T18:47:15.842 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:15.843 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":184,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:46:51.876369+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.6","mappings":[{"from":2,"to":5}]},{"pgid":"21.1d","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:15.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 msgr2=0x7f86bc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 0x7f86bc06d0c0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f86dc067350 tx=0x7f86c8008040 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 msgr2=0x7f86dc141ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f86cc00c430 tx=0x7f86cc00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 shutdown_connections 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f86bc06ac00 0x7f86bc06d0c0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f86dc146610 0x7f86dc15b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86dc0b2780 0x7f86dc0711a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 --2- 172.21.15.192:0/1359307609 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86dc0afd80 0x7f86dc141ec0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.841+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 >> 172.21.15.192:0/1359307609 conn(0x7f86dc0ae960 msgr2=0x7f86dc15e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.842+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 shutdown_connections 2024-09-13T18:47:15.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:15.842+0000 7f86e2600640 1 -- 172.21.15.192:0/1359307609 wait complete. 2024-09-13T18:47:15.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:52.747334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:53.893065+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:15.861 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:16.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.013+0000 7f75ff400640 1 Processor -- start 2024-09-13T18:47:16.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.013+0000 7f75ff400640 1 -- start start 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.014+0000 7f75ff400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 0x7f75f806ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.014+0000 7f75ff400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f815a8e0 con 0x7f75f80cdf60 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.014+0000 7f75ff400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f80b2fe0 con 0x7f75f80b3470 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.014+0000 7f75ff400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f80b26b0 con 0x7f75f80cb330 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.014+0000 7f75f7e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f75f80cdf60 0x7f75f80ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37388/0 (socket says 172.21.15.192:37388) 2024-09-13T18:47:16.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7e00640 1 -- 172.21.15.192:0/479374920 learned_addr learned my addr 172.21.15.192:0/479374920 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:16.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75fca00640 1 --2- 172.21.15.192:0/479374920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 0x7f75f806ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173451645 0 0) 0x7f75f815a8e0 con 0x7f75f80cdf60 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e0003520 con 0x7f75f80cdf60 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1988818466 0 0) 0x7f75f80b2fe0 con 0x7f75f80b3470 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75f815a8e0 con 0x7f75f80b3470 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3943245458 0 0) 0x7f75e0003520 con 0x7f75f80cdf60 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75fca00640 1 -- 172.21.15.192:0/479374920 >> v1:172.21.15.194:6789/0 conn(0x7f75f80b3470 legacy=0x7f75f80b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75fca00640 1 -- 172.21.15.192:0/479374920 >> v1:172.21.15.192:6789/0 conn(0x7f75f80cdf60 legacy=0x7f75f80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.015+0000 7f75fca00640 1 -- 172.21.15.192:0/479374920 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f80b2990 con 0x7f75f80cb330 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.016+0000 7f75fca00640 1 --2- 172.21.15.192:0/479374920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 0x7f75f806ac00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097d0 tx=0x7f75ec02a080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd3bdfd8d6e47b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4001670 con 0x7f75f80cb330 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec02ab10 con 0x7f75f80cb330 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75f7400640 1 -- 172.21.15.192:0/479374920 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec02aea0 con 0x7f75f80cb330 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75ff400640 1 -- 172.21.15.192:0/479374920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 msgr2=0x7f75f806ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.020 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75ff400640 1 --2- 172.21.15.192:0/479374920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 0x7f75f806ac00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f75ec0097d0 tx=0x7f75ec02a080 comp rx=0 tx=0).stop 2024-09-13T18:47:16.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.017+0000 7f75ff400640 1 -- 172.21.15.192:0/479374920 shutdown_connections 2024-09-13T18:47:16.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.018+0000 7f75ff400640 1 --2- 172.21.15.192:0/479374920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cb330 0x7f75f806ac00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.018+0000 7f75ff400640 1 -- 172.21.15.192:0/479374920 >> 172.21.15.192:0/479374920 conn(0x7f75f80b08f0 msgr2=0x7f75f80b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.018+0000 7f75ff400640 1 -- 172.21.15.192:0/479374920 shutdown_connections 2024-09-13T18:47:16.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.018+0000 7f75ff400640 1 -- 172.21.15.192:0/479374920 wait complete. 2024-09-13T18:47:16.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.019+0000 7f75ff400640 1 Processor -- start 2024-09-13T18:47:16.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.019+0000 7f75ff400640 1 -- start start 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 0x7f75f8158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 0x7f75f813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f813f990 con 0x7f75f80b3470 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f81594c0 con 0x7f75f80cb330 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75ff400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f8158c20 con 0x7f75f80cdf60 2024-09-13T18:47:16.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75fca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75fca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37852/0 (socket says 172.21.15.192:37852) 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.020+0000 7f75fca00640 1 -- 172.21.15.192:0/168299111 learned_addr learned my addr 172.21.15.192:0/168299111 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75f7e00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 0x7f75f8158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fd400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 0x7f75f813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 -- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 msgr2=0x7f75f813ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 0x7f75f813ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 -- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 msgr2=0x7f75f8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 0x7f75f8158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ec009400 con 0x7f75f80b3470 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75f7e00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 0x7f75f8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fd400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 0x7f75f813ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75fca00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f75ec035040 tx=0x7f75ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec03d830 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ec03d9b0 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ec03dd60 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.021+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f8158f00 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.022+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f81f4650 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.023+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f806cbd0 con 0x7f75f80b3470 2024-09-13T18:47:16.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.023+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f75ec039040 con 0x7f75f80b3470 2024-09-13T18:47:16.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.025+0000 7f75f4c00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 0x7f75d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.025+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f75ec0a9d40 con 0x7f75f80b3470 2024-09-13T18:47:16.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.025+0000 7f75f7e00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 0x7f75d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.025+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f75d80727f0 con 0x7f75f80b3470 2024-09-13T18:47:16.028 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.026+0000 7f75f7e00640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 0x7f75d806d0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f75e40011e0 tx=0x7f75e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.032 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.029+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f75ec074ed0 con 0x7f75f80b3470 2024-09-13T18:47:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.197+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f75f80b2150 con 0x7f75f80b3470 2024-09-13T18:47:16.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.197+0000 7f75f4c00640 1 -- 172.21.15.192:0/168299111 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7f75ec04b020 con 0x7f75f80b3470 2024-09-13T18:47:16.200 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:47:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 msgr2=0x7f75d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 0x7f75d806d0c0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f75e40011e0 tx=0x7f75e4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:16.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 msgr2=0x7f75f8147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f75ec035040 tx=0x7f75ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 shutdown_connections 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f75d806ac00 0x7f75d806d0c0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75f80cdf60 0x7f75f813ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75f80cb330 0x7f75f8158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 --2- 172.21.15.192:0/168299111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75f80b3470 0x7f75f8147be0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 >> 172.21.15.192:0/168299111 conn(0x7f75f80b08f0 msgr2=0x7f75f80715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.199+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 shutdown_connections 2024-09-13T18:47:16.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.200+0000 7f75ff400640 1 -- 172.21.15.192:0/168299111 wait complete. 2024-09-13T18:47:16.219 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:16.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.371+0000 7faedb000640 1 Processor -- start 2024-09-13T18:47:16.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.371+0000 7faedb000640 1 -- start start 2024-09-13T18:47:16.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.372+0000 7faedb000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7faed406c800 0x7faed40b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.372+0000 7faedb000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed406cc70 con 0x7faed41434c0 2024-09-13T18:47:16.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.372+0000 7faedb000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faed406b480 con 0x7faed40b3bd0 2024-09-13T18:47:16.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.372+0000 7faedb000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faed40ce770 con 0x7faed406c800 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7faed41434c0 0x7faed406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37402/0 (socket says 172.21.15.192:37402) 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3e00640 1 -- 172.21.15.192:0/3213357783 learned_addr learned my addr 172.21.15.192:0/3213357783 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3400640 1 --2- 172.21.15.192:0/3213357783 >> v2:172.21.15.194:3300/0 conn(0x7faed406c800 0x7faed40b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed2a00640 1 -- 172.21.15.192:0/3213357783 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034963911 0 0) 0x7faed406cc70 con 0x7faed41434c0 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed2a00640 1 -- 172.21.15.192:0/3213357783 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb8003520 con 0x7faed41434c0 2024-09-13T18:47:16.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3400640 1 -- 172.21.15.192:0/3213357783 >> v1:172.21.15.194:6789/0 conn(0x7faed40b3bd0 legacy=0x7faed406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3400640 1 -- 172.21.15.192:0/3213357783 >> v1:172.21.15.192:6789/0 conn(0x7faed41434c0 legacy=0x7faed406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.373+0000 7faed3400640 1 -- 172.21.15.192:0/3213357783 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed406b760 con 0x7faed406c800 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.374+0000 7faed3400640 1 --2- 172.21.15.192:0/3213357783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed406c800 0x7faed40b3690 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7faec00097d0 tx=0x7faec002a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba757b1403f9c3d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faed2a00640 1 -- 172.21.15.192:0/3213357783 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0032440 con 0x7faed406c800 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faed2a00640 1 -- 172.21.15.192:0/3213357783 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec00325a0 con 0x7faed406c800 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faed2a00640 1 -- 172.21.15.192:0/3213357783 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0032930 con 0x7faed406c800 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 -- 172.21.15.192:0/3213357783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed406c800 msgr2=0x7faed40b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 --2- 172.21.15.192:0/3213357783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed406c800 0x7faed40b3690 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7faec00097d0 tx=0x7faec002a1c0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 -- 172.21.15.192:0/3213357783 shutdown_connections 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 --2- 172.21.15.192:0/3213357783 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed406c800 0x7faed40b3690 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 -- 172.21.15.192:0/3213357783 >> 172.21.15.192:0/3213357783 conn(0x7faed40b08f0 msgr2=0x7faed40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 -- 172.21.15.192:0/3213357783 shutdown_connections 2024-09-13T18:47:16.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.375+0000 7faedb000640 1 -- 172.21.15.192:0/3213357783 wait complete. 2024-09-13T18:47:16.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.377+0000 7faedb000640 1 Processor -- start 2024-09-13T18:47:16.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.377+0000 7faedb000640 1 -- start start 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 0x7faed4153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed41434c0 0x7faed41564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed413e070 con 0x7faed40b3bd0 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faed4156a00 con 0x7faed41434c0 2024-09-13T18:47:16.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faedb000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faed4153850 con 0x7faed406c800 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37856/0 (socket says 172.21.15.192:37856) 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed3400640 1 -- 172.21.15.192:0/3569966967 learned_addr learned my addr 172.21.15.192:0/3569966967 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed9000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed41434c0 0x7faed41564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed3e00640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 0x7faed4153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.378+0000 7faed3400640 1 -- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 msgr2=0x7faed4153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3400640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 0x7faed4153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3400640 1 -- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed41434c0 msgr2=0x7faed41564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3400640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed41434c0 0x7faed41564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3400640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec0009400 con 0x7faed40b3bd0 2024-09-13T18:47:16.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3e00640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 0x7faed4153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:16.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faed3400640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7faec0035040 tx=0x7faec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0006e10 con 0x7faed40b3bd0 2024-09-13T18:47:16.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec0032e90 con 0x7faed40b3bd0 2024-09-13T18:47:16.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0030be0 con 0x7faed40b3bd0 2024-09-13T18:47:16.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4071160 con 0x7faed40b3bd0 2024-09-13T18:47:16.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.379+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faed413e5a0 con 0x7faed40b3bd0 2024-09-13T18:47:16.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.380+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faed40cdb00 con 0x7faed40b3bd0 2024-09-13T18:47:16.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.381+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7faec0039040 con 0x7faed40b3bd0 2024-09-13T18:47:16.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.383+0000 7faecbe00640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.383+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faec00a9c20 con 0x7faed40b3bd0 2024-09-13T18:47:16.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.383+0000 7faed3e00640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.383+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7faeb40727f0 con 0x7faed40b3bd0 2024-09-13T18:47:16.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.383+0000 7faed3e00640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 0x7faeb406d0c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faec40011e0 tx=0x7faec4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.386+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7faec0037060 con 0x7faed40b3bd0 2024-09-13T18:47:16.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.553+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faed40cc7d0 con 0x7faed40b3bd0 2024-09-13T18:47:16.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.553+0000 7faecbe00640 1 -- 172.21.15.192:0/3569966967 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v184) v1 ==== 104+0+11 (secure 0 0 0) 0x7faec0041020 con 0x7faed40b3bd0 2024-09-13T18:47:16.556 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.555+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 msgr2=0x7faeb406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.555+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 0x7faeb406d0c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7faec40011e0 tx=0x7faec4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.555+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 msgr2=0x7faed4155f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.555+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7faec0035040 tx=0x7faec00046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 shutdown_connections 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7faeb406ac00 0x7faeb406d0c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7faed41434c0 0x7faed41564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faed40b3bd0 0x7faed4155f80 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 --2- 172.21.15.192:0/3569966967 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7faed406c800 0x7faed4153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 >> 172.21.15.192:0/3569966967 conn(0x7faed40b08f0 msgr2=0x7faed40b33b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 shutdown_connections 2024-09-13T18:47:16.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.556+0000 7faedb000640 1 -- 172.21.15.192:0/3569966967 wait complete. 2024-09-13T18:47:16.574 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:16.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.726+0000 7fe019400640 1 Processor -- start 2024-09-13T18:47:16.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.726+0000 7fe019400640 1 -- start start 2024-09-13T18:47:16.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe019400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fe01415b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe019400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe01406c0b0 0x7fe01406c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe019400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0140b2000 con 0x7fe0141589f0 2024-09-13T18:47:16.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe019400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01406ca80 con 0x7fe01406c0b0 2024-09-13T18:47:16.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe019400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b2ba0 con 0x7fe0140b3af0 2024-09-13T18:47:16.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe012800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe0141589f0 0x7fe0140b2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37408/0 (socket says 172.21.15.192:37408) 2024-09-13T18:47:16.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.727+0000 7fe012800640 1 -- 172.21.15.192:0/3500002295 learned_addr learned my addr 172.21.15.192:0/3500002295 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:16.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011e00640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fe01415b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe013200640 1 --2- 172.21.15.192:0/3500002295 >> v2:172.21.15.194:3300/0 conn(0x7fe01406c0b0 0x7fe01406c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2682863857 0 0) 0x7fe0140b2000 con 0x7fe0141589f0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff8003520 con 0x7fe0141589f0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2950308068 0 0) 0x7fdff8003520 con 0x7fe0141589f0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 msgr2=0x7fe01415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fe01415b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 >> v2:172.21.15.194:3300/0 conn(0x7fe01406c0b0 msgr2=0x7fe01406c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 --2- 172.21.15.192:0/3500002295 >> v2:172.21.15.194:3300/0 conn(0x7fe01406c0b0 0x7fe01406c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01415bbd0 con 0x7fe0141589f0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe004001670 con 0x7fe0141589f0 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 >> v1:172.21.15.192:6789/0 conn(0x7fe0141589f0 legacy=0x7fe0140b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff8003970 0x7fdff8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdff80047c0 0x7fdff8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fdff8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406ca80 con 0x7fdff80047c0 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0140b2ba0 con 0x7fdff8003970 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.728+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdff800b980 con 0x7fe0140b3af0 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdff80047c0 0x7fdff8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe012800640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff8003970 0x7fdff8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe013200640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fdff8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 -- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 msgr2=0x7fdff8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe0140b3af0 0x7fdff8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 -- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff8003970 msgr2=0x7fdff8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff8003970 0x7fdff8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.729+0000 7fe011e00640 1 -- 172.21.15.192:0/3500002295 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff8003520 con 0x7fdff80047c0 2024-09-13T18:47:16.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.730+0000 7fe011e00640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdff80047c0 0x7fdff8004c40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe01406edf0 tx=0x7fdff80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5bcfd24de44018 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.730+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000031400 con 0x7fdff80047c0 2024-09-13T18:47:16.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.730+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00002d050 con 0x7fdff80047c0 2024-09-13T18:47:16.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.730+0000 7fe011400640 1 -- 172.21.15.192:0/3500002295 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe000031780 con 0x7fdff80047c0 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 -- 172.21.15.192:0/3500002295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdff80047c0 msgr2=0x7fdff8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 --2- 172.21.15.192:0/3500002295 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdff80047c0 0x7fdff8004c40 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fe01406edf0 tx=0x7fdff80057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe013200640 1 -- 172.21.15.192:0/3500002295 reap_dead start 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 -- 172.21.15.192:0/3500002295 shutdown_connections 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 -- 172.21.15.192:0/3500002295 >> 172.21.15.192:0/3500002295 conn(0x7fe0140b08f0 msgr2=0x7fe0140b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 -- 172.21.15.192:0/3500002295 shutdown_connections 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.731+0000 7fe019400640 1 -- 172.21.15.192:0/3500002295 wait complete. 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.733+0000 7fe019400640 1 Processor -- start 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.733+0000 7fe019400640 1 -- start start 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80047c0 0x7fe014071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe014151df0 0x7fe014153b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414eb80 con 0x7fe01414dc20 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01414f6f0 con 0x7fdff80047c0 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe019400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe01406f600 con 0x7fe014151df0 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37862/0 (socket says 172.21.15.192:37862) 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 -- 172.21.15.192:0/3762365928 learned_addr learned my addr 172.21.15.192:0/3762365928 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe012800640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80047c0 0x7fe014071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe011e00640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe014151df0 0x7fe014153b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 -- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe014151df0 msgr2=0x7fe014153b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe014151df0 0x7fe014153b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 -- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80047c0 msgr2=0x7fe014071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.734+0000 7fe013200640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80047c0 0x7fe014071260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe013200640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe01414e5e0 con 0x7fe01414dc20 2024-09-13T18:47:16.744 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe013200640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cb8c0 tx=0x7fe00c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c00e040 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c00f040 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0141f2b90 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c015670 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.735+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01414f940 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.736+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01415b670 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.737+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe00c0157d0 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.738+0000 7fe00aa00640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 0x7fdff406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.739+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe00c089f40 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.739+0000 7fe012800640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 0x7fdff406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.739+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fdff40727f0 con 0x7fe01414dc20 2024-09-13T18:47:16.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.739+0000 7fe012800640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 0x7fdff406d0c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe004000fb0 tx=0x7fe004009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:16.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.743+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe00c0550d0 con 0x7fe01414dc20 2024-09-13T18:47:16.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.911+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0140cb8f0 con 0x7fe01414dc20 2024-09-13T18:47:16.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.911+0000 7fe00aa00640 1 -- 172.21.15.192:0/3762365928 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v184) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe00c022030 con 0x7fe01414dc20 2024-09-13T18:47:16.914 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 msgr2=0x7fdff406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 0x7fdff406d0c0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe004000fb0 tx=0x7fe004009040 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 msgr2=0x7fe01414e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fe0140cb8c0 tx=0x7fe00c00f580 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 shutdown_connections 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdff406ac00 0x7fdff406d0c0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe01414dc20 0x7fe01414e0a0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe014151df0 0x7fe014153b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 --2- 172.21.15.192:0/3762365928 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdff80047c0 0x7fe014071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 >> 172.21.15.192:0/3762365928 conn(0x7fe0140b08f0 msgr2=0x7fe0140ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 shutdown_connections 2024-09-13T18:47:16.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:16.914+0000 7fe019400640 1 -- 172.21.15.192:0/3762365928 wait complete. 2024-09-13T18:47:16.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:47:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.083+0000 7f6a2c000640 1 Processor -- start 2024-09-13T18:47:17.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.083+0000 7f6a2c000640 1 -- start start 2024-09-13T18:47:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.084+0000 7f6a2c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a240cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.084+0000 7f6a2c000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a24140480 con 0x7f6a2415bc20 2024-09-13T18:47:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.084+0000 7f6a2c000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a2415ebd0 con 0x7f6a240cacd0 2024-09-13T18:47:17.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.084+0000 7f6a2c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a240cb5f0 con 0x7f6a2415e790 2024-09-13T18:47:17.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a2a000640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6a2415bc20 0x7f6a240afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37410/0 (socket says 172.21.15.192:37410) 2024-09-13T18:47:17.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a2a000640 1 -- 172.21.15.192:0/1354175971 learned_addr learned my addr 172.21.15.192:0/1354175971 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a28c00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a240cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588163838 0 0) 0x7f6a24140480 con 0x7f6a2415bc20 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c003520 con 0x7f6a2415bc20 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2091921749 0 0) 0x7f6a2415ebd0 con 0x7f6a240cacd0 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a24140480 con 0x7f6a240cacd0 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3855891338 0 0) 0x7f6a0c003520 con 0x7f6a2415bc20 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 msgr2=0x7f6a240cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a240cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 >> v1:172.21.15.194:6789/0 conn(0x7f6a240cacd0 legacy=0x7f6a24140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2415ee90 con 0x7f6a2415bc20 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.085+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f6a1c0019f0 con 0x7f6a2415bc20 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 >> v1:172.21.15.192:6789/0 conn(0x7f6a2415bc20 legacy=0x7f6a240afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a0c003b30 0x7f6a0c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a0c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00ba30 con 0x7f6a0c003b30 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00bba0 con 0x7f6a0c004d00 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a0c00bd60 con 0x7f6a2415e790 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a0c003b30 0x7f6a0c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a28c00640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a0c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a2a000640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 -- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 msgr2=0x7f6a0c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:17.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a2415e790 0x7f6a0c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 -- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c004d00 msgr2=0x7f6a0c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a29600640 1 -- 172.21.15.192:0/1354175971 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c003520 con 0x7f6a0c003b30 2024-09-13T18:47:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.086+0000 7f6a2a000640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a0c004d00 0x7f6a0c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:17.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.087+0000 7f6a29600640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a0c003b30 0x7f6a0c003f30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6a180018d0 tx=0x7f6a0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aea09910a8d5ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a180052d0 con 0x7f6a0c003b30 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18005430 con 0x7f6a0c003b30 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a23e00640 1 -- 172.21.15.192:0/1354175971 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1802aca0 con 0x7f6a0c003b30 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 -- 172.21.15.192:0/1354175971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a0c003b30 msgr2=0x7f6a0c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 --2- 172.21.15.192:0/1354175971 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a0c003b30 0x7f6a0c003f30 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f6a180018d0 tx=0x7f6a0c0057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2a000640 1 -- 172.21.15.192:0/1354175971 reap_dead start 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 -- 172.21.15.192:0/1354175971 shutdown_connections 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 -- 172.21.15.192:0/1354175971 >> 172.21.15.192:0/1354175971 conn(0x7f6a240ae960 msgr2=0x7f6a2406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 -- 172.21.15.192:0/1354175971 shutdown_connections 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.088+0000 7f6a2c000640 1 -- 172.21.15.192:0/1354175971 wait complete. 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.090+0000 7f6a2c000640 1 Processor -- start 2024-09-13T18:47:17.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.090+0000 7f6a2c000640 1 -- start start 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0c003b30 0x7f6a240cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2413f330 0x7f6a2413f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2413fcf0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2406ae70 con 0x7f6a2413f330 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a2c000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a2406b150 con 0x7f6a0c003b30 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a28c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a28c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37882/0 (socket says 172.21.15.192:37882) 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.091+0000 7f6a28c00640 1 -- 172.21.15.192:0/735717249 learned_addr learned my addr 172.21.15.192:0/735717249 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 -- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0c003b30 msgr2=0x7f6a240cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0c003b30 0x7f6a240cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 -- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2413f330 msgr2=0x7f6a2413f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2413f330 0x7f6a2413f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2406b430 con 0x7f6a2406a8b0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a28c00640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f6a100119a0 tx=0x7f6a10011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1000faf0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1000fc50 con 0x7f6a2406a8b0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a10014440 con 0x7f6a2406a8b0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a2406b710 con 0x7f6a2406a8b0 2024-09-13T18:47:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.092+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a240cccb0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.093+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a240cb0b0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.095+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a100145a0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.096+0000 7f6a21600640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 0x7f6a0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.096+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a10089b70 con 0x7f6a2406a8b0 2024-09-13T18:47:17.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.096+0000 7f6a29600640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 0x7f6a0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.096+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f6a040727f0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.097+0000 7f6a29600640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 0x7f6a0406d0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a18032000 tx=0x7f6a1802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.101+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a10022020 con 0x7f6a2406a8b0 2024-09-13T18:47:17.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.279+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a2406c6a0 con 0x7f6a2406a8b0 2024-09-13T18:47:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.279+0000 7f6a21600640 1 -- 172.21.15.192:0/735717249 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v184) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a10054d00 con 0x7f6a2406a8b0 2024-09-13T18:47:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:47:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 msgr2=0x7f6a0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 0x7f6a0406d0c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6a18032000 tx=0x7f6a1802e000 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 msgr2=0x7f6a24135220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f6a100119a0 tx=0x7f6a10011e60 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 shutdown_connections 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a0406ac00 0x7f6a0406d0c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a2413f330 0x7f6a2413f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a2406a8b0 0x7f6a24135220 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 --2- 172.21.15.192:0/735717249 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a0c003b30 0x7f6a240cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.281+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 >> 172.21.15.192:0/735717249 conn(0x7f6a240ae960 msgr2=0x7f6a2415a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.282+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 shutdown_connections 2024-09-13T18:47:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.282+0000 7f6a2c000640 1 -- 172.21.15.192:0/735717249 wait complete. 2024-09-13T18:47:17.300 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:47:17.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:17.300 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:17.363 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:47:17.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:17.364 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:47:17.400 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:17.400 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:17.440 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:17.440 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:17.518 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:17.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.667+0000 7f8a12600640 1 Processor -- start 2024-09-13T18:47:17.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.667+0000 7f8a12600640 1 -- start start 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.668+0000 7f8a12600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8a0c0cacd0 0x7f8a0c15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.668+0000 7f8a12600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c140480 con 0x7f8a0c15bc20 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.668+0000 7f8a12600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0c0cb520 con 0x7f8a0c0cb0b0 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.668+0000 7f8a12600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a0c15ee90 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.668+0000 7f8a0be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f8a0c15bc20 0x7f8a0c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37420/0 (socket says 172.21.15.192:37420) 2024-09-13T18:47:17.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0be00640 1 -- 172.21.15.192:0/1944111865 learned_addr learned my addr 172.21.15.192:0/1944111865 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0b400640 1 --2- 172.21.15.192:0/1944111865 >> v2:172.21.15.194:3300/0 conn(0x7f8a0c0cacd0 0x7f8a0c15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 306171543 0 0) 0x7f8a0c140480 con 0x7f8a0c15bc20 2024-09-13T18:47:17.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89f0003520 con 0x7f8a0c15bc20 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0b400640 1 -- 172.21.15.192:0/1944111865 >> v1:172.21.15.194:6789/0 conn(0x7f8a0c0cb0b0 legacy=0x7f8a0c140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 691311331 0 0) 0x7f89f0003520 con 0x7f8a0c15bc20 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0b400640 1 -- 172.21.15.192:0/1944111865 >> v1:172.21.15.192:6789/0 conn(0x7f8a0c15bc20 legacy=0x7f8a0c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.669+0000 7f8a0b400640 1 -- 172.21.15.192:0/1944111865 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c15f170 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a0b400640 1 --2- 172.21.15.192:0/1944111865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c15e790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0097a0 tx=0x7f89fc02a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec803fe4fdc86bec server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a040019f0 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89fc02ac50 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a0a000640 1 -- 172.21.15.192:0/1944111865 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89fc032440 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a12600640 1 -- 172.21.15.192:0/1944111865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 msgr2=0x7f8a0c15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a12600640 1 --2- 172.21.15.192:0/1944111865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c15e790 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f89fc0097a0 tx=0x7f89fc02a1c0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a12600640 1 -- 172.21.15.192:0/1944111865 shutdown_connections 2024-09-13T18:47:17.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a12600640 1 --2- 172.21.15.192:0/1944111865 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c15e790 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.671+0000 7f8a12600640 1 -- 172.21.15.192:0/1944111865 >> 172.21.15.192:0/1944111865 conn(0x7f8a0c0ae960 msgr2=0x7f8a0c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.672+0000 7f8a12600640 1 -- 172.21.15.192:0/1944111865 shutdown_connections 2024-09-13T18:47:17.675 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.672+0000 7f8a12600640 1 -- 172.21.15.192:0/1944111865 wait complete. 2024-09-13T18:47:17.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.673+0000 7f8a12600640 1 Processor -- start 2024-09-13T18:47:17.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.673+0000 7f8a12600640 1 -- start start 2024-09-13T18:47:17.677 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c06acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a0c0cb0b0 0x7f8a0c0cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cd7d0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cc730 con 0x7f8a0c0cacd0 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a12600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a0c0cca10 con 0x7f8a0c0cb0b0 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a0be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37894/0 (socket says 172.21.15.192:37894) 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.674+0000 7f8a0be00640 1 -- 172.21.15.192:0/1198376266 learned_addr learned my addr 172.21.15.192:0/1198376266 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0b400640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c06acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0aa00640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a0c0cb0b0 0x7f8a0c0cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 -- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a0c0cb0b0 msgr2=0x7f8a0c0cbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a0c0cb0b0 0x7f8a0c0cbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.678 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 -- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 msgr2=0x7f8a0c06acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c06acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc009400 con 0x7f8a0c15bc20 2024-09-13T18:47:17.679 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a0be00640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cc70 tx=0x7f8a0400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400ce80 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a04012400 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a04012770 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.675+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a0c0cccf0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.676+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a0c0cd2b0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.677+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0c0cd4d0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.677+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8a04007070 con 0x7f8a0c15bc20 2024-09-13T18:47:17.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.678+0000 7f8a03400640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 0x7f89ec06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:17.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.678+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8a04089490 con 0x7f8a0c15bc20 2024-09-13T18:47:17.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.679+0000 7f8a0b400640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 0x7f89ec06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:17.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.679+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f89ec0727f0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.682 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.679+0000 7f8a0b400640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 0x7f89ec06d0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f89fc034000 tx=0x7f89fc02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:17.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.682+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8a04017060 con 0x7f8a0c15bc20 2024-09-13T18:47:17.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.851+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a0c15e790 con 0x7f8a0c15bc20 2024-09-13T18:47:17.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.852+0000 7f8a03400640 1 -- 172.21.15.192:0/1198376266 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+16763 (secure 0 0 0) 0x7f8a040546d0 con 0x7f8a0c15bc20 2024-09-13T18:47:17.855 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:17.855 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":184,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:46:51.876369+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.6","mappings":[{"from":2,"to":5}]},{"pgid":"21.1d","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 msgr2=0x7f89ec06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 0x7f89ec06d0c0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f89fc034000 tx=0x7f89fc02e000 comp rx=0 tx=0).stop 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 msgr2=0x7f8a0c158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400cc70 tx=0x7f8a0400a430 comp rx=0 tx=0).stop 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 shutdown_connections 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f89ec06ac00 0x7f89ec06d0c0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8a0c15bc20 0x7f8a0c158d30 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8a0c0cb0b0 0x7f8a0c0cbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 --2- 172.21.15.192:0/1198376266 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8a0c0cacd0 0x7f8a0c06acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:17.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 >> 172.21.15.192:0/1198376266 conn(0x7f8a0c0ae960 msgr2=0x7f8a0c15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:17.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 shutdown_connections 2024-09-13T18:47:17.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:17.854+0000 7f8a12600640 1 -- 172.21.15.192:0/1198376266 wait complete. 2024-09-13T18:47:17.873 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:52.747334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:53.893065+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:17.873 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:18.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.031+0000 7f6d06400640 1 Processor -- start 2024-09-13T18:47:18.034 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.031+0000 7f6d06400640 1 -- start start 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6d06400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 0x7f6d000b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6d06400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 0x7f6d0006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6d06400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d000b2000 con 0x7f6d000b3af0 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6d06400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0006ca80 con 0x7f6d0006c0b0 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6d06400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0015b970 con 0x7f6d001589f0 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cfea00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6d000b3af0 0x7f6d0015b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37434/0 (socket says 172.21.15.192:37434) 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cfea00640 1 -- 172.21.15.192:0/2399343207 learned_addr learned my addr 172.21.15.192:0/2399343207 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cff400640 1 --2- 172.21.15.192:0/2399343207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 0x7f6d000b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.036 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cffe00640 1 --2- 172.21.15.192:0/2399343207 >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 0x7f6d0006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3817214996 0 0) 0x7f6d000b2000 con 0x7f6d000b3af0 2024-09-13T18:47:18.037 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.033+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ce4003520 con 0x7f6d000b3af0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1567613823 0 0) 0x7f6ce4003520 con 0x7f6d000b3af0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cff400640 1 -- 172.21.15.192:0/2399343207 >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 msgr2=0x7f6d0006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cff400640 1 --2- 172.21.15.192:0/2399343207 >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 0x7f6d0006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cff400640 1 -- 172.21.15.192:0/2399343207 >> v1:172.21.15.192:6789/0 conn(0x7f6d000b3af0 legacy=0x7f6d0015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cff400640 1 -- 172.21.15.192:0/2399343207 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0015bbd0 con 0x7f6d001589f0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.034+0000 7f6cffe00640 1 --2- 172.21.15.192:0/2399343207 >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 0x7f6d0006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.035+0000 7f6cff400640 1 --2- 172.21.15.192:0/2399343207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 0x7f6d000b2490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00097a0 tx=0x7f6cf002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c84857e2e9ec162 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.035+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cec001670 con 0x7f6d001589f0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.035+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf002aba0 con 0x7f6d001589f0 2024-09-13T18:47:18.038 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.035+0000 7f6cfe000640 1 -- 172.21.15.192:0/2399343207 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf0032440 con 0x7f6d001589f0 2024-09-13T18:47:18.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 -- 172.21.15.192:0/2399343207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 msgr2=0x7f6d000b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 --2- 172.21.15.192:0/2399343207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 0x7f6d000b2490 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6cf00097a0 tx=0x7f6cf002a110 comp rx=0 tx=0).stop 2024-09-13T18:47:18.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 -- 172.21.15.192:0/2399343207 shutdown_connections 2024-09-13T18:47:18.039 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 --2- 172.21.15.192:0/2399343207 >> v2:172.21.15.194:3300/0 conn(0x7f6d0006c0b0 0x7f6d0006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 --2- 172.21.15.192:0/2399343207 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d001589f0 0x7f6d000b2490 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 -- 172.21.15.192:0/2399343207 >> 172.21.15.192:0/2399343207 conn(0x7f6d000b08f0 msgr2=0x7f6d000b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 -- 172.21.15.192:0/2399343207 shutdown_connections 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.036+0000 7f6d06400640 1 -- 172.21.15.192:0/2399343207 wait complete. 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.037+0000 7f6d06400640 1 Processor -- start 2024-09-13T18:47:18.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.037+0000 7f6d06400640 1 -- start start 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d000b3af0 0x7f6d001f3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d001589f0 0x7f6d000adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001f3210 con 0x7f6d0006c0b0 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d001f2e70 con 0x7f6d001589f0 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.038+0000 7f6d06400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d00158220 con 0x7f6d000b3af0 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37902/0 (socket says 172.21.15.192:37902) 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 -- 172.21.15.192:0/1438901579 learned_addr learned my addr 172.21.15.192:0/1438901579 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cfea00640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d000b3af0 0x7f6d001f3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.042 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cffe00640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d001589f0 0x7f6d000adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 -- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d000b3af0 msgr2=0x7f6d001f3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d000b3af0 0x7f6d001f3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 -- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d001589f0 msgr2=0x7f6d000adab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d001589f0 0x7f6d000adab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cf8009a70 con 0x7f6d0006c0b0 2024-09-13T18:47:18.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.039+0000 7f6cff400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c00 tx=0x7f6cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.040+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf003e860 con 0x7f6d0006c0b0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.040+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cf003e9e0 con 0x7f6d0006c0b0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.040+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cf003ed90 con 0x7f6d0006c0b0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.040+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf0009400 con 0x7f6d0006c0b0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.040+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d001502c0 con 0x7f6d0006c0b0 2024-09-13T18:47:18.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.041+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0015a2b0 con 0x7f6d0006c0b0 2024-09-13T18:47:18.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.042+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6cf003c400 con 0x7f6d0006c0b0 2024-09-13T18:47:18.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.042+0000 7f6cf7400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 0x7f6ce006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.043+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6cf00a9f20 con 0x7f6d0006c0b0 2024-09-13T18:47:18.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.043+0000 7f6cfea00640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 0x7f6ce006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.043+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f6ce00727f0 con 0x7f6d0006c0b0 2024-09-13T18:47:18.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.043+0000 7f6cfea00640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 0x7f6ce006d0c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6d00157610 tx=0x7f6cec001e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.049 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.048+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6cf0037060 con 0x7f6d0006c0b0 2024-09-13T18:47:18.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.217+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6d0006c540 con 0x7f6d0006c0b0 2024-09-13T18:47:18.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.217+0000 7f6cf7400640 1 -- 172.21.15.192:0/1438901579 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6cf0042020 con 0x7f6d0006c0b0 2024-09-13T18:47:18.221 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.219+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 msgr2=0x7f6ce006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.219+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 0x7f6ce006d0c0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6d00157610 tx=0x7f6cec001e40 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 msgr2=0x7f6d00157ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f6cf0000c00 tx=0x7f6cf00046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 shutdown_connections 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6ce006ac00 0x7f6ce006d0c0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6d001589f0 0x7f6d000adab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6d000b3af0 0x7f6d001f3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 --2- 172.21.15.192:0/1438901579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6d0006c0b0 0x7f6d00157ce0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 >> 172.21.15.192:0/1438901579 conn(0x7f6d000b08f0 msgr2=0x7f6d000b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 shutdown_connections 2024-09-13T18:47:18.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.220+0000 7f6d06400640 1 -- 172.21.15.192:0/1438901579 wait complete. 2024-09-13T18:47:18.238 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:18.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.389+0000 7fd653c00640 1 Processor -- start 2024-09-13T18:47:18.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.389+0000 7fd653c00640 1 -- start start 2024-09-13T18:47:18.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.390+0000 7fd653c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd64c1589f0 0x7fd64c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.390+0000 7fd653c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c0b3af0 0x7fd64c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.390+0000 7fd653c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd64c0b2000 con 0x7fd64c06c0b0 2024-09-13T18:47:18.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.390+0000 7fd653c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd64c15bbd0 con 0x7fd64c1589f0 2024-09-13T18:47:18.393 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.390+0000 7fd653c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c15beb0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd64c1589f0 0x7fd64c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd64be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c0b3af0 0x7fd64c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd64c1589f0 0x7fd64c0b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:54948/0 (socket says 172.21.15.192:54948) 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 -- 172.21.15.192:0/1966453373 learned_addr learned my addr 172.21.15.192:0/1966453373 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 -- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c0b3af0 msgr2=0x7fd64c15b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 --2- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c0b3af0 0x7fd64c15b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 -- 172.21.15.192:0/1966453373 >> v1:172.21.15.194:6789/0 conn(0x7fd64c06c0b0 legacy=0x7fd64c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.391+0000 7fd651200640 1 -- 172.21.15.192:0/1966453373 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd64c15c190 con 0x7fd64c1589f0 2024-09-13T18:47:18.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.392+0000 7fd651200640 1 --2- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c1589f0 0x7fd64c0b2490 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd640009870 tx=0x7fd64002a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15437f1a2f8da4a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.392+0000 7fd64b400640 1 -- 172.21.15.192:0/1966453373 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640032440 con 0x7fd64c1589f0 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.392+0000 7fd64b400640 1 -- 172.21.15.192:0/1966453373 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6400325a0 con 0x7fd64c1589f0 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.392+0000 7fd64b400640 1 -- 172.21.15.192:0/1966453373 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd640032930 con 0x7fd64c1589f0 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 -- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c1589f0 msgr2=0x7fd64c0b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 --2- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c1589f0 0x7fd64c0b2490 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd640009870 tx=0x7fd64002a270 comp rx=0 tx=0).stop 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 -- 172.21.15.192:0/1966453373 shutdown_connections 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 --2- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c0b3af0 0x7fd64c15b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 --2- 172.21.15.192:0/1966453373 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c1589f0 0x7fd64c0b2490 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 -- 172.21.15.192:0/1966453373 >> 172.21.15.192:0/1966453373 conn(0x7fd64c0b08f0 msgr2=0x7fd64c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 -- 172.21.15.192:0/1966453373 shutdown_connections 2024-09-13T18:47:18.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.393+0000 7fd653c00640 1 -- 172.21.15.192:0/1966453373 wait complete. 2024-09-13T18:47:18.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.395+0000 7fd653c00640 1 Processor -- start 2024-09-13T18:47:18.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.395+0000 7fd653c00640 1 -- start start 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 0x7fd64c13b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 0x7fd64c0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13df70 con 0x7fd64c0b3af0 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13e250 con 0x7fd64c06c0b0 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64c13e530 con 0x7fd64c1589f0 2024-09-13T18:47:18.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37916/0 (socket says 172.21.15.192:37916) 2024-09-13T18:47:18.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 -- 172.21.15.192:0/2572551417 learned_addr learned my addr 172.21.15.192:0/2572551417 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd651200640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 0x7fd64c13b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd651c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 0x7fd64c0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 -- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 msgr2=0x7fd64c0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 0x7fd64c0afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 -- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 msgr2=0x7fd64c13b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 0x7fd64c13b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6400094d0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd651200640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 0x7fd64c13b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd651c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 0x7fd64c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd64be00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e8b0 tx=0x7fd63800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638009610 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd63800c940 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64c13e810 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd63800ccf0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.397+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64c13ba20 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.398+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64c15b260 con 0x7fd64c0b3af0 2024-09-13T18:47:18.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.399+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd638013470 con 0x7fd64c0b3af0 2024-09-13T18:47:18.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.400+0000 7fd648c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 0x7fd62c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.400+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6380895e0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.400+0000 7fd651200640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 0x7fd62c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.400+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fd62c0727f0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.401+0000 7fd651200640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 0x7fd62c06d0c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd64002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.404+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd638054770 con 0x7fd64c0b3af0 2024-09-13T18:47:18.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.572+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd64c0cc0b0 con 0x7fd64c0b3af0 2024-09-13T18:47:18.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.573+0000 7fd648c00640 1 -- 172.21.15.192:0/2572551417 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v184) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd638021020 con 0x7fd64c0b3af0 2024-09-13T18:47:18.578 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:47:18.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 msgr2=0x7fd62c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 0x7fd62c06d0c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd640034000 tx=0x7fd64002e000 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 msgr2=0x7fd64c0af8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fd63800e8b0 tx=0x7fd63800ed70 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 shutdown_connections 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd62c06ac00 0x7fd62c06d0c0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd64c1589f0 0x7fd64c0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd64c0b3af0 0x7fd64c0af8f0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 --2- 172.21.15.192:0/2572551417 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd64c06c0b0 0x7fd64c13b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 >> 172.21.15.192:0/2572551417 conn(0x7fd64c0b08f0 msgr2=0x7fd64c159f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 shutdown_connections 2024-09-13T18:47:18.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.575+0000 7fd653c00640 1 -- 172.21.15.192:0/2572551417 wait complete. 2024-09-13T18:47:18.595 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:18.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.746+0000 7f7e61200640 1 Processor -- start 2024-09-13T18:47:18.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.748+0000 7f7e61200640 1 -- start start 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e61200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7e5c0b02f0 0x7f7e5c15bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e61200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5c15b070 con 0x7f7e5c15b810 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e61200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e5c15ee20 con 0x7f7e5c1402c0 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e61200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e5c15f100 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e5aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7e5c15b810 0x7f7e5c0afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37442/0 (socket says 172.21.15.192:37442) 2024-09-13T18:47:18.751 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e5aa00640 1 -- 172.21.15.192:0/97191495 learned_addr learned my addr 172.21.15.192:0/97191495 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:18.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.749+0000 7f7e5be00640 1 --2- 172.21.15.192:0/97191495 >> v2:172.21.15.194:3300/0 conn(0x7f7e5c0b02f0 0x7f7e5c15bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2842105912 0 0) 0x7f7e5c15b070 con 0x7f7e5c15b810 2024-09-13T18:47:18.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e40003520 con 0x7f7e5c15b810 2024-09-13T18:47:18.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2619484637 0 0) 0x7f7e40003520 con 0x7f7e5c15b810 2024-09-13T18:47:18.752 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5be00640 1 -- 172.21.15.192:0/97191495 >> v1:172.21.15.194:6789/0 conn(0x7f7e5c1402c0 legacy=0x7f7e5c15e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5be00640 1 -- 172.21.15.192:0/97191495 >> v1:172.21.15.192:6789/0 conn(0x7f7e5c15b810 legacy=0x7f7e5c0afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.750+0000 7f7e5be00640 1 -- 172.21.15.192:0/97191495 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e5c15f3e0 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.751+0000 7f7e5be00640 1 --2- 172.21.15.192:0/97191495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c15bc50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e5402a680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4423ddf40d2ab52 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.751+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e48001670 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5402d050 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e5a000640 1 -- 172.21.15.192:0/97191495 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e54007760 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 -- 172.21.15.192:0/97191495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 msgr2=0x7f7e5c15bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 --2- 172.21.15.192:0/97191495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c15bc50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009d90 tx=0x7f7e5402a680 comp rx=0 tx=0).stop 2024-09-13T18:47:18.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 -- 172.21.15.192:0/97191495 shutdown_connections 2024-09-13T18:47:18.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 --2- 172.21.15.192:0/97191495 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c15bc50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 -- 172.21.15.192:0/97191495 >> 172.21.15.192:0/97191495 conn(0x7f7e5c0ae7f0 msgr2=0x7f7e5c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 -- 172.21.15.192:0/97191495 shutdown_connections 2024-09-13T18:47:18.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.752+0000 7f7e61200640 1 -- 172.21.15.192:0/97191495 wait complete. 2024-09-13T18:47:18.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.754+0000 7f7e61200640 1 Processor -- start 2024-09-13T18:47:18.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.754+0000 7f7e61200640 1 -- start start 2024-09-13T18:47:18.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c13cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 0x7f7e5c1f2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1418c0 con 0x7f7e5c15b810 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c1f5f30 con 0x7f7e5c0b02f0 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e61200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e5c0b2cc0 con 0x7f7e5c1402c0 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e5be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e5be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37926/0 (socket says 172.21.15.192:37926) 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e5be00640 1 -- 172.21.15.192:0/822231367 learned_addr learned my addr 172.21.15.192:0/822231367 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e5aa00640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 0x7f7e5c1f2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.755+0000 7f7e5b400640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c13cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 -- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 msgr2=0x7f7e5c1f2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 0x7f7e5c1f2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 -- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 msgr2=0x7f7e5c13cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c13cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e54009a70 con 0x7f7e5c15b810 2024-09-13T18:47:18.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5aa00640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 0x7f7e5c1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:18.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e5be00640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009eb0 tx=0x7f7e54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5403c8f0 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5403ca50 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e5403cdc0 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e5c141b10 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.756+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c1420d0 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.757+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e5c15ac80 con 0x7f7e5c15b810 2024-09-13T18:47:18.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.758+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7e54031400 con 0x7f7e5c15b810 2024-09-13T18:47:18.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.759+0000 7f7e53400640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 0x7f7e3c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:18.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.759+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7e540aa9d0 con 0x7f7e5c15b810 2024-09-13T18:47:18.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.759+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f7e3c072820 con 0x7f7e5c15b810 2024-09-13T18:47:18.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.759+0000 7f7e5b400640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 0x7f7e3c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:18.762 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.760+0000 7f7e5b400640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 0x7f7e3c06d0f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000f60 tx=0x7f7e4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:18.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.763+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7e54075c00 con 0x7f7e5c15b810 2024-09-13T18:47:18.934 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.933+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e5c0af780 con 0x7f7e5c15b810 2024-09-13T18:47:18.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.933+0000 7f7e53400640 1 -- 172.21.15.192:0/822231367 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v184) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e54049030 con 0x7f7e5c15b810 2024-09-13T18:47:18.935 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:47:18.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 msgr2=0x7f7e3c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 0x7f7e3c06d0f0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c000f60 tx=0x7f7e4c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 msgr2=0x7f7e5c15d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f7e54009eb0 tx=0x7f7e54004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 shutdown_connections 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7e3c06ac30 0x7f7e3c06d0f0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e5c15b810 0x7f7e5c15d690 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7e5c1402c0 0x7f7e5c1f2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 --2- 172.21.15.192:0/822231367 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7e5c0b02f0 0x7f7e5c13cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.935+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 >> 172.21.15.192:0/822231367 conn(0x7f7e5c0ae7f0 msgr2=0x7f7e5c0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.936+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 shutdown_connections 2024-09-13T18:47:18.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:18.936+0000 7f7e61200640 1 -- 172.21.15.192:0/822231367 wait complete. 2024-09-13T18:47:18.954 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:47:19.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.106+0000 7f2247600640 1 Processor -- start 2024-09-13T18:47:19.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.106+0000 7f2247600640 1 -- start start 2024-09-13T18:47:19.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.107+0000 7f2247600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22400cacd0 0x7f224015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.107+0000 7f2247600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22400cb0b0 0x7f224015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.107+0000 7f2247600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2240140480 con 0x7f2240140980 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.107+0000 7f2247600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224015c160 con 0x7f22400cacd0 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.107+0000 7f2247600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224015ee90 con 0x7f22400cb0b0 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22400cacd0 0x7f224015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f22400cacd0 0x7f224015e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37928/0 (socket says 172.21.15.192:37928) 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 -- 172.21.15.192:0/2491768386 learned_addr learned my addr 172.21.15.192:0/2491768386 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f223fe00640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22400cb0b0 0x7f224015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 -- 172.21.15.192:0/2491768386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22400cb0b0 msgr2=0x7f224015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22400cb0b0 0x7f224015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 -- 172.21.15.192:0/2491768386 >> v1:172.21.15.194:6789/0 conn(0x7f2240140980 legacy=0x7f22400afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.108+0000 7f2244c00640 1 -- 172.21.15.192:0/2491768386 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224015f170 con 0x7f22400cacd0 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.109+0000 7f2244c00640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f224015e790 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2234009870 tx=0x7f223402a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6909e56d6d450e24 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.109+0000 7f223f400640 1 -- 172.21.15.192:0/2491768386 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234032440 con 0x7f22400cacd0 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.109+0000 7f223f400640 1 -- 172.21.15.192:0/2491768386 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22340325a0 con 0x7f22400cacd0 2024-09-13T18:47:19.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.109+0000 7f223f400640 1 -- 172.21.15.192:0/2491768386 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234032930 con 0x7f22400cacd0 2024-09-13T18:47:19.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 -- 172.21.15.192:0/2491768386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 msgr2=0x7f224015e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f224015e790 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f2234009870 tx=0x7f223402a250 comp rx=0 tx=0).stop 2024-09-13T18:47:19.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 -- 172.21.15.192:0/2491768386 shutdown_connections 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f22400cb0b0 0x7f224015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 --2- 172.21.15.192:0/2491768386 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f224015e790 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 -- 172.21.15.192:0/2491768386 >> 172.21.15.192:0/2491768386 conn(0x7f22400ae960 msgr2=0x7f224006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 -- 172.21.15.192:0/2491768386 shutdown_connections 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.110+0000 7f2247600640 1 -- 172.21.15.192:0/2491768386 wait complete. 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.112+0000 7f2247600640 1 Processor -- start 2024-09-13T18:47:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.112+0000 7f2247600640 1 -- start start 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 0x7f224013d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 0x7f224013f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224013dac0 con 0x7f22400cacd0 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22400b37a0 con 0x7f22400cb0b0 2024-09-13T18:47:19.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2247600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22400b3a80 con 0x7f2240140980 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37930/0 (socket says 172.21.15.192:37930) 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 -- 172.21.15.192:0/619959539 learned_addr learned my addr 172.21.15.192:0/619959539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2245600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 0x7f224013f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f223fe00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 0x7f224013d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 -- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 msgr2=0x7f224013f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 0x7f224013f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 -- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 msgr2=0x7f224013d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 0x7f224013d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2244c00640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22340094d0 con 0x7f22400cacd0 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f223fe00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 0x7f224013d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.113+0000 7f2245600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 0x7f224013f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.114+0000 7f2244c00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2234000c00 tx=0x7f22340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.114+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234032440 con 0x7f22400cacd0 2024-09-13T18:47:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.114+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2234030980 con 0x7f22400cacd0 2024-09-13T18:47:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.114+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2234030d30 con 0x7f22400cacd0 2024-09-13T18:47:19.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.114+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22400b3d60 con 0x7f22400cacd0 2024-09-13T18:47:19.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.115+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22400b4320 con 0x7f22400cacd0 2024-09-13T18:47:19.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.116+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224006c6c0 con 0x7f22400cacd0 2024-09-13T18:47:19.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.116+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2234039040 con 0x7f22400cacd0 2024-09-13T18:47:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.117+0000 7f223cc00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 0x7f222006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.117+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f22340a9d50 con 0x7f22400cacd0 2024-09-13T18:47:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.117+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f22200727f0 con 0x7f22400cacd0 2024-09-13T18:47:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.117+0000 7f223fe00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 0x7f222006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.118+0000 7f223fe00640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 0x7f222006d0c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2240070e40 tx=0x7f222c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.123 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.121+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2234074ee0 con 0x7f22400cacd0 2024-09-13T18:47:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.303+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f224015df70 con 0x7f22400cacd0 2024-09-13T18:47:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.303+0000 7f223cc00640 1 -- 172.21.15.192:0/619959539 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v184) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2234037080 con 0x7f22400cacd0 2024-09-13T18:47:19.306 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:47:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 msgr2=0x7f222006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 0x7f222006d0c0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2240070e40 tx=0x7f222c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 msgr2=0x7f22400b4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f2234000c00 tx=0x7f22340046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 shutdown_connections 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f222006ac00 0x7f222006d0c0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2240140980 0x7f224013f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f22400cb0b0 0x7f224013d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 --2- 172.21.15.192:0/619959539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22400cacd0 0x7f22400b4840 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 >> 172.21.15.192:0/619959539 conn(0x7f22400ae960 msgr2=0x7f22400ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 shutdown_connections 2024-09-13T18:47:19.308 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.305+0000 7f2247600640 1 -- 172.21.15.192:0/619959539 wait complete. 2024-09-13T18:47:19.322 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:47:19.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:19.323 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:19.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:47:19.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:19.391 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:47:19.429 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:19.429 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:19.464 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:47:19.465 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:19.465 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:19.506 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:47:19.506 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.657+0000 7fa626400640 1 Processor -- start 2024-09-13T18:47:19.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.657+0000 7fa626400640 1 -- start start 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.658+0000 7fa626400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa62015a9e0 0x7fa62006ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.658+0000 7fa626400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa62006b3d0 0x7fa6200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.658+0000 7fa626400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62006c5d0 con 0x7fa62006e990 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.658+0000 7fa626400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200b3730 con 0x7fa62006b3d0 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.658+0000 7fa626400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6200b3920 con 0x7fa62015a9e0 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa62006b3d0 0x7fa6200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa62006b3d0 0x7fa6200cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37944/0 (socket says 172.21.15.192:37944) 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 -- 172.21.15.192:0/1343507415 learned_addr learned my addr 172.21.15.192:0/1343507415 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa625000640 1 --2- 172.21.15.192:0/1343507415 >> v2:172.21.15.194:3300/0 conn(0x7fa62015a9e0 0x7fa62006ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 -- 172.21.15.192:0/1343507415 >> v2:172.21.15.194:3300/0 conn(0x7fa62015a9e0 msgr2=0x7fa62006ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 --2- 172.21.15.192:0/1343507415 >> v2:172.21.15.194:3300/0 conn(0x7fa62015a9e0 0x7fa62006ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 -- 172.21.15.192:0/1343507415 >> v1:172.21.15.194:6789/0 conn(0x7fa62006e990 legacy=0x7fa620070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.659+0000 7fa61fe00640 1 -- 172.21.15.192:0/1343507415 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6200b3c00 con 0x7fa62006b3d0 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.660+0000 7fa61fe00640 1 --2- 172.21.15.192:0/1343507415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006b3d0 0x7fa6200cd8c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fa62006cc90 tx=0x7fa60c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceda9833a720c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.660+0000 7fa61f400640 1 -- 172.21.15.192:0/1343507415 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c032440 con 0x7fa62006b3d0 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.660+0000 7fa61f400640 1 -- 172.21.15.192:0/1343507415 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60c0325a0 con 0x7fa62006b3d0 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.660+0000 7fa61f400640 1 -- 172.21.15.192:0/1343507415 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60c032930 con 0x7fa62006b3d0 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 -- 172.21.15.192:0/1343507415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006b3d0 msgr2=0x7fa6200cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 --2- 172.21.15.192:0/1343507415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006b3d0 0x7fa6200cd8c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7fa62006cc90 tx=0x7fa60c02a270 comp rx=0 tx=0).stop 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 -- 172.21.15.192:0/1343507415 shutdown_connections 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 --2- 172.21.15.192:0/1343507415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006b3d0 0x7fa6200cd8c0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 --2- 172.21.15.192:0/1343507415 >> v2:172.21.15.194:3300/0 conn(0x7fa62015a9e0 0x7fa62006ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 -- 172.21.15.192:0/1343507415 >> 172.21.15.192:0/1343507415 conn(0x7fa6200736d0 msgr2=0x7fa6200b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 -- 172.21.15.192:0/1343507415 shutdown_connections 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.661+0000 7fa626400640 1 -- 172.21.15.192:0/1343507415 wait complete. 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.663+0000 7fa626400640 1 Processor -- start 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.663+0000 7fa626400640 1 -- start start 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa62015a9e0 0x7fa620151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6201590f0 con 0x7fa62006e990 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa620152550 con 0x7fa62006b3d0 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa626400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62015a240 con 0x7fa62015a9e0 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa61fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:54998/0 (socket says 172.21.15.192:54998) 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa61fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37956/0 (socket says 172.21.15.192:37956) 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 -- 172.21.15.192:0/1393414707 learned_addr learned my addr 172.21.15.192:0/1393414707 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625a00640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa62015a9e0 0x7fa620151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 -- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa62015a9e0 msgr2=0x7fa620151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa62015a9e0 0x7fa620151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 -- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 msgr2=0x7fa620159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa625000640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60c0094d0 con 0x7fa62006b3d0 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.664+0000 7fa61fe00640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa625000640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa61400e8a0 tx=0x7fa61400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140094f0 con 0x7fa62006b3d0 2024-09-13T18:47:19.670 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61400c940 con 0x7fa62006b3d0 2024-09-13T18:47:19.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa620158570 con 0x7fa62006b3d0 2024-09-13T18:47:19.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61400ccf0 con 0x7fa62006b3d0 2024-09-13T18:47:19.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.665+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa620158b30 con 0x7fa62006b3d0 2024-09-13T18:47:19.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.666+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6200ce6c0 con 0x7fa62006b3d0 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.667+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa614013470 con 0x7fa62006b3d0 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.668+0000 7fa61cc00640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 0x7fa60006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.668+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa6140894b0 con 0x7fa62006b3d0 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.668+0000 7fa61fe00640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 0x7fa60006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.668+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fa6000727f0 con 0x7fa62006b3d0 2024-09-13T18:47:19.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.669+0000 7fa61fe00640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 0x7fa60006d0c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa60c034000 tx=0x7fa60c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:19.674 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.673+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa614054660 con 0x7fa62006b3d0 2024-09-13T18:47:19.878 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.876+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa620152690 con 0x7fa62006b3d0 2024-09-13T18:47:19.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.877+0000 7fa61cc00640 1 -- 172.21.15.192:0/1393414707 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7fa614021090 con 0x7fa62006b3d0 2024-09-13T18:47:19.879 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:19.879 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:47:19.880 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 msgr2=0x7fa60006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 0x7fa60006d0c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa60c034000 tx=0x7fa60c02e000 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 msgr2=0x7fa620150a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fa61400e8a0 tx=0x7fa61400ed60 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 shutdown_connections 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa60006ac00 0x7fa60006d0c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa62015a9e0 0x7fa620151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa62006e990 0x7fa620159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 --2- 172.21.15.192:0/1393414707 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa62006b3d0 0x7fa620150a90 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 >> 172.21.15.192:0/1393414707 conn(0x7fa6200736d0 msgr2=0x7fa62015e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 shutdown_connections 2024-09-13T18:47:19.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:19.880+0000 7fa626400640 1 -- 172.21.15.192:0/1393414707 wait complete. 2024-09-13T18:47:19.898 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:20.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.048+0000 7fd97de00640 1 Processor -- start 2024-09-13T18:47:20.050 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.048+0000 7fd97de00640 1 -- start start 2024-09-13T18:47:20.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd97de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 0x7fd97815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd97de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 0x7fd97815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd97de00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd978140480 con 0x7fd978140980 2024-09-13T18:47:20.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd97de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd97815c160 con 0x7fd9780cacd0 2024-09-13T18:47:20.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd97de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97815ee90 con 0x7fd9780cb0b0 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd977400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fd978140980 0x7fd9780afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37458/0 (socket says 172.21.15.192:37458) 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.049+0000 7fd977400640 1 -- 172.21.15.192:0/4288857728 learned_addr learned my addr 172.21.15.192:0/4288857728 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd976a00640 1 --2- 172.21.15.192:0/4288857728 >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 0x7fd97815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd96e000640 1 --2- 172.21.15.192:0/4288857728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 0x7fd97815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958026439 0 0) 0x7fd978140480 con 0x7fd978140980 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd95c003520 con 0x7fd978140980 2024-09-13T18:47:20.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd96e000640 1 -- 172.21.15.192:0/4288857728 >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 msgr2=0x7fd97815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2430879041 0 0) 0x7fd95c003520 con 0x7fd978140980 2024-09-13T18:47:20.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd96e000640 1 --2- 172.21.15.192:0/4288857728 >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 0x7fd97815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd96e000640 1 -- 172.21.15.192:0/4288857728 >> v1:172.21.15.192:6789/0 conn(0x7fd978140980 legacy=0x7fd9780afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd96e000640 1 -- 172.21.15.192:0/4288857728 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd97815f170 con 0x7fd9780cb0b0 2024-09-13T18:47:20.053 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.050+0000 7fd976a00640 1 --2- 172.21.15.192:0/4288857728 >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 0x7fd97815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.051+0000 7fd96e000640 1 --2- 172.21.15.192:0/4288857728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 0x7fd97815bc20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9600097a0 tx=0x7fd96002a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ad7cfa351a31d5c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.051+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd970001670 con 0x7fd9780cb0b0 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.051+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96002aba0 con 0x7fd9780cb0b0 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.051+0000 7fd976000640 1 -- 172.21.15.192:0/4288857728 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd960032440 con 0x7fd9780cb0b0 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 -- 172.21.15.192:0/4288857728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 msgr2=0x7fd97815bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 --2- 172.21.15.192:0/4288857728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 0x7fd97815bc20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd9600097a0 tx=0x7fd96002a110 comp rx=0 tx=0).stop 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 -- 172.21.15.192:0/4288857728 shutdown_connections 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 --2- 172.21.15.192:0/4288857728 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9780cb0b0 0x7fd97815bc20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.054 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 --2- 172.21.15.192:0/4288857728 >> v2:172.21.15.194:3300/0 conn(0x7fd9780cacd0 0x7fd97815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 -- 172.21.15.192:0/4288857728 >> 172.21.15.192:0/4288857728 conn(0x7fd9780ae960 msgr2=0x7fd97806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 -- 172.21.15.192:0/4288857728 shutdown_connections 2024-09-13T18:47:20.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.052+0000 7fd97de00640 1 -- 172.21.15.192:0/4288857728 wait complete. 2024-09-13T18:47:20.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.054+0000 7fd97de00640 1 Processor -- start 2024-09-13T18:47:20.055 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.054+0000 7fd97de00640 1 -- start start 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9780cb0b0 0x7fd9780a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 0x7fd97813c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd978069f40 con 0x7fd9780cacd0 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97806a1b0 con 0x7fd9780cb0b0 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd97de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd97806a490 con 0x7fd978140980 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:37970/0 (socket says 172.21.15.192:37970) 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 -- 172.21.15.192:0/219987443 learned_addr learned my addr 172.21.15.192:0/219987443 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd96e000640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9780cb0b0 0x7fd9780a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd977400640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 0x7fd97813c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.058 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 -- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 msgr2=0x7fd97813c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 0x7fd97813c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 -- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9780cb0b0 msgr2=0x7fd9780a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9780cb0b0 0x7fd9780a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd976a00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd968009a70 con 0x7fd9780cacd0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.055+0000 7fd977400640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 0x7fd97813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd976a00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fd96800efc0 tx=0x7fd96800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968014680 con 0x7fd9780cacd0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd96800f040 con 0x7fd9780cacd0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd968014a00 con 0x7fd9780cacd0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd960009400 con 0x7fd9780cacd0 2024-09-13T18:47:20.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.056+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9781e5910 con 0x7fd9780cacd0 2024-09-13T18:47:20.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.057+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd97815bc20 con 0x7fd9780cacd0 2024-09-13T18:47:20.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.058+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd968014b60 con 0x7fd9780cacd0 2024-09-13T18:47:20.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.059+0000 7fd96fe00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 0x7fd95406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.059+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd96808a3f0 con 0x7fd9780cacd0 2024-09-13T18:47:20.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.059+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fd9540727f0 con 0x7fd9780cacd0 2024-09-13T18:47:20.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.059+0000 7fd96e000640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 0x7fd95406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.060+0000 7fd96e000640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 0x7fd95406d0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd960034000 tx=0x7fd96002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.063+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9680554f0 con 0x7fd9780cacd0 2024-09-13T18:47:20.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.235+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd97806c6c0 con 0x7fd9780cacd0 2024-09-13T18:47:20.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.236+0000 7fd96fe00640 1 -- 172.21.15.192:0/219987443 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v184) v1 ==== 74+0+16763 (secure 0 0 0) 0x7fd968058b10 con 0x7fd9780cacd0 2024-09-13T18:47:20.238 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:20.238 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":184,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:46:51.876369+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"184","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.6","mappings":[{"from":2,"to":5}]},{"pgid":"21.1d","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:20.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 msgr2=0x7fd95406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 0x7fd95406d0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fd960034000 tx=0x7fd96002e000 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 msgr2=0x7fd97806bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fd96800efc0 tx=0x7fd96800c490 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 shutdown_connections 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd95406ac00 0x7fd95406d0c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd978140980 0x7fd97813c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9780cb0b0 0x7fd9780a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 --2- 172.21.15.192:0/219987443 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9780cacd0 0x7fd97806bc70 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.238+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 >> 172.21.15.192:0/219987443 conn(0x7fd9780ae960 msgr2=0x7fd97815a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.239+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 shutdown_connections 2024-09-13T18:47:20.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.239+0000 7fd97de00640 1 -- 172.21.15.192:0/219987443 wait complete. 2024-09-13T18:47:20.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:45:52.747334+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '179', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:45:53.893065+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '184', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:20.258 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:20.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.411+0000 7f7cabe00640 1 Processor -- start 2024-09-13T18:47:20.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.412+0000 7f7cabe00640 1 -- start start 2024-09-13T18:47:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cac159b00 0x7f7cac0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7cac06bc30 0x7f7cac0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac159ee0 0x7f7cac15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac15af60 con 0x7f7cac159b00 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cac06b7a0 con 0x7f7cac06bc30 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cabe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac15ac80 con 0x7f7cac159ee0 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7caaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cac159b00 0x7f7cac0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7caaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7cac159b00 0x7f7cac0b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48934/0 (socket says 172.21.15.192:48934) 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7caaa00640 1 -- 172.21.15.192:0/2610447203 learned_addr learned my addr 172.21.15.192:0/2610447203 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7cab400640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac159ee0 0x7f7cac15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.413+0000 7f7caa000640 1 --2- 172.21.15.192:0/2610447203 >> v2:172.21.15.194:3300/0 conn(0x7f7cac06bc30 0x7f7cac0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.414+0000 7f7caaa00640 1 -- 172.21.15.192:0/2610447203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac159ee0 msgr2=0x7f7cac15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.414+0000 7f7caaa00640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac159ee0 0x7f7cac15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.414+0000 7f7caaa00640 1 -- 172.21.15.192:0/2610447203 >> v2:172.21.15.194:3300/0 conn(0x7f7cac06bc30 msgr2=0x7f7cac0b32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.414+0000 7f7caaa00640 1 --2- 172.21.15.192:0/2610447203 >> v2:172.21.15.194:3300/0 conn(0x7f7cac06bc30 0x7f7cac0b32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.414+0000 7f7caaa00640 1 -- 172.21.15.192:0/2610447203 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cac06b150 con 0x7f7cac159b00 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7caaa00640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159b00 0x7f7cac0b2d70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f7cac06c830 tx=0x7f7c9c02c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909a4fafc36478bf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7ca9600640 1 -- 172.21.15.192:0/2610447203 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c031710 con 0x7f7cac159b00 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7ca9600640 1 -- 172.21.15.192:0/2610447203 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9c02f050 con 0x7f7cac159b00 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7ca9600640 1 -- 172.21.15.192:0/2610447203 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c9c031a90 con 0x7f7cac159b00 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7cabe00640 1 -- 172.21.15.192:0/2610447203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159b00 msgr2=0x7f7cac0b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.415+0000 7f7cabe00640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159b00 0x7f7cac0b2d70 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f7cac06c830 tx=0x7f7c9c02c3f0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 -- 172.21.15.192:0/2610447203 shutdown_connections 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac159ee0 0x7f7cac15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 --2- 172.21.15.192:0/2610447203 >> v2:172.21.15.194:3300/0 conn(0x7f7cac06bc30 0x7f7cac0b32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 --2- 172.21.15.192:0/2610447203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159b00 0x7f7cac0b2d70 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 -- 172.21.15.192:0/2610447203 >> 172.21.15.192:0/2610447203 conn(0x7f7cac0736d0 msgr2=0x7f7cac0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 -- 172.21.15.192:0/2610447203 shutdown_connections 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.416+0000 7f7cabe00640 1 -- 172.21.15.192:0/2610447203 wait complete. 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.417+0000 7f7cabe00640 1 Processor -- start 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.417+0000 7f7cabe00640 1 -- start start 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac06bc30 0x7f7cac154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cac159b00 0x7f7cac1e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1e3930 con 0x7f7cac159ee0 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1e3c10 con 0x7f7cac159b00 2024-09-13T18:47:20.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cabe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cac1e3ef0 con 0x7f7cac06bc30 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cab400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cab400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48950/0 (socket says 172.21.15.192:48950) 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.418+0000 7f7cab400640 1 -- 172.21.15.192:0/1302880605 learned_addr learned my addr 172.21.15.192:0/1302880605 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7caaa00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac06bc30 0x7f7cac154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7caa000640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cac159b00 0x7f7cac1e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 -- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac06bc30 msgr2=0x7f7cac154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac06bc30 0x7f7cac154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 -- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cac159b00 msgr2=0x7f7cac1e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cac159b00 0x7f7cac1e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0094d0 con 0x7f7cac159ee0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cab400640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400efc0 tx=0x7f7ca400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca4009ba0 con 0x7f7cac159ee0 2024-09-13T18:47:20.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ca400f040 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ca40146c0 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.419+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cac1e41d0 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.420+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cac154990 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.421+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cac1e46f0 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.421+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7ca4014820 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.422+0000 7f7ca2a00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.422+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7ca4089d80 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.422+0000 7f7caaa00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.422+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f7c8c0727f0 con 0x7f7cac159ee0 2024-09-13T18:47:20.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.423+0000 7f7caaa00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c035000 tx=0x7f7c9c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.426+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7ca4018020 con 0x7f7cac159ee0 2024-09-13T18:47:20.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.599+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cac0cb5c0 con 0x7f7cac159ee0 2024-09-13T18:47:20.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.600+0000 7f7ca2a00640 1 -- 172.21.15.192:0/1302880605 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v184) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cac1e46f0 con 0x7f7cac159ee0 2024-09-13T18:47:20.602 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 msgr2=0x7f7c8c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c035000 tx=0x7f7c9c008030 comp rx=0 tx=0).stop 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 msgr2=0x7f7cac0b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f7ca400efc0 tx=0x7f7ca400c490 comp rx=0 tx=0).stop 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 shutdown_connections 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c8c06ac00 0x7f7c8c06d0c0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7cac159ee0 0x7f7cac0b1d20 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.604 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7cac159b00 0x7f7cac1e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 --2- 172.21.15.192:0/1302880605 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7cac06bc30 0x7f7cac154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 >> 172.21.15.192:0/1302880605 conn(0x7f7cac0736d0 msgr2=0x7f7cac0cc520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 shutdown_connections 2024-09-13T18:47:20.605 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.602+0000 7f7cabe00640 1 -- 172.21.15.192:0/1302880605 wait complete. 2024-09-13T18:47:20.620 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:47:20.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.778+0000 7fb804e00640 1 Processor -- start 2024-09-13T18:47:20.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.778+0000 7fb804e00640 1 -- start start 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.779+0000 7fb804e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb80015a910 0x7fb8000b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.779+0000 7fb804e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb800160ac0 0x7fb800160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.779+0000 7fb804e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8000b2b40 con 0x7fb8000ad840 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb804e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000b21e0 con 0x7fb80015a910 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb804e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8000b1bf0 con 0x7fb800160ac0 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb80015a910 0x7fb8000b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb80015a910 0x7fb8000b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48962/0 (socket says 172.21.15.192:48962) 2024-09-13T18:47:20.782 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 -- 172.21.15.192:0/1843207632 learned_addr learned my addr 172.21.15.192:0/1843207632 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:20.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fd400640 1 --2- 172.21.15.192:0/1843207632 >> v2:172.21.15.194:3300/0 conn(0x7fb800160ac0 0x7fb800160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 -- 172.21.15.192:0/1843207632 >> v2:172.21.15.194:3300/0 conn(0x7fb800160ac0 msgr2=0x7fb800160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 --2- 172.21.15.192:0/1843207632 >> v2:172.21.15.194:3300/0 conn(0x7fb800160ac0 0x7fb800160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 -- 172.21.15.192:0/1843207632 >> v1:172.21.15.194:6789/0 conn(0x7fb8000ad840 legacy=0x7fb8000cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:20.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.780+0000 7fb7fde00640 1 -- 172.21.15.192:0/1843207632 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800161510 con 0x7fb80015a910 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.781+0000 7fb7fde00640 1 --2- 172.21.15.192:0/1843207632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb8000b2600 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb8000ce530 tx=0x7fb7f002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be7f4f73b6782420 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.781+0000 7fb7fca00640 1 -- 172.21.15.192:0/1843207632 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0032440 con 0x7fb80015a910 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.781+0000 7fb7fca00640 1 -- 172.21.15.192:0/1843207632 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f00325a0 con 0x7fb80015a910 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb7fca00640 1 -- 172.21.15.192:0/1843207632 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0032930 con 0x7fb80015a910 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 -- 172.21.15.192:0/1843207632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 msgr2=0x7fb8000b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 --2- 172.21.15.192:0/1843207632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb8000b2600 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fb8000ce530 tx=0x7fb7f002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 -- 172.21.15.192:0/1843207632 shutdown_connections 2024-09-13T18:47:20.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 --2- 172.21.15.192:0/1843207632 >> v2:172.21.15.194:3300/0 conn(0x7fb800160ac0 0x7fb800160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 --2- 172.21.15.192:0/1843207632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb8000b2600 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 -- 172.21.15.192:0/1843207632 >> 172.21.15.192:0/1843207632 conn(0x7fb8000b08f0 msgr2=0x7fb8000b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 -- 172.21.15.192:0/1843207632 shutdown_connections 2024-09-13T18:47:20.785 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.782+0000 7fb804e00640 1 -- 172.21.15.192:0/1843207632 wait complete. 2024-09-13T18:47:20.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.784+0000 7fb804e00640 1 Processor -- start 2024-09-13T18:47:20.786 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.784+0000 7fb804e00640 1 -- start start 2024-09-13T18:47:20.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb800160ac0 0x7fb80006bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80006ea50 con 0x7fb80015a910 2024-09-13T18:47:20.788 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80006ecf0 con 0x7fb8000ad840 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb804e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80006efd0 con 0x7fb800160ac0 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48976/0 (socket says 172.21.15.192:48976) 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fd400640 1 -- 172.21.15.192:0/2873431248 learned_addr learned my addr 172.21.15.192:0/2873431248 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:44292/0 (socket says 172.21.15.192:44292) 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.785+0000 7fb7fe800640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb800160ac0 0x7fb80006bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 -- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb800160ac0 msgr2=0x7fb80006bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb800160ac0 0x7fb80006bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 -- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 msgr2=0x7fb80006b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f00094d0 con 0x7fb8000ad840 2024-09-13T18:47:20.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fd400640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:20.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.786+0000 7fb7fde00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0031000 tx=0x7fb7f00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.787+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f0032440 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.787+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f0030b80 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.787+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f003d420 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.787+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb80006f2b0 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.787+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb80014fb80 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.788+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb80015acf0 con 0x7fb8000ad840 2024-09-13T18:47:20.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.789+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb7f0039040 con 0x7fb8000ad840 2024-09-13T18:47:20.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.790+0000 7fb7f6000640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 0x7fb7e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:20.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.790+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb7f00a9dd0 con 0x7fb8000ad840 2024-09-13T18:47:20.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.790+0000 7fb7fd400640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 0x7fb7e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:20.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.790+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7fb7e00727f0 con 0x7fb8000ad840 2024-09-13T18:47:20.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.791+0000 7fb7fd400640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 0x7fb7e006d0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb8000ae1a0 tx=0x7fb7ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:20.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.794+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb7f004b060 con 0x7fb8000ad840 2024-09-13T18:47:20.966 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.965+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb80006ee30 con 0x7fb8000ad840 2024-09-13T18:47:20.967 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.965+0000 7fb7f6000640 1 -- 172.21.15.192:0/2873431248 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v184) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb80006ee30 con 0x7fb8000ad840 2024-09-13T18:47:20.967 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 msgr2=0x7fb7e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 0x7fb7e006d0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fb8000ae1a0 tx=0x7fb7ec008040 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 msgr2=0x7fb80014f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0031000 tx=0x7fb7f00046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 shutdown_connections 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb7e006ac00 0x7fb7e006d0c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb800160ac0 0x7fb80006bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb80015a910 0x7fb80006b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 --2- 172.21.15.192:0/2873431248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb8000ad840 0x7fb80014f640 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:20.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 >> 172.21.15.192:0/2873431248 conn(0x7fb8000b08f0 msgr2=0x7fb8000ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 shutdown_connections 2024-09-13T18:47:20.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:20.968+0000 7fb804e00640 1 -- 172.21.15.192:0/2873431248 wait complete. 2024-09-13T18:47:20.986 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:47:21.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.143+0000 7f6e9ba00640 1 Processor -- start 2024-09-13T18:47:21.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.143+0000 7f6e9ba00640 1 -- start start 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e9406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e9406a8b0 0x7f6e940b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 0x7f6e9406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940b4060 con 0x7f6e9406a8b0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e940ce770 con 0x7f6e940b3bd0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.144+0000 7f6e9ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9406b480 con 0x7f6e941434c0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e9406a8b0 0x7f6e940b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6e9406a8b0 0x7f6e940b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48986/0 (socket says 172.21.15.192:48986) 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 -- 172.21.15.192:0/2280947859 learned_addr learned my addr 172.21.15.192:0/2280947859 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e99000640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e9406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e99a00640 1 --2- 172.21.15.192:0/2280947859 >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 0x7f6e9406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 -- 172.21.15.192:0/2280947859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 msgr2=0x7f6e9406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e9406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 -- 172.21.15.192:0/2280947859 >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 msgr2=0x7f6e9406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 --2- 172.21.15.192:0/2280947859 >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 0x7f6e9406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e93e00640 1 -- 172.21.15.192:0/2280947859 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9406b760 con 0x7f6e9406a8b0 2024-09-13T18:47:21.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.145+0000 7f6e99a00640 1 --2- 172.21.15.192:0/2280947859 >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 0x7f6e9406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.146+0000 7f6e93e00640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e940b3690 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009870 tx=0x7f6e8002c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43814ba42d16153f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.146+0000 7f6e93400640 1 -- 172.21.15.192:0/2280947859 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80031710 con 0x7f6e9406a8b0 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.146+0000 7f6e93400640 1 -- 172.21.15.192:0/2280947859 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8002f050 con 0x7f6e9406a8b0 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.146+0000 7f6e93400640 1 -- 172.21.15.192:0/2280947859 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80031a90 con 0x7f6e9406a8b0 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 -- 172.21.15.192:0/2280947859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 msgr2=0x7f6e940b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e940b3690 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009870 tx=0x7f6e8002c420 comp rx=0 tx=0).stop 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 -- 172.21.15.192:0/2280947859 shutdown_connections 2024-09-13T18:47:21.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/2280947859 >> v2:172.21.15.194:3300/0 conn(0x7f6e940b3bd0 0x7f6e9406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e940b3690 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/2280947859 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e9406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 -- 172.21.15.192:0/2280947859 >> 172.21.15.192:0/2280947859 conn(0x7f6e940b08f0 msgr2=0x7f6e940b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 -- 172.21.15.192:0/2280947859 shutdown_connections 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.147+0000 7f6e9ba00640 1 -- 172.21.15.192:0/2280947859 wait complete. 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.149+0000 7f6e9ba00640 1 Processor -- start 2024-09-13T18:47:21.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.149+0000 7f6e9ba00640 1 -- start start 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e940b3bd0 0x7f6e941581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e94158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9413c970 con 0x7f6e9406a8b0 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94158da0 con 0x7f6e940b3bd0 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e9ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e94159080 con 0x7f6e941434c0 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48998/0 (socket says 172.21.15.192:48998) 2024-09-13T18:47:21.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 -- 172.21.15.192:0/3431910107 learned_addr learned my addr 172.21.15.192:0/3431910107 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e93e00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e940b3bd0 0x7f6e941581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 -- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 msgr2=0x7f6e94158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e94158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 -- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e940b3bd0 msgr2=0x7f6e941581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e940b3bd0 0x7f6e941581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.150+0000 7f6e99000640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e800094d0 con 0x7f6e9406a8b0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e99000640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800d5f0 tx=0x7f6e8800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e880125f0 con 0x7f6e9406a8b0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88012750 con 0x7f6e9406a8b0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e94159360 con 0x7f6e9406a8b0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88012b00 con 0x7f6e9406a8b0 2024-09-13T18:47:21.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.151+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e94159920 con 0x7f6e9406a8b0 2024-09-13T18:47:21.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.152+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9406acf0 con 0x7f6e9406a8b0 2024-09-13T18:47:21.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.153+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6e88012c60 con 0x7f6e9406a8b0 2024-09-13T18:47:21.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.154+0000 7f6e90c00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 0x7f6e7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.154+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6e88089880 con 0x7f6e9406a8b0 2024-09-13T18:47:21.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.154+0000 7f6e93e00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 0x7f6e7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.154+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f6e740727f0 con 0x7f6e9406a8b0 2024-09-13T18:47:21.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.155+0000 7f6e93e00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 0x7f6e7406d0c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e80035000 tx=0x7f6e80008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.158+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6e88054a20 con 0x7f6e9406a8b0 2024-09-13T18:47:21.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.327+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6e9415d120 con 0x7f6e9406a8b0 2024-09-13T18:47:21.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.328+0000 7f6e90c00640 1 -- 172.21.15.192:0/3431910107 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v184) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6e88058040 con 0x7f6e9406a8b0 2024-09-13T18:47:21.330 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 msgr2=0x7f6e7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 0x7f6e7406d0c0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6e80035000 tx=0x7f6e80008030 comp rx=0 tx=0).stop 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 msgr2=0x7f6e94157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7f6e8800d5f0 tx=0x7f6e8800dab0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 shutdown_connections 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6e7406ac00 0x7f6e7406d0c0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6e941434c0 0x7f6e94158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6e940b3bd0 0x7f6e941581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 --2- 172.21.15.192:0/3431910107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e9406a8b0 0x7f6e94157750 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 >> 172.21.15.192:0/3431910107 conn(0x7f6e940b08f0 msgr2=0x7f6e940b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 shutdown_connections 2024-09-13T18:47:21.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.330+0000 7f6e9ba00640 1 -- 172.21.15.192:0/3431910107 wait complete. 2024-09-13T18:47:21.348 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.499+0000 7f2b48200640 1 Processor -- start 2024-09-13T18:47:21.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.499+0000 7f2b48200640 1 -- start start 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.500+0000 7f2b48200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b400cacd0 0x7f2b4015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b48200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b4015bc20 0x7f2b400afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b48200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b40140480 con 0x7f2b400cb0b0 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b48200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b4015ee90 con 0x7f2b4015bc20 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b48200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4015f170 con 0x7f2b400cacd0 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b46200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2b4015bc20 0x7f2b400afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.512 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b44e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f2b400cb0b0 0x7f2b40140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36990/0 (socket says 172.21.15.192:36990) 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b44e00640 1 -- 172.21.15.192:0/1518021594 learned_addr learned my addr 172.21.15.192:0/1518021594 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b45800640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b400cacd0 0x7f2b4015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b46200640 1 -- 172.21.15.192:0/1518021594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b400cacd0 msgr2=0x7f2b4015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b46200640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b400cacd0 0x7f2b4015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b46200640 1 -- 172.21.15.192:0/1518021594 >> v1:172.21.15.192:6789/0 conn(0x7f2b400cb0b0 legacy=0x7f2b40140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b46200640 1 -- 172.21.15.192:0/1518021594 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b4015f450 con 0x7f2b4015bc20 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.501+0000 7f2b3fe00640 1 -- 172.21.15.192:0/1518021594 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3416862970 0 0) 0x7f2b40140480 con 0x7f2b400cb0b0 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.502+0000 7f2b46200640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b4015bc20 0x7f2b400afd80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f2b380097a0 tx=0x7f2b3802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac2d4d8f73cb97c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b3fe00640 1 -- 172.21.15.192:0/1518021594 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38032440 con 0x7f2b4015bc20 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b3fe00640 1 -- 172.21.15.192:0/1518021594 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b380325a0 con 0x7f2b4015bc20 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b3fe00640 1 -- 172.21.15.192:0/1518021594 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b38032930 con 0x7f2b4015bc20 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 -- 172.21.15.192:0/1518021594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b4015bc20 msgr2=0x7f2b400afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.513 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b4015bc20 0x7f2b400afd80 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f2b380097a0 tx=0x7f2b3802a180 comp rx=0 tx=0).stop 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 -- 172.21.15.192:0/1518021594 shutdown_connections 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b4015bc20 0x7f2b400afd80 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 --2- 172.21.15.192:0/1518021594 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b400cacd0 0x7f2b4015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 -- 172.21.15.192:0/1518021594 >> 172.21.15.192:0/1518021594 conn(0x7f2b400ae960 msgr2=0x7f2b4006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 -- 172.21.15.192:0/1518021594 shutdown_connections 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.503+0000 7f2b48200640 1 -- 172.21.15.192:0/1518021594 wait complete. 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.505+0000 7f2b48200640 1 Processor -- start 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.505+0000 7f2b48200640 1 -- start start 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 0x7f2b400b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 0x7f2b400b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400b4de0 con 0x7f2b400cacd0 2024-09-13T18:47:21.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4006a600 con 0x7f2b400cb0b0 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b48200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b400ccb30 con 0x7f2b4015bc20 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b45800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b45800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49028/0 (socket says 172.21.15.192:49028) 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.506+0000 7f2b45800640 1 -- 172.21.15.192:0/792627301 learned_addr learned my addr 172.21.15.192:0/792627301 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b46200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 0x7f2b400b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b44e00640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 0x7f2b400b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 -- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 msgr2=0x7f2b400b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 0x7f2b400b3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 -- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 msgr2=0x7f2b400b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 0x7f2b400b36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38009400 con 0x7f2b400cacd0 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b46200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 0x7f2b400b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:21.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b44e00640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 0x7f2b400b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b45800640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400efc0 tx=0x7f2b3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34009b80 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3400f040 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340146a0 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b400cd070 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.507+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b40069fb0 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.508+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4015e790 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.509+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2b34014800 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.510+0000 7f2b3d600640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 0x7f2b2006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.510+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2b3408a240 con 0x7f2b400cacd0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.510+0000 7f2b44e00640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 0x7f2b2006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:21.516 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.510+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=185}) v3 -- 0x7f2b200727f0 con 0x7f2b400cacd0 2024-09-13T18:47:21.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.511+0000 7f2b44e00640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 0x7f2b2006d0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2b401f61a0 tx=0x7f2b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:21.517 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.514+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2b340553d0 con 0x7f2b400cacd0 2024-09-13T18:47:21.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.715+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b4015c450 con 0x7f2b400cacd0 2024-09-13T18:47:22.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.715+0000 7f2b3d600640 1 -- 172.21.15.192:0/792627301 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f2b340589f0 con 0x7f2b400cacd0 2024-09-13T18:47:22.314 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:22.314 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.717+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 msgr2=0x7f2b2006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.717+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 0x7f2b2006d0c0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2b401f61a0 tx=0x7f2b2c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.717+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 msgr2=0x7f2b400cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.717+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400efc0 tx=0x7f2b3400c490 comp rx=0 tx=0).stop 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.717+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 shutdown_connections 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2b2006ac00 0x7f2b2006d0c0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2b4015bc20 0x7f2b400b3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2b400cb0b0 0x7f2b400b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 --2- 172.21.15.192:0/792627301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b400cacd0 0x7f2b400cc5f0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 >> 172.21.15.192:0/792627301 conn(0x7f2b400ae960 msgr2=0x7f2b400b0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 shutdown_connections 2024-09-13T18:47:22.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:21.718+0000 7f2b48200640 1 -- 172.21.15.192:0/792627301 wait complete. 2024-09-13T18:47:22.317 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:22.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.470+0000 7feed7400640 1 Processor -- start 2024-09-13T18:47:22.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.470+0000 7feed7400640 1 -- start start 2024-09-13T18:47:22.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.471+0000 7feed7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 0x7feed00ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.471+0000 7feed7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feed00afd80 0x7feed00b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.471+0000 7feed7400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed00b0710 con 0x7feed00b2780 2024-09-13T18:47:22.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.471+0000 7feed7400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed00cd920 con 0x7feed00afd80 2024-09-13T18:47:22.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.471+0000 7feed7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed00adf50 con 0x7feed0146610 2024-09-13T18:47:22.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feed00afd80 0x7feed00b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feed00afd80 0x7feed00b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49030/0 (socket says 172.21.15.192:49030) 2024-09-13T18:47:22.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 -- 172.21.15.192:0/584356601 learned_addr learned my addr 172.21.15.192:0/584356601 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed4a00640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 0x7feed00ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 -- 172.21.15.192:0/584356601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 msgr2=0x7feed00ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 0x7feed00ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 -- 172.21.15.192:0/584356601 >> v1:172.21.15.194:6789/0 conn(0x7feed00b2780 legacy=0x7feed00ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed5400640 1 -- 172.21.15.192:0/584356601 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed00ae770 con 0x7feed00afd80 2024-09-13T18:47:22.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.472+0000 7feed4a00640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 0x7feed00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.473+0000 7feed5400640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00afd80 0x7feed00b01d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e50 tx=0x7feec802a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f143efe38178722 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feecfe00640 1 -- 172.21.15.192:0/584356601 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8031600 con 0x7feed00afd80 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feecfe00640 1 -- 172.21.15.192:0/584356601 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec802d050 con 0x7feed00afd80 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feecfe00640 1 -- 172.21.15.192:0/584356601 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8031980 con 0x7feed00afd80 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 -- 172.21.15.192:0/584356601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00afd80 msgr2=0x7feed00b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00afd80 0x7feed00b01d0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e50 tx=0x7feec802a710 comp rx=0 tx=0).stop 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 -- 172.21.15.192:0/584356601 shutdown_connections 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed00afd80 0x7feed00b01d0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 --2- 172.21.15.192:0/584356601 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed0146610 0x7feed00ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 -- 172.21.15.192:0/584356601 >> 172.21.15.192:0/584356601 conn(0x7feed00ae960 msgr2=0x7feed006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 -- 172.21.15.192:0/584356601 shutdown_connections 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.474+0000 7feed7400640 1 -- 172.21.15.192:0/584356601 wait complete. 2024-09-13T18:47:22.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.476+0000 7feed7400640 1 Processor -- start 2024-09-13T18:47:22.478 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.476+0000 7feed7400640 1 -- start start 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed00afd80 0x7feed015c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed00b2780 0x7feed013c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed015cd20 con 0x7feed0146610 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed0070a40 con 0x7feed00afd80 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed0070d20 con 0x7feed00b2780 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed5400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49034/0 (socket says 172.21.15.192:49034) 2024-09-13T18:47:22.479 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feed5400640 1 -- 172.21.15.192:0/1092174784 learned_addr learned my addr 172.21.15.192:0/1092174784 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed4a00640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed00afd80 0x7feed015c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.477+0000 7feec7e00640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed00b2780 0x7feed013c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 -- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed00b2780 msgr2=0x7feed013c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed00b2780 0x7feed013c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 -- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed00afd80 msgr2=0x7feed015c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed00afd80 0x7feed015c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 -- 172.21.15.192:0/1092174784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009b30 con 0x7feed0146610 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed5400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e50 tx=0x7feec8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec803d860 con 0x7feed0146610 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec803d9e0 con 0x7feed0146610 2024-09-13T18:47:22.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec803dd90 con 0x7feed0146610 2024-09-13T18:47:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed0071000 con 0x7feed0146610 2024-09-13T18:47:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.478+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed00715c0 con 0x7feed0146610 2024-09-13T18:47:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.479+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed00717b0 con 0x7feed0146610 2024-09-13T18:47:22.482 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.480+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feec803b400 con 0x7feed0146610 2024-09-13T18:47:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.481+0000 7feecd600640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 0x7feeac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.481+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feec80aa350 con 0x7feed0146610 2024-09-13T18:47:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.481+0000 7feed4a00640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 0x7feeac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.483 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.482+0000 7feed4a00640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 0x7feeac06d0c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feec0006fd0 tx=0x7feec0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.487 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.486+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feec8075450 con 0x7feed0146610 2024-09-13T18:47:22.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.655+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feed01469f0 con 0x7feed0146610 2024-09-13T18:47:22.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.657+0000 7feecd600640 1 -- 172.21.15.192:0/1092174784 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+16744 (secure 0 0 0) 0x7feec807de60 con 0x7feed0146610 2024-09-13T18:47:22.659 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:22.659 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":185,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:21.881902+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.6","mappings":[{"from":2,"to":5}]},{"pgid":"21.1d","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 msgr2=0x7feeac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 0x7feeac06d0c0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7feec0006fd0 tx=0x7feec0008040 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 msgr2=0x7feed013c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7feec8009e50 tx=0x7feec8004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 shutdown_connections 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feeac06ac00 0x7feeac06d0c0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feed0146610 0x7feed013c720 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feed00b2780 0x7feed013c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 --2- 172.21.15.192:0/1092174784 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feed00afd80 0x7feed015c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 >> 172.21.15.192:0/1092174784 conn(0x7feed00ae960 msgr2=0x7feed0144890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 shutdown_connections 2024-09-13T18:47:22.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.659+0000 7feed7400640 1 -- 172.21.15.192:0/1092174784 wait complete. 2024-09-13T18:47:22.677 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:47:22.677 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:22.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.827+0000 7febc1600640 1 Processor -- start 2024-09-13T18:47:22.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.827+0000 7febc1600640 1 -- start start 2024-09-13T18:47:22.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febc1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 0x7febbc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febc1600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febbc0cb0b0 0x7febbc15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febc1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febbc140480 con 0x7febbc140980 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febc1600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febbc15c160 con 0x7febbc0cb0b0 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febc1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc15ee90 con 0x7febbc0cacd0 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febbc0cb0b0 0x7febbc15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7febbc0cb0b0 0x7febbc15bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49046/0 (socket says 172.21.15.192:49046) 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.828+0000 7febba000640 1 -- 172.21.15.192:0/1868581927 learned_addr learned my addr 172.21.15.192:0/1868581927 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febbaa00640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 0x7febbc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febba000640 1 -- 172.21.15.192:0/1868581927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 msgr2=0x7febbc15e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febba000640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 0x7febbc15e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febba000640 1 -- 172.21.15.192:0/1868581927 >> v1:172.21.15.194:6789/0 conn(0x7febbc140980 legacy=0x7febbc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febba000640 1 -- 172.21.15.192:0/1868581927 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febbc15f170 con 0x7febbc0cb0b0 2024-09-13T18:47:22.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.829+0000 7febbaa00640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 0x7febbc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:22.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.830+0000 7febba000640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cb0b0 0x7febbc15bc20 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7feba8009870 tx=0x7feba802a250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0751526cbd26fd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.830+0000 7febb9600640 1 -- 172.21.15.192:0/1868581927 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8032440 con 0x7febbc0cb0b0 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.830+0000 7febb9600640 1 -- 172.21.15.192:0/1868581927 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba80325a0 con 0x7febbc0cb0b0 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.830+0000 7febb9600640 1 -- 172.21.15.192:0/1868581927 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba8032930 con 0x7febbc0cb0b0 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 -- 172.21.15.192:0/1868581927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cb0b0 msgr2=0x7febbc15bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cb0b0 0x7febbc15bc20 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7feba8009870 tx=0x7feba802a250 comp rx=0 tx=0).stop 2024-09-13T18:47:22.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 -- 172.21.15.192:0/1868581927 shutdown_connections 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cb0b0 0x7febbc15bc20 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 --2- 172.21.15.192:0/1868581927 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc0cacd0 0x7febbc15e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 -- 172.21.15.192:0/1868581927 >> 172.21.15.192:0/1868581927 conn(0x7febbc0ae960 msgr2=0x7febbc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 -- 172.21.15.192:0/1868581927 shutdown_connections 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.831+0000 7febc1600640 1 -- 172.21.15.192:0/1868581927 wait complete. 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.832+0000 7febc1600640 1 Processor -- start 2024-09-13T18:47:22.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.832+0000 7febc1600640 1 -- start start 2024-09-13T18:47:22.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 0x7febbc154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 0x7febbc13f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc1553c0 con 0x7febbc0cacd0 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febbc15aad0 con 0x7febbc0cb0b0 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.833+0000 7febc1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febbc15b040 con 0x7febbc140980 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49054/0 (socket says 172.21.15.192:49054) 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 -- 172.21.15.192:0/4143557312 learned_addr learned my addr 172.21.15.192:0/4143557312 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febba000640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 0x7febbc154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbb400640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 0x7febbc13f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 -- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 msgr2=0x7febbc13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 0x7febbc13f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 -- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 msgr2=0x7febbc154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 0x7febbc154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 -- 172.21.15.192:0/4143557312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba80094d0 con 0x7febbc0cacd0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbb400640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 0x7febbc13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febba000640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 0x7febbc154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.834+0000 7febbaa00640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7febac00d800 tx=0x7febac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.835+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac004030 con 0x7febbc0cacd0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.835+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac004190 con 0x7febbc0cacd0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.835+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac004520 con 0x7febbc0cacd0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.835+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febbc158ed0 con 0x7febbc0cacd0 2024-09-13T18:47:22.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.835+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febbc159450 con 0x7febbc0cacd0 2024-09-13T18:47:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.836+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febbc15bc20 con 0x7febbc0cacd0 2024-09-13T18:47:22.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.837+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7febac0096a0 con 0x7febbc0cacd0 2024-09-13T18:47:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.837+0000 7febb2a00640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 0x7feb9c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.837+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5767+0+0 (secure 0 0 0) 0x7febac089560 con 0x7febbc0cacd0 2024-09-13T18:47:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.838+0000 7febba000640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 0x7feb9c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:22.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.838+0000 7febba000640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 0x7feb9c06d0f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:22.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:22.842+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7febac054670 con 0x7febbc0cacd0 2024-09-13T18:47:23.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.046+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febbc06c6c0 con 0x7febbc0cacd0 2024-09-13T18:47:23.048 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.047+0000 7febb2a00640 1 -- 172.21.15.192:0/4143557312 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7febac057c90 con 0x7febbc0cacd0 2024-09-13T18:47:23.049 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:23.049 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:47:23.049 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:47:23.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 msgr2=0x7feb9c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.051 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 0x7feb9c06d0f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7feba8034000 tx=0x7feba802e000 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 msgr2=0x7febbc15a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7febac00d800 tx=0x7febac00dcc0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 shutdown_connections 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb9c06ac30 0x7feb9c06d0f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7febbc140980 0x7febbc13f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7febbc0cb0b0 0x7febbc154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 --2- 172.21.15.192:0/4143557312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7febbc0cacd0 0x7febbc15a3d0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 >> 172.21.15.192:0/4143557312 conn(0x7febbc0ae960 msgr2=0x7febbc070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 shutdown_connections 2024-09-13T18:47:23.052 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.049+0000 7febc1600640 1 -- 172.21.15.192:0/4143557312 wait complete. 2024-09-13T18:47:23.067 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:23.220 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.218+0000 7f6a4a800640 1 Processor -- start 2024-09-13T18:47:23.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.218+0000 7f6a4a800640 1 -- start start 2024-09-13T18:47:23.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a4a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a440b0490 0x7f6a440cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a4a800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4415ec00 con 0x7f6a440cacd0 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a4a800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a44140480 con 0x7f6a4415e790 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a4a800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a440cb5f0 con 0x7f6a440b0490 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f6a440cacd0 0x7f6a44140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36992/0 (socket says 172.21.15.192:36992) 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43400640 1 -- 172.21.15.192:0/607460412 learned_addr learned my addr 172.21.15.192:0/607460412 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:23.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43e00640 1 --2- 172.21.15.192:0/607460412 >> v2:172.21.15.192:3300/0 conn(0x7f6a440b0490 0x7f6a440cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a42a00640 1 -- 172.21.15.192:0/607460412 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3498606521 0 0) 0x7f6a4415ec00 con 0x7f6a440cacd0 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a42a00640 1 -- 172.21.15.192:0/607460412 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a28003520 con 0x7f6a440cacd0 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43e00640 1 -- 172.21.15.192:0/607460412 >> v1:172.21.15.194:6789/0 conn(0x7f6a4415e790 legacy=0x7f6a440afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43e00640 1 -- 172.21.15.192:0/607460412 >> v1:172.21.15.192:6789/0 conn(0x7f6a440cacd0 legacy=0x7f6a44140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.220+0000 7f6a43e00640 1 -- 172.21.15.192:0/607460412 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4415ee90 con 0x7f6a440b0490 2024-09-13T18:47:23.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.221+0000 7f6a43e00640 1 --2- 172.21.15.192:0/607460412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b0490 0x7f6a440cb0b0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009d90 tx=0x7f6a3c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514b74581c5a036c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a42a00640 1 -- 172.21.15.192:0/607460412 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007740 con 0x7f6a440b0490 2024-09-13T18:47:23.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a42a00640 1 -- 172.21.15.192:0/607460412 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c02d050 con 0x7f6a440b0490 2024-09-13T18:47:23.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a42a00640 1 -- 172.21.15.192:0/607460412 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c007ac0 con 0x7f6a440b0490 2024-09-13T18:47:23.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 -- 172.21.15.192:0/607460412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b0490 msgr2=0x7f6a440cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 --2- 172.21.15.192:0/607460412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b0490 0x7f6a440cb0b0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009d90 tx=0x7f6a3c02a6f0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 -- 172.21.15.192:0/607460412 shutdown_connections 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 --2- 172.21.15.192:0/607460412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a440b0490 0x7f6a440cb0b0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 -- 172.21.15.192:0/607460412 >> 172.21.15.192:0/607460412 conn(0x7f6a440ae960 msgr2=0x7f6a4406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 -- 172.21.15.192:0/607460412 shutdown_connections 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.222+0000 7f6a4a800640 1 -- 172.21.15.192:0/607460412 wait complete. 2024-09-13T18:47:23.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.224+0000 7f6a4a800640 1 Processor -- start 2024-09-13T18:47:23.226 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.224+0000 7f6a4a800640 1 -- start start 2024-09-13T18:47:23.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a440b0490 0x7f6a440b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a440cacd0 0x7f6a441f0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f1c50 con 0x7f6a4415e790 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a44156a50 con 0x7f6a440b0490 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a4a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a441f1040 con 0x7f6a440cacd0 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49076/0 (socket says 172.21.15.192:49076) 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a43e00640 1 -- 172.21.15.192:0/12307008 learned_addr learned my addr 172.21.15.192:0/12307008 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.225+0000 7f6a43400640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a440b0490 0x7f6a440b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a3aa00640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a440cacd0 0x7f6a441f0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 -- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a440cacd0 msgr2=0x7f6a441f0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a440cacd0 0x7f6a441f0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 -- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a440b0490 msgr2=0x7f6a440b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a440b0490 0x7f6a440b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.228 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 -- 172.21.15.192:0/12307008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c009a70 con 0x7f6a4415e790 2024-09-13T18:47:23.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a43e00640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009eb0 tx=0x7f6a3c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c03b820 con 0x7f6a4415e790 2024-09-13T18:47:23.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c03b980 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c03bcf0 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a441f1320 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.226+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a441f18e0 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.227+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a44156bc0 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.228+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a3c031400 con 0x7f6a4415e790 2024-09-13T18:47:23.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.229+0000 7f6a3be00640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 0x7f6a2006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.229+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a3c0aa650 con 0x7f6a4415e790 2024-09-13T18:47:23.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.229+0000 7f6a43400640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 0x7f6a2006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.230+0000 7f6a43400640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 0x7f6a2006d0f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a340011e0 tx=0x7f6a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.233+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a3c0756d0 con 0x7f6a4415e790 2024-09-13T18:47:23.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.433+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6a440cb0b0 con 0x7f6a4415e790 2024-09-13T18:47:23.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.434+0000 7f6a3be00640 1 -- 172.21.15.192:0/12307008 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4750 (secure 0 0 0) 0x7f6a3c078cf0 con 0x7f6a4415e790 2024-09-13T18:47:23.436 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:23.436 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":78,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:45:54.890757+0000","modified":"2024-09-13T18:45:57.906830+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8586},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8586":{"gid":8586,"name":"a","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.192:6837/2926352862","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2926352862},{"type":"v1","addr":"172.21.15.192:6837","nonce":2926352862}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2024-09-13T18:47:23.436 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 78 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 msgr2=0x7f6a2006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 0x7f6a2006d0f0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a340011e0 tx=0x7f6a34009040 comp rx=0 tx=0).stop 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 msgr2=0x7f6a4406aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009eb0 tx=0x7f6a3c004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 shutdown_connections 2024-09-13T18:47:23.438 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6a2006ac30 0x7f6a2006d0f0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a4415e790 0x7f6a4406aef0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a440cacd0 0x7f6a441f0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 --2- 172.21.15.192:0/12307008 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a440b0490 0x7f6a440b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 >> 172.21.15.192:0/12307008 conn(0x7f6a440ae960 msgr2=0x7f6a4413f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 shutdown_connections 2024-09-13T18:47:23.439 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.436+0000 7f6a4a800640 1 -- 172.21.15.192:0/12307008 wait complete. 2024-09-13T18:47:23.454 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:23.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.604+0000 7fb1dce00640 1 Processor -- start 2024-09-13T18:47:23.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.604+0000 7fb1dce00640 1 -- start start 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.605+0000 7fb1dce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1d8146610 0x7fb1d80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.605+0000 7fb1dce00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb1d80b2780 0x7fb1d80ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.605+0000 7fb1dce00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1d80ae770 con 0x7fb1d80afd80 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.605+0000 7fb1dce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80cd920 con 0x7fb1d8146610 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.605+0000 7fb1dce00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1d80cdb30 con 0x7fb1d80b2780 2024-09-13T18:47:23.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d6800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb1d80afd80 0x7fb1d80b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36998/0 (socket says 172.21.15.192:36998) 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb1d8146610 0x7fb1d80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d6800640 1 -- 172.21.15.192:0/1957965074 learned_addr learned my addr 172.21.15.192:0/1957965074 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1cd400640 1 --2- 172.21.15.192:0/1957965074 >> v2:172.21.15.194:3300/0 conn(0x7fb1d80b2780 0x7fb1d80ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5e00640 1 -- 172.21.15.192:0/1957965074 >> v2:172.21.15.194:3300/0 conn(0x7fb1d80b2780 msgr2=0x7fb1d80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/1957965074 >> v2:172.21.15.194:3300/0 conn(0x7fb1d80b2780 0x7fb1d80ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5e00640 1 -- 172.21.15.192:0/1957965074 >> v1:172.21.15.192:6789/0 conn(0x7fb1d80afd80 legacy=0x7fb1d80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5e00640 1 -- 172.21.15.192:0/1957965074 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1d80ae1b0 con 0x7fb1d8146610 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.606+0000 7fb1d5400640 1 -- 172.21.15.192:0/1957965074 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1877688997 0 0) 0x7fb1d80ae770 con 0x7fb1d80afd80 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.607+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/1957965074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d8146610 0x7fb1d80ce2f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd19aac80bd36abe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1d5400640 1 -- 172.21.15.192:0/1957965074 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c802ae50 con 0x7fb1d8146610 2024-09-13T18:47:23.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1d5400640 1 -- 172.21.15.192:0/1957965074 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8032440 con 0x7fb1d8146610 2024-09-13T18:47:23.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1d5400640 1 -- 172.21.15.192:0/1957965074 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c80327d0 con 0x7fb1d8146610 2024-09-13T18:47:23.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 -- 172.21.15.192:0/1957965074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d8146610 msgr2=0x7fb1d80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 --2- 172.21.15.192:0/1957965074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d8146610 0x7fb1d80ce2f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fb1c80097a0 tx=0x7fb1c802a140 comp rx=0 tx=0).stop 2024-09-13T18:47:23.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 -- 172.21.15.192:0/1957965074 shutdown_connections 2024-09-13T18:47:23.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 --2- 172.21.15.192:0/1957965074 >> v2:172.21.15.194:3300/0 conn(0x7fb1d80b2780 0x7fb1d80ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 --2- 172.21.15.192:0/1957965074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d8146610 0x7fb1d80ce2f0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 -- 172.21.15.192:0/1957965074 >> 172.21.15.192:0/1957965074 conn(0x7fb1d80ae960 msgr2=0x7fb1d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 -- 172.21.15.192:0/1957965074 shutdown_connections 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.608+0000 7fb1dce00640 1 -- 172.21.15.192:0/1957965074 wait complete. 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.610+0000 7fb1dce00640 1 Processor -- start 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.610+0000 7fb1dce00640 1 -- start start 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 0x7fb1d806eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 0x7fb1d813de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d806f420 con 0x7fb1d80b2780 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d8071aa0 con 0x7fb1d8146610 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1dce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1d806f630 con 0x7fb1d80afd80 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1cd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1cd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49094/0 (socket says 172.21.15.192:49094) 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.611+0000 7fb1cd400640 1 -- 172.21.15.192:0/2833768130 learned_addr learned my addr 172.21.15.192:0/2833768130 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:23.615 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1d6800640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 0x7fb1d813de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 -- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 msgr2=0x7fb1d806eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 0x7fb1d806eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 0x7fb1d806eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 -- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 msgr2=0x7fb1d813de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 0x7fb1d813de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 -- 172.21.15.192:0/2833768130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009400 con 0x7fb1d80b2780 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 0x7fb1d806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1d6800640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 0x7fb1d813de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cd400640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e980 tx=0x7fb1c000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c0009670 con 0x7fb1d80b2780 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c000ca00 con 0x7fb1d80b2780 2024-09-13T18:47:23.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c000cd90 con 0x7fb1d80b2780 2024-09-13T18:47:23.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d806f910 con 0x7fb1d80b2780 2024-09-13T18:47:23.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.612+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1d806fed0 con 0x7fb1d80b2780 2024-09-13T18:47:23.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.613+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1d8070210 con 0x7fb1d80b2780 2024-09-13T18:47:23.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.614+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb1c0013470 con 0x7fb1d80b2780 2024-09-13T18:47:23.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.615+0000 7fb1cea00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 0x7fb1b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.615+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb1c0089650 con 0x7fb1d80b2780 2024-09-13T18:47:23.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.615+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 0x7fb1b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.616+0000 7fb1d5e00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 0x7fb1b406d0c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8034000 tx=0x7fb1c802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.619+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb1c00547e0 con 0x7fb1d80b2780 2024-09-13T18:47:23.791 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.788+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1d80ce2f0 con 0x7fb1d80b2780 2024-09-13T18:47:23.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.790+0000 7fb1cea00640 1 -- 172.21.15.192:0/2833768130 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+16744 (secure 0 0 0) 0x7fb1c0057e00 con 0x7fb1d80b2780 2024-09-13T18:47:23.792 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:23.793 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":185,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:21.881902+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:45:52.747334+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"179","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-13T18:45:53.893065+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.6","mappings":[{"from":2,"to":5}]},{"pgid":"21.1d","mappings":[{"from":2,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:23.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 msgr2=0x7fb1b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 0x7fb1b406d0c0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8034000 tx=0x7fb1c802e000 comp rx=0 tx=0).stop 2024-09-13T18:47:23.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 msgr2=0x7fb1d8143610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fb1c000e980 tx=0x7fb1c000ee40 comp rx=0 tx=0).stop 2024-09-13T18:47:23.795 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 shutdown_connections 2024-09-13T18:47:23.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb1b406ac00 0x7fb1b406d0c0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb1d8146610 0x7fb1d813de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1d80b2780 0x7fb1d8143610 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 --2- 172.21.15.192:0/2833768130 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb1d80afd80 0x7fb1d806eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.796 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 >> 172.21.15.192:0/2833768130 conn(0x7fb1d80ae960 msgr2=0x7fb1d8160730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 shutdown_connections 2024-09-13T18:47:23.797 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.792+0000 7fb1dce00640 1 -- 172.21.15.192:0/2833768130 wait complete. 2024-09-13T18:47:23.810 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:47:23.963 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.961+0000 7fe341c00640 1 Processor -- start 2024-09-13T18:47:23.964 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.961+0000 7fe341c00640 1 -- start start 2024-09-13T18:47:23.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.962+0000 7fe341c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 0x7fe33c15a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.962+0000 7fe341c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe33c0b0490 0x7fe33c15a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.962+0000 7fe341c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe33c0b2f00 con 0x7fe33c15dee0 2024-09-13T18:47:23.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.962+0000 7fe341c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe33c15aec0 con 0x7fe33c0b0490 2024-09-13T18:47:23.968 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.962+0000 7fe341c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c0b3150 con 0x7fe33c0b3f10 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 0x7fe33c15a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33aa00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7fe33c15dee0 0x7fe33c0afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:57458/0 (socket says 172.21.15.192:57458) 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33aa00640 1 -- 172.21.15.192:0/895570769 learned_addr learned my addr 172.21.15.192:0/895570769 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33b400640 1 --2- 172.21.15.192:0/895570769 >> v2:172.21.15.194:3300/0 conn(0x7fe33c0b0490 0x7fe33c15a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe339600640 1 -- 172.21.15.192:0/895570769 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249135019 0 0) 0x7fe33c0b2f00 con 0x7fe33c15dee0 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33a000640 1 -- 172.21.15.192:0/895570769 >> v2:172.21.15.194:3300/0 conn(0x7fe33c0b0490 msgr2=0x7fe33c15a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33a000640 1 --2- 172.21.15.192:0/895570769 >> v2:172.21.15.194:3300/0 conn(0x7fe33c0b0490 0x7fe33c15a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33a000640 1 -- 172.21.15.192:0/895570769 >> v1:172.21.15.194:6789/0 conn(0x7fe33c15dee0 legacy=0x7fe33c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.963+0000 7fe33a000640 1 -- 172.21.15.192:0/895570769 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe33c0b3430 con 0x7fe33c0b3f10 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.964+0000 7fe33a000640 1 --2- 172.21.15.192:0/895570769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 0x7fe33c15a440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3280097a0 tx=0x7fe32802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a523bd9b0673e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.964+0000 7fe339600640 1 -- 172.21.15.192:0/895570769 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328032440 con 0x7fe33c0b3f10 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe339600640 1 -- 172.21.15.192:0/895570769 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3280325a0 con 0x7fe33c0b3f10 2024-09-13T18:47:23.969 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe339600640 1 -- 172.21.15.192:0/895570769 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe328032930 con 0x7fe33c0b3f10 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 -- 172.21.15.192:0/895570769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 msgr2=0x7fe33c15a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 --2- 172.21.15.192:0/895570769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 0x7fe33c15a440 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe3280097a0 tx=0x7fe32802a180 comp rx=0 tx=0).stop 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 -- 172.21.15.192:0/895570769 shutdown_connections 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 --2- 172.21.15.192:0/895570769 >> v2:172.21.15.194:3300/0 conn(0x7fe33c0b0490 0x7fe33c15a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 --2- 172.21.15.192:0/895570769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c0b3f10 0x7fe33c15a440 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 -- 172.21.15.192:0/895570769 >> 172.21.15.192:0/895570769 conn(0x7fe33c0ae960 msgr2=0x7fe33c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 -- 172.21.15.192:0/895570769 shutdown_connections 2024-09-13T18:47:23.970 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.965+0000 7fe341c00640 1 -- 172.21.15.192:0/895570769 wait complete. 2024-09-13T18:47:23.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.967+0000 7fe341c00640 1 Processor -- start 2024-09-13T18:47:23.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.967+0000 7fe341c00640 1 -- start start 2024-09-13T18:47:23.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe33c0b0490 0x7fe33c071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 0x7fe33c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c157620 con 0x7fe33c157170 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c151e90 con 0x7fe33c0b0490 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe341c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33c151310 con 0x7fe33c15dee0 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 0x7fe33c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33aa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe33c0b0490 0x7fe33c071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49096/0 (socket says 172.21.15.192:49096) 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33a000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 0x7fe33c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:45146/0 (socket says 172.21.15.192:45146) 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.968+0000 7fe33b400640 1 -- 172.21.15.192:0/4182198709 learned_addr learned my addr 172.21.15.192:0/4182198709 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 -- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 msgr2=0x7fe33c156c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 0x7fe33c156c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 -- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe33c0b0490 msgr2=0x7fe33c071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe33c0b0490 0x7fe33c071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 -- 172.21.15.192:0/4182198709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe328009400 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe33b400640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe334009dd0 tx=0x7fe33400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334014480 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33400f040 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe33c1515f0 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe334014840 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.969+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe33c151bb0 con 0x7fe33c157170 2024-09-13T18:47:23.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.970+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe33c0afd80 con 0x7fe33c157170 2024-09-13T18:47:23.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.971+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe3340149a0 con 0x7fe33c157170 2024-09-13T18:47:23.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.972+0000 7fe332a00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:23.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.972+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe334089e10 con 0x7fe33c157170 2024-09-13T18:47:23.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.972+0000 7fe33aa00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:23.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.973+0000 7fe33aa00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 0x7fe31c06d0c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe32c007fd0 tx=0x7fe32c007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:23.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:23.977+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe33408d030 con 0x7fe33c157170 2024-09-13T18:47:24.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.177+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe33c15aba0 con 0x7fe33c157170 2024-09-13T18:47:24.181 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:47:24.178+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:47:24.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.187+0000 7fe332a00640 1 -- 172.21.15.192:0/4182198709 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v79) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe334055050 con 0x7fe33c157170 2024-09-13T18:47:24.190 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:47:24.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 msgr2=0x7fe31c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.192 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 0x7fe31c06d0c0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fe32c007fd0 tx=0x7fe32c007de0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 msgr2=0x7fe33c13a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fe334009dd0 tx=0x7fe33400c490 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 shutdown_connections 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe31c06ac00 0x7fe31c06d0c0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe33c157170 0x7fe33c13a0d0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe33c15dee0 0x7fe33c156c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 --2- 172.21.15.192:0/4182198709 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe33c0b0490 0x7fe33c071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.189+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 >> 172.21.15.192:0/4182198709 conn(0x7fe33c0ae960 msgr2=0x7fe33c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.190+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 shutdown_connections 2024-09-13T18:47:24.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.190+0000 7fe341c00640 1 -- 172.21.15.192:0/4182198709 wait complete. 2024-09-13T18:47:24.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:47:24.253 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:47:24.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.364+0000 7fb9f7400640 1 Processor -- start 2024-09-13T18:47:24.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.364+0000 7fb9f7400640 1 -- start start 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9f00b3da0 0x7fb9f006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f7400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9f006b480 con 0x7fb9f006a8b0 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f7400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9f00ce770 con 0x7fb9f00b3da0 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f006b760 con 0x7fb9f01434c0 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f5400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb9f00b3da0 0x7fb9f006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9efe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fb9f006a8b0 0x7fb9f00b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37006/0 (socket says 172.21.15.192:37006) 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9efe00640 1 -- 172.21.15.192:0/2705995445 learned_addr learned my addr 172.21.15.192:0/2705995445 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:24.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f4a00640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.366+0000 7fb9f5400640 1 -- 172.21.15.192:0/2705995445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 msgr2=0x7fb9f006c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:24.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.367+0000 7fb9f5400640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f006c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.367+0000 7fb9f5400640 1 -- 172.21.15.192:0/2705995445 >> v1:172.21.15.192:6789/0 conn(0x7fb9f006a8b0 legacy=0x7fb9f00b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.367+0000 7fb9f5400640 1 -- 172.21.15.192:0/2705995445 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f006ba40 con 0x7fb9f00b3da0 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.367+0000 7fb9ef400640 1 -- 172.21.15.192:0/2705995445 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3672953043 0 0) 0x7fb9f006b480 con 0x7fb9f006a8b0 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.367+0000 7fb9f5400640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f00b3da0 0x7fb9f006e920 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009dc0 tx=0x7fb9e802a5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83990521d7ddf2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9ef400640 1 -- 172.21.15.192:0/2705995445 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8007740 con 0x7fb9f00b3da0 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9ef400640 1 -- 172.21.15.192:0/2705995445 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e802d050 con 0x7fb9f00b3da0 2024-09-13T18:47:24.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9ef400640 1 -- 172.21.15.192:0/2705995445 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8007ac0 con 0x7fb9f00b3da0 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 -- 172.21.15.192:0/2705995445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f00b3da0 msgr2=0x7fb9f006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f00b3da0 0x7fb9f006e920 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8009dc0 tx=0x7fb9e802a5f0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 -- 172.21.15.192:0/2705995445 shutdown_connections 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f00b3da0 0x7fb9f006e920 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 --2- 172.21.15.192:0/2705995445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f006c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 -- 172.21.15.192:0/2705995445 >> 172.21.15.192:0/2705995445 conn(0x7fb9f00b08f0 msgr2=0x7fb9f00b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 -- 172.21.15.192:0/2705995445 shutdown_connections 2024-09-13T18:47:24.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.368+0000 7fb9f7400640 1 -- 172.21.15.192:0/2705995445 wait complete. 2024-09-13T18:47:24.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.370+0000 7fb9f7400640 1 Processor -- start 2024-09-13T18:47:24.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.370+0000 7fb9f7400640 1 -- start start 2024-09-13T18:47:24.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 0x7fb9f0153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f013a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0154c60 con 0x7fb9f006a8b0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0154150 con 0x7fb9f00b3da0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f7400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f0154980 con 0x7fb9f01434c0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49122/0 (socket says 172.21.15.192:49122) 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f4a00640 1 -- 172.21.15.192:0/3840302190 learned_addr learned my addr 172.21.15.192:0/3840302190 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.371+0000 7fb9f5400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f013a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9efe00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 0x7fb9f0153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 -- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 msgr2=0x7fb9f013a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f013a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 -- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 msgr2=0x7fb9f0153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:24.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 0x7fb9f0153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:24.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 -- 172.21.15.192:0/3840302190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e8009a70 con 0x7fb9f006a8b0 2024-09-13T18:47:24.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9efe00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 0x7fb9f0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:24.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f4a00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000e870 tx=0x7fb9e000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00094f0 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e000c940 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e000ccf0 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f0141f00 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.372+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f01424c0 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.373+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0141d60 con 0x7fb9f006a8b0 2024-09-13T18:47:24.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.374+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb9e0013470 con 0x7fb9f006a8b0 2024-09-13T18:47:24.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.375+0000 7fb9ecc00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 0x7fb9d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:24.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.375+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb9e00894d0 con 0x7fb9f006a8b0 2024-09-13T18:47:24.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.376+0000 7fb9efe00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 0x7fb9d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:24.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.376+0000 7fb9efe00640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 0x7fb9d006d0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0157840 tx=0x7fb9dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:24.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.379+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb9f0141d60 con 0x7fb9f006a8b0 2024-09-13T18:47:24.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:24.583+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb9f0141d60 con 0x7fb9f006a8b0 2024-09-13T18:47:25.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.191+0000 7fb9ecc00640 1 -- 172.21.15.192:0/3840302190 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v80) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb9f0141d60 con 0x7fb9f006a8b0 2024-09-13T18:47:25.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 msgr2=0x7fb9d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 0x7fb9d006d0c0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0157840 tx=0x7fb9dc009040 comp rx=0 tx=0).stop 2024-09-13T18:47:25.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 msgr2=0x7fb9f01543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7fb9e000e870 tx=0x7fb9e000ed30 comp rx=0 tx=0).stop 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 shutdown_connections 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb9d006ac00 0x7fb9d006d0c0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb9f01434c0 0x7fb9f013a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb9f00b3da0 0x7fb9f0153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 --2- 172.21.15.192:0/3840302190 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb9f006a8b0 0x7fb9f01543a0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.193+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 >> 172.21.15.192:0/3840302190 conn(0x7fb9f00b08f0 msgr2=0x7fb9f00b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.194+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 shutdown_connections 2024-09-13T18:47:25.197 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.194+0000 7fb9f7400640 1 -- 172.21.15.192:0/3840302190 wait complete. 2024-09-13T18:47:25.214 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:47:25.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.407+0000 7f6a21600640 1 Processor -- start 2024-09-13T18:47:25.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.407+0000 7f6a21600640 1 -- start start 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.408+0000 7f6a21600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a1c071b80 0x7f6a1c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.408+0000 7f6a21600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c1403e0 0x7f6a1c070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.408+0000 7f6a21600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c06a330 con 0x7f6a1c071100 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.408+0000 7f6a21600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c13e0f0 con 0x7f6a1c071b80 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.408+0000 7f6a21600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c15f840 con 0x7f6a1c1403e0 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a1c071b80 0x7f6a1c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f6a1c071b80 0x7f6a1c15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49138/0 (socket says 172.21.15.192:49138) 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 -- 172.21.15.192:0/3338115514 learned_addr learned my addr 172.21.15.192:0/3338115514 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1a000640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c1403e0 0x7f6a1c070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.412 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 -- 172.21.15.192:0/3338115514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c1403e0 msgr2=0x7f6a1c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:25.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c1403e0 0x7f6a1c070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 -- 172.21.15.192:0/3338115514 >> v1:172.21.15.194:6789/0 conn(0x7f6a1c071100 legacy=0x7f6a1c0cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:25.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.409+0000 7f6a1aa00640 1 -- 172.21.15.192:0/3338115514 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c15b300 con 0x7f6a1c071b80 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.410+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c071b80 0x7f6a1c15f300 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009870 tx=0x7f6a0c02a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95226878376a40da server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.410+0000 7f6a19600640 1 -- 172.21.15.192:0/3338115514 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c032440 con 0x7f6a1c071b80 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.410+0000 7f6a19600640 1 -- 172.21.15.192:0/3338115514 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c0325a0 con 0x7f6a1c071b80 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.410+0000 7f6a19600640 1 -- 172.21.15.192:0/3338115514 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c032930 con 0x7f6a1c071b80 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 -- 172.21.15.192:0/3338115514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c071b80 msgr2=0x7f6a1c15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c071b80 0x7f6a1c15f300 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009870 tx=0x7f6a0c02a200 comp rx=0 tx=0).stop 2024-09-13T18:47:25.414 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 -- 172.21.15.192:0/3338115514 shutdown_connections 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c1403e0 0x7f6a1c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 --2- 172.21.15.192:0/3338115514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c071b80 0x7f6a1c15f300 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 -- 172.21.15.192:0/3338115514 >> 172.21.15.192:0/3338115514 conn(0x7f6a1c0b0c40 msgr2=0x7f6a1c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 -- 172.21.15.192:0/3338115514 shutdown_connections 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.411+0000 7f6a21600640 1 -- 172.21.15.192:0/3338115514 wait complete. 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.413+0000 7f6a21600640 1 Processor -- start 2024-09-13T18:47:25.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.413+0000 7f6a21600640 1 -- start start 2024-09-13T18:47:25.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 0x7f6a1c1f2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 0x7f6a1c13d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1f6260 con 0x7f6a1c1403e0 2024-09-13T18:47:25.417 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1f6540 con 0x7f6a1c071b80 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a21600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1f6820 con 0x7f6a1c071100 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49146/0 (socket says 172.21.15.192:49146) 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 -- 172.21.15.192:0/3130575169 learned_addr learned my addr 172.21.15.192:0/3130575169 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1a000640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 0x7f6a1c13d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 0x7f6a1c1f2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 -- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 msgr2=0x7f6a1c1f2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 0x7f6a1c1f2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 -- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 msgr2=0x7f6a1c13d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 0x7f6a1c13d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.414+0000 7f6a1b400640 1 -- 172.21.15.192:0/3130575169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a0c0094d0 con 0x7f6a1c1403e0 2024-09-13T18:47:25.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a1a000640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 0x7f6a1c13d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:25.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 0x7f6a1c1f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:25.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a1b400640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400c780 tx=0x7f6a1400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14004b60 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400ce90 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c1f6b00 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400a850 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.415+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c1f6de0 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.416+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c0cb7b0 con 0x7f6a1c1403e0 2024-09-13T18:47:25.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.417+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6a1400a9b0 con 0x7f6a1c1403e0 2024-09-13T18:47:25.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.418+0000 7f6a12a00640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 0x7f69fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:25.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.418+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6a140895c0 con 0x7f6a1c1403e0 2024-09-13T18:47:25.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.419+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 0x7f69fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:25.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.419+0000 7f6a1aa00640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 0x7f69fc06d0c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c034000 tx=0x7f6a0c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:25.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.423+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6a14054700 con 0x7f6a1c1403e0 2024-09-13T18:47:25.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:25.588+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a1c15f2e0 con 0x7f6a1c1403e0 2024-09-13T18:47:26.196 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.193+0000 7f6a12a00640 1 -- 172.21.15.192:0/3130575169 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v187) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6a14057d20 con 0x7f6a1c1403e0 2024-09-13T18:47:26.196 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:47:26.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 msgr2=0x7f69fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 0x7f69fc06d0c0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c034000 tx=0x7f6a0c02e000 comp rx=0 tx=0).stop 2024-09-13T18:47:26.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 msgr2=0x7f6a1c0a9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f6a1400c780 tx=0x7f6a1400cc40 comp rx=0 tx=0).stop 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 shutdown_connections 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f69fc06ac00 0x7f69fc06d0c0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6a1c1403e0 0x7f6a1c0a9430 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6a1c071b80 0x7f6a1c13d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 --2- 172.21.15.192:0/3130575169 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6a1c071100 0x7f6a1c1f2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.196+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 >> 172.21.15.192:0/3130575169 conn(0x7f6a1c0b0c40 msgr2=0x7f6a1c13fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.197+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 shutdown_connections 2024-09-13T18:47:26.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.197+0000 7f6a21600640 1 -- 172.21.15.192:0/3130575169 wait complete. 2024-09-13T18:47:26.218 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:47:26.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.373+0000 7f9ddd400640 1 Processor -- start 2024-09-13T18:47:26.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.373+0000 7f9ddd400640 1 -- start start 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9ddd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 0x7f9dd815bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9ddd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9dd8158a10 0x7f9dd80b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9ddd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd80cfad0 con 0x7f9dd80b6230 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9ddd400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd80b66a0 con 0x7f9dd8158a10 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9ddd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd815c1d0 con 0x7f9dd8158630 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.374+0000 7f9dd7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9dd8158a10 0x7f9dd80b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f9dd8158a10 0x7f9dd80b5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49162/0 (socket says 172.21.15.192:49162) 2024-09-13T18:47:26.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 -- 172.21.15.192:0/3006399205 learned_addr learned my addr 172.21.15.192:0/3006399205 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7e00640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 0x7f9dd815bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 -- 172.21.15.192:0/3006399205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 msgr2=0x7f9dd815bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 0x7f9dd815bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 -- 172.21.15.192:0/3006399205 >> v1:172.21.15.194:6789/0 conn(0x7f9dd80b6230 legacy=0x7f9dd815e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7400640 1 -- 172.21.15.192:0/3006399205 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd80b3f40 con 0x7f9dd8158a10 2024-09-13T18:47:26.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.375+0000 7f9dd7e00640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 0x7f9dd815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:26.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.376+0000 7f9dd7400640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd80b5cf0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe96c7fa4025f7a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.376+0000 7f9dd6a00640 1 -- 172.21.15.192:0/3006399205 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4032440 con 0x7f9dd8158a10 2024-09-13T18:47:26.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.376+0000 7f9dd6a00640 1 -- 172.21.15.192:0/3006399205 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc40325a0 con 0x7f9dd8158a10 2024-09-13T18:47:26.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.376+0000 7f9dd6a00640 1 -- 172.21.15.192:0/3006399205 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4032930 con 0x7f9dd8158a10 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 -- 172.21.15.192:0/3006399205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 msgr2=0x7f9dd80b5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd80b5cf0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009870 tx=0x7f9dc402a200 comp rx=0 tx=0).stop 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 -- 172.21.15.192:0/3006399205 shutdown_connections 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd80b5cf0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3006399205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd8158630 0x7f9dd815bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 -- 172.21.15.192:0/3006399205 >> 172.21.15.192:0/3006399205 conn(0x7f9dd80b2910 msgr2=0x7f9dd80b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 -- 172.21.15.192:0/3006399205 shutdown_connections 2024-09-13T18:47:26.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.377+0000 7f9ddd400640 1 -- 172.21.15.192:0/3006399205 wait complete. 2024-09-13T18:47:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.378+0000 7f9ddd400640 1 Processor -- start 2024-09-13T18:47:26.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 -- start start 2024-09-13T18:47:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd80b6230 0x7f9dd813eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd8158630 0x7f9dd8154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd8142290 con 0x7f9dd8158a10 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81553a0 con 0x7f9dd8158630 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.379+0000 7f9ddd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd81504b0 con 0x7f9dd80b6230 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49178/0 (socket says 172.21.15.192:49178) 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 -- 172.21.15.192:0/3450656013 learned_addr learned my addr 172.21.15.192:0/3450656013 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9dd7400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd8158630 0x7f9dd8154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9dd7e00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd80b6230 0x7f9dd813eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 -- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd80b6230 msgr2=0x7f9dd813eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd80b6230 0x7f9dd813eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 -- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd8158630 msgr2=0x7f9dd8154e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd8158630 0x7f9dd8154e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 -- 172.21.15.192:0/3450656013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40094d0 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.380+0000 7f9ddca00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c7b0 tx=0x7f9dd000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.381+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0004b60 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.381+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dd0004cc0 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.381+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd000aa90 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.381+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd8141fb0 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.381+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd81528f0 con 0x7f9dd8158a10 2024-09-13T18:47:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.382+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd8152470 con 0x7f9dd8158a10 2024-09-13T18:47:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.383+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9dd000abf0 con 0x7f9dd8158a10 2024-09-13T18:47:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.384+0000 7f9dcfe00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 0x7f9db806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.384+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f9dd0089250 con 0x7f9dd8158a10 2024-09-13T18:47:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.384+0000 7f9dd7e00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 0x7f9db806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.384+0000 7f9dd7e00640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 0x7f9db806d0c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800ab60 tx=0x7f9dc8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:26.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.388+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9dd8152470 con 0x7f9dd8158a10 2024-09-13T18:47:26.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:26.556+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9dd8150670 con 0x7f9dd8158a10 2024-09-13T18:47:27.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.198+0000 7f9dcfe00640 1 -- 172.21.15.192:0/3450656013 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v188) v1 ==== 169+0+0 (secure 0 0 0) 0x7f9dd8150670 con 0x7f9dd8158a10 2024-09-13T18:47:27.201 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:47:27.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.201+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 msgr2=0x7f9db806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.201+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 0x7f9db806d0c0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800ab60 tx=0x7f9dc8008040 comp rx=0 tx=0).stop 2024-09-13T18:47:27.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.201+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 msgr2=0x7f9dd815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.204 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.201+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f9dd000c7b0 tx=0x7f9dd000cc70 comp rx=0 tx=0).stop 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 shutdown_connections 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9db806ac00 0x7f9db806d0c0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9dd8158a10 0x7f9dd815d490 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9dd8158630 0x7f9dd8154e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 --2- 172.21.15.192:0/3450656013 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9dd80b6230 0x7f9dd813eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 >> 172.21.15.192:0/3450656013 conn(0x7f9dd80b2910 msgr2=0x7f9dd815c380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 shutdown_connections 2024-09-13T18:47:27.205 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.202+0000 7f9ddd400640 1 -- 172.21.15.192:0/3450656013 wait complete. 2024-09-13T18:47:27.222 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:47:27.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.373+0000 7f2e78600640 1 Processor -- start 2024-09-13T18:47:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.374+0000 7f2e78600640 1 -- start start 2024-09-13T18:47:27.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e78600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 0x7f2e700b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e78600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e700b3bd0 0x7f2e7006e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e78600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7006cc40 con 0x7f2e701434c0 2024-09-13T18:47:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e78600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e700b4060 con 0x7f2e700b3bd0 2024-09-13T18:47:27.378 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e78600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e700ce770 con 0x7f2e7006c800 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e76600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e700b3bd0 0x7f2e7006e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e76600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2e700b3bd0 0x7f2e7006e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49180/0 (socket says 172.21.15.192:49180) 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.375+0000 7f2e76600640 1 -- 172.21.15.192:0/3731792864 learned_addr learned my addr 172.21.15.192:0/3731792864 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e75200640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 0x7f2e700b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e76600640 1 -- 172.21.15.192:0/3731792864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 msgr2=0x7f2e700b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e76600640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 0x7f2e700b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e76600640 1 -- 172.21.15.192:0/3731792864 >> v1:172.21.15.194:6789/0 conn(0x7f2e701434c0 legacy=0x7f2e7006a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e76600640 1 -- 172.21.15.192:0/3731792864 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7006b480 con 0x7f2e700b3bd0 2024-09-13T18:47:27.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.376+0000 7f2e75200640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 0x7f2e700b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e76600640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e700b3bd0 0x7f2e7006e920 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800bb40 tx=0x7f2e6802c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6efcfe878b62a3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e6fe00640 1 -- 172.21.15.192:0/3731792864 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032820 con 0x7f2e700b3bd0 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e6fe00640 1 -- 172.21.15.192:0/3731792864 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6802e040 con 0x7f2e700b3bd0 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e6fe00640 1 -- 172.21.15.192:0/3731792864 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68032ba0 con 0x7f2e700b3bd0 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e78600640 1 -- 172.21.15.192:0/3731792864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e700b3bd0 msgr2=0x7f2e7006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.377+0000 7f2e78600640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e700b3bd0 0x7f2e7006e920 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800bb40 tx=0x7f2e6802c960 comp rx=0 tx=0).stop 2024-09-13T18:47:27.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 -- 172.21.15.192:0/3731792864 shutdown_connections 2024-09-13T18:47:27.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e700b3bd0 0x7f2e7006e920 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 --2- 172.21.15.192:0/3731792864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e7006c800 0x7f2e700b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 -- 172.21.15.192:0/3731792864 >> 172.21.15.192:0/3731792864 conn(0x7f2e700b08f0 msgr2=0x7f2e700b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 -- 172.21.15.192:0/3731792864 shutdown_connections 2024-09-13T18:47:27.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.378+0000 7f2e78600640 1 -- 172.21.15.192:0/3731792864 wait complete. 2024-09-13T18:47:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.379+0000 7f2e78600640 1 Processor -- start 2024-09-13T18:47:27.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.379+0000 7f2e78600640 1 -- start start 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 0x7f2e701421c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e701434c0 0x7f2e70139670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e701f3c10 con 0x7f2e7006c800 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70159260 con 0x7f2e701434c0 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.380+0000 7f2e78600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e70142700 con 0x7f2e700b3bd0 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49186/0 (socket says 172.21.15.192:49186) 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 -- 172.21.15.192:0/120661244 learned_addr learned my addr 172.21.15.192:0/120661244 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75200640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 0x7f2e701421c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e76600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e701434c0 0x7f2e70139670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 -- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 msgr2=0x7f2e701421c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 0x7f2e701421c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 -- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e701434c0 msgr2=0x7f2e70139670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e701434c0 0x7f2e70139670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 -- 172.21.15.192:0/120661244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6800b770 con 0x7f2e7006c800 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75200640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 0x7f2e701421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e75c00640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c760 tx=0x7f2e6400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.381+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64003b70 con 0x7f2e7006c800 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.382+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64003cf0 con 0x7f2e7006c800 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.382+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e701594d0 con 0x7f2e7006c800 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.382+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6400aa30 con 0x7f2e7006c800 2024-09-13T18:47:27.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.382+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e70158e30 con 0x7f2e7006c800 2024-09-13T18:47:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.383+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e7006c2e0 con 0x7f2e7006c800 2024-09-13T18:47:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.384+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2e6400ab90 con 0x7f2e7006c800 2024-09-13T18:47:27.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.384+0000 7f2e6d600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 0x7f2e5006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.385+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2e64088cd0 con 0x7f2e7006c800 2024-09-13T18:47:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.385+0000 7f2e75200640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 0x7f2e5006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.385+0000 7f2e75200640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 0x7f2e5006d0c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006af70 tx=0x7f2e5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.389+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2e64054240 con 0x7f2e7006c800 2024-09-13T18:47:27.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.562+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2e7013db90 con 0x7f2e7006c800 2024-09-13T18:47:27.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.566+0000 7f2e6d600640 1 -- 172.21.15.192:0/120661244 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2e64003e60 con 0x7f2e7006c800 2024-09-13T18:47:27.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 msgr2=0x7f2e5006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 0x7f2e5006d0c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f2e7006af70 tx=0x7f2e5c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:27.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 msgr2=0x7f2e701f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f2e6400c760 tx=0x7f2e6400cc20 comp rx=0 tx=0).stop 2024-09-13T18:47:27.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 shutdown_connections 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e5006ac00 0x7f2e5006d0c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2e701434c0 0x7f2e70139670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2e700b3bd0 0x7f2e701421c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 --2- 172.21.15.192:0/120661244 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e7006c800 0x7f2e701f35e0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 >> 172.21.15.192:0/120661244 conn(0x7f2e700b08f0 msgr2=0x7f2e700afaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 shutdown_connections 2024-09-13T18:47:27.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.569+0000 7f2e78600640 1 -- 172.21.15.192:0/120661244 wait complete. 2024-09-13T18:47:27.587 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2024-09-13T18:47:27.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.737+0000 7fe49a400640 1 Processor -- start 2024-09-13T18:47:27.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.737+0000 7fe49a400640 1 -- start start 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe49a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe4940cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe49a400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4940ccec0 con 0x7fe494071810 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe49a400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe494071dd0 con 0x7fe494150480 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe49a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940cb770 con 0x7fe4940cc530 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe492a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe494071810 0x7fe4940b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37020/0 (socket says 172.21.15.192:37020) 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.738+0000 7fe492a00640 1 -- 172.21.15.192:0/4254596534 learned_addr learned my addr 172.21.15.192:0/4254596534 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe493e00640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe4940cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3737118274 0 0) 0x7fe4940ccec0 con 0x7fe494071810 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe478003440 con 0x7fe494071810 2024-09-13T18:47:27.745 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967847919 0 0) 0x7fe494071dd0 con 0x7fe494150480 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4940ccec0 con 0x7fe494150480 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4209396789 0 0) 0x7fe478003440 con 0x7fe494071810 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 msgr2=0x7fe4940cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe4940cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 >> v1:172.21.15.194:6789/0 conn(0x7fe494150480 legacy=0x7fe49415a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cba50 con 0x7fe494071810 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7fe480001670 con 0x7fe494071810 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 >> v1:172.21.15.192:6789/0 conn(0x7fe494071810 legacy=0x7fe4940b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe478008850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe478004100 0x7fe47800ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe47800d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940cb770 con 0x7fe478003c20 2024-09-13T18:47:27.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800dcd0 con 0x7fe478004100 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47800de90 con 0x7fe4940cc530 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.739+0000 7fe493400640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe478008850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe492a00640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe478004100 0x7fe47800ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493e00640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe47800d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493400640 1 -- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 msgr2=0x7fe47800d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493400640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe4940cc530 0x7fe47800d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493400640 1 -- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe478004100 msgr2=0x7fe47800ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493400640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe478004100 0x7fe47800ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.740+0000 7fe493400640 1 -- 172.21.15.192:0/4254596534 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe478003440 con 0x7fe478003c20 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.741+0000 7fe493400640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe478008850 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe4840018d0 tx=0x7fe4780036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e9fa59fec1c263 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.741+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840052d0 con 0x7fe478003c20 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.741+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484005430 con 0x7fe478003c20 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.741+0000 7fe492000640 1 -- 172.21.15.192:0/4254596534 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48402aca0 con 0x7fe478003c20 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 -- 172.21.15.192:0/4254596534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 msgr2=0x7fe478008850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 --2- 172.21.15.192:0/4254596534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe478008850 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7fe4840018d0 tx=0x7fe4780036f0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe493e00640 1 -- 172.21.15.192:0/4254596534 reap_dead start 2024-09-13T18:47:27.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 -- 172.21.15.192:0/4254596534 shutdown_connections 2024-09-13T18:47:27.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 -- 172.21.15.192:0/4254596534 >> 172.21.15.192:0/4254596534 conn(0x7fe4940ae960 msgr2=0x7fe49406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:27.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 -- 172.21.15.192:0/4254596534 shutdown_connections 2024-09-13T18:47:27.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.742+0000 7fe49a400640 1 -- 172.21.15.192:0/4254596534 wait complete. 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.743+0000 7fe49a400640 1 Processor -- start 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.744+0000 7fe49a400640 1 -- start start 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.744+0000 7fe49a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.744+0000 7fe49a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 0x7fe49414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe49a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 0x7fe494070160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe49a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494159570 con 0x7fe478003c20 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe49a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe494154770 con 0x7fe494150a70 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe49a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe494157000 con 0x7fe494154a10 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49204/0 (socket says 172.21.15.192:49204) 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 -- 172.21.15.192:0/3470603468 learned_addr learned my addr 172.21.15.192:0/3470603468 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe492a00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 0x7fe49414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.754 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493e00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 0x7fe494070160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 -- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 msgr2=0x7fe49414e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 0x7fe49414e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 -- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 msgr2=0x7fe494070160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 0x7fe494070160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 -- 172.21.15.192:0/3470603468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4941572e0 con 0x7fe478003c20 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe492a00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 0x7fe49414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493e00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 0x7fe494070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:27.755 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.745+0000 7fe493400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe48402a660 tx=0x7fe4840012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.746+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4840069e0 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.746+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484006b40 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.746+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484007040 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.746+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4941575c0 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.746+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49414ebf0 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.747+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe494067490 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.748+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe4840071a0 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.748+0000 7fe48b400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 0x7fe47406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.749+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4840a94f0 con 0x7fe478003c20 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.749+0000 7fe492a00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 0x7fe47406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:27.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.749+0000 7fe492a00640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 0x7fe47406d0c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe494153ca0 tx=0x7fe480009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:27.757 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.753+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe484074ae0 con 0x7fe478003c20 2024-09-13T18:47:27.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:27.984+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fe494067490 con 0x7fe478003c20 2024-09-13T18:47:28.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.204+0000 7fe48b400640 1 -- 172.21.15.192:0/3470603468 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v560) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe484078100 con 0x7fe478003c20 2024-09-13T18:47:28.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 msgr2=0x7fe47406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 0x7fe47406d0c0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe494153ca0 tx=0x7fe480009040 comp rx=0 tx=0).stop 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 msgr2=0x7fe494154070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7fe48402a660 tx=0x7fe4840012d0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 shutdown_connections 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47406ac00 0x7fe47406d0c0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe494150a70 0x7fe494070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe494154a10 0x7fe49414e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 --2- 172.21.15.192:0/3470603468 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe478003c20 0x7fe494154070 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.206+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 >> 172.21.15.192:0/3470603468 conn(0x7fe4940ae960 msgr2=0x7fe4940ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.207+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 shutdown_connections 2024-09-13T18:47:28.211 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.207+0000 7fe49a400640 1 -- 172.21.15.192:0/3470603468 wait complete. 2024-09-13T18:47:28.225 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2024-09-13T18:47:28.225 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2024-09-13T18:47:28.226 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:28.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.374+0000 7f0805a00640 1 Processor -- start 2024-09-13T18:47:28.377 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.375+0000 7f0805a00640 1 -- start start 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 0x7f0800159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 0x7f080015a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f080015af60 con 0x7f0800159b00 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f080006b7a0 con 0x7f080006bc30 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080015ac80 con 0x7f08000b3480 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f07ffe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f0800159b00 0x7f08000b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37032/0 (socket says 172.21.15.192:37032) 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f07ffe00640 1 -- 172.21.15.192:0/818021254 learned_addr learned my addr 172.21.15.192:0/818021254 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f0805000640 1 --2- 172.21.15.192:0/818021254 >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 0x7f080015a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.379 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f07ff400640 1 --2- 172.21.15.192:0/818021254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 0x7f0800159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.376+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 553473446 0 0) 0x7f080015af60 con 0x7f0800159b00 2024-09-13T18:47:28.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07e4005730 con 0x7f0800159b00 2024-09-13T18:47:28.380 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1761403958 0 0) 0x7f07e4005730 con 0x7f0800159b00 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07ff400640 1 -- 172.21.15.192:0/818021254 >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 msgr2=0x7f080015a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07ff400640 1 --2- 172.21.15.192:0/818021254 >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 0x7f080015a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07ff400640 1 -- 172.21.15.192:0/818021254 >> v1:172.21.15.192:6789/0 conn(0x7f0800159b00 legacy=0x7f08000b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f07ff400640 1 -- 172.21.15.192:0/818021254 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f080006b150 con 0x7f08000b3480 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.377+0000 7f0805000640 1 --2- 172.21.15.192:0/818021254 >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 0x7f080015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:28.381 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.378+0000 7f07ff400640 1 --2- 172.21.15.192:0/818021254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 0x7f0800159ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0097a0 tx=0x7f07ec02a110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478296407ea3c018 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.378+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f0001670 con 0x7f08000b3480 2024-09-13T18:47:28.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.378+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec02aba0 con 0x7f08000b3480 2024-09-13T18:47:28.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.378+0000 7f07fea00640 1 -- 172.21.15.192:0/818021254 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec032440 con 0x7f08000b3480 2024-09-13T18:47:28.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 -- 172.21.15.192:0/818021254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 msgr2=0x7f0800159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.382 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 --2- 172.21.15.192:0/818021254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 0x7f0800159ee0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07ec0097a0 tx=0x7f07ec02a110 comp rx=0 tx=0).stop 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 -- 172.21.15.192:0/818021254 shutdown_connections 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 --2- 172.21.15.192:0/818021254 >> v2:172.21.15.194:3300/0 conn(0x7f080006bc30 0x7f080015a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 --2- 172.21.15.192:0/818021254 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08000b3480 0x7f0800159ee0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 -- 172.21.15.192:0/818021254 >> 172.21.15.192:0/818021254 conn(0x7f08000736d0 msgr2=0x7f08000b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 -- 172.21.15.192:0/818021254 shutdown_connections 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.379+0000 7f0805a00640 1 -- 172.21.15.192:0/818021254 wait complete. 2024-09-13T18:47:28.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.381+0000 7f0805a00640 1 Processor -- start 2024-09-13T18:47:28.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.381+0000 7f0805a00640 1 -- start start 2024-09-13T18:47:28.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080006bc30 0x7f080014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0800159b00 0x7f080014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080015b020 con 0x7f08000b3480 2024-09-13T18:47:28.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080014ffb0 con 0x7f0800159b00 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f080014d870 con 0x7f080006bc30 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49206/0 (socket says 172.21.15.192:49206) 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 -- 172.21.15.192:0/4084122757 learned_addr learned my addr 172.21.15.192:0/4084122757 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ffe00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080006bc30 0x7f080014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f0805000640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0800159b00 0x7f080014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 -- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080006bc30 msgr2=0x7f080014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080006bc30 0x7f080014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 -- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0800159b00 msgr2=0x7f080014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0800159b00 0x7f080014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.382+0000 7f07ff400640 1 -- 172.21.15.192:0/4084122757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009a70 con 0x7f08000b3480 2024-09-13T18:47:28.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f07ff400640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f07ec035040 tx=0x7f07ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec03d830 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec03d990 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07ec009400 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec03dd20 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.383+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f080014fd10 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.384+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0800067680 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.385+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f07ec039040 con 0x7f08000b3480 2024-09-13T18:47:28.389 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.386+0000 7f07f7e00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 0x7f07e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.386+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f07ec0a9800 con 0x7f08000b3480 2024-09-13T18:47:28.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.386+0000 7f07ffe00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 0x7f07e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.387+0000 7f07ffe00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 0x7f07e006d0c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f07f00019e0 tx=0x7f07f0001970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.390+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f07ec074e10 con 0x7f08000b3480 2024-09-13T18:47:28.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.559+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08000b2d70 con 0x7f08000b3480 2024-09-13T18:47:28.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.560+0000 7f07f7e00640 1 -- 172.21.15.192:0/4084122757 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v188) v1 ==== 74+0+13059 (secure 0 0 0) 0x7f07ec006e10 con 0x7f08000b3480 2024-09-13T18:47:28.563 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:28.563 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":188,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:27.192578+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.192:6837/2926352862":"2024-09-14T18:47:24.179290+0000","172.21.15.192:6836/2926352862":"2024-09-14T18:47:24.179290+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 msgr2=0x7f07e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 0x7f07e006d0c0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f07f00019e0 tx=0x7f07f0001970 comp rx=0 tx=0).stop 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 msgr2=0x7f080014d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f07ec035040 tx=0x7f07ec0046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 shutdown_connections 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f07e006ac00 0x7f07e006d0c0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0800159b00 0x7f080014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08000b3480 0x7f080014d330 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 --2- 172.21.15.192:0/4084122757 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f080006bc30 0x7f080014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 >> 172.21.15.192:0/4084122757 conn(0x7f08000736d0 msgr2=0x7f08000cc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 shutdown_connections 2024-09-13T18:47:28.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.562+0000 7f0805a00640 1 -- 172.21.15.192:0/4084122757 wait complete. 2024-09-13T18:47:28.581 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:28.582 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:28.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.734+0000 7f9609200640 1 Processor -- start 2024-09-13T18:47:28.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.734+0000 7f9609200640 1 -- start start 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9609200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f960406c800 0x7f96040b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9609200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960406cc70 con 0x7f96041434c0 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9609200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960406b480 con 0x7f96040b3bd0 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9609200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96040ce770 con 0x7f960406c800 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9601e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f96041434c0 0x7f960406a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37042/0 (socket says 172.21.15.192:37042) 2024-09-13T18:47:28.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.735+0000 7f9601e00640 1 -- 172.21.15.192:0/3578525378 learned_addr learned my addr 172.21.15.192:0/3578525378 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f95fbe00640 1 --2- 172.21.15.192:0/3578525378 >> v2:172.21.15.194:3300/0 conn(0x7f960406c800 0x7f96040b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156177331 0 0) 0x7f960406cc70 con 0x7f96041434c0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95e8003520 con 0x7f96041434c0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254435760 0 0) 0x7f960406b480 con 0x7f96040b3bd0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960406cc70 con 0x7f96040b3bd0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2105679096 0 0) 0x7f95e8003520 con 0x7f96041434c0 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 >> v2:172.21.15.194:3300/0 conn(0x7f960406c800 msgr2=0x7f96040b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 --2- 172.21.15.192:0/3578525378 >> v2:172.21.15.194:3300/0 conn(0x7f960406c800 0x7f96040b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 >> v1:172.21.15.194:6789/0 conn(0x7f96040b3bd0 legacy=0x7f960406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.741 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960406b760 con 0x7f96041434c0 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f95f40015f0 con 0x7f96041434c0 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 >> v1:172.21.15.192:6789/0 conn(0x7f96041434c0 legacy=0x7f960406a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e8003b30 0x7f95e8003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 0x7f95e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e8005180 0x7f95e800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96040ce770 con 0x7f95e80047c0 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95e800e2e0 con 0x7f95e8003b30 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.736+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95e800e4a0 con 0x7f95e8005180 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 0x7f95e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f9601e00640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e8003b30 0x7f95e8003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f9602800640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e8005180 0x7f95e800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 -- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e8005180 msgr2=0x7f95e800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e8005180 0x7f95e800db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 -- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e8003b30 msgr2=0x7f95e8003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e8003b30 0x7f95e8003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f95fbe00640 1 -- 172.21.15.192:0/3578525378 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e8003520 con 0x7f95e80047c0 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f9602800640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95e8005180 0x7f95e800db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.737+0000 7f9602800640 1 -- 172.21.15.192:0/3578525378 reap_dead start 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.738+0000 7f95fbe00640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 0x7f95e8004c40 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009ac0 tx=0x7f95e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d041f401f2f0f4b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.738+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec031400 con 0x7f95e80047c0 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.738+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec02d050 con 0x7f95e80047c0 2024-09-13T18:47:28.743 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.738+0000 7f9601400640 1 -- 172.21.15.192:0/3578525378 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec031780 con 0x7f95e80047c0 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 -- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 msgr2=0x7f95e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 0x7f95e8004c40 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009ac0 tx=0x7f95e80057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 -- 172.21.15.192:0/3578525378 shutdown_connections 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 --2- 172.21.15.192:0/3578525378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95e80047c0 0x7f95e8004c40 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 -- 172.21.15.192:0/3578525378 >> 172.21.15.192:0/3578525378 conn(0x7f96040b08f0 msgr2=0x7f96040b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 -- 172.21.15.192:0/3578525378 shutdown_connections 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.739+0000 7f9609200640 1 -- 172.21.15.192:0/3578525378 wait complete. 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.740+0000 7f9609200640 1 Processor -- start 2024-09-13T18:47:28.746 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 -- start start 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e80047c0 0x7f96041562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9604139440 0x7f96040707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9604157570 con 0x7f960415ab20 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960415b4e0 con 0x7f95e80047c0 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.741+0000 7f9609200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96041398c0 con 0x7f9604139440 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49224/0 (socket says 172.21.15.192:49224) 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 -- 172.21.15.192:0/1917087078 learned_addr learned my addr 172.21.15.192:0/1917087078 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f95fbe00640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9604139440 0x7f96040707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9601e00640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e80047c0 0x7f96041562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 -- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9604139440 msgr2=0x7f96040707d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9604139440 0x7f96040707d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 -- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e80047c0 msgr2=0x7f96041562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e80047c0 0x7f96041562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.742+0000 7f9602800640 1 -- 172.21.15.192:0/1917087078 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96041568f0 con 0x7f960415ab20 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f9602800640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f96040cbe40 tx=0x7f95fc00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc017070 con 0x7f960415ab20 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00ee50 con 0x7f960415ab20 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9604156bd0 con 0x7f960415ab20 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc003b80 con 0x7f960415ab20 2024-09-13T18:47:28.748 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.743+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9604157190 con 0x7f960415ab20 2024-09-13T18:47:28.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.744+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9604157350 con 0x7f960415ab20 2024-09-13T18:47:28.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.745+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95fc003ce0 con 0x7f960415ab20 2024-09-13T18:47:28.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.746+0000 7f95fa000640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 0x7f95e006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:28.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.746+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f95fc088440 con 0x7f960415ab20 2024-09-13T18:47:28.749 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.746+0000 7f9601e00640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 0x7f95e006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:28.750 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.747+0000 7f9601e00640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 0x7f95e006d0f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f96040704e0 tx=0x7f95f4001da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:28.753 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.750+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f95fc0539d0 con 0x7f960415ab20 2024-09-13T18:47:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.917+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f96040cc7d0 con 0x7f960415ab20 2024-09-13T18:47:28.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.918+0000 7f95fa000640 1 -- 172.21.15.192:0/1917087078 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v188) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95fc056ff0 con 0x7f960415ab20 2024-09-13T18:47:28.921 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 msgr2=0x7f95e006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 0x7f95e006d0f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f96040704e0 tx=0x7f95f4001da0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 msgr2=0x7f960415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f96040cbe40 tx=0x7f95fc00ec00 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 shutdown_connections 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95e006ac30 0x7f95e006d0f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f960415ab20 0x7f960415afa0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9604139440 0x7f96040707d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 --2- 172.21.15.192:0/1917087078 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95e80047c0 0x7f96041562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 >> 172.21.15.192:0/1917087078 conn(0x7f96040b08f0 msgr2=0x7f96040ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 shutdown_connections 2024-09-13T18:47:28.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:28.920+0000 7f9609200640 1 -- 172.21.15.192:0/1917087078 wait complete. 2024-09-13T18:47:28.938 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-13T18:47:29.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.087+0000 7fb0fa400640 1 Processor -- start 2024-09-13T18:47:29.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.087+0000 7fb0fa400640 1 -- start start 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.088+0000 7fb0fa400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb0f413fe30 0x7fb0f40b5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.088+0000 7fb0fa400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.088+0000 7fb0fa400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f40d0970 con 0x7fb0f40cfe10 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.088+0000 7fb0fa400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40b5f00 con 0x7fb0f40b5a70 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.088+0000 7fb0fa400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f40d0690 con 0x7fb0f413fe30 2024-09-13T18:47:29.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f9000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb0f413fe30 0x7fb0f40b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49230/0 (socket says 172.21.15.192:49230) 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 -- 172.21.15.192:0/3786249356 learned_addr learned my addr 172.21.15.192:0/3786249356 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 -- 172.21.15.192:0/3786249356 >> v2:172.21.15.194:3300/0 conn(0x7fb0f413fe30 msgr2=0x7fb0f40b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 --2- 172.21.15.192:0/3786249356 >> v2:172.21.15.194:3300/0 conn(0x7fb0f413fe30 0x7fb0f40b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 -- 172.21.15.192:0/3786249356 >> v1:172.21.15.194:6789/0 conn(0x7fb0f40cfe10 legacy=0x7fb0f4142410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.089+0000 7fb0f3e00640 1 -- 172.21.15.192:0/3786249356 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4140510 con 0x7fb0f40b5a70 2024-09-13T18:47:29.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.090+0000 7fb0f3e00640 1 --2- 172.21.15.192:0/3786249356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4071d60 tx=0x7fb0e002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6faeda7e425b9edf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.090+0000 7fb0f3400640 1 -- 172.21.15.192:0/3786249356 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0032440 con 0x7fb0f40b5a70 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.090+0000 7fb0f3400640 1 -- 172.21.15.192:0/3786249356 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e00325a0 con 0x7fb0f40b5a70 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.090+0000 7fb0f3400640 1 -- 172.21.15.192:0/3786249356 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e0032930 con 0x7fb0f40b5a70 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 -- 172.21.15.192:0/3786249356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f40b5a70 msgr2=0x7fb0f40cf8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3786249356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4071d60 tx=0x7fb0e002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 -- 172.21.15.192:0/3786249356 shutdown_connections 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3786249356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f40b5a70 0x7fb0f40cf8d0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3786249356 >> v2:172.21.15.194:3300/0 conn(0x7fb0f413fe30 0x7fb0f40b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 -- 172.21.15.192:0/3786249356 >> 172.21.15.192:0/3786249356 conn(0x7fb0f4071920 msgr2=0x7fb0f40b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:29.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 -- 172.21.15.192:0/3786249356 shutdown_connections 2024-09-13T18:47:29.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.091+0000 7fb0fa400640 1 -- 172.21.15.192:0/3786249356 wait complete. 2024-09-13T18:47:29.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.093+0000 7fb0fa400640 1 Processor -- start 2024-09-13T18:47:29.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.093+0000 7fb0fa400640 1 -- start start 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40b5a70 0x7fb0f413e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0f40cfe10 0x7fb0f413ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f4160680 con 0x7fb0f413fe30 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41600c0 con 0x7fb0f40b5a70 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0fa400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f41603a0 con 0x7fb0f40cfe10 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0f9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0f9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:49232/0 (socket says 172.21.15.192:49232) 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0f9a00640 1 -- 172.21.15.192:0/3234699829 learned_addr learned my addr 172.21.15.192:0/3234699829 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0f9000640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40b5a70 0x7fb0f413e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.094+0000 7fb0f3e00640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0f40cfe10 0x7fb0f413ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 -- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0f40cfe10 msgr2=0x7fb0f413ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0f40cfe10 0x7fb0f413ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 -- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40b5a70 msgr2=0x7fb0f413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40b5a70 0x7fb0f413e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 -- 172.21.15.192:0/3234699829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e00094d0 con 0x7fb0f413fe30 2024-09-13T18:47:29.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f9a00640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c7a0 tx=0x7fb0ec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec003b70 con 0x7fb0f413fe30 2024-09-13T18:47:29.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec003cf0 con 0x7fb0f413fe30 2024-09-13T18:47:29.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f41359f0 con 0x7fb0f413fe30 2024-09-13T18:47:29.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ec003ea0 con 0x7fb0f413fe30 2024-09-13T18:47:29.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.095+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f415da60 con 0x7fb0f413fe30 2024-09-13T18:47:29.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.096+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f413f650 con 0x7fb0f413fe30 2024-09-13T18:47:29.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.097+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb0ec00aa90 con 0x7fb0f413fe30 2024-09-13T18:47:29.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.098+0000 7fb0f0c00640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 0x7fb0d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:29.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.098+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb0ec088e20 con 0x7fb0f413fe30 2024-09-13T18:47:29.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.098+0000 7fb0f9000640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 0x7fb0d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:29.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.099+0000 7fb0f9000640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 0x7fb0d406d0c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009aa0 tx=0x7fb0e8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:29.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.103+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb0ec054310 con 0x7fb0f413fe30 2024-09-13T18:47:29.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:29.336+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7fb0f40d01f0 con 0x7fb0f413fe30 2024-09-13T18:47:30.214 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.211+0000 7fb0f0c00640 1 -- 172.21.15.192:0/3234699829 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v562) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb0ec057930 con 0x7fb0f413fe30 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.213+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 msgr2=0x7fb0d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.213+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 0x7fb0d406d0c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009aa0 tx=0x7fb0e8009190 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 msgr2=0x7fb0f415d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fb0ec00c7a0 tx=0x7fb0ec00cc60 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 shutdown_connections 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb0d406ac00 0x7fb0d406d0c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0f413fe30 0x7fb0f415d520 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb0f40cfe10 0x7fb0f413ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 --2- 172.21.15.192:0/3234699829 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb0f40b5a70 0x7fb0f413e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 >> 172.21.15.192:0/3234699829 conn(0x7fb0f4071920 msgr2=0x7fb0f413aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 shutdown_connections 2024-09-13T18:47:30.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.214+0000 7fb0fa400640 1 -- 172.21.15.192:0/3234699829 wait complete. 2024-09-13T18:47:30.234 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-13T18:47:30.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.391+0000 7fa15ea00640 1 Processor -- start 2024-09-13T18:47:30.394 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.391+0000 7fa15ea00640 1 -- start start 2024-09-13T18:47:30.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 0x7fa1580b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa158160ac0 0x7fa158160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa1580adc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.396 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1580b21e0 con 0x7fa158160ac0 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1580b1bf0 con 0x7fa15815a910 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.392+0000 7fa15ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1580ae1d0 con 0x7fa1580ad840 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa158160ac0 0x7fa158160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa158160ac0 0x7fa158160f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35964/0 (socket says 172.21.15.192:35964) 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 -- 172.21.15.192:0/4269877861 learned_addr learned my addr 172.21.15.192:0/4269877861 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157e00640 1 --2- 172.21.15.192:0/4269877861 >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 0x7fa1580b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa15ca00640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa1580adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 -- 172.21.15.192:0/4269877861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 msgr2=0x7fa1580adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa1580adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 -- 172.21.15.192:0/4269877861 >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 msgr2=0x7fa1580b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 --2- 172.21.15.192:0/4269877861 >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 0x7fa1580b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157400640 1 -- 172.21.15.192:0/4269877861 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1580b2b40 con 0x7fa158160ac0 2024-09-13T18:47:30.397 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.393+0000 7fa157e00640 1 --2- 172.21.15.192:0/4269877861 >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 0x7fa1580b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.394+0000 7fa157400640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa158160ac0 0x7fa158160f30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b18c0 tx=0x7fa14402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5640fbd0afa61c7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.394+0000 7fa156a00640 1 -- 172.21.15.192:0/4269877861 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa14402ae90 con 0x7fa158160ac0 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa156a00640 1 -- 172.21.15.192:0/4269877861 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa144032440 con 0x7fa158160ac0 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa156a00640 1 -- 172.21.15.192:0/4269877861 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1440327d0 con 0x7fa158160ac0 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 -- 172.21.15.192:0/4269877861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa158160ac0 msgr2=0x7fa158160f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa158160ac0 0x7fa158160f30 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fa1580b18c0 tx=0x7fa14402a140 comp rx=0 tx=0).stop 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 -- 172.21.15.192:0/4269877861 shutdown_connections 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa1580adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 --2- 172.21.15.192:0/4269877861 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa158160ac0 0x7fa158160f30 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 --2- 172.21.15.192:0/4269877861 >> v2:172.21.15.194:3300/0 conn(0x7fa15815a910 0x7fa1580b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 -- 172.21.15.192:0/4269877861 >> 172.21.15.192:0/4269877861 conn(0x7fa1580b08f0 msgr2=0x7fa1580b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 -- 172.21.15.192:0/4269877861 shutdown_connections 2024-09-13T18:47:30.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.395+0000 7fa15ea00640 1 -- 172.21.15.192:0/4269877861 wait complete. 2024-09-13T18:47:30.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.397+0000 7fa15ea00640 1 Processor -- start 2024-09-13T18:47:30.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.397+0000 7fa15ea00640 1 -- start start 2024-09-13T18:47:30.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa158069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa158160ac0 0x7fa15815ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158071780 con 0x7fa15815a910 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158153d50 con 0x7fa158160ac0 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ea00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa15815c010 con 0x7fa1580ad840 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35976/0 (socket says 172.21.15.192:35976) 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 -- 172.21.15.192:0/3923625359 learned_addr learned my addr 172.21.15.192:0/3923625359 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa15ca00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa158160ac0 0x7fa15815ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157e00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa158069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 -- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 msgr2=0x7fa158069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa158069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.402 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 -- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa158160ac0 msgr2=0x7fa15815ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa158160ac0 0x7fa15815ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.398+0000 7fa157400640 1 -- 172.21.15.192:0/3923625359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1440094d0 con 0x7fa15815a910 2024-09-13T18:47:30.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa157400640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa14402a180 tx=0x7fa1440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144030850 con 0x7fa15815a910 2024-09-13T18:47:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1440309b0 con 0x7fa15815a910 2024-09-13T18:47:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa144030d60 con 0x7fa15815a910 2024-09-13T18:47:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15806a990 con 0x7fa15815a910 2024-09-13T18:47:30.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.399+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15815c260 con 0x7fa15815a910 2024-09-13T18:47:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.400+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580b2930 con 0x7fa15815a910 2024-09-13T18:47:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.401+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa144039040 con 0x7fa15815a910 2024-09-13T18:47:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.402+0000 7fa14fe00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 0x7fa13806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.402+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa1440a9bc0 con 0x7fa15815a910 2024-09-13T18:47:30.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.402+0000 7fa157e00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 0x7fa13806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:30.406 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.403+0000 7fa157e00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 0x7fa13806d0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa148008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:30.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.406+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa144075090 con 0x7fa15815a910 2024-09-13T18:47:30.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.573+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa15815acf0 con 0x7fa15815a910 2024-09-13T18:47:30.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.577+0000 7fa14fe00640 1 -- 172.21.15.192:0/3923625359 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa1440786b0 con 0x7fa15815a910 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 msgr2=0x7fa13806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 0x7fa13806d0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fa148006fd0 tx=0x7fa148008040 comp rx=0 tx=0).stop 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 msgr2=0x7fa158153810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fa14402a180 tx=0x7fa1440046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 shutdown_connections 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa13806ac00 0x7fa13806d0c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa158160ac0 0x7fa15815ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa15815a910 0x7fa158153810 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 --2- 172.21.15.192:0/3923625359 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa1580ad840 0x7fa158069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:30.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 >> 172.21.15.192:0/3923625359 conn(0x7fa1580b08f0 msgr2=0x7fa1580b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:30.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 shutdown_connections 2024-09-13T18:47:30.585 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:30.580+0000 7fa15ea00640 1 -- 172.21.15.192:0/3923625359 wait complete. 2024-09-13T18:47:30.598 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:47:30.598 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:47:30.681 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:47:30.779 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:47:30.779 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:30.779 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:30.814 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:47:30.814 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:30.815 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:30.851 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:47:30.851 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:30.852 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:30.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:47:30.890 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:30.890 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:30.928 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:47:30.928 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-13T18:47:30.928 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:31.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.080+0000 7f98ae400640 1 Processor -- start 2024-09-13T18:47:31.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.080+0000 7f98ae400640 1 -- start start 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ae400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 0x7f98a8070b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ae400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f98a80b3600 0x7f98a80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ae400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98a806f830 con 0x7f98a806bca0 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ae400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a80b3fb0 con 0x7f98a80b3600 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ae400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98a806fa80 con 0x7f98a81592d0 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ada00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f98a806bca0 0x7f98a806c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36256/0 (socket says 172.21.15.192:36256) 2024-09-13T18:47:31.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98a7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f98a80b3600 0x7f98a80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ada00640 1 -- 172.21.15.192:0/1411817513 learned_addr learned my addr 172.21.15.192:0/1411817513 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:31.085 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.081+0000 7f98ad000640 1 --2- 172.21.15.192:0/1411817513 >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 0x7f98a8070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98a7e00640 1 -- 172.21.15.192:0/1411817513 >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 msgr2=0x7f98a8070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98a7e00640 1 --2- 172.21.15.192:0/1411817513 >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 0x7f98a8070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98a7e00640 1 -- 172.21.15.192:0/1411817513 >> v1:172.21.15.192:6789/0 conn(0x7f98a806bca0 legacy=0x7f98a806c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98a7e00640 1 -- 172.21.15.192:0/1411817513 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a806fd60 con 0x7f98a80b3600 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98ad000640 1 --2- 172.21.15.192:0/1411817513 >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 0x7f98a8070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.082+0000 7f98a7400640 1 -- 172.21.15.192:0/1411817513 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260529887 0 0) 0x7f98a806f830 con 0x7f98a806bca0 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.083+0000 7f98a7e00640 1 --2- 172.21.15.192:0/1411817513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a80b3a70 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b41c0 tx=0x7f989402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49e4a174dab6dd37 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.083+0000 7f98a7400640 1 -- 172.21.15.192:0/1411817513 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894032440 con 0x7f98a80b3600 2024-09-13T18:47:31.086 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.083+0000 7f98a7400640 1 -- 172.21.15.192:0/1411817513 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98940325a0 con 0x7f98a80b3600 2024-09-13T18:47:31.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.083+0000 7f98a7400640 1 -- 172.21.15.192:0/1411817513 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894032930 con 0x7f98a80b3600 2024-09-13T18:47:31.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 -- 172.21.15.192:0/1411817513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 msgr2=0x7f98a80b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.087 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 --2- 172.21.15.192:0/1411817513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a80b3a70 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f98a80b41c0 tx=0x7f989402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 -- 172.21.15.192:0/1411817513 shutdown_connections 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 --2- 172.21.15.192:0/1411817513 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a80b3a70 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 --2- 172.21.15.192:0/1411817513 >> v2:172.21.15.194:3300/0 conn(0x7f98a81592d0 0x7f98a8070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 -- 172.21.15.192:0/1411817513 >> 172.21.15.192:0/1411817513 conn(0x7f98a80736d0 msgr2=0x7f98a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 -- 172.21.15.192:0/1411817513 shutdown_connections 2024-09-13T18:47:31.088 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.084+0000 7f98ae400640 1 -- 172.21.15.192:0/1411817513 wait complete. 2024-09-13T18:47:31.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.085+0000 7f98ae400640 1 Processor -- start 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.085+0000 7f98ae400640 1 -- start start 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 0x7f98a80cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 0x7f98a81f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a8149cf0 con 0x7f98a80b3600 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81490e0 con 0x7f98a81592d0 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.086+0000 7f98ae400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98a81493c0 con 0x7f98a806bca0 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:35982/0 (socket says 172.21.15.192:35982) 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 -- 172.21.15.192:0/3224915413 learned_addr learned my addr 172.21.15.192:0/3224915413 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:31.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98ada00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 0x7f98a81f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98ad000640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 0x7f98a80cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 -- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 msgr2=0x7f98a80cc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 0x7f98a80cc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 -- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 msgr2=0x7f98a81f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 0x7f98a81f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 -- 172.21.15.192:0/3224915413 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894009400 con 0x7f98a80b3600 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98ada00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 0x7f98a81f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98ad000640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 0x7f98a80cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.087+0000 7f98a7e00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f98940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.088+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894004230 con 0x7f98a80b3600 2024-09-13T18:47:31.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.088+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894004390 con 0x7f98a80b3600 2024-09-13T18:47:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.088+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894030b20 con 0x7f98a80b3600 2024-09-13T18:47:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.088+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a81496a0 con 0x7f98a80b3600 2024-09-13T18:47:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.088+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a80cc630 con 0x7f98a80b3600 2024-09-13T18:47:31.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.089+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98a8149ea0 con 0x7f98a80b3600 2024-09-13T18:47:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.090+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9894039050 con 0x7f98a80b3600 2024-09-13T18:47:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.091+0000 7f98a4c00640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 0x7f988806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.091+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98940a99b0 con 0x7f98a80b3600 2024-09-13T18:47:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.091+0000 7f98ad000640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 0x7f988806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.091+0000 7f98ad000640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 0x7f988806d0f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f989c006fd0 tx=0x7f989c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.095+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f98a8149ea0 con 0x7f98a80b3600 2024-09-13T18:47:31.300 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.297+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98a8149ea0 con 0x7f98a80b3600 2024-09-13T18:47:31.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.298+0000 7f98a4c00640 1 -- 172.21.15.192:0/3224915413 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 80 v80) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f98a8149ea0 con 0x7f98a80b3600 2024-09-13T18:47:31.301 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:31.301 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":80,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8065,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/3670542780","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":3670542780},{"type":"v1","addr":"172.21.15.194:6834","nonce":3670542780}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8068,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/2043225562","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2043225562},{"type":"v1","addr":"172.21.15.194:6835","nonce":2043225562}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8583,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6835/1416938359","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":1416938359},{"type":"v1","addr":"172.21.15.192:6835","nonce":1416938359}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8913,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2902303871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6836","nonce":2902303871},{"type":"v1","addr":"172.21.15.192:6837","nonce":2902303871}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":80}],"filesystems":[]} 2024-09-13T18:47:31.301 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 80 2024-09-13T18:47:31.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 msgr2=0x7f988806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 0x7f988806d0f0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f989c006fd0 tx=0x7f989c008040 comp rx=0 tx=0).stop 2024-09-13T18:47:31.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 msgr2=0x7f98a8151530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f9894000c00 tx=0x7f98940046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 shutdown_connections 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988806ac30 0x7f988806d0f0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98a81592d0 0x7f98a81f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98a80b3600 0x7f98a8151530 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 --2- 172.21.15.192:0/3224915413 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98a806bca0 0x7f98a80cc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 >> 172.21.15.192:0/3224915413 conn(0x7f98a80736d0 msgr2=0x7f98a8154350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 shutdown_connections 2024-09-13T18:47:31.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.300+0000 7f98ae400640 1 -- 172.21.15.192:0/3224915413 wait complete. 2024-09-13T18:47:31.319 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-13T18:47:31.319 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-13T18:47:31.319 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:47:31.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:47:31.320 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-13T18:47:31.320 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-13T18:47:31.320 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:47:31.320 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:47:31.320 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-13T18:47:31.320 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-13T18:47:31.321 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:47:31.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:47:31.321 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-13T18:47:31.321 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-13T18:47:31.321 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:47:31.321 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:47:31.335 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:47:31.335 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-13T18:47:31.336 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:47:31.336 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-13T18:47:31.337 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:47:31.338 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-13T18:47:31.338 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:47:31.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-13T18:47:31.381 INFO:tasks.ceph.mds.a:Started 2024-09-13T18:47:31.381 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.382 INFO:tasks.ceph.mds.b:Started 2024-09-13T18:47:31.383 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.383 INFO:tasks.ceph.mds.c:Started 2024-09-13T18:47:31.383 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.385 INFO:tasks.ceph.mds.d:Started 2024-09-13T18:47:31.385 DEBUG:teuthology.parallel:result is None 2024-09-13T18:47:31.385 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-13T18:47:31.512 INFO:tasks.ceph.mds.a.smithi192.stdout:starting mds.a at 2024-09-13T18:47:31.512 INFO:tasks.ceph.mds.c.smithi192.stdout:starting mds.c at 2024-09-13T18:47:31.514 INFO:tasks.ceph.mds.d.smithi194.stdout:starting mds.d at 2024-09-13T18:47:31.515 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:47:31.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.548+0000 7fe4a1000640 1 Processor -- start 2024-09-13T18:47:31.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.549+0000 7fe4a1000640 1 -- start start 2024-09-13T18:47:31.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c146610 0x7fe49c0ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe4a1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe49c0b2780 0x7fe49c0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe4a1000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49c0ae770 con 0x7fe49c0afd80 2024-09-13T18:47:31.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe4a1000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49c0cd920 con 0x7fe49c0b2780 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe4a1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c0cdb30 con 0x7fe49c146610 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe49c0b2780 0x7fe49c0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe49c0b2780 0x7fe49c0ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36046/0 (socket says 172.21.15.192:36046) 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 -- 172.21.15.192:0/2482718606 learned_addr learned my addr 172.21.15.192:0/2482718606 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499e00640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c146610 0x7fe49c0ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 -- 172.21.15.192:0/2482718606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c146610 msgr2=0x7fe49c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c146610 0x7fe49c0ce2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.550+0000 7fe499400640 1 -- 172.21.15.192:0/2482718606 >> v1:172.21.15.194:6789/0 conn(0x7fe49c0afd80 legacy=0x7fe49c0b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.551+0000 7fe498a00640 1 -- 172.21.15.192:0/2482718606 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085369214 0 0) 0x7fe49c0ae770 con 0x7fe49c0afd80 2024-09-13T18:47:31.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.551+0000 7fe499400640 1 -- 172.21.15.192:0/2482718606 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe49c0ae1b0 con 0x7fe49c0b2780 2024-09-13T18:47:31.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe499400640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c0ad840 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7e51f45e748231 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe498a00640 1 -- 172.21.15.192:0/2482718606 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488032440 con 0x7fe49c0b2780 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe498a00640 1 -- 172.21.15.192:0/2482718606 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4880325a0 con 0x7fe49c0b2780 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe498a00640 1 -- 172.21.15.192:0/2482718606 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488032930 con 0x7fe49c0b2780 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 -- 172.21.15.192:0/2482718606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 msgr2=0x7fe49c0ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c0ad840 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7fe488009870 tx=0x7fe48802a270 comp rx=0 tx=0).stop 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 -- 172.21.15.192:0/2482718606 shutdown_connections 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c0ad840 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 --2- 172.21.15.192:0/2482718606 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c146610 0x7fe49c0ce2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.552+0000 7fe4a1000640 1 -- 172.21.15.192:0/2482718606 >> 172.21.15.192:0/2482718606 conn(0x7fe49c0ae960 msgr2=0x7fe49c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:31.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.553+0000 7fe4a1000640 1 -- 172.21.15.192:0/2482718606 shutdown_connections 2024-09-13T18:47:31.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.553+0000 7fe4a1000640 1 -- 172.21.15.192:0/2482718606 wait complete. 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.554+0000 7fe4a1000640 1 Processor -- start 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.554+0000 7fe4a1000640 1 -- start start 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 0x7fe49c140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe49c146610 0x7fe49c06af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c140ca0 con 0x7fe49c0b2780 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1e8fd0 con 0x7fe49c146610 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe4a1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49c1f28b0 con 0x7fe49c0afd80 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe499400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe499400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36048/0 (socket says 172.21.15.192:36048) 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe499400640 1 -- 172.21.15.192:0/1492550765 learned_addr learned my addr 172.21.15.192:0/1492550765 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:31.559 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.555+0000 7fe49a800640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe49c146610 0x7fe49c06af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499e00640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 0x7fe49c140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 -- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 msgr2=0x7fe49c140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 0x7fe49c140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 -- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe49c146610 msgr2=0x7fe49c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe49c146610 0x7fe49c06af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 -- 172.21.15.192:0/1492550765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4880094d0 con 0x7fe49c0b2780 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499e00640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 0x7fe49c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:31.560 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe499400640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe488000c00 tx=0x7fe4880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488032440 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe488032e20 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe488004270 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.556+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe49c1f2b90 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.557+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49c1f2530 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.558+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49c1f30b0 con 0x7fe49c0b2780 2024-09-13T18:47:31.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.559+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe488039050 con 0x7fe49c0b2780 2024-09-13T18:47:31.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.560+0000 7fe492000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 0x7fe47c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:31.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.560+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe4880a96c0 con 0x7fe49c0b2780 2024-09-13T18:47:31.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.560+0000 7fe499e00640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 0x7fe47c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:31.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.561+0000 7fe499e00640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 0x7fe47c06d0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009e90 tx=0x7fe48c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:31.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.564+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe49c1f30b0 con 0x7fe49c0b2780 2024-09-13T18:47:31.747 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:31.745+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe49c1f30b0 con 0x7fe49c0b2780 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.581+0000 7fe492000640 1 -- 172.21.15.192:0/1492550765 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v193) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe49c1f30b0 con 0x7fe49c0b2780 2024-09-13T18:47:32.584 INFO:teuthology.orchestra.run.smithi192.stderr: removed all blocklist entries 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 msgr2=0x7fe47c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 0x7fe47c06d0c0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009e90 tx=0x7fe48c009190 comp rx=0 tx=0).stop 2024-09-13T18:47:32.586 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 msgr2=0x7fe49c1e85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fe488000c00 tx=0x7fe4880046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 shutdown_connections 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.583+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe47c06ac00 0x7fe47c06d0c0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe49c146610 0x7fe49c06af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe49c0b2780 0x7fe49c1e85c0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 --2- 172.21.15.192:0/1492550765 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe49c0afd80 0x7fe49c140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 >> 172.21.15.192:0/1492550765 conn(0x7fe49c0ae960 msgr2=0x7fe49c0b3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 shutdown_connections 2024-09-13T18:47:32.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.584+0000 7fe4a1000640 1 -- 172.21.15.192:0/1492550765 wait complete. 2024-09-13T18:47:32.603 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-13T18:47:32.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.753+0000 7f830bc00640 1 Processor -- start 2024-09-13T18:47:32.756 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.753+0000 7f830bc00640 1 -- start start 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f830bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f830415dee0 0x7f83040afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f830bc00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f830415e2c0 0x7f830415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f830bc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83040b2f00 con 0x7f83040b3f10 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f830bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040b3150 con 0x7f830415dee0 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f830bc00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83040b3430 con 0x7f830415e2c0 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f8309200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f830415dee0 0x7f83040afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f8303e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f83040b3f10 0x7f830415a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36278/0 (socket says 172.21.15.192:36278) 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.754+0000 7f8303e00640 1 -- 172.21.15.192:0/16966639 learned_addr learned my addr 172.21.15.192:0/16966639 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8309c00640 1 --2- 172.21.15.192:0/16966639 >> v2:172.21.15.194:3300/0 conn(0x7f830415e2c0 0x7f830415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8309200640 1 -- 172.21.15.192:0/16966639 >> v2:172.21.15.194:3300/0 conn(0x7f830415e2c0 msgr2=0x7f830415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:32.758 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8309200640 1 --2- 172.21.15.192:0/16966639 >> v2:172.21.15.194:3300/0 conn(0x7f830415e2c0 0x7f830415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8309200640 1 -- 172.21.15.192:0/16966639 >> v1:172.21.15.192:6789/0 conn(0x7f83040b3f10 legacy=0x7f830415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8309200640 1 -- 172.21.15.192:0/16966639 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83040b3710 con 0x7f830415dee0 2024-09-13T18:47:32.759 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.755+0000 7f8303400640 1 -- 172.21.15.192:0/16966639 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3261231169 0 0) 0x7f83040b2f00 con 0x7f83040b3f10 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.756+0000 7f8309200640 1 --2- 172.21.15.192:0/16966639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f830415dee0 0x7f83040afd80 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f83040cec10 tx=0x7f82f802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb69a8931dd1758 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.756+0000 7f8303400640 1 -- 172.21.15.192:0/16966639 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032440 con 0x7f830415dee0 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.756+0000 7f8303400640 1 -- 172.21.15.192:0/16966639 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82f80325a0 con 0x7f830415dee0 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.756+0000 7f8303400640 1 -- 172.21.15.192:0/16966639 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82f8032930 con 0x7f830415dee0 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 -- 172.21.15.192:0/16966639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f830415dee0 msgr2=0x7f83040afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 --2- 172.21.15.192:0/16966639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f830415dee0 0x7f83040afd80 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f83040cec10 tx=0x7f82f802a1a0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 -- 172.21.15.192:0/16966639 shutdown_connections 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 --2- 172.21.15.192:0/16966639 >> v2:172.21.15.194:3300/0 conn(0x7f830415e2c0 0x7f830415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 --2- 172.21.15.192:0/16966639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f830415dee0 0x7f83040afd80 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.760 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 -- 172.21.15.192:0/16966639 >> 172.21.15.192:0/16966639 conn(0x7f83040ae960 msgr2=0x7f830406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:32.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 -- 172.21.15.192:0/16966639 shutdown_connections 2024-09-13T18:47:32.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.757+0000 7f830bc00640 1 -- 172.21.15.192:0/16966639 wait complete. 2024-09-13T18:47:32.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.759+0000 7f830bc00640 1 Processor -- start 2024-09-13T18:47:32.761 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.759+0000 7f830bc00640 1 -- start start 2024-09-13T18:47:32.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f830415dee0 0x7f83041351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 0x7f83041f29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83041424b0 con 0x7f8304152340 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8304141830 con 0x7f830415dee0 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f830bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8304141b10 con 0x7f830415e2c0 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36066/0 (socket says 172.21.15.192:36066) 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 -- 172.21.15.192:0/1988817899 learned_addr learned my addr 172.21.15.192:0/1988817899 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309200640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f830415dee0 0x7f83041351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8303e00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 0x7f83041f29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 -- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 msgr2=0x7f83041f29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 0x7f83041f29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 -- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f830415dee0 msgr2=0x7f83041351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f830415dee0 0x7f83041351d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8309c00640 1 -- 172.21.15.192:0/1988817899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f8009400 con 0x7f8304152340 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.760+0000 7f8303e00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 0x7f83041f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f8309c00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f82fc007e60 tx=0x7f82fc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc014420 con 0x7f8304152340 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82fc0145a0 con 0x7f8304152340 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8304141df0 con 0x7f8304152340 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc014950 con 0x7f8304152340 2024-09-13T18:47:32.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.761+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830413c6c0 con 0x7f8304152340 2024-09-13T18:47:32.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.762+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83041425f0 con 0x7f8304152340 2024-09-13T18:47:32.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.763+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f82fc014ab0 con 0x7f8304152340 2024-09-13T18:47:32.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.764+0000 7f8300c00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 0x7f82e406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:32.766 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.764+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f82fc089860 con 0x7f8304152340 2024-09-13T18:47:32.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.764+0000 7f8309200640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 0x7f82e406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:32.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.765+0000 7f8309200640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 0x7f82e406d0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:32.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.769+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f83041425f0 con 0x7f8304152340 2024-09-13T18:47:32.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.996+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83041425f0 con 0x7f8304152340 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.997+0000 7f8300c00640 1 -- 172.21.15.192:0/1988817899 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f83041425f0 con 0x7f8304152340 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: "auth_dump": [ 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.a", 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm6hYbIRAAQ6Dp9ujCiECf/Kxh53qR7A==", 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.000 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.b", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmtmStNBAAK9cBy2KuWAJ4EcqIcM9Lgw==", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.001 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.c", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmh7LeKhAA+ELUOLG//MsKFqfFref+Mw==", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mds.d", 2024-09-13T18:47:33.002 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmCuK+AhAAlOVQGA1FtrrhM0sTcJrZqw==", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.0", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmGJ7oGBAAh3/V5M3SsKtbVNK5Xqs/zA==", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.003 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.1", 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmuW77IxAAqFqJw7I9NJ7Dh0Vo45sTdw==", 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.004 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.2", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmPCSWLRAAqGQ9waG4PC8wfj4vdNBSEA==", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.3", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDhheRmUx5sNxAAuWpQ6CE/WizLEBZSyVWmow==", 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.005 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.4", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDkheRmwlHtNRAAms+PdprJo1C8yJbXrEZymQ==", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.006 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.5", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmi/RWBRAAqJQL7WdGyPSi8QZJ5KuTGw==", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.6", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmgZB3DxAAL0Ve3u8A7rmZyFy51k8MyA==", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.007 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "osd.7", 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDlheRmTt9JGRAAybjkyLcHtBXwSrHG4YAZDQ==", 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow profile osd", 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile osd", 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.008 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.0", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmH3lMCxAAcQRo0dSjs8H5ZEGdxY/GYA==", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow r", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.1", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmGC8VGBAA+i4H3lMCtoaBimSdOLogxg==", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.009 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.2", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmeSupERAAL5qqdQXxri+kCZgzo/kk3w==", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:47:33.010 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.3", 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDeheRmAUCBHhAAbcowGCWWTYrK0TE9prVkmQ==", 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow", 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow r", 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow rw", 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow rwx" 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.011 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "client.admin", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDcheRmaXlkLRAAfQXyqoA2OdBFiFbehbISRQ==", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": "allow *", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow *", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.x", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRmU3KRGhAA6D69YpvScLhdjTDAMpS8ew==", 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.012 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "entity": "mgr.y", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "key": "AQDdheRm/Z1jExAApjq1mhmF8FfsC4i3U4hAcw==", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "caps": { 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "mds": "allow *", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "mon": "allow profile mgr", 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": "allow *" 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.013 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:33.014 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:33.014 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 msgr2=0x7f82e406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 0x7f82e406d0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f802e000 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 msgr2=0x7f83041f2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f82fc007e60 tx=0x7f82fc00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 shutdown_connections 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f82e406ac00 0x7f82e406d0c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8304152340 0x7f83041f2f20 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f830415e2c0 0x7f83041f29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 --2- 172.21.15.192:0/1988817899 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f830415dee0 0x7f83041351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 >> 172.21.15.192:0/1988817899 conn(0x7f83040ae960 msgr2=0x7f83040711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 shutdown_connections 2024-09-13T18:47:33.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:32.999+0000 7f830bc00640 1 -- 172.21.15.192:0/1988817899 wait complete. 2024-09-13T18:47:33.018 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:33.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.167+0000 7f7527400640 1 Processor -- start 2024-09-13T18:47:33.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.167+0000 7f7527400640 1 -- start start 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.168+0000 7f7527400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f75200b0490 0x7f75200cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.168+0000 7f7527400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752015ec00 con 0x7f752015e790 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.168+0000 7f7527400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7520140480 con 0x7f75200cacd0 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.168+0000 7f7527400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75200cb5f0 con 0x7f75200b0490 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.168+0000 7f751fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f752015e790 0x7f75200afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36290/0 (socket says 172.21.15.192:36290) 2024-09-13T18:47:33.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f751fe00640 1 -- 172.21.15.192:0/3522395251 learned_addr learned my addr 172.21.15.192:0/3522395251 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:33.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f7525400640 1 --2- 172.21.15.192:0/3522395251 >> v2:172.21.15.194:3300/0 conn(0x7f75200b0490 0x7f75200cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f751f400640 1 -- 172.21.15.192:0/3522395251 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865421768 0 0) 0x7f752015ec00 con 0x7f752015e790 2024-09-13T18:47:33.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f751f400640 1 -- 172.21.15.192:0/3522395251 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7508003520 con 0x7f752015e790 2024-09-13T18:47:33.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f7525400640 1 -- 172.21.15.192:0/3522395251 >> v1:172.21.15.194:6789/0 conn(0x7f75200cacd0 legacy=0x7f7520140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f7525400640 1 -- 172.21.15.192:0/3522395251 >> v1:172.21.15.192:6789/0 conn(0x7f752015e790 legacy=0x7f75200afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.169+0000 7f7525400640 1 -- 172.21.15.192:0/3522395251 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752015ee90 con 0x7f75200b0490 2024-09-13T18:47:33.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.170+0000 7f7525400640 1 --2- 172.21.15.192:0/3522395251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200b0490 0x7f75200cb0b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7518009d90 tx=0x7f751802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce042facb19e712c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.170+0000 7f751f400640 1 -- 172.21.15.192:0/3522395251 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518007740 con 0x7f75200b0490 2024-09-13T18:47:33.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f751f400640 1 -- 172.21.15.192:0/3522395251 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751802d050 con 0x7f75200b0490 2024-09-13T18:47:33.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f751f400640 1 -- 172.21.15.192:0/3522395251 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7518007ac0 con 0x7f75200b0490 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 -- 172.21.15.192:0/3522395251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200b0490 msgr2=0x7f75200cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 --2- 172.21.15.192:0/3522395251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200b0490 0x7f75200cb0b0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f7518009d90 tx=0x7f751802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 -- 172.21.15.192:0/3522395251 shutdown_connections 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 --2- 172.21.15.192:0/3522395251 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200b0490 0x7f75200cb0b0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 -- 172.21.15.192:0/3522395251 >> 172.21.15.192:0/3522395251 conn(0x7f75200ae960 msgr2=0x7f752006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 -- 172.21.15.192:0/3522395251 shutdown_connections 2024-09-13T18:47:33.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.171+0000 7f7527400640 1 -- 172.21.15.192:0/3522395251 wait complete. 2024-09-13T18:47:33.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.173+0000 7f7527400640 1 Processor -- start 2024-09-13T18:47:33.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.173+0000 7f7527400640 1 -- start start 2024-09-13T18:47:33.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75200b0490 0x7f7520150ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200cacd0 0x7f75200cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75201e4910 con 0x7f752015e790 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75200ccbe0 con 0x7f75200cacd0 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7527400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75200cbfd0 con 0x7f75200b0490 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7525400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7525400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36068/0 (socket says 172.21.15.192:36068) 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7525400640 1 -- 172.21.15.192:0/3763273911 learned_addr learned my addr 172.21.15.192:0/3763273911 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f7524a00640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75200b0490 0x7f7520150ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.174+0000 7f751fe00640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200cacd0 0x7f75200cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 -- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75200b0490 msgr2=0x7f7520150ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75200b0490 0x7f7520150ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 -- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200cacd0 msgr2=0x7f75200cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200cacd0 0x7f75200cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 -- 172.21.15.192:0/3763273911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7518009a70 con 0x7f752015e790 2024-09-13T18:47:33.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7525400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7518009eb0 tx=0x7f7518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751803b820 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751803b980 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75200cc2b0 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751803bcf0 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.175+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75200cc870 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.176+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75200ccd70 con 0x7f752015e790 2024-09-13T18:47:33.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.177+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7518031400 con 0x7f752015e790 2024-09-13T18:47:33.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.178+0000 7f751cc00640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 0x7f750006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.178+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f75180aa950 con 0x7f752015e790 2024-09-13T18:47:33.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.178+0000 7f7524a00640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 0x7f750006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.179+0000 7f7524a00640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 0x7f750006d0c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f60 tx=0x7f7514009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.183+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7518075df0 con 0x7f752015e790 2024-09-13T18:47:33.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.355+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75200cb0b0 con 0x7f752015e790 2024-09-13T18:47:33.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.356+0000 7f751cc00640 1 -- 172.21.15.192:0/3763273911 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+12928 (secure 0 0 0) 0x7f7518079410 con 0x7f752015e790 2024-09-13T18:47:33.359 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:33.359 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":193,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:32.577951+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":182,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 msgr2=0x7f750006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 0x7f750006d0c0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f60 tx=0x7f7514009040 comp rx=0 tx=0).stop 2024-09-13T18:47:33.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 msgr2=0x7f7520069ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f7518009eb0 tx=0x7f7518004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 shutdown_connections 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f750006ac00 0x7f750006d0c0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f752015e790 0x7f7520069ea0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.358+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f75200cacd0 0x7f75200cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.359+0000 7f7527400640 1 --2- 172.21.15.192:0/3763273911 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f75200b0490 0x7f7520150ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.359+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 >> 172.21.15.192:0/3763273911 conn(0x7f75200ae960 msgr2=0x7f7520070910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.359+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 shutdown_connections 2024-09-13T18:47:33.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.359+0000 7f7527400640 1 -- 172.21.15.192:0/3763273911 wait complete. 2024-09-13T18:47:33.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:47:33.378 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:47:33.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.530+0000 7f6743600640 1 Processor -- start 2024-09-13T18:47:33.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.530+0000 7f6743600640 1 -- start start 2024-09-13T18:47:33.535 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.531+0000 7f6743600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 0x7f673c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.531+0000 7f6743600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 0x7f673c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.531+0000 7f6743600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0b2000 con 0x7f673c06c0b0 2024-09-13T18:47:33.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.531+0000 7f6743600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c15bbd0 con 0x7f673c1589f0 2024-09-13T18:47:33.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.531+0000 7f6743600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c15beb0 con 0x7f673c0b3af0 2024-09-13T18:47:33.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673be00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 0x7f673c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f6741600640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f673c06c0b0 0x7f673c0cbb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:42516/0 (socket says 172.21.15.192:42516) 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f6741600640 1 -- 172.21.15.192:0/599590370 learned_addr learned my addr 172.21.15.192:0/599590370 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f6740c00640 1 --2- 172.21.15.192:0/599590370 >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 0x7f673c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673be00640 1 -- 172.21.15.192:0/599590370 >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 msgr2=0x7f673c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673be00640 1 --2- 172.21.15.192:0/599590370 >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 0x7f673c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673be00640 1 -- 172.21.15.192:0/599590370 >> v1:172.21.15.194:6789/0 conn(0x7f673c06c0b0 legacy=0x7f673c0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673b400640 1 -- 172.21.15.192:0/599590370 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1532975206 0 0) 0x7f673c0b2000 con 0x7f673c06c0b0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f673be00640 1 -- 172.21.15.192:0/599590370 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c15c190 con 0x7f673c0b3af0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.532+0000 7f6740c00640 1 --2- 172.21.15.192:0/599590370 >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 0x7f673c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.533+0000 7f673be00640 1 --2- 172.21.15.192:0/599590370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 0x7f673c15b260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=415e6830349bf786 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f673b400640 1 -- 172.21.15.192:0/599590370 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728032440 con 0x7f673c0b3af0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f673b400640 1 -- 172.21.15.192:0/599590370 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280325a0 con 0x7f673c0b3af0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f673b400640 1 -- 172.21.15.192:0/599590370 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728032930 con 0x7f673c0b3af0 2024-09-13T18:47:33.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 -- 172.21.15.192:0/599590370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 msgr2=0x7f673c15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 --2- 172.21.15.192:0/599590370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 0x7f673c15b260 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f67280097a0 tx=0x7f672802a180 comp rx=0 tx=0).stop 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 -- 172.21.15.192:0/599590370 shutdown_connections 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 --2- 172.21.15.192:0/599590370 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c0b3af0 0x7f673c15b260 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 --2- 172.21.15.192:0/599590370 >> v2:172.21.15.194:3300/0 conn(0x7f673c1589f0 0x7f673c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 -- 172.21.15.192:0/599590370 >> 172.21.15.192:0/599590370 conn(0x7f673c0b08f0 msgr2=0x7f673c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 -- 172.21.15.192:0/599590370 shutdown_connections 2024-09-13T18:47:33.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.534+0000 7f6743600640 1 -- 172.21.15.192:0/599590370 wait complete. 2024-09-13T18:47:33.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.536+0000 7f6743600640 1 Processor -- start 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.536+0000 7f6743600640 1 -- start start 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c06c0b0 0x7f673c157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f673c0b3af0 0x7f673c14fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c15e570 con 0x7f673c1589f0 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c158160 con 0x7f673c0b3af0 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6743600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c156970 con 0x7f673c06c0b0 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6741600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6740c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c06c0b0 0x7f673c157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6741600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36074/0 (socket says 172.21.15.192:36074) 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f6741600640 1 -- 172.21.15.192:0/3018371319 learned_addr learned my addr 172.21.15.192:0/3018371319 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:33.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.537+0000 7f673be00640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f673c0b3af0 0x7f673c14fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 -- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c06c0b0 msgr2=0x7f673c157c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c06c0b0 0x7f673c157c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 -- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f673c0b3af0 msgr2=0x7f673c14fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f673c0b3af0 0x7f673c14fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 -- 172.21.15.192:0/3018371319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c009400 con 0x7f673c1589f0 2024-09-13T18:47:33.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6741600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f673400c810 tx=0x7f673400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400a640 con 0x7f673c1589f0 2024-09-13T18:47:33.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673400a7c0 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6728009400 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673400ab70 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.538+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c156ea0 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.539+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c0cca70 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.540+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f673400acd0 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.541+0000 7f6738c00640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 0x7f671c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.541+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6734088890 con 0x7f673c1589f0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.541+0000 7f6740c00640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 0x7f671c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.542+0000 7f6740c00640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 0x7f671c06d0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f672c009c30 tx=0x7f672c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.545+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6734053dd0 con 0x7f673c1589f0 2024-09-13T18:47:33.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.710+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f673c15b770 con 0x7f673c1589f0 2024-09-13T18:47:33.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.711+0000 7f6738c00640 1 -- 172.21.15.192:0/3018371319 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v193) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6734018020 con 0x7f673c1589f0 2024-09-13T18:47:33.714 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 msgr2=0x7f671c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 0x7f671c06d0c0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f672c009c30 tx=0x7f672c009190 comp rx=0 tx=0).stop 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 msgr2=0x7f673c153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f673400c810 tx=0x7f673400ccd0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 shutdown_connections 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f671c06ac00 0x7f671c06d0c0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f673c1589f0 0x7f673c153670 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.716 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f673c0b3af0 0x7f673c14fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 --2- 172.21.15.192:0/3018371319 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f673c06c0b0 0x7f673c157c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 >> 172.21.15.192:0/3018371319 conn(0x7f673c0b08f0 msgr2=0x7f673c0aedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 shutdown_connections 2024-09-13T18:47:33.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.713+0000 7f6743600640 1 -- 172.21.15.192:0/3018371319 wait complete. 2024-09-13T18:47:33.733 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-13T18:47:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.881+0000 7fd9d4a00640 1 Processor -- start 2024-09-13T18:47:33.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.881+0000 7fd9d4a00640 1 -- start start 2024-09-13T18:47:33.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.882+0000 7fd9d4a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd9d00cacd0 0x7fd9d015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9d4a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d015bc20 0x7fd9d00afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9d4a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9d0140480 con 0x7fd9d00cb0b0 2024-09-13T18:47:33.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9d4a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d00cb520 con 0x7fd9d015bc20 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9d4a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9d015ee90 con 0x7fd9d00cacd0 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d015bc20 0x7fd9d00afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd9d015bc20 0x7fd9d00afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36086/0 (socket says 172.21.15.192:36086) 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 -- 172.21.15.192:0/3876439907 learned_addr learned my addr 172.21.15.192:0/3876439907 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9cde00640 1 --2- 172.21.15.192:0/3876439907 >> v2:172.21.15.194:3300/0 conn(0x7fd9d00cacd0 0x7fd9d015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 -- 172.21.15.192:0/3876439907 >> v2:172.21.15.194:3300/0 conn(0x7fd9d00cacd0 msgr2=0x7fd9d015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 --2- 172.21.15.192:0/3876439907 >> v2:172.21.15.194:3300/0 conn(0x7fd9d00cacd0 0x7fd9d015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 -- 172.21.15.192:0/3876439907 >> v1:172.21.15.194:6789/0 conn(0x7fd9d00cb0b0 legacy=0x7fd9d0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.883+0000 7fd9ce800640 1 -- 172.21.15.192:0/3876439907 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d015f170 con 0x7fd9d015bc20 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.884+0000 7fd9ce800640 1 --2- 172.21.15.192:0/3876439907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d015bc20 0x7fd9d00afd80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00b2350 tx=0x7fd9c802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc08986cc07ea493 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9cca00640 1 -- 172.21.15.192:0/3876439907 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031600 con 0x7fd9d015bc20 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9cca00640 1 -- 172.21.15.192:0/3876439907 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c802d050 con 0x7fd9d015bc20 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9cca00640 1 -- 172.21.15.192:0/3876439907 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8031980 con 0x7fd9d015bc20 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 -- 172.21.15.192:0/3876439907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d015bc20 msgr2=0x7fd9d00afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/3876439907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d015bc20 0x7fd9d00afd80 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd9d00b2350 tx=0x7fd9c802a730 comp rx=0 tx=0).stop 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 -- 172.21.15.192:0/3876439907 shutdown_connections 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/3876439907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d015bc20 0x7fd9d00afd80 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/3876439907 >> v2:172.21.15.194:3300/0 conn(0x7fd9d00cacd0 0x7fd9d015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 -- 172.21.15.192:0/3876439907 >> 172.21.15.192:0/3876439907 conn(0x7fd9d00ae960 msgr2=0x7fd9d006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 -- 172.21.15.192:0/3876439907 shutdown_connections 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.885+0000 7fd9d4a00640 1 -- 172.21.15.192:0/3876439907 wait complete. 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.887+0000 7fd9d4a00640 1 Processor -- start 2024-09-13T18:47:33.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.887+0000 7fd9d4a00640 1 -- start start 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d00cb0b0 0x7fd9d00cc790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d015bc20 0x7fd9d00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d00cd5c0 con 0x7fd9d00cacd0 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d012c7e0 con 0x7fd9d00cb0b0 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9d4a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d013d8d0 con 0x7fd9d015bc20 2024-09-13T18:47:33.893 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9cde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9cde00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36088/0 (socket says 172.21.15.192:36088) 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.888+0000 7fd9cde00640 1 -- 172.21.15.192:0/1784893445 learned_addr learned my addr 172.21.15.192:0/1784893445 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 -- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d015bc20 msgr2=0x7fd9d00cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d015bc20 0x7fd9d00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 -- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d00cb0b0 msgr2=0x7fd9d00cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d00cb0b0 0x7fd9d00cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 -- 172.21.15.192:0/1784893445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c8009b30 con 0x7fd9d00cacd0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9cde00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e8a0 tx=0x7fd9c000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c00094f0 con 0x7fd9d00cacd0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9c000c940 con 0x7fd9d00cacd0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c000ccf0 con 0x7fd9d00cacd0 2024-09-13T18:47:33.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d00cd2e0 con 0x7fd9d00cacd0 2024-09-13T18:47:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.889+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d012c470 con 0x7fd9d00cacd0 2024-09-13T18:47:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.891+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d015e790 con 0x7fd9d00cacd0 2024-09-13T18:47:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.891+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd9c0013470 con 0x7fd9d00cacd0 2024-09-13T18:47:33.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.892+0000 7fd9c6000640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 0x7fd9b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.893+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd9c0089520 con 0x7fd9d00cacd0 2024-09-13T18:47:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.893+0000 7fd9cd400640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 0x7fd9b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:33.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.893+0000 7fd9cd400640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 0x7fd9b006d0c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc000f60 tx=0x7fd9bc0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:33.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:33.897+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd9c00549b0 con 0x7fd9d00cacd0 2024-09-13T18:47:34.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.066+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd9d006c6c0 con 0x7fd9d00cacd0 2024-09-13T18:47:34.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.066+0000 7fd9c6000640 1 -- 172.21.15.192:0/1784893445 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v193) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd9c0057fd0 con 0x7fd9d00cacd0 2024-09-13T18:47:34.069 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout:[ 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout: "poolnum": 1, 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout: "poolname": ".mgr" 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:34.070 INFO:teuthology.orchestra.run.smithi192.stdout:] 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 msgr2=0x7fd9b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 0x7fd9b006d0c0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd9bc000f60 tx=0x7fd9bc0079b0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 msgr2=0x7fd9d015a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000e8a0 tx=0x7fd9c000ed60 comp rx=0 tx=0).stop 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 shutdown_connections 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd9b006ac00 0x7fd9b006d0c0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd9d015bc20 0x7fd9d00cccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.072 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd9d00cb0b0 0x7fd9d00cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 --2- 172.21.15.192:0/1784893445 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd9d00cacd0 0x7fd9d015a000 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 >> 172.21.15.192:0/1784893445 conn(0x7fd9d00ae960 msgr2=0x7fd9d00709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 shutdown_connections 2024-09-13T18:47:34.073 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.069+0000 7fd9d4a00640 1 -- 172.21.15.192:0/1784893445 wait complete. 2024-09-13T18:47:34.088 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-13T18:47:34.088 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-13T18:47:34.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.243+0000 7fa93d200640 1 Processor -- start 2024-09-13T18:47:34.246 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.243+0000 7fa93d200640 1 -- start start 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 0x7fa93806e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa93806bf20 0x7fa9380b3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 0x7fa93806a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9380cd020 con 0x7fa93806bf20 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9380b3f50 con 0x7fa9380b3ac0 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa93d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9380cc780 con 0x7fa938159a40 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa935400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa93806bf20 0x7fa9380b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa935400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa93806bf20 0x7fa9380b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36104/0 (socket says 172.21.15.192:36104) 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.244+0000 7fa935400640 1 -- 172.21.15.192:0/554303843 learned_addr learned my addr 172.21.15.192:0/554303843 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935e00640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 0x7fa93806e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa936800640 1 --2- 172.21.15.192:0/554303843 >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 0x7fa93806a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935400640 1 -- 172.21.15.192:0/554303843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 msgr2=0x7fa93806e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935400640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 0x7fa93806e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935400640 1 -- 172.21.15.192:0/554303843 >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 msgr2=0x7fa93806a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935400640 1 --2- 172.21.15.192:0/554303843 >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 0x7fa93806a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935400640 1 -- 172.21.15.192:0/554303843 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9380cca60 con 0x7fa93806bf20 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa935e00640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 0x7fa93806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:34.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.245+0000 7fa936800640 1 --2- 172.21.15.192:0/554303843 >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 0x7fa93806a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.246+0000 7fa935400640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa93806bf20 0x7fa9380b3580 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa9380cdf40 tx=0x7fa92402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2317dbcb5c32d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.246+0000 7fa934a00640 1 -- 172.21.15.192:0/554303843 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924032440 con 0x7fa93806bf20 2024-09-13T18:47:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.246+0000 7fa934a00640 1 -- 172.21.15.192:0/554303843 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9240325a0 con 0x7fa93806bf20 2024-09-13T18:47:34.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.246+0000 7fa934a00640 1 -- 172.21.15.192:0/554303843 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924032930 con 0x7fa93806bf20 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 -- 172.21.15.192:0/554303843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa93806bf20 msgr2=0x7fa9380b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa93806bf20 0x7fa9380b3580 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fa9380cdf40 tx=0x7fa92402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 -- 172.21.15.192:0/554303843 shutdown_connections 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 --2- 172.21.15.192:0/554303843 >> v2:172.21.15.194:3300/0 conn(0x7fa9380b3ac0 0x7fa93806a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa93806bf20 0x7fa9380b3580 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 --2- 172.21.15.192:0/554303843 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa938159a40 0x7fa93806e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 -- 172.21.15.192:0/554303843 >> 172.21.15.192:0/554303843 conn(0x7fa9380736d0 msgr2=0x7fa9380b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 -- 172.21.15.192:0/554303843 shutdown_connections 2024-09-13T18:47:34.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.247+0000 7fa93d200640 1 -- 172.21.15.192:0/554303843 wait complete. 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.248+0000 7fa93d200640 1 Processor -- start 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 -- start start 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 0x7fa93814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa938159a40 0x7fa9380b2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381f4d90 con 0x7fa9380b3ac0 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa938153b40 con 0x7fa938159a40 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.249+0000 7fa93d200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9381f51b0 con 0x7fa93806bf20 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36120/0 (socket says 172.21.15.192:36120) 2024-09-13T18:47:34.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 -- 172.21.15.192:0/293664581 learned_addr learned my addr 172.21.15.192:0/293664581 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935e00640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 0x7fa93814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa936800640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa938159a40 0x7fa9380b2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 -- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 msgr2=0x7fa93814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 0x7fa93814cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 -- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa938159a40 msgr2=0x7fa9380b2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa938159a40 0x7fa9380b2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 -- 172.21.15.192:0/293664581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9240094d0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935e00640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 0x7fa93814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:34.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.250+0000 7fa935400640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa92402a220 tx=0x7fa9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.251+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924032440 con 0x7fa9380b3ac0 2024-09-13T18:47:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.251+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa924030ba0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.251+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92403d440 con 0x7fa9380b3ac0 2024-09-13T18:47:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.251+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9381f43f0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.251+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9381f49b0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.252+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9381f4ed0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.253+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa924039040 con 0x7fa9380b3ac0 2024-09-13T18:47:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.254+0000 7fa92e000640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 0x7fa91806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.254+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9240a9bd0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.254+0000 7fa935e00640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 0x7fa91806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:34.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.254+0000 7fa935e00640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 0x7fa91806d0c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa928006fd0 tx=0x7fa928008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:34.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.258+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa9381f4ed0 con 0x7fa9380b3ac0 2024-09-13T18:47:34.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:34.424+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa9381f4ed0 con 0x7fa9380b3ac0 2024-09-13T18:47:35.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.231+0000 7fa92e000640 1 -- 172.21.15.192:0/293664581 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v194) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa9381f4ed0 con 0x7fa9380b3ac0 2024-09-13T18:47:35.237 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' created 2024-09-13T18:47:35.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 msgr2=0x7fa91806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 0x7fa91806d0c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fa928006fd0 tx=0x7fa928008040 comp rx=0 tx=0).stop 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 msgr2=0x7fa938153110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fa92402a220 tx=0x7fa9240046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 shutdown_connections 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa91806ac00 0x7fa91806d0c0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa938159a40 0x7fa9380b2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa9380b3ac0 0x7fa938153110 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 --2- 172.21.15.192:0/293664581 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa93806bf20 0x7fa93814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 >> 172.21.15.192:0/293664581 conn(0x7fa9380736d0 msgr2=0x7fa938155df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 shutdown_connections 2024-09-13T18:47:35.241 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.236+0000 7fa93d200640 1 -- 172.21.15.192:0/293664581 wait complete. 2024-09-13T18:47:35.258 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-13T18:47:35.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.417+0000 7f0de9a00640 1 Processor -- start 2024-09-13T18:47:35.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.417+0000 7f0de9a00640 1 -- start start 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de9a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0de41589f0 0x7f0de40b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de9a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 0x7f0de406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de9a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0de40b2000 con 0x7f0de40b3af0 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de9a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de406ca30 con 0x7f0de41589f0 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de9a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0de415b970 con 0x7f0de406c0b0 2024-09-13T18:47:35.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de2a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0de41589f0 0x7f0de40b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de2a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0de41589f0 0x7f0de40b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36132/0 (socket says 172.21.15.192:36132) 2024-09-13T18:47:35.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.418+0000 7f0de2a00640 1 -- 172.21.15.192:0/3041620559 learned_addr learned my addr 172.21.15.192:0/3041620559 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:35.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de3400640 1 --2- 172.21.15.192:0/3041620559 >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 0x7f0de406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de2a00640 1 -- 172.21.15.192:0/3041620559 >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 msgr2=0x7f0de406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de2a00640 1 --2- 172.21.15.192:0/3041620559 >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 0x7f0de406c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de2a00640 1 -- 172.21.15.192:0/3041620559 >> v1:172.21.15.192:6789/0 conn(0x7f0de40b3af0 legacy=0x7f0de415b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de2a00640 1 -- 172.21.15.192:0/3041620559 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0de415bbd0 con 0x7f0de41589f0 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de3400640 1 --2- 172.21.15.192:0/3041620559 >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 0x7f0de406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.419+0000 7f0de1600640 1 -- 172.21.15.192:0/3041620559 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819486854 0 0) 0x7f0de40b2000 con 0x7f0de40b3af0 2024-09-13T18:47:35.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.420+0000 7f0de2a00640 1 --2- 172.21.15.192:0/3041620559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de41589f0 0x7f0de40b2490 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0de40cb890 tx=0x7f0dd402a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba9d7a8e8763d11 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.420+0000 7f0de1600640 1 -- 172.21.15.192:0/3041620559 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4032440 con 0x7f0de41589f0 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.420+0000 7f0de1600640 1 -- 172.21.15.192:0/3041620559 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd40325a0 con 0x7f0de41589f0 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.420+0000 7f0de1600640 1 -- 172.21.15.192:0/3041620559 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4032930 con 0x7f0de41589f0 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 -- 172.21.15.192:0/3041620559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de41589f0 msgr2=0x7f0de40b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 --2- 172.21.15.192:0/3041620559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de41589f0 0x7f0de40b2490 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f0de40cb890 tx=0x7f0dd402a200 comp rx=0 tx=0).stop 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 -- 172.21.15.192:0/3041620559 shutdown_connections 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 --2- 172.21.15.192:0/3041620559 >> v2:172.21.15.194:3300/0 conn(0x7f0de406c0b0 0x7f0de406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 --2- 172.21.15.192:0/3041620559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de41589f0 0x7f0de40b2490 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 -- 172.21.15.192:0/3041620559 >> 172.21.15.192:0/3041620559 conn(0x7f0de40b08f0 msgr2=0x7f0de40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:35.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 -- 172.21.15.192:0/3041620559 shutdown_connections 2024-09-13T18:47:35.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.421+0000 7f0de9a00640 1 -- 172.21.15.192:0/3041620559 wait complete. 2024-09-13T18:47:35.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.423+0000 7f0de9a00640 1 Processor -- start 2024-09-13T18:47:35.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.423+0000 7f0de9a00640 1 -- start start 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0de40b3af0 0x7f0de4154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0de41589f0 0x7f0de41f68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e11b0 con 0x7f0de406c0b0 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e1420 con 0x7f0de40b3af0 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de9a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0de41e1700 con 0x7f0de41589f0 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36146/0 (socket says 172.21.15.192:36146) 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 -- 172.21.15.192:0/2505197583 learned_addr learned my addr 172.21.15.192:0/2505197583 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2000640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0de40b3af0 0x7f0de4154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de3400640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0de41589f0 0x7f0de41f68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 -- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0de41589f0 msgr2=0x7f0de41f68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0de41589f0 0x7f0de41f68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 -- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0de40b3af0 msgr2=0x7f0de4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0de40b3af0 0x7f0de4154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:35.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.424+0000 7f0de2a00640 1 -- 172.21.15.192:0/2505197583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40094d0 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0de2a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f0dd402a240 tx=0x7f0dd40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd4030b80 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd4030ce0 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd403d680 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de41f60d0 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.425+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de4154f80 con 0x7f0de406c0b0 2024-09-13T18:47:35.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.426+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de4155110 con 0x7f0de406c0b0 2024-09-13T18:47:35.430 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.427+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0dd4039040 con 0x7f0de406c0b0 2024-09-13T18:47:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.428+0000 7f0ddaa00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 0x7f0dc406d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.428+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0dd40a9d20 con 0x7f0de406c0b0 2024-09-13T18:47:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.428+0000 7f0de2000640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 0x7f0dc406d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:35.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.429+0000 7f0de2000640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 0x7f0dc406d0f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0de4071730 tx=0x7f0dd0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:35.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.433+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0de4155110 con 0x7f0de406c0b0 2024-09-13T18:47:35.606 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:35.603+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0de4155110 con 0x7f0de406c0b0 2024-09-13T18:47:36.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.237+0000 7f0ddaa00640 1 -- 172.21.15.192:0/2505197583 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v195) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0de4155110 con 0x7f0de406c0b0 2024-09-13T18:47:36.240 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' created 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 msgr2=0x7f0dc406d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 0x7f0dc406d0f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0de4071730 tx=0x7f0dd0009040 comp rx=0 tx=0).stop 2024-09-13T18:47:36.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 msgr2=0x7f0de41552d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f0dd402a240 tx=0x7f0dd40046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 shutdown_connections 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0dc406ac30 0x7f0dc406d0f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0de41589f0 0x7f0de41f68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0de40b3af0 0x7f0de4154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 --2- 172.21.15.192:0/2505197583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0de406c0b0 0x7f0de41552d0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.245+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 >> 172.21.15.192:0/2505197583 conn(0x7f0de40b08f0 msgr2=0x7f0de415b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.246+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 shutdown_connections 2024-09-13T18:47:36.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.246+0000 7f0de9a00640 1 -- 172.21.15.192:0/2505197583 wait complete. 2024-09-13T18:47:36.268 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-13T18:47:36.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.421+0000 7f1656200640 1 Processor -- start 2024-09-13T18:47:36.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.421+0000 7f1656200640 1 -- start start 2024-09-13T18:47:36.425 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f1656200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f16500cb330 0x7f165006ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f1656200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500b3470 0x7f16500b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f1656200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f165015a8e0 con 0x7f16500cdf60 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f1656200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500b2fe0 con 0x7f16500b3470 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f1656200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500b26b0 con 0x7f16500cb330 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f164fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500b3470 0x7f16500b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f164fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f16500b3470 0x7f16500b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36154/0 (socket says 172.21.15.192:36154) 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.422+0000 7f164fe00640 1 -- 172.21.15.192:0/262747250 learned_addr learned my addr 172.21.15.192:0/262747250 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.423+0000 7f164f400640 1 --2- 172.21.15.192:0/262747250 >> v2:172.21.15.194:3300/0 conn(0x7f16500cb330 0x7f165006ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.423+0000 7f164fe00640 1 -- 172.21.15.192:0/262747250 >> v2:172.21.15.194:3300/0 conn(0x7f16500cb330 msgr2=0x7f165006ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.423+0000 7f164fe00640 1 --2- 172.21.15.192:0/262747250 >> v2:172.21.15.194:3300/0 conn(0x7f16500cb330 0x7f165006ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.423+0000 7f164fe00640 1 -- 172.21.15.192:0/262747250 >> v1:172.21.15.194:6789/0 conn(0x7f16500cdf60 legacy=0x7f16500ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.423+0000 7f164fe00640 1 -- 172.21.15.192:0/262747250 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16500b2990 con 0x7f16500b3470 2024-09-13T18:47:36.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.424+0000 7f164fe00640 1 --2- 172.21.15.192:0/262747250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f16500b3870 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f16500b18c0 tx=0x7f164802b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8afc89ab67a8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.424+0000 7f164ea00640 1 -- 172.21.15.192:0/262747250 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648008500 con 0x7f16500b3470 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.424+0000 7f164ea00640 1 -- 172.21.15.192:0/262747250 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164802e050 con 0x7f16500b3470 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.424+0000 7f164ea00640 1 -- 172.21.15.192:0/262747250 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648008880 con 0x7f16500b3470 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 -- 172.21.15.192:0/262747250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 msgr2=0x7f16500b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 --2- 172.21.15.192:0/262747250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f16500b3870 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f16500b18c0 tx=0x7f164802b730 comp rx=0 tx=0).stop 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 -- 172.21.15.192:0/262747250 shutdown_connections 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 --2- 172.21.15.192:0/262747250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f16500b3870 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 --2- 172.21.15.192:0/262747250 >> v2:172.21.15.194:3300/0 conn(0x7f16500cb330 0x7f165006ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 -- 172.21.15.192:0/262747250 >> 172.21.15.192:0/262747250 conn(0x7f16500b08f0 msgr2=0x7f16500b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 -- 172.21.15.192:0/262747250 shutdown_connections 2024-09-13T18:47:36.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.425+0000 7f1656200640 1 -- 172.21.15.192:0/262747250 wait complete. 2024-09-13T18:47:36.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.426+0000 7f1656200640 1 Processor -- start 2024-09-13T18:47:36.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.426+0000 7f1656200640 1 -- start start 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb330 0x7f16501414f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16500cdf60 0x7f1650151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650150b90 con 0x7f16500b3470 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650150e70 con 0x7f16500cdf60 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.427+0000 7f1656200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1650151150 con 0x7f16500cb330 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36160/0 (socket says 172.21.15.192:36160) 2024-09-13T18:47:36.431 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 -- 172.21.15.192:0/2058313714 learned_addr learned my addr 172.21.15.192:0/2058313714 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164fe00640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16500cdf60 0x7f1650151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f1647e00640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb330 0x7f16501414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 -- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb330 msgr2=0x7f16501414f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb330 0x7f16501414f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 -- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16500cdf60 msgr2=0x7f1650151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16500cdf60 0x7f1650151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 -- 172.21.15.192:0/2058313714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f164800ac40 con 0x7f16500b3470 2024-09-13T18:47:36.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.428+0000 7f164f400640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f164000d5d0 tx=0x7f164000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.429+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16400125f0 con 0x7f16500b3470 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.429+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1640012770 con 0x7f16500b3470 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.429+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1640012b20 con 0x7f16500b3470 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.429+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1650151430 con 0x7f16500b3470 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.429+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1650141a30 con 0x7f16500b3470 2024-09-13T18:47:36.433 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.430+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650151950 con 0x7f16500b3470 2024-09-13T18:47:36.434 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.431+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1640012c80 con 0x7f16500b3470 2024-09-13T18:47:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.432+0000 7f1647400640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 0x7f162c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.433+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(195..195 src has 1..195) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f1640089780 con 0x7f16500b3470 2024-09-13T18:47:36.435 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.433+0000 7f1647e00640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 0x7f162c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.436 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.433+0000 7f1647e00640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 0x7f162c06d0c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f16501f41c0 tx=0x7f1638009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.438+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1650151950 con 0x7f16500b3470 2024-09-13T18:47:36.646 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.644+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1650151950 con 0x7f16500b3470 2024-09-13T18:47:36.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.654+0000 7f1647400640 1 -- 172.21.15.192:0/2058313714 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v82) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1650151950 con 0x7f16500b3470 2024-09-13T18:47:36.657 INFO:teuthology.orchestra.run.smithi192.stderr:new fs with metadata pool 22 and data pool 23 2024-09-13T18:47:36.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.658+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 msgr2=0x7f162c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.658+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 0x7f162c06d0c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f16501f41c0 tx=0x7f1638009040 comp rx=0 tx=0).stop 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.658+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 msgr2=0x7f1650150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.658+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f164000d5d0 tx=0x7f164000da90 comp rx=0 tx=0).stop 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 shutdown_connections 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f162c06ac00 0x7f162c06d0c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f16500cdf60 0x7f1650151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f16500cb330 0x7f16501414f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 --2- 172.21.15.192:0/2058313714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16500b3470 0x7f1650150150 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.659+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 >> 172.21.15.192:0/2058313714 conn(0x7f16500b08f0 msgr2=0x7f16500ce3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.662+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 shutdown_connections 2024-09-13T18:47:36.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.662+0000 7f1656200640 1 -- 172.21.15.192:0/2058313714 wait complete. 2024-09-13T18:47:36.687 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:36.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.836+0000 7f4431400640 1 Processor -- start 2024-09-13T18:47:36.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.836+0000 7f4431400640 1 -- start start 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f4431400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f442c15dee0 0x7f442c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f4431400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f4431400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f442c0b2f00 con 0x7f442c0b3f10 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f4431400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f442c0b3150 con 0x7f442c15dee0 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f4431400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c0b3430 con 0x7f442c15e2c0 2024-09-13T18:47:36.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.837+0000 7f442a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f442c15dee0 0x7f442c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f442c15dee0 0x7f442c0afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36176/0 (socket says 172.21.15.192:36176) 2024-09-13T18:47:36.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 -- 172.21.15.192:0/225198819 learned_addr learned my addr 172.21.15.192:0/225198819 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442b200640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 -- 172.21.15.192:0/225198819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 msgr2=0x7f442c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 -- 172.21.15.192:0/225198819 >> v1:172.21.15.194:6789/0 conn(0x7f442c0b3f10 legacy=0x7f442c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442a800640 1 -- 172.21.15.192:0/225198819 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442c0b3710 con 0x7f442c15dee0 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.838+0000 7f442b200640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.839+0000 7f442a800640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c0afd80 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f441c009870 tx=0x7f441c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22f03ce108d4e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.839+0000 7f4429400640 1 -- 172.21.15.192:0/225198819 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c032440 con 0x7f442c15dee0 2024-09-13T18:47:36.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.839+0000 7f4429400640 1 -- 172.21.15.192:0/225198819 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c0325a0 con 0x7f442c15dee0 2024-09-13T18:47:36.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.839+0000 7f4429400640 1 -- 172.21.15.192:0/225198819 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c032930 con 0x7f442c15dee0 2024-09-13T18:47:36.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 -- 172.21.15.192:0/225198819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 msgr2=0x7f442c0afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c0afd80 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f441c009870 tx=0x7f441c02a210 comp rx=0 tx=0).stop 2024-09-13T18:47:36.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 -- 172.21.15.192:0/225198819 shutdown_connections 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 --2- 172.21.15.192:0/225198819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c0afd80 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 -- 172.21.15.192:0/225198819 >> 172.21.15.192:0/225198819 conn(0x7f442c0ae960 msgr2=0x7f442c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 -- 172.21.15.192:0/225198819 shutdown_connections 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.840+0000 7f4431400640 1 -- 172.21.15.192:0/225198819 wait complete. 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.842+0000 7f4431400640 1 Processor -- start 2024-09-13T18:47:36.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.842+0000 7f4431400640 1 -- start start 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c13e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c13c7b0 0x7f442c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1406f0 con 0x7f442c15dee0 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1e3cd0 con 0x7f442c13c7b0 2024-09-13T18:47:36.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4431400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f442c1e3fb0 con 0x7f442c15e2c0 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36188/0 (socket says 172.21.15.192:36188) 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 -- 172.21.15.192:0/3553664616 learned_addr learned my addr 172.21.15.192:0/3553664616 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442b200640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c13c7b0 0x7f442c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f4429e00640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c13e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 -- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 msgr2=0x7f442c13e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c13e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 -- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c13c7b0 msgr2=0x7f442c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c13c7b0 0x7f442c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.843+0000 7f442a800640 1 -- 172.21.15.192:0/3553664616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f441c0094d0 con 0x7f442c15dee0 2024-09-13T18:47:36.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f442a800640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f441c009870 tx=0x7f441c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c030b00 con 0x7f442c15dee0 2024-09-13T18:47:36.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f441c030c60 con 0x7f442c15dee0 2024-09-13T18:47:36.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f441c03d420 con 0x7f442c15dee0 2024-09-13T18:47:36.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442c1e4290 con 0x7f442c15dee0 2024-09-13T18:47:36.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.844+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442c1e39e0 con 0x7f442c15dee0 2024-09-13T18:47:36.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.845+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442c067490 con 0x7f442c15dee0 2024-09-13T18:47:36.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.846+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f441c039040 con 0x7f442c15dee0 2024-09-13T18:47:36.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.847+0000 7f4422a00640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 0x7f440c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:36.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.847+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f441c0aa090 con 0x7f442c15dee0 2024-09-13T18:47:36.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.847+0000 7f4429e00640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 0x7f440c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:36.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.848+0000 7f4429e00640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 0x7f440c06d0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f442c159cf0 tx=0x7f4418007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:36.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:36.851+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f441c075280 con 0x7f442c15dee0 2024-09-13T18:47:37.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.022+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f442c150c00 con 0x7f442c15dee0 2024-09-13T18:47:37.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.023+0000 7f4422a00640 1 -- 172.21.15.192:0/3553664616 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f441c0788a0 con 0x7f442c15dee0 2024-09-13T18:47:37.026 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:37.027 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":196,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:36.645784+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 msgr2=0x7f440c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 0x7f440c06d0c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f442c159cf0 tx=0x7f4418007e30 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 msgr2=0x7f442c1e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f441c009870 tx=0x7f441c0046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 shutdown_connections 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f440c06ac00 0x7f440c06d0c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f442c13c7b0 0x7f442c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f442c15e2c0 0x7f442c13e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 --2- 172.21.15.192:0/3553664616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f442c15dee0 0x7f442c1e34a0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 >> 172.21.15.192:0/3553664616 conn(0x7f442c0ae960 msgr2=0x7f442c06ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 shutdown_connections 2024-09-13T18:47:37.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.026+0000 7f4431400640 1 -- 172.21.15.192:0/3553664616 wait complete. 2024-09-13T18:47:37.045 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:37.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.195+0000 7f3abce00640 1 Processor -- start 2024-09-13T18:47:37.198 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.195+0000 7f3abce00640 1 -- start start 2024-09-13T18:47:37.199 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.196+0000 7f3abce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cacd0 0x7f3ab815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3abce00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3ab815bc20 0x7f3ab80afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3abce00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab8140480 con 0x7f3ab80cb0b0 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3abce00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab815ee90 con 0x7f3ab815bc20 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3abce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab815f170 con 0x7f3ab80cacd0 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3ab815bc20 0x7f3ab80afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3ab815bc20 0x7f3ab80afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36194/0 (socket says 172.21.15.192:36194) 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 -- 172.21.15.192:0/2091619662 learned_addr learned my addr 172.21.15.192:0/2091619662 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:37.200 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab5e00640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cacd0 0x7f3ab815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 -- 172.21.15.192:0/2091619662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cacd0 msgr2=0x7f3ab815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cacd0 0x7f3ab815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 -- 172.21.15.192:0/2091619662 >> v1:172.21.15.192:6789/0 conn(0x7f3ab80cb0b0 legacy=0x7f3ab8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab6800640 1 -- 172.21.15.192:0/2091619662 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab815f450 con 0x7f3ab815bc20 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.197+0000 7f3ab4a00640 1 -- 172.21.15.192:0/2091619662 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378960322 0 0) 0x7f3ab8140480 con 0x7f3ab80cb0b0 2024-09-13T18:47:37.201 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.198+0000 7f3ab6800640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab815bc20 0x7f3ab80afd80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009870 tx=0x7f3ab002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a57f5c0b02ecf321 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3ab4a00640 1 -- 172.21.15.192:0/2091619662 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0032440 con 0x7f3ab815bc20 2024-09-13T18:47:37.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3ab4a00640 1 -- 172.21.15.192:0/2091619662 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ab00325a0 con 0x7f3ab815bc20 2024-09-13T18:47:37.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3ab4a00640 1 -- 172.21.15.192:0/2091619662 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ab0032930 con 0x7f3ab815bc20 2024-09-13T18:47:37.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 -- 172.21.15.192:0/2091619662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab815bc20 msgr2=0x7f3ab80afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.202 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab815bc20 0x7f3ab80afd80 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f3ab0009870 tx=0x7f3ab002a270 comp rx=0 tx=0).stop 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 -- 172.21.15.192:0/2091619662 shutdown_connections 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab815bc20 0x7f3ab80afd80 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 --2- 172.21.15.192:0/2091619662 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cacd0 0x7f3ab815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 -- 172.21.15.192:0/2091619662 >> 172.21.15.192:0/2091619662 conn(0x7f3ab80ae960 msgr2=0x7f3ab806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 -- 172.21.15.192:0/2091619662 shutdown_connections 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.199+0000 7f3abce00640 1 -- 172.21.15.192:0/2091619662 wait complete. 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.201+0000 7f3abce00640 1 Processor -- start 2024-09-13T18:47:37.203 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.201+0000 7f3abce00640 1 -- start start 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cb0b0 0x7f3ab81e6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ab815bc20 0x7f3ab81e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab806ade0 con 0x7f3ab80cacd0 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab813da60 con 0x7f3ab815bc20 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3abce00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab806a1d0 con 0x7f3ab80cb0b0 2024-09-13T18:47:37.206 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3ab5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3ab5e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36202/0 (socket says 172.21.15.192:36202) 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3ab5e00640 1 -- 172.21.15.192:0/747669050 learned_addr learned my addr 172.21.15.192:0/747669050 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3ab6800640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ab815bc20 0x7f3ab81e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.202+0000 7f3ab5400640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cb0b0 0x7f3ab81e6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 -- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cb0b0 msgr2=0x7f3ab81e6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cb0b0 0x7f3ab81e6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 -- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ab815bc20 msgr2=0x7f3ab81e45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ab815bc20 0x7f3ab81e45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 -- 172.21.15.192:0/747669050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00094d0 con 0x7f3ab80cacd0 2024-09-13T18:47:37.207 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3ab5e00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007e70 tx=0x7f3aa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014620 con 0x7f3ab80cacd0 2024-09-13T18:47:37.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa8014780 con 0x7f3ab80cacd0 2024-09-13T18:47:37.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8014b30 con 0x7f3ab80cacd0 2024-09-13T18:47:37.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab806a4b0 con 0x7f3ab80cacd0 2024-09-13T18:47:37.208 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.203+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab806aa70 con 0x7f3ab80cacd0 2024-09-13T18:47:37.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.204+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab806eba0 con 0x7f3ab80cacd0 2024-09-13T18:47:37.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.205+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3aa8014c90 con 0x7f3ab80cacd0 2024-09-13T18:47:37.209 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.206+0000 7f3aae000640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.206+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3aa8089c40 con 0x7f3ab80cacd0 2024-09-13T18:47:37.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.206+0000 7f3ab5400640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.210 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.207+0000 7f3ab5400640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 0x7f3a9806d0c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81e5d70 tx=0x7f3aa4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.210+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3aa8054e30 con 0x7f3ab80cacd0 2024-09-13T18:47:37.224 INFO:tasks.ceph.mds.b.smithi194.stderr:2024-09-13T18:47:37.222+0000 7f4df1400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:47:37.387 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.384+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab815e790 con 0x7f3ab80cacd0 2024-09-13T18:47:37.388 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.385+0000 7f3aae000640 1 -- 172.21.15.192:0/747669050 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+16653 (secure 0 0 0) 0x7f3aa8058450 con 0x7f3ab80cacd0 2024-09-13T18:47:37.388 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:37.388 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":196,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:36.645784+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:37.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 msgr2=0x7f3a9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 0x7f3a9806d0c0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81e5d70 tx=0x7f3aa4009040 comp rx=0 tx=0).stop 2024-09-13T18:47:37.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 msgr2=0x7f3ab8159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.390 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8007e70 tx=0x7f3aa800e4b0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 shutdown_connections 2024-09-13T18:47:37.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3a9806ac00 0x7f3a9806d0c0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3ab815bc20 0x7f3ab81e45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3ab80cb0b0 0x7f3ab81e6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.391 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 --2- 172.21.15.192:0/747669050 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3ab80cacd0 0x7f3ab8159ff0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 >> 172.21.15.192:0/747669050 conn(0x7f3ab80ae960 msgr2=0x7f3ab815cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 shutdown_connections 2024-09-13T18:47:37.392 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.387+0000 7f3abce00640 1 -- 172.21.15.192:0/747669050 wait complete. 2024-09-13T18:47:37.407 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-13T18:47:37.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.559+0000 7f7b85400640 1 Processor -- start 2024-09-13T18:47:37.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.559+0000 7f7b85400640 1 -- start start 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b85400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 0x7f7b800b4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b85400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b800b2d90 0x7f7b8006fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b85400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8006f940 con 0x7f7b80142e00 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b85400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b8006f610 con 0x7f7b800b2d90 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b85400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b800b3530 con 0x7f7b800b02f0 2024-09-13T18:47:37.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b84a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7b800b2d90 0x7f7b8006fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b7fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7b80142e00 0x7f7b800afbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36310/0 (socket says 172.21.15.192:36310) 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b7fe00640 1 -- 172.21.15.192:0/3143857359 learned_addr learned my addr 172.21.15.192:0/3143857359 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b77400640 1 --2- 172.21.15.192:0/3143857359 >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 0x7f7b800b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b84a00640 1 -- 172.21.15.192:0/3143857359 >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 msgr2=0x7f7b800b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b84a00640 1 --2- 172.21.15.192:0/3143857359 >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 0x7f7b800b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b84a00640 1 -- 172.21.15.192:0/3143857359 >> v1:172.21.15.192:6789/0 conn(0x7f7b80142e00 legacy=0x7f7b800afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b84a00640 1 -- 172.21.15.192:0/3143857359 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b800b3810 con 0x7f7b800b2d90 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b7f400640 1 -- 172.21.15.192:0/3143857359 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3858898071 0 0) 0x7f7b8006f940 con 0x7f7b80142e00 2024-09-13T18:47:37.565 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.561+0000 7f7b77400640 1 --2- 172.21.15.192:0/3143857359 >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 0x7f7b800b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:37.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.562+0000 7f7b84a00640 1 --2- 172.21.15.192:0/3143857359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b2d90 0x7f7b8006fdd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f7b8006e590 tx=0x7f7b7802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c163746bcd1c28 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b7f400640 1 -- 172.21.15.192:0/3143857359 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7802aea0 con 0x7f7b800b2d90 2024-09-13T18:47:37.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b7f400640 1 -- 172.21.15.192:0/3143857359 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7802d050 con 0x7f7b800b2d90 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b7f400640 1 -- 172.21.15.192:0/3143857359 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78007960 con 0x7f7b800b2d90 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 -- 172.21.15.192:0/3143857359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b2d90 msgr2=0x7f7b8006fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 --2- 172.21.15.192:0/3143857359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b2d90 0x7f7b8006fdd0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f7b8006e590 tx=0x7f7b7802a680 comp rx=0 tx=0).stop 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 -- 172.21.15.192:0/3143857359 shutdown_connections 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 --2- 172.21.15.192:0/3143857359 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b2d90 0x7f7b8006fdd0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 --2- 172.21.15.192:0/3143857359 >> v2:172.21.15.194:3300/0 conn(0x7f7b800b02f0 0x7f7b800b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 -- 172.21.15.192:0/3143857359 >> 172.21.15.192:0/3143857359 conn(0x7f7b800ae7f0 msgr2=0x7f7b8006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 -- 172.21.15.192:0/3143857359 shutdown_connections 2024-09-13T18:47:37.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.563+0000 7f7b85400640 1 -- 172.21.15.192:0/3143857359 wait complete. 2024-09-13T18:47:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.565+0000 7f7b85400640 1 Processor -- start 2024-09-13T18:47:37.568 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.565+0000 7f7b85400640 1 -- start start 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 0x7f7b8006aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 0x7f7b8006b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b801388c0 con 0x7f7b800b02f0 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80153710 con 0x7f7b800b2d90 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b85400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b80138ad0 con 0x7f7b80142e00 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36210/0 (socket says 172.21.15.192:36210) 2024-09-13T18:47:37.569 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.566+0000 7f7b7fe00640 1 -- 172.21.15.192:0/2895541142 learned_addr learned my addr 172.21.15.192:0/2895541142 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:37.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b77400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 0x7f7b8006aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b84a00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 0x7f7b8006b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 -- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 msgr2=0x7f7b8006b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 0x7f7b8006b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 -- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 msgr2=0x7f7b8006aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 0x7f7b8006aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 -- 172.21.15.192:0/2895541142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b78009a70 con 0x7f7b800b02f0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b77400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 0x7f7b8006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b84a00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 0x7f7b8006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7fe00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c430 tx=0x7f7b7000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b700074e0 con 0x7f7b800b02f0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b70007660 con 0x7f7b800b02f0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b80143360 con 0x7f7b800b02f0 2024-09-13T18:47:37.571 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70004a20 con 0x7f7b800b02f0 2024-09-13T18:47:37.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.567+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b80139090 con 0x7f7b800b02f0 2024-09-13T18:47:37.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.568+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b800b4910 con 0x7f7b800b02f0 2024-09-13T18:47:37.572 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.569+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7b70004b80 con 0x7f7b800b02f0 2024-09-13T18:47:37.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.570+0000 7f7b7cc00640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 0x7f7b5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:37.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.570+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b70089710 con 0x7f7b800b02f0 2024-09-13T18:47:37.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.571+0000 7f7b77400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 0x7f7b5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:37.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.571+0000 7f7b77400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 0x7f7b5c06d0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7b68006fd0 tx=0x7f7b68008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:37.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.575+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7b700549d0 con 0x7f7b800b02f0 2024-09-13T18:47:37.780 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:37.778+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7b80137fa0 con 0x7f7b800b02f0 2024-09-13T18:47:38.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.656+0000 7f7b7cc00640 1 -- 172.21.15.192:0/2895541142 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v84) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7b70057ff0 con 0x7f7b800b02f0 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 msgr2=0x7f7b5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 0x7f7b5c06d0f0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7b68006fd0 tx=0x7f7b68008040 comp rx=0 tx=0).stop 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 msgr2=0x7f7b801531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000c430 tx=0x7f7b7000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 shutdown_connections 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7b5c06ac30 0x7f7b5c06d0f0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7b80142e00 0x7f7b8006b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7b800b2d90 0x7f7b8006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 --2- 172.21.15.192:0/2895541142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b800b02f0 0x7f7b801531d0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 >> 172.21.15.192:0/2895541142 conn(0x7f7b800ae7f0 msgr2=0x7f7b8015d560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 shutdown_connections 2024-09-13T18:47:38.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.659+0000 7f7b85400640 1 -- 172.21.15.192:0/2895541142 wait complete. 2024-09-13T18:47:38.680 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-13T18:47:38.680 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-13T18:47:38.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.837+0000 7fa565a00640 1 Processor -- start 2024-09-13T18:47:38.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.837+0000 7fa565a00640 1 -- start start 2024-09-13T18:47:38.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa565a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa5600b4910 0x7fa5600b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa565a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56006f940 con 0x7fa5600b02f0 2024-09-13T18:47:38.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa565a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600b32d0 con 0x7fa560142e00 2024-09-13T18:47:38.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa565a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600b4d20 con 0x7fa5600b4910 2024-09-13T18:47:38.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa557400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fa5600b02f0 0x7fa56006fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36322/0 (socket says 172.21.15.192:36322) 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa557400640 1 -- 172.21.15.192:0/2388253397 learned_addr learned my addr 172.21.15.192:0/2388253397 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.838+0000 7fa565000640 1 --2- 172.21.15.192:0/2388253397 >> v2:172.21.15.194:3300/0 conn(0x7fa5600b4910 0x7fa5600b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.839+0000 7fa55f400640 1 -- 172.21.15.192:0/2388253397 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2563679685 0 0) 0x7fa56006f940 con 0x7fa5600b02f0 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.839+0000 7fa55f400640 1 -- 172.21.15.192:0/2388253397 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa544005730 con 0x7fa5600b02f0 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.839+0000 7fa565000640 1 -- 172.21.15.192:0/2388253397 >> v1:172.21.15.194:6789/0 conn(0x7fa560142e00 legacy=0x7fa5600afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.839+0000 7fa565000640 1 -- 172.21.15.192:0/2388253397 >> v1:172.21.15.192:6789/0 conn(0x7fa5600b02f0 legacy=0x7fa56006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.839+0000 7fa565000640 1 -- 172.21.15.192:0/2388253397 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56006f610 con 0x7fa5600b4910 2024-09-13T18:47:38.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.840+0000 7fa565000640 1 --2- 172.21.15.192:0/2388253397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b4910 0x7fa5600b2d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa558009d90 tx=0x7fa55802a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ba0e9c714256aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.840+0000 7fa55f400640 1 -- 172.21.15.192:0/2388253397 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558007740 con 0x7fa5600b4910 2024-09-13T18:47:38.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.840+0000 7fa55f400640 1 -- 172.21.15.192:0/2388253397 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55802d050 con 0x7fa5600b4910 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.840+0000 7fa55f400640 1 -- 172.21.15.192:0/2388253397 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558007ac0 con 0x7fa5600b4910 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 -- 172.21.15.192:0/2388253397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b4910 msgr2=0x7fa5600b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 --2- 172.21.15.192:0/2388253397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b4910 0x7fa5600b2d90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fa558009d90 tx=0x7fa55802a6f0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 -- 172.21.15.192:0/2388253397 shutdown_connections 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 --2- 172.21.15.192:0/2388253397 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b4910 0x7fa5600b2d90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 -- 172.21.15.192:0/2388253397 >> 172.21.15.192:0/2388253397 conn(0x7fa5600ae7f0 msgr2=0x7fa56006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 -- 172.21.15.192:0/2388253397 shutdown_connections 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.841+0000 7fa565a00640 1 -- 172.21.15.192:0/2388253397 wait complete. 2024-09-13T18:47:38.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.843+0000 7fa565a00640 1 Processor -- start 2024-09-13T18:47:38.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.843+0000 7fa565a00640 1 -- start start 2024-09-13T18:47:38.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b02f0 0x7fa5601341f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa560142e00 0x7fa5601f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560138390 con 0x7fa5600b4910 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560138650 con 0x7fa5600b02f0 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560138930 con 0x7fa560142e00 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa557400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa557400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36222/0 (socket says 172.21.15.192:36222) 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa557400640 1 -- 172.21.15.192:0/1502119769 learned_addr learned my addr 172.21.15.192:0/1502119769 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa55fe00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b02f0 0x7fa5601341f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.844+0000 7fa565000640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa560142e00 0x7fa5601f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 -- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa560142e00 msgr2=0x7fa5601f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa560142e00 0x7fa5601f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 -- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b02f0 msgr2=0x7fa5601341f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:38.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b02f0 0x7fa5601341f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:38.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 -- 172.21.15.192:0/1502119769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009a70 con 0x7fa5600b4910 2024-09-13T18:47:38.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa557400640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c500 tx=0x7fa54800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548005ce0 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548005e40 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548007330 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.845+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa560138c10 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.846+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560134910 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.846+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa560138e30 con 0x7fa5600b4910 2024-09-13T18:47:38.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.847+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa548007550 con 0x7fa5600b4910 2024-09-13T18:47:38.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.848+0000 7fa55cc00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 0x7fa53c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:38.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.848+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa5480889c0 con 0x7fa5600b4910 2024-09-13T18:47:38.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.848+0000 7fa55fe00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 0x7fa53c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:38.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.849+0000 7fa55fe00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 0x7fa53c06d0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f60 tx=0x7fa550009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:38.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:38.852+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa548053d00 con 0x7fa5600b4910 2024-09-13T18:47:39.032 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:39.036 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:47:39.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.058+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa5600afbe0 con 0x7fa5600b4910 2024-09-13T18:47:39.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.666+0000 7fa55cc00640 1 -- 172.21.15.192:0/1502119769 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v85) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa548017020 con 0x7fa5600b4910 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 msgr2=0x7fa53c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 0x7fa53c06d0c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fa550000f60 tx=0x7fa550009040 comp rx=0 tx=0).stop 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 msgr2=0x7fa5601f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c500 tx=0x7fa54800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 shutdown_connections 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa53c06ac00 0x7fa53c06d0c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa560142e00 0x7fa5601f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.672 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa5600b4910 0x7fa5601f1f30 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 --2- 172.21.15.192:0/1502119769 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa5600b02f0 0x7fa5601341f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 >> 172.21.15.192:0/1502119769 conn(0x7fa5600ae7f0 msgr2=0x7fa5600cdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 shutdown_connections 2024-09-13T18:47:39.673 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.669+0000 7fa565a00640 1 -- 172.21.15.192:0/1502119769 wait complete. 2024-09-13T18:47:39.689 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-13T18:47:39.689 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:39.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.836+0000 7f603f800640 1 Processor -- start 2024-09-13T18:47:39.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.836+0000 7f603f800640 1 -- start start 2024-09-13T18:47:39.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 0x7f603815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603f800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380b2f00 con 0x7f603815dee0 2024-09-13T18:47:39.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603f800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60380b3150 con 0x7f60380b3f10 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60380b3430 con 0x7f60380b0490 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603ce00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f603815dee0 0x7f60380afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36330/0 (socket says 172.21.15.192:36330) 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603ce00640 1 -- 172.21.15.192:0/54403831 learned_addr learned my addr 172.21.15.192:0/54403831 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f603d800640 1 --2- 172.21.15.192:0/54403831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 0x7f603815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316285454 0 0) 0x7f60380b2f00 con 0x7f603815dee0 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.838+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6020005730 con 0x7f603815dee0 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.839+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492021602 0 0) 0x7f60380b3150 con 0x7f60380b3f10 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.839+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60380b2f00 con 0x7f60380b3f10 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.839+0000 7f603d800640 1 -- 172.21.15.192:0/54403831 >> v1:172.21.15.194:6789/0 conn(0x7f60380b3f10 legacy=0x7f603815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.839+0000 7f603d800640 1 -- 172.21.15.192:0/54403831 >> v1:172.21.15.192:6789/0 conn(0x7f603815dee0 legacy=0x7f60380afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.839+0000 7f603d800640 1 -- 172.21.15.192:0/54403831 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60380b3710 con 0x7f60380b0490 2024-09-13T18:47:39.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.840+0000 7f603d800640 1 --2- 172.21.15.192:0/54403831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 0x7f603815ab50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6030009dc0 tx=0x7f603002a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41f9f5e67b175267 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.840+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030007740 con 0x7f60380b0490 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.840+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603002d050 con 0x7f60380b0490 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.840+0000 7f6037400640 1 -- 172.21.15.192:0/54403831 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6030007ac0 con 0x7f60380b0490 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 -- 172.21.15.192:0/54403831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 msgr2=0x7f603815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 --2- 172.21.15.192:0/54403831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 0x7f603815ab50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6030009dc0 tx=0x7f603002a6d0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 -- 172.21.15.192:0/54403831 shutdown_connections 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 --2- 172.21.15.192:0/54403831 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f60380b0490 0x7f603815ab50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 -- 172.21.15.192:0/54403831 >> 172.21.15.192:0/54403831 conn(0x7f60380ae960 msgr2=0x7f603806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 -- 172.21.15.192:0/54403831 shutdown_connections 2024-09-13T18:47:39.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.841+0000 7f603f800640 1 -- 172.21.15.192:0/54403831 wait complete. 2024-09-13T18:47:39.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.842+0000 7f603f800640 1 Processor -- start 2024-09-13T18:47:39.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.843+0000 7f603f800640 1 -- start start 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.843+0000 7f603f800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60380b0490 0x7f60381364a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.843+0000 7f603f800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603815dee0 0x7f603806a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603f800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603f800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603813d6c0 con 0x7f60381e4690 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603f800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603806bd30 con 0x7f60380b0490 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603f800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603806b1b0 con 0x7f603815dee0 2024-09-13T18:47:39.848 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36226/0 (socket says 172.21.15.192:36226) 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 -- 172.21.15.192:0/1445094644 learned_addr learned my addr 172.21.15.192:0/1445094644 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f6037e00640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603815dee0 0x7f603806a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603ce00640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60380b0490 0x7f60381364a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 -- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603815dee0 msgr2=0x7f603806a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603815dee0 0x7f603806a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 -- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60380b0490 msgr2=0x7f60381364a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60380b0490 0x7f60381364a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.844+0000 7f603d800640 1 -- 172.21.15.192:0/1445094644 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6030009a70 con 0x7f60381e4690 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f603d800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6030009ee0 tx=0x7f6030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603003c830 con 0x7f60381e4690 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f603003c990 con 0x7f60381e4690 2024-09-13T18:47:39.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f603003cd20 con 0x7f60381e4690 2024-09-13T18:47:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603806b490 con 0x7f60381e4690 2024-09-13T18:47:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.845+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60381369e0 con 0x7f60381e4690 2024-09-13T18:47:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.846+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f603806b880 con 0x7f60381e4690 2024-09-13T18:47:39.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.847+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6030031400 con 0x7f60381e4690 2024-09-13T18:47:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.848+0000 7f6034c00640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 0x7f601806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.848+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60300aa750 con 0x7f60381e4690 2024-09-13T18:47:39.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.848+0000 7f603ce00640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 0x7f601806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:39.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.849+0000 7f603ce00640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 0x7f601806d0f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f602c000f60 tx=0x7f602c007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:39.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:39.853+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f60300759d0 con 0x7f60381e4690 2024-09-13T18:47:40.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.053+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60380afd80 con 0x7f60381e4690 2024-09-13T18:47:40.056 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.054+0000 7f6034c00640 1 -- 172.21.15.192:0/1445094644 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7f6030078ff0 con 0x7f60381e4690 2024-09-13T18:47:40.057 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:40.057 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:47:40.057 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:47:40.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 msgr2=0x7f601806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 0x7f601806d0f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f602c000f60 tx=0x7f602c007d50 comp rx=0 tx=0).stop 2024-09-13T18:47:40.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 msgr2=0x7f603813be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6030009ee0 tx=0x7f6030004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:40.059 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 shutdown_connections 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f601806ac30 0x7f601806d0f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60381e4690 0x7f603813be10 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f603815dee0 0x7f603806a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 --2- 172.21.15.192:0/1445094644 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f60380b0490 0x7f60381364a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 >> 172.21.15.192:0/1445094644 conn(0x7f60380ae960 msgr2=0x7f60380b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 shutdown_connections 2024-09-13T18:47:40.060 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.056+0000 7f603f800640 1 -- 172.21.15.192:0/1445094644 wait complete. 2024-09-13T18:47:40.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:47:40.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.226+0000 7f4089000640 1 Processor -- start 2024-09-13T18:47:40.229 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.226+0000 7f4089000640 1 -- start start 2024-09-13T18:47:40.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.227+0000 7f4089000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f40840cacd0 0x7f408415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.227+0000 7f4089000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4084140480 con 0x7f408415bc20 2024-09-13T18:47:40.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.227+0000 7f4089000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40840cb520 con 0x7f40840cb0b0 2024-09-13T18:47:40.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.227+0000 7f4089000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408415ee90 con 0x7f40840cacd0 2024-09-13T18:47:40.230 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.227+0000 7f4082800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f408415bc20 0x7f40840afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:36334/0 (socket says 172.21.15.192:36334) 2024-09-13T18:47:40.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4082800640 1 -- 172.21.15.192:0/4129121816 learned_addr learned my addr 172.21.15.192:0/4129121816 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:40.231 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081e00640 1 --2- 172.21.15.192:0/4129121816 >> v2:172.21.15.194:3300/0 conn(0x7f40840cacd0 0x7f408415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3544709942 0 0) 0x7f4084140480 con 0x7f408415bc20 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4068003520 con 0x7f408415bc20 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 204344671 0 0) 0x7f40840cb520 con 0x7f40840cb0b0 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4084140480 con 0x7f40840cb0b0 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081e00640 1 -- 172.21.15.192:0/4129121816 >> v1:172.21.15.194:6789/0 conn(0x7f40840cb0b0 legacy=0x7f4084140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081e00640 1 -- 172.21.15.192:0/4129121816 >> v1:172.21.15.192:6789/0 conn(0x7f408415bc20 legacy=0x7f40840afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.228+0000 7f4081e00640 1 -- 172.21.15.192:0/4129121816 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408415f170 con 0x7f40840cacd0 2024-09-13T18:47:40.232 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.229+0000 7f4081e00640 1 --2- 172.21.15.192:0/4129121816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408415e790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f40740097a0 tx=0x7f407402a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=602d0d5c5add9b7d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.229+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074032440 con 0x7f40840cacd0 2024-09-13T18:47:40.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.229+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40740325a0 con 0x7f40840cacd0 2024-09-13T18:47:40.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.229+0000 7f4081400640 1 -- 172.21.15.192:0/4129121816 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074032930 con 0x7f40840cacd0 2024-09-13T18:47:40.233 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 -- 172.21.15.192:0/4129121816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 msgr2=0x7f408415e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 --2- 172.21.15.192:0/4129121816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408415e790 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f40740097a0 tx=0x7f407402a230 comp rx=0 tx=0).stop 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 -- 172.21.15.192:0/4129121816 shutdown_connections 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 --2- 172.21.15.192:0/4129121816 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408415e790 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 -- 172.21.15.192:0/4129121816 >> 172.21.15.192:0/4129121816 conn(0x7f40840ae960 msgr2=0x7f408406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 -- 172.21.15.192:0/4129121816 shutdown_connections 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.230+0000 7f4089000640 1 -- 172.21.15.192:0/4129121816 wait complete. 2024-09-13T18:47:40.234 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.232+0000 7f4089000640 1 Processor -- start 2024-09-13T18:47:40.235 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.232+0000 7f4089000640 1 -- start start 2024-09-13T18:47:40.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408413d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f408415bc20 0x7f40840aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.236 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408413db50 con 0x7f40840cb0b0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40840b31e0 con 0x7f40840cacd0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4089000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40840b34c0 con 0x7f408415bc20 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f407be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f407be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36236/0 (socket says 172.21.15.192:36236) 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f407be00640 1 -- 172.21.15.192:0/3406985856 learned_addr learned my addr 172.21.15.192:0/3406985856 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408413d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4082800640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f408415bc20 0x7f40840aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 -- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f408415bc20 msgr2=0x7f40840aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f408415bc20 0x7f40840aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 -- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 msgr2=0x7f40840ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f4081e00640 1 -- 172.21.15.192:0/3406985856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4074009400 con 0x7f40840cacd0 2024-09-13T18:47:40.237 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.233+0000 7f407be00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f4081e00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408413d610 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f40840ce980 tx=0x7f40740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074006e10 con 0x7f40840cacd0 2024-09-13T18:47:40.238 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4074030980 con 0x7f40840cacd0 2024-09-13T18:47:40.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074030d10 con 0x7f40840cacd0 2024-09-13T18:47:40.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40840b37a0 con 0x7f40840cacd0 2024-09-13T18:47:40.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.234+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40840aa2d0 con 0x7f40840cacd0 2024-09-13T18:47:40.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.235+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408415e790 con 0x7f40840cacd0 2024-09-13T18:47:40.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.236+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4074039040 con 0x7f40840cacd0 2024-09-13T18:47:40.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.237+0000 7f407a000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 0x7f406006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.237+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40740a9b70 con 0x7f40840cacd0 2024-09-13T18:47:40.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.237+0000 7f407be00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 0x7f406006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.238+0000 7f407be00640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 0x7f406006d0c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f40840b4ed0 tx=0x7f406c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.245 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.242+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4074074df0 con 0x7f40840cacd0 2024-09-13T18:47:40.415 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.412+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f408406c6c0 con 0x7f40840cacd0 2024-09-13T18:47:40.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.414+0000 7f407a000640 1 -- 172.21.15.192:0/3406985856 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v197) v1 ==== 74+0+16640 (secure 0 0 0) 0x7f4074078410 con 0x7f40840cacd0 2024-09-13T18:47:40.417 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:40.417 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":197,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:47:37.649727+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"197","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 msgr2=0x7f406006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 0x7f406006d0c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f40840b4ed0 tx=0x7f406c009040 comp rx=0 tx=0).stop 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 msgr2=0x7f408413d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408413d610 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f40840ce980 tx=0x7f40740046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 shutdown_connections 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f406006ac00 0x7f406006d0c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f408415bc20 0x7f40840aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40840cb0b0 0x7f40840ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.419 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 --2- 172.21.15.192:0/3406985856 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40840cacd0 0x7f408413d610 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 >> 172.21.15.192:0/3406985856 conn(0x7f40840ae960 msgr2=0x7f408415dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 shutdown_connections 2024-09-13T18:47:40.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.416+0000 7f4089000640 1 -- 172.21.15.192:0/3406985856 wait complete. 2024-09-13T18:47:40.436 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-09-13T18:47:40.436 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:40.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.586+0000 7f941a600640 1 Processor -- start 2024-09-13T18:47:40.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.586+0000 7f941a600640 1 -- start start 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f941a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 0x7f94140cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f941a600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94140cdb80 0x7f94140b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f941a600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941406ba10 con 0x7f941415ce40 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f941a600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140ce030 con 0x7f94140cdb80 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f941a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941415d220 con 0x7f941406a8b0 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f9419c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94140cdb80 0x7f94140b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f9419c00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f94140cdb80 0x7f94140b6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45778/0 (socket says 172.21.15.192:45778) 2024-09-13T18:47:40.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f9419c00640 1 -- 172.21.15.192:0/74575810 learned_addr learned my addr 172.21.15.192:0/74575810 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:40.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.587+0000 7f9413e00640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 0x7f94140cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9419c00640 1 -- 172.21.15.192:0/74575810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 msgr2=0x7f94140cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.591 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9419c00640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 0x7f94140cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9419c00640 1 -- 172.21.15.192:0/74575810 >> v1:172.21.15.194:6789/0 conn(0x7f941415ce40 legacy=0x7f94140d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9419c00640 1 -- 172.21.15.192:0/74575810 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941406ae00 con 0x7f94140cdb80 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9413e00640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 0x7f94140cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.588+0000 7f9419c00640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94140cdb80 0x7f94140b6000 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f940c009e50 tx=0x7f940c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2791899f697f127e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f9413400640 1 -- 172.21.15.192:0/74575810 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c02aea0 con 0x7f94140cdb80 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f9413400640 1 -- 172.21.15.192:0/74575810 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c02d050 con 0x7f94140cdb80 2024-09-13T18:47:40.592 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f9413400640 1 -- 172.21.15.192:0/74575810 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c031820 con 0x7f94140cdb80 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 -- 172.21.15.192:0/74575810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94140cdb80 msgr2=0x7f94140b6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94140cdb80 0x7f94140b6000 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f940c009e50 tx=0x7f940c02a6c0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 -- 172.21.15.192:0/74575810 shutdown_connections 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f94140cdb80 0x7f94140b6000 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 --2- 172.21.15.192:0/74575810 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941406a8b0 0x7f94140cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 -- 172.21.15.192:0/74575810 >> 172.21.15.192:0/74575810 conn(0x7f94140d2d50 msgr2=0x7f94140d3130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.589+0000 7f941a600640 1 -- 172.21.15.192:0/74575810 shutdown_connections 2024-09-13T18:47:40.593 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.590+0000 7f941a600640 1 -- 172.21.15.192:0/74575810 wait complete. 2024-09-13T18:47:40.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.591+0000 7f941a600640 1 Processor -- start 2024-09-13T18:47:40.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.591+0000 7f941a600640 1 -- start start 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94140cdb80 0x7f94140cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941415ce40 0x7f94140c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94141536a0 con 0x7f941406a8b0 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140c7290 con 0x7f94140cdb80 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f941a600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94140c7570 con 0x7f941415ce40 2024-09-13T18:47:40.596 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f9419200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f9419200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45780/0 (socket says 172.21.15.192:45780) 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f9419200640 1 -- 172.21.15.192:0/782824526 learned_addr learned my addr 172.21.15.192:0/782824526 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.592+0000 7f9413e00640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94140cdb80 0x7f94140cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419c00640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941415ce40 0x7f94140c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 -- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941415ce40 msgr2=0x7f94140c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941415ce40 0x7f94140c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 -- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94140cdb80 msgr2=0x7f94140cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94140cdb80 0x7f94140cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 -- 172.21.15.192:0/782824526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009b30 con 0x7f941406a8b0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9419200640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f940800b3f0 tx=0x7f940800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408011830 con 0x7f941406a8b0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9408011990 con 0x7f941406a8b0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408011d40 con 0x7f941406a8b0 2024-09-13T18:47:40.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.593+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94140c7850 con 0x7f941406a8b0 2024-09-13T18:47:40.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.594+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140c7e10 con 0x7f941406a8b0 2024-09-13T18:47:40.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.594+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94140cd640 con 0x7f941406a8b0 2024-09-13T18:47:40.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.595+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f940801a400 con 0x7f941406a8b0 2024-09-13T18:47:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.596+0000 7f9410c00640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.596+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94080890c0 con 0x7f941406a8b0 2024-09-13T18:47:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.596+0000 7f9413e00640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.597+0000 7f9413e00640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 0x7f93f406d0c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f94141f6060 tx=0x7f9400008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.600+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f94080542b0 con 0x7f941406a8b0 2024-09-13T18:47:40.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.766+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f94140b8200 con 0x7f93f406ac00 2024-09-13T18:47:40.777 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.774+0000 7f9410c00640 1 -- 172.21.15.192:0/782824526 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+283209 (secure 0 0 0) 0x7f94140b8200 con 0x7f93f406ac00 2024-09-13T18:47:40.780 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:40.782 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:47:40.783 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 msgr2=0x7f93f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 0x7f93f406d0c0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f94141f6060 tx=0x7f9400008040 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 msgr2=0x7f9414152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f940800b3f0 tx=0x7f940800b8b0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 shutdown_connections 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93f406ac00 0x7f93f406d0c0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f941415ce40 0x7f94140c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f94140cdb80 0x7f94140cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 --2- 172.21.15.192:0/782824526 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f941406a8b0 0x7f9414152b70 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 >> 172.21.15.192:0/782824526 conn(0x7f94140d2d50 msgr2=0x7f94140d1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 shutdown_connections 2024-09-13T18:47:40.784 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.778+0000 7f941a600640 1 -- 172.21.15.192:0/782824526 wait complete. 2024-09-13T18:47:40.797 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2024-09-13T18:47:38.899780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592640,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":195,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":170,"acting":170,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":140,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9813,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552686,"statfs":{"total":1600000000,"available":1589950579,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2272,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000641"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658617+0000","last_change":"2024-09-13T18:47:36.661864+0000","last_active":"2024-09-13T18:47:37.658617+0000","last_peered":"2024-09-13T18:47:37.658617+0000","last_clean":"2024-09-13T18:47:37.658617+0000","last_became_active":"2024-09-13T18:47:36.661668+0000","last_became_peered":"2024-09-13T18:47:36.661668+0000","last_unstale":"2024-09-13T18:47:37.658617+0000","last_undegraded":"2024-09-13T18:47:37.658617+0000","last_fullsized":"2024-09-13T18:47:37.658617+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:12.904196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657979+0000","last_change":"2024-09-13T18:47:36.661890+0000","last_active":"2024-09-13T18:47:37.657979+0000","last_peered":"2024-09-13T18:47:37.657979+0000","last_clean":"2024-09-13T18:47:37.657979+0000","last_became_active":"2024-09-13T18:47:36.661647+0000","last_became_peered":"2024-09-13T18:47:36.661647+0000","last_unstale":"2024-09-13T18:47:37.657979+0000","last_undegraded":"2024-09-13T18:47:37.657979+0000","last_fullsized":"2024-09-13T18:47:37.657979+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:28.662400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658066+0000","last_change":"2024-09-13T18:47:36.661224+0000","last_active":"2024-09-13T18:47:37.658066+0000","last_peered":"2024-09-13T18:47:37.658066+0000","last_clean":"2024-09-13T18:47:37.658066+0000","last_became_active":"2024-09-13T18:47:36.660848+0000","last_became_peered":"2024-09-13T18:47:36.660848+0000","last_unstale":"2024-09-13T18:47:37.658066+0000","last_undegraded":"2024-09-13T18:47:37.658066+0000","last_fullsized":"2024-09-13T18:47:37.658066+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867974+0000","last_change":"2024-09-13T18:47:36.669907+0000","last_active":"2024-09-13T18:47:37.867974+0000","last_peered":"2024-09-13T18:47:37.867974+0000","last_clean":"2024-09-13T18:47:37.867974+0000","last_became_active":"2024-09-13T18:47:36.668320+0000","last_became_peered":"2024-09-13T18:47:36.668320+0000","last_unstale":"2024-09-13T18:47:37.867974+0000","last_undegraded":"2024-09-13T18:47:37.867974+0000","last_fullsized":"2024-09-13T18:47:37.867974+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:46.218122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867966+0000","last_change":"2024-09-13T18:47:36.662868+0000","last_active":"2024-09-13T18:47:37.867966+0000","last_peered":"2024-09-13T18:47:37.867966+0000","last_clean":"2024-09-13T18:47:37.867966+0000","last_became_active":"2024-09-13T18:47:36.662152+0000","last_became_peered":"2024-09-13T18:47:36.662152+0000","last_unstale":"2024-09-13T18:47:37.867966+0000","last_undegraded":"2024-09-13T18:47:37.867966+0000","last_fullsized":"2024-09-13T18:47:37.867966+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:45.446183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654511+0000","last_change":"2024-09-13T18:47:36.673472+0000","last_active":"2024-09-13T18:47:37.654511+0000","last_peered":"2024-09-13T18:47:37.654511+0000","last_clean":"2024-09-13T18:47:37.654511+0000","last_became_active":"2024-09-13T18:47:36.673250+0000","last_became_peered":"2024-09-13T18:47:36.673250+0000","last_unstale":"2024-09-13T18:47:37.654511+0000","last_undegraded":"2024-09-13T18:47:37.654511+0000","last_fullsized":"2024-09-13T18:47:37.654511+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:15.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868721+0000","last_change":"2024-09-13T18:47:36.664565+0000","last_active":"2024-09-13T18:47:37.868721+0000","last_peered":"2024-09-13T18:47:37.868721+0000","last_clean":"2024-09-13T18:47:37.868721+0000","last_became_active":"2024-09-13T18:47:36.661677+0000","last_became_peered":"2024-09-13T18:47:36.661677+0000","last_unstale":"2024-09-13T18:47:37.868721+0000","last_undegraded":"2024-09-13T18:47:37.868721+0000","last_fullsized":"2024-09-13T18:47:37.868721+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:06.278126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867252+0000","last_change":"2024-09-13T18:47:36.662565+0000","last_active":"2024-09-13T18:47:37.867252+0000","last_peered":"2024-09-13T18:47:37.867252+0000","last_clean":"2024-09-13T18:47:37.867252+0000","last_became_active":"2024-09-13T18:47:36.662122+0000","last_became_peered":"2024-09-13T18:47:36.662122+0000","last_unstale":"2024-09-13T18:47:37.867252+0000","last_undegraded":"2024-09-13T18:47:37.867252+0000","last_fullsized":"2024-09-13T18:47:37.867252+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:42.388111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867252+0000","last_change":"2024-09-13T18:47:36.664646+0000","last_active":"2024-09-13T18:47:37.867252+0000","last_peered":"2024-09-13T18:47:37.867252+0000","last_clean":"2024-09-13T18:47:37.867252+0000","last_became_active":"2024-09-13T18:47:36.664122+0000","last_became_peered":"2024-09-13T18:47:36.664122+0000","last_unstale":"2024-09-13T18:47:37.867252+0000","last_undegraded":"2024-09-13T18:47:37.867252+0000","last_fullsized":"2024-09-13T18:47:37.867252+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:28.662400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867710+0000","last_change":"2024-09-13T18:47:36.661874+0000","last_active":"2024-09-13T18:47:37.867710+0000","last_peered":"2024-09-13T18:47:37.867710+0000","last_clean":"2024-09-13T18:47:37.867710+0000","last_became_active":"2024-09-13T18:47:36.661593+0000","last_became_peered":"2024-09-13T18:47:36.661593+0000","last_unstale":"2024-09-13T18:47:37.867710+0000","last_undegraded":"2024-09-13T18:47:37.867710+0000","last_fullsized":"2024-09-13T18:47:37.867710+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:33.424281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867544+0000","last_change":"2024-09-13T18:47:36.669840+0000","last_active":"2024-09-13T18:47:37.867544+0000","last_peered":"2024-09-13T18:47:37.867544+0000","last_clean":"2024-09-13T18:47:37.867544+0000","last_became_active":"2024-09-13T18:47:36.669514+0000","last_became_peered":"2024-09-13T18:47:36.669514+0000","last_unstale":"2024-09-13T18:47:37.867544+0000","last_undegraded":"2024-09-13T18:47:37.867544+0000","last_fullsized":"2024-09-13T18:47:37.867544+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658377+0000","last_change":"2024-09-13T18:47:36.664243+0000","last_active":"2024-09-13T18:47:37.658377+0000","last_peered":"2024-09-13T18:47:37.658377+0000","last_clean":"2024-09-13T18:47:37.658377+0000","last_became_active":"2024-09-13T18:47:36.663264+0000","last_became_peered":"2024-09-13T18:47:36.663264+0000","last_unstale":"2024-09-13T18:47:37.658377+0000","last_undegraded":"2024-09-13T18:47:37.658377+0000","last_fullsized":"2024-09-13T18:47:37.658377+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:34.255552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657964+0000","last_change":"2024-09-13T18:47:36.673118+0000","last_active":"2024-09-13T18:47:37.657964+0000","last_peered":"2024-09-13T18:47:37.657964+0000","last_clean":"2024-09-13T18:47:37.657964+0000","last_became_active":"2024-09-13T18:47:36.671634+0000","last_became_peered":"2024-09-13T18:47:36.671634+0000","last_unstale":"2024-09-13T18:47:37.657964+0000","last_undegraded":"2024-09-13T18:47:37.657964+0000","last_fullsized":"2024-09-13T18:47:37.657964+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.114294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867391+0000","last_change":"2024-09-13T18:47:36.664493+0000","last_active":"2024-09-13T18:47:37.867391+0000","last_peered":"2024-09-13T18:47:37.867391+0000","last_clean":"2024-09-13T18:47:37.867391+0000","last_became_active":"2024-09-13T18:47:36.663207+0000","last_became_peered":"2024-09-13T18:47:36.663207+0000","last_unstale":"2024-09-13T18:47:37.867391+0000","last_undegraded":"2024-09-13T18:47:37.867391+0000","last_fullsized":"2024-09-13T18:47:37.867391+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.088394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867786+0000","last_change":"2024-09-13T18:47:36.668519+0000","last_active":"2024-09-13T18:47:37.867786+0000","last_peered":"2024-09-13T18:47:37.867786+0000","last_clean":"2024-09-13T18:47:37.867786+0000","last_became_active":"2024-09-13T18:47:36.668138+0000","last_became_peered":"2024-09-13T18:47:36.668138+0000","last_unstale":"2024-09-13T18:47:37.867786+0000","last_undegraded":"2024-09-13T18:47:37.867786+0000","last_fullsized":"2024-09-13T18:47:37.867786+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:47.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867847+0000","last_change":"2024-09-13T18:47:36.667789+0000","last_active":"2024-09-13T18:47:37.867847+0000","last_peered":"2024-09-13T18:47:37.867847+0000","last_clean":"2024-09-13T18:47:37.867847+0000","last_became_active":"2024-09-13T18:47:36.667384+0000","last_became_peered":"2024-09-13T18:47:36.667384+0000","last_unstale":"2024-09-13T18:47:37.867847+0000","last_undegraded":"2024-09-13T18:47:37.867847+0000","last_fullsized":"2024-09-13T18:47:37.867847+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:54.602448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654664+0000","last_change":"2024-09-13T18:47:36.666114+0000","last_active":"2024-09-13T18:47:37.654664+0000","last_peered":"2024-09-13T18:47:37.654664+0000","last_clean":"2024-09-13T18:47:37.654664+0000","last_became_active":"2024-09-13T18:47:36.665672+0000","last_became_peered":"2024-09-13T18:47:36.665672+0000","last_unstale":"2024-09-13T18:47:37.654664+0000","last_undegraded":"2024-09-13T18:47:37.654664+0000","last_fullsized":"2024-09-13T18:47:37.654664+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:49.496985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867321+0000","last_change":"2024-09-13T18:47:36.663016+0000","last_active":"2024-09-13T18:47:37.867321+0000","last_peered":"2024-09-13T18:47:37.867321+0000","last_clean":"2024-09-13T18:47:37.867321+0000","last_became_active":"2024-09-13T18:47:36.662775+0000","last_became_peered":"2024-09-13T18:47:36.662775+0000","last_unstale":"2024-09-13T18:47:37.867321+0000","last_undegraded":"2024-09-13T18:47:37.867321+0000","last_fullsized":"2024-09-13T18:47:37.867321+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867672+0000","last_change":"2024-09-13T18:47:36.674991+0000","last_active":"2024-09-13T18:47:37.867672+0000","last_peered":"2024-09-13T18:47:37.867672+0000","last_clean":"2024-09-13T18:47:37.867672+0000","last_became_active":"2024-09-13T18:47:36.670790+0000","last_became_peered":"2024-09-13T18:47:36.670790+0000","last_unstale":"2024-09-13T18:47:37.867672+0000","last_undegraded":"2024-09-13T18:47:37.867672+0000","last_fullsized":"2024-09-13T18:47:37.867672+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:51.215456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658033+0000","last_change":"2024-09-13T18:47:36.660207+0000","last_active":"2024-09-13T18:47:37.658033+0000","last_peered":"2024-09-13T18:47:37.658033+0000","last_clean":"2024-09-13T18:47:37.658033+0000","last_became_active":"2024-09-13T18:47:36.659987+0000","last_became_peered":"2024-09-13T18:47:36.659987+0000","last_unstale":"2024-09-13T18:47:37.658033+0000","last_undegraded":"2024-09-13T18:47:37.658033+0000","last_fullsized":"2024-09-13T18:47:37.658033+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:54.622550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654631+0000","last_change":"2024-09-13T18:47:36.669332+0000","last_active":"2024-09-13T18:47:37.654631+0000","last_peered":"2024-09-13T18:47:37.654631+0000","last_clean":"2024-09-13T18:47:37.654631+0000","last_became_active":"2024-09-13T18:47:36.667384+0000","last_became_peered":"2024-09-13T18:47:36.667384+0000","last_unstale":"2024-09-13T18:47:37.654631+0000","last_undegraded":"2024-09-13T18:47:37.654631+0000","last_fullsized":"2024-09-13T18:47:37.654631+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:30.065102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867586+0000","last_change":"2024-09-13T18:47:36.670605+0000","last_active":"2024-09-13T18:47:37.867586+0000","last_peered":"2024-09-13T18:47:37.867586+0000","last_clean":"2024-09-13T18:47:37.867586+0000","last_became_active":"2024-09-13T18:47:36.670395+0000","last_became_peered":"2024-09-13T18:47:36.670395+0000","last_unstale":"2024-09-13T18:47:37.867586+0000","last_undegraded":"2024-09-13T18:47:37.867586+0000","last_fullsized":"2024-09-13T18:47:37.867586+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:37:19.969319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867281+0000","last_change":"2024-09-13T18:47:36.665054+0000","last_active":"2024-09-13T18:47:37.867281+0000","last_peered":"2024-09-13T18:47:37.867281+0000","last_clean":"2024-09-13T18:47:37.867281+0000","last_became_active":"2024-09-13T18:47:36.664834+0000","last_became_peered":"2024-09-13T18:47:36.664834+0000","last_unstale":"2024-09-13T18:47:37.867281+0000","last_undegraded":"2024-09-13T18:47:37.867281+0000","last_fullsized":"2024-09-13T18:47:37.867281+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:01.048756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868012+0000","last_change":"2024-09-13T18:47:36.663069+0000","last_active":"2024-09-13T18:47:37.868012+0000","last_peered":"2024-09-13T18:47:37.868012+0000","last_clean":"2024-09-13T18:47:37.868012+0000","last_became_active":"2024-09-13T18:47:36.662649+0000","last_became_peered":"2024-09-13T18:47:36.662649+0000","last_unstale":"2024-09-13T18:47:37.868012+0000","last_undegraded":"2024-09-13T18:47:37.868012+0000","last_fullsized":"2024-09-13T18:47:37.868012+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:28.441914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867667+0000","last_change":"2024-09-13T18:47:36.674337+0000","last_active":"2024-09-13T18:47:37.867667+0000","last_peered":"2024-09-13T18:47:37.867667+0000","last_clean":"2024-09-13T18:47:37.867667+0000","last_became_active":"2024-09-13T18:47:36.674117+0000","last_became_peered":"2024-09-13T18:47:36.674117+0000","last_unstale":"2024-09-13T18:47:37.867667+0000","last_undegraded":"2024-09-13T18:47:37.867667+0000","last_fullsized":"2024-09-13T18:47:37.867667+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:45.863229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868399+0000","last_change":"2024-09-13T18:47:36.672250+0000","last_active":"2024-09-13T18:47:37.868399+0000","last_peered":"2024-09-13T18:47:37.868399+0000","last_clean":"2024-09-13T18:47:37.868399+0000","last_became_active":"2024-09-13T18:47:36.672021+0000","last_became_peered":"2024-09-13T18:47:36.672021+0000","last_unstale":"2024-09-13T18:47:37.868399+0000","last_undegraded":"2024-09-13T18:47:37.868399+0000","last_fullsized":"2024-09-13T18:47:37.868399+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.678978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657948+0000","last_change":"2024-09-13T18:47:36.660579+0000","last_active":"2024-09-13T18:47:37.657948+0000","last_peered":"2024-09-13T18:47:37.657948+0000","last_clean":"2024-09-13T18:47:37.657948+0000","last_became_active":"2024-09-13T18:47:36.660352+0000","last_became_peered":"2024-09-13T18:47:36.660352+0000","last_unstale":"2024-09-13T18:47:37.657948+0000","last_undegraded":"2024-09-13T18:47:37.657948+0000","last_fullsized":"2024-09-13T18:47:37.657948+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.847089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867831+0000","last_change":"2024-09-13T18:47:36.661312+0000","last_active":"2024-09-13T18:47:37.867831+0000","last_peered":"2024-09-13T18:47:37.867831+0000","last_clean":"2024-09-13T18:47:37.867831+0000","last_became_active":"2024-09-13T18:47:36.660957+0000","last_became_peered":"2024-09-13T18:47:36.660957+0000","last_unstale":"2024-09-13T18:47:37.867831+0000","last_undegraded":"2024-09-13T18:47:37.867831+0000","last_fullsized":"2024-09-13T18:47:37.867831+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:15.109881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658700+0000","last_change":"2024-09-13T18:47:36.655940+0000","last_active":"2024-09-13T18:47:37.658700+0000","last_peered":"2024-09-13T18:47:37.658700+0000","last_clean":"2024-09-13T18:47:37.658700+0000","last_became_active":"2024-09-13T18:47:36.655724+0000","last_became_peered":"2024-09-13T18:47:36.655724+0000","last_unstale":"2024-09-13T18:47:37.658700+0000","last_undegraded":"2024-09-13T18:47:37.658700+0000","last_fullsized":"2024-09-13T18:47:37.658700+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:47.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654290+0000","last_change":"2024-09-13T18:47:36.669216+0000","last_active":"2024-09-13T18:47:37.654290+0000","last_peered":"2024-09-13T18:47:37.654290+0000","last_clean":"2024-09-13T18:47:37.654290+0000","last_became_active":"2024-09-13T18:47:36.668140+0000","last_became_peered":"2024-09-13T18:47:36.668140+0000","last_unstale":"2024-09-13T18:47:37.654290+0000","last_undegraded":"2024-09-13T18:47:37.654290+0000","last_fullsized":"2024-09-13T18:47:37.654290+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:30.933540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867382+0000","last_change":"2024-09-13T18:47:36.669353+0000","last_active":"2024-09-13T18:47:37.867382+0000","last_peered":"2024-09-13T18:47:37.867382+0000","last_clean":"2024-09-13T18:47:37.867382+0000","last_became_active":"2024-09-13T18:47:36.667977+0000","last_became_peered":"2024-09-13T18:47:36.667977+0000","last_unstale":"2024-09-13T18:47:37.867382+0000","last_undegraded":"2024-09-13T18:47:37.867382+0000","last_fullsized":"2024-09-13T18:47:37.867382+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:21.714940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"196'4","reported_seq":15,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658531+0000","last_change":"2024-09-13T18:47:36.248069+0000","last_active":"2024-09-13T18:47:37.658531+0000","last_peered":"2024-09-13T18:47:37.658531+0000","last_clean":"2024-09-13T18:47:37.658531+0000","last_became_active":"2024-09-13T18:47:36.247865+0000","last_became_peered":"2024-09-13T18:47:36.247865+0000","last_unstale":"2024-09-13T18:47:37.658531+0000","last_undegraded":"2024-09-13T18:47:37.658531+0000","last_fullsized":"2024-09-13T18:47:37.658531+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:04.681747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658177+0000","last_change":"2024-09-13T18:47:36.669924+0000","last_active":"2024-09-13T18:47:37.658177+0000","last_peered":"2024-09-13T18:47:37.658177+0000","last_clean":"2024-09-13T18:47:37.658177+0000","last_became_active":"2024-09-13T18:47:36.669714+0000","last_became_peered":"2024-09-13T18:47:36.669714+0000","last_unstale":"2024-09-13T18:47:37.658177+0000","last_undegraded":"2024-09-13T18:47:37.658177+0000","last_fullsized":"2024-09-13T18:47:37.658177+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:56.498028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867471+0000","last_change":"2024-09-13T18:47:36.247873+0000","last_active":"2024-09-13T18:47:37.867471+0000","last_peered":"2024-09-13T18:47:37.867471+0000","last_clean":"2024-09-13T18:47:37.867471+0000","last_became_active":"2024-09-13T18:47:36.247670+0000","last_became_peered":"2024-09-13T18:47:36.247670+0000","last_unstale":"2024-09-13T18:47:37.867471+0000","last_undegraded":"2024-09-13T18:47:37.867471+0000","last_fullsized":"2024-09-13T18:47:37.867471+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:05.270967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654735+0000","last_change":"2024-09-13T18:47:36.670298+0000","last_active":"2024-09-13T18:47:37.654735+0000","last_peered":"2024-09-13T18:47:37.654735+0000","last_clean":"2024-09-13T18:47:37.654735+0000","last_became_active":"2024-09-13T18:47:36.670002+0000","last_became_peered":"2024-09-13T18:47:36.670002+0000","last_unstale":"2024-09-13T18:47:37.654735+0000","last_undegraded":"2024-09-13T18:47:37.654735+0000","last_fullsized":"2024-09-13T18:47:37.654735+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:32.842473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654636+0000","last_change":"2024-09-13T18:47:36.247230+0000","last_active":"2024-09-13T18:47:37.654636+0000","last_peered":"2024-09-13T18:47:37.654636+0000","last_clean":"2024-09-13T18:47:37.654636+0000","last_became_active":"2024-09-13T18:47:36.243649+0000","last_became_peered":"2024-09-13T18:47:36.243649+0000","last_unstale":"2024-09-13T18:47:37.654636+0000","last_undegraded":"2024-09-13T18:47:37.654636+0000","last_fullsized":"2024-09-13T18:47:37.654636+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.301658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867874+0000","last_change":"2024-09-13T18:47:36.668375+0000","last_active":"2024-09-13T18:47:37.867874+0000","last_peered":"2024-09-13T18:47:37.867874+0000","last_clean":"2024-09-13T18:47:37.867874+0000","last_became_active":"2024-09-13T18:47:36.667792+0000","last_became_peered":"2024-09-13T18:47:36.667792+0000","last_unstale":"2024-09-13T18:47:37.867874+0000","last_undegraded":"2024-09-13T18:47:37.867874+0000","last_fullsized":"2024-09-13T18:47:37.867874+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:35.222306+0000","last_change":"2024-09-13T18:47:35.222306+0000","last_active":"2024-09-13T18:47:35.222306+0000","last_peered":"2024-09-13T18:47:35.222306+0000","last_clean":"2024-09-13T18:47:35.222306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:35.222306+0000","last_undegraded":"2024-09-13T18:47:35.222306+0000","last_fullsized":"2024-09-13T18:47:35.222306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867428+0000","last_change":"2024-09-13T18:47:36.670701+0000","last_active":"2024-09-13T18:47:37.867428+0000","last_peered":"2024-09-13T18:47:37.867428+0000","last_clean":"2024-09-13T18:47:37.867428+0000","last_became_active":"2024-09-13T18:47:36.670465+0000","last_became_peered":"2024-09-13T18:47:36.670465+0000","last_unstale":"2024-09-13T18:47:37.867428+0000","last_undegraded":"2024-09-13T18:47:37.867428+0000","last_fullsized":"2024-09-13T18:47:37.867428+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:50.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658161+0000","last_change":"2024-09-13T18:47:36.245474+0000","last_active":"2024-09-13T18:47:37.658161+0000","last_peered":"2024-09-13T18:47:37.658161+0000","last_clean":"2024-09-13T18:47:37.658161+0000","last_became_active":"2024-09-13T18:47:36.243139+0000","last_became_peered":"2024-09-13T18:47:36.243139+0000","last_unstale":"2024-09-13T18:47:37.658161+0000","last_undegraded":"2024-09-13T18:47:37.658161+0000","last_fullsized":"2024-09-13T18:47:37.658161+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:04.857128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654443+0000","last_change":"2024-09-13T18:47:36.669403+0000","last_active":"2024-09-13T18:47:37.654443+0000","last_peered":"2024-09-13T18:47:37.654443+0000","last_clean":"2024-09-13T18:47:37.654443+0000","last_became_active":"2024-09-13T18:47:36.668520+0000","last_became_peered":"2024-09-13T18:47:36.668520+0000","last_unstale":"2024-09-13T18:47:37.654443+0000","last_undegraded":"2024-09-13T18:47:37.654443+0000","last_fullsized":"2024-09-13T18:47:37.654443+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:48.332483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867516+0000","last_change":"2024-09-13T18:47:36.238895+0000","last_active":"2024-09-13T18:47:37.867516+0000","last_peered":"2024-09-13T18:47:37.867516+0000","last_clean":"2024-09-13T18:47:37.867516+0000","last_became_active":"2024-09-13T18:47:36.238649+0000","last_became_peered":"2024-09-13T18:47:36.238649+0000","last_unstale":"2024-09-13T18:47:37.867516+0000","last_undegraded":"2024-09-13T18:47:37.867516+0000","last_fullsized":"2024-09-13T18:47:37.867516+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:52.841280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658136+0000","last_change":"2024-09-13T18:47:36.245328+0000","last_active":"2024-09-13T18:47:37.658136+0000","last_peered":"2024-09-13T18:47:37.658136+0000","last_clean":"2024-09-13T18:47:37.658136+0000","last_became_active":"2024-09-13T18:47:36.245089+0000","last_became_peered":"2024-09-13T18:47:36.245089+0000","last_unstale":"2024-09-13T18:47:37.658136+0000","last_undegraded":"2024-09-13T18:47:37.658136+0000","last_fullsized":"2024-09-13T18:47:37.658136+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:48.596962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868097+0000","last_change":"2024-09-13T18:47:36.669196+0000","last_active":"2024-09-13T18:47:37.868097+0000","last_peered":"2024-09-13T18:47:37.868097+0000","last_clean":"2024-09-13T18:47:37.868097+0000","last_became_active":"2024-09-13T18:47:36.667671+0000","last_became_peered":"2024-09-13T18:47:36.667671+0000","last_unstale":"2024-09-13T18:47:37.868097+0000","last_undegraded":"2024-09-13T18:47:37.868097+0000","last_fullsized":"2024-09-13T18:47:37.868097+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:12.420165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:35.222306+0000","last_change":"2024-09-13T18:47:35.222306+0000","last_active":"2024-09-13T18:47:35.222306+0000","last_peered":"2024-09-13T18:47:35.222306+0000","last_clean":"2024-09-13T18:47:35.222306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:35.222306+0000","last_undegraded":"2024-09-13T18:47:35.222306+0000","last_fullsized":"2024-09-13T18:47:35.222306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867934+0000","last_change":"2024-09-13T18:47:36.675029+0000","last_active":"2024-09-13T18:47:37.867934+0000","last_peered":"2024-09-13T18:47:37.867934+0000","last_clean":"2024-09-13T18:47:37.867934+0000","last_became_active":"2024-09-13T18:47:36.674190+0000","last_became_peered":"2024-09-13T18:47:36.674190+0000","last_unstale":"2024-09-13T18:47:37.867934+0000","last_undegraded":"2024-09-13T18:47:37.867934+0000","last_fullsized":"2024-09-13T18:47:37.867934+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:58.411478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654601+0000","last_change":"2024-09-13T18:47:36.245731+0000","last_active":"2024-09-13T18:47:37.654601+0000","last_peered":"2024-09-13T18:47:37.654601+0000","last_clean":"2024-09-13T18:47:37.654601+0000","last_became_active":"2024-09-13T18:47:36.245198+0000","last_became_peered":"2024-09-13T18:47:36.245198+0000","last_unstale":"2024-09-13T18:47:37.654601+0000","last_undegraded":"2024-09-13T18:47:37.654601+0000","last_fullsized":"2024-09-13T18:47:37.654601+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.744688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867791+0000","last_change":"2024-09-13T18:47:36.675163+0000","last_active":"2024-09-13T18:47:37.867791+0000","last_peered":"2024-09-13T18:47:37.867791+0000","last_clean":"2024-09-13T18:47:37.867791+0000","last_became_active":"2024-09-13T18:47:36.674266+0000","last_became_peered":"2024-09-13T18:47:36.674266+0000","last_unstale":"2024-09-13T18:47:37.867791+0000","last_undegraded":"2024-09-13T18:47:37.867791+0000","last_fullsized":"2024-09-13T18:47:37.867791+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:38.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:35.222306+0000","last_change":"2024-09-13T18:47:35.222306+0000","last_active":"2024-09-13T18:47:35.222306+0000","last_peered":"2024-09-13T18:47:35.222306+0000","last_clean":"2024-09-13T18:47:35.222306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:35.222306+0000","last_undegraded":"2024-09-13T18:47:35.222306+0000","last_fullsized":"2024-09-13T18:47:35.222306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658256+0000","last_change":"2024-09-13T18:47:36.661070+0000","last_active":"2024-09-13T18:47:37.658256+0000","last_peered":"2024-09-13T18:47:37.658256+0000","last_clean":"2024-09-13T18:47:37.658256+0000","last_became_active":"2024-09-13T18:47:36.660552+0000","last_became_peered":"2024-09-13T18:47:36.660552+0000","last_unstale":"2024-09-13T18:47:37.658256+0000","last_undegraded":"2024-09-13T18:47:37.658256+0000","last_fullsized":"2024-09-13T18:47:37.658256+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:56.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"196'6","reported_seq":17,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867364+0000","last_change":"2024-09-13T18:47:36.249645+0000","last_active":"2024-09-13T18:47:37.867364+0000","last_peered":"2024-09-13T18:47:37.867364+0000","last_clean":"2024-09-13T18:47:37.867364+0000","last_became_active":"2024-09-13T18:47:36.248562+0000","last_became_peered":"2024-09-13T18:47:36.248562+0000","last_unstale":"2024-09-13T18:47:37.867364+0000","last_undegraded":"2024-09-13T18:47:37.867364+0000","last_fullsized":"2024-09-13T18:47:37.867364+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:46.156648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867990+0000","last_change":"2024-09-13T18:47:36.667642+0000","last_active":"2024-09-13T18:47:37.867990+0000","last_peered":"2024-09-13T18:47:37.867990+0000","last_clean":"2024-09-13T18:47:37.867990+0000","last_became_active":"2024-09-13T18:47:36.662714+0000","last_became_peered":"2024-09-13T18:47:36.662714+0000","last_unstale":"2024-09-13T18:47:37.867990+0000","last_undegraded":"2024-09-13T18:47:37.867990+0000","last_fullsized":"2024-09-13T18:47:37.867990+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:05.864286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867761+0000","last_change":"2024-09-13T18:47:36.236420+0000","last_active":"2024-09-13T18:47:37.867761+0000","last_peered":"2024-09-13T18:47:37.867761+0000","last_clean":"2024-09-13T18:47:37.867761+0000","last_became_active":"2024-09-13T18:47:36.235714+0000","last_became_peered":"2024-09-13T18:47:36.235714+0000","last_unstale":"2024-09-13T18:47:37.867761+0000","last_undegraded":"2024-09-13T18:47:37.867761+0000","last_fullsized":"2024-09-13T18:47:37.867761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:10.671819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654814+0000","last_change":"2024-09-13T18:47:36.248999+0000","last_active":"2024-09-13T18:47:37.654814+0000","last_peered":"2024-09-13T18:47:37.654814+0000","last_clean":"2024-09-13T18:47:37.654814+0000","last_became_active":"2024-09-13T18:47:36.248768+0000","last_became_peered":"2024-09-13T18:47:36.248768+0000","last_unstale":"2024-09-13T18:47:37.654814+0000","last_undegraded":"2024-09-13T18:47:37.654814+0000","last_fullsized":"2024-09-13T18:47:37.654814+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:55.139069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654365+0000","last_change":"2024-09-13T18:47:36.665426+0000","last_active":"2024-09-13T18:47:37.654365+0000","last_peered":"2024-09-13T18:47:37.654365+0000","last_clean":"2024-09-13T18:47:37.654365+0000","last_became_active":"2024-09-13T18:47:36.664799+0000","last_became_peered":"2024-09-13T18:47:36.664799+0000","last_unstale":"2024-09-13T18:47:37.654365+0000","last_undegraded":"2024-09-13T18:47:37.654365+0000","last_fullsized":"2024-09-13T18:47:37.654365+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:52.028390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868810+0000","last_change":"2024-09-13T18:47:36.244155+0000","last_active":"2024-09-13T18:47:37.868810+0000","last_peered":"2024-09-13T18:47:37.868810+0000","last_clean":"2024-09-13T18:47:37.868810+0000","last_became_active":"2024-09-13T18:47:36.242743+0000","last_became_peered":"2024-09-13T18:47:36.242743+0000","last_unstale":"2024-09-13T18:47:37.868810+0000","last_undegraded":"2024-09-13T18:47:37.868810+0000","last_fullsized":"2024-09-13T18:47:37.868810+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:07.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867249+0000","last_change":"2024-09-13T18:47:36.663400+0000","last_active":"2024-09-13T18:47:37.867249+0000","last_peered":"2024-09-13T18:47:37.867249+0000","last_clean":"2024-09-13T18:47:37.867249+0000","last_became_active":"2024-09-13T18:47:36.662412+0000","last_became_peered":"2024-09-13T18:47:36.662412+0000","last_unstale":"2024-09-13T18:47:37.867249+0000","last_undegraded":"2024-09-13T18:47:37.867249+0000","last_fullsized":"2024-09-13T18:47:37.867249+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:12.904196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"196'8","reported_seq":19,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867529+0000","last_change":"2024-09-13T18:47:36.245057+0000","last_active":"2024-09-13T18:47:37.867529+0000","last_peered":"2024-09-13T18:47:37.867529+0000","last_clean":"2024-09-13T18:47:37.867529+0000","last_became_active":"2024-09-13T18:47:36.244381+0000","last_became_peered":"2024-09-13T18:47:36.244381+0000","last_unstale":"2024-09-13T18:47:37.867529+0000","last_undegraded":"2024-09-13T18:47:37.867529+0000","last_fullsized":"2024-09-13T18:47:37.867529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:37.775988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867751+0000","last_change":"2024-09-13T18:47:36.670043+0000","last_active":"2024-09-13T18:47:37.867751+0000","last_peered":"2024-09-13T18:47:37.867751+0000","last_clean":"2024-09-13T18:47:37.867751+0000","last_became_active":"2024-09-13T18:47:36.669789+0000","last_became_peered":"2024-09-13T18:47:36.669789+0000","last_unstale":"2024-09-13T18:47:37.867751+0000","last_undegraded":"2024-09-13T18:47:37.867751+0000","last_fullsized":"2024-09-13T18:47:37.867751+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:53.848438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867435+0000","last_change":"2024-09-13T18:47:36.249505+0000","last_active":"2024-09-13T18:47:37.867435+0000","last_peered":"2024-09-13T18:47:37.867435+0000","last_clean":"2024-09-13T18:47:37.867435+0000","last_became_active":"2024-09-13T18:47:36.248263+0000","last_became_peered":"2024-09-13T18:47:36.248263+0000","last_unstale":"2024-09-13T18:47:37.867435+0000","last_undegraded":"2024-09-13T18:47:37.867435+0000","last_fullsized":"2024-09-13T18:47:37.867435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:50.768636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868204+0000","last_change":"2024-09-13T18:47:36.663657+0000","last_active":"2024-09-13T18:47:37.868204+0000","last_peered":"2024-09-13T18:47:37.868204+0000","last_clean":"2024-09-13T18:47:37.868204+0000","last_became_active":"2024-09-13T18:47:36.663431+0000","last_became_peered":"2024-09-13T18:47:36.663431+0000","last_unstale":"2024-09-13T18:47:37.868204+0000","last_undegraded":"2024-09-13T18:47:37.868204+0000","last_fullsized":"2024-09-13T18:47:37.868204+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.472218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867916+0000","last_change":"2024-09-13T18:47:36.249045+0000","last_active":"2024-09-13T18:47:37.867916+0000","last_peered":"2024-09-13T18:47:37.867916+0000","last_clean":"2024-09-13T18:47:37.867916+0000","last_became_active":"2024-09-13T18:47:36.248847+0000","last_became_peered":"2024-09-13T18:47:36.248847+0000","last_unstale":"2024-09-13T18:47:37.867916+0000","last_undegraded":"2024-09-13T18:47:37.867916+0000","last_fullsized":"2024-09-13T18:47:37.867916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:48.596962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868562+0000","last_change":"2024-09-13T18:47:36.670564+0000","last_active":"2024-09-13T18:47:37.868562+0000","last_peered":"2024-09-13T18:47:37.868562+0000","last_clean":"2024-09-13T18:47:37.868562+0000","last_became_active":"2024-09-13T18:47:36.670058+0000","last_became_peered":"2024-09-13T18:47:36.670058+0000","last_unstale":"2024-09-13T18:47:37.868562+0000","last_undegraded":"2024-09-13T18:47:37.868562+0000","last_fullsized":"2024-09-13T18:47:37.868562+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:16.583320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867310+0000","last_change":"2024-09-13T18:47:36.245401+0000","last_active":"2024-09-13T18:47:37.867310+0000","last_peered":"2024-09-13T18:47:37.867310+0000","last_clean":"2024-09-13T18:47:37.867310+0000","last_became_active":"2024-09-13T18:47:36.244957+0000","last_became_peered":"2024-09-13T18:47:36.244957+0000","last_unstale":"2024-09-13T18:47:37.867310+0000","last_undegraded":"2024-09-13T18:47:37.867310+0000","last_fullsized":"2024-09-13T18:47:37.867310+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.427182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658462+0000","last_change":"2024-09-13T18:47:36.242697+0000","last_active":"2024-09-13T18:47:37.658462+0000","last_peered":"2024-09-13T18:47:37.658462+0000","last_clean":"2024-09-13T18:47:37.658462+0000","last_became_active":"2024-09-13T18:47:36.242416+0000","last_became_peered":"2024-09-13T18:47:36.242416+0000","last_unstale":"2024-09-13T18:47:37.658462+0000","last_undegraded":"2024-09-13T18:47:37.658462+0000","last_fullsized":"2024-09-13T18:47:37.658462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:48.076074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658035+0000","last_change":"2024-09-13T18:47:36.658494+0000","last_active":"2024-09-13T18:47:37.658035+0000","last_peered":"2024-09-13T18:47:37.658035+0000","last_clean":"2024-09-13T18:47:37.658035+0000","last_became_active":"2024-09-13T18:47:36.658266+0000","last_became_peered":"2024-09-13T18:47:36.658266+0000","last_unstale":"2024-09-13T18:47:37.658035+0000","last_undegraded":"2024-09-13T18:47:37.658035+0000","last_fullsized":"2024-09-13T18:47:37.658035+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:35.222306+0000","last_change":"2024-09-13T18:47:35.222306+0000","last_active":"2024-09-13T18:47:35.222306+0000","last_peered":"2024-09-13T18:47:35.222306+0000","last_clean":"2024-09-13T18:47:35.222306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:35.222306+0000","last_undegraded":"2024-09-13T18:47:35.222306+0000","last_fullsized":"2024-09-13T18:47:35.222306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658374+0000","last_change":"2024-09-13T18:47:36.245779+0000","last_active":"2024-09-13T18:47:37.658374+0000","last_peered":"2024-09-13T18:47:37.658374+0000","last_clean":"2024-09-13T18:47:37.658374+0000","last_became_active":"2024-09-13T18:47:36.245552+0000","last_became_peered":"2024-09-13T18:47:36.245552+0000","last_unstale":"2024-09-13T18:47:37.658374+0000","last_undegraded":"2024-09-13T18:47:37.658374+0000","last_fullsized":"2024-09-13T18:47:37.658374+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:27.219461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658781+0000","last_change":"2024-09-13T18:47:36.654784+0000","last_active":"2024-09-13T18:47:37.658781+0000","last_peered":"2024-09-13T18:47:37.658781+0000","last_clean":"2024-09-13T18:47:37.658781+0000","last_became_active":"2024-09-13T18:47:36.654585+0000","last_became_peered":"2024-09-13T18:47:36.654585+0000","last_unstale":"2024-09-13T18:47:37.658781+0000","last_undegraded":"2024-09-13T18:47:37.658781+0000","last_fullsized":"2024-09-13T18:47:37.658781+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:33.424281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867842+0000","last_change":"2024-09-13T18:47:36.238796+0000","last_active":"2024-09-13T18:47:37.867842+0000","last_peered":"2024-09-13T18:47:37.867842+0000","last_clean":"2024-09-13T18:47:37.867842+0000","last_became_active":"2024-09-13T18:47:36.238563+0000","last_became_peered":"2024-09-13T18:47:36.238563+0000","last_unstale":"2024-09-13T18:47:37.867842+0000","last_undegraded":"2024-09-13T18:47:37.867842+0000","last_fullsized":"2024-09-13T18:47:37.867842+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:50.208297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867870+0000","last_change":"2024-09-13T18:47:36.676822+0000","last_active":"2024-09-13T18:47:37.867870+0000","last_peered":"2024-09-13T18:47:37.867870+0000","last_clean":"2024-09-13T18:47:37.867870+0000","last_became_active":"2024-09-13T18:47:36.676557+0000","last_became_peered":"2024-09-13T18:47:36.676557+0000","last_unstale":"2024-09-13T18:47:37.867870+0000","last_undegraded":"2024-09-13T18:47:37.867870+0000","last_fullsized":"2024-09-13T18:47:37.867870+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:05.688905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658376+0000","last_change":"2024-09-13T18:47:36.240840+0000","last_active":"2024-09-13T18:47:37.658376+0000","last_peered":"2024-09-13T18:47:37.658376+0000","last_clean":"2024-09-13T18:47:37.658376+0000","last_became_active":"2024-09-13T18:47:36.240602+0000","last_became_peered":"2024-09-13T18:47:36.240602+0000","last_unstale":"2024-09-13T18:47:37.658376+0000","last_undegraded":"2024-09-13T18:47:37.658376+0000","last_fullsized":"2024-09-13T18:47:37.658376+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:19.745843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:36.229465+0000","last_change":"2024-09-13T18:47:36.229465+0000","last_active":"2024-09-13T18:47:36.229465+0000","last_peered":"2024-09-13T18:47:36.229465+0000","last_clean":"2024-09-13T18:47:36.229465+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:36.229465+0000","last_undegraded":"2024-09-13T18:47:36.229465+0000","last_fullsized":"2024-09-13T18:47:36.229465+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"22.7","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654719+0000","last_change":"2024-09-13T18:47:36.248480+0000","last_active":"2024-09-13T18:47:37.654719+0000","last_peered":"2024-09-13T18:47:37.654719+0000","last_clean":"2024-09-13T18:47:37.654719+0000","last_became_active":"2024-09-13T18:47:36.247088+0000","last_became_peered":"2024-09-13T18:47:36.247088+0000","last_unstale":"2024-09-13T18:47:37.654719+0000","last_undegraded":"2024-09-13T18:47:37.654719+0000","last_fullsized":"2024-09-13T18:47:37.654719+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:16.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868344+0000","last_change":"2024-09-13T18:47:36.664543+0000","last_active":"2024-09-13T18:47:37.868344+0000","last_peered":"2024-09-13T18:47:37.868344+0000","last_clean":"2024-09-13T18:47:37.868344+0000","last_became_active":"2024-09-13T18:47:36.661618+0000","last_became_peered":"2024-09-13T18:47:36.661618+0000","last_unstale":"2024-09-13T18:47:37.868344+0000","last_undegraded":"2024-09-13T18:47:37.868344+0000","last_fullsized":"2024-09-13T18:47:37.868344+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:56.498028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658087+0000","last_change":"2024-09-13T18:47:36.245674+0000","last_active":"2024-09-13T18:47:37.658087+0000","last_peered":"2024-09-13T18:47:37.658087+0000","last_clean":"2024-09-13T18:47:37.658087+0000","last_became_active":"2024-09-13T18:47:36.245001+0000","last_became_peered":"2024-09-13T18:47:36.245001+0000","last_unstale":"2024-09-13T18:47:37.658087+0000","last_undegraded":"2024-09-13T18:47:37.658087+0000","last_fullsized":"2024-09-13T18:47:37.658087+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:21.060815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867674+0000","last_change":"2024-09-13T18:47:36.662728+0000","last_active":"2024-09-13T18:47:37.867674+0000","last_peered":"2024-09-13T18:47:37.867674+0000","last_clean":"2024-09-13T18:47:37.867674+0000","last_became_active":"2024-09-13T18:47:36.662497+0000","last_became_peered":"2024-09-13T18:47:36.662497+0000","last_unstale":"2024-09-13T18:47:37.867674+0000","last_undegraded":"2024-09-13T18:47:37.867674+0000","last_fullsized":"2024-09-13T18:47:37.867674+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658276+0000","last_change":"2024-09-13T18:47:36.246019+0000","last_active":"2024-09-13T18:47:37.658276+0000","last_peered":"2024-09-13T18:47:37.658276+0000","last_clean":"2024-09-13T18:47:37.658276+0000","last_became_active":"2024-09-13T18:47:36.245556+0000","last_became_peered":"2024-09-13T18:47:36.245556+0000","last_unstale":"2024-09-13T18:47:37.658276+0000","last_undegraded":"2024-09-13T18:47:37.658276+0000","last_fullsized":"2024-09-13T18:47:37.658276+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:13.058518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868307+0000","last_change":"2024-09-13T18:47:36.665539+0000","last_active":"2024-09-13T18:47:37.868307+0000","last_peered":"2024-09-13T18:47:37.868307+0000","last_clean":"2024-09-13T18:47:37.868307+0000","last_became_active":"2024-09-13T18:47:36.665224+0000","last_became_peered":"2024-09-13T18:47:36.665224+0000","last_unstale":"2024-09-13T18:47:37.868307+0000","last_undegraded":"2024-09-13T18:47:37.868307+0000","last_fullsized":"2024-09-13T18:47:37.868307+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:56.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-13T18:47:35.222306+0000","last_change":"2024-09-13T18:47:35.222306+0000","last_active":"2024-09-13T18:47:35.222306+0000","last_peered":"2024-09-13T18:47:35.222306+0000","last_clean":"2024-09-13T18:47:35.222306+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-13T18:47:35.222306+0000","last_undegraded":"2024-09-13T18:47:35.222306+0000","last_fullsized":"2024-09-13T18:47:35.222306+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654542+0000","last_change":"2024-09-13T18:47:36.670877+0000","last_active":"2024-09-13T18:47:37.654542+0000","last_peered":"2024-09-13T18:47:37.654542+0000","last_clean":"2024-09-13T18:47:37.654542+0000","last_became_active":"2024-09-13T18:47:36.668859+0000","last_became_peered":"2024-09-13T18:47:36.668859+0000","last_unstale":"2024-09-13T18:47:37.654542+0000","last_undegraded":"2024-09-13T18:47:37.654542+0000","last_fullsized":"2024-09-13T18:47:37.654542+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:52.638881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867743+0000","last_change":"2024-09-13T18:47:36.249187+0000","last_active":"2024-09-13T18:47:37.867743+0000","last_peered":"2024-09-13T18:47:37.867743+0000","last_clean":"2024-09-13T18:47:37.867743+0000","last_became_active":"2024-09-13T18:47:36.248694+0000","last_became_peered":"2024-09-13T18:47:36.248694+0000","last_unstale":"2024-09-13T18:47:37.867743+0000","last_undegraded":"2024-09-13T18:47:37.867743+0000","last_fullsized":"2024-09-13T18:47:37.867743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.954560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658876+0000","last_change":"2024-09-13T18:47:36.667258+0000","last_active":"2024-09-13T18:47:37.658876+0000","last_peered":"2024-09-13T18:47:37.658876+0000","last_clean":"2024-09-13T18:47:37.658876+0000","last_became_active":"2024-09-13T18:47:36.666598+0000","last_became_peered":"2024-09-13T18:47:36.666598+0000","last_unstale":"2024-09-13T18:47:37.658876+0000","last_undegraded":"2024-09-13T18:47:37.658876+0000","last_fullsized":"2024-09-13T18:47:37.658876+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:27.850917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868898+0000","last_change":"2024-09-13T18:47:36.244771+0000","last_active":"2024-09-13T18:47:37.868898+0000","last_peered":"2024-09-13T18:47:37.868898+0000","last_clean":"2024-09-13T18:47:37.868898+0000","last_became_active":"2024-09-13T18:47:36.243814+0000","last_became_peered":"2024-09-13T18:47:36.243814+0000","last_unstale":"2024-09-13T18:47:37.868898+0000","last_undegraded":"2024-09-13T18:47:37.868898+0000","last_fullsized":"2024-09-13T18:47:37.868898+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.572013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867901+0000","last_change":"2024-09-13T18:47:36.673051+0000","last_active":"2024-09-13T18:47:37.867901+0000","last_peered":"2024-09-13T18:47:37.867901+0000","last_clean":"2024-09-13T18:47:37.867901+0000","last_became_active":"2024-09-13T18:47:36.670287+0000","last_became_peered":"2024-09-13T18:47:36.670287+0000","last_unstale":"2024-09-13T18:47:37.867901+0000","last_undegraded":"2024-09-13T18:47:37.867901+0000","last_fullsized":"2024-09-13T18:47:37.867901+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:49.604120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658604+0000","last_change":"2024-09-13T18:47:36.246728+0000","last_active":"2024-09-13T18:47:37.658604+0000","last_peered":"2024-09-13T18:47:37.658604+0000","last_clean":"2024-09-13T18:47:37.658604+0000","last_became_active":"2024-09-13T18:47:36.245742+0000","last_became_peered":"2024-09-13T18:47:36.245742+0000","last_unstale":"2024-09-13T18:47:37.658604+0000","last_undegraded":"2024-09-13T18:47:37.658604+0000","last_fullsized":"2024-09-13T18:47:37.658604+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:48.239246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658456+0000","last_change":"2024-09-13T18:47:36.666922+0000","last_active":"2024-09-13T18:47:37.658456+0000","last_peered":"2024-09-13T18:47:37.658456+0000","last_clean":"2024-09-13T18:47:37.658456+0000","last_became_active":"2024-09-13T18:47:36.666034+0000","last_became_peered":"2024-09-13T18:47:36.666034+0000","last_unstale":"2024-09-13T18:47:37.658456+0000","last_undegraded":"2024-09-13T18:47:37.658456+0000","last_fullsized":"2024-09-13T18:47:37.658456+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:15.109881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658350+0000","last_change":"2024-09-13T18:47:36.241987+0000","last_active":"2024-09-13T18:47:37.658350+0000","last_peered":"2024-09-13T18:47:37.658350+0000","last_clean":"2024-09-13T18:47:37.658350+0000","last_became_active":"2024-09-13T18:47:36.241777+0000","last_became_peered":"2024-09-13T18:47:36.241777+0000","last_unstale":"2024-09-13T18:47:37.658350+0000","last_undegraded":"2024-09-13T18:47:37.658350+0000","last_fullsized":"2024-09-13T18:47:37.658350+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:55.465028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868622+0000","last_change":"2024-09-13T18:47:36.669474+0000","last_active":"2024-09-13T18:47:37.868622+0000","last_peered":"2024-09-13T18:47:37.868622+0000","last_clean":"2024-09-13T18:47:37.868622+0000","last_became_active":"2024-09-13T18:47:36.668884+0000","last_became_peered":"2024-09-13T18:47:36.668884+0000","last_unstale":"2024-09-13T18:47:37.868622+0000","last_undegraded":"2024-09-13T18:47:37.868622+0000","last_fullsized":"2024-09-13T18:47:37.868622+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:14.065677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867226+0000","last_change":"2024-09-13T18:47:36.245237+0000","last_active":"2024-09-13T18:47:37.867226+0000","last_peered":"2024-09-13T18:47:37.867226+0000","last_clean":"2024-09-13T18:47:37.867226+0000","last_became_active":"2024-09-13T18:47:36.244654+0000","last_became_peered":"2024-09-13T18:47:36.244654+0000","last_unstale":"2024-09-13T18:47:37.867226+0000","last_undegraded":"2024-09-13T18:47:37.867226+0000","last_fullsized":"2024-09-13T18:47:37.867226+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:17.347692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":329,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.658592+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:47:36.658592+0000","last_peered":"2024-09-13T18:47:36.658592+0000","last_clean":"2024-09-13T18:47:36.658592+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:47:36.658592+0000","last_undegraded":"2024-09-13T18:47:36.658592+0000","last_fullsized":"2024-09-13T18:47:36.658592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2272,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":31,"ondisk_log_size":31,"up":54,"acting":54,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542293,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193675,"statfs":{"total":200000000,"available":198323574,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.90400000000000003,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.66400000000000003},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.93000000000000005,"5min":0.94799999999999995,"15min":1.014},"last":0.63}]},{"osd":1,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.52000000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70799999999999996,"15min":0.67700000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.95699999999999996,"5min":1.004,"15min":1.004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.66400000000000003},"min":{"1min":0.504,"5min":0.45800000000000002,"15min":0.41599999999999998},"max":{"1min":0.86899999999999999,"5min":0.93799999999999994,"15min":0.999},"last":0.67400000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.91500000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.75},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.78000000000000003},"min":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92700000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.56599999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.372,"15min":0.313},"max":{"1min":0.86499999999999999,"5min":0.97599999999999998,"15min":1.036},"last":0.373},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.46500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.442},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98299999999999998,"15min":1.371},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":1.143},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":0.98099999999999998,"15min":1.125},"last":0.61299999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.67300000000000004},"min":{"1min":0.41699999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.93200000000000005,"15min":1.665},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.66300000000000003},"min":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":1.591},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.004,"5min":1.016,"15min":2.2709999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":2.169},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.70899999999999996},"min":{"1min":0.58499999999999996,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.93899999999999995,"5min":0.96499999999999997,"15min":1.4450000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90200000000000002,"5min":1.071,"15min":1.071},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0249999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.0840000000000001},"last":1.052},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.5,"5min":0.438,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":1.115},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.1140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.76100000000000001},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":1.02,"15min":6.4539999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.01},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.436,"15min":0.377},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68600000000000005,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":1.038,"5min":1.038,"15min":6.5019999999999998},"last":0.748}]},{"osd":2,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.032},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":0.79100000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.76200000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.5509999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":1.403},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.46500000000000002,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.871},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.49099999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.85999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68400000000000005},"min":{"1min":0.52100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96799999999999997,"5min":1.581,"15min":2.0579999999999998},"last":0.501},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92300000000000004,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.94899999999999995,"5min":1.48,"15min":1.48},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.53400000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.94099999999999995,"5min":1.5589999999999999,"15min":3.706},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":1.028,"5min":2.915,"15min":3.742},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.55100000000000005,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.085,"5min":1.762,"15min":3.6909999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.85999999999999999,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.55100000000000005,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.88,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.843,"15min":3.7989999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.88800000000000001,"5min":1.548,"15min":5.5069999999999997},"last":0.755},{"interface":"front","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.72999999999999998},"min":{"1min":0.622,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.87,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1086,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194225,"statfs":{"total":200000000,"available":198887189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.65300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.36599999999999999,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.371}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.66300000000000003,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.52400000000000002},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.64400000000000002,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":7.798},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":1.0669999999999999,"15min":3.093},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.58099999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.006,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0389999999999999,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.58099999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95499999999999996,"5min":1.2,"15min":1.2},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.874},"min":{"1min":0.622,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.751,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.92500000000000004,"5min":1.105,"15min":8.0519999999999996},"last":0.875}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.73799999999999999},"min":{"1min":0.59899999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.026,"5min":1.1559999999999999,"15min":1.206},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79500000000000004,"15min":0.82199999999999995},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194226,"statfs":{"total":200000000,"available":198888193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.50900000000000001,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.499,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.504},"min":{"1min":0.41099999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.71999999999999997},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98099999999999998,"5min":1.111,"15min":1.111},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63,"5min":0.52100000000000002,"15min":0.47299999999999998},"max":{"1min":1.006,"5min":1.423,"15min":1.423},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79200000000000004,"15min":0.753},"min":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.73899999999999999},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.329,"15min":1.329},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0129999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":1.159,"15min":1.159},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81100000000000005,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.016,"5min":1.508,"15min":1.508},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193649,"statfs":{"total":200000000,"available":198296661,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":1.036},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67000000000000004,"5min":0.73999999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.505,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.39400000000000002,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.45500000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.3029999999999999},"last":0.748}]},{"osd":5,"last update":"Fri Sep 13 18:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.96499999999999997,"15min":1.242},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.628},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.754,"15min":0.76700000000000002},"min":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.76800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41899999999999998,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":0.60199999999999998,"15min":1.669},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":1.591},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":1.03},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":1.637},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74299999999999999,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.97399999999999998,"5min":1.21,"15min":1.21},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90900000000000003,"5min":1.056,"15min":1.698},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.76800000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0189999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88600000000000001,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.135,"5min":1.236,"15min":1.236},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.752},"min":{"1min":0.54000000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94699999999999995,"5min":1.165,"15min":2.3399999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.72799999999999998},"min":{"1min":0.56899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89900000000000002,"5min":1.135,"15min":1.1830000000000001},"last":0.80600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:47:40.803 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.987+0000 7f691cc00640 1 Processor -- start 2024-09-13T18:47:40.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.987+0000 7f691cc00640 1 -- start start 2024-09-13T18:47:40.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f691cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f69180cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f691cc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6918140480 con 0x7f69180cacd0 2024-09-13T18:47:40.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f691cc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f691815ebd0 con 0x7f691815bc20 2024-09-13T18:47:40.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f691cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69180cb5f0 con 0x7f691815e790 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f6915e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f69180cacd0 0x7f6918140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59368/0 (socket says 172.21.15.192:59368) 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.988+0000 7f6915e00640 1 -- 172.21.15.192:0/2805844301 learned_addr learned my addr 172.21.15.192:0/2805844301 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6915400640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f69180cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3838298232 0 0) 0x7f6918140480 con 0x7f69180cacd0 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68fc003520 con 0x7f69180cacd0 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3940958117 0 0) 0x7f68fc003520 con 0x7f69180cacd0 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 msgr2=0x7f69180cb0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f69180cb0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 >> v1:172.21.15.194:6789/0 conn(0x7f691815bc20 legacy=0x7f69180afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.997 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691815ee90 con 0x7f69180cacd0 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f6908001670 con 0x7f69180cacd0 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 >> v1:172.21.15.192:6789/0 conn(0x7f69180cacd0 legacy=0x7f6918140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f68fc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68fc003ee0 0x7f68fc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68fc004d00 0x7f68fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00b9b0 con 0x7f68fc004d00 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00bb20 con 0x7f68fc003ee0 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc00bce0 con 0x7f691815e790 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.989+0000 7f6916800640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68fc004d00 0x7f68fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6915e00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f68fc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6915400640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68fc003ee0 0x7f68fc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6916800640 1 -- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 msgr2=0x7f68fc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6916800640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691815e790 0x7f68fc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6916800640 1 -- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68fc003ee0 msgr2=0x7f68fc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6916800640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f68fc003ee0 0x7f68fc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.990+0000 7f6916800640 1 -- 172.21.15.192:0/2805844301 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc003520 con 0x7f68fc004d00 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.991+0000 7f6916800640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68fc004d00 0x7f68fc005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6910002010 tx=0x7f68fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60478d2ff1efc93b server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.991+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6910031600 con 0x7f68fc004d00 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.991+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691002d050 con 0x7f68fc004d00 2024-09-13T18:47:40.999 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.991+0000 7f6914a00640 1 -- 172.21.15.192:0/2805844301 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69100319c0 con 0x7f68fc004d00 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 -- 172.21.15.192:0/2805844301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68fc004d00 msgr2=0x7f68fc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 --2- 172.21.15.192:0/2805844301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f68fc004d00 0x7f68fc005180 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f6910002010 tx=0x7f68fc0057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f6916800640 1 -- 172.21.15.192:0/2805844301 reap_dead start 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 -- 172.21.15.192:0/2805844301 shutdown_connections 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 -- 172.21.15.192:0/2805844301 >> 172.21.15.192:0/2805844301 conn(0x7f69180ae960 msgr2=0x7f691806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 -- 172.21.15.192:0/2805844301 shutdown_connections 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.992+0000 7f691cc00640 1 -- 172.21.15.192:0/2805844301 wait complete. 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.993+0000 7f691cc00640 1 Processor -- start 2024-09-13T18:47:41.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 -- start start 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691813ce00 0x7f6918152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69180b3bd0 0x7f69180b4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69180b4590 con 0x7f6918154440 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181533a0 con 0x7f69180b3bd0 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.994+0000 7f691cc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6918153680 con 0x7f691813ce00 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45812/0 (socket says 172.21.15.192:45812) 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 -- 172.21.15.192:0/1234786238 learned_addr learned my addr 172.21.15.192:0/1234786238 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915e00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691813ce00 0x7f6918152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6916800640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69180b3bd0 0x7f69180b4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 -- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691813ce00 msgr2=0x7f6918152b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691813ce00 0x7f6918152b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 -- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69180b3bd0 msgr2=0x7f69180b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69180b3bd0 0x7f69180b4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 -- 172.21.15.192:0/1234786238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6918153960 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.995+0000 7f6915400640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f69040119a0 tx=0x7f6904011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.996+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690400faf0 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.996+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f690400fc50 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.996+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6918153c40 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.996+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904014440 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.996+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69181530b0 con 0x7f6918154440 2024-09-13T18:47:41.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.997+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6918140980 con 0x7f6918154440 2024-09-13T18:47:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.998+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f69040145a0 con 0x7f6918154440 2024-09-13T18:47:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.999+0000 7f690e000640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 0x7f68f806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.999+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6904089a80 con 0x7f6918154440 2024-09-13T18:47:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:40.999+0000 7f6915e00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 0x7f68f806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.000+0000 7f6915e00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 0x7f68f806d0f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae930 tx=0x7f6908001170 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.007 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.003+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6904054d10 con 0x7f6918154440 2024-09-13T18:47:41.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.168+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f691815c090 con 0x7f68f806ac30 2024-09-13T18:47:41.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.175+0000 7f690e000640 1 -- 172.21.15.192:0/1234786238 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284699 (secure 0 0 0) 0x7f6908007e80 con 0x7f68f806ac30 2024-09-13T18:47:41.182 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:41.183 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 msgr2=0x7f68f806d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 0x7f68f806d0f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae930 tx=0x7f6908001170 comp rx=0 tx=0).stop 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 msgr2=0x7f691813d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f69040119a0 tx=0x7f6904011e60 comp rx=0 tx=0).stop 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 shutdown_connections 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f68f806ac30 0x7f68f806d0f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f69180b3bd0 0x7f69180b4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6918154440 0x7f691813d1e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 --2- 172.21.15.192:0/1234786238 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f691813ce00 0x7f6918152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 >> 172.21.15.192:0/1234786238 conn(0x7f69180ae960 msgr2=0x7f691813ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 shutdown_connections 2024-09-13T18:47:41.186 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.180+0000 7f691cc00640 1 -- 172.21.15.192:0/1234786238 wait complete. 2024-09-13T18:47:41.198 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":555,"stamp":"2024-09-13T18:47:40.900194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9839,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552660,"statfs":{"total":1600000000,"available":1589924740,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.670214"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658617+0000","last_change":"2024-09-13T18:47:36.661864+0000","last_active":"2024-09-13T18:47:37.658617+0000","last_peered":"2024-09-13T18:47:37.658617+0000","last_clean":"2024-09-13T18:47:37.658617+0000","last_became_active":"2024-09-13T18:47:36.661668+0000","last_became_peered":"2024-09-13T18:47:36.661668+0000","last_unstale":"2024-09-13T18:47:37.658617+0000","last_undegraded":"2024-09-13T18:47:37.658617+0000","last_fullsized":"2024-09-13T18:47:37.658617+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:12.904196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657979+0000","last_change":"2024-09-13T18:47:36.661890+0000","last_active":"2024-09-13T18:47:37.657979+0000","last_peered":"2024-09-13T18:47:37.657979+0000","last_clean":"2024-09-13T18:47:37.657979+0000","last_became_active":"2024-09-13T18:47:36.661647+0000","last_became_peered":"2024-09-13T18:47:36.661647+0000","last_unstale":"2024-09-13T18:47:37.657979+0000","last_undegraded":"2024-09-13T18:47:37.657979+0000","last_fullsized":"2024-09-13T18:47:37.657979+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:28.662400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658066+0000","last_change":"2024-09-13T18:47:36.661224+0000","last_active":"2024-09-13T18:47:37.658066+0000","last_peered":"2024-09-13T18:47:37.658066+0000","last_clean":"2024-09-13T18:47:37.658066+0000","last_became_active":"2024-09-13T18:47:36.660848+0000","last_became_peered":"2024-09-13T18:47:36.660848+0000","last_unstale":"2024-09-13T18:47:37.658066+0000","last_undegraded":"2024-09-13T18:47:37.658066+0000","last_fullsized":"2024-09-13T18:47:37.658066+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867974+0000","last_change":"2024-09-13T18:47:36.669907+0000","last_active":"2024-09-13T18:47:37.867974+0000","last_peered":"2024-09-13T18:47:37.867974+0000","last_clean":"2024-09-13T18:47:37.867974+0000","last_became_active":"2024-09-13T18:47:36.668320+0000","last_became_peered":"2024-09-13T18:47:36.668320+0000","last_unstale":"2024-09-13T18:47:37.867974+0000","last_undegraded":"2024-09-13T18:47:37.867974+0000","last_fullsized":"2024-09-13T18:47:37.867974+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:04:46.218122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867966+0000","last_change":"2024-09-13T18:47:36.662868+0000","last_active":"2024-09-13T18:47:37.867966+0000","last_peered":"2024-09-13T18:47:37.867966+0000","last_clean":"2024-09-13T18:47:37.867966+0000","last_became_active":"2024-09-13T18:47:36.662152+0000","last_became_peered":"2024-09-13T18:47:36.662152+0000","last_unstale":"2024-09-13T18:47:37.867966+0000","last_undegraded":"2024-09-13T18:47:37.867966+0000","last_fullsized":"2024-09-13T18:47:37.867966+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:15:45.446183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654511+0000","last_change":"2024-09-13T18:47:36.673472+0000","last_active":"2024-09-13T18:47:37.654511+0000","last_peered":"2024-09-13T18:47:37.654511+0000","last_clean":"2024-09-13T18:47:37.654511+0000","last_became_active":"2024-09-13T18:47:36.673250+0000","last_became_peered":"2024-09-13T18:47:36.673250+0000","last_unstale":"2024-09-13T18:47:37.654511+0000","last_undegraded":"2024-09-13T18:47:37.654511+0000","last_fullsized":"2024-09-13T18:47:37.654511+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:01:15.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868721+0000","last_change":"2024-09-13T18:47:36.664565+0000","last_active":"2024-09-13T18:47:37.868721+0000","last_peered":"2024-09-13T18:47:37.868721+0000","last_clean":"2024-09-13T18:47:37.868721+0000","last_became_active":"2024-09-13T18:47:36.661677+0000","last_became_peered":"2024-09-13T18:47:36.661677+0000","last_unstale":"2024-09-13T18:47:37.868721+0000","last_undegraded":"2024-09-13T18:47:37.868721+0000","last_fullsized":"2024-09-13T18:47:37.868721+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:06.278126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867252+0000","last_change":"2024-09-13T18:47:36.662565+0000","last_active":"2024-09-13T18:47:37.867252+0000","last_peered":"2024-09-13T18:47:37.867252+0000","last_clean":"2024-09-13T18:47:37.867252+0000","last_became_active":"2024-09-13T18:47:36.662122+0000","last_became_peered":"2024-09-13T18:47:36.662122+0000","last_unstale":"2024-09-13T18:47:37.867252+0000","last_undegraded":"2024-09-13T18:47:37.867252+0000","last_fullsized":"2024-09-13T18:47:37.867252+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:00:42.388111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867252+0000","last_change":"2024-09-13T18:47:36.664646+0000","last_active":"2024-09-13T18:47:37.867252+0000","last_peered":"2024-09-13T18:47:37.867252+0000","last_clean":"2024-09-13T18:47:37.867252+0000","last_became_active":"2024-09-13T18:47:36.664122+0000","last_became_peered":"2024-09-13T18:47:36.664122+0000","last_unstale":"2024-09-13T18:47:37.867252+0000","last_undegraded":"2024-09-13T18:47:37.867252+0000","last_fullsized":"2024-09-13T18:47:37.867252+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:01:28.662400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867710+0000","last_change":"2024-09-13T18:47:36.661874+0000","last_active":"2024-09-13T18:47:37.867710+0000","last_peered":"2024-09-13T18:47:37.867710+0000","last_clean":"2024-09-13T18:47:37.867710+0000","last_became_active":"2024-09-13T18:47:36.661593+0000","last_became_peered":"2024-09-13T18:47:36.661593+0000","last_unstale":"2024-09-13T18:47:37.867710+0000","last_undegraded":"2024-09-13T18:47:37.867710+0000","last_fullsized":"2024-09-13T18:47:37.867710+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:33.424281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867544+0000","last_change":"2024-09-13T18:47:36.669840+0000","last_active":"2024-09-13T18:47:37.867544+0000","last_peered":"2024-09-13T18:47:37.867544+0000","last_clean":"2024-09-13T18:47:37.867544+0000","last_became_active":"2024-09-13T18:47:36.669514+0000","last_became_peered":"2024-09-13T18:47:36.669514+0000","last_unstale":"2024-09-13T18:47:37.867544+0000","last_undegraded":"2024-09-13T18:47:37.867544+0000","last_fullsized":"2024-09-13T18:47:37.867544+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:11:08.590092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658377+0000","last_change":"2024-09-13T18:47:36.664243+0000","last_active":"2024-09-13T18:47:37.658377+0000","last_peered":"2024-09-13T18:47:37.658377+0000","last_clean":"2024-09-13T18:47:37.658377+0000","last_became_active":"2024-09-13T18:47:36.663264+0000","last_became_peered":"2024-09-13T18:47:36.663264+0000","last_unstale":"2024-09-13T18:47:37.658377+0000","last_undegraded":"2024-09-13T18:47:37.658377+0000","last_fullsized":"2024-09-13T18:47:37.658377+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:44:34.255552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657964+0000","last_change":"2024-09-13T18:47:36.673118+0000","last_active":"2024-09-13T18:47:37.657964+0000","last_peered":"2024-09-13T18:47:37.657964+0000","last_clean":"2024-09-13T18:47:37.657964+0000","last_became_active":"2024-09-13T18:47:36.671634+0000","last_became_peered":"2024-09-13T18:47:36.671634+0000","last_unstale":"2024-09-13T18:47:37.657964+0000","last_undegraded":"2024-09-13T18:47:37.657964+0000","last_fullsized":"2024-09-13T18:47:37.657964+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:10:24.114294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867391+0000","last_change":"2024-09-13T18:47:36.664493+0000","last_active":"2024-09-13T18:47:37.867391+0000","last_peered":"2024-09-13T18:47:37.867391+0000","last_clean":"2024-09-13T18:47:37.867391+0000","last_became_active":"2024-09-13T18:47:36.663207+0000","last_became_peered":"2024-09-13T18:47:36.663207+0000","last_unstale":"2024-09-13T18:47:37.867391+0000","last_undegraded":"2024-09-13T18:47:37.867391+0000","last_fullsized":"2024-09-13T18:47:37.867391+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:28.088394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867786+0000","last_change":"2024-09-13T18:47:36.668519+0000","last_active":"2024-09-13T18:47:37.867786+0000","last_peered":"2024-09-13T18:47:37.867786+0000","last_clean":"2024-09-13T18:47:37.867786+0000","last_became_active":"2024-09-13T18:47:36.668138+0000","last_became_peered":"2024-09-13T18:47:36.668138+0000","last_unstale":"2024-09-13T18:47:37.867786+0000","last_undegraded":"2024-09-13T18:47:37.867786+0000","last_fullsized":"2024-09-13T18:47:37.867786+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:47.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867847+0000","last_change":"2024-09-13T18:47:36.667789+0000","last_active":"2024-09-13T18:47:37.867847+0000","last_peered":"2024-09-13T18:47:37.867847+0000","last_clean":"2024-09-13T18:47:37.867847+0000","last_became_active":"2024-09-13T18:47:36.667384+0000","last_became_peered":"2024-09-13T18:47:36.667384+0000","last_unstale":"2024-09-13T18:47:37.867847+0000","last_undegraded":"2024-09-13T18:47:37.867847+0000","last_fullsized":"2024-09-13T18:47:37.867847+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:52:54.602448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654664+0000","last_change":"2024-09-13T18:47:36.666114+0000","last_active":"2024-09-13T18:47:37.654664+0000","last_peered":"2024-09-13T18:47:37.654664+0000","last_clean":"2024-09-13T18:47:37.654664+0000","last_became_active":"2024-09-13T18:47:36.665672+0000","last_became_peered":"2024-09-13T18:47:36.665672+0000","last_unstale":"2024-09-13T18:47:37.654664+0000","last_undegraded":"2024-09-13T18:47:37.654664+0000","last_fullsized":"2024-09-13T18:47:37.654664+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:31:49.496985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867321+0000","last_change":"2024-09-13T18:47:36.663016+0000","last_active":"2024-09-13T18:47:37.867321+0000","last_peered":"2024-09-13T18:47:37.867321+0000","last_clean":"2024-09-13T18:47:37.867321+0000","last_became_active":"2024-09-13T18:47:36.662775+0000","last_became_peered":"2024-09-13T18:47:36.662775+0000","last_unstale":"2024-09-13T18:47:37.867321+0000","last_undegraded":"2024-09-13T18:47:37.867321+0000","last_fullsized":"2024-09-13T18:47:37.867321+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867672+0000","last_change":"2024-09-13T18:47:36.674991+0000","last_active":"2024-09-13T18:47:37.867672+0000","last_peered":"2024-09-13T18:47:37.867672+0000","last_clean":"2024-09-13T18:47:37.867672+0000","last_became_active":"2024-09-13T18:47:36.670790+0000","last_became_peered":"2024-09-13T18:47:36.670790+0000","last_unstale":"2024-09-13T18:47:37.867672+0000","last_undegraded":"2024-09-13T18:47:37.867672+0000","last_fullsized":"2024-09-13T18:47:37.867672+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:51.215456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658033+0000","last_change":"2024-09-13T18:47:36.660207+0000","last_active":"2024-09-13T18:47:37.658033+0000","last_peered":"2024-09-13T18:47:37.658033+0000","last_clean":"2024-09-13T18:47:37.658033+0000","last_became_active":"2024-09-13T18:47:36.659987+0000","last_became_peered":"2024-09-13T18:47:36.659987+0000","last_unstale":"2024-09-13T18:47:37.658033+0000","last_undegraded":"2024-09-13T18:47:37.658033+0000","last_fullsized":"2024-09-13T18:47:37.658033+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:06:54.622550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654631+0000","last_change":"2024-09-13T18:47:36.669332+0000","last_active":"2024-09-13T18:47:37.654631+0000","last_peered":"2024-09-13T18:47:37.654631+0000","last_clean":"2024-09-13T18:47:37.654631+0000","last_became_active":"2024-09-13T18:47:36.667384+0000","last_became_peered":"2024-09-13T18:47:36.667384+0000","last_unstale":"2024-09-13T18:47:37.654631+0000","last_undegraded":"2024-09-13T18:47:37.654631+0000","last_fullsized":"2024-09-13T18:47:37.654631+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:09:30.065102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867586+0000","last_change":"2024-09-13T18:47:36.670605+0000","last_active":"2024-09-13T18:47:37.867586+0000","last_peered":"2024-09-13T18:47:37.867586+0000","last_clean":"2024-09-13T18:47:37.867586+0000","last_became_active":"2024-09-13T18:47:36.670395+0000","last_became_peered":"2024-09-13T18:47:36.670395+0000","last_unstale":"2024-09-13T18:47:37.867586+0000","last_undegraded":"2024-09-13T18:47:37.867586+0000","last_fullsized":"2024-09-13T18:47:37.867586+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:37:19.969319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867871+0000","last_change":"2024-09-13T18:47:36.677545+0000","last_active":"2024-09-13T18:47:37.867871+0000","last_peered":"2024-09-13T18:47:37.867871+0000","last_clean":"2024-09-13T18:47:37.867871+0000","last_became_active":"2024-09-13T18:47:36.674997+0000","last_became_peered":"2024-09-13T18:47:36.674997+0000","last_unstale":"2024-09-13T18:47:37.867871+0000","last_undegraded":"2024-09-13T18:47:37.867871+0000","last_fullsized":"2024-09-13T18:47:37.867871+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.472218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867281+0000","last_change":"2024-09-13T18:47:36.665054+0000","last_active":"2024-09-13T18:47:37.867281+0000","last_peered":"2024-09-13T18:47:37.867281+0000","last_clean":"2024-09-13T18:47:37.867281+0000","last_became_active":"2024-09-13T18:47:36.664834+0000","last_became_peered":"2024-09-13T18:47:36.664834+0000","last_unstale":"2024-09-13T18:47:37.867281+0000","last_undegraded":"2024-09-13T18:47:37.867281+0000","last_fullsized":"2024-09-13T18:47:37.867281+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:12:01.048756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868012+0000","last_change":"2024-09-13T18:47:36.663069+0000","last_active":"2024-09-13T18:47:37.868012+0000","last_peered":"2024-09-13T18:47:37.868012+0000","last_clean":"2024-09-13T18:47:37.868012+0000","last_became_active":"2024-09-13T18:47:36.662649+0000","last_became_peered":"2024-09-13T18:47:36.662649+0000","last_unstale":"2024-09-13T18:47:37.868012+0000","last_undegraded":"2024-09-13T18:47:37.868012+0000","last_fullsized":"2024-09-13T18:47:37.868012+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:39:28.441914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867998+0000","last_change":"2024-09-13T18:47:36.673956+0000","last_active":"2024-09-13T18:47:37.867998+0000","last_peered":"2024-09-13T18:47:37.867998+0000","last_clean":"2024-09-13T18:47:37.867998+0000","last_became_active":"2024-09-13T18:47:36.673462+0000","last_became_peered":"2024-09-13T18:47:36.673462+0000","last_unstale":"2024-09-13T18:47:37.867998+0000","last_undegraded":"2024-09-13T18:47:37.867998+0000","last_fullsized":"2024-09-13T18:47:37.867998+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:56.498028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867667+0000","last_change":"2024-09-13T18:47:36.674337+0000","last_active":"2024-09-13T18:47:37.867667+0000","last_peered":"2024-09-13T18:47:37.867667+0000","last_clean":"2024-09-13T18:47:37.867667+0000","last_became_active":"2024-09-13T18:47:36.674117+0000","last_became_peered":"2024-09-13T18:47:36.674117+0000","last_unstale":"2024-09-13T18:47:37.867667+0000","last_undegraded":"2024-09-13T18:47:37.867667+0000","last_fullsized":"2024-09-13T18:47:37.867667+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:12:45.863229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868399+0000","last_change":"2024-09-13T18:47:36.672250+0000","last_active":"2024-09-13T18:47:37.868399+0000","last_peered":"2024-09-13T18:47:37.868399+0000","last_clean":"2024-09-13T18:47:37.868399+0000","last_became_active":"2024-09-13T18:47:36.672021+0000","last_became_peered":"2024-09-13T18:47:36.672021+0000","last_unstale":"2024-09-13T18:47:37.868399+0000","last_undegraded":"2024-09-13T18:47:37.868399+0000","last_fullsized":"2024-09-13T18:47:37.868399+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:11.678978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.657948+0000","last_change":"2024-09-13T18:47:36.660579+0000","last_active":"2024-09-13T18:47:37.657948+0000","last_peered":"2024-09-13T18:47:37.657948+0000","last_clean":"2024-09-13T18:47:37.657948+0000","last_became_active":"2024-09-13T18:47:36.660352+0000","last_became_peered":"2024-09-13T18:47:36.660352+0000","last_unstale":"2024-09-13T18:47:37.657948+0000","last_undegraded":"2024-09-13T18:47:37.657948+0000","last_fullsized":"2024-09-13T18:47:37.657948+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.847089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867831+0000","last_change":"2024-09-13T18:47:36.661312+0000","last_active":"2024-09-13T18:47:37.867831+0000","last_peered":"2024-09-13T18:47:37.867831+0000","last_clean":"2024-09-13T18:47:37.867831+0000","last_became_active":"2024-09-13T18:47:36.660957+0000","last_became_peered":"2024-09-13T18:47:36.660957+0000","last_unstale":"2024-09-13T18:47:37.867831+0000","last_undegraded":"2024-09-13T18:47:37.867831+0000","last_fullsized":"2024-09-13T18:47:37.867831+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:15.109881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658700+0000","last_change":"2024-09-13T18:47:36.655940+0000","last_active":"2024-09-13T18:47:37.658700+0000","last_peered":"2024-09-13T18:47:37.658700+0000","last_clean":"2024-09-13T18:47:37.658700+0000","last_became_active":"2024-09-13T18:47:36.655724+0000","last_became_peered":"2024-09-13T18:47:36.655724+0000","last_unstale":"2024-09-13T18:47:37.658700+0000","last_undegraded":"2024-09-13T18:47:37.658700+0000","last_fullsized":"2024-09-13T18:47:37.658700+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:51:47.744341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654290+0000","last_change":"2024-09-13T18:47:36.669216+0000","last_active":"2024-09-13T18:47:37.654290+0000","last_peered":"2024-09-13T18:47:37.654290+0000","last_clean":"2024-09-13T18:47:37.654290+0000","last_became_active":"2024-09-13T18:47:36.668140+0000","last_became_peered":"2024-09-13T18:47:36.668140+0000","last_unstale":"2024-09-13T18:47:37.654290+0000","last_undegraded":"2024-09-13T18:47:37.654290+0000","last_fullsized":"2024-09-13T18:47:37.654290+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:31:30.933540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867382+0000","last_change":"2024-09-13T18:47:36.669353+0000","last_active":"2024-09-13T18:47:37.867382+0000","last_peered":"2024-09-13T18:47:37.867382+0000","last_clean":"2024-09-13T18:47:37.867382+0000","last_became_active":"2024-09-13T18:47:36.667977+0000","last_became_peered":"2024-09-13T18:47:36.667977+0000","last_unstale":"2024-09-13T18:47:37.867382+0000","last_undegraded":"2024-09-13T18:47:37.867382+0000","last_fullsized":"2024-09-13T18:47:37.867382+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:38:21.714940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1f","version":"196'4","reported_seq":15,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658531+0000","last_change":"2024-09-13T18:47:36.248069+0000","last_active":"2024-09-13T18:47:37.658531+0000","last_peered":"2024-09-13T18:47:37.658531+0000","last_clean":"2024-09-13T18:47:37.658531+0000","last_became_active":"2024-09-13T18:47:36.247865+0000","last_became_peered":"2024-09-13T18:47:36.247865+0000","last_unstale":"2024-09-13T18:47:37.658531+0000","last_undegraded":"2024-09-13T18:47:37.658531+0000","last_fullsized":"2024-09-13T18:47:37.658531+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:04.681747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658177+0000","last_change":"2024-09-13T18:47:36.669924+0000","last_active":"2024-09-13T18:47:37.658177+0000","last_peered":"2024-09-13T18:47:37.658177+0000","last_clean":"2024-09-13T18:47:37.658177+0000","last_became_active":"2024-09-13T18:47:36.669714+0000","last_became_peered":"2024-09-13T18:47:36.669714+0000","last_unstale":"2024-09-13T18:47:37.658177+0000","last_undegraded":"2024-09-13T18:47:37.658177+0000","last_fullsized":"2024-09-13T18:47:37.658177+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:56.498028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1e","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867471+0000","last_change":"2024-09-13T18:47:36.247873+0000","last_active":"2024-09-13T18:47:37.867471+0000","last_peered":"2024-09-13T18:47:37.867471+0000","last_clean":"2024-09-13T18:47:37.867471+0000","last_became_active":"2024-09-13T18:47:36.247670+0000","last_became_peered":"2024-09-13T18:47:36.247670+0000","last_unstale":"2024-09-13T18:47:37.867471+0000","last_undegraded":"2024-09-13T18:47:37.867471+0000","last_fullsized":"2024-09-13T18:47:37.867471+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:35:05.270967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654735+0000","last_change":"2024-09-13T18:47:36.670298+0000","last_active":"2024-09-13T18:47:37.654735+0000","last_peered":"2024-09-13T18:47:37.654735+0000","last_clean":"2024-09-13T18:47:37.654735+0000","last_became_active":"2024-09-13T18:47:36.670002+0000","last_became_peered":"2024-09-13T18:47:36.670002+0000","last_unstale":"2024-09-13T18:47:37.654735+0000","last_undegraded":"2024-09-13T18:47:37.654735+0000","last_fullsized":"2024-09-13T18:47:37.654735+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:16:32.842473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1d","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654636+0000","last_change":"2024-09-13T18:47:36.247230+0000","last_active":"2024-09-13T18:47:37.654636+0000","last_peered":"2024-09-13T18:47:37.654636+0000","last_clean":"2024-09-13T18:47:37.654636+0000","last_became_active":"2024-09-13T18:47:36.243649+0000","last_became_peered":"2024-09-13T18:47:36.243649+0000","last_unstale":"2024-09-13T18:47:37.654636+0000","last_undegraded":"2024-09-13T18:47:37.654636+0000","last_fullsized":"2024-09-13T18:47:37.654636+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:42.301658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867874+0000","last_change":"2024-09-13T18:47:36.668375+0000","last_active":"2024-09-13T18:47:37.867874+0000","last_peered":"2024-09-13T18:47:37.867874+0000","last_clean":"2024-09-13T18:47:37.867874+0000","last_became_active":"2024-09-13T18:47:36.667792+0000","last_became_peered":"2024-09-13T18:47:36.667792+0000","last_unstale":"2024-09-13T18:47:37.867874+0000","last_undegraded":"2024-09-13T18:47:37.867874+0000","last_fullsized":"2024-09-13T18:47:37.867874+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1c","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868120+0000","last_change":"2024-09-13T18:47:36.244916+0000","last_active":"2024-09-13T18:47:37.868120+0000","last_peered":"2024-09-13T18:47:37.868120+0000","last_clean":"2024-09-13T18:47:37.868120+0000","last_became_active":"2024-09-13T18:47:36.244677+0000","last_became_peered":"2024-09-13T18:47:36.244677+0000","last_unstale":"2024-09-13T18:47:37.868120+0000","last_undegraded":"2024-09-13T18:47:37.868120+0000","last_fullsized":"2024-09-13T18:47:37.868120+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:16:46.676897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867428+0000","last_change":"2024-09-13T18:47:36.670701+0000","last_active":"2024-09-13T18:47:37.867428+0000","last_peered":"2024-09-13T18:47:37.867428+0000","last_clean":"2024-09-13T18:47:37.867428+0000","last_became_active":"2024-09-13T18:47:36.670465+0000","last_became_peered":"2024-09-13T18:47:36.670465+0000","last_unstale":"2024-09-13T18:47:37.867428+0000","last_undegraded":"2024-09-13T18:47:37.867428+0000","last_fullsized":"2024-09-13T18:47:37.867428+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:28:50.256377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1b","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658161+0000","last_change":"2024-09-13T18:47:36.245474+0000","last_active":"2024-09-13T18:47:37.658161+0000","last_peered":"2024-09-13T18:47:37.658161+0000","last_clean":"2024-09-13T18:47:37.658161+0000","last_became_active":"2024-09-13T18:47:36.243139+0000","last_became_peered":"2024-09-13T18:47:36.243139+0000","last_unstale":"2024-09-13T18:47:37.658161+0000","last_undegraded":"2024-09-13T18:47:37.658161+0000","last_fullsized":"2024-09-13T18:47:37.658161+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:04.857128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654443+0000","last_change":"2024-09-13T18:47:36.669403+0000","last_active":"2024-09-13T18:47:37.654443+0000","last_peered":"2024-09-13T18:47:37.654443+0000","last_clean":"2024-09-13T18:47:37.654443+0000","last_became_active":"2024-09-13T18:47:36.668520+0000","last_became_peered":"2024-09-13T18:47:36.668520+0000","last_unstale":"2024-09-13T18:47:37.654443+0000","last_undegraded":"2024-09-13T18:47:37.654443+0000","last_fullsized":"2024-09-13T18:47:37.654443+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:09:48.332483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.1a","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867516+0000","last_change":"2024-09-13T18:47:36.238895+0000","last_active":"2024-09-13T18:47:37.867516+0000","last_peered":"2024-09-13T18:47:37.867516+0000","last_clean":"2024-09-13T18:47:37.867516+0000","last_became_active":"2024-09-13T18:47:36.238649+0000","last_became_peered":"2024-09-13T18:47:36.238649+0000","last_unstale":"2024-09-13T18:47:37.867516+0000","last_undegraded":"2024-09-13T18:47:37.867516+0000","last_fullsized":"2024-09-13T18:47:37.867516+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:52.841280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868409+0000","last_change":"2024-09-13T18:47:36.668026+0000","last_active":"2024-09-13T18:47:37.868409+0000","last_peered":"2024-09-13T18:47:37.868409+0000","last_clean":"2024-09-13T18:47:37.868409+0000","last_became_active":"2024-09-13T18:47:36.667669+0000","last_became_peered":"2024-09-13T18:47:36.667669+0000","last_unstale":"2024-09-13T18:47:37.868409+0000","last_undegraded":"2024-09-13T18:47:37.868409+0000","last_fullsized":"2024-09-13T18:47:37.868409+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658136+0000","last_change":"2024-09-13T18:47:36.245328+0000","last_active":"2024-09-13T18:47:37.658136+0000","last_peered":"2024-09-13T18:47:37.658136+0000","last_clean":"2024-09-13T18:47:37.658136+0000","last_became_active":"2024-09-13T18:47:36.245089+0000","last_became_peered":"2024-09-13T18:47:36.245089+0000","last_unstale":"2024-09-13T18:47:37.658136+0000","last_undegraded":"2024-09-13T18:47:37.658136+0000","last_fullsized":"2024-09-13T18:47:37.658136+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:48.596962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868097+0000","last_change":"2024-09-13T18:47:36.669196+0000","last_active":"2024-09-13T18:47:37.868097+0000","last_peered":"2024-09-13T18:47:37.868097+0000","last_clean":"2024-09-13T18:47:37.868097+0000","last_became_active":"2024-09-13T18:47:36.667671+0000","last_became_peered":"2024-09-13T18:47:36.667671+0000","last_unstale":"2024-09-13T18:47:37.868097+0000","last_undegraded":"2024-09-13T18:47:37.868097+0000","last_fullsized":"2024-09-13T18:47:37.868097+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:33:12.420165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868579+0000","last_change":"2024-09-13T18:47:36.245057+0000","last_active":"2024-09-13T18:47:37.868579+0000","last_peered":"2024-09-13T18:47:37.868579+0000","last_clean":"2024-09-13T18:47:37.868579+0000","last_became_active":"2024-09-13T18:47:36.244259+0000","last_became_peered":"2024-09-13T18:47:36.244259+0000","last_unstale":"2024-09-13T18:47:37.868579+0000","last_undegraded":"2024-09-13T18:47:37.868579+0000","last_fullsized":"2024-09-13T18:47:37.868579+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:52.841280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867934+0000","last_change":"2024-09-13T18:47:36.675029+0000","last_active":"2024-09-13T18:47:37.867934+0000","last_peered":"2024-09-13T18:47:37.867934+0000","last_clean":"2024-09-13T18:47:37.867934+0000","last_became_active":"2024-09-13T18:47:36.674190+0000","last_became_peered":"2024-09-13T18:47:36.674190+0000","last_unstale":"2024-09-13T18:47:37.867934+0000","last_undegraded":"2024-09-13T18:47:37.867934+0000","last_fullsized":"2024-09-13T18:47:37.867934+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:02:58.411478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654601+0000","last_change":"2024-09-13T18:47:36.245731+0000","last_active":"2024-09-13T18:47:37.654601+0000","last_peered":"2024-09-13T18:47:37.654601+0000","last_clean":"2024-09-13T18:47:37.654601+0000","last_became_active":"2024-09-13T18:47:36.245198+0000","last_became_peered":"2024-09-13T18:47:36.245198+0000","last_unstale":"2024-09-13T18:47:37.654601+0000","last_undegraded":"2024-09-13T18:47:37.654601+0000","last_fullsized":"2024-09-13T18:47:37.654601+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:41:20.744688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867791+0000","last_change":"2024-09-13T18:47:36.675163+0000","last_active":"2024-09-13T18:47:37.867791+0000","last_peered":"2024-09-13T18:47:37.867791+0000","last_clean":"2024-09-13T18:47:37.867791+0000","last_became_active":"2024-09-13T18:47:36.674266+0000","last_became_peered":"2024-09-13T18:47:36.674266+0000","last_unstale":"2024-09-13T18:47:37.867791+0000","last_undegraded":"2024-09-13T18:47:37.867791+0000","last_fullsized":"2024-09-13T18:47:37.867791+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:46:38.049513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.15","version":"196'3","reported_seq":14,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868190+0000","last_change":"2024-09-13T18:47:36.249655+0000","last_active":"2024-09-13T18:47:37.868190+0000","last_peered":"2024-09-13T18:47:37.868190+0000","last_clean":"2024-09-13T18:47:37.868190+0000","last_became_active":"2024-09-13T18:47:36.249213+0000","last_became_peered":"2024-09-13T18:47:36.249213+0000","last_unstale":"2024-09-13T18:47:37.868190+0000","last_undegraded":"2024-09-13T18:47:37.868190+0000","last_fullsized":"2024-09-13T18:47:37.868190+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:39:27.081235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658256+0000","last_change":"2024-09-13T18:47:36.661070+0000","last_active":"2024-09-13T18:47:37.658256+0000","last_peered":"2024-09-13T18:47:37.658256+0000","last_clean":"2024-09-13T18:47:37.658256+0000","last_became_active":"2024-09-13T18:47:36.660552+0000","last_became_peered":"2024-09-13T18:47:36.660552+0000","last_unstale":"2024-09-13T18:47:37.658256+0000","last_undegraded":"2024-09-13T18:47:37.658256+0000","last_fullsized":"2024-09-13T18:47:37.658256+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:56.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.14","version":"196'6","reported_seq":17,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867364+0000","last_change":"2024-09-13T18:47:36.249645+0000","last_active":"2024-09-13T18:47:37.867364+0000","last_peered":"2024-09-13T18:47:37.867364+0000","last_clean":"2024-09-13T18:47:37.867364+0000","last_became_active":"2024-09-13T18:47:36.248562+0000","last_became_peered":"2024-09-13T18:47:36.248562+0000","last_unstale":"2024-09-13T18:47:37.867364+0000","last_undegraded":"2024-09-13T18:47:37.867364+0000","last_fullsized":"2024-09-13T18:47:37.867364+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:44:46.156648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867990+0000","last_change":"2024-09-13T18:47:36.667642+0000","last_active":"2024-09-13T18:47:37.867990+0000","last_peered":"2024-09-13T18:47:37.867990+0000","last_clean":"2024-09-13T18:47:37.867990+0000","last_became_active":"2024-09-13T18:47:36.662714+0000","last_became_peered":"2024-09-13T18:47:36.662714+0000","last_unstale":"2024-09-13T18:47:37.867990+0000","last_undegraded":"2024-09-13T18:47:37.867990+0000","last_fullsized":"2024-09-13T18:47:37.867990+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:33:05.864286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.13","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867761+0000","last_change":"2024-09-13T18:47:36.236420+0000","last_active":"2024-09-13T18:47:37.867761+0000","last_peered":"2024-09-13T18:47:37.867761+0000","last_clean":"2024-09-13T18:47:37.867761+0000","last_became_active":"2024-09-13T18:47:36.235714+0000","last_became_peered":"2024-09-13T18:47:36.235714+0000","last_unstale":"2024-09-13T18:47:37.867761+0000","last_undegraded":"2024-09-13T18:47:37.867761+0000","last_fullsized":"2024-09-13T18:47:37.867761+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:10.671819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868501+0000","last_change":"2024-09-13T18:47:36.667885+0000","last_active":"2024-09-13T18:47:37.868501+0000","last_peered":"2024-09-13T18:47:37.868501+0000","last_clean":"2024-09-13T18:47:37.868501+0000","last_became_active":"2024-09-13T18:47:36.667378+0000","last_became_peered":"2024-09-13T18:47:36.667378+0000","last_unstale":"2024-09-13T18:47:37.868501+0000","last_undegraded":"2024-09-13T18:47:37.868501+0000","last_fullsized":"2024-09-13T18:47:37.868501+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:14:31.847089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654814+0000","last_change":"2024-09-13T18:47:36.248999+0000","last_active":"2024-09-13T18:47:37.654814+0000","last_peered":"2024-09-13T18:47:37.654814+0000","last_clean":"2024-09-13T18:47:37.654814+0000","last_became_active":"2024-09-13T18:47:36.248768+0000","last_became_peered":"2024-09-13T18:47:36.248768+0000","last_unstale":"2024-09-13T18:47:37.654814+0000","last_undegraded":"2024-09-13T18:47:37.654814+0000","last_fullsized":"2024-09-13T18:47:37.654814+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:39:55.139069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654365+0000","last_change":"2024-09-13T18:47:36.665426+0000","last_active":"2024-09-13T18:47:37.654365+0000","last_peered":"2024-09-13T18:47:37.654365+0000","last_clean":"2024-09-13T18:47:37.654365+0000","last_became_active":"2024-09-13T18:47:36.664799+0000","last_became_peered":"2024-09-13T18:47:36.664799+0000","last_unstale":"2024-09-13T18:47:37.654365+0000","last_undegraded":"2024-09-13T18:47:37.654365+0000","last_fullsized":"2024-09-13T18:47:37.654365+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:55:52.028390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868810+0000","last_change":"2024-09-13T18:47:36.244155+0000","last_active":"2024-09-13T18:47:37.868810+0000","last_peered":"2024-09-13T18:47:37.868810+0000","last_clean":"2024-09-13T18:47:37.868810+0000","last_became_active":"2024-09-13T18:47:36.242743+0000","last_became_peered":"2024-09-13T18:47:36.242743+0000","last_unstale":"2024-09-13T18:47:37.868810+0000","last_undegraded":"2024-09-13T18:47:37.868810+0000","last_fullsized":"2024-09-13T18:47:37.868810+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:13:07.944076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867249+0000","last_change":"2024-09-13T18:47:36.663400+0000","last_active":"2024-09-13T18:47:37.867249+0000","last_peered":"2024-09-13T18:47:37.867249+0000","last_clean":"2024-09-13T18:47:37.867249+0000","last_became_active":"2024-09-13T18:47:36.662412+0000","last_became_peered":"2024-09-13T18:47:36.662412+0000","last_unstale":"2024-09-13T18:47:37.867249+0000","last_undegraded":"2024-09-13T18:47:37.867249+0000","last_fullsized":"2024-09-13T18:47:37.867249+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:52:12.904196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.10","version":"196'8","reported_seq":19,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867529+0000","last_change":"2024-09-13T18:47:36.245057+0000","last_active":"2024-09-13T18:47:37.867529+0000","last_peered":"2024-09-13T18:47:37.867529+0000","last_clean":"2024-09-13T18:47:37.867529+0000","last_became_active":"2024-09-13T18:47:36.244381+0000","last_became_peered":"2024-09-13T18:47:36.244381+0000","last_unstale":"2024-09-13T18:47:37.867529+0000","last_undegraded":"2024-09-13T18:47:37.867529+0000","last_fullsized":"2024-09-13T18:47:37.867529+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:15:37.775988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867751+0000","last_change":"2024-09-13T18:47:36.670043+0000","last_active":"2024-09-13T18:47:37.867751+0000","last_peered":"2024-09-13T18:47:37.867751+0000","last_clean":"2024-09-13T18:47:37.867751+0000","last_became_active":"2024-09-13T18:47:36.669789+0000","last_became_peered":"2024-09-13T18:47:36.669789+0000","last_unstale":"2024-09-13T18:47:37.867751+0000","last_undegraded":"2024-09-13T18:47:37.867751+0000","last_fullsized":"2024-09-13T18:47:37.867751+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T04:54:53.848438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.f","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867435+0000","last_change":"2024-09-13T18:47:36.249505+0000","last_active":"2024-09-13T18:47:37.867435+0000","last_peered":"2024-09-13T18:47:37.867435+0000","last_clean":"2024-09-13T18:47:37.867435+0000","last_became_active":"2024-09-13T18:47:36.248263+0000","last_became_peered":"2024-09-13T18:47:36.248263+0000","last_unstale":"2024-09-13T18:47:37.867435+0000","last_undegraded":"2024-09-13T18:47:37.867435+0000","last_fullsized":"2024-09-13T18:47:37.867435+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:50.768636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868204+0000","last_change":"2024-09-13T18:47:36.663657+0000","last_active":"2024-09-13T18:47:37.868204+0000","last_peered":"2024-09-13T18:47:37.868204+0000","last_clean":"2024-09-13T18:47:37.868204+0000","last_became_active":"2024-09-13T18:47:36.663431+0000","last_became_peered":"2024-09-13T18:47:36.663431+0000","last_unstale":"2024-09-13T18:47:37.868204+0000","last_undegraded":"2024-09-13T18:47:37.868204+0000","last_fullsized":"2024-09-13T18:47:37.868204+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:31:01.472218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.e","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867916+0000","last_change":"2024-09-13T18:47:36.249045+0000","last_active":"2024-09-13T18:47:37.867916+0000","last_peered":"2024-09-13T18:47:37.867916+0000","last_clean":"2024-09-13T18:47:37.867916+0000","last_became_active":"2024-09-13T18:47:36.248847+0000","last_became_peered":"2024-09-13T18:47:36.248847+0000","last_unstale":"2024-09-13T18:47:37.867916+0000","last_undegraded":"2024-09-13T18:47:37.867916+0000","last_fullsized":"2024-09-13T18:47:37.867916+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:48.596962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868562+0000","last_change":"2024-09-13T18:47:36.670564+0000","last_active":"2024-09-13T18:47:37.868562+0000","last_peered":"2024-09-13T18:47:37.868562+0000","last_clean":"2024-09-13T18:47:37.868562+0000","last_became_active":"2024-09-13T18:47:36.670058+0000","last_became_peered":"2024-09-13T18:47:36.670058+0000","last_unstale":"2024-09-13T18:47:37.868562+0000","last_undegraded":"2024-09-13T18:47:37.868562+0000","last_fullsized":"2024-09-13T18:47:37.868562+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:16.583320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.d","version":"196'1","reported_seq":12,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867310+0000","last_change":"2024-09-13T18:47:36.245401+0000","last_active":"2024-09-13T18:47:37.867310+0000","last_peered":"2024-09-13T18:47:37.867310+0000","last_clean":"2024-09-13T18:47:37.867310+0000","last_became_active":"2024-09-13T18:47:36.244957+0000","last_became_peered":"2024-09-13T18:47:36.244957+0000","last_unstale":"2024-09-13T18:47:37.867310+0000","last_undegraded":"2024-09-13T18:47:37.867310+0000","last_fullsized":"2024-09-13T18:47:37.867310+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:32:11.427182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867893+0000","last_change":"2024-09-13T18:47:36.673811+0000","last_active":"2024-09-13T18:47:37.867893+0000","last_peered":"2024-09-13T18:47:37.867893+0000","last_clean":"2024-09-13T18:47:37.867893+0000","last_became_active":"2024-09-13T18:47:36.673160+0000","last_became_peered":"2024-09-13T18:47:36.673160+0000","last_unstale":"2024-09-13T18:47:37.867893+0000","last_undegraded":"2024-09-13T18:47:37.867893+0000","last_fullsized":"2024-09-13T18:47:37.867893+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T01:19:16.583320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658462+0000","last_change":"2024-09-13T18:47:36.242697+0000","last_active":"2024-09-13T18:47:37.658462+0000","last_peered":"2024-09-13T18:47:37.658462+0000","last_clean":"2024-09-13T18:47:37.658462+0000","last_became_active":"2024-09-13T18:47:36.242416+0000","last_became_peered":"2024-09-13T18:47:36.242416+0000","last_unstale":"2024-09-13T18:47:37.658462+0000","last_undegraded":"2024-09-13T18:47:37.658462+0000","last_fullsized":"2024-09-13T18:47:37.658462+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:46:48.076074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658035+0000","last_change":"2024-09-13T18:47:36.658494+0000","last_active":"2024-09-13T18:47:37.658035+0000","last_peered":"2024-09-13T18:47:37.658035+0000","last_clean":"2024-09-13T18:47:37.658035+0000","last_became_active":"2024-09-13T18:47:36.658266+0000","last_became_peered":"2024-09-13T18:47:36.658266+0000","last_unstale":"2024-09-13T18:47:37.658035+0000","last_undegraded":"2024-09-13T18:47:37.658035+0000","last_fullsized":"2024-09-13T18:47:37.658035+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:51:03.377981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.b","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868286+0000","last_change":"2024-09-13T18:47:36.247290+0000","last_active":"2024-09-13T18:47:37.868286+0000","last_peered":"2024-09-13T18:47:37.868286+0000","last_clean":"2024-09-13T18:47:37.868286+0000","last_became_active":"2024-09-13T18:47:36.246871+0000","last_became_peered":"2024-09-13T18:47:36.246871+0000","last_unstale":"2024-09-13T18:47:37.868286+0000","last_undegraded":"2024-09-13T18:47:37.868286+0000","last_fullsized":"2024-09-13T18:47:37.868286+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T22:47:10.671819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867976+0000","last_change":"2024-09-13T18:47:36.668266+0000","last_active":"2024-09-13T18:47:37.867976+0000","last_peered":"2024-09-13T18:47:37.867976+0000","last_clean":"2024-09-13T18:47:37.867976+0000","last_became_active":"2024-09-13T18:47:36.667667+0000","last_became_peered":"2024-09-13T18:47:36.667667+0000","last_unstale":"2024-09-13T18:47:37.867976+0000","last_undegraded":"2024-09-13T18:47:37.867976+0000","last_fullsized":"2024-09-13T18:47:37.867976+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:27.850917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658374+0000","last_change":"2024-09-13T18:47:36.245779+0000","last_active":"2024-09-13T18:47:37.658374+0000","last_peered":"2024-09-13T18:47:37.658374+0000","last_clean":"2024-09-13T18:47:37.658374+0000","last_became_active":"2024-09-13T18:47:36.245552+0000","last_became_peered":"2024-09-13T18:47:36.245552+0000","last_unstale":"2024-09-13T18:47:37.658374+0000","last_undegraded":"2024-09-13T18:47:37.658374+0000","last_fullsized":"2024-09-13T18:47:37.658374+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:02:27.219461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658781+0000","last_change":"2024-09-13T18:47:36.654784+0000","last_active":"2024-09-13T18:47:37.658781+0000","last_peered":"2024-09-13T18:47:37.658781+0000","last_clean":"2024-09-13T18:47:37.658781+0000","last_became_active":"2024-09-13T18:47:36.654585+0000","last_became_peered":"2024-09-13T18:47:36.654585+0000","last_unstale":"2024-09-13T18:47:37.658781+0000","last_undegraded":"2024-09-13T18:47:37.658781+0000","last_fullsized":"2024-09-13T18:47:37.658781+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:57:33.424281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867842+0000","last_change":"2024-09-13T18:47:36.238796+0000","last_active":"2024-09-13T18:47:37.867842+0000","last_peered":"2024-09-13T18:47:37.867842+0000","last_clean":"2024-09-13T18:47:37.867842+0000","last_became_active":"2024-09-13T18:47:36.238563+0000","last_became_peered":"2024-09-13T18:47:36.238563+0000","last_unstale":"2024-09-13T18:47:37.867842+0000","last_undegraded":"2024-09-13T18:47:37.867842+0000","last_fullsized":"2024-09-13T18:47:37.867842+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:50.208297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867870+0000","last_change":"2024-09-13T18:47:36.676822+0000","last_active":"2024-09-13T18:47:37.867870+0000","last_peered":"2024-09-13T18:47:37.867870+0000","last_clean":"2024-09-13T18:47:37.867870+0000","last_became_active":"2024-09-13T18:47:36.676557+0000","last_became_peered":"2024-09-13T18:47:36.676557+0000","last_unstale":"2024-09-13T18:47:37.867870+0000","last_undegraded":"2024-09-13T18:47:37.867870+0000","last_fullsized":"2024-09-13T18:47:37.867870+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:23:05.688905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658376+0000","last_change":"2024-09-13T18:47:36.240840+0000","last_active":"2024-09-13T18:47:37.658376+0000","last_peered":"2024-09-13T18:47:37.658376+0000","last_clean":"2024-09-13T18:47:37.658376+0000","last_became_active":"2024-09-13T18:47:36.240602+0000","last_became_peered":"2024-09-13T18:47:36.240602+0000","last_unstale":"2024-09-13T18:47:37.658376+0000","last_undegraded":"2024-09-13T18:47:37.658376+0000","last_fullsized":"2024-09-13T18:47:37.658376+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:52:19.745843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868090+0000","last_change":"2024-09-13T18:47:36.677635+0000","last_active":"2024-09-13T18:47:37.868090+0000","last_peered":"2024-09-13T18:47:37.868090+0000","last_clean":"2024-09-13T18:47:37.868090+0000","last_became_active":"2024-09-13T18:47:36.675352+0000","last_became_peered":"2024-09-13T18:47:36.675352+0000","last_unstale":"2024-09-13T18:47:37.868090+0000","last_undegraded":"2024-09-13T18:47:37.868090+0000","last_fullsized":"2024-09-13T18:47:37.868090+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:56.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.7","version":"196'2","reported_seq":13,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654719+0000","last_change":"2024-09-13T18:47:36.248480+0000","last_active":"2024-09-13T18:47:37.654719+0000","last_peered":"2024-09-13T18:47:37.654719+0000","last_clean":"2024-09-13T18:47:37.654719+0000","last_became_active":"2024-09-13T18:47:36.247088+0000","last_became_peered":"2024-09-13T18:47:36.247088+0000","last_unstale":"2024-09-13T18:47:37.654719+0000","last_undegraded":"2024-09-13T18:47:37.654719+0000","last_fullsized":"2024-09-13T18:47:37.654719+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:17:16.686938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868344+0000","last_change":"2024-09-13T18:47:36.664543+0000","last_active":"2024-09-13T18:47:37.868344+0000","last_peered":"2024-09-13T18:47:37.868344+0000","last_clean":"2024-09-13T18:47:37.868344+0000","last_became_active":"2024-09-13T18:47:36.661618+0000","last_became_peered":"2024-09-13T18:47:36.661618+0000","last_unstale":"2024-09-13T18:47:37.868344+0000","last_undegraded":"2024-09-13T18:47:37.868344+0000","last_fullsized":"2024-09-13T18:47:37.868344+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:30:56.498028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658087+0000","last_change":"2024-09-13T18:47:36.245674+0000","last_active":"2024-09-13T18:47:37.658087+0000","last_peered":"2024-09-13T18:47:37.658087+0000","last_clean":"2024-09-13T18:47:37.658087+0000","last_became_active":"2024-09-13T18:47:36.245001+0000","last_became_peered":"2024-09-13T18:47:36.245001+0000","last_unstale":"2024-09-13T18:47:37.658087+0000","last_undegraded":"2024-09-13T18:47:37.658087+0000","last_fullsized":"2024-09-13T18:47:37.658087+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:49:21.060815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867674+0000","last_change":"2024-09-13T18:47:36.662728+0000","last_active":"2024-09-13T18:47:37.867674+0000","last_peered":"2024-09-13T18:47:37.867674+0000","last_clean":"2024-09-13T18:47:37.867674+0000","last_became_active":"2024-09-13T18:47:36.662497+0000","last_became_peered":"2024-09-13T18:47:36.662497+0000","last_unstale":"2024-09-13T18:47:37.867674+0000","last_undegraded":"2024-09-13T18:47:37.867674+0000","last_fullsized":"2024-09-13T18:47:37.867674+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T03:01:59.403245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658276+0000","last_change":"2024-09-13T18:47:36.246019+0000","last_active":"2024-09-13T18:47:37.658276+0000","last_peered":"2024-09-13T18:47:37.658276+0000","last_clean":"2024-09-13T18:47:37.658276+0000","last_became_active":"2024-09-13T18:47:36.245556+0000","last_became_peered":"2024-09-13T18:47:36.245556+0000","last_unstale":"2024-09-13T18:47:37.658276+0000","last_undegraded":"2024-09-13T18:47:37.658276+0000","last_fullsized":"2024-09-13T18:47:37.658276+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:13.058518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868307+0000","last_change":"2024-09-13T18:47:36.665539+0000","last_active":"2024-09-13T18:47:37.868307+0000","last_peered":"2024-09-13T18:47:37.868307+0000","last_clean":"2024-09-13T18:47:37.868307+0000","last_became_active":"2024-09-13T18:47:36.665224+0000","last_became_peered":"2024-09-13T18:47:36.665224+0000","last_unstale":"2024-09-13T18:47:37.868307+0000","last_undegraded":"2024-09-13T18:47:37.868307+0000","last_fullsized":"2024-09-13T18:47:37.868307+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T18:58:56.582282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868637+0000","last_change":"2024-09-13T18:47:36.246779+0000","last_active":"2024-09-13T18:47:37.868637+0000","last_peered":"2024-09-13T18:47:37.868637+0000","last_clean":"2024-09-13T18:47:37.868637+0000","last_became_active":"2024-09-13T18:47:36.246448+0000","last_became_peered":"2024-09-13T18:47:36.246448+0000","last_unstale":"2024-09-13T18:47:37.868637+0000","last_undegraded":"2024-09-13T18:47:37.868637+0000","last_fullsized":"2024-09-13T18:47:37.868637+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:21:50.208297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.654542+0000","last_change":"2024-09-13T18:47:36.670877+0000","last_active":"2024-09-13T18:47:37.654542+0000","last_peered":"2024-09-13T18:47:37.654542+0000","last_clean":"2024-09-13T18:47:37.654542+0000","last_became_active":"2024-09-13T18:47:36.668859+0000","last_became_peered":"2024-09-13T18:47:36.668859+0000","last_unstale":"2024-09-13T18:47:37.654542+0000","last_undegraded":"2024-09-13T18:47:37.654542+0000","last_fullsized":"2024-09-13T18:47:37.654542+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:39:52.638881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867743+0000","last_change":"2024-09-13T18:47:36.249187+0000","last_active":"2024-09-13T18:47:37.867743+0000","last_peered":"2024-09-13T18:47:37.867743+0000","last_clean":"2024-09-13T18:47:37.867743+0000","last_became_active":"2024-09-13T18:47:36.248694+0000","last_became_peered":"2024-09-13T18:47:36.248694+0000","last_unstale":"2024-09-13T18:47:37.867743+0000","last_undegraded":"2024-09-13T18:47:37.867743+0000","last_fullsized":"2024-09-13T18:47:37.867743+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T05:29:32.954560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658876+0000","last_change":"2024-09-13T18:47:36.667258+0000","last_active":"2024-09-13T18:47:37.658876+0000","last_peered":"2024-09-13T18:47:37.658876+0000","last_clean":"2024-09-13T18:47:37.658876+0000","last_became_active":"2024-09-13T18:47:36.666598+0000","last_became_peered":"2024-09-13T18:47:36.666598+0000","last_unstale":"2024-09-13T18:47:37.658876+0000","last_undegraded":"2024-09-13T18:47:37.658876+0000","last_fullsized":"2024-09-13T18:47:37.658876+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:00:27.850917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868898+0000","last_change":"2024-09-13T18:47:36.244771+0000","last_active":"2024-09-13T18:47:37.868898+0000","last_peered":"2024-09-13T18:47:37.868898+0000","last_clean":"2024-09-13T18:47:37.868898+0000","last_became_active":"2024-09-13T18:47:36.243814+0000","last_became_peered":"2024-09-13T18:47:36.243814+0000","last_unstale":"2024-09-13T18:47:37.868898+0000","last_undegraded":"2024-09-13T18:47:37.868898+0000","last_fullsized":"2024-09-13T18:47:37.868898+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:55:56.572013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867901+0000","last_change":"2024-09-13T18:47:36.673051+0000","last_active":"2024-09-13T18:47:37.867901+0000","last_peered":"2024-09-13T18:47:37.867901+0000","last_clean":"2024-09-13T18:47:37.867901+0000","last_became_active":"2024-09-13T18:47:36.670287+0000","last_became_peered":"2024-09-13T18:47:36.670287+0000","last_unstale":"2024-09-13T18:47:37.867901+0000","last_undegraded":"2024-09-13T18:47:37.867901+0000","last_fullsized":"2024-09-13T18:47:37.867901+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T02:22:49.604120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658604+0000","last_change":"2024-09-13T18:47:36.246728+0000","last_active":"2024-09-13T18:47:37.658604+0000","last_peered":"2024-09-13T18:47:37.658604+0000","last_clean":"2024-09-13T18:47:37.658604+0000","last_became_active":"2024-09-13T18:47:36.245742+0000","last_became_peered":"2024-09-13T18:47:36.245742+0000","last_unstale":"2024-09-13T18:47:37.658604+0000","last_undegraded":"2024-09-13T18:47:37.658604+0000","last_fullsized":"2024-09-13T18:47:37.658604+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T00:18:48.239246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658456+0000","last_change":"2024-09-13T18:47:36.666922+0000","last_active":"2024-09-13T18:47:37.658456+0000","last_peered":"2024-09-13T18:47:37.658456+0000","last_clean":"2024-09-13T18:47:37.658456+0000","last_became_active":"2024-09-13T18:47:36.666034+0000","last_became_peered":"2024-09-13T18:47:36.666034+0000","last_unstale":"2024-09-13T18:47:37.658456+0000","last_undegraded":"2024-09-13T18:47:37.658456+0000","last_fullsized":"2024-09-13T18:47:37.658456+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T23:26:15.109881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.658350+0000","last_change":"2024-09-13T18:47:36.241987+0000","last_active":"2024-09-13T18:47:37.658350+0000","last_peered":"2024-09-13T18:47:37.658350+0000","last_clean":"2024-09-13T18:47:37.658350+0000","last_became_active":"2024-09-13T18:47:36.241777+0000","last_became_peered":"2024-09-13T18:47:36.241777+0000","last_unstale":"2024-09-13T18:47:37.658350+0000","last_undegraded":"2024-09-13T18:47:37.658350+0000","last_fullsized":"2024-09-13T18:47:37.658350+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:54:55.465028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.868622+0000","last_change":"2024-09-13T18:47:36.669474+0000","last_active":"2024-09-13T18:47:37.868622+0000","last_peered":"2024-09-13T18:47:37.868622+0000","last_clean":"2024-09-13T18:47:37.868622+0000","last_became_active":"2024-09-13T18:47:36.668884+0000","last_became_peered":"2024-09-13T18:47:36.668884+0000","last_unstale":"2024-09-13T18:47:37.868622+0000","last_undegraded":"2024-09-13T18:47:37.868622+0000","last_fullsized":"2024-09-13T18:47:37.868622+0000","mapping_epoch":195,"log_start":"0'0","ondisk_log_start":"0'0","created":195,"last_epoch_clean":196,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:36.229465+0000","last_clean_scrub_stamp":"2024-09-13T18:47:36.229465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T19:43:14.065677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":197,"state":"active+clean","last_fresh":"2024-09-13T18:47:37.867226+0000","last_change":"2024-09-13T18:47:36.245237+0000","last_active":"2024-09-13T18:47:37.867226+0000","last_peered":"2024-09-13T18:47:37.867226+0000","last_clean":"2024-09-13T18:47:37.867226+0000","last_became_active":"2024-09-13T18:47:36.244654+0000","last_became_peered":"2024-09-13T18:47:36.244654+0000","last_unstale":"2024-09-13T18:47:37.867226+0000","last_undegraded":"2024-09-13T18:47:37.867226+0000","last_fullsized":"2024-09-13T18:47:37.867226+0000","mapping_epoch":194,"log_start":"0'0","ondisk_log_start":"0'0","created":194,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:47:35.222306+0000","last_clean_scrub_stamp":"2024-09-13T18:47:35.222306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T21:42:17.347692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":329,"reported_epoch":196,"state":"active+clean","last_fresh":"2024-09-13T18:47:36.658592+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:47:36.658592+0000","last_peered":"2024-09-13T18:47:36.658592+0000","last_clean":"2024-09-13T18:47:36.658592+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:47:36.658592+0000","last_undegraded":"2024-09-13T18:47:36.658592+0000","last_fullsized":"2024-09-13T18:47:36.658592+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542294,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1662,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193650,"statfs":{"total":200000000,"available":198297735,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.66800000000000004,"15min":0.65000000000000002},"min":{"1min":0.441,"5min":0.33700000000000002,"15min":0.313},"max":{"1min":0.90400000000000003,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.70499999999999996,"15min":0.66400000000000003},"min":{"1min":0.44600000000000001,"5min":0.38500000000000001,"15min":0.34599999999999997},"max":{"1min":0.93000000000000005,"5min":0.94799999999999995,"15min":1.014},"last":0.46000000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.70699999999999996,"15min":0.68300000000000005},"min":{"1min":0.47199999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.91000000000000003,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.63},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.69199999999999995,"15min":0.66700000000000004},"min":{"1min":0.53800000000000003,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.89700000000000002,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.50700000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.70799999999999996,"15min":0.67700000000000005},"min":{"1min":0.48899999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.95699999999999996,"5min":1.004,"15min":1.004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68500000000000005,"15min":0.66400000000000003},"min":{"1min":0.504,"5min":0.45800000000000002,"15min":0.41599999999999998},"max":{"1min":0.86899999999999999,"5min":0.93799999999999994,"15min":0.999},"last":0.60699999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.72499999999999998,"15min":0.78400000000000003},"min":{"1min":0.52500000000000002,"5min":0.497,"15min":0.47499999999999998},"max":{"1min":0.91500000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.71999999999999997,"15min":0.78000000000000003},"min":{"1min":0.49399999999999999,"5min":0.48999999999999999,"15min":0.44},"max":{"1min":0.92700000000000005,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.69799999999999995}]},{"osd":4,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56799999999999995,"15min":0.56699999999999995},"min":{"1min":0.379,"5min":0.372,"15min":0.313},"max":{"1min":0.86499999999999999,"5min":0.97599999999999998,"15min":1.036},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60499999999999998,"15min":0.61399999999999999},"min":{"1min":0.433,"5min":0.39300000000000002,"15min":0.36299999999999999},"max":{"1min":0.80200000000000005,"5min":1.004,"15min":1.1799999999999999},"last":0.73499999999999999}]},{"osd":6,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66900000000000004,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.44900000000000001,"15min":0.38300000000000001},"max":{"1min":0.89700000000000002,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68899999999999995,"15min":0.70399999999999996},"min":{"1min":0.438,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89600000000000002,"5min":0.98299999999999998,"15min":1.371},"last":0.71999999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:46:47 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.68100000000000005,"15min":0.67800000000000005},"min":{"1min":0.45600000000000002,"5min":0.44800000000000001,"15min":0.40400000000000003},"max":{"1min":0.88100000000000001,"5min":0.92400000000000004,"15min":1.143},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.69399999999999995,"15min":0.68799999999999994},"min":{"1min":0.496,"5min":0.47599999999999998,"15min":0.41799999999999998},"max":{"1min":0.871,"5min":0.98099999999999998,"15min":1.125},"last":0.76000000000000001}]}]},{"osd":7,"up_from":13,"seq":55834574996,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70299999999999996,"15min":0.67300000000000004},"min":{"1min":0.41699999999999998,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.92000000000000004,"5min":0.93200000000000005,"15min":1.665},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.69899999999999995,"15min":0.66300000000000003},"min":{"1min":0.45400000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.92000000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.73899999999999999,"15min":0.68899999999999995},"min":{"1min":0.497,"5min":0.46899999999999997,"15min":0.432},"max":{"1min":0.97499999999999998,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.67800000000000005,"15min":0.66200000000000003},"min":{"1min":0.498,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.875,"5min":0.96799999999999997,"15min":1.591},"last":0.75}]},{"osd":2,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.73299999999999998,"15min":0.70799999999999996},"min":{"1min":0.54200000000000004,"5min":0.439,"15min":0.439},"max":{"1min":1.004,"5min":1.016,"15min":2.2709999999999999},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.745,"15min":0.72199999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":2.169},"last":0.88200000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.75700000000000001,"15min":0.70899999999999996},"min":{"1min":0.58499999999999996,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.93899999999999995,"5min":0.96499999999999997,"15min":1.4450000000000001},"last":0.96599999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69399999999999995,"15min":0.66900000000000004},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.90200000000000002,"5min":1.071,"15min":1.071},"last":0.89500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.86599999999999999,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.627,"15min":0.63400000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35199999999999998},"max":{"1min":0.94699999999999995,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":1.0249999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.70899999999999996,"15min":0.69099999999999995},"min":{"1min":0.47399999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.0840000000000001},"last":1.052},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.68300000000000005,"15min":0.66300000000000003},"min":{"1min":0.5,"5min":0.438,"15min":0.372},"max":{"1min":0.92100000000000004,"5min":1.0289999999999999,"15min":1.115},"last":0.80200000000000005}]},{"osd":6,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.73299999999999998,"15min":0.71299999999999997},"min":{"1min":0.53300000000000003,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":1.0229999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.77800000000000002,"15min":0.75},"min":{"1min":0.55500000000000005,"5min":0.52500000000000002,"15min":0.50700000000000001},"max":{"1min":1.0049999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":1.1140000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574996,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.69899999999999995,"15min":0.76100000000000001},"min":{"1min":0.46899999999999997,"5min":0.39700000000000002,"15min":0.32400000000000001},"max":{"1min":0.83699999999999997,"5min":1.02,"15min":6.4539999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.65500000000000003},"min":{"1min":0.432,"5min":0.41599999999999998,"15min":0.35899999999999999},"max":{"1min":0.92300000000000004,"5min":1.01,"15min":1.01},"last":0.55600000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.69699999999999995,"15min":0.77000000000000002},"min":{"1min":0.47299999999999998,"5min":0.436,"15min":0.377},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68600000000000005,"15min":0.75700000000000001},"min":{"1min":0.495,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":1.038,"5min":1.038,"15min":6.5019999999999998},"last":0.748}]},{"osd":2,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.69699999999999995,"15min":0.67000000000000004},"min":{"1min":0.50800000000000001,"5min":0.47399999999999998,"15min":0.41599999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.032},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.69899999999999995,"15min":0.79100000000000004},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95199999999999996,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.84399999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.69699999999999995,"15min":0.76200000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.97499999999999998,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.746,"5min":0.72599999999999998,"15min":0.68700000000000006},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.72599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.629,"15min":0.63500000000000001},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.81200000000000006,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.68300000000000005,"15min":0.68500000000000005},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.78900000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.57499999999999996,"15min":0.59899999999999998},"min":{"1min":0.42099999999999999,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.871,"5min":0.871,"15min":1.5509999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.628,"15min":0.63},"min":{"1min":0.39400000000000002,"5min":0.38,"15min":0.38},"max":{"1min":0.85499999999999998,"5min":0.88400000000000001,"15min":1.403},"last":0.63100000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:43 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66200000000000003,"15min":0.67600000000000005},"min":{"1min":0.46500000000000002,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.871},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.49099999999999999,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.84499999999999997,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.85999999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888741,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.70599999999999996,"15min":0.68400000000000005},"min":{"1min":0.52100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.96799999999999997,"5min":1.581,"15min":2.0579999999999998},"last":0.501},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69299999999999995,"15min":0.67000000000000004},"min":{"1min":0.46899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92300000000000004,"5min":1.2370000000000001,"15min":2.3399999999999999},"last":0.71899999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70399999999999996,"15min":0.69199999999999995},"min":{"1min":0.497,"5min":0.45200000000000001,"15min":0.40400000000000003},"max":{"1min":0.94899999999999995,"5min":1.48,"15min":1.48},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.71699999999999997,"15min":0.69799999999999995},"min":{"1min":0.50600000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":1.6060000000000001,"15min":2.8180000000000001},"last":0.66600000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.71299999999999997,"15min":0.70999999999999996},"min":{"1min":0.53400000000000003,"5min":0.373,"15min":0.373},"max":{"1min":0.94099999999999995,"5min":1.5589999999999999,"15min":3.706},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.70599999999999996},"min":{"1min":0.54500000000000004,"5min":0.46700000000000003,"15min":0.41899999999999998},"max":{"1min":1.028,"5min":2.915,"15min":3.742},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73599999999999999,"15min":0.72699999999999998},"min":{"1min":0.55100000000000005,"5min":0.41799999999999998,"15min":0.40799999999999997},"max":{"1min":1.085,"5min":1.762,"15min":3.6909999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.72299999999999998,"15min":0.69799999999999995},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.996,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":0.61599999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.85999999999999999,"5min":1.6870000000000001,"15min":1.9970000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.65400000000000003,"15min":0.61799999999999999},"min":{"1min":0.443,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81399999999999995,"5min":4.4569999999999999,"15min":4.4569999999999999},"last":0.77900000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.72499999999999998,"15min":0.74399999999999999},"min":{"1min":0.55100000000000005,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.88,"5min":4.0620000000000003,"15min":8.5519999999999996},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.48599999999999999,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.95999999999999996,"5min":1.843,"15min":3.7989999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:46:51 2024","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.64600000000000002,"15min":0.63600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.88800000000000001,"5min":1.548,"15min":5.5069999999999997},"last":0.755},{"interface":"front","average":{"1min":0.753,"5min":0.78300000000000003,"15min":0.72999999999999998},"min":{"1min":0.622,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":0.87,"5min":4.5259999999999998,"15min":4.5259999999999998},"last":0.83799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574996,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1086,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194225,"statfs":{"total":200000000,"available":198887189,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.44,"15min":0.438},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.65300000000000002,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.46400000000000002,"15min":0.45600000000000002},"min":{"1min":0.36599999999999999,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.71499999999999997,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.371}]},{"osd":1,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.48799999999999999,"15min":0.62},"min":{"1min":0.36399999999999999,"5min":0.32200000000000001,"15min":0.26800000000000002},"max":{"1min":0.66300000000000003,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.52400000000000002},"min":{"1min":0.36299999999999999,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.72899999999999998,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.53200000000000003,"15min":0.56799999999999995},"min":{"1min":0.38600000000000001,"5min":0.35899999999999999,"15min":0.34499999999999997},"max":{"1min":0.64400000000000002,"5min":0.78600000000000003,"15min":4.7919999999999998},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.51500000000000001,"15min":0.60699999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.75700000000000001,"5min":0.83499999999999996,"15min":7.798},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.75,"15min":0.78100000000000003},"min":{"1min":0.56999999999999995,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":0.97499999999999998,"5min":1.0669999999999999,"15min":3.093},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.754,"5min":0.74299999999999999,"15min":0.746},"min":{"1min":0.58099999999999996,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.006,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.999}]},{"osd":5,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76800000000000002,"15min":0.78900000000000003},"min":{"1min":0.60599999999999998,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.0389999999999999,"5min":1.1950000000000001,"15min":3.0299999999999998},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.73299999999999998,"15min":0.73199999999999998},"min":{"1min":0.58099999999999996,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.95499999999999996,"5min":1.2,"15min":1.2},"last":0.88400000000000001}]},{"osd":6,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.75,"15min":0.874},"min":{"1min":0.622,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.01,"5min":1.1519999999999999,"15min":7.9199999999999999},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.751,"15min":0.82999999999999996},"min":{"1min":0.61399999999999999,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.92500000000000004,"5min":1.105,"15min":8.0519999999999996},"last":0.875}]},{"osd":7,"last update":"Fri Sep 13 18:46:56 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.73799999999999999},"min":{"1min":0.59899999999999998,"5min":0.503,"15min":0.503},"max":{"1min":1.026,"5min":1.1559999999999999,"15min":1.206},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.79500000000000004,"15min":0.82199999999999995},"min":{"1min":0.66100000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.046,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194226,"statfs":{"total":200000000,"available":198888193,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.41499999999999998,"15min":0.41899999999999998},"min":{"1min":0.308,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.50900000000000001,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46200000000000002,"15min":0.45700000000000002},"min":{"1min":0.31900000000000001,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.71999999999999997,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.499,"15min":0.48799999999999999},"min":{"1min":0.371,"5min":0.34399999999999997,"15min":0.31900000000000001},"max":{"1min":0.67400000000000004,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.433},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.46300000000000002,"15min":0.46800000000000003},"min":{"1min":0.35599999999999998,"5min":0.29799999999999999,"15min":0.26100000000000001},"max":{"1min":0.61399999999999999,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.41399999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.501,"15min":0.504},"min":{"1min":0.41099999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.622,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58299999999999996,"15min":0.57599999999999996},"min":{"1min":0.495,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.76000000000000001,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.51800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.745,"15min":0.72699999999999998},"min":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":0.90600000000000003,"5min":1.0609999999999999,"15min":1.1830000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.71999999999999997},"min":{"1min":0.52800000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98099999999999998,"5min":1.111,"15min":1.111},"last":0.442}]},{"osd":5,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79600000000000004,"15min":0.77800000000000002},"min":{"1min":0.63,"5min":0.52100000000000002,"15min":0.47299999999999998},"max":{"1min":1.006,"5min":1.423,"15min":1.423},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.79200000000000004,"15min":0.753},"min":{"1min":0.60499999999999998,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.96899999999999997,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.499}]},{"osd":6,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.76000000000000001,"15min":0.73899999999999999},"min":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.98399999999999999,"5min":1.329,"15min":1.329},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.745,"15min":0.72099999999999997},"min":{"1min":0.57999999999999996,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0129999999999999,"5min":1.022,"15min":1.6220000000000001},"last":0.53300000000000003}]},{"osd":7,"last update":"Fri Sep 13 18:47:01 2024","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.78700000000000003,"15min":0.76000000000000001},"min":{"1min":0.61099999999999999,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.97799999999999998,"5min":1.159,"15min":1.159},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.81299999999999994,"5min":0.81100000000000005,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.016,"5min":1.508,"15min":1.508},"last":0.57899999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1663,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193649,"statfs":{"total":200000000,"available":198296661,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42799999999999999,"15min":0.437},"min":{"1min":0.308,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.56200000000000006,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.47399999999999998,"15min":0.47999999999999998},"min":{"1min":0.34399999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.63,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.35499999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.436,"15min":0.45200000000000001},"min":{"1min":0.316,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60399999999999998,"5min":0.63300000000000001,"15min":1.036},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50700000000000001,"15min":0.496},"min":{"1min":0.38,"5min":0.32200000000000001,"15min":0.27900000000000003},"max":{"1min":0.71199999999999997,"5min":0.73699999999999999,"15min":0.85399999999999998},"last":0.46000000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.67000000000000004,"5min":0.73999999999999999,"15min":0.86499999999999999},"last":0.495},{"interface":"front","average":{"1min":0.505,"5min":0.504,"15min":0.51000000000000001},"min":{"1min":0.39400000000000002,"5min":0.33000000000000002,"15min":0.29499999999999998},"max":{"1min":0.63600000000000001,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.39500000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79200000000000004,"15min":0.77700000000000002},"min":{"1min":0.57499999999999996,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.75800000000000001,"15min":0.76500000000000001},"min":{"1min":0.56499999999999995,"5min":0.48599999999999999,"15min":0.45500000000000002},"max":{"1min":1.139,"5min":1.139,"15min":1.3029999999999999},"last":0.748}]},{"osd":5,"last update":"Fri Sep 13 18:47:03 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.75,"15min":0.74399999999999999},"min":{"1min":0.53200000000000003,"5min":0.50700000000000001,"15min":0.42599999999999999},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.503,"5min":0.503,"15min":0.41899999999999998},"max":{"1min":0.94799999999999995,"5min":0.96499999999999997,"15min":1.242},"last":0.66500000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77800000000000002,"15min":0.78200000000000003},"min":{"1min":0.57199999999999995,"5min":0.53700000000000003,"15min":0.53200000000000003},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.78800000000000003,"15min":0.78600000000000003},"min":{"1min":0.59699999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.69899999999999995}]},{"osd":7,"last update":"Fri Sep 13 18:46:46 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.76100000000000001,"15min":0.75700000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.628},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.754,"15min":0.76700000000000002},"min":{"1min":0.57699999999999996,"5min":0.51500000000000001,"15min":0.5},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.76800000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574996,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1085,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198888705,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.41799999999999998,"5min":0.41899999999999998,"15min":0.443},"min":{"1min":0.27300000000000002,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.53600000000000003,"5min":0.60199999999999998,"15min":1.669},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45300000000000001,"15min":0.45100000000000001},"min":{"1min":0.29799999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.874},"last":0.34399999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.49399999999999999,"15min":0.498},"min":{"1min":0.38,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.69999999999999996,"5min":0.76100000000000001,"15min":1.591},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.499,"5min":0.51300000000000001,"15min":0.49399999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.53700000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.47699999999999998,"15min":0.46899999999999997},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.66600000000000004,"5min":0.70899999999999996,"15min":1.03},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.36799999999999999,"15min":0.315},"max":{"1min":0.74299999999999999,"5min":0.75800000000000001,"15min":1.637},"last":0.497}]},{"osd":4,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74299999999999999,"15min":0.71899999999999997},"min":{"1min":0.60099999999999998,"5min":0.48899999999999999,"15min":0.45200000000000001},"max":{"1min":0.97399999999999998,"5min":1.21,"15min":1.21},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73799999999999999,"15min":0.71799999999999997},"min":{"1min":0.52500000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90900000000000003,"5min":1.056,"15min":1.698},"last":0.74199999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:46:50 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.79900000000000004,"15min":0.76800000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0669999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76900000000000002,"15min":0.77500000000000002},"min":{"1min":0.58899999999999997,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0189999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.94299999999999995}]},{"osd":6,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.753},"min":{"1min":0.61799999999999999,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.88600000000000001,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.76800000000000002,"15min":0.73599999999999999},"min":{"1min":0.51300000000000001,"5min":0.496,"15min":0.48999999999999999},"max":{"1min":1.135,"5min":1.236,"15min":1.236},"last":0.77100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:46:48 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.748,"15min":0.752},"min":{"1min":0.54000000000000004,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94699999999999995,"5min":1.165,"15min":2.3399999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.746,"5min":0.77400000000000002,"15min":0.72799999999999998},"min":{"1min":0.56899999999999995,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89900000000000002,"5min":1.135,"15min":1.1830000000000001},"last":0.80600000000000005}]}]}],"pool_statfs":[]}} 2024-09-13T18:47:41.203 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-09-13T18:47:41.204 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-13T18:47:41.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.396+0000 7f5521400640 1 Processor -- start 2024-09-13T18:47:41.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.396+0000 7f5521400640 1 -- start start 2024-09-13T18:47:41.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.397+0000 7f5521400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.397+0000 7f5521400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f551c0adf50 0x7f551c160f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.397+0000 7f5521400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c0b2b40 con 0x7f551c160ac0 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.397+0000 7f5521400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0b21e0 con 0x7f551c0adf50 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.397+0000 7f5521400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0b1bf0 con 0x7f551c15a910 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551b200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f551c0adf50 0x7f551c160f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f5519e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f551c160ac0 0x7f551c0ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59370/0 (socket says 172.21.15.192:59370) 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f5519e00640 1 -- 172.21.15.192:0/1283902049 learned_addr learned my addr 172.21.15.192:0/1283902049 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:41.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551a800640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f5519400640 1 -- 172.21.15.192:0/1283902049 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568904834 0 0) 0x7f551c0b2b40 con 0x7f551c160ac0 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f5519400640 1 -- 172.21.15.192:0/1283902049 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5500003520 con 0x7f551c160ac0 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551b200640 1 -- 172.21.15.192:0/1283902049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 msgr2=0x7f551c0b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551b200640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c0b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.403 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551b200640 1 -- 172.21.15.192:0/1283902049 >> v1:172.21.15.192:6789/0 conn(0x7f551c160ac0 legacy=0x7f551c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.398+0000 7f551b200640 1 -- 172.21.15.192:0/1283902049 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c161510 con 0x7f551c0adf50 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.399+0000 7f551b200640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c160f00 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5514009d90 tx=0x7f551402a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6af3a65199736 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5519400640 1 -- 172.21.15.192:0/1283902049 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514031600 con 0x7f551c0adf50 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5519400640 1 -- 172.21.15.192:0/1283902049 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551402d050 con 0x7f551c0adf50 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5519400640 1 -- 172.21.15.192:0/1283902049 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5514031960 con 0x7f551c0adf50 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 -- 172.21.15.192:0/1283902049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 msgr2=0x7f551c160f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c160f00 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f5514009d90 tx=0x7f551402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 -- 172.21.15.192:0/1283902049 shutdown_connections 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c160f00 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 --2- 172.21.15.192:0/1283902049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c0b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.404 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 -- 172.21.15.192:0/1283902049 >> 172.21.15.192:0/1283902049 conn(0x7f551c0b08f0 msgr2=0x7f551c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 -- 172.21.15.192:0/1283902049 shutdown_connections 2024-09-13T18:47:41.405 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.400+0000 7f5521400640 1 -- 172.21.15.192:0/1283902049 wait complete. 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.402+0000 7f5521400640 1 Processor -- start 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.402+0000 7f5521400640 1 -- start start 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f551c160ac0 0x7f551c15c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c156ff0 con 0x7f551c0adf50 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1f5ed0 con 0x7f551c160ac0 2024-09-13T18:47:41.407 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5521400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c1f6170 con 0x7f551c15a910 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45838/0 (socket says 172.21.15.192:45838) 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 -- 172.21.15.192:0/289249679 learned_addr learned my addr 172.21.15.192:0/289249679 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f5519e00640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551b200640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f551c160ac0 0x7f551c15c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 -- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 msgr2=0x7f551c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 -- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f551c160ac0 msgr2=0x7f551c15c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f551c160ac0 0x7f551c15c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.403+0000 7f551a800640 1 -- 172.21.15.192:0/289249679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5514009a70 con 0x7f551c0adf50 2024-09-13T18:47:41.408 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f551a800640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f550c00e9b0 tx=0x7f550c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c009670 con 0x7f551c0adf50 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f550c00c9a0 con 0x7f551c0adf50 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f550c00cd50 con 0x7f551c0adf50 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c1f6450 con 0x7f551c0adf50 2024-09-13T18:47:41.409 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.404+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c1f6a10 con 0x7f551c0adf50 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.405+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c0ae6e0 con 0x7f551c0adf50 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.406+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f550c013470 con 0x7f551c0adf50 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.407+0000 7f5512a00640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 0x7f54fc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.407+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f550c0895b0 con 0x7f551c0adf50 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.407+0000 7f5519e00640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 0x7f54fc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.410 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.408+0000 7f5519e00640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 0x7f54fc06d0c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f551c157260 tx=0x7f5508009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.413 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.411+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f550c054780 con 0x7f551c0adf50 2024-09-13T18:47:41.645 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.642+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f551c06c970 con 0x7f551c0adf50 2024-09-13T18:47:41.649 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.647+0000 7f5512a00640 1 -- 172.21.15.192:0/289249679 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f550c087e60 con 0x7f551c0adf50 2024-09-13T18:47:41.650 INFO:teuthology.orchestra.run.smithi192.stderr:updated caps for client.0 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 msgr2=0x7f54fc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 0x7f54fc06d0c0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f551c157260 tx=0x7f5508009040 comp rx=0 tx=0).stop 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 msgr2=0x7f551c1f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f550c00e9b0 tx=0x7f550c00ee70 comp rx=0 tx=0).stop 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 shutdown_connections 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f54fc06ac00 0x7f54fc06d0c0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f551c160ac0 0x7f551c15c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f551c15a910 0x7f551c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 --2- 172.21.15.192:0/289249679 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f551c0adf50 0x7f551c1f3080 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 >> 172.21.15.192:0/289249679 conn(0x7f551c0b08f0 msgr2=0x7f551c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 shutdown_connections 2024-09-13T18:47:41.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.649+0000 7f5521400640 1 -- 172.21.15.192:0/289249679 wait complete. 2024-09-13T18:47:41.667 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:41.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.818+0000 7f2903c00640 1 Processor -- start 2024-09-13T18:47:41.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.818+0000 7f2903c00640 1 -- start start 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f2903c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28fc150480 0x7f28fc15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f2903c00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f28fc0cc530 0x7f28fc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f2903c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28fc0ccec0 con 0x7f28fc071810 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f2903c00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28fc071dd0 con 0x7f28fc0cc530 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f2903c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0cb770 con 0x7f28fc150480 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.819+0000 7f28fbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f28fc071810 0x7f28fc0b1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59378/0 (socket says 172.21.15.192:59378) 2024-09-13T18:47:41.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fbe00640 1 -- 172.21.15.192:0/3840186636 learned_addr learned my addr 172.21.15.192:0/3840186636 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:41.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f2901200640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28fc150480 0x7f28fc15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f2901c00640 1 --2- 172.21.15.192:0/3840186636 >> v2:172.21.15.194:3300/0 conn(0x7f28fc0cc530 0x7f28fc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1045074985 0 0) 0x7f28fc0ccec0 con 0x7f28fc071810 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28e4003520 con 0x7f28fc071810 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2391143867 0 0) 0x7f28e4003520 con 0x7f28fc071810 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28fc150480 msgr2=0x7f28fc15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28fc150480 0x7f28fc15a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 >> v2:172.21.15.194:3300/0 conn(0x7f28fc0cc530 msgr2=0x7f28fc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 --2- 172.21.15.192:0/3840186636 >> v2:172.21.15.194:3300/0 conn(0x7f28fc0cc530 0x7f28fc0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc0cba50 con 0x7f28fc071810 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f28e8001670 con 0x7f28fc071810 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.820+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 >> v1:172.21.15.192:6789/0 conn(0x7f28fc071810 legacy=0x7f28fc0b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28e4003970 0x7f28e4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.825 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e4005180 0x7f28e400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc071dd0 con 0x7f28e4005180 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc0cb770 con 0x7f28e4003970 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e400bec0 con 0x7f28e40047c0 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f2901200640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28fc150480 0x7f28fc15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f2901c00640 1 --2- 172.21.15.192:0/3840186636 >> v2:172.21.15.194:3300/0 conn(0x7f28fc0cc530 0x7f28fc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f2901c00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e4005180 0x7f28e400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f2901200640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28e4003970 0x7f28e4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 -- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28e4003970 msgr2=0x7f28e4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28e4003970 0x7f28e4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 -- 172.21.15.192:0/3840186636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e4005180 msgr2=0x7f28e400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e4005180 0x7f28e400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f28fbe00640 1 -- 172.21.15.192:0/3840186636 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e4003520 con 0x7f28e40047c0 2024-09-13T18:47:41.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.821+0000 7f2901c00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28e4005180 0x7f28e400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.822+0000 7f28fbe00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28e4004c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c210 tx=0x7f28e40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70f1ac2350f3a8dc server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8005ad0 con 0x7f28e40047c0 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e8005c30 con 0x7f28e40047c0 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f28fb400640 1 -- 172.21.15.192:0/3840186636 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e8007070 con 0x7f28e40047c0 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 -- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 msgr2=0x7f28e4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 --2- 172.21.15.192:0/3840186636 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28e4004c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f28e800c210 tx=0x7f28e40057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2901c00640 1 -- 172.21.15.192:0/3840186636 reap_dead start 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 -- 172.21.15.192:0/3840186636 shutdown_connections 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 -- 172.21.15.192:0/3840186636 >> 172.21.15.192:0/3840186636 conn(0x7f28fc0ae960 msgr2=0x7f28fc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:41.828 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 -- 172.21.15.192:0/3840186636 shutdown_connections 2024-09-13T18:47:41.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.823+0000 7f2903c00640 1 -- 172.21.15.192:0/3840186636 wait complete. 2024-09-13T18:47:41.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.825+0000 7f2903c00640 1 Processor -- start 2024-09-13T18:47:41.829 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.825+0000 7f2903c00640 1 -- start start 2024-09-13T18:47:41.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28fc14f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 0x7f28fc152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc14f7b0 con 0x7f28fc152a90 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1e3b00 con 0x7f28fc1e61e0 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2903c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28fc1e2ef0 con 0x7f28e40047c0 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2901c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2901c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45858/0 (socket says 172.21.15.192:45858) 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2901c00640 1 -- 172.21.15.192:0/2827327409 learned_addr learned my addr 172.21.15.192:0/2827327409 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f2901200640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28fc14f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.826+0000 7f28fbe00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 0x7f28fc152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 -- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 msgr2=0x7f28fc14f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28fc14f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 -- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 msgr2=0x7f28fc152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 0x7f28fc152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:41.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 -- 172.21.15.192:0/2827327409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28fc1e31d0 con 0x7f28fc152a90 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f28fbe00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 0x7f28fc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2901c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0b43b0 tx=0x7f28f400f870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400e040 con 0x7f28fc152a90 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400f040 con 0x7f28fc152a90 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f4003db0 con 0x7f28fc152a90 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc1e34b0 con 0x7f28fc152a90 2024-09-13T18:47:41.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.827+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28fc153160 con 0x7f28fc152a90 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.828+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28fc1e3c40 con 0x7f28fc152a90 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.829+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f28f4004030 con 0x7f28fc152a90 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.830+0000 7f28f8c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 0x7f28dc06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.830+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f28f4089e50 con 0x7f28fc152a90 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.830+0000 7f2901200640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 0x7f28dc06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:41.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.831+0000 7f2901200640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 0x7f28dc06d0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0b07c0 tx=0x7f28f000a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:41.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:41.834+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f28f40bd9c0 con 0x7f28fc152a90 2024-09-13T18:47:42.040 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.038+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28fc0cda70 con 0x7f28fc152a90 2024-09-13T18:47:42.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.038+0000 7f28f8c00640 1 -- 172.21.15.192:0/2827327409 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7f28f40550d0 con 0x7f28fc152a90 2024-09-13T18:47:42.041 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:42.041 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:47:42.042 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.040+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 msgr2=0x7f28dc06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.040+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 0x7f28dc06d0c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0b07c0 tx=0x7f28f000a2a0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.040+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 msgr2=0x7f28fc070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.040+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f28fc0b43b0 tx=0x7f28f400f870 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 shutdown_connections 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f28dc06ac00 0x7f28dc06d0c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f28fc152a90 0x7f28fc070450 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f28fc1e61e0 0x7f28fc152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 --2- 172.21.15.192:0/2827327409 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f28e40047c0 0x7f28fc14f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 >> 172.21.15.192:0/2827327409 conn(0x7f28fc0ae960 msgr2=0x7f28fc0ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 shutdown_connections 2024-09-13T18:47:42.045 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.041+0000 7f2903c00640 1 -- 172.21.15.192:0/2827327409 wait complete. 2024-09-13T18:47:42.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 85, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-13T18:47:36.646150+0000', 'modified': '2024-09-13T18:47:39.655357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9003}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9003': {'gid': 9003, 'name': 'b', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.194:6834/1492074018', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.194:6833', 'nonce': 1492074018}, {'type': 'v1', 'addr': '172.21.15.194:6834', 'nonce': 1492074018}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-09-13T18:47:42.462 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-13T18:47:42.462 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-13T18:47:42.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.613+0000 7fabede00640 1 Processor -- start 2024-09-13T18:47:42.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.613+0000 7fabede00640 1 -- start start 2024-09-13T18:47:42.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.614+0000 7fabede00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fabe8146610 0x7fabe80ce2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabede00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80adf50 con 0x7fabe80afd80 2024-09-13T18:47:42.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabede00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabe80ae770 con 0x7fabe80b2780 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabede00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabe80cd920 con 0x7fabe8146610 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fabe8146610 0x7fabe80ce2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe7400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fabe80afd80 0x7fabe80b3050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:59380/0 (socket says 172.21.15.192:59380) 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe7400640 1 -- 172.21.15.192:0/1389056420 learned_addr learned my addr 172.21.15.192:0/1389056420 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe6a00640 1 -- 172.21.15.192:0/1389056420 >> v1:172.21.15.194:6789/0 conn(0x7fabe80b2780 legacy=0x7fabe80ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe6a00640 1 -- 172.21.15.192:0/1389056420 >> v1:172.21.15.192:6789/0 conn(0x7fabe80afd80 legacy=0x7fabe80b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe6a00640 1 -- 172.21.15.192:0/1389056420 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe80cdb30 con 0x7fabe8146610 2024-09-13T18:47:42.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.615+0000 7fabe6000640 1 -- 172.21.15.192:0/1389056420 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828641534 0 0) 0x7fabe80adf50 con 0x7fabe80afd80 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.616+0000 7fabe6a00640 1 --2- 172.21.15.192:0/1389056420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe8146610 0x7fabe80ce2f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cda60 tx=0x7fabd802a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51cd0dcf9382d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.616+0000 7fabe6000640 1 -- 172.21.15.192:0/1389056420 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8032440 con 0x7fabe8146610 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabe6000640 1 -- 172.21.15.192:0/1389056420 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd80325a0 con 0x7fabe8146610 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabe6000640 1 -- 172.21.15.192:0/1389056420 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8032930 con 0x7fabe8146610 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 -- 172.21.15.192:0/1389056420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe8146610 msgr2=0x7fabe80ce2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 --2- 172.21.15.192:0/1389056420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe8146610 0x7fabe80ce2f0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fabe80cda60 tx=0x7fabd802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 -- 172.21.15.192:0/1389056420 shutdown_connections 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 --2- 172.21.15.192:0/1389056420 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe8146610 0x7fabe80ce2f0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 -- 172.21.15.192:0/1389056420 >> 172.21.15.192:0/1389056420 conn(0x7fabe80ae960 msgr2=0x7fabe806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 -- 172.21.15.192:0/1389056420 shutdown_connections 2024-09-13T18:47:42.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.617+0000 7fabede00640 1 -- 172.21.15.192:0/1389056420 wait complete. 2024-09-13T18:47:42.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.619+0000 7fabede00640 1 Processor -- start 2024-09-13T18:47:42.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.619+0000 7fabede00640 1 -- start start 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe80afd80 0x7fabe815a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe8146610 0x7fabe8144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe806fc60 con 0x7fabe80b2780 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabe815a910 con 0x7fabe80afd80 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabede00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabe8141a50 con 0x7fabe8146610 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45880/0 (socket says 172.21.15.192:45880) 2024-09-13T18:47:42.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 -- 172.21.15.192:0/2154254205 learned_addr learned my addr 172.21.15.192:0/2154254205 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe80afd80 0x7fabe815a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabe7400640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe8146610 0x7fabe8144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 -- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe8146610 msgr2=0x7fabe8144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe8146610 0x7fabe8144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 -- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe80afd80 msgr2=0x7fabe815a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe80afd80 0x7fabe815a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.620+0000 7fabde000640 1 -- 172.21.15.192:0/2154254205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8009400 con 0x7fabe80b2780 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabde000640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c430 tx=0x7fabd000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabdfe00640 1 -- 172.21.15.192:0/2154254205 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00052d0 con 0x7fabe80b2780 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabe806f890 con 0x7fabe80b2780 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabdfe00640 1 -- 172.21.15.192:0/2154254205 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0005430 con 0x7fabe80b2780 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabdfe00640 1 -- 172.21.15.192:0/2154254205 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0003830 con 0x7fabe80b2780 2024-09-13T18:47:42.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.621+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe8070190 con 0x7fabe80b2780 2024-09-13T18:47:42.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.623+0000 7fabdfe00640 1 -- 172.21.15.192:0/2154254205 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fabd0003990 con 0x7fabe80b2780 2024-09-13T18:47:42.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.624+0000 7fabdfe00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.624+0000 7fabdfe00640 1 -- 172.21.15.192:0/2154254205 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd0088940 con 0x7fabe80b2780 2024-09-13T18:47:42.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.624+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.624+0000 7fabf0c13740 1 Processor -- start 2024-09-13T18:47:42.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.625+0000 7fabf0c13740 1 -- start start 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.625+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 0x7fabc406d0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabd8034000 tx=0x7fabd802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.625+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.625+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440ccf7e90 0x56440cd47ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.625+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd480e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabf0c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cc63ab0 con 0x56440cd21b80 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cc61240 con 0x56440ccf7e90 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56440cc5cb30 con 0x56440ccfa6d0 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd480e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:44800/0 (socket says 172.21.15.192:44800) 2024-09-13T18:47:42.631 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 -- 172.21.15.192:0/2966187305 learned_addr learned my addr 172.21.15.192:0/2966187305 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabde000640 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440ccf7e90 0x56440cd47ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 -- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440ccf7e90 msgr2=0x56440cd47ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440ccf7e90 0x56440cd47ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 -- 172.21.15.192:0/2966187305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 msgr2=0x56440cd480e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd480e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe6a00640 1 -- 172.21.15.192:0/2966187305 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56440cc27bd0 con 0x56440ccfa6d0 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.626+0000 7fabe7400640 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabd802a7b0 tx=0x7fabd802c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8c9cb538d633af6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabd7e00640 1 -- 172.21.15.192:0/2966187305 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd803c880 con 0x56440ccfa6d0 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabd7e00640 1 -- 172.21.15.192:0/2966187305 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd803c9e0 con 0x56440ccfa6d0 2024-09-13T18:47:42.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabd7e00640 1 -- 172.21.15.192:0/2966187305 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd803cd50 con 0x56440ccfa6d0 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabf0c13740 1 -- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 msgr2=0x56440ccfaab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.627+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fabd802a7b0 tx=0x7fabd802c000 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 -- 172.21.15.192:0/2966187305 shutdown_connections 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd480e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440ccf7e90 0x56440cd47ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2966187305 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440ccfaab0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 -- 172.21.15.192:0/2966187305 >> 172.21.15.192:0/2966187305 conn(0x56440ccf6e00 msgr2=0x56440cd3f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 -- 172.21.15.192:0/2966187305 shutdown_connections 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 -- 172.21.15.192:0/2966187305 wait complete. 2024-09-13T18:47:42.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 -- start start 2024-09-13T18:47:42.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.628+0000 7fabf0c13740 1 Processor -- start 2024-09-13T18:47:42.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440cd21b80 0x56440cd25660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd450b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cbfe260 con 0x56440ccfa6d0 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cbfdf00 con 0x56440cd44c30 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56440c9c3f20 con 0x56440cd21b80 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.629+0000 7fabf0c13740 10 client.0 _ll_register_callbacks cb 0x56440cc561a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45894/0 (socket says 172.21.15.192:45894) 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 -- 172.21.15.192:0/2730434803 learned_addr learned my addr 172.21.15.192:0/2730434803 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabde000640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440cd21b80 0x56440cd25660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe7400640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 -- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440cd21b80 msgr2=0x56440cd25660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440cd21b80 0x56440cd25660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 -- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 msgr2=0x56440cd450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd450b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 -- 172.21.15.192:0/2730434803 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe80cdb30 con 0x56440ccfa6d0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabe6a00640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x56440cd42770 tx=0x7fabd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd38ef1cf4d45861 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.630+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd8004240 con 0x56440ccfa6d0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd80043a0 con 0x56440ccfa6d0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56440cc86cd0 con 0x56440ccfa6d0 2024-09-13T18:47:42.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabd80519b0 con 0x56440ccfa6d0 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 10 client.9141 fetch_fsmap learned FSMap version 85 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x56440cc5b1b0 con 0x56440ccfa6d0 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56440cc86cd0 con 0x56440ccfa6d0 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 85) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fabd8044070 con 0x56440ccfa6d0 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 10 client.9141 fetch_fsmap finished waiting for FSMap version 85 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 10 client.9141 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 20 client.9141 populate_metadata read hostname 'smithi192' 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd5a1f0 0x56440cd5c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 4 client.9141 mds_command: new command op to 9003 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.631+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 --> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56440c9503c0 con 0x56440cd5a1f0 2024-09-13T18:47:42.640 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.632+0000 7fabde000640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd5a1f0 0x56440cd5c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.632+0000 7fabde000640 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd5a1f0 0x56440cd5c5e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f4a76df665c85eb server_cookie=8222281e98698558 in_seq=0 out_seq=0 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.632+0000 7fabd4c00640 10 client.9141 ms_handle_connect on v2:172.21.15.194:6833/1492074018 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabd4c00640 1 -- 172.21.15.192:0/2730434803 <== mds.0 v2:172.21.15.194:6833/1492074018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19071 (crc 0 0 0) 0x56440c9503c0 con 0x56440cd5a1f0 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabd4c00640 10 client.9141 handle_command_reply: tid=0 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 client.9141 shutdown 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 msgr2=0x56440cd47120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x56440cd42770 tx=0x7fabd8004730 comp rx=0 tx=0).stop 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 shutdown_connections 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd5a1f0 0x56440cd5c5e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440cd21b80 0x56440cd25660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 --2- 172.21.15.192:0/2730434803 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440ccfa6d0 0x56440cd47120 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabd4c00640 0 client.9141 ms_handle_reset on v2:172.21.15.194:6833/1492074018 2024-09-13T18:47:42.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 >> 172.21.15.192:0/2730434803 conn(0x56440ccf7e90 msgr2=0x56440cd3e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 shutdown_connections 2024-09-13T18:47:42.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.633+0000 7fabf0c13740 1 -- 172.21.15.192:0/2730434803 wait complete. 2024-09-13T18:47:42.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.634+0000 7fabf0c13740 20 client.9141 trim_cache size 0 max 16384 2024-09-13T18:47:42.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.649+0000 7fabf0c13740 1 Processor -- start 2024-09-13T18:47:42.651 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.649+0000 7fabf0c13740 1 -- start start 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cd3caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd417e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cd58dd0 con 0x56440cd21b80 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cd263c0 con 0x56440cd44c30 2024-09-13T18:47:42.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56440ccf0e50 con 0x56440ccfa6d0 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45896/0 (socket says 172.21.15.192:45896) 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 -- 172.21.15.192:0/1116079787 learned_addr learned my addr 172.21.15.192:0/1116079787 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 -- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 msgr2=0x56440cd3caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cd3caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 -- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 msgr2=0x56440cd417e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd417e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.650+0000 7fabde000640 1 -- 172.21.15.192:0/1116079787 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56440cbfd470 con 0x56440cd21b80 2024-09-13T18:47:42.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabde000640 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fabd00577a0 tx=0x7fabd0086d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8946f9950079ffd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabdcc00640 1 -- 172.21.15.192:0/1116079787 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0055bb0 con 0x56440cd21b80 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabdcc00640 1 -- 172.21.15.192:0/1116079787 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd0053f20 con 0x56440cd21b80 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabdcc00640 1 -- 172.21.15.192:0/1116079787 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd00762b0 con 0x56440cd21b80 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 -- 172.21.15.192:0/1116079787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 msgr2=0x56440cd412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7fabd00577a0 tx=0x7fabd0086d40 comp rx=0 tx=0).stop 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 -- 172.21.15.192:0/1116079787 shutdown_connections 2024-09-13T18:47:42.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd417e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd412a0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1116079787 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cd3caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 -- 172.21.15.192:0/1116079787 >> 172.21.15.192:0/1116079787 conn(0x56440ccf7e90 msgr2=0x56440ccf0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 -- 172.21.15.192:0/1116079787 shutdown_connections 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.651+0000 7fabf0c13740 1 -- 172.21.15.192:0/1116079787 wait complete. 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.652+0000 7fabf0c13740 1 -- start start 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.652+0000 7fabf0c13740 1 Processor -- start 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cda9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd3d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cd57b10 con 0x56440cd21b80 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x56440cda9c00 con 0x56440cd44c30 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x56440cd5e480 con 0x56440ccfa6d0 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabf0c13740 10 client.0 _ll_register_callbacks cb 0x7fabe0004be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabde000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45906/0 (socket says 172.21.15.192:45906) 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabde000640 1 -- 172.21.15.192:0/1015812490 learned_addr learned my addr 172.21.15.192:0/1015812490 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabe6a00640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cda9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.653+0000 7fabe7400640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd3d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 -- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 msgr2=0x56440cda9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cda9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 -- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 msgr2=0x56440cd3d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd3d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 -- 172.21.15.192:0/1015812490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabe8070190 con 0x56440cd21b80 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabe7400640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd3d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabe6a00640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cda9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabde000640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fabd00577a0 tx=0x7fabd0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72edeb90f85557f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabd4c00640 10 client.0 ms_handle_connect on v2:172.21.15.192:3300/0 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabd0054090 con 0x56440cd21b80 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mon.0 v2:172.21.15.192:3300/0 2 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabd005b140 con 0x56440cd21b80 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fabd803c9e0 con 0x56440cd21b80 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fabd005b300 con 0x56440cd21b80 2024-09-13T18:47:42.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabf0c13740 10 client.9147 fetch_fsmap learned FSMap version 85 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.654+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=2+}) v3 -- 0x56440cc22980 con 0x56440cd21b80 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mon.0 v2:172.21.15.192:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabd007a080 con 0x56440cd21b80 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mon.0 v2:172.21.15.192:3300/0 5 ==== fsmap(e 85) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fabd005f6c0 con 0x56440cd21b80 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 10 client.9147 fetch_fsmap finished waiting for FSMap version 85 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 10 client.9147 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 20 client.9147 populate_metadata read hostname 'smithi192' 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd9f820 0x56440cd9fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 4 client.9147 mds_command: new command op to 9003 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 --> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56440c9616c0 con 0x56440cd9f820 2024-09-13T18:47:42.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.655+0000 7fabe6a00640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd9f820 0x56440cd9fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabe6a00640 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd9f820 0x56440cd9fc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e00352107410807 server_cookie=3bdf60391ccffdd6 in_seq=0 out_seq=0 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabd4c00640 10 client.9147 ms_handle_connect on v2:172.21.15.194:6833/1492074018 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabd4c00640 1 -- 172.21.15.192:0/1015812490 <== mds.0 v2:172.21.15.194:6833/1492074018 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x56440c9616c0 con 0x56440cd9f820 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabd4c00640 10 client.9147 handle_command_reply: tid=0 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 client.9147 shutdown 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 msgr2=0x56440cd440e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7fabd00577a0 tx=0x7fabd0005040 comp rx=0 tx=0).stop 2024-09-13T18:47:42.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 shutdown_connections 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:6833/1492074018,v1:172.21.15.194:6834/1492074018] conn(0x56440cd9f820 0x56440cd9fc00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x56440cd44c30 0x56440cd3d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x56440cd21b80 0x56440cd440e0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 --2- 172.21.15.192:0/1015812490 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x56440ccfa6d0 0x56440cda9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabd4c00640 0 client.9147 ms_handle_reset on v2:172.21.15.194:6833/1492074018 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 >> 172.21.15.192:0/1015812490 conn(0x56440ccf7e90 msgr2=0x56440cd41200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 shutdown_connections 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 1 -- 172.21.15.192:0/1015812490 wait complete. 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.656+0000 7fabf0c13740 20 client.9147 trim_cache size 0 max 16384 2024-09-13T18:47:42.665 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "whoami": 0, 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 9003, 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "want_state": "up:active", 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "state": "up:active", 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs", 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "rank_uptime": 6.0066926240000003, 2024-09-13T18:47:42.666 INFO:teuthology.orchestra.run.smithi192.stdout: "mdsmap_epoch": 85, 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch": 197, 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi192.stdout: "osdmap_epoch_barrier": 197, 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi192.stdout: "uptime": 11.140155977999999 2024-09-13T18:47:42.667 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 msgr2=0x7fabc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 0x7fabc406d0c0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fabd8034000 tx=0x7fabd802e000 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 msgr2=0x7fabe8141510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fabd000c430 tx=0x7fabd000c8f0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 shutdown_connections 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fabc406ac00 0x7fabc406d0c0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fabe8146610 0x7fabe8144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fabe80b2780 0x7fabe8141510 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 --2- 172.21.15.192:0/2154254205 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fabe80afd80 0x7fabe815a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 >> 172.21.15.192:0/2154254205 conn(0x7fabe80ae960 msgr2=0x7fabe8161020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 shutdown_connections 2024-09-13T18:47:42.669 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.657+0000 7fabede00640 1 -- 172.21.15.192:0/2154254205 wait complete. 2024-09-13T18:47:42.674 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.824+0000 7f8f2ec00640 1 Processor -- start 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.824+0000 7f8f2ec00640 1 -- start start 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f2ec00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f280cacd0 0x7f8f2815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f2ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f2815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f2ec00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f28140480 con 0x7f8f28140980 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f2ec00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2815c160 con 0x7f8f280cacd0 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f2ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2815ee90 con 0x7f8f280cb0b0 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f27e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f280cacd0 0x7f8f2815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.831 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f27e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f8f280cacd0 0x7f8f2815e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45910/0 (socket says 172.21.15.192:45910) 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.825+0000 7f8f27e00640 1 -- 172.21.15.192:0/2630108583 learned_addr learned my addr 172.21.15.192:0/2630108583 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.826+0000 7f8f1f400640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f2815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.826+0000 7f8f27e00640 1 -- 172.21.15.192:0/2630108583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 msgr2=0x7f8f2815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.826+0000 7f8f27e00640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f2815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.826+0000 7f8f27e00640 1 -- 172.21.15.192:0/2630108583 >> v1:172.21.15.194:6789/0 conn(0x7f8f28140980 legacy=0x7f8f280afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.826+0000 7f8f27e00640 1 -- 172.21.15.192:0/2630108583 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2815f170 con 0x7f8f280cacd0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.827+0000 7f8f27e00640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f2815e790 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e50 tx=0x7f8f1802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54eeca02bea0399 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.827+0000 7f8f27400640 1 -- 172.21.15.192:0/2630108583 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18031600 con 0x7f8f280cacd0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.827+0000 7f8f27400640 1 -- 172.21.15.192:0/2630108583 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1802d050 con 0x7f8f280cacd0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.827+0000 7f8f27400640 1 -- 172.21.15.192:0/2630108583 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f18031980 con 0x7f8f280cacd0 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 -- 172.21.15.192:0/2630108583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 msgr2=0x7f8f2815e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f2815e790 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f8f18009e50 tx=0x7f8f1802a730 comp rx=0 tx=0).stop 2024-09-13T18:47:42.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 -- 172.21.15.192:0/2630108583 shutdown_connections 2024-09-13T18:47:42.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f2815bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/2630108583 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f2815e790 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 -- 172.21.15.192:0/2630108583 >> 172.21.15.192:0/2630108583 conn(0x7f8f280ae960 msgr2=0x7f8f2806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:42.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 -- 172.21.15.192:0/2630108583 shutdown_connections 2024-09-13T18:47:42.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.828+0000 7f8f2ec00640 1 -- 172.21.15.192:0/2630108583 wait complete. 2024-09-13T18:47:42.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.829+0000 7f8f2ec00640 1 Processor -- start 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.830+0000 7f8f2ec00640 1 -- start start 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.830+0000 7f8f2ec00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2ec00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f280ccd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2ec00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f28140980 0x7f8f280cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2ec00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280cc8f0 con 0x7f8f280cacd0 2024-09-13T18:47:42.836 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2ec00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280cbc70 con 0x7f8f28140980 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2ec00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f280cbf50 con 0x7f8f280cb0b0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45914/0 (socket says 172.21.15.192:45914) 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 -- 172.21.15.192:0/3623154487 learned_addr learned my addr 172.21.15.192:0/3623154487 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f1f400640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f280ccd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f2cc00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f28140980 0x7f8f280cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 -- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 msgr2=0x7f8f280ccd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f280ccd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 -- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f28140980 msgr2=0x7f8f280cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f28140980 0x7f8f280cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 -- 172.21.15.192:0/3623154487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f18009b30 con 0x7f8f280cacd0 2024-09-13T18:47:42.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.831+0000 7f8f27e00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f8f18034040 tx=0x7f8f18004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.832+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1803d860 con 0x7f8f280cacd0 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.832+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1803d9c0 con 0x7f8f280cacd0 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.832+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1803dd70 con 0x7f8f280cacd0 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.832+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f280cc230 con 0x7f8f280cacd0 2024-09-13T18:47:42.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.832+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f280adff0 con 0x7f8f280cacd0 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.833+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f280cca30 con 0x7f8f280cacd0 2024-09-13T18:47:42.839 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.834+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8f1803b400 con 0x7f8f280cacd0 2024-09-13T18:47:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.835+0000 7f8f24c00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 0x7f8f0406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.835+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f180aa270 con 0x7f8f280cacd0 2024-09-13T18:47:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.835+0000 7f8f1f400640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 0x7f8f0406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:42.840 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.836+0000 7f8f1f400640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 0x7f8f0406d0c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8f2815acf0 tx=0x7f8f10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:42.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:42.839+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f8f280cca30 con 0x7f8f280cacd0 2024-09-13T18:47:43.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.040+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8f280cca30 con 0x7f8f280cacd0 2024-09-13T18:47:43.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.040+0000 7f8f24c00640 1 -- 172.21.15.192:0/3623154487 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8f280cca30 con 0x7f8f280cacd0 2024-09-13T18:47:43.043 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.042+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 msgr2=0x7f8f0406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.042+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 0x7f8f0406d0c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f8f2815acf0 tx=0x7f8f10008040 comp rx=0 tx=0).stop 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.042+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 msgr2=0x7f8f280adab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.042+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f8f18034040 tx=0x7f8f18004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 shutdown_connections 2024-09-13T18:47:43.046 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f8f0406ac00 0x7f8f0406d0c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8f28140980 0x7f8f280cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8f280cb0b0 0x7f8f280ccd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 --2- 172.21.15.192:0/3623154487 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f280cacd0 0x7f8f280adab0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 >> 172.21.15.192:0/3623154487 conn(0x7f8f280ae960 msgr2=0x7f8f281581a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 shutdown_connections 2024-09-13T18:47:43.047 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:43.043+0000 7f8f2ec00640 1 -- 172.21.15.192:0/3623154487 wait complete. 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:43.062 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:47:43.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.063 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:43.099 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42046sec preferred_lft 42046sec 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-13T18:47:43.100 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::7c50:27ff:fe32:c047/64 scope link 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether ce:e2:26:2d:a4:7d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::cce2:26ff:fe2d:a47d/64 scope link 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 9a:01:02:06:bb:5d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:47:43.101 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::9801:2ff:fe06:bb5d/64 scope link 2024-09-13T18:47:43.102 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:43.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.102 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:43.194 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-13T18:47:43.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.197 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-13T18:47:43.233 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-13T18:47:43.233 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:43.233 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:43.233 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:47:43.233 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:43.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.234 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec bash -c ' 2024-09-13T18:47:43.234 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-13T18:47:43.234 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:43.235 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:43.235 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:43.235 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-13T18:47:43.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.380 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:47:43.415 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:47:43.415 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:47:43.415 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:47:43.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.416 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-13T18:47:43.511 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:43.511 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:43.546 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T18:47:43.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:43.547 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:43.621 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-09-13T18:47:43.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.622 DEBUG:teuthology.orchestra.run.smithi192:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:43.750 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:43.751 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi192.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: trying mount with new device syntax: 0@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:47:43.777 INFO:teuthology.orchestra.run.smithi192.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:47:43.778 INFO:teuthology.orchestra.run.smithi192.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T18:47:43.778 INFO:teuthology.orchestra.run.smithi192.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:47:43.779 INFO:teuthology.orchestra.run.smithi192.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:47:43.779 INFO:teuthology.orchestra.run.smithi192.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:47:43.779 INFO:teuthology.orchestra.run.smithi192.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:47:43.782 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:47:43.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.782 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T18:47:43.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:43.839 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:43.885 INFO:teuthology.orchestra.run.smithi192.stdout:client7358 2024-09-13T18:47:43.886 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:43.886 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:43.961 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-13T18:47:44.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.149+0000 7f2734400640 1 Processor -- start 2024-09-13T18:47:44.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.149+0000 7f2734400640 1 -- start start 2024-09-13T18:47:44.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.150+0000 7f2734400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15dee0 0x7f272c0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.150+0000 7f2734400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f272c15e2c0 0x7f272c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.150+0000 7f2734400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272c0b2f00 con 0x7f272c0b3f10 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.150+0000 7f2734400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f272c0b3150 con 0x7f272c15e2c0 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.150+0000 7f2734400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c0b3430 con 0x7f272c15dee0 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f272c15e2c0 0x7f272c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f272c15e2c0 0x7f272c15ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45922/0 (socket says 172.21.15.192:45922) 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 -- 172.21.15.192:0/315332041 learned_addr learned my addr 172.21.15.192:0/315332041 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2731a00640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15dee0 0x7f272c0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 -- 172.21.15.192:0/315332041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15dee0 msgr2=0x7f272c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15dee0 0x7f272c0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 -- 172.21.15.192:0/315332041 >> v1:172.21.15.194:6789/0 conn(0x7f272c0b3f10 legacy=0x7f272c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.151+0000 7f2732400640 1 -- 172.21.15.192:0/315332041 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c0b3710 con 0x7f272c15e2c0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.152+0000 7f2732400640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c15e2c0 0x7f272c15ab50 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e50 tx=0x7f272402c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed452606f898f72 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.152+0000 7f272be00640 1 -- 172.21.15.192:0/315332041 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724032430 con 0x7f272c15e2c0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.152+0000 7f272be00640 1 -- 172.21.15.192:0/315332041 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724032590 con 0x7f272c15e2c0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.152+0000 7f272be00640 1 -- 172.21.15.192:0/315332041 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724032920 con 0x7f272c15e2c0 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 -- 172.21.15.192:0/315332041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c15e2c0 msgr2=0x7f272c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c15e2c0 0x7f272c15ab50 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e50 tx=0x7f272402c940 comp rx=0 tx=0).stop 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 -- 172.21.15.192:0/315332041 shutdown_connections 2024-09-13T18:47:44.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c15e2c0 0x7f272c15ab50 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 --2- 172.21.15.192:0/315332041 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15dee0 0x7f272c0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 -- 172.21.15.192:0/315332041 >> 172.21.15.192:0/315332041 conn(0x7f272c0ae960 msgr2=0x7f272c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 -- 172.21.15.192:0/315332041 shutdown_connections 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.153+0000 7f2734400640 1 -- 172.21.15.192:0/315332041 wait complete. 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.154+0000 7f2734400640 1 Processor -- start 2024-09-13T18:47:44.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 -- start start 2024-09-13T18:47:44.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272c15dee0 0x7f272c1e99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15e2c0 0x7f272c1f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c152290 con 0x7f272c151150 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272c1f3df0 con 0x7f272c15dee0 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.155+0000 7f2734400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272c151710 con 0x7f272c15e2c0 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2731a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272c15dee0 0x7f272c1e99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45932/0 (socket says 172.21.15.192:45932) 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 -- 172.21.15.192:0/3468944681 learned_addr learned my addr 172.21.15.192:0/3468944681 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2731000640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15e2c0 0x7f272c1f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 -- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15e2c0 msgr2=0x7f272c1f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15e2c0 0x7f272c1f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 -- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272c15dee0 msgr2=0x7f272c1e99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272c15dee0 0x7f272c1e99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.156+0000 7f2732400640 1 -- 172.21.15.192:0/3468944681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2724009b30 con 0x7f272c151150 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2732400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e50 tx=0x7f2724004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724032430 con 0x7f272c151150 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272403b840 con 0x7f272c151150 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272403bbf0 con 0x7f272c151150 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272c1519f0 con 0x7f272c151150 2024-09-13T18:47:44.161 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.157+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272c151fb0 con 0x7f272c151150 2024-09-13T18:47:44.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.158+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f272c0afd80 con 0x7f272c151150 2024-09-13T18:47:44.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.159+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f272403bd50 con 0x7f272c151150 2024-09-13T18:47:44.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.160+0000 7f2729600640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 0x7f270c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:44.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.160+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27240aa3c0 con 0x7f272c151150 2024-09-13T18:47:44.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.160+0000 7f2731a00640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 0x7f270c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:44.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.161+0000 7f2731a00640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 0x7f270c06d0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2720009b40 tx=0x7f2720009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:44.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.164+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f27240755b0 con 0x7f272c151150 2024-09-13T18:47:44.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.368+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f272c15aab0 con 0x7f272c151150 2024-09-13T18:47:44.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.368+0000 7f2729600640 1 -- 172.21.15.192:0/3468944681 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v85) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2724009510 con 0x7f272c151150 2024-09-13T18:47:44.371 INFO:teuthology.orchestra.run.smithi192.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 msgr2=0x7f270c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 0x7f270c06d0c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2720009b40 tx=0x7f2720009190 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 msgr2=0x7f272c1529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f2724009e50 tx=0x7f2724004ab0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 shutdown_connections 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270c06ac00 0x7f270c06d0c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272c151150 0x7f272c1529e0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f272c15e2c0 0x7f272c1f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 --2- 172.21.15.192:0/3468944681 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272c15dee0 0x7f272c1e99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:44.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 >> 172.21.15.192:0/3468944681 conn(0x7f272c0ae960 msgr2=0x7f272c06f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:44.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 shutdown_connections 2024-09-13T18:47:44.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:44.371+0000 7f2734400640 1 -- 172.21.15.192:0/3468944681 wait complete. 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi194.front.sepia.ceph.com 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T18:47:44.391 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:47:44.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.392 DEBUG:teuthology.orchestra.run.smithi194:> ip addr 2024-09-13T18:47:44.432 INFO:teuthology.orchestra.run.smithi194.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T18:47:44.432 INFO:teuthology.orchestra.run.smithi194.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 ::1/128 scope host 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:fe brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f0 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:d9:3a:ff brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: altname enp7s0f1 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T18:47:44.433 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a4 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 0c:c4:7a:88:7e:a5 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet 172.21.15.194/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft 42050sec preferred_lft 42050sec 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::ec4:7aff:fe88:7ea5/64 scope link noprefixroute 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::48cd:d1ff:fed1:885/64 scope link 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.434 INFO:teuthology.orchestra.run.smithi194.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 02:69:76:da:a8:06 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::69:76ff:feda:a806/64 scope link 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: link/ether 12:65:9e:ee:bd:24 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: inet6 fe80::1065:9eff:feee:bd24/64 scope link 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run.smithi194.stdout: valid_lft forever preferred_lft forever 2024-09-13T18:47:44.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.435 DEBUG:teuthology.orchestra.run.smithi194:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T18:47:44.530 INFO:teuthology.orchestra.run.smithi194.stdout:1 2024-09-13T18:47:44.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.533 DEBUG:teuthology.orchestra.run.smithi194:> route 2024-09-13T18:47:44.570 INFO:teuthology.orchestra.run.smithi194.stdout:Kernel IP routing table 2024-09-13T18:47:44.570 INFO:teuthology.orchestra.run.smithi194.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T18:47:44.571 INFO:teuthology.orchestra.run.smithi194.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T18:47:44.571 INFO:teuthology.orchestra.run.smithi194.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T18:47:44.571 INFO:teuthology.orchestra.run.smithi194.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T18:47:44.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.571 DEBUG:teuthology.orchestra.run.smithi194:> (cd / && exec bash -c ' 2024-09-13T18:47:44.571 DEBUG:teuthology.orchestra.run.smithi194:> set -e 2024-09-13T18:47:44.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T18:47:44.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T18:47:44.571 DEBUG:teuthology.orchestra.run.smithi194:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T18:47:44.572 DEBUG:teuthology.orchestra.run.smithi194:> ') 2024-09-13T18:47:44.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.720 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:47:44.755 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:47:44.755 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:47:44.755 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:47:44.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.755 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link set brx.0 up 2024-09-13T18:47:44.852 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:44.852 DEBUG:teuthology.orchestra.run.smithi194:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:44.887 INFO:teuthology.orchestra.run.smithi194.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T18:47:44.887 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T18:47:44.887 DEBUG:teuthology.orchestra.run.smithi194:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:44.961 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-09-13T18:47:44.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:44.962 DEBUG:teuthology.orchestra.run.smithi194:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:45.089 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:45.089 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:45.115 INFO:teuthology.orchestra.run.smithi194.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-09-13T18:47:45.115 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-09-13T18:47:45.115 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: resolved to: "172.21.15.192:3300,172.21.15.194:3300,172.21.15.194:3301" 2024-09-13T18:47:45.115 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: trying mount with new device syntax: 1@5e3ff1eb-2fb8-41d1-9304-859f6d9757cb.cephfs=/ 2024-09-13T18:47:45.115 INFO:teuthology.orchestra.run.smithi194.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.192:3300/172.21.15.194:3300/172.21.15.194:3301" will pass to kernel 2024-09-13T18:47:45.116 INFO:teuthology.orchestra.run.smithi194.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T18:47:45.117 INFO:teuthology.orchestra.run.smithi194.stdout: You just mounted a file system that supports labels which does not 2024-09-13T18:47:45.117 INFO:teuthology.orchestra.run.smithi194.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T18:47:45.117 INFO:teuthology.orchestra.run.smithi194.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T18:47:45.117 INFO:teuthology.orchestra.run.smithi194.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T18:47:45.120 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T18:47:45.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:45.120 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T18:47:45.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:45.175 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T18:47:45.212 INFO:teuthology.orchestra.run.smithi194.stdout:client8581 2024-09-13T18:47:45.213 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:47:45.213 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:45.288 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:45.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.442+0000 7fe526800640 1 Processor -- start 2024-09-13T18:47:45.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.442+0000 7fe526800640 1 -- start start 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe52015dee0 0x7fe5200afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 0x7fe52015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200b2f00 con 0x7fe5200b3f10 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5200b3150 con 0x7fe52015dee0 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.443+0000 7fe526800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5200b3430 con 0x7fe52015e2c0 2024-09-13T18:47:45.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 0x7fe52015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45934/0 (socket says 172.21.15.192:45934) 2024-09-13T18:47:45.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51ea00640 1 -- 172.21.15.192:0/4116301649 learned_addr learned my addr 172.21.15.192:0/4116301649 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:45.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51f400640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.194:3300/0 conn(0x7fe52015dee0 0x7fe5200afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 -- 172.21.15.192:0/4116301649 >> v2:172.21.15.194:3300/0 conn(0x7fe52015dee0 msgr2=0x7fe5200afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.194:3300/0 conn(0x7fe52015dee0 0x7fe5200afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 -- 172.21.15.192:0/4116301649 >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 msgr2=0x7fe5200b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51fe00640 1 -- 172.21.15.192:0/4116301649 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200b3710 con 0x7fe52015e2c0 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.444+0000 7fe51ea00640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.445+0000 7fe51fe00640 1 --2- 172.21.15.192:0/4116301649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 0x7fe52015a440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe52006cd20 tx=0x7fe51802a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e5923ac83064834 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe51e000640 1 -- 172.21.15.192:0/4116301649 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518031600 con 0x7fe52015e2c0 2024-09-13T18:47:45.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe51e000640 1 -- 172.21.15.192:0/4116301649 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51802d050 con 0x7fe52015e2c0 2024-09-13T18:47:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe51e000640 1 -- 172.21.15.192:0/4116301649 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe518031980 con 0x7fe52015e2c0 2024-09-13T18:47:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 -- 172.21.15.192:0/4116301649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 msgr2=0x7fe52015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 --2- 172.21.15.192:0/4116301649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 0x7fe52015a440 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe52006cd20 tx=0x7fe51802a5d0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 -- 172.21.15.192:0/4116301649 shutdown_connections 2024-09-13T18:47:45.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 --2- 172.21.15.192:0/4116301649 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015e2c0 0x7fe52015a440 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.192:3300/0 conn(0x7fe5200b3f10 0x7fe5200b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 --2- 172.21.15.192:0/4116301649 >> v2:172.21.15.194:3300/0 conn(0x7fe52015dee0 0x7fe5200afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 -- 172.21.15.192:0/4116301649 >> 172.21.15.192:0/4116301649 conn(0x7fe5200ae960 msgr2=0x7fe52006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 -- 172.21.15.192:0/4116301649 shutdown_connections 2024-09-13T18:47:45.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.446+0000 7fe526800640 1 -- 172.21.15.192:0/4116301649 wait complete. 2024-09-13T18:47:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.448+0000 7fe526800640 1 Processor -- start 2024-09-13T18:47:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.448+0000 7fe526800640 1 -- start start 2024-09-13T18:47:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 0x7fe5201e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe52015e2c0 0x7fe5201e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201e8de0 con 0x7fe5201e7d10 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201e81d0 con 0x7fe52015e2c0 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe526800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201e84b0 con 0x7fe52015dee0 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45940/0 (socket says 172.21.15.192:45940) 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 -- 172.21.15.192:0/1073054227 learned_addr learned my addr 172.21.15.192:0/1073054227 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51ea00640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe52015e2c0 0x7fe5201e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51f400640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 0x7fe5201e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 -- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 msgr2=0x7fe5201e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 0x7fe5201e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 -- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe52015e2c0 msgr2=0x7fe5201e77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe52015e2c0 0x7fe5201e77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.449+0000 7fe51fe00640 1 -- 172.21.15.192:0/1073054227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c0094d0 con 0x7fe5201e7d10 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe51f400640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 0x7fe5201e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe51fe00640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe51802abc0 tx=0x7fe518004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51803b820 con 0x7fe5201e7d10 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51803b980 con 0x7fe5201e7d10 2024-09-13T18:47:45.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe518009a70 con 0x7fe5201e7d10 2024-09-13T18:47:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51803bd10 con 0x7fe5201e7d10 2024-09-13T18:47:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.450+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5201e8a70 con 0x7fe5201e7d10 2024-09-13T18:47:45.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.451+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52015a440 con 0x7fe5201e7d10 2024-09-13T18:47:45.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.452+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe51803a3a0 con 0x7fe5201e7d10 2024-09-13T18:47:45.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.453+0000 7fe517400640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 0x7fe50006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:45.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.453+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5180aa9c0 con 0x7fe5201e7d10 2024-09-13T18:47:45.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.453+0000 7fe51f400640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 0x7fe50006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:45.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.454+0000 7fe51f400640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 0x7fe50006d0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe510009b10 tx=0x7fe510008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:45.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.457+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe518075b00 con 0x7fe5201e7d10 2024-09-13T18:47:45.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.656+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe520066f70 con 0x7fe5201e7d10 2024-09-13T18:47:45.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.657+0000 7fe517400640 1 -- 172.21.15.192:0/1073054227 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7fe518009450 con 0x7fe5201e7d10 2024-09-13T18:47:45.660 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:45.660 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:47:45.661 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.659+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 msgr2=0x7fe50006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.659+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 0x7fe50006d0c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe510009b10 tx=0x7fe510008040 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.659+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 msgr2=0x7fe5201e34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.659+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fe51802abc0 tx=0x7fe518004a40 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 shutdown_connections 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe50006ac00 0x7fe50006d0c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5201e7d10 0x7fe5201e34a0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe52015e2c0 0x7fe5201e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 --2- 172.21.15.192:0/1073054227 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe52015dee0 0x7fe5201e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 >> 172.21.15.192:0/1073054227 conn(0x7fe5200ae960 msgr2=0x7fe520158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:45.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 shutdown_connections 2024-09-13T18:47:45.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:45.660+0000 7fe526800640 1 -- 172.21.15.192:0/1073054227 wait complete. 2024-09-13T18:47:45.678 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:47:45.851 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":9003,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.1867250760000001,"mdsmap_epoch":85,"osdmap_epoch":197,"osdmap_epoch_barrier":197,"uptime":14.32018768} 2024-09-13T18:47:45.851 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 9003, "mdsmap_epoch": 85, "osdmap_epoch": 197, "osdmap_epoch_barrier": 197, "rank_uptime": 9.186725076, "state": "up:active", "uptime": 14.32018768, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:47:45.851 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2024-09-13T18:47:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.003+0000 7fd2efe00640 1 Processor -- start 2024-09-13T18:47:46.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.004+0000 7fd2efe00640 1 -- start start 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2efe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2efe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 0x7fd2f006a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2efe00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f013cfa0 con 0x7fd2f015d7f0 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2efe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f006aa60 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2efe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f00cc3c0 con 0x7fd2f006a0b0 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45942/0 (socket says 172.21.15.192:45942) 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 -- 172.21.15.192:0/1503146840 learned_addr learned my addr 172.21.15.192:0/1503146840 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:46.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2ee000640 1 --2- 172.21.15.192:0/1503146840 >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 0x7fd2f006a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 -- 172.21.15.192:0/1503146840 >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 msgr2=0x7fd2f006a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 --2- 172.21.15.192:0/1503146840 >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 0x7fd2f006a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 -- 172.21.15.192:0/1503146840 >> v1:172.21.15.194:6789/0 conn(0x7fd2f015d7f0 legacy=0x7fd2f015dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2eea00640 1 -- 172.21.15.192:0/1503146840 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f00ce720 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.005+0000 7fd2ee000640 1 --2- 172.21.15.192:0/1503146840 >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 0x7fd2f006a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.006+0000 7fd2eea00640 1 --2- 172.21.15.192:0/1503146840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00b18e0 tx=0x7fd2e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36d711b0e8396bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2ed600640 1 -- 172.21.15.192:0/1503146840 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0032440 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2ed600640 1 -- 172.21.15.192:0/1503146840 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e00325a0 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2ed600640 1 -- 172.21.15.192:0/1503146840 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0032930 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 -- 172.21.15.192:0/1503146840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f00cbfe0 msgr2=0x7fd2f00ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 --2- 172.21.15.192:0/1503146840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fd2f00b18e0 tx=0x7fd2e002a270 comp rx=0 tx=0).stop 2024-09-13T18:47:46.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 -- 172.21.15.192:0/1503146840 shutdown_connections 2024-09-13T18:47:46.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 --2- 172.21.15.192:0/1503146840 >> v2:172.21.15.194:3300/0 conn(0x7fd2f006a0b0 0x7fd2f006a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 --2- 172.21.15.192:0/1503146840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f00cbfe0 0x7fd2f00ce1e0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 -- 172.21.15.192:0/1503146840 >> 172.21.15.192:0/1503146840 conn(0x7fd2f0073490 msgr2=0x7fd2f00b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 -- 172.21.15.192:0/1503146840 shutdown_connections 2024-09-13T18:47:46.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.007+0000 7fd2efe00640 1 -- 172.21.15.192:0/1503146840 wait complete. 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.009+0000 7fd2efe00640 1 Processor -- start 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.009+0000 7fd2efe00640 1 -- start start 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2f00cbfe0 0x7fd2f013c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f015d7f0 0x7fd2f015cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f013ca90 con 0x7fd2f015d7f0 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01f36c0 con 0x7fd2f006a0b0 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2efe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f01f2b40 con 0x7fd2f00cbfe0 2024-09-13T18:47:46.014 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2eea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2ef400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f015d7f0 0x7fd2f015cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2eea00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:51996/0 (socket says 172.21.15.192:51996) 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2eea00640 1 -- 172.21.15.192:0/22690808 learned_addr learned my addr 172.21.15.192:0/22690808 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.010+0000 7fd2ee000640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2f00cbfe0 0x7fd2f013c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 -- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2f00cbfe0 msgr2=0x7fd2f013c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2f00cbfe0 0x7fd2f013c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 -- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f015d7f0 msgr2=0x7fd2f015cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f015d7f0 0x7fd2f015cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 -- 172.21.15.192:0/22690808 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2e00094d0 con 0x7fd2f006a0b0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2eea00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd2e002a2b0 tx=0x7fd2e00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e0032440 con 0x7fd2f006a0b0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e0030ba0 con 0x7fd2f006a0b0 2024-09-13T18:47:46.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f01f2e20 con 0x7fd2f006a0b0 2024-09-13T18:47:46.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e003d440 con 0x7fd2f006a0b0 2024-09-13T18:47:46.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.011+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f01f33e0 con 0x7fd2f006a0b0 2024-09-13T18:47:46.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.012+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f0067b10 con 0x7fd2f006a0b0 2024-09-13T18:47:46.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.013+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd2e0039040 con 0x7fd2f006a0b0 2024-09-13T18:47:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.014+0000 7fd2e6a00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 0x7fd2d006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.014+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2e00a9e50 con 0x7fd2f006a0b0 2024-09-13T18:47:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.014+0000 7fd2ee000640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 0x7fd2d006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:46.017 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.015+0000 7fd2ee000640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 0x7fd2d006d0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0150850 tx=0x7fd2dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:46.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.019+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd2e0075050 con 0x7fd2f006a0b0 2024-09-13T18:47:46.191 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.188+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fd2f0151300 con 0x7fd2f006a0b0 2024-09-13T18:47:46.700 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.697+0000 7fd2e6a00640 1 -- 172.21.15.192:0/22690808 <== mon.1 v2:172.21.15.194:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v198) v1 ==== 181+0+0 (secure 0 0 0) 0x7fd2e0078670 con 0x7fd2f006a0b0 2024-09-13T18:47:46.700 INFO:teuthology.orchestra.run.smithi192.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2024-09-13T18:47:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 msgr2=0x7fd2d006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 0x7fd2d006d0c0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0150850 tx=0x7fd2dc008040 comp rx=0 tx=0).stop 2024-09-13T18:47:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 msgr2=0x7fd2f01528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:46.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd2e002a2b0 tx=0x7fd2e00046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 shutdown_connections 2024-09-13T18:47:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2d006ac00 0x7fd2d006d0c0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2f015d7f0 0x7fd2f015cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd2f00cbfe0 0x7fd2f013c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 --2- 172.21.15.192:0/22690808 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd2f006a0b0 0x7fd2f01528f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.699+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 >> 172.21.15.192:0/22690808 conn(0x7fd2f0073490 msgr2=0x7fd2f013e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.700+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 shutdown_connections 2024-09-13T18:47:46.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:46.700+0000 7fd2efe00640 1 -- 172.21.15.192:0/22690808 wait complete. 2024-09-13T18:47:46.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2024-09-13T18:47:46.887 INFO:teuthology.orchestra.run.smithi192.stdout:{"osd_mon_report_interval":"5"} 2024-09-13T18:47:46.887 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2024-09-13T18:47:46.887 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2024-09-13T18:47:46.887 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:46.887 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:46.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:46.923 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2024-09-13T18:47:47.146 INFO:teuthology.orchestra.run.smithi192.stderr:16+0 records in 2024-09-13T18:47:47.146 INFO:teuthology.orchestra.run.smithi192.stderr:16+0 records out 2024-09-13T18:47:47.147 INFO:teuthology.orchestra.run.smithi192.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.143312 s, 117 MB/s 2024-09-13T18:47:47.147 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:47.148 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:47.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:47.183 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2024-09-13T18:47:47.393 INFO:teuthology.orchestra.run.smithi192.stderr:17+0 records in 2024-09-13T18:47:47.393 INFO:teuthology.orchestra.run.smithi192.stderr:17+0 records out 2024-09-13T18:47:47.393 INFO:teuthology.orchestra.run.smithi192.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.13102 s, 136 MB/s 2024-09-13T18:47:47.394 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2024-09-13T18:47:47.394 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.543+0000 7ff889e00640 1 Processor -- start 2024-09-13T18:47:47.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.543+0000 7ff889e00640 1 -- start start 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff889e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff88415dee0 0x7ff8840afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff889e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7ff88415e2c0 0x7ff88415ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff889e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8840b2f00 con 0x7ff8840b3f10 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff889e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840b3150 con 0x7ff88415dee0 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff889e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8840b3430 con 0x7ff88415e2c0 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff88415dee0 0x7ff8840afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7ff88415dee0 0x7ff8840afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45960/0 (socket says 172.21.15.192:45960) 2024-09-13T18:47:47.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 -- 172.21.15.192:0/1127211785 learned_addr learned my addr 172.21.15.192:0/1127211785 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff883400640 1 --2- 172.21.15.192:0/1127211785 >> v2:172.21.15.194:3300/0 conn(0x7ff88415e2c0 0x7ff88415ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 -- 172.21.15.192:0/1127211785 >> v2:172.21.15.194:3300/0 conn(0x7ff88415e2c0 msgr2=0x7ff88415ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 --2- 172.21.15.192:0/1127211785 >> v2:172.21.15.194:3300/0 conn(0x7ff88415e2c0 0x7ff88415ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 -- 172.21.15.192:0/1127211785 >> v1:172.21.15.194:6789/0 conn(0x7ff8840b3f10 legacy=0x7ff88415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:47.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.545+0000 7ff882a00640 1 -- 172.21.15.192:0/1127211785 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8840b3710 con 0x7ff88415dee0 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.546+0000 7ff882a00640 1 --2- 172.21.15.192:0/1127211785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415dee0 0x7ff8840afd80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cec10 tx=0x7ff87402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e9feacd2f637628 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.546+0000 7ff882000640 1 -- 172.21.15.192:0/1127211785 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874032440 con 0x7ff88415dee0 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff882000640 1 -- 172.21.15.192:0/1127211785 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8740325a0 con 0x7ff88415dee0 2024-09-13T18:47:47.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff882000640 1 -- 172.21.15.192:0/1127211785 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff874032930 con 0x7ff88415dee0 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 -- 172.21.15.192:0/1127211785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415dee0 msgr2=0x7ff8840afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 --2- 172.21.15.192:0/1127211785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415dee0 0x7ff8840afd80 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7ff8840cec10 tx=0x7ff87402a230 comp rx=0 tx=0).stop 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 -- 172.21.15.192:0/1127211785 shutdown_connections 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 --2- 172.21.15.192:0/1127211785 >> v2:172.21.15.194:3300/0 conn(0x7ff88415e2c0 0x7ff88415ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 --2- 172.21.15.192:0/1127211785 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415dee0 0x7ff8840afd80 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 -- 172.21.15.192:0/1127211785 >> 172.21.15.192:0/1127211785 conn(0x7ff8840ae960 msgr2=0x7ff88406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 -- 172.21.15.192:0/1127211785 shutdown_connections 2024-09-13T18:47:47.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.547+0000 7ff889e00640 1 -- 172.21.15.192:0/1127211785 wait complete. 2024-09-13T18:47:47.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.549+0000 7ff889e00640 1 Processor -- start 2024-09-13T18:47:47.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.549+0000 7ff889e00640 1 -- start start 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff88415dee0 0x7ff884150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff88406b120 0x7ff8841381c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8841435f0 con 0x7ff88415e2c0 2024-09-13T18:47:47.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff884151490 con 0x7ff88406b120 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff889e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff884151770 con 0x7ff88415dee0 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff87a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff87a000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:45974/0 (socket says 172.21.15.192:45974) 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff87a000640 1 -- 172.21.15.192:0/877223478 learned_addr learned my addr 172.21.15.192:0/877223478 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff883400640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff88406b120 0x7ff8841381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.550+0000 7ff882a00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff88415dee0 0x7ff884150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 -- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff88415dee0 msgr2=0x7ff884150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff88415dee0 0x7ff884150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 -- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff88406b120 msgr2=0x7ff8841381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff88406b120 0x7ff8841381c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 -- 172.21.15.192:0/877223478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740094d0 con 0x7ff88415e2c0 2024-09-13T18:47:47.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87a000640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c430 tx=0x7ff86c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c011790 con 0x7ff88415e2c0 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0118f0 con 0x7ff88415e2c0 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c011ce0 con 0x7ff88415e2c0 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff884151a50 con 0x7ff88415e2c0 2024-09-13T18:47:47.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.551+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff884152010 con 0x7ff88415e2c0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.552+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff884067490 con 0x7ff88415e2c0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.553+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff86c01c460 con 0x7ff88415e2c0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.554+0000 7ff87be00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 0x7ff86006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.554+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff86c089200 con 0x7ff88415e2c0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.554+0000 7ff882a00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 0x7ff86006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:47.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.555+0000 7ff882a00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 0x7ff86006d0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff874034000 tx=0x7ff87402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:47.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.558+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff86c0543f0 con 0x7ff88415e2c0 2024-09-13T18:47:47.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.731+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff8841f0820 con 0x7ff88415e2c0 2024-09-13T18:47:47.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.733+0000 7ff87be00640 1 -- 172.21.15.192:0/877223478 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v198) v1 ==== 81+0+34082 (secure 0 0 0) 0x7ff86c057a10 con 0x7ff88415e2c0 2024-09-13T18:47:47.736 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:47.736 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 198, 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:47:46.688601+0000", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:47:47.737 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:47:47.738 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:47.739 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:47.740 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:47.741 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:47.742 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:47.743 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:47:47.744 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:47.745 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:47.746 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:47.747 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:47.748 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:47.749 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:47.750 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.751 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:47.752 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:47.753 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "198", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:47.754 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:47.755 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:47.756 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.757 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:47.758 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:47.759 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.760 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.761 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:47:47.762 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.763 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.764 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:47.765 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:47.766 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.767 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.768 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:47:47.769 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.770 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.771 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:47:47.772 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.773 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.774 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.775 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.776 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.777 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.778 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.779 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.780 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.781 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.782 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.783 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.784 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.785 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:47:47.786 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:47:47.787 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.788 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.789 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.790 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.791 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.792 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.793 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.794 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.795 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.796 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.797 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.798 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.799 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.800 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.801 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:47.802 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.803 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.804 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.805 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.806 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:47.807 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.808 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.809 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.810 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.811 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.812 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:47.813 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:47:47.814 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:47.815 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 msgr2=0x7ff86006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 0x7ff86006d0c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7ff874034000 tx=0x7ff87402e000 comp rx=0 tx=0).stop 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 msgr2=0x7ff8841430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7ff86c00c430 tx=0x7ff86c00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 shutdown_connections 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff86006ac00 0x7ff86006d0c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff88406b120 0x7ff8841381c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff88415e2c0 0x7ff8841430b0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 --2- 172.21.15.192:0/877223478 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff88415dee0 0x7ff884150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 >> 172.21.15.192:0/877223478 conn(0x7ff8840ae960 msgr2=0x7ff8840715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 shutdown_connections 2024-09-13T18:47:47.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:47.735+0000 7ff889e00640 1 -- 172.21.15.192:0/877223478 wait complete. 2024-09-13T18:47:47.818 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:47:52.820 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:47:52.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.981+0000 7feeb1000640 1 Processor -- start 2024-09-13T18:47:52.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.982+0000 7feeb1000640 1 -- start start 2024-09-13T18:47:52.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7feeac159b00 0x7feeac0b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feeac06bc30 0x7feeac0b32b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac159ee0 0x7feeac15a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac15af60 con 0x7feeac06bc30 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac06b7a0 con 0x7feeac159b00 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeb1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac15ac80 con 0x7feeac159ee0 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeaaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feeac06bc30 0x7feeac0b32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeaaa00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feeac06bc30 0x7feeac0b32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36536/0 (socket says 172.21.15.192:36536) 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeaaa00640 1 -- 172.21.15.192:0/2348554501 learned_addr learned my addr 172.21.15.192:0/2348554501 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeab400640 1 --2- 172.21.15.192:0/2348554501 >> v2:172.21.15.194:3300/0 conn(0x7feeac159b00 0x7feeac0b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.983+0000 7feeabe00640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac159ee0 0x7feeac15a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.984+0000 7feeaaa00640 1 -- 172.21.15.192:0/2348554501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac159ee0 msgr2=0x7feeac15a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.984+0000 7feeaaa00640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac159ee0 0x7feeac15a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.984+0000 7feeaaa00640 1 -- 172.21.15.192:0/2348554501 >> v2:172.21.15.194:3300/0 conn(0x7feeac159b00 msgr2=0x7feeac0b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:52.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.984+0000 7feeaaa00640 1 --2- 172.21.15.192:0/2348554501 >> v2:172.21.15.194:3300/0 conn(0x7feeac159b00 0x7feeac0b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.984+0000 7feeaaa00640 1 -- 172.21.15.192:0/2348554501 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac06b150 con 0x7feeac06bc30 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeaaa00640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac06bc30 0x7feeac0b32b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7feeac06cc90 tx=0x7fee9c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb556e45be23341e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeaa000640 1 -- 172.21.15.192:0/2348554501 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c032440 con 0x7feeac06bc30 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeaa000640 1 -- 172.21.15.192:0/2348554501 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9c0325a0 con 0x7feeac06bc30 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeaa000640 1 -- 172.21.15.192:0/2348554501 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9c032930 con 0x7feeac06bc30 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 -- 172.21.15.192:0/2348554501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac06bc30 msgr2=0x7feeac0b32b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac06bc30 0x7feeac0b32b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7feeac06cc90 tx=0x7fee9c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 -- 172.21.15.192:0/2348554501 shutdown_connections 2024-09-13T18:47:52.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac159ee0 0x7feeac15a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 --2- 172.21.15.192:0/2348554501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac06bc30 0x7feeac0b32b0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 --2- 172.21.15.192:0/2348554501 >> v2:172.21.15.194:3300/0 conn(0x7feeac159b00 0x7feeac0b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.985+0000 7feeb1000640 1 -- 172.21.15.192:0/2348554501 >> 172.21.15.192:0/2348554501 conn(0x7feeac0736d0 msgr2=0x7feeac0b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.986+0000 7feeb1000640 1 -- 172.21.15.192:0/2348554501 shutdown_connections 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.986+0000 7feeb1000640 1 -- 172.21.15.192:0/2348554501 wait complete. 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.987+0000 7feeb1000640 1 Processor -- start 2024-09-13T18:47:52.990 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.987+0000 7feeb1000640 1 -- start start 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 0x7feeac14e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 0x7feeac151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac14e830 con 0x7feeac159ee0 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac071220 con 0x7feeac159b00 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.988+0000 7feeb1000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1f2dd0 con 0x7feeac06bc30 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeab400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 0x7feeac14e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.992 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeaaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 0x7feeac151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeab400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 0x7feeac14e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:58282/0 (socket says 172.21.15.192:58282) 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeab400640 1 -- 172.21.15.192:0/186016440 learned_addr learned my addr 172.21.15.192:0/186016440 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeaaa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 0x7feeac151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:38854/0 (socket says 172.21.15.192:38854) 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36552/0 (socket says 172.21.15.192:36552) 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 -- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 msgr2=0x7feeac14e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 0x7feeac14e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 -- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 msgr2=0x7feeac151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 0x7feeac151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0094d0 con 0x7feeac159ee0 2024-09-13T18:47:52.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.989+0000 7feeabe00640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7feea4007d20 tx=0x7feea400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:52.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.990+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea4018070 con 0x7feeac159ee0 2024-09-13T18:47:52.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.990+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea400ed70 con 0x7feeac159ee0 2024-09-13T18:47:52.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.990+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea400eee0 con 0x7feeac159ee0 2024-09-13T18:47:52.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.990+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac070980 con 0x7feeac159ee0 2024-09-13T18:47:52.994 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.990+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac070f40 con 0x7feeac159ee0 2024-09-13T18:47:52.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.991+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac15d0c0 con 0x7feeac159ee0 2024-09-13T18:47:52.995 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.992+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feea4014420 con 0x7feeac159ee0 2024-09-13T18:47:52.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.993+0000 7feea3400640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 0x7fee8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:52.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.993+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feea4089470 con 0x7feeac159ee0 2024-09-13T18:47:52.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.993+0000 7feeab400640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 0x7fee8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:52.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.993+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fee88072730 con 0x7feeac159ee0 2024-09-13T18:47:52.996 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.994+0000 7feeab400640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 0x7fee8806d0c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fee94006fd0 tx=0x7fee94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:53.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:52.998+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feea4054660 con 0x7feeac159ee0 2024-09-13T18:47:53.169 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.166+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feeac0cb5c0 con 0x7feeac159ee0 2024-09-13T18:47:53.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.168+0000 7feea3400640 1 -- 172.21.15.192:0/186016440 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+34101 (secure 0 0 0) 0x7feea4057c80 con 0x7feeac159ee0 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 199, 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:47:53.171 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:47:51.888840+0000", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:47:53.172 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:47:53.173 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:53.174 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.175 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:53.176 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:53.177 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:53.178 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:53.179 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:53.180 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:53.181 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:53.182 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:53.183 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:53.184 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:47:53.185 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:53.186 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:53.187 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:53.188 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "199", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:53.189 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:53.190 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:53.191 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:47:53.193 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.194 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.196 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.197 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.198 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.199 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:47:53.200 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:47:53.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:47:53.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:47:53.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.204 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.205 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.206 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:47:53.207 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.208 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:47:53.210 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.211 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.212 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.213 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:47:53.215 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.216 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.217 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:47:53.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.220 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.223 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.225 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.226 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.227 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.228 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.229 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.232 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.232 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.232 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.232 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.232 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:47:53.233 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.234 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.235 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.237 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:53.238 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.241 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:53.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:53.243 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:53.244 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.245 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.246 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:47:53.247 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.248 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.249 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.250 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:47:53.251 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.252 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:47:53.253 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:47:53.254 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:47:53.254 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:53.254 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 msgr2=0x7fee8806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 0x7fee8806d0c0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fee94006fd0 tx=0x7fee94008040 comp rx=0 tx=0).stop 2024-09-13T18:47:53.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 msgr2=0x7feeac1f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7feea4007d20 tx=0x7feea400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 shutdown_connections 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fee8806ac00 0x7fee8806d0c0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feeac159ee0 0x7feeac1f3540 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feeac159b00 0x7feeac151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.170+0000 7feeb1000640 1 --2- 172.21.15.192:0/186016440 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feeac06bc30 0x7feeac14e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.171+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 >> 172.21.15.192:0/186016440 conn(0x7feeac0736d0 msgr2=0x7feeac15c500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.171+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 shutdown_connections 2024-09-13T18:47:53.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.171+0000 7feeb1000640 1 -- 172.21.15.192:0/186016440 wait complete. 2024-09-13T18:47:53.257 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-13T18:47:53.257 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:47:53.257 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:47:53.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:53.293 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2024-09-13T18:47:53.682 INFO:teuthology.orchestra.run.smithi192.stderr:dd: fdatasync failed for 'large_file_b': No space left on device 2024-09-13T18:47:53.682 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:47:53.682 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:47:53.682 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.307456 s, 171 MB/s 2024-09-13T18:47:53.683 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:47:53.684 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:47:53.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.834+0000 7f71ff400640 1 Processor -- start 2024-09-13T18:47:53.837 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.834+0000 7f71ff400640 1 -- start start 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71ff400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71f80b3f10 0x7f71f815a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71ff400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f71f80b0490 0x7f71f815a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71ff400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f80b2f00 con 0x7f71f815dee0 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71ff400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f815aec0 con 0x7f71f80b0490 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71ff400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80b3150 con 0x7f71f80b3f10 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71fca00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f71f815dee0 0x7f71f80afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56886/0 (socket says 172.21.15.192:56886) 2024-09-13T18:47:53.838 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.835+0000 7f71fca00640 1 -- 172.21.15.192:0/3322825150 learned_addr learned my addr 172.21.15.192:0/3322825150 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:47:53.841 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7e00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71f80b3f10 0x7f71f815a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71fd400640 1 --2- 172.21.15.192:0/3322825150 >> v2:172.21.15.194:3300/0 conn(0x7f71f80b0490 0x7f71f815a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2249731377 0 0) 0x7f71f80b2f00 con 0x7f71f815dee0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71e0003520 con 0x7f71f815dee0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2453863102 0 0) 0x7f71e0003520 con 0x7f71f815dee0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71f80b3f10 msgr2=0x7f71f815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71f80b3f10 0x7f71f815a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 >> v2:172.21.15.194:3300/0 conn(0x7f71f80b0490 msgr2=0x7f71f815a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 --2- 172.21.15.192:0/3322825150 >> v2:172.21.15.194:3300/0 conn(0x7f71f80b0490 0x7f71f815a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80b3430 con 0x7f71f815dee0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f71ec001670 con 0x7f71f815dee0 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 >> v1:172.21.15.192:6789/0 conn(0x7f71f815dee0 legacy=0x7f71f80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e0003970 0x7f71e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e00047c0 0x7f71e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e0005180 0x7f71e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f815aec0 con 0x7f71e0003970 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80b3150 con 0x7f71e0005180 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71e000bec0 con 0x7f71e00047c0 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.836+0000 7f71fd400640 1 --2- 172.21.15.192:0/3322825150 >> v2:172.21.15.194:3300/0 conn(0x7f71f80b0490 0x7f71f815a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71f7e00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71f80b3f10 0x7f71f815a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e0003970 0x7f71e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 -- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e00047c0 msgr2=0x7f71e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e00047c0 0x7f71e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 -- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e0005180 msgr2=0x7f71e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71e0005180 0x7f71e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.843 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.837+0000 7f71fca00640 1 -- 172.21.15.192:0/3322825150 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e0003520 con 0x7f71e0003970 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.838+0000 7f71fca00640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e0003970 0x7f71e0003d90 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c270 tx=0x7f71e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adafa6e1174740f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.838+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec005ad0 con 0x7f71e0003970 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.838+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ec005c30 con 0x7f71e0003970 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.838+0000 7f71f7400640 1 -- 172.21.15.192:0/3322825150 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ec007070 con 0x7f71e0003970 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 -- 172.21.15.192:0/3322825150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e0003970 msgr2=0x7f71e0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 --2- 172.21.15.192:0/3322825150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71e0003970 0x7f71e0003d90 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f71ec00c270 tx=0x7f71e00057f0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71fd400640 1 -- 172.21.15.192:0/3322825150 reap_dead start 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 -- 172.21.15.192:0/3322825150 shutdown_connections 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 -- 172.21.15.192:0/3322825150 >> 172.21.15.192:0/3322825150 conn(0x7f71f80ae960 msgr2=0x7f71f806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:53.844 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 -- 172.21.15.192:0/3322825150 shutdown_connections 2024-09-13T18:47:53.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.839+0000 7f71ff400640 1 -- 172.21.15.192:0/3322825150 wait complete. 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.841+0000 7f71ff400640 1 Processor -- start 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.841+0000 7f71ff400640 1 -- start start 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.841+0000 7f71ff400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e0003970 0x7f71f8143090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.841+0000 7f71ff400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f8141640 0x7f71f813c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71ff400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71ff400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f8141220 con 0x7f71f813c5f0 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71ff400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f81402c0 con 0x7f71f8141640 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71ff400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f81405a0 con 0x7f71e0003970 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36574/0 (socket says 172.21.15.192:36574) 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 -- 172.21.15.192:0/1614587876 learned_addr learned my addr 172.21.15.192:0/1614587876 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fca00640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e0003970 0x7f71f8143090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71f7e00640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f8141640 0x7f71f813c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 -- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e0003970 msgr2=0x7f71f8143090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e0003970 0x7f71f8143090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 -- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f8141640 msgr2=0x7f71f813c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f8141640 0x7f71f813c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:53.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f8140880 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.842+0000 7f71fd400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f71f80b0910 tx=0x7f71f000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.843+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0010040 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.843+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71f000bce0 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.843+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71f0003bd0 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.843+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f8140b60 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.843+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f8141ac0 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.844+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f8141360 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.845+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f71f0003d30 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.846+0000 7f71f4c00640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 0x7f71d806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.846+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71f0088f60 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.846+0000 7f71fca00640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 0x7f71d806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.846+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f71d8072730 con 0x7f71f813c5f0 2024-09-13T18:47:53.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.847+0000 7f71fca00640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 0x7f71d806d0c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71ec033000 tx=0x7f71ec035040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:53.854 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:53.850+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f71f8141360 con 0x7f71f813c5f0 2024-09-13T18:47:54.023 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.020+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f71f8141360 con 0x7f71f813c5f0 2024-09-13T18:47:54.024 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.021+0000 7f71f4c00640 1 -- 172.21.15.192:0/1614587876 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+34101 (secure 0 0 0) 0x7f71f8141360 con 0x7f71f813c5f0 2024-09-13T18:47:54.025 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:54.025 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:54.025 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 199, 2024-09-13T18:47:54.025 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:47:54.025 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:47:51.888840+0000", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:47:54.026 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:47:54.027 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:54.028 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:47:54.029 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:47:54.030 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:54.031 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:54.032 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:54.033 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:47:54.034 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:54.035 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:54.036 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:54.037 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:54.038 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.039 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:54.040 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:54.041 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.042 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:54.043 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.044 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:54.045 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.049 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:54.050 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:54.051 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "199", 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:54.052 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:54.053 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:54.054 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.055 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:47:54.056 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.057 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.058 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.059 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.060 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:47:54.061 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.062 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.063 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.064 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.065 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.066 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.067 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.068 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.069 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.070 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.071 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.072 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.073 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:47:54.074 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.075 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.076 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.077 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.078 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.079 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.080 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.081 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.082 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.083 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:47:54.084 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:47:54.085 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:47:54.086 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.087 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.088 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.089 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:47:54.090 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.091 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.092 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:47:54.094 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.095 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:47:54.096 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.097 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.098 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.099 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.100 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.101 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:54.102 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.103 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:54.106 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:54.107 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.108 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.109 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.110 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.111 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.113 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.114 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:47:54.116 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:47:54.117 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:47:54.118 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:54.119 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:54.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.023+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 msgr2=0x7f71d806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.023+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 0x7f71d806d0c0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71ec033000 tx=0x7f71ec035040 comp rx=0 tx=0).stop 2024-09-13T18:47:54.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.023+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 msgr2=0x7f71f80ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.023+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f71f80b0910 tx=0x7f71f000b480 comp rx=0 tx=0).stop 2024-09-13T18:47:54.121 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 shutdown_connections 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f71d806ac00 0x7f71d806d0c0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f813c5f0 0x7f71f80ab870 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f71f8141640 0x7f71f813c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 --2- 172.21.15.192:0/1614587876 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f71e0003970 0x7f71f8143090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 >> 172.21.15.192:0/1614587876 conn(0x7f71f80ae960 msgr2=0x7f71f80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 shutdown_connections 2024-09-13T18:47:54.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.024+0000 7f71ff400640 1 -- 172.21.15.192:0/1614587876 wait complete. 2024-09-13T18:47:54.123 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:47:54.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.274+0000 7fa0d8400640 1 Processor -- start 2024-09-13T18:47:54.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.274+0000 7fa0d8400640 1 -- start start 2024-09-13T18:47:54.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d8400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0d015e790 0x7fa0d00cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d8400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fa0d015bc20 0x7fa0d00afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d8400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0d015ec00 con 0x7fa0d00cacd0 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d8400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d00cb5f0 con 0x7fa0d015e790 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d8400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0d0140480 con 0x7fa0d015bc20 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.275+0000 7fa0d5000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0d015e790 0x7fa0d00cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fa0d015e790 0x7fa0d00cb0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36576/0 (socket says 172.21.15.192:36576) 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 -- 172.21.15.192:0/1113202600 learned_addr learned my addr 172.21.15.192:0/1113202600 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d6400640 1 --2- 172.21.15.192:0/1113202600 >> v2:172.21.15.194:3300/0 conn(0x7fa0d015bc20 0x7fa0d00afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 -- 172.21.15.192:0/1113202600 >> v2:172.21.15.194:3300/0 conn(0x7fa0d015bc20 msgr2=0x7fa0d00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:54.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 --2- 172.21.15.192:0/1113202600 >> v2:172.21.15.194:3300/0 conn(0x7fa0d015bc20 0x7fa0d00afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 -- 172.21.15.192:0/1113202600 >> v1:172.21.15.194:6789/0 conn(0x7fa0d00cacd0 legacy=0x7fa0d0140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:47:54.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.276+0000 7fa0d5000640 1 -- 172.21.15.192:0/1113202600 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d015ee90 con 0x7fa0d015e790 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.277+0000 7fa0d5000640 1 --2- 172.21.15.192:0/1113202600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015e790 0x7fa0d00cb0b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0158ce0 tx=0x7fa0bc02a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=752715f45d8a3697 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.277+0000 7fa0cfe00640 1 -- 172.21.15.192:0/1113202600 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc032440 con 0x7fa0d015e790 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.277+0000 7fa0cfe00640 1 -- 172.21.15.192:0/1113202600 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc0325a0 con 0x7fa0d015e790 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.277+0000 7fa0cfe00640 1 -- 172.21.15.192:0/1113202600 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc032930 con 0x7fa0d015e790 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 -- 172.21.15.192:0/1113202600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015e790 msgr2=0x7fa0d00cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 --2- 172.21.15.192:0/1113202600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015e790 0x7fa0d00cb0b0 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7fa0d0158ce0 tx=0x7fa0bc02a230 comp rx=0 tx=0).stop 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 -- 172.21.15.192:0/1113202600 shutdown_connections 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 --2- 172.21.15.192:0/1113202600 >> v2:172.21.15.194:3300/0 conn(0x7fa0d015bc20 0x7fa0d00afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 --2- 172.21.15.192:0/1113202600 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015e790 0x7fa0d00cb0b0 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 -- 172.21.15.192:0/1113202600 >> 172.21.15.192:0/1113202600 conn(0x7fa0d00ae960 msgr2=0x7fa0d006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:54.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 -- 172.21.15.192:0/1113202600 shutdown_connections 2024-09-13T18:47:54.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.278+0000 7fa0d8400640 1 -- 172.21.15.192:0/1113202600 wait complete. 2024-09-13T18:47:54.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.279+0000 7fa0d8400640 1 Processor -- start 2024-09-13T18:47:54.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.280+0000 7fa0d8400640 1 -- start start 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.280+0000 7fa0d8400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0d00cacd0 0x7fa0d013be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.280+0000 7fa0d8400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.280+0000 7fa0d8400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0d015e790 0x7fa0d006b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.280+0000 7fa0d8400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00b3a50 con 0x7fa0d015bc20 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d8400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d00b2b80 con 0x7fa0d015e790 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d8400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0d01f3c80 con 0x7fa0d00cacd0 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36578/0 (socket says 172.21.15.192:36578) 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 -- 172.21.15.192:0/4143978060 learned_addr learned my addr 172.21.15.192:0/4143978060 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:54.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d6400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0d015e790 0x7fa0d006b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5a00640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0d00cacd0 0x7fa0d013be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 -- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0d00cacd0 msgr2=0x7fa0d013be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0d00cacd0 0x7fa0d013be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 -- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0d015e790 msgr2=0x7fa0d006b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0d015e790 0x7fa0d006b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.281+0000 7fa0d5000640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0bc0094d0 con 0x7fa0d015bc20 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0d5000640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc02a270 tx=0x7fa0bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc032440 con 0x7fa0d015bc20 2024-09-13T18:47:54.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0bc030b80 con 0x7fa0d015bc20 2024-09-13T18:47:54.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0bc03d420 con 0x7fa0d015bc20 2024-09-13T18:47:54.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0d00b2dd0 con 0x7fa0d015bc20 2024-09-13T18:47:54.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.282+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0d00b3390 con 0x7fa0d015bc20 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.283+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0d00b3b90 con 0x7fa0d015bc20 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.284+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fa0bc039040 con 0x7fa0d015bc20 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.285+0000 7fa0cd600640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 0x7fa0b006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.285+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa0bc0a9f30 con 0x7fa0d015bc20 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.285+0000 7fa0d5a00640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 0x7fa0b006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.285+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7fa0b0072730 con 0x7fa0d015bc20 2024-09-13T18:47:54.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.285+0000 7fa0d5a00640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 0x7fa0b006d0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.289+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fa0d00b3b90 con 0x7fa0d015bc20 2024-09-13T18:47:54.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.489+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa0d00b3b90 con 0x7fa0d015bc20 2024-09-13T18:47:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.490+0000 7fa0cd600640 1 -- 172.21.15.192:0/4143978060 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7fa0d00b3b90 con 0x7fa0d015bc20 2024-09-13T18:47:54.493 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:54.493 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:47:54.493 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 msgr2=0x7fa0b006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 0x7fa0b006d0c0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fa0c4006fd0 tx=0x7fa0c4008040 comp rx=0 tx=0).stop 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 msgr2=0x7fa0d01f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc02a270 tx=0x7fa0bc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 shutdown_connections 2024-09-13T18:47:54.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fa0b006ac00 0x7fa0b006d0c0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fa0d015e790 0x7fa0d006b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0d015bc20 0x7fa0d01f3740 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 --2- 172.21.15.192:0/4143978060 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fa0d00cacd0 0x7fa0d013be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 >> 172.21.15.192:0/4143978060 conn(0x7fa0d00ae960 msgr2=0x7fa0d015c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 shutdown_connections 2024-09-13T18:47:54.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.492+0000 7fa0d8400640 1 -- 172.21.15.192:0/4143978060 wait complete. 2024-09-13T18:47:54.510 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:47:54.691 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":9003,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":18.026899974999999,"mdsmap_epoch":85,"osdmap_epoch":199,"osdmap_epoch_barrier":199,"uptime":23.160365698} 2024-09-13T18:47:54.691 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 9003, "mdsmap_epoch": 85, "osdmap_epoch": 199, "osdmap_epoch_barrier": 199, "rank_uptime": 18.026899975, "state": "up:active", "uptime": 23.160365698, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:47:54.691 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:47:54.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.692 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2024-09-13T18:47:54.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:47:54.730 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2024-09-13T18:47:54.826 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:47:54.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.975+0000 7f1d1bc00640 1 Processor -- start 2024-09-13T18:47:54.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.975+0000 7f1d1bc00640 1 -- start start 2024-09-13T18:47:54.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.976+0000 7f1d1bc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d140730a0 0x7f1d140734f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d1bc00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d14073a30 con 0x7f1d140cf1b0 2024-09-13T18:47:54.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d1bc00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d14161490 con 0x7f1d1415d3d0 2024-09-13T18:47:54.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d1bc00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140af820 con 0x7f1d140730a0 2024-09-13T18:47:54.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d140730a0 0x7f1d140734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1d140730a0 0x7f1d140734f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36586/0 (socket says 172.21.15.192:36586) 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 -- 172.21.15.192:0/2004211054 learned_addr learned my addr 172.21.15.192:0/2004211054 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d19200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f1d140cf1b0 0x7f1d140aed60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:56892/0 (socket says 172.21.15.192:56892) 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 -- 172.21.15.192:0/2004211054 >> v1:172.21.15.194:6789/0 conn(0x7f1d1415d3d0 legacy=0x7f1d1415d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 -- 172.21.15.192:0/2004211054 >> v1:172.21.15.192:6789/0 conn(0x7f1d140cf1b0 legacy=0x7f1d140aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13e00640 1 -- 172.21.15.192:0/2004211054 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d14160b60 con 0x7f1d140730a0 2024-09-13T18:47:54.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.977+0000 7f1d13400640 1 -- 172.21.15.192:0/2004211054 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1259314102 0 0) 0x7f1d08001110 con 0x7f1d140cf1b0 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.978+0000 7f1d13e00640 1 --2- 172.21.15.192:0/2004211054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140730a0 0x7f1d140734f0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009870 tx=0x7f1d0002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed9d80804864443 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.978+0000 7f1d13400640 1 -- 172.21.15.192:0/2004211054 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00032640 con 0x7f1d140730a0 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.978+0000 7f1d13400640 1 -- 172.21.15.192:0/2004211054 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d000327a0 con 0x7f1d140730a0 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d13400640 1 -- 172.21.15.192:0/2004211054 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00032b30 con 0x7f1d140730a0 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 -- 172.21.15.192:0/2004211054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140730a0 msgr2=0x7f1d140734f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/2004211054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140730a0 0x7f1d140734f0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009870 tx=0x7f1d0002a300 comp rx=0 tx=0).stop 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 -- 172.21.15.192:0/2004211054 shutdown_connections 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/2004211054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140730a0 0x7f1d140734f0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 -- 172.21.15.192:0/2004211054 >> 172.21.15.192:0/2004211054 conn(0x7f1d140b2030 msgr2=0x7f1d14069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:54.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 -- 172.21.15.192:0/2004211054 shutdown_connections 2024-09-13T18:47:54.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.979+0000 7f1d1bc00640 1 -- 172.21.15.192:0/2004211054 wait complete. 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.981+0000 7f1d1bc00640 1 Processor -- start 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.981+0000 7f1d1bc00640 1 -- start start 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d140730a0 0x7f1d14152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 0x7f1d1415f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14152b60 con 0x7f1d140cf1b0 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14149320 con 0x7f1d140730a0 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d1bc00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14155290 con 0x7f1d1415d3d0 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d13e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d13e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:36602/0 (socket says 172.21.15.192:36602) 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d13e00640 1 -- 172.21.15.192:0/3636348011 learned_addr learned my addr 172.21.15.192:0/3636348011 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d19200640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d140730a0 0x7f1d14152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d19c00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 0x7f1d1415f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.982+0000 7f1d13e00640 1 -- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 msgr2=0x7f1d1415f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d13e00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 0x7f1d1415f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d13e00640 1 -- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d140730a0 msgr2=0x7f1d14152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d13e00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d140730a0 0x7f1d14152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d13e00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d000094d0 con 0x7f1d140cf1b0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d19c00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 0x7f1d1415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d13e00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f1d00000c00 tx=0x7f1d000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d00030b80 con 0x7f1d140cf1b0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d00030d00 con 0x7f1d140cf1b0 2024-09-13T18:47:54.987 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0003d660 con 0x7f1d140cf1b0 2024-09-13T18:47:54.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d14155570 con 0x7f1d140cf1b0 2024-09-13T18:47:54.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.983+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d14155b30 con 0x7f1d140cf1b0 2024-09-13T18:47:54.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.984+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d140b2d00 con 0x7f1d140cf1b0 2024-09-13T18:47:54.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.985+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1d00039040 con 0x7f1d140cf1b0 2024-09-13T18:47:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.986+0000 7f1d10c00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 0x7f1cf406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:47:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.986+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d000a9fc0 con 0x7f1d140cf1b0 2024-09-13T18:47:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.986+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f1cf4072730 con 0x7f1d140cf1b0 2024-09-13T18:47:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.986+0000 7f1d19200640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 0x7f1cf406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:47:54.989 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.987+0000 7f1d19200640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 0x7f1cf406d0c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007df0 tx=0x7f1d08007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:47:54.993 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:54.990+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1d00075240 con 0x7f1d140cf1b0 2024-09-13T18:47:55.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.159+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f1d141577c0 con 0x7f1d140cf1b0 2024-09-13T18:47:55.163 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.161+0000 7f1d10c00640 1 -- 172.21.15.192:0/3636348011 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+34101 (secure 0 0 0) 0x7f1d00078860 con 0x7f1d140cf1b0 2024-09-13T18:47:55.164 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:47:55.164 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:47:55.164 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 199, 2024-09-13T18:47:55.164 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:47:51.888840+0000", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:55.165 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:47:55.166 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:55.167 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:55.168 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:55.169 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:55.170 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:55.171 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:47:55.172 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:55.173 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:55.174 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:55.175 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:55.176 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:55.177 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:55.178 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:47:55.179 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:47:55.180 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:47:55.181 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:47:55.182 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "199", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:47:55.183 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:47:55.184 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:47:55.185 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:47:55.186 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.187 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.188 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:47:55.189 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.190 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.191 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.192 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.193 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.194 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.195 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.196 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.197 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.199 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.200 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.201 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:47:55.202 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.203 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:47:55.204 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.205 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:47:55.206 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:55.207 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.208 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.209 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.210 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.211 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.212 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.213 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.214 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.215 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.216 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.217 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.218 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:47:55.219 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.220 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.221 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.222 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.223 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.224 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:47:55.225 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.226 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.227 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.228 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.229 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.230 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:47:55.231 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:47:55.232 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.233 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.234 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:47:55.235 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.236 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.237 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.238 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.239 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.240 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:47:55.241 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.242 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.243 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:47:55.244 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.245 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.246 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:47:55.247 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:47:55.248 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:47:55.249 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:47:55.250 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 msgr2=0x7f1cf406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 0x7f1cf406d0c0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007df0 tx=0x7f1d08007d80 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 msgr2=0x7f1d14148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f1d00000c00 tx=0x7f1d000046c0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 shutdown_connections 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1cf406ac00 0x7f1cf406d0c0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1d1415d3d0 0x7f1d1415f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d140cf1b0 0x7f1d14148de0 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 --2- 172.21.15.192:0/3636348011 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1d140730a0 0x7f1d14152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 >> 172.21.15.192:0/3636348011 conn(0x7f1d140b2030 msgr2=0x7f1d1406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:47:55.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 shutdown_connections 2024-09-13T18:47:55.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:47:55.163+0000 7f1d1bc00640 1 -- 172.21.15.192:0/3636348011 wait complete. 2024-09-13T18:47:55.253 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:48:00.254 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:48:00.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.413+0000 7f3369200640 1 Processor -- start 2024-09-13T18:48:00.416 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.414+0000 7f3369200640 1 -- start start 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3369200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f336406ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3369200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f33640cdfd0 0x7f3364070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3369200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336406c5d0 con 0x7f336406b3d0 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3369200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33640b3730 con 0x7f33640cdfd0 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3369200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33640b3920 con 0x7f336415a9e0 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f335aa00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f336406b3d0 0x7f33640cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37616/0 (socket says 172.21.15.192:37616) 2024-09-13T18:48:00.418 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f335aa00640 1 -- 172.21.15.192:0/4179066215 learned_addr learned my addr 172.21.15.192:0/4179066215 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3363400640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f336406ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3363e00640 1 --2- 172.21.15.192:0/4179066215 >> v2:172.21.15.194:3300/0 conn(0x7f33640cdfd0 0x7f3364070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.415+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1518596487 0 0) 0x7f336406c5d0 con 0x7f336406b3d0 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3348003520 con 0x7f336406b3d0 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3869928123 0 0) 0x7f3348003520 con 0x7f336406b3d0 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 msgr2=0x7f336406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f336406ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.420 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 >> v2:172.21.15.194:3300/0 conn(0x7f33640cdfd0 msgr2=0x7f3364070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 --2- 172.21.15.192:0/4179066215 >> v2:172.21.15.194:3300/0 conn(0x7f33640cdfd0 0x7f3364070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33640b3c00 con 0x7f336406b3d0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f334c001670 con 0x7f336406b3d0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 >> v1:172.21.15.192:6789/0 conn(0x7f336406b3d0 legacy=0x7f33640cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003970 0x7f3348003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33480047c0 0x7f3348004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f3348005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33640b3920 con 0x7f33480047c0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f334800b980 con 0x7f3348003970 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f334800bac0 con 0x7f336415a9e0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f335aa00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33480047c0 0x7f3348004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3363400640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003970 0x7f3348003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.421 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.416+0000 7f3363e00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f3348005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.417+0000 7f335aa00640 1 -- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 msgr2=0x7f3348005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:00.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.417+0000 7f335aa00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f336415a9e0 0x7f3348005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.417+0000 7f335aa00640 1 -- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003970 msgr2=0x7f3348003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:00.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.417+0000 7f335aa00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3348003970 0x7f3348003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.422 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.417+0000 7f335aa00640 1 -- 172.21.15.192:0/4179066215 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348003520 con 0x7f33480047c0 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f335aa00640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33480047c0 0x7f3348004c40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f336406c830 tx=0x7f33480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447fc30b2dbe4f0a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c005ad0 con 0x7f33480047c0 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c02d070 con 0x7f33480047c0 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3362a00640 1 -- 172.21.15.192:0/4179066215 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c005e70 con 0x7f33480047c0 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3369200640 1 -- 172.21.15.192:0/4179066215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33480047c0 msgr2=0x7f3348004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3369200640 1 --2- 172.21.15.192:0/4179066215 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f33480047c0 0x7f3348004c40 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f336406c830 tx=0x7f33480057f0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.418+0000 7f3363e00640 1 -- 172.21.15.192:0/4179066215 reap_dead start 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.419+0000 7f3369200640 1 -- 172.21.15.192:0/4179066215 shutdown_connections 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.419+0000 7f3369200640 1 -- 172.21.15.192:0/4179066215 >> 172.21.15.192:0/4179066215 conn(0x7f33640736d0 msgr2=0x7f33640b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.419+0000 7f3369200640 1 -- 172.21.15.192:0/4179066215 shutdown_connections 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.419+0000 7f3369200640 1 -- 172.21.15.192:0/4179066215 wait complete. 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.420+0000 7f3369200640 1 Processor -- start 2024-09-13T18:48:00.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.420+0000 7f3369200640 1 -- start start 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33480047c0 0x7f336414f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 0x7f33641511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336415b440 con 0x7f336414fa70 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3364158c40 con 0x7f3364159550 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.421+0000 7f3369200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3364158f20 con 0x7f33480047c0 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57314/0 (socket says 172.21.15.192:57314) 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 -- 172.21.15.192:0/1224528991 learned_addr learned my addr 172.21.15.192:0/1224528991 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363400640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33480047c0 0x7f336414f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f335aa00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 0x7f33641511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 -- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33480047c0 msgr2=0x7f336414f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33480047c0 0x7f336414f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 -- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 msgr2=0x7f33641511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 0x7f33641511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3364159200 con 0x7f336414fa70 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f335aa00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 0x7f33641511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f3363e00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f336406ba20 tx=0x7f335c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.422+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c00e040 con 0x7f336414fa70 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.423+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336415b060 con 0x7f336414fa70 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.423+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c00f040 con 0x7f336414fa70 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.423+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c003bd0 con 0x7f336414fa70 2024-09-13T18:48:00.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.423+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336415f450 con 0x7f336414fa70 2024-09-13T18:48:00.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.424+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336406e990 con 0x7f336414fa70 2024-09-13T18:48:00.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.424+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f335c003d30 con 0x7f336414fa70 2024-09-13T18:48:00.428 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.425+0000 7f335be00640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:00.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.425+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f335c089ca0 con 0x7f336414fa70 2024-09-13T18:48:00.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.426+0000 7f3363400640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:00.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.426+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=200}) v3 -- 0x7f3340072730 con 0x7f336414fa70 2024-09-13T18:48:00.429 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.426+0000 7f3363400640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3354009a60 tx=0x7f3354009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:00.432 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.430+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f335c054df0 con 0x7f336414fa70 2024-09-13T18:48:00.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.597+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f33640b09e0 con 0x7f336414fa70 2024-09-13T18:48:00.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.598+0000 7f335be00640 1 -- 172.21.15.192:0/1224528991 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v199) v1 ==== 81+0+34101 (secure 0 0 0) 0x7f335c023070 con 0x7f336414fa70 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 199, 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:47:51.888840+0000", 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:48:00.602 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:48:00.603 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:48:00.604 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:00.605 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:00.606 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:00.607 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:00.608 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.609 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:00.610 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:48:00.611 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:00.612 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:00.613 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:00.614 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:00.615 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:00.616 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:00.617 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:00.618 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.619 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.620 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1027, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool,full,full_quota", 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:00.621 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:48:00.622 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "199", 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:00.623 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:00.624 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:00.625 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:00.626 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.627 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.628 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.629 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.630 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.632 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.632 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.632 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.633 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.633 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:48:00.633 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.633 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.633 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.634 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.634 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:48:00.634 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.634 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.634 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.635 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.636 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.637 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.638 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.639 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.640 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.641 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.642 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.643 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.644 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:48:00.645 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.646 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.647 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.648 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:48:00.649 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.650 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.651 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.652 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.653 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.654 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.655 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.656 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.657 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:48:00.658 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.659 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.660 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.661 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:48:00.662 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:48:00.663 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.664 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:48:00.665 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.666 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.667 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.668 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:48:00.669 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.670 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.671 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.672 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:48:00.673 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:48:00.674 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.675 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.676 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.677 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.678 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.679 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.680 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.681 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.682 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.683 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.684 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.685 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.686 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.687 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:00.688 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:00.689 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:00.690 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:00.690 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:00.690 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:00.690 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:00.690 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.691 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.692 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.692 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.692 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:48:00.692 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.692 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.693 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.694 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:48:00.694 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.694 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.694 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.694 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.695 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.696 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.697 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.697 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.697 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:48:00.697 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.697 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.698 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:48:00.699 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:48:00.700 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.701 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.702 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.703 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:00.704 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.705 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.706 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.707 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:48:00.708 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:00.709 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:48:00.710 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.711 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:00.712 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.600+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 msgr2=0x7f334006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.600+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3354009a60 tx=0x7f3354009190 comp rx=0 tx=0).stop 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.600+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 msgr2=0x7f3364151710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.600+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f336406ba20 tx=0x7f335c00f580 comp rx=0 tx=0).stop 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 shutdown_connections 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f334006ac00 0x7f334006d0c0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f336414fa70 0x7f3364151710 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3364159550 0x7f33641511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 --2- 172.21.15.192:0/1224528991 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f33480047c0 0x7f336414f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 >> 172.21.15.192:0/1224528991 conn(0x7f33640736d0 msgr2=0x7f3364156a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 shutdown_connections 2024-09-13T18:48:00.715 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:00.601+0000 7f3369200640 1 -- 172.21.15.192:0/1224528991 wait complete. 2024-09-13T18:48:00.715 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2024-09-13T18:48:05.717 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:48:05.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.877+0000 7fd3dd400640 1 Processor -- start 2024-09-13T18:48:05.880 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.877+0000 7fd3dd400640 1 -- start start 2024-09-13T18:48:05.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3dd400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3d8071810 0x7fd3d80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3dd400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd3d80b2230 0x7fd3d80cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3dd400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3d8071dd0 con 0x7fd3d8150480 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3dd400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80cb770 con 0x7fd3d8071810 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3dd400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3d80cba50 con 0x7fd3d80b2230 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3d8071810 0x7fd3d80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3d8071810 0x7fd3d80b1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57322/0 (socket says 172.21.15.192:57322) 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 -- 172.21.15.192:0/164903093 learned_addr learned my addr 172.21.15.192:0/164903093 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:05.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3d7200640 1 --2- 172.21.15.192:0/164903093 >> v2:172.21.15.194:3300/0 conn(0x7fd3d80b2230 0x7fd3d80cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 -- 172.21.15.192:0/164903093 >> v2:172.21.15.194:3300/0 conn(0x7fd3d80b2230 msgr2=0x7fd3d80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 --2- 172.21.15.192:0/164903093 >> v2:172.21.15.194:3300/0 conn(0x7fd3d80b2230 0x7fd3d80cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 -- 172.21.15.192:0/164903093 >> v1:172.21.15.194:6789/0 conn(0x7fd3d8150480 legacy=0x7fd3d815a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.879+0000 7fd3cde00640 1 -- 172.21.15.192:0/164903093 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3d80cbd30 con 0x7fd3d8071810 2024-09-13T18:48:05.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.880+0000 7fd3cde00640 1 --2- 172.21.15.192:0/164903093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8071810 0x7fd3d80b1cf0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80b43e0 tx=0x7fd3c002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8d44518acf6a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3d5e00640 1 -- 172.21.15.192:0/164903093 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0032440 con 0x7fd3d8071810 2024-09-13T18:48:05.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3d5e00640 1 -- 172.21.15.192:0/164903093 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c00325a0 con 0x7fd3d8071810 2024-09-13T18:48:05.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3d5e00640 1 -- 172.21.15.192:0/164903093 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c0032930 con 0x7fd3d8071810 2024-09-13T18:48:05.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 -- 172.21.15.192:0/164903093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8071810 msgr2=0x7fd3d80b1cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 --2- 172.21.15.192:0/164903093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8071810 0x7fd3d80b1cf0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd3d80b43e0 tx=0x7fd3c002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 -- 172.21.15.192:0/164903093 shutdown_connections 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 --2- 172.21.15.192:0/164903093 >> v2:172.21.15.194:3300/0 conn(0x7fd3d80b2230 0x7fd3d80cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 --2- 172.21.15.192:0/164903093 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8071810 0x7fd3d80b1cf0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 -- 172.21.15.192:0/164903093 >> 172.21.15.192:0/164903093 conn(0x7fd3d80ae960 msgr2=0x7fd3d806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 -- 172.21.15.192:0/164903093 shutdown_connections 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.881+0000 7fd3dd400640 1 -- 172.21.15.192:0/164903093 wait complete. 2024-09-13T18:48:05.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.883+0000 7fd3dd400640 1 Processor -- start 2024-09-13T18:48:05.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.883+0000 7fd3dd400640 1 -- start start 2024-09-13T18:48:05.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 0x7fd3d8069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3d80b2230 0x7fd3d806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d814d8f0 con 0x7fd3d8150480 2024-09-13T18:48:05.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d814d5c0 con 0x7fd3d8071810 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3dd400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3d8149620 con 0x7fd3d80b2230 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3d7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3d7200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57330/0 (socket says 172.21.15.192:57330) 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.884+0000 7fd3d7200640 1 -- 172.21.15.192:0/2493592099 learned_addr learned my addr 172.21.15.192:0/2493592099 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3cde00640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3d80b2230 0x7fd3d806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d6800640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 0x7fd3d8069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 -- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3d80b2230 msgr2=0x7fd3d806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3d80b2230 0x7fd3d806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 -- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 msgr2=0x7fd3d8069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 0x7fd3d8069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 -- 172.21.15.192:0/2493592099 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c00094d0 con 0x7fd3d8150480 2024-09-13T18:48:05.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d6800640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 0x7fd3d8069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3d7200640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0007e30 tx=0x7fd3d000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d0014620 con 0x7fd3d8150480 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3d000ee90 con 0x7fd3d8150480 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3d8149900 con 0x7fd3d8150480 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.885+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3d00149c0 con 0x7fd3d8150480 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.886+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3d806c2f0 con 0x7fd3d8150480 2024-09-13T18:48:05.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.886+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3d814da60 con 0x7fd3d8150480 2024-09-13T18:48:05.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.887+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd3d0014b20 con 0x7fd3d8150480 2024-09-13T18:48:05.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.888+0000 7fd3cf400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 0x7fd3b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:05.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.888+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3d0089cd0 con 0x7fd3d8150480 2024-09-13T18:48:05.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.888+0000 7fd3d6800640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 0x7fd3b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:05.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.889+0000 7fd3d6800640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 0x7fd3b406d0c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd3d814f800 tx=0x7fd3c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:05.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:05.892+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd3d0054e10 con 0x7fd3d8150480 2024-09-13T18:48:06.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.062+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fd3d80b1cf0 con 0x7fd3d8150480 2024-09-13T18:48:06.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.064+0000 7fd3cf400640 1 -- 172.21.15.192:0/2493592099 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v200) v1 ==== 81+0+34082 (secure 0 0 0) 0x7fd3d0058430 con 0x7fd3d8150480 2024-09-13T18:48:06.067 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:06.067 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:06.067 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 200, 2024-09-13T18:48:06.067 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:48:01.891393+0000", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:48:06.068 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:48:06.069 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.070 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:48:06.071 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.072 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.073 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.074 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.075 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:48:06.076 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:48:06.077 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.078 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.079 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.080 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.081 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.082 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.083 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:48:06.084 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:48:06.085 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:48:06.086 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "200", 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.087 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.088 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.089 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.090 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.091 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.092 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:48:06.093 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.094 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:48:06.095 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:48:06.096 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.097 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.098 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.099 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.100 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.101 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.102 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.103 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.104 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.105 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.106 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.107 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.108 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.109 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.110 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.111 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.112 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.113 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.114 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.115 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.116 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.117 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.118 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.120 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.120 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.121 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.122 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.123 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.124 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.125 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.126 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.127 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.128 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:48:06.129 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.130 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:48:06.131 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.132 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.133 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.134 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.135 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.136 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.137 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.138 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.139 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.140 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.141 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.142 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:48:06.143 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.143 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:06.143 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.143 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.143 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.144 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.145 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:06.146 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.147 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:48:06.148 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:48:06.149 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.150 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.151 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 msgr2=0x7fd3b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 0x7fd3b406d0c0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fd3d814f800 tx=0x7fd3c8009040 comp rx=0 tx=0).stop 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 msgr2=0x7fd3d81485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd3d0007e30 tx=0x7fd3d000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 shutdown_connections 2024-09-13T18:48:06.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd3b406ac00 0x7fd3b406d0c0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3d8150480 0x7fd3d81485a0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd3d80b2230 0x7fd3d806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 --2- 172.21.15.192:0/2493592099 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3d8071810 0x7fd3d8069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 >> 172.21.15.192:0/2493592099 conn(0x7fd3d80ae960 msgr2=0x7fd3d80af350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 shutdown_connections 2024-09-13T18:48:06.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.066+0000 7fd3dd400640 1 -- 172.21.15.192:0/2493592099 wait complete. 2024-09-13T18:48:06.155 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2024-09-13T18:48:06.155 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2024-09-13T18:48:06.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.304+0000 7f2550800640 1 Processor -- start 2024-09-13T18:48:06.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.304+0000 7f2550800640 1 -- start start 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.305+0000 7f2550800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254815dee0 0x7f25480afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.305+0000 7f2550800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f254815e2c0 0x7f254815ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.305+0000 7f2550800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25480b2f00 con 0x7f25480b3f10 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.305+0000 7f2550800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25480b3150 con 0x7f254815e2c0 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.305+0000 7f2550800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25480b3430 con 0x7f254815dee0 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254d400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f25480b3f10 0x7f254815a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37624/0 (socket says 172.21.15.192:37624) 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254d400640 1 -- 172.21.15.192:0/3108015525 learned_addr learned my addr 172.21.15.192:0/3108015525 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254e800640 1 --2- 172.21.15.192:0/3108015525 >> v2:172.21.15.192:3300/0 conn(0x7f254815e2c0 0x7f254815ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254de00640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254815dee0 0x7f25480afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.309 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254ca00640 1 -- 172.21.15.192:0/3108015525 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029971045 0 0) 0x7f25480b2f00 con 0x7f25480b3f10 2024-09-13T18:48:06.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254ca00640 1 -- 172.21.15.192:0/3108015525 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2530003520 con 0x7f25480b3f10 2024-09-13T18:48:06.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254e800640 1 -- 172.21.15.192:0/3108015525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254815dee0 msgr2=0x7f25480afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:06.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254e800640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254815dee0 0x7f25480afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254e800640 1 -- 172.21.15.192:0/3108015525 >> v1:172.21.15.192:6789/0 conn(0x7f25480b3f10 legacy=0x7f254815a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.310 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.306+0000 7f254e800640 1 -- 172.21.15.192:0/3108015525 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480b3710 con 0x7f254815e2c0 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.307+0000 7f254e800640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254815ab50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2544009d90 tx=0x7f254402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f3fd4aeb26a7e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.307+0000 7f254ca00640 1 -- 172.21.15.192:0/3108015525 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544007740 con 0x7f254815e2c0 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.307+0000 7f254ca00640 1 -- 172.21.15.192:0/3108015525 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254402d050 con 0x7f254815e2c0 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.307+0000 7f254ca00640 1 -- 172.21.15.192:0/3108015525 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2544007ac0 con 0x7f254815e2c0 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 -- 172.21.15.192:0/3108015525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 msgr2=0x7f254815ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254815ab50 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f2544009d90 tx=0x7f254402a660 comp rx=0 tx=0).stop 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 -- 172.21.15.192:0/3108015525 shutdown_connections 2024-09-13T18:48:06.311 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254815ab50 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 --2- 172.21.15.192:0/3108015525 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254815dee0 0x7f25480afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 -- 172.21.15.192:0/3108015525 >> 172.21.15.192:0/3108015525 conn(0x7f25480ae960 msgr2=0x7f254806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 -- 172.21.15.192:0/3108015525 shutdown_connections 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.308+0000 7f2550800640 1 -- 172.21.15.192:0/3108015525 wait complete. 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.310+0000 7f2550800640 1 Processor -- start 2024-09-13T18:48:06.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.310+0000 7f2550800640 1 -- start start 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f254815dee0 0x7f254813a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254813d5a0 0x7f254806ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2548162ec0 con 0x7f254815e2c0 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25481631a0 con 0x7f254815dee0 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f2550800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2548163480 con 0x7f254813d5a0 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57356/0 (socket says 172.21.15.192:57356) 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 -- 172.21.15.192:0/2196549975 learned_addr learned my addr 172.21.15.192:0/2196549975 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254e800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254813d5a0 0x7f254806ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254de00640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f254815dee0 0x7f254813a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 -- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254813d5a0 msgr2=0x7f254806ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254813d5a0 0x7f254806ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.315 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 -- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f254815dee0 msgr2=0x7f254813a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f254815dee0 0x7f254813a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.311+0000 7f254d400640 1 -- 172.21.15.192:0/2196549975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544009a70 con 0x7f254815e2c0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f254d400640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f253800c500 tx=0x7f253800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538005ce0 con 0x7f254815e2c0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2538005e40 con 0x7f254815e2c0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2548163760 con 0x7f254815e2c0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2538007330 con 0x7f254815e2c0 2024-09-13T18:48:06.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.312+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f254813a7f0 con 0x7f254815e2c0 2024-09-13T18:48:06.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.313+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254815af00 con 0x7f254815e2c0 2024-09-13T18:48:06.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.314+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2538007550 con 0x7f254815e2c0 2024-09-13T18:48:06.317 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.315+0000 7f2542000640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 0x7f252c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.315+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2538088900 con 0x7f254815e2c0 2024-09-13T18:48:06.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.315+0000 7f254de00640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 0x7f252c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.318 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.316+0000 7f254de00640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 0x7f252c06d0c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f253c009b40 tx=0x7f253c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.324 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.319+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2538053c40 con 0x7f254815e2c0 2024-09-13T18:48:06.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.488+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2548163c80 con 0x7f254815e2c0 2024-09-13T18:48:06.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.489+0000 7f2542000640 1 -- 172.21.15.192:0/2196549975 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v200) v1 ==== 81+0+34082 (secure 0 0 0) 0x7f2538017020 con 0x7f254815e2c0 2024-09-13T18:48:06.492 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:06.492 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:06.492 INFO:teuthology.orchestra.run.smithi192.stdout: "epoch": 200, 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "created": "2024-09-13T18:35:21.980890+0000", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "modified": "2024-09-13T18:48:01.891393+0000", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "last_up_change": "2024-09-13T18:35:29.028602+0000", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "last_in_change": "2024-09-13T18:35:24.785692+0000", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_num": 5799936, 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_set": [ 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "pglog_hardlimit", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "purged_snapdirs", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_deletes", 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: "sortbitwise" 2024-09-13T18:48:06.493 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_version": 4, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "full_ratio": 0.69999998807907104, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "backfillfull_ratio": 0.60000002384185791, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "nearfull_ratio": 0.60000002384185791, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_snapshot": "", 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_max": 23, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "max_osd": 8, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "require_min_compat_client": "luminous", 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "min_compat_client": "jewel", 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "require_osd_release": "reef", 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "allow_crimson": false, 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: "pools": [ 2024-09-13T18:48:06.494 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 1, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": ".mgr", 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:35:28.785395+0000", 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.495 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 1, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 1, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 1, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 1, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 1, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.496 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "122", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:06.497 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.498 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.499 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_max": 32, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 1 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "mgr": {} 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 8, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 8, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 0.25, 2024-09-13T18:48:06.500 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 2, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 2, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 22, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_metadata", 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:34.465884+0000", 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.501 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 32, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 32, 2024-09-13T18:48:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 32, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 32, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 32, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "196", 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.503 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 0, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.504 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.505 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_bias": 4, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 16, 2024-09-13T18:48:06.506 INFO:teuthology.orchestra.run.smithi192.stdout: "recovery_priority": 5 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": "cephfs" 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.5, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.5, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.5, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.5, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.507 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "pool": 23, 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_name": "cephfs_data", 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "create_time": "2024-09-13T18:47:35.644556+0000", 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "flags": 1, 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "flags_names": "hashpspool", 2024-09-13T18:48:06.508 INFO:teuthology.orchestra.run.smithi192.stdout: "type": 1, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "size": 2, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "min_size": 1, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_rule": 0, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_count": 0, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_target": 0, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_barrier": 0, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "object_hash": 2, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_autoscale_mode": "off", 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num": 64, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num": 64, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_placement_num_target": 64, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_target": 64, 2024-09-13T18:48:06.509 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_pending": 64, 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_pg_merge_meta": { 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "source_pgid": "0.0", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "ready_epoch": 0, 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_started": 0, 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_epoch_clean": 0, 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "source_version": "0'0", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "target_version": "0'0" 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_change": "200", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend": "0", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "last_force_op_resend_preluminous": "0", 2024-09-13T18:48:06.510 INFO:teuthology.orchestra.run.smithi192.stdout: "auid": 0, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_mode": "selfmanaged", 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_seq": 0, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "snap_epoch": 0, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "pool_snaps": [], 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps": "[]", 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_bytes": 33554432, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "quota_max_objects": 0, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "tiers": [], 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "tier_of": -1, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "read_tier": -1, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "write_tier": -1, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_mode": "none", 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_bytes": 0, 2024-09-13T18:48:06.511 INFO:teuthology.orchestra.run.smithi192.stdout: "target_max_objects": 0, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_flush_age": 0, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "cache_min_evict_age": 0, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profile": "", 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_params": { 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "none" 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_period": 0, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_count": 0, 2024-09-13T18:48:06.512 INFO:teuthology.orchestra.run.smithi192.stdout: "use_gmt_hitset": true, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "min_read_recency_for_promote": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "min_write_recency_for_promote": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_grade_decay_rate": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "hit_set_search_last_n": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "grade_table": [], 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "stripe_width": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "expected_num_objects": 0, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "fast_read": false, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "options": { 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_num_min": 64, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "target_size_ratio": 0.89999997615814209 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.513 INFO:teuthology.orchestra.run.smithi192.stdout: "application_metadata": { 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "cephfs": { 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "data": "cephfs" 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "read_balance": { 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "score_acting": 1.3799999952316284, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "score_stable": 1.3799999952316284, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "optimal_score": 1, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_acting": 1.3799999952316284, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "raw_score_stable": 1.3799999952316284, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity_weighted": 1, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity": 1, 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: "average_primary_affinity_weighted": 1 2024-09-13T18:48:06.514 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "osds": [ 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.515 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6823", 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6825", 2024-09-13T18:48:06.516 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6826", 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6827", 2024-09-13T18:48:06.517 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6830", 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6831", 2024-09-13T18:48:06.518 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6828", 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.519 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6829", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4155920616 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6825/4155920616", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6827/4155920616", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6831/4155920616", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6829/4155920616", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.520 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.521 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6816", 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6817", 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.522 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6818", 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6819", 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.523 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6822", 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6824", 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.524 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6820", 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6821", 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4129826895 2024-09-13T18:48:06.525 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6817/4129826895", 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6819/4129826895", 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6824/4129826895", 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6821/4129826895", 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:06.526 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.527 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.527 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.527 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.528 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6808", 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.529 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6809", 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.530 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6810", 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6811", 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.531 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6814", 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6815", 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.532 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6812", 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6813", 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1589536644 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.533 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6809/1589536644", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6811/1589536644", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6815/1589536644", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6813/1589536644", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.534 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6800", 2024-09-13T18:48:06.535 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6801", 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.536 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6802", 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6803", 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.537 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6806", 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6807", 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.538 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6804", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.192:6805", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2116235987 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.192:6801/2116235987", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.192:6803/2116235987", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.192:6807/2116235987", 2024-09-13T18:48:06.539 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.192:6805/2116235987", 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.540 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6800", 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.541 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6801", 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6802", 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.542 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6803", 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6806", 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.543 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6807", 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6804", 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.544 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6805", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 2064160374 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6801/2064160374", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6803/2064160374", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6807/2064160374", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6805/2064160374", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.545 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 14, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.546 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6817", 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6819", 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.547 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6821", 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6823", 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.548 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6829", 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6831", 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.549 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6825", 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6827", 2024-09-13T18:48:06.550 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 1215883585 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6819/1215883585", 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6823/1215883585", 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6831/1215883585", 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6827/1215883585", 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.551 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.552 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6808", 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.553 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6809", 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6810", 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.554 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6811", 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6814", 2024-09-13T18:48:06.555 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6815", 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.556 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6812", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6813", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3931263301 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6809/3931263301", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6811/3931263301", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6815/3931263301", 2024-09-13T18:48:06.557 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6813/3931263301", 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "up": 1, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "in": 1, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "weight": 1, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_affinity": 1, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_begin": 0, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "last_clean_end": 0, 2024-09-13T18:48:06.558 INFO:teuthology.orchestra.run.smithi192.stdout: "up_from": 13, 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "up_thru": 195, 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "down_at": 0, 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "lost_at": 0, 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addrs": { 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6816", 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.559 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6818", 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addrs": { 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6820", 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.560 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6822", 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addrs": { 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6828", 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.561 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6830", 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addrs": { 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "addrvec": [ 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v2", 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6824", 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.562 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "172.21.15.194:6826", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 4082236586 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "public_addr": "172.21.15.194:6818/4082236586", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "cluster_addr": "172.21.15.194:6822/4082236586", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_back_addr": "172.21.15.194:6830/4082236586", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "heartbeat_front_addr": "172.21.15.194:6826/4082236586", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "state": [ 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "exists", 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: "up" 2024-09-13T18:48:06.563 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_xinfo": [ 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 0, 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.035279+0000", 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.564 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 1, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.081910+0000", 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 2, 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.565 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.052665+0000", 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 3, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.968428+0000", 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 4, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:25.948128+0000", 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.567 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 5, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.089221+0000", 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 6, 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.568 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.048828+0000", 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: { 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "osd": 7, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "down_stamp": "0.000000", 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_probability": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "laggy_interval": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "features": 4540138322906710015, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "old_weight": 0, 2024-09-13T18:48:06.569 INFO:teuthology.orchestra.run.smithi192.stdout: "last_purged_snaps_scrub": "2024-09-13T18:35:26.011073+0000", 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "dead_epoch": 0 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: ], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap": [], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_items": [], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_upmap_primaries": [], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "pg_temp": [], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "primary_temp": [], 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklist": {}, 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "range_blocklist": {}, 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "erasure_code_profiles": { 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "default": { 2024-09-13T18:48:06.570 INFO:teuthology.orchestra.run.smithi192.stdout: "crush-failure-domain": "osd", 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "k": "2", 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "m": "1", 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "plugin": "jerasure", 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "technique": "reed_sol_van" 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "removed_snaps_queue": [], 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "new_removed_snaps": [], 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "new_purged_snaps": [], 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "crush_node_flags": {}, 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "device_class_flags": {}, 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode": { 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_enabled": false, 2024-09-13T18:48:06.571 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_bucket_count": 0, 2024-09-13T18:48:06.572 INFO:teuthology.orchestra.run.smithi192.stdout: "degraded_stretch_mode": 0, 2024-09-13T18:48:06.572 INFO:teuthology.orchestra.run.smithi192.stdout: "recovering_stretch_mode": 0, 2024-09-13T18:48:06.572 INFO:teuthology.orchestra.run.smithi192.stdout: "stretch_mode_bucket": 0 2024-09-13T18:48:06.572 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-13T18:48:06.572 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 msgr2=0x7f252c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 0x7f252c06d0c0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f253c009b40 tx=0x7f253c009190 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 msgr2=0x7f254813d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f253800c500 tx=0x7f253800c9c0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 shutdown_connections 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f252c06ac00 0x7f252c06d0c0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f254813d5a0 0x7f254806ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f254815e2c0 0x7f254813d060 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 --2- 172.21.15.192:0/2196549975 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f254815dee0 0x7f254813a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 >> 172.21.15.192:0/2196549975 conn(0x7f25480ae960 msgr2=0x7f254813b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 shutdown_connections 2024-09-13T18:48:06.574 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.491+0000 7f2550800640 1 -- 172.21.15.192:0/2196549975 wait complete. 2024-09-13T18:48:06.575 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:06.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.725+0000 7f17ada00640 1 Processor -- start 2024-09-13T18:48:06.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.725+0000 7f17ada00640 1 -- start start 2024-09-13T18:48:06.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17ada00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17a80b0490 0x7f17a80cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17ada00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a815ec00 con 0x7f17a80cacd0 2024-09-13T18:48:06.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17ada00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a8140480 con 0x7f17a815e790 2024-09-13T18:48:06.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17ada00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a80cb5f0 con 0x7f17a80b0490 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17a7400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f17a80b0490 0x7f17a80cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.726+0000 7f17a6a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f17a80cacd0 0x7f17a8140980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37634/0 (socket says 172.21.15.192:37634) 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a6a00640 1 -- 172.21.15.192:0/2673967200 learned_addr learned my addr 172.21.15.192:0/2673967200 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a6000640 1 -- 172.21.15.192:0/2673967200 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1683069474 0 0) 0x7f17a815ec00 con 0x7f17a80cacd0 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a6000640 1 -- 172.21.15.192:0/2673967200 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178c003520 con 0x7f17a80cacd0 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a7400640 1 -- 172.21.15.192:0/2673967200 >> v1:172.21.15.194:6789/0 conn(0x7f17a815e790 legacy=0x7f17a80afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a7400640 1 -- 172.21.15.192:0/2673967200 >> v1:172.21.15.192:6789/0 conn(0x7f17a80cacd0 legacy=0x7f17a8140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.727+0000 7f17a7400640 1 -- 172.21.15.192:0/2673967200 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a815ee90 con 0x7f17a80b0490 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.728+0000 7f17a7400640 1 --2- 172.21.15.192:0/2673967200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a80b0490 0x7f17a80cb0b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=550778a5e6e72fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.728+0000 7f17a6000640 1 -- 172.21.15.192:0/2673967200 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0007740 con 0x7f17a80b0490 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.728+0000 7f17a6000640 1 -- 172.21.15.192:0/2673967200 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a002d050 con 0x7f17a80b0490 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.728+0000 7f17a6000640 1 -- 172.21.15.192:0/2673967200 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0007aa0 con 0x7f17a80b0490 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 -- 172.21.15.192:0/2673967200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a80b0490 msgr2=0x7f17a80cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 --2- 172.21.15.192:0/2673967200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a80b0490 0x7f17a80cb0b0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a002a6f0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 -- 172.21.15.192:0/2673967200 shutdown_connections 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 --2- 172.21.15.192:0/2673967200 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a80b0490 0x7f17a80cb0b0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 -- 172.21.15.192:0/2673967200 >> 172.21.15.192:0/2673967200 conn(0x7f17a80ae960 msgr2=0x7f17a806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 -- 172.21.15.192:0/2673967200 shutdown_connections 2024-09-13T18:48:06.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.729+0000 7f17ada00640 1 -- 172.21.15.192:0/2673967200 wait complete. 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.731+0000 7f17ada00640 1 Processor -- start 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.731+0000 7f17ada00640 1 -- start start 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17a80b0490 0x7f17a81f0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a80cacd0 0x7f17a806b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a806b7f0 con 0x7f17a815e790 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a806a210 con 0x7f17a80cacd0 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17ada00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a806a4f0 con 0x7f17a80b0490 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57360/0 (socket says 172.21.15.192:57360) 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 -- 172.21.15.192:0/3066896316 learned_addr learned my addr 172.21.15.192:0/3066896316 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a6a00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17a80b0490 0x7f17a81f0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f179fe00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a80cacd0 0x7f17a806b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 -- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17a80b0490 msgr2=0x7f17a81f0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17a80b0490 0x7f17a81f0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 -- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a80cacd0 msgr2=0x7f17a806b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a80cacd0 0x7f17a806b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.738 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.732+0000 7f17a7400640 1 -- 172.21.15.192:0/3066896316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0009a70 con 0x7f17a815e790 2024-09-13T18:48:06.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f17a7400640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0003b90 con 0x7f17a815e790 2024-09-13T18:48:06.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0003cf0 con 0x7f17a815e790 2024-09-13T18:48:06.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a003b900 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a806a7d0 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.733+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a806ad90 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.734+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a80cb0b0 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.735+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f17a003ba60 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.736+0000 7f179ea00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 0x7f178406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.736+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17a00aa270 con 0x7f17a815e790 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.736+0000 7f17a6a00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 0x7f178406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:06.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.737+0000 7f17a6a00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 0x7f178406d0c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f17980011e0 tx=0x7f1798009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:06.742 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.740+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f17a00753b0 con 0x7f17a815e790 2024-09-13T18:48:06.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.943+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17a813f460 con 0x7f17a815e790 2024-09-13T18:48:06.946 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.943+0000 7f179ea00640 1 -- 172.21.15.192:0/3066896316 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7f17a00789d0 con 0x7f17a815e790 2024-09-13T18:48:06.946 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:06.947 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:48:06.947 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:48:06.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.945+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 msgr2=0x7f178406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.945+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 0x7f178406d0c0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f17980011e0 tx=0x7f1798009040 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.945+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 msgr2=0x7f17a813d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.945+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009d90 tx=0x7f17a0004a40 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.945+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 shutdown_connections 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f178406ac00 0x7f178406d0c0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17a815e790 0x7f17a813d510 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f17a80cacd0 0x7f17a806b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 --2- 172.21.15.192:0/3066896316 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f17a80b0490 0x7f17a81f0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 >> 172.21.15.192:0/3066896316 conn(0x7f17a80ae960 msgr2=0x7f17a813fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 shutdown_connections 2024-09-13T18:48:06.949 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:06.946+0000 7f17ada00640 1 -- 172.21.15.192:0/3066896316 wait complete. 2024-09-13T18:48:06.964 DEBUG:teuthology.orchestra.run.smithi194:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2024-09-13T18:48:07.146 INFO:teuthology.orchestra.run.smithi194.stdout:{"cluster_fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","whoami":0,"id":9003,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":30.481900701000001,"mdsmap_epoch":85,"osdmap_epoch":200,"osdmap_epoch_barrier":199,"uptime":35.615388232000001} 2024-09-13T18:48:07.146 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "5e3ff1eb-2fb8-41d1-9304-859f6d9757cb", "fs_name": "cephfs", "id": 9003, "mdsmap_epoch": 85, "osdmap_epoch": 200, "osdmap_epoch_barrier": 199, "rank_uptime": 30.481900701, "state": "up:active", "uptime": 35.615388232, "want_state": "up:active", "whoami": 0 } 2024-09-13T18:48:07.147 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-13T18:48:07.147 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:07.147 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:07.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:07.183 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2024-09-13T18:48:07.606 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records in 2024-09-13T18:48:07.607 INFO:teuthology.orchestra.run.smithi192.stderr:50+0 records out 2024-09-13T18:48:07.607 INFO:teuthology.orchestra.run.smithi192.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.34705 s, 151 MB/s 2024-09-13T18:48:07.609 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-13T18:48:07.609 DEBUG:teuthology.orchestra.run.smithi192:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:48:07.699 DEBUG:teuthology.orchestra.run.smithi194:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-13T18:48:07.789 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-13T18:48:07.790 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:07.790 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:07.825 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:07.826 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:07.901 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:08.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.088+0000 7f9ccb200640 1 Processor -- start 2024-09-13T18:48:08.091 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.088+0000 7f9ccb200640 1 -- start start 2024-09-13T18:48:08.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9ccb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9cc40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9ccb200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40ae770 con 0x7f9cc4146610 2024-09-13T18:48:08.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9ccb200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc40cdb30 con 0x7f9cc40afd80 2024-09-13T18:48:08.092 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9ccb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40cd920 con 0x7f9cc40b2780 2024-09-13T18:48:08.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9cc3e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f9cc4146610 0x7f9cc40ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37646/0 (socket says 172.21.15.192:37646) 2024-09-13T18:48:08.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9cc3e00640 1 -- 172.21.15.192:0/939154358 learned_addr learned my addr 172.21.15.192:0/939154358 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:08.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9cc3400640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9cc40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 900426301 0 0) 0x7f9cc40ae770 con 0x7f9cc4146610 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.090+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca8003520 con 0x7f9cc4146610 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 792844301 0 0) 0x7f9ca8003520 con 0x7f9cc4146610 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 msgr2=0x7f9cc40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9cc40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 >> v1:172.21.15.194:6789/0 conn(0x7f9cc40afd80 legacy=0x7f9cc40b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40ae1b0 con 0x7f9cc4146610 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f9cb4001670 con 0x7f9cc4146610 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 >> v1:172.21.15.192:6789/0 conn(0x7f9cc4146610 legacy=0x7f9cc40ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9ca80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ca8003ee0 0x7f9ca80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8004d00 0x7f9ca8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.095 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40cd920 con 0x7f9ca8004d00 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca800b9e0 con 0x7f9ca8003ee0 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca800bba0 con 0x7f9cc40b2780 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc3e00640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9ca80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc9200640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8004d00 0x7f9ca8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.091+0000 7f9cc3400640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ca8003ee0 0x7f9ca80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc3400640 1 -- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 msgr2=0x7f9ca80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc3400640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc40b2780 0x7f9ca80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc3400640 1 -- 172.21.15.192:0/939154358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8004d00 msgr2=0x7f9ca8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc3400640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8004d00 0x7f9ca8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc3400640 1 -- 172.21.15.192:0/939154358 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca8003520 con 0x7f9ca8003ee0 2024-09-13T18:48:08.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.092+0000 7f9cc9200640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8004d00 0x7f9ca8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9cc3400640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ca8003ee0 0x7f9ca80047c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009a90 tx=0x7f9ca80057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8859423f16eacfe server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0031400 con 0x7f9ca8003ee0 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb002d050 con 0x7f9ca8003ee0 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9cc2a00640 1 -- 172.21.15.192:0/939154358 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0031780 con 0x7f9ca8003ee0 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9ccb200640 1 -- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ca8003ee0 msgr2=0x7f9ca80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9ccb200640 1 --2- 172.21.15.192:0/939154358 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9ca8003ee0 0x7f9ca80047c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009a90 tx=0x7f9ca80057f0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9cc9200640 1 -- 172.21.15.192:0/939154358 reap_dead start 2024-09-13T18:48:08.098 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9ccb200640 1 -- 172.21.15.192:0/939154358 shutdown_connections 2024-09-13T18:48:08.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9ccb200640 1 -- 172.21.15.192:0/939154358 >> 172.21.15.192:0/939154358 conn(0x7f9cc40ae960 msgr2=0x7f9cc406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.093+0000 7f9ccb200640 1 -- 172.21.15.192:0/939154358 shutdown_connections 2024-09-13T18:48:08.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.094+0000 7f9ccb200640 1 -- 172.21.15.192:0/939154358 wait complete. 2024-09-13T18:48:08.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.095+0000 7f9ccb200640 1 Processor -- start 2024-09-13T18:48:08.099 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.095+0000 7f9ccb200640 1 -- start start 2024-09-13T18:48:08.100 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cc41f3240 0x7f9cc406aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 0x7f9cc415f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4071020 con 0x7f9ca8003ee0 2024-09-13T18:48:08.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc41f3920 con 0x7f9cc41f3240 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9ccb200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc415f600 con 0x7f9cc415ec40 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9cc3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9cc3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57384/0 (socket says 172.21.15.192:57384) 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.096+0000 7f9cc3e00640 1 -- 172.21.15.192:0/1527733529 learned_addr learned my addr 172.21.15.192:0/1527733529 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3400640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cc41f3240 0x7f9cc406aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc9200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 0x7f9cc415f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 -- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 msgr2=0x7f9cc415f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 0x7f9cc415f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 -- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cc41f3240 msgr2=0x7f9cc406aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cc41f3240 0x7f9cc406aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 -- 172.21.15.192:0/1527733529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc406af40 con 0x7f9ca8003ee0 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc9200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 0x7f9cc415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:08.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cc3e00640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001b60 tx=0x7f9cb4007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400f960 con 0x7f9ca8003ee0 2024-09-13T18:48:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb400fb00 con 0x7f9ca8003ee0 2024-09-13T18:48:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400feb0 con 0x7f9ca8003ee0 2024-09-13T18:48:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc40704a0 con 0x7f9ca8003ee0 2024-09-13T18:48:08.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.097+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc4070a60 con 0x7f9ca8003ee0 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.098+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc40b01b0 con 0x7f9ca8003ee0 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.099+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9cb401d460 con 0x7f9ca8003ee0 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.100+0000 7f9cbbe00640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 0x7f9ca406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.100+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cb40892c0 con 0x7f9ca8003ee0 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.100+0000 7f9cc3400640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 0x7f9ca406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.104 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.101+0000 7f9cc3400640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 0x7f9ca406d0c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0033000 tx=0x7f9cb0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.104+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9cb4054490 con 0x7f9ca8003ee0 2024-09-13T18:48:08.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.279+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cc406af40 con 0x7f9ca8003ee0 2024-09-13T18:48:08.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.280+0000 7f9cbbe00640 1 -- 172.21.15.192:0/1527733529 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+16647 (secure 0 0 0) 0x7f9cc406af40 con 0x7f9ca8003ee0 2024-09-13T18:48:08.283 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:08.283 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":200,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:01.891393+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 msgr2=0x7f9ca406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 0x7f9ca406d0c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0033000 tx=0x7f9cb0008030 comp rx=0 tx=0).stop 2024-09-13T18:48:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 msgr2=0x7f9cc406fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4001b60 tx=0x7f9cb4007720 comp rx=0 tx=0).stop 2024-09-13T18:48:08.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 shutdown_connections 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f9ca406ac00 0x7f9ca406d0c0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9cc415ec40 0x7f9cc415f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9cc41f3240 0x7f9cc406aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 --2- 172.21.15.192:0/1527733529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ca8003ee0 0x7f9cc406fe10 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 >> 172.21.15.192:0/1527733529 conn(0x7f9cc40ae960 msgr2=0x7f9cc40b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 shutdown_connections 2024-09-13T18:48:08.286 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.282+0000 7f9ccb200640 1 -- 172.21.15.192:0/1527733529 wait complete. 2024-09-13T18:48:08.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:34.465884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:35.644556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '200', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:48:08.302 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 Processor -- start 2024-09-13T18:48:08.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 -- start start 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f708c15a910 0x7f708c0b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f708c160ac0 0x7f708c160f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f708c0b2b40 con 0x7f708c0ad840 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0b21e0 con 0x7f708c15a910 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7093e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f708c0b1bf0 con 0x7f708c160ac0 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.456+0000 7f7091400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f708c15a910 0x7f708c0b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f708c15a910 0x7f708c0b2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57388/0 (socket says 172.21.15.192:57388) 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 -- 172.21.15.192:0/3002402321 learned_addr learned my addr 172.21.15.192:0/3002402321 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:08.461 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091e00640 1 --1- 172.21.15.192:0/3002402321 >> v1:172.21.15.192:6789/0 conn(0x7f708c0ad840 0x7f708c0cc760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37654/0 (socket says 172.21.15.192:37654) 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7090a00640 1 --2- 172.21.15.192:0/3002402321 >> v2:172.21.15.194:3300/0 conn(0x7f708c160ac0 0x7f708c160f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 -- 172.21.15.192:0/3002402321 >> v2:172.21.15.194:3300/0 conn(0x7f708c160ac0 msgr2=0x7f708c160f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 --2- 172.21.15.192:0/3002402321 >> v2:172.21.15.194:3300/0 conn(0x7f708c160ac0 0x7f708c160f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 -- 172.21.15.192:0/3002402321 >> v1:172.21.15.192:6789/0 conn(0x7f708c0ad840 legacy=0x7f708c0cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f7091400640 1 -- 172.21.15.192:0/3002402321 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c161510 con 0x7f708c15a910 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.457+0000 7f708be00640 1 -- 172.21.15.192:0/3002402321 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714991396 0 0) 0x7f708c0b2b40 con 0x7f708c0ad840 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.458+0000 7f7091400640 1 --2- 172.21.15.192:0/3002402321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0b2600 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f708c0ce530 tx=0x7f708002a1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f46e77c532be8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.458+0000 7f708be00640 1 -- 172.21.15.192:0/3002402321 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080032440 con 0x7f708c15a910 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.458+0000 7f708be00640 1 -- 172.21.15.192:0/3002402321 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70800325a0 con 0x7f708c15a910 2024-09-13T18:48:08.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.458+0000 7f708be00640 1 -- 172.21.15.192:0/3002402321 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080032930 con 0x7f708c15a910 2024-09-13T18:48:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 -- 172.21.15.192:0/3002402321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 msgr2=0x7f708c0b2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 --2- 172.21.15.192:0/3002402321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0b2600 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f708c0ce530 tx=0x7f708002a1f0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 -- 172.21.15.192:0/3002402321 shutdown_connections 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 --2- 172.21.15.192:0/3002402321 >> v2:172.21.15.194:3300/0 conn(0x7f708c160ac0 0x7f708c160f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 --2- 172.21.15.192:0/3002402321 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0b2600 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 -- 172.21.15.192:0/3002402321 >> 172.21.15.192:0/3002402321 conn(0x7f708c0b08f0 msgr2=0x7f708c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 -- 172.21.15.192:0/3002402321 shutdown_connections 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.459+0000 7f7093e00640 1 -- 172.21.15.192:0/3002402321 wait complete. 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.461+0000 7f7093e00640 1 Processor -- start 2024-09-13T18:48:08.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.461+0000 7f7093e00640 1 -- start start 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708c0ad840 0x7f708c158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708c160ac0 0x7f708c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c158950 con 0x7f708c15a910 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0c4580 con 0x7f708c0ad840 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7093e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f708c0c4860 con 0x7f708c160ac0 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57398/0 (socket says 172.21.15.192:57398) 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 -- 172.21.15.192:0/1159310603 learned_addr learned my addr 172.21.15.192:0/1159310603 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:08.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7091400640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708c0ad840 0x7f708c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7091e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708c160ac0 0x7f708c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 -- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708c160ac0 msgr2=0x7f708c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708c160ac0 0x7f708c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 -- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708c0ad840 msgr2=0x7f708c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708c0ad840 0x7f708c158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 -- 172.21.15.192:0/1159310603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70800094d0 con 0x7f708c15a910 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.462+0000 7f7090a00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f707800e9b0 tx=0x7f707800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.463+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7078009670 con 0x7f708c15a910 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.463+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f707800c9a0 con 0x7f708c15a910 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.463+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f707800cd50 con 0x7f708c15a910 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.463+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f708c0c4b40 con 0x7f708c15a910 2024-09-13T18:48:08.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.463+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f708c06f610 con 0x7f708c15a910 2024-09-13T18:48:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.464+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f708c15acf0 con 0x7f708c15a910 2024-09-13T18:48:08.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.465+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7078013470 con 0x7f708c15a910 2024-09-13T18:48:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.466+0000 7f7089600640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.466+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7078089500 con 0x7f708c15a910 2024-09-13T18:48:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.466+0000 7f7091400640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.469 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.466+0000 7f7091400640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 0x7f706c06d0c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7080034000 tx=0x7f708002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.470+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7078054780 con 0x7f708c15a910 2024-09-13T18:48:08.638 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.636+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f708c0c40a0 con 0x7f708c15a910 2024-09-13T18:48:08.639 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.636+0000 7f7089600640 1 -- 172.21.15.192:0/1159310603 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v200) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7078057da0 con 0x7f708c15a910 2024-09-13T18:48:08.639 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:48:08.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 msgr2=0x7f706c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.641 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 0x7f706c06d0c0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7080034000 tx=0x7f708002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 msgr2=0x7f708c0c3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f707800e9b0 tx=0x7f707800ee70 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 shutdown_connections 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f706c06ac00 0x7f706c06d0c0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f708c160ac0 0x7f708c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f708c15a910 0x7f708c0c3b60 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 --2- 172.21.15.192:0/1159310603 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f708c0ad840 0x7f708c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 >> 172.21.15.192:0/1159310603 conn(0x7f708c0b08f0 msgr2=0x7f708c0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.638+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 shutdown_connections 2024-09-13T18:48:08.642 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.639+0000 7f7093e00640 1 -- 172.21.15.192:0/1159310603 wait complete. 2024-09-13T18:48:08.657 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:08.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.812+0000 7f40c1600640 1 Processor -- start 2024-09-13T18:48:08.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.812+0000 7f40c1600640 1 -- start start 2024-09-13T18:48:08.816 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40c1600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40c1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0b3470 0x7f40bc0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40c1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40bc15a8e0 con 0x7f40bc0cb330 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40c1600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40bc0b2fe0 con 0x7f40bc0cdf60 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40c1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc0b26b0 con 0x7f40bc0b3470 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40ba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40ba000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57400/0 (socket says 172.21.15.192:57400) 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40ba000640 1 -- 172.21.15.192:0/2724894858 learned_addr learned my addr 172.21.15.192:0/2724894858 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.813+0000 7f40baa00640 1 --1- 172.21.15.192:0/2724894858 >> v1:172.21.15.194:6789/0 conn(0x7f40bc0cb330 0x7f40bc06ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:52418/0 (socket says 172.21.15.192:52418) 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.814+0000 7f40bb400640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0b3470 0x7f40bc0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.814+0000 7f40ba000640 1 -- 172.21.15.192:0/2724894858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0b3470 msgr2=0x7f40bc0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.814+0000 7f40ba000640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0b3470 0x7f40bc0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.814+0000 7f40ba000640 1 -- 172.21.15.192:0/2724894858 >> v1:172.21.15.194:6789/0 conn(0x7f40bc0cb330 legacy=0x7f40bc06ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.814+0000 7f40ba000640 1 -- 172.21.15.192:0/2724894858 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40bc0b2990 con 0x7f40bc0cdf60 2024-09-13T18:48:08.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.815+0000 7f40ba000640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009870 tx=0x7f40a802a130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d187a466fd7cce server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.815+0000 7f40b9600640 1 -- 172.21.15.192:0/2724894858 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a802ae80 con 0x7f40bc0cdf60 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.815+0000 7f40b9600640 1 -- 172.21.15.192:0/2724894858 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8032440 con 0x7f40bc0cdf60 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.815+0000 7f40b9600640 1 -- 172.21.15.192:0/2724894858 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80327b0 con 0x7f40bc0cdf60 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 -- 172.21.15.192:0/2724894858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 msgr2=0x7f40bc0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009870 tx=0x7f40a802a130 comp rx=0 tx=0).stop 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 -- 172.21.15.192:0/2724894858 shutdown_connections 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0b3470 0x7f40bc0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 --2- 172.21.15.192:0/2724894858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc0ce3f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 -- 172.21.15.192:0/2724894858 >> 172.21.15.192:0/2724894858 conn(0x7f40bc0b08f0 msgr2=0x7f40bc0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 -- 172.21.15.192:0/2724894858 shutdown_connections 2024-09-13T18:48:08.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.816+0000 7f40c1600640 1 -- 172.21.15.192:0/2724894858 wait complete. 2024-09-13T18:48:08.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.817+0000 7f40c1600640 1 Processor -- start 2024-09-13T18:48:08.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 -- start start 2024-09-13T18:48:08.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 0x7f40bc15b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0cb330 0x7f40bc1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15c040 con 0x7f40bc0cdf60 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc154ee0 con 0x7f40bc0b3470 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.818+0000 7f40c1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40bc15ba80 con 0x7f40bc0cb330 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40baa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 0x7f40bc15b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40ba000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0cb330 0x7f40bc1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40baa00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 0x7f40bc15b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3300/0 says I am v2:172.21.15.192:41964/0 (socket says 172.21.15.192:41964) 2024-09-13T18:48:08.822 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40baa00640 1 -- 172.21.15.192:0/3897727434 learned_addr learned my addr 172.21.15.192:0/3897727434 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 -- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0cb330 msgr2=0x7f40bc1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0cb330 0x7f40bc1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 -- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 msgr2=0x7f40bc15b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 0x7f40bc15b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 -- 172.21.15.192:0/3897727434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a80094d0 con 0x7f40bc0cdf60 2024-09-13T18:48:08.823 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.819+0000 7f40bb400640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc15ac70 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eba0 tx=0x7f40b400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.820+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b400cd20 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.820+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b400f040 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.820+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40bc15bd60 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.820+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b40146c0 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.820+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40bc154480 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.821+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40bc154000 con 0x7f40bc0cdf60 2024-09-13T18:48:08.824 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.822+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f40b4014820 con 0x7f40bc0cdf60 2024-09-13T18:48:08.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.823+0000 7f40b2a00640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 0x7f409c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:08.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.823+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40b4089f90 con 0x7f40bc0cdf60 2024-09-13T18:48:08.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.823+0000 7f40baa00640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 0x7f409c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:08.826 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.824+0000 7f40baa00640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 0x7f409c06d0f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000f60 tx=0x7f40ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:08.830 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.827+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f40b40bd9c0 con 0x7f40bc0cdf60 2024-09-13T18:48:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.995+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40bc154670 con 0x7f40bc0cdf60 2024-09-13T18:48:08.998 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.995+0000 7f40b2a00640 1 -- 172.21.15.192:0/3897727434 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v200) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40b4018020 con 0x7f40bc0cdf60 2024-09-13T18:48:08.998 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.997+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 msgr2=0x7f409c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.997+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 0x7f409c06d0f0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f40ac000f60 tx=0x7f40ac009040 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.997+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 msgr2=0x7f40bc15ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.997+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc15ac70 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f40b400eba0 tx=0x7f40b400c490 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.997+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 shutdown_connections 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f409c06ac30 0x7f409c06d0f0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f40bc0cdf60 0x7f40bc15ac70 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f40bc0cb330 0x7f40bc1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 --2- 172.21.15.192:0/3897727434 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f40bc0b3470 0x7f40bc15b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 >> 172.21.15.192:0/3897727434 conn(0x7f40bc0b08f0 msgr2=0x7f40bc0b0cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.001 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 shutdown_connections 2024-09-13T18:48:09.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:08.998+0000 7f40c1600640 1 -- 172.21.15.192:0/3897727434 wait complete. 2024-09-13T18:48:09.017 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:09.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:09.164 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:09.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.170+0000 7f1f98800640 1 Processor -- start 2024-09-13T18:48:09.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.170+0000 7f1f98800640 1 -- start start 2024-09-13T18:48:09.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f98800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f901589f0 0x7f1f900b2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f98800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f1f900b3af0 0x7f1f9015b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f98800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f900b2000 con 0x7f1f9006c0b0 2024-09-13T18:48:09.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f98800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9015bbd0 con 0x7f1f901589f0 2024-09-13T18:48:09.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f98800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9015beb0 con 0x7f1f900b3af0 2024-09-13T18:48:09.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f95e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f901589f0 0x7f1f900b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f95e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f1f901589f0 0x7f1f900b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57414/0 (socket says 172.21.15.192:57414) 2024-09-13T18:48:09.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.171+0000 7f1f95e00640 1 -- 172.21.15.192:0/1913306409 learned_addr learned my addr 172.21.15.192:0/1913306409 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:09.175 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f95400640 1 --2- 172.21.15.192:0/1913306409 >> v2:172.21.15.194:3300/0 conn(0x7f1f900b3af0 0x7f1f9015b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f95e00640 1 -- 172.21.15.192:0/1913306409 >> v2:172.21.15.194:3300/0 conn(0x7f1f900b3af0 msgr2=0x7f1f9015b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f95e00640 1 --2- 172.21.15.192:0/1913306409 >> v2:172.21.15.194:3300/0 conn(0x7f1f900b3af0 0x7f1f9015b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f95e00640 1 -- 172.21.15.192:0/1913306409 >> v1:172.21.15.192:6789/0 conn(0x7f1f9006c0b0 legacy=0x7f1f900cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f95e00640 1 -- 172.21.15.192:0/1913306409 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9015c190 con 0x7f1f901589f0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.172+0000 7f1f94a00640 1 -- 172.21.15.192:0/1913306409 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15573206 0 0) 0x7f1f900b2000 con 0x7f1f9006c0b0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.173+0000 7f1f95e00640 1 --2- 172.21.15.192:0/1913306409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f901589f0 0x7f1f900b2490 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f1f9006edf0 tx=0x7f1f8402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1ab2f7474f22d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.173+0000 7f1f94a00640 1 -- 172.21.15.192:0/1913306409 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84032440 con 0x7f1f901589f0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.173+0000 7f1f94a00640 1 -- 172.21.15.192:0/1913306409 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f840325a0 con 0x7f1f901589f0 2024-09-13T18:48:09.176 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.173+0000 7f1f94a00640 1 -- 172.21.15.192:0/1913306409 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84032930 con 0x7f1f901589f0 2024-09-13T18:48:09.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 -- 172.21.15.192:0/1913306409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f901589f0 msgr2=0x7f1f900b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 --2- 172.21.15.192:0/1913306409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f901589f0 0x7f1f900b2490 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f1f9006edf0 tx=0x7f1f8402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 -- 172.21.15.192:0/1913306409 shutdown_connections 2024-09-13T18:48:09.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 --2- 172.21.15.192:0/1913306409 >> v2:172.21.15.194:3300/0 conn(0x7f1f900b3af0 0x7f1f9015b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.177 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 --2- 172.21.15.192:0/1913306409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f901589f0 0x7f1f900b2490 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 -- 172.21.15.192:0/1913306409 >> 172.21.15.192:0/1913306409 conn(0x7f1f900b08f0 msgr2=0x7f1f900b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 -- 172.21.15.192:0/1913306409 shutdown_connections 2024-09-13T18:48:09.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.174+0000 7f1f98800640 1 -- 172.21.15.192:0/1913306409 wait complete. 2024-09-13T18:48:09.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.176+0000 7f1f98800640 1 Processor -- start 2024-09-13T18:48:09.178 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.176+0000 7f1f98800640 1 -- start start 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f9006c0b0 0x7f1f9014dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f901589f0 0x7f1f90151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f90157340 con 0x7f1f900b3af0 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f901f6d20 con 0x7f1f901589f0 2024-09-13T18:48:09.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f98800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f9014e6c0 con 0x7f1f9006c0b0 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57422/0 (socket says 172.21.15.192:57422) 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 -- 172.21.15.192:0/1834851659 learned_addr learned my addr 172.21.15.192:0/1834851659 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f96800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f901589f0 0x7f1f90151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95e00640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f9006c0b0 0x7f1f9014dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 -- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f9006c0b0 msgr2=0x7f1f9014dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f9006c0b0 0x7f1f9014dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 -- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f901589f0 msgr2=0x7f1f90151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f901589f0 0x7f1f90151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.177+0000 7f1f95400640 1 -- 172.21.15.192:0/1834851659 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840094d0 con 0x7f1f900b3af0 2024-09-13T18:48:09.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f95400640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e9b0 tx=0x7f1f8000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80009670 con 0x7f1f900b3af0 2024-09-13T18:48:09.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000c9a0 con 0x7f1f900b3af0 2024-09-13T18:48:09.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000cd50 con 0x7f1f900b3af0 2024-09-13T18:48:09.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f901566c0 con 0x7f1f900b3af0 2024-09-13T18:48:09.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.178+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f90156c80 con 0x7f1f900b3af0 2024-09-13T18:48:09.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.179+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9015b260 con 0x7f1f900b3af0 2024-09-13T18:48:09.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.180+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1f80013470 con 0x7f1f900b3af0 2024-09-13T18:48:09.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.181+0000 7f1f8a000640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 0x7f1f7406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.181+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f800898b0 con 0x7f1f900b3af0 2024-09-13T18:48:09.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.181+0000 7f1f95e00640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 0x7f1f7406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.182+0000 7f1f95e00640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 0x7f1f7406d0c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1f84034000 tx=0x7f1f8402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.186+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f1f80054b30 con 0x7f1f900b3af0 2024-09-13T18:48:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.361+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1f900cb8f0 con 0x7f1f900b3af0 2024-09-13T18:48:09.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.361+0000 7f1f8a000640 1 -- 172.21.15.192:0/1834851659 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v200) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1f800170a0 con 0x7f1f900b3af0 2024-09-13T18:48:09.364 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:48:09.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.364+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 msgr2=0x7f1f7406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.364+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 0x7f1f7406d0c0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f1f84034000 tx=0x7f1f8402e000 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 msgr2=0x7f1f901f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000e9b0 tx=0x7f1f8000ee70 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 shutdown_connections 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f1f7406ac00 0x7f1f7406d0c0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f1f901589f0 0x7f1f90151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1f900b3af0 0x7f1f901f67e0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 --2- 172.21.15.192:0/1834851659 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f1f9006c0b0 0x7f1f9014dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 >> 172.21.15.192:0/1834851659 conn(0x7f1f900b08f0 msgr2=0x7f1f900cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 shutdown_connections 2024-09-13T18:48:09.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.365+0000 7f1f98800640 1 -- 172.21.15.192:0/1834851659 wait complete. 2024-09-13T18:48:09.382 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:09.537 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.536+0000 7fc246200640 1 Processor -- start 2024-09-13T18:48:09.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.536+0000 7fc246200640 1 -- start start 2024-09-13T18:48:09.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc246200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc2401467a0 0x7fc2400cf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc246200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 0x7fc2400b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc246200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2400b5ec0 con 0x7fc2400b6680 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc246200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc240146b80 con 0x7fc2401467a0 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc246200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2400cfe40 con 0x7fc2400b5530 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc244e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc2401467a0 0x7fc2400cf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc23fe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc2400b6680 0x7fc2400aeca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37678/0 (socket says 172.21.15.192:37678) 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.537+0000 7fc23fe00640 1 -- 172.21.15.192:0/1297375695 learned_addr learned my addr 172.21.15.192:0/1297375695 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc245800640 1 --2- 172.21.15.192:0/1297375695 >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 0x7fc2400b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc244e00640 1 -- 172.21.15.192:0/1297375695 >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 msgr2=0x7fc2400b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc244e00640 1 --2- 172.21.15.192:0/1297375695 >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 0x7fc2400b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc244e00640 1 -- 172.21.15.192:0/1297375695 >> v1:172.21.15.192:6789/0 conn(0x7fc2400b6680 legacy=0x7fc2400aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc23f400640 1 -- 172.21.15.192:0/1297375695 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3988427308 0 0) 0x7fc22c001110 con 0x7fc2400b6680 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc244e00640 1 -- 172.21.15.192:0/1297375695 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400ad840 con 0x7fc2401467a0 2024-09-13T18:48:09.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.538+0000 7fc245800640 1 --2- 172.21.15.192:0/1297375695 >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 0x7fc2400b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:09.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc244e00640 1 --2- 172.21.15.192:0/1297375695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc2400cf900 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b3da0 tx=0x7fc23402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747cb0d77a8b2486 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc23f400640 1 -- 172.21.15.192:0/1297375695 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23402ae60 con 0x7fc2401467a0 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc23f400640 1 -- 172.21.15.192:0/1297375695 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc234032440 con 0x7fc2401467a0 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc23f400640 1 -- 172.21.15.192:0/1297375695 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2340327d0 con 0x7fc2401467a0 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc246200640 1 -- 172.21.15.192:0/1297375695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 msgr2=0x7fc2400cf900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.539+0000 7fc246200640 1 --2- 172.21.15.192:0/1297375695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc2400cf900 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b3da0 tx=0x7fc23402a110 comp rx=0 tx=0).stop 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 -- 172.21.15.192:0/1297375695 shutdown_connections 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 --2- 172.21.15.192:0/1297375695 >> v2:172.21.15.194:3300/0 conn(0x7fc2400b5530 0x7fc2400b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 --2- 172.21.15.192:0/1297375695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc2400cf900 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 -- 172.21.15.192:0/1297375695 >> 172.21.15.192:0/1297375695 conn(0x7fc240071a20 msgr2=0x7fc2400b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 -- 172.21.15.192:0/1297375695 shutdown_connections 2024-09-13T18:48:09.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.540+0000 7fc246200640 1 -- 172.21.15.192:0/1297375695 wait complete. 2024-09-13T18:48:09.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.541+0000 7fc246200640 1 Processor -- start 2024-09-13T18:48:09.543 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.541+0000 7fc246200640 1 -- start start 2024-09-13T18:48:09.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b5530 0x7fc240069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b6680 0x7fc24014e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24014d110 con 0x7fc2401467a0 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc24006a3e0 con 0x7fc2400b6680 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc246200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2401403b0 con 0x7fc2400b5530 2024-09-13T18:48:09.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.542+0000 7fc245800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57450/0 (socket says 172.21.15.192:57450) 2024-09-13T18:48:09.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 -- 172.21.15.192:0/1062678485 learned_addr learned my addr 172.21.15.192:0/1062678485 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc23fe00640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b6680 0x7fc24014e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc244e00640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b5530 0x7fc240069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 -- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b5530 msgr2=0x7fc240069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b5530 0x7fc240069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 -- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b6680 msgr2=0x7fc24014e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b6680 0x7fc24014e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 -- 172.21.15.192:0/1062678485 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234009400 con 0x7fc2401467a0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc245800640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc23800cd80 tx=0x7fc23800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800f680 con 0x7fc2401467a0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.543+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23800f800 con 0x7fc2401467a0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.544+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc24015ca90 con 0x7fc2401467a0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.544+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23800fbb0 con 0x7fc2401467a0 2024-09-13T18:48:09.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.544+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc24014cac0 con 0x7fc2401467a0 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.545+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc240067490 con 0x7fc2401467a0 2024-09-13T18:48:09.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.546+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fc23800b040 con 0x7fc2401467a0 2024-09-13T18:48:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.547+0000 7fc23cc00640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 0x7fc22006d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.547+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc238089c20 con 0x7fc2401467a0 2024-09-13T18:48:09.553 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.547+0000 7fc244e00640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 0x7fc22006d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.548+0000 7fc244e00640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 0x7fc22006d0f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc234034000 tx=0x7fc23402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:09.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.551+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fc238054e10 con 0x7fc2401467a0 2024-09-13T18:48:09.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.729+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc24014d2c0 con 0x7fc2401467a0 2024-09-13T18:48:09.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.730+0000 7fc23cc00640 1 -- 172.21.15.192:0/1062678485 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v200) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc24014d2c0 con 0x7fc2401467a0 2024-09-13T18:48:09.732 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:48:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 msgr2=0x7fc22006d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 0x7fc22006d0f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fc234034000 tx=0x7fc23402e000 comp rx=0 tx=0).stop 2024-09-13T18:48:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 msgr2=0x7fc24014d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:09.735 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc23800cd80 tx=0x7fc23800a650 comp rx=0 tx=0).stop 2024-09-13T18:48:09.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 shutdown_connections 2024-09-13T18:48:09.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fc22006ac30 0x7fc22006d0f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc2401467a0 0x7fc24014d5a0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc2400b6680 0x7fc24014e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 --2- 172.21.15.192:0/1062678485 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc2400b5530 0x7fc240069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 >> 172.21.15.192:0/1062678485 conn(0x7fc240071a20 msgr2=0x7fc240143700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 shutdown_connections 2024-09-13T18:48:09.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:09.732+0000 7fc246200640 1 -- 172.21.15.192:0/1062678485 wait complete. 2024-09-13T18:48:09.749 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T18:48:09.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:09.749 DEBUG:teuthology.orchestra.run.smithi192:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T18:48:09.855 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:09.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:09.855 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T18:48:09.892 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:48:09.892 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:09.930 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:48:09.930 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:10.010 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.164+0000 7f20ade00640 1 Processor -- start 2024-09-13T18:48:10.166 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.164+0000 7f20ade00640 1 -- start start 2024-09-13T18:48:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ade00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.170 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ade00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a806f830 con 0x7f20a806bca0 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ade00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a806fa80 con 0x7f20a81592d0 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ade00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8071230 con 0x7f20a80b3600 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ad400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f20a806bca0 0x7f20a806c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:37694/0 (socket says 172.21.15.192:37694) 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20ad400640 1 -- 172.21.15.192:0/1586413755 learned_addr learned my addr 172.21.15.192:0/1586413755 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.165+0000 7f20a7e00640 1 --2- 172.21.15.192:0/1586413755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.171 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 264559803 0 0) 0x7f20a806f830 con 0x7f20a806bca0 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f208c003520 con 0x7f20a806bca0 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3480528963 0 0) 0x7f20a806fa80 con 0x7f20a81592d0 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7e00640 1 -- 172.21.15.192:0/1586413755 >> v1:172.21.15.194:6789/0 conn(0x7f20a81592d0 legacy=0x7f20a8070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7e00640 1 -- 172.21.15.192:0/1586413755 >> v1:172.21.15.192:6789/0 conn(0x7f20a806bca0 legacy=0x7f20a806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.166+0000 7f20a7e00640 1 -- 172.21.15.192:0/1586413755 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a806fd60 con 0x7f20a80b3600 2024-09-13T18:48:10.172 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.167+0000 7f20a7e00640 1 --2- 172.21.15.192:0/1586413755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80b3a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f209400a970 tx=0x7f209402b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8829e7f4ce02bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.167+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094032600 con 0x7f20a80b3600 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.167+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209402e050 con 0x7f20a80b3600 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.167+0000 7f20a7400640 1 -- 172.21.15.192:0/1586413755 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2094032980 con 0x7f20a80b3600 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 -- 172.21.15.192:0/1586413755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 msgr2=0x7f20a80b3a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 --2- 172.21.15.192:0/1586413755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80b3a70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f209400a970 tx=0x7f209402b5d0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.173 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 -- 172.21.15.192:0/1586413755 shutdown_connections 2024-09-13T18:48:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 --2- 172.21.15.192:0/1586413755 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80b3a70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 -- 172.21.15.192:0/1586413755 >> 172.21.15.192:0/1586413755 conn(0x7f20a80736d0 msgr2=0x7f20a80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 -- 172.21.15.192:0/1586413755 shutdown_connections 2024-09-13T18:48:10.174 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.168+0000 7f20ade00640 1 -- 172.21.15.192:0/1586413755 wait complete. 2024-09-13T18:48:10.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.170+0000 7f20ade00640 1 Processor -- start 2024-09-13T18:48:10.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.170+0000 7f20ade00640 1 -- start start 2024-09-13T18:48:10.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.179 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20a81592d0 0x7f20a80cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a81f68f0 con 0x7f20a806bca0 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a8156320 con 0x7f20a81592d0 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ade00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a813e760 con 0x7f20a80b3600 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57456/0 (socket says 172.21.15.192:57456) 2024-09-13T18:48:10.180 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 -- 172.21.15.192:0/2826826104 learned_addr learned my addr 172.21.15.192:0/2826826104 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20ad400640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20a81592d0 0x7f20a80cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20a7e00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 -- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 msgr2=0x7f20a80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.181 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 -- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20a81592d0 msgr2=0x7f20a80cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20a81592d0 0x7f20a80cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.171+0000 7f20aca00640 1 -- 172.21.15.192:0/2826826104 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209400a5a0 con 0x7f20a806bca0 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20aca00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f209800c7f0 tx=0x7f209800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098003da0 con 0x7f20a806bca0 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2098005070 con 0x7f20a806bca0 2024-09-13T18:48:10.182 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a813ea40 con 0x7f20a806bca0 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2098005400 con 0x7f20a806bca0 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.172+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a813f000 con 0x7f20a806bca0 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.173+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a8156160 con 0x7f20a806bca0 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.174+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2098005560 con 0x7f20a806bca0 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.175+0000 7f20a4c00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 0x7f208806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.175+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2098088b50 con 0x7f20a806bca0 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.175+0000 7f20a7e00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 0x7f208806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.175+0000 7f20a7e00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 0x7f208806d0c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2094035000 tx=0x7f2094030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.184 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.179+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f20a8156160 con 0x7f20a806bca0 2024-09-13T18:48:10.347 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.345+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20a8156160 con 0x7f20a806bca0 2024-09-13T18:48:10.348 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.346+0000 7f20a4c00640 1 -- 172.21.15.192:0/2826826104 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+16647 (secure 0 0 0) 0x7f20a8156160 con 0x7f20a806bca0 2024-09-13T18:48:10.348 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:10.349 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":200,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:01.891393+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:10.350 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.348+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 msgr2=0x7f208806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.348+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 0x7f208806d0c0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2094035000 tx=0x7f2094030000 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.348+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 msgr2=0x7f20a81f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.348+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f209800c7f0 tx=0x7f209800ccb0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 shutdown_connections 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f208806ac00 0x7f208806d0c0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f20a81592d0 0x7f20a80cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f20a80b3600 0x7f20a80cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 --2- 172.21.15.192:0/2826826104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f20a806bca0 0x7f20a81f63b0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 >> 172.21.15.192:0/2826826104 conn(0x7f20a80736d0 msgr2=0x7f20a806ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 shutdown_connections 2024-09-13T18:48:10.351 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.349+0000 7f20ade00640 1 -- 172.21.15.192:0/2826826104 wait complete. 2024-09-13T18:48:10.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:34.465884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:35.644556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '200', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:48:10.367 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.521+0000 7f05a3e00640 1 Processor -- start 2024-09-13T18:48:10.523 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.521+0000 7f05a3e00640 1 -- start start 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.522+0000 7f05a3e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f059c06c800 0x7f059c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.522+0000 7f05a3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c06e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.522+0000 7f05a3e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f059c06cc70 con 0x7f059c1434c0 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.522+0000 7f05a3e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f059c0b4060 con 0x7f059c06c800 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.522+0000 7f05a3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c0ce770 con 0x7f059c0b3bd0 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f059c06c800 0x7f059c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f059c06c800 0x7f059c0b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56782/0 (socket says 172.21.15.192:56782) 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 -- 172.21.15.192:0/3928125388 learned_addr learned my addr 172.21.15.192:0/3928125388 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a1e00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c06e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 -- 172.21.15.192:0/3928125388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 msgr2=0x7f059c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:10.525 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c06e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 -- 172.21.15.192:0/3928125388 >> v1:172.21.15.194:6789/0 conn(0x7f059c1434c0 legacy=0x7f059c06a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.526 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.523+0000 7f05a0a00640 1 -- 172.21.15.192:0/3928125388 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c06b480 con 0x7f059c06c800 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.524+0000 7f05a0a00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c06c800 0x7f059c0b3690 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f058800bb40 tx=0x7f058802c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6ba9fc6b1b881af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.524+0000 7f059be00640 1 -- 172.21.15.192:0/3928125388 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588032820 con 0x7f059c06c800 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.524+0000 7f059be00640 1 -- 172.21.15.192:0/3928125388 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f058802e040 con 0x7f059c06c800 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.524+0000 7f059be00640 1 -- 172.21.15.192:0/3928125388 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588032ba0 con 0x7f059c06c800 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 -- 172.21.15.192:0/3928125388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c06c800 msgr2=0x7f059c0b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c06c800 0x7f059c0b3690 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f058800bb40 tx=0x7f058802c960 comp rx=0 tx=0).stop 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 -- 172.21.15.192:0/3928125388 shutdown_connections 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c06e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3928125388 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c06c800 0x7f059c0b3690 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.527 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 -- 172.21.15.192:0/3928125388 >> 172.21.15.192:0/3928125388 conn(0x7f059c0b08f0 msgr2=0x7f059c0b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 -- 172.21.15.192:0/3928125388 shutdown_connections 2024-09-13T18:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.525+0000 7f05a3e00640 1 -- 172.21.15.192:0/3928125388 wait complete. 2024-09-13T18:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.527+0000 7f05a3e00640 1 Processor -- start 2024-09-13T18:48:10.528 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.527+0000 7f05a3e00640 1 -- start start 2024-09-13T18:48:10.529 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f059c06c800 0x7f059c155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c13e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c155950 con 0x7f059c1434c0 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059c13f210 con 0x7f059c06c800 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f059c06e9c0 con 0x7f059c0b3bd0 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56794/0 (socket says 172.21.15.192:56794) 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 -- 172.21.15.192:0/3100954963 learned_addr learned my addr 172.21.15.192:0/3100954963 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a0a00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c13e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.530 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1400640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f059c06c800 0x7f059c155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 -- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 msgr2=0x7f059c13e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.531 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c13e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 -- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f059c06c800 msgr2=0x7f059c155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f059c06c800 0x7f059c155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.528+0000 7f05a1e00640 1 -- 172.21.15.192:0/3100954963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058800b770 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f05a1e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f059400efc0 tx=0x7f059400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594014480 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f059400f040 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594014820 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f059c06eca0 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.529+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059c06f260 con 0x7f059c1434c0 2024-09-13T18:48:10.532 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.530+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f059c06c2e0 con 0x7f059c1434c0 2024-09-13T18:48:10.533 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.531+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0594014980 con 0x7f059c1434c0 2024-09-13T18:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.532+0000 7f0599600640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 0x7f057c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.532+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0594089d20 con 0x7f059c1434c0 2024-09-13T18:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.532+0000 7f05a1400640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 0x7f057c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.534 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.533+0000 7f05a1400640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 0x7f057c06d0c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0590000f60 tx=0x7f0590009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.536+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0594055040 con 0x7f059c1434c0 2024-09-13T18:48:10.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.706+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f059c0cd0f0 con 0x7f059c1434c0 2024-09-13T18:48:10.708 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.706+0000 7f0599600640 1 -- 172.21.15.192:0/3100954963 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v200) v1 ==== 93+0+10 (secure 0 0 0) 0x7f05940180a0 con 0x7f059c1434c0 2024-09-13T18:48:10.708 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:48:10.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 msgr2=0x7f057c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 0x7f057c06d0c0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0590000f60 tx=0x7f0590009040 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 msgr2=0x7f059c0704e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f059400efc0 tx=0x7f059400c490 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 shutdown_connections 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f057c06ac00 0x7f057c06d0c0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f059c1434c0 0x7f059c0704e0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f059c0b3bd0 0x7f059c13e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.708+0000 7f05a3e00640 1 --2- 172.21.15.192:0/3100954963 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f059c06c800 0x7f059c155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.709+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 >> 172.21.15.192:0/3100954963 conn(0x7f059c0b08f0 msgr2=0x7f059c15ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.709+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 shutdown_connections 2024-09-13T18:48:10.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.709+0000 7f05a3e00640 1 -- 172.21.15.192:0/3100954963 wait complete. 2024-09-13T18:48:10.726 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:10.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.879+0000 7fbe3f200640 1 Processor -- start 2024-09-13T18:48:10.881 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.879+0000 7fbe3f200640 1 -- start start 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbe381465a0 0x7fbe380712b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe380d0710 0x7fbe380717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe381608d0 0x7fbe38160d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe38161830 con 0x7fbe380d0710 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe380d0280 con 0x7fbe381465a0 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe380cf9b0 con 0x7fbe381608d0 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe380d0710 0x7fbe380717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.882 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3d400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fbe380d0710 0x7fbe380717f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56802/0 (socket says 172.21.15.192:56802) 2024-09-13T18:48:10.883 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.880+0000 7fbe3d400640 1 -- 172.21.15.192:0/2988611909 learned_addr learned my addr 172.21.15.192:0/2988611909 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3de00640 1 --2- 172.21.15.192:0/2988611909 >> v2:172.21.15.194:3300/0 conn(0x7fbe381465a0 0x7fbe380712b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3e800640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe381608d0 0x7fbe38160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3d400640 1 -- 172.21.15.192:0/2988611909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe381608d0 msgr2=0x7fbe38160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3d400640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe381608d0 0x7fbe38160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3d400640 1 -- 172.21.15.192:0/2988611909 >> v2:172.21.15.194:3300/0 conn(0x7fbe381465a0 msgr2=0x7fbe380712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3d400640 1 --2- 172.21.15.192:0/2988611909 >> v2:172.21.15.194:3300/0 conn(0x7fbe381465a0 0x7fbe380712b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.881+0000 7fbe3d400640 1 -- 172.21.15.192:0/2988611909 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe38161550 con 0x7fbe380d0710 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.882+0000 7fbe3d400640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380d0710 0x7fbe380717f0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fbe380b3b00 tx=0x7fbe2802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36d07aea8764fc5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.882+0000 7fbe3ca00640 1 -- 172.21.15.192:0/2988611909 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28032440 con 0x7fbe380d0710 2024-09-13T18:48:10.884 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.882+0000 7fbe3ca00640 1 -- 172.21.15.192:0/2988611909 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe280325a0 con 0x7fbe380d0710 2024-09-13T18:48:10.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.882+0000 7fbe3ca00640 1 -- 172.21.15.192:0/2988611909 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28032930 con 0x7fbe380d0710 2024-09-13T18:48:10.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 -- 172.21.15.192:0/2988611909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380d0710 msgr2=0x7fbe380717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.885 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380d0710 0x7fbe380717f0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fbe380b3b00 tx=0x7fbe2802a1e0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 -- 172.21.15.192:0/2988611909 shutdown_connections 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe381608d0 0x7fbe38160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 --2- 172.21.15.192:0/2988611909 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe380d0710 0x7fbe380717f0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 --2- 172.21.15.192:0/2988611909 >> v2:172.21.15.194:3300/0 conn(0x7fbe381465a0 0x7fbe380712b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 -- 172.21.15.192:0/2988611909 >> 172.21.15.192:0/2988611909 conn(0x7fbe380b30b0 msgr2=0x7fbe38070ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 -- 172.21.15.192:0/2988611909 shutdown_connections 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.883+0000 7fbe3f200640 1 -- 172.21.15.192:0/2988611909 wait complete. 2024-09-13T18:48:10.886 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.884+0000 7fbe3f200640 1 Processor -- start 2024-09-13T18:48:10.887 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 -- start start 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe380d0710 0x7fbe3815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe381608d0 0x7fbe381566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3812e2d0 con 0x7fbe381465a0 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3812eb70 con 0x7fbe381608d0 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.885+0000 7fbe3f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe38158ed0 con 0x7fbe380d0710 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.888 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56806/0 (socket says 172.21.15.192:56806) 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 -- 172.21.15.192:0/1942716111 learned_addr learned my addr 172.21.15.192:0/1942716111 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3de00640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe380d0710 0x7fbe3815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3e800640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe381608d0 0x7fbe381566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 -- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe380d0710 msgr2=0x7fbe3815be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe380d0710 0x7fbe3815be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 -- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe381608d0 msgr2=0x7fbe381566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe381608d0 0x7fbe381566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 -- 172.21.15.192:0/1942716111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe280094d0 con 0x7fbe381465a0 2024-09-13T18:48:10.889 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.886+0000 7fbe3d400640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c00 tx=0x7fbe280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.887+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe28032440 con 0x7fbe381465a0 2024-09-13T18:48:10.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.887+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe28030ba0 con 0x7fbe381465a0 2024-09-13T18:48:10.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.887+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe2803d440 con 0x7fbe381465a0 2024-09-13T18:48:10.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.887+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe381588e0 con 0x7fbe381465a0 2024-09-13T18:48:10.890 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.887+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3812e800 con 0x7fbe381465a0 2024-09-13T18:48:10.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.888+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38160d10 con 0x7fbe381465a0 2024-09-13T18:48:10.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.889+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe28039040 con 0x7fbe381465a0 2024-09-13T18:48:10.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.889+0000 7fbe32000640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 0x7fbe1c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:10.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.890+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe280a9cc0 con 0x7fbe381465a0 2024-09-13T18:48:10.891 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.890+0000 7fbe3de00640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 0x7fbe1c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:10.892 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.890+0000 7fbe3de00640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 0x7fbe1c06d0c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c006fd0 tx=0x7fbe2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:10.895 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:10.894+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe28074f50 con 0x7fbe381465a0 2024-09-13T18:48:11.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.064+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbe380ae180 con 0x7fbe381465a0 2024-09-13T18:48:11.066 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.064+0000 7fbe32000640 1 -- 172.21.15.192:0/1942716111 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v200) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbe280410a0 con 0x7fbe381465a0 2024-09-13T18:48:11.067 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:48:11.068 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.066+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 msgr2=0x7fbe1c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.066+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 0x7fbe1c06d0c0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c006fd0 tx=0x7fbe2c008040 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.066+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 msgr2=0x7fbe381561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.066+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7fbe28000c00 tx=0x7fbe280046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 shutdown_connections 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe1c06ac00 0x7fbe1c06d0c0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbe381608d0 0x7fbe381566f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbe381465a0 0x7fbe381561b0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 --2- 172.21.15.192:0/1942716111 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbe380d0710 0x7fbe3815be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 >> 172.21.15.192:0/1942716111 conn(0x7fbe380b30b0 msgr2=0x7fbe3815fc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 shutdown_connections 2024-09-13T18:48:11.069 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.067+0000 7fbe3f200640 1 -- 172.21.15.192:0/1942716111 wait complete. 2024-09-13T18:48:11.084 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:11.239 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.238+0000 7f4268e00640 1 Processor -- start 2024-09-13T18:48:11.240 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.238+0000 7f4268e00640 1 -- start start 2024-09-13T18:48:11.247 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42641402c0 0x7f426415e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f426415b810 0x7f426415bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f42640b0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640b05b0 con 0x7f42641402c0 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426415b070 con 0x7f426415b810 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4268e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f426415eba0 con 0x7f42640afbe0 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4263400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42641402c0 0x7f426415e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4263400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f42641402c0 0x7f426415e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56814/0 (socket says 172.21.15.192:56814) 2024-09-13T18:48:11.248 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4263400640 1 -- 172.21.15.192:0/3687033539 learned_addr learned my addr 172.21.15.192:0/3687033539 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4263e00640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f42640b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.239+0000 7f4262a00640 1 --2- 172.21.15.192:0/3687033539 >> v2:172.21.15.194:3300/0 conn(0x7f426415b810 0x7f426415bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.240+0000 7f4263400640 1 -- 172.21.15.192:0/3687033539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 msgr2=0x7f42640b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.240+0000 7f4263400640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f42640b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.240+0000 7f4263400640 1 -- 172.21.15.192:0/3687033539 >> v2:172.21.15.194:3300/0 conn(0x7f426415b810 msgr2=0x7f426415bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.240+0000 7f4263400640 1 --2- 172.21.15.192:0/3687033539 >> v2:172.21.15.194:3300/0 conn(0x7f426415b810 0x7f426415bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.240+0000 7f4263400640 1 -- 172.21.15.192:0/3687033539 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426415ee20 con 0x7f42641402c0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4263400640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42641402c0 0x7f426415e660 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f42640b4a30 tx=0x7f425402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7578c3a14105f1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4262000640 1 -- 172.21.15.192:0/3687033539 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254032440 con 0x7f42641402c0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4262000640 1 -- 172.21.15.192:0/3687033539 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42540325a0 con 0x7f42641402c0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4262000640 1 -- 172.21.15.192:0/3687033539 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4254032930 con 0x7f42641402c0 2024-09-13T18:48:11.249 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4268e00640 1 -- 172.21.15.192:0/3687033539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42641402c0 msgr2=0x7f426415e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.241+0000 7f4268e00640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42641402c0 0x7f426415e660 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f42640b4a30 tx=0x7f425402a1e0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 -- 172.21.15.192:0/3687033539 shutdown_connections 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f42640b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 --2- 172.21.15.192:0/3687033539 >> v2:172.21.15.194:3300/0 conn(0x7f426415b810 0x7f426415bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 --2- 172.21.15.192:0/3687033539 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42641402c0 0x7f426415e660 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 -- 172.21.15.192:0/3687033539 >> 172.21.15.192:0/3687033539 conn(0x7f42640ae7f0 msgr2=0x7f426406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 -- 172.21.15.192:0/3687033539 shutdown_connections 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.242+0000 7f4268e00640 1 -- 172.21.15.192:0/3687033539 wait complete. 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.243+0000 7f4268e00640 1 Processor -- start 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.243+0000 7f4268e00640 1 -- start start 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f4264143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42641402c0 0x7f426413a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.250 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640cc9b0 con 0x7f426415b810 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42641439c0 con 0x7f42641402c0 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4268e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4264070f70 con 0x7f42640afbe0 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4263e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4263e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56830/0 (socket says 172.21.15.192:56830) 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.244+0000 7f4263e00640 1 -- 172.21.15.192:0/632869427 learned_addr learned my addr 172.21.15.192:0/632869427 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4262a00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42641402c0 0x7f426413a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263400640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f4264143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 -- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 msgr2=0x7f4264143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f4264143480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 -- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42641402c0 msgr2=0x7f426413a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42641402c0 0x7f426413a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 -- 172.21.15.192:0/632869427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540094d0 con 0x7f426415b810 2024-09-13T18:48:11.251 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f4263e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f425c007e90 tx=0x7f425c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c014420 con 0x7f426415b810 2024-09-13T18:48:11.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.245+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c014580 con 0x7f426415b810 2024-09-13T18:48:11.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.246+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c014930 con 0x7f426415b810 2024-09-13T18:48:11.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.246+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4264143030 con 0x7f426415b810 2024-09-13T18:48:11.252 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.246+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640cc360 con 0x7f426415b810 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.247+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42640ccb60 con 0x7f426415b810 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.248+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f425c014a90 con 0x7f426415b810 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.249+0000 7f425b400640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 0x7f424406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.249+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f425c089b90 con 0x7f426415b810 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.249+0000 7f4263400640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 0x7f424406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.253 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.250+0000 7f4263400640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 0x7f424406d0c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4254034000 tx=0x7f425402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.253+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f42640ccb60 con 0x7f426415b810 2024-09-13T18:48:11.423 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.422+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42640ccb60 con 0x7f426415b810 2024-09-13T18:48:11.424 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.422+0000 7f425b400640 1 -- 172.21.15.192:0/632869427 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v200) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42640ccb60 con 0x7f426415b810 2024-09-13T18:48:11.424 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:48:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 msgr2=0x7f424406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 0x7f424406d0c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4254034000 tx=0x7f425402e000 comp rx=0 tx=0).stop 2024-09-13T18:48:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 msgr2=0x7f42640cce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f425c007e90 tx=0x7f425c00e4b0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 shutdown_connections 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f424406ac00 0x7f424406d0c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f426415b810 0x7f42640cce40 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f42641402c0 0x7f426413a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 --2- 172.21.15.192:0/632869427 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f42640afbe0 0x7f4264143480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 >> 172.21.15.192:0/632869427 conn(0x7f42640ae7f0 msgr2=0x7f426406f520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.424+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 shutdown_connections 2024-09-13T18:48:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.425+0000 7f4268e00640 1 -- 172.21.15.192:0/632869427 wait complete. 2024-09-13T18:48:11.443 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-13T18:48:11.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.592+0000 7f7be7e00640 1 Processor -- start 2024-09-13T18:48:11.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.593+0000 7f7be7e00640 1 -- start start 2024-09-13T18:48:11.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be81598d0 0x7f7be80b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.599 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7be80cd5b0 0x7f7be80cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be7e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80cdf30 con 0x7f7be806b180 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be7e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be806bcf0 con 0x7f7be80cd5b0 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be806bf10 con 0x7f7be81598d0 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7bde000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7be80cd5b0 0x7f7be80cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7bde000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f7be80cd5b0 0x7f7be80cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56836/0 (socket says 172.21.15.192:56836) 2024-09-13T18:48:11.600 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7bde000640 1 -- 172.21.15.192:0/2312190669 learned_addr learned my addr 172.21.15.192:0/2312190669 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:11.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.594+0000 7f7be6a00640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be81598d0 0x7f7be80b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.595+0000 7f7bde000640 1 -- 172.21.15.192:0/2312190669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be81598d0 msgr2=0x7f7be80b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:11.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.595+0000 7f7bde000640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be81598d0 0x7f7be80b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.595+0000 7f7bde000640 1 -- 172.21.15.192:0/2312190669 >> v1:172.21.15.192:6789/0 conn(0x7f7be806b180 legacy=0x7f7be806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.601 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.595+0000 7f7bde000640 1 -- 172.21.15.192:0/2312190669 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be80b2e10 con 0x7f7be80cd5b0 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7bde000640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be80cd5b0 0x7f7be80cd9f0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000bb10 tx=0x7f7bd002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161f8f1e8b5c52a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be6000640 1 -- 172.21.15.192:0/2312190669 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0032820 con 0x7f7be80cd5b0 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be6000640 1 -- 172.21.15.192:0/2312190669 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd002e040 con 0x7f7be80cd5b0 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be6000640 1 -- 172.21.15.192:0/2312190669 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd0032ba0 con 0x7f7be80cd5b0 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 -- 172.21.15.192:0/2312190669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be80cd5b0 msgr2=0x7f7be80cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.602 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be80cd5b0 0x7f7be80cd9f0 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000bb10 tx=0x7f7bd002c920 comp rx=0 tx=0).stop 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 -- 172.21.15.192:0/2312190669 shutdown_connections 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be80cd5b0 0x7f7be80cd9f0 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 --2- 172.21.15.192:0/2312190669 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be81598d0 0x7f7be80b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.596+0000 7f7be7e00640 1 -- 172.21.15.192:0/2312190669 >> 172.21.15.192:0/2312190669 conn(0x7f7be80736d0 msgr2=0x7f7be80b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.597+0000 7f7be7e00640 1 -- 172.21.15.192:0/2312190669 shutdown_connections 2024-09-13T18:48:11.603 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.597+0000 7f7be7e00640 1 -- 172.21.15.192:0/2312190669 wait complete. 2024-09-13T18:48:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.598+0000 7f7be7e00640 1 Processor -- start 2024-09-13T18:48:11.608 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.598+0000 7f7be7e00640 1 -- start start 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be80cd5b0 0x7f7be8143550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be81598d0 0x7f7be815c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be815b5d0 con 0x7f7be806b180 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8143a90 con 0x7f7be81598d0 2024-09-13T18:48:11.609 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.599+0000 7f7be7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7be815b7c0 con 0x7f7be80cd5b0 2024-09-13T18:48:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56838/0 (socket says 172.21.15.192:56838) 2024-09-13T18:48:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 -- 172.21.15.192:0/4015882916 learned_addr learned my addr 172.21.15.192:0/4015882916 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7bde000640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be80cd5b0 0x7f7be8143550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.610 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be7400640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be81598d0 0x7f7be815c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 -- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be80cd5b0 msgr2=0x7f7be8143550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be80cd5b0 0x7f7be8143550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 -- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be81598d0 msgr2=0x7f7be815c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be81598d0 0x7f7be815c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 -- 172.21.15.192:0/4015882916 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd000b770 con 0x7f7be806b180 2024-09-13T18:48:11.611 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.600+0000 7f7be6a00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800d800 tx=0x7f7bd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.601+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800b6c0 con 0x7f7be806b180 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.601+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800b820 con 0x7f7be806b180 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.601+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800bbb0 con 0x7f7be806b180 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.601+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be815baa0 con 0x7f7be806b180 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.601+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be815c060 con 0x7f7be806b180 2024-09-13T18:48:11.612 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.602+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be8159d40 con 0x7f7be806b180 2024-09-13T18:48:11.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.603+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7bd800bd10 con 0x7f7be806b180 2024-09-13T18:48:11.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.604+0000 7f7bdf400640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 0x7f7bc406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:11.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.604+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7bd8089700 con 0x7f7be806b180 2024-09-13T18:48:11.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.604+0000 7f7bde000640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 0x7f7bc406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:11.613 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.605+0000 7f7bde000640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 0x7f7bc406d0c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0037000 tx=0x7f7bd0032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:11.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.608+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7bd8054a20 con 0x7f7be806b180 2024-09-13T18:48:11.789 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.787+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7be80cd390 con 0x7f7be806b180 2024-09-13T18:48:11.790 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.788+0000 7f7bdf400640 1 -- 172.21.15.192:0/4015882916 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v200) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7bd8058040 con 0x7f7be806b180 2024-09-13T18:48:11.790 INFO:teuthology.orchestra.run.smithi192.stderr:listed 0 entries 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 msgr2=0x7f7bc406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 0x7f7bc406d0c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0037000 tx=0x7f7bd0032000 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 msgr2=0x7f7be815b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7f7bd800d800 tx=0x7f7bd800dcc0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 shutdown_connections 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7bc406ac00 0x7f7bc406d0c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7be81598d0 0x7f7be815c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7be80cd5b0 0x7f7be8143550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 --2- 172.21.15.192:0/4015882916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7be806b180 0x7f7be815b090 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:11.792 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 >> 172.21.15.192:0/4015882916 conn(0x7f7be80736d0 msgr2=0x7f7be806a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:11.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 shutdown_connections 2024-09-13T18:48:11.793 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:11.790+0000 7f7be7e00640 1 -- 172.21.15.192:0/4015882916 wait complete. 2024-09-13T18:48:11.808 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T18:48:11.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:11.808 DEBUG:teuthology.orchestra.run.smithi194:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T18:48:11.877 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:11.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:11.877 DEBUG:teuthology.orchestra.run.smithi194:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T18:48:11.917 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:11.917 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:11.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:48:11.954 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:48:11.954 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:11.992 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:48:11.992 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:12.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.145+0000 7f6dd6800640 1 Processor -- start 2024-09-13T18:48:12.147 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.145+0000 7f6dd6800640 1 -- start start 2024-09-13T18:48:12.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.146+0000 7f6dd6800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f6dd00cacd0 0x7f6dd015e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.146+0000 7f6dd6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 0x7f6dd015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.146+0000 7f6dd6800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd0140480 con 0x7f6dd0140980 2024-09-13T18:48:12.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.146+0000 7f6dd6800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd015c160 con 0x7f6dd00cacd0 2024-09-13T18:48:12.148 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.146+0000 7f6dd6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd015ee90 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 0x7f6dd015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.149 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dcfe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7f6dd0140980 0x7f6dd00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:54956/0 (socket says 172.21.15.192:54956) 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dcfe00640 1 -- 172.21.15.192:0/30300323 learned_addr learned my addr 172.21.15.192:0/30300323 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dcf400640 1 --2- 172.21.15.192:0/30300323 >> v2:172.21.15.194:3300/0 conn(0x7f6dd00cacd0 0x7f6dd015e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dcea00640 1 -- 172.21.15.192:0/30300323 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455247581 0 0) 0x7f6dd0140480 con 0x7f6dd0140980 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dc6a00640 1 -- 172.21.15.192:0/30300323 >> v2:172.21.15.194:3300/0 conn(0x7f6dd00cacd0 msgr2=0x7f6dd015e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.147+0000 7f6dc6a00640 1 --2- 172.21.15.192:0/30300323 >> v2:172.21.15.194:3300/0 conn(0x7f6dd00cacd0 0x7f6dd015e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.148+0000 7f6dc6a00640 1 -- 172.21.15.192:0/30300323 >> v1:172.21.15.194:6789/0 conn(0x7f6dd0140980 legacy=0x7f6dd00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.150 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.148+0000 7f6dc6a00640 1 -- 172.21.15.192:0/30300323 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd015f170 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dc6a00640 1 --2- 172.21.15.192:0/30300323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 0x7f6dd015bc20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6db80097a0 tx=0x7f6db802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfd59e8443e071c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dcea00640 1 -- 172.21.15.192:0/30300323 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8032440 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dcea00640 1 -- 172.21.15.192:0/30300323 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db80325a0 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dcea00640 1 -- 172.21.15.192:0/30300323 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8032930 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.151 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 -- 172.21.15.192:0/30300323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 msgr2=0x7f6dd015bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 --2- 172.21.15.192:0/30300323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 0x7f6dd015bc20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6db80097a0 tx=0x7f6db802a180 comp rx=0 tx=0).stop 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 -- 172.21.15.192:0/30300323 shutdown_connections 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 --2- 172.21.15.192:0/30300323 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cb0b0 0x7f6dd015bc20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 --2- 172.21.15.192:0/30300323 >> v2:172.21.15.194:3300/0 conn(0x7f6dd00cacd0 0x7f6dd015e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 -- 172.21.15.192:0/30300323 >> 172.21.15.192:0/30300323 conn(0x7f6dd00ae960 msgr2=0x7f6dd006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 -- 172.21.15.192:0/30300323 shutdown_connections 2024-09-13T18:48:12.152 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.149+0000 7f6dd6800640 1 -- 172.21.15.192:0/30300323 wait complete. 2024-09-13T18:48:12.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.151+0000 7f6dd6800640 1 Processor -- start 2024-09-13T18:48:12.153 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.151+0000 7f6dd6800640 1 -- start start 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cacd0 0x7f6dd01582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 0x7f6dd00b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd01f5b10 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd0158810 con 0x7f6dd0140980 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dd6800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd00b4d20 con 0x7f6dd00cacd0 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dc6a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56848/0 (socket says 172.21.15.192:56848) 2024-09-13T18:48:12.155 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.152+0000 7f6dc6a00640 1 -- 172.21.15.192:0/1695216384 learned_addr learned my addr 172.21.15.192:0/1695216384 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dcf400640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cacd0 0x7f6dd01582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dcfe00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 0x7f6dd00b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 -- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cacd0 msgr2=0x7f6dd01582d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cacd0 0x7f6dd01582d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 -- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 msgr2=0x7f6dd00b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 0x7f6dd00b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db8009400 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dcfe00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 0x7f6dd00b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc6a00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6db8035040 tx=0x7f6db80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8006e10 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db8032e90 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db8030ba0 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.153+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd013e480 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.154+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd013ea40 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.154+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd015bc20 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.157 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.155+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f6db8039040 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.156+0000 7f6dc7e00640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 0x7f6dac06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.156+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6db80a9bd0 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.156+0000 7f6dcf400640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 0x7f6dac06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.158 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.157+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f6dac072730 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.157+0000 7f6dcf400640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 0x7f6dac06d0c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0151c50 tx=0x7f6dc0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.162 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.161+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f6db8074da0 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.362+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6dd006c6c0 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.363+0000 7f6dc7e00640 1 -- 172.21.15.192:0/1695216384 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7f6db8041090 con 0x7f6dd00cb0b0 2024-09-13T18:48:12.365 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:12.365 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:48:12.365 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 msgr2=0x7f6dac06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 0x7f6dac06d0c0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0151c50 tx=0x7f6dc0008040 comp rx=0 tx=0).stop 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 msgr2=0x7f6dd0156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7f6db8035040 tx=0x7f6db80046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 shutdown_connections 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f6dac06ac00 0x7f6dac06d0c0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f6dd0140980 0x7f6dd00b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6dd00cb0b0 0x7f6dd0156350 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 --2- 172.21.15.192:0/1695216384 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f6dd00cacd0 0x7f6dd01582d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 >> 172.21.15.192:0/1695216384 conn(0x7f6dd00ae960 msgr2=0x7f6dd00718a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 shutdown_connections 2024-09-13T18:48:12.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.365+0000 7f6dd6800640 1 -- 172.21.15.192:0/1695216384 wait complete. 2024-09-13T18:48:12.384 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:12.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.534+0000 7f981c400640 1 Processor -- start 2024-09-13T18:48:12.536 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.535+0000 7f981c400640 1 -- start start 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f981415dee0 0x7f98140afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f98140b3f10 0x7f98140b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415e2c0 0x7f981415a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140b2f00 con 0x7f981415dee0 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140b3150 con 0x7f98140b3f10 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f981c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b3430 con 0x7f981415e2c0 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f981415dee0 0x7f98140afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f981415dee0 0x7f98140afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56864/0 (socket says 172.21.15.192:56864) 2024-09-13T18:48:12.538 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 -- 172.21.15.192:0/4275843395 learned_addr learned my addr 172.21.15.192:0/4275843395 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:12.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 -- 172.21.15.192:0/4275843395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415e2c0 msgr2=0x7f981415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:12.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 --2- 172.21.15.192:0/4275843395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415e2c0 0x7f981415a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.539 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 -- 172.21.15.192:0/4275843395 >> v2:172.21.15.194:3300/0 conn(0x7f98140b3f10 msgr2=0x7f98140b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 --2- 172.21.15.192:0/4275843395 >> v2:172.21.15.194:3300/0 conn(0x7f98140b3f10 0x7f98140b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.536+0000 7f9819a00640 1 -- 172.21.15.192:0/4275843395 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140b3710 con 0x7f981415dee0 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.537+0000 7f9819a00640 1 --2- 172.21.15.192:0/4275843395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415dee0 0x7f98140afd80 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f98140b4700 tx=0x7f980802a1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1254c83eaefab56 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f9813e00640 1 -- 172.21.15.192:0/4275843395 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808032440 con 0x7f981415dee0 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f9813e00640 1 -- 172.21.15.192:0/4275843395 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98080325a0 con 0x7f981415dee0 2024-09-13T18:48:12.540 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f9813e00640 1 -- 172.21.15.192:0/4275843395 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9808032930 con 0x7f981415dee0 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 -- 172.21.15.192:0/4275843395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415dee0 msgr2=0x7f98140afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 --2- 172.21.15.192:0/4275843395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415dee0 0x7f98140afd80 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f98140b4700 tx=0x7f980802a1d0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 -- 172.21.15.192:0/4275843395 shutdown_connections 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 --2- 172.21.15.192:0/4275843395 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415e2c0 0x7f981415a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 --2- 172.21.15.192:0/4275843395 >> v2:172.21.15.194:3300/0 conn(0x7f98140b3f10 0x7f98140b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 --2- 172.21.15.192:0/4275843395 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415dee0 0x7f98140afd80 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 -- 172.21.15.192:0/4275843395 >> 172.21.15.192:0/4275843395 conn(0x7f98140ae960 msgr2=0x7f981406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 -- 172.21.15.192:0/4275843395 shutdown_connections 2024-09-13T18:48:12.541 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.538+0000 7f981c400640 1 -- 172.21.15.192:0/4275843395 wait complete. 2024-09-13T18:48:12.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.540+0000 7f981c400640 1 Processor -- start 2024-09-13T18:48:12.542 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.540+0000 7f981c400640 1 -- start start 2024-09-13T18:48:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 0x7f98141514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 0x7f98140add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98141f6780 con 0x7f981415e2c0 2024-09-13T18:48:12.544 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9814151ee0 con 0x7f9814151a30 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f981c400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98141f5e50 con 0x7f981415dee0 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f9819000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f9819000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56876/0 (socket says 172.21.15.192:56876) 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f9819000640 1 -- 172.21.15.192:0/3670793391 learned_addr learned my addr 172.21.15.192:0/3670793391 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.541+0000 7f9819a00640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 0x7f98141514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f981a400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 0x7f98140add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 -- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 msgr2=0x7f98141514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 0x7f98141514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 -- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 msgr2=0x7f98140add80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 0x7f98140add80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98080094d0 con 0x7f981415e2c0 2024-09-13T18:48:12.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819a00640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 0x7f98141514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f981a400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 0x7f98140add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9819000640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f980000b4a0 tx=0x7f980000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800010610 con 0x7f981415e2c0 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800010770 con 0x7f981415e2c0 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800010b20 con 0x7f981415e2c0 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98141f6130 con 0x7f981415e2c0 2024-09-13T18:48:12.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.542+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98141f6c10 con 0x7f981415e2c0 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.543+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981415a440 con 0x7f981415e2c0 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.544+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9800010c80 con 0x7f981415e2c0 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.545+0000 7f9811600640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 0x7f97f406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.545+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9800088f30 con 0x7f981415e2c0 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.545+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f97f4072730 con 0x7f981415e2c0 2024-09-13T18:48:12.547 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.545+0000 7f9819a00640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 0x7f97f406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.546+0000 7f9819a00640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 0x7f97f406d0c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9808034000 tx=0x7f980802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.550 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.549+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9800014060 con 0x7f981415e2c0 2024-09-13T18:48:12.724 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.722+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f981413ce20 con 0x7f981415e2c0 2024-09-13T18:48:12.725 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.723+0000 7f9811600640 1 -- 172.21.15.192:0/3670793391 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f980001e070 con 0x7f981415e2c0 2024-09-13T18:48:12.726 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:12.726 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":201,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:11.893397+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 msgr2=0x7f97f406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 0x7f97f406d0c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f9808034000 tx=0x7f980802e000 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 msgr2=0x7f98140ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f980000b4a0 tx=0x7f980000b960 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 shutdown_connections 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f97f406ac00 0x7f97f406d0c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9814151a30 0x7f98140add80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f981415e2c0 0x7f98140ad840 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 --2- 172.21.15.192:0/3670793391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f981415dee0 0x7f98141514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 >> 172.21.15.192:0/3670793391 conn(0x7f98140ae960 msgr2=0x7f9814071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:12.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 shutdown_connections 2024-09-13T18:48:12.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.726+0000 7f981c400640 1 -- 172.21.15.192:0/3670793391 wait complete. 2024-09-13T18:48:12.743 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T18:35:28.785395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '122', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-13T18:47:34.465884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '196', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2024-09-13T18:47:35.644556+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '201', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-13T18:48:12.744 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-13T18:48:12.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.896+0000 7fd31c800640 1 Processor -- start 2024-09-13T18:48:12.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.896+0000 7fd31c800640 1 -- start start 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.897+0000 7fd31c800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3141434c0 0x7fd31406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.897+0000 7fd31c800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31406b480 con 0x7fd31406a8b0 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.897+0000 7fd31c800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31406b760 con 0x7fd3140b3da0 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.897+0000 7fd31c800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3140ce770 con 0x7fd3141434c0 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.897+0000 7fd319e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3141434c0 0x7fd31406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fd3141434c0 0x7fd31406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56888/0 (socket says 172.21.15.192:56888) 2024-09-13T18:48:12.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319e00640 1 -- 172.21.15.192:0/2389627104 learned_addr learned my addr 172.21.15.192:0/2389627104 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:12.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319400640 1 --1- 172.21.15.192:0/2389627104 >> v1:172.21.15.192:6789/0 conn(0x7fd31406a8b0 0x7fd3140b3690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52898/0 (socket says 172.21.15.192:52898) 2024-09-13T18:48:12.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319e00640 1 -- 172.21.15.192:0/2389627104 >> v1:172.21.15.194:6789/0 conn(0x7fd3140b3da0 legacy=0x7fd31406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319e00640 1 -- 172.21.15.192:0/2389627104 >> v1:172.21.15.192:6789/0 conn(0x7fd31406a8b0 legacy=0x7fd3140b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.898+0000 7fd319e00640 1 -- 172.21.15.192:0/2389627104 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31406ba40 con 0x7fd3141434c0 2024-09-13T18:48:12.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.899+0000 7fd319e00640 1 --2- 172.21.15.192:0/2389627104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd31406c800 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd308009870 tx=0x7fd30802a160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d9978fdd76f757 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.899+0000 7fd318a00640 1 -- 172.21.15.192:0/2389627104 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30802adf0 con 0x7fd3141434c0 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.899+0000 7fd318a00640 1 -- 172.21.15.192:0/2389627104 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd308032440 con 0x7fd3141434c0 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.899+0000 7fd318a00640 1 -- 172.21.15.192:0/2389627104 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3080327d0 con 0x7fd3141434c0 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 -- 172.21.15.192:0/2389627104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 msgr2=0x7fd31406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 --2- 172.21.15.192:0/2389627104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd31406c800 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fd308009870 tx=0x7fd30802a160 comp rx=0 tx=0).stop 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 -- 172.21.15.192:0/2389627104 shutdown_connections 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 --2- 172.21.15.192:0/2389627104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd31406c800 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 -- 172.21.15.192:0/2389627104 >> 172.21.15.192:0/2389627104 conn(0x7fd3140b08f0 msgr2=0x7fd3140b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:12.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 -- 172.21.15.192:0/2389627104 shutdown_connections 2024-09-13T18:48:12.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.900+0000 7fd31c800640 1 -- 172.21.15.192:0/2389627104 wait complete. 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.901+0000 7fd31c800640 1 Processor -- start 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 -- start start 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31406a8b0 0x7fd3140c4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 0x7fd3141f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314155530 con 0x7fd3141434c0 2024-09-13T18:48:12.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3141f6cd0 con 0x7fd3140b3da0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.902+0000 7fd31c800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd314159cb0 con 0x7fd31406a8b0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56894/0 (socket says 172.21.15.192:56894) 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 -- 172.21.15.192:0/2765638870 learned_addr learned my addr 172.21.15.192:0/2765638870 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd319e00640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31406a8b0 0x7fd3140c4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd319400640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 0x7fd3141f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 -- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31406a8b0 msgr2=0x7fd3140c4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31406a8b0 0x7fd3140c4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 -- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 msgr2=0x7fd3141f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 0x7fd3141f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3080094d0 con 0x7fd3141434c0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd319400640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 0x7fd3141f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.903+0000 7fd31a800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c7a0 tx=0x7fd31000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.904+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310003b70 con 0x7fd3141434c0 2024-09-13T18:48:12.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.904+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd310003cf0 con 0x7fd3141434c0 2024-09-13T18:48:12.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.904+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd310003ea0 con 0x7fd3141434c0 2024-09-13T18:48:12.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.904+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314159f90 con 0x7fd3141434c0 2024-09-13T18:48:12.908 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.904+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3141f6fb0 con 0x7fd3141434c0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.905+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3140cc7d0 con 0x7fd3141434c0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.906+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd31000aa90 con 0x7fd3141434c0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.906+0000 7fd30e000640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 0x7fd2f806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.907+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3100890a0 con 0x7fd3141434c0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.907+0000 7fd319e00640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 0x7fd2f806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.907+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fd2f8072730 con 0x7fd3141434c0 2024-09-13T18:48:12.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.907+0000 7fd319e00640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 0x7fd2f806d0c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd308034000 tx=0x7fd30802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:12.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:12.911+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd310054310 con 0x7fd3141434c0 2024-09-13T18:48:13.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.079+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3140b25f0 con 0x7fd3141434c0 2024-09-13T18:48:13.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.079+0000 7fd30e000640 1 -- 172.21.15.192:0/2765638870 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v201) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd310057930 con 0x7fd3141434c0 2024-09-13T18:48:13.081 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 1 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 msgr2=0x7fd2f806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 0x7fd2f806d0c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fd308034000 tx=0x7fd30802e000 comp rx=0 tx=0).stop 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 msgr2=0x7fd3141f66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7fd31000c7a0 tx=0x7fd31000cc60 comp rx=0 tx=0).stop 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 shutdown_connections 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd2f806ac00 0x7fd2f806d0c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd3141434c0 0x7fd3141f66a0 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.083 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd3140b3da0 0x7fd3141f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 --2- 172.21.15.192:0/2765638870 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd31406a8b0 0x7fd3140c4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 >> 172.21.15.192:0/2765638870 conn(0x7fd3140b08f0 msgr2=0x7fd314070930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 shutdown_connections 2024-09-13T18:48:13.084 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.081+0000 7fd31c800640 1 -- 172.21.15.192:0/2765638870 wait complete. 2024-09-13T18:48:13.099 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-13T18:48:13.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.254+0000 7f5050800640 1 Processor -- start 2024-09-13T18:48:13.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.254+0000 7f5050800640 1 -- start start 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f5050800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f50480d14e0 0x7f50480b2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f5050800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504815ddd0 con 0x7f50480d2940 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f5050800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f504806aeb0 con 0x7f50480d1100 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f5050800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50480cdf50 con 0x7f50480d14e0 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f504e800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f50480d2940 0x7f5048161050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52904/0 (socket says 172.21.15.192:52904) 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.255+0000 7f504e800640 1 -- 172.21.15.192:0/3612130642 learned_addr learned my addr 172.21.15.192:0/3612130642 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504d400640 1 --2- 172.21.15.192:0/3612130642 >> v2:172.21.15.194:3300/0 conn(0x7f50480d14e0 0x7f50480b2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152249561 0 0) 0x7f504815ddd0 con 0x7f50480d2940 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5030003520 con 0x7f50480d2940 2024-09-13T18:48:13.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955590327 0 0) 0x7f504806aeb0 con 0x7f50480d1100 2024-09-13T18:48:13.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f504815ddd0 con 0x7f50480d1100 2024-09-13T18:48:13.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504d400640 1 -- 172.21.15.192:0/3612130642 >> v1:172.21.15.194:6789/0 conn(0x7f50480d1100 legacy=0x7f5048160940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1531537192 0 0) 0x7f5030003520 con 0x7f50480d2940 2024-09-13T18:48:13.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504d400640 1 -- 172.21.15.192:0/3612130642 >> v1:172.21.15.192:6789/0 conn(0x7f50480d2940 legacy=0x7f5048161050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.256+0000 7f504d400640 1 -- 172.21.15.192:0/3612130642 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50480d2d50 con 0x7f50480d14e0 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.257+0000 7f504d400640 1 --2- 172.21.15.192:0/3612130642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b2260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f50380097a0 tx=0x7f503802a1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40f0915a5fec5b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50440019f0 con 0x7f50480d14e0 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503802ac50 con 0x7f50480d14e0 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f504ca00640 1 -- 172.21.15.192:0/3612130642 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038032440 con 0x7f50480d14e0 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 -- 172.21.15.192:0/3612130642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 msgr2=0x7f50480b2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.261 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 --2- 172.21.15.192:0/3612130642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b2260 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f50380097a0 tx=0x7f503802a1c0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 -- 172.21.15.192:0/3612130642 shutdown_connections 2024-09-13T18:48:13.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 --2- 172.21.15.192:0/3612130642 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b2260 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 -- 172.21.15.192:0/3612130642 >> 172.21.15.192:0/3612130642 conn(0x7f50480b4a20 msgr2=0x7f50480b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 -- 172.21.15.192:0/3612130642 shutdown_connections 2024-09-13T18:48:13.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.258+0000 7f5050800640 1 -- 172.21.15.192:0/3612130642 wait complete. 2024-09-13T18:48:13.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.260+0000 7f5050800640 1 Processor -- start 2024-09-13T18:48:13.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.260+0000 7f5050800640 1 -- start start 2024-09-13T18:48:13.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50480d1100 0x7f50480b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b89b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480d1d80 con 0x7f50480d2940 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50480b8590 con 0x7f50480d14e0 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f5050800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50480b78a0 con 0x7f50480d1100 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504e800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56900/0 (socket says 172.21.15.192:56900) 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504e800640 1 -- 172.21.15.192:0/103180853 learned_addr learned my addr 172.21.15.192:0/103180853 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504de00640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50480d1100 0x7f50480b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504d400640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.261+0000 7f504e800640 1 -- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50480d1100 msgr2=0x7f50480b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f504e800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50480d1100 0x7f50480b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f504e800640 1 -- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 msgr2=0x7f50480b89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f504e800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f504e800640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5038009400 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f504e800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f504400cca0 tx=0x7f504400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044012400 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5044012580 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5044012930 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50480b7ed0 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.262+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50480b6e40 con 0x7f50480d2940 2024-09-13T18:48:13.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.263+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50481602c0 con 0x7f50480d2940 2024-09-13T18:48:13.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.264+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f5044007070 con 0x7f50480d2940 2024-09-13T18:48:13.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.265+0000 7f5042000640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.265+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5044089420 con 0x7f50480d2940 2024-09-13T18:48:13.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.265+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f502c072730 con 0x7f50480d2940 2024-09-13T18:48:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.265+0000 7f504de00640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.266+0000 7f504de00640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 0x7f502c06d0c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f503c0011e0 tx=0x7f503c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.269+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f50440546a0 con 0x7f50480d2940 2024-09-13T18:48:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.438+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50480cda00 con 0x7f50480d2940 2024-09-13T18:48:13.440 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.439+0000 7f5042000640 1 -- 172.21.15.192:0/103180853 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v201) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5044017020 con 0x7f50480d2940 2024-09-13T18:48:13.440 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 32 2024-09-13T18:48:13.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 msgr2=0x7f502c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 0x7f502c06d0c0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f503c0011e0 tx=0x7f503c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:13.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 msgr2=0x7f50480b6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f504400cca0 tx=0x7f504400a430 comp rx=0 tx=0).stop 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 shutdown_connections 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f502c06ac00 0x7f502c06d0c0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50480d2940 0x7f50480b6900 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50480d14e0 0x7f50480b89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 --2- 172.21.15.192:0/103180853 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50480d1100 0x7f50480b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 >> 172.21.15.192:0/103180853 conn(0x7f50480b4a20 msgr2=0x7f50480b4170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 shutdown_connections 2024-09-13T18:48:13.444 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.441+0000 7f5050800640 1 -- 172.21.15.192:0/103180853 wait complete. 2024-09-13T18:48:13.458 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-13T18:48:13.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.613+0000 7f7c94a00640 1 Processor -- start 2024-09-13T18:48:13.614 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.613+0000 7f7c94a00640 1 -- start start 2024-09-13T18:48:13.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c94a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c900b2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c94a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9006f940 con 0x7f7c900b02f0 2024-09-13T18:48:13.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c94a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c900b32d0 con 0x7f7c90142e00 2024-09-13T18:48:13.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c94a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9006f610 con 0x7f7c900b4910 2024-09-13T18:48:13.616 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c86a00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f7c900b02f0 0x7f7c9006fdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52912/0 (socket says 172.21.15.192:52912) 2024-09-13T18:48:13.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c86a00640 1 -- 172.21.15.192:0/1865341851 learned_addr learned my addr 172.21.15.192:0/1865341851 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:13.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.614+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c900b2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145926439 0 0) 0x7f7c9006f940 con 0x7f7c900b02f0 2024-09-13T18:48:13.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c74003520 con 0x7f7c900b02f0 2024-09-13T18:48:13.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263882914 0 0) 0x7f7c900b32d0 con 0x7f7c90142e00 2024-09-13T18:48:13.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c9006f940 con 0x7f7c90142e00 2024-09-13T18:48:13.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1594912466 0 0) 0x7f7c74003520 con 0x7f7c900b02f0 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 msgr2=0x7f7c900b2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c900b2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 >> v1:172.21.15.194:6789/0 conn(0x7f7c90142e00 legacy=0x7f7c900afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c900b3530 con 0x7f7c900b02f0 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f7c78001670 con 0x7f7c900b02f0 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 >> v1:172.21.15.192:6789/0 conn(0x7f7c900b02f0 legacy=0x7f7c9006fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c74003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004090 0x7f7c740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c74004d00 0x7f7c74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9006f610 con 0x7f7c74004d00 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7400ba60 con 0x7f7c74004090 2024-09-13T18:48:13.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7400bc20 con 0x7f7c900b4910 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.615+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c74004d00 0x7f7c74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8f400640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c74003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c86a00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004090 0x7f7c740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 msgr2=0x7f7c74003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900b4910 0x7f7c74003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004090 msgr2=0x7f7c740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004090 0x7f7c740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1865341851 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c74003520 con 0x7f7c74004d00 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.616+0000 7f7c86a00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004090 0x7f7c740047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c74004d00 0x7f7c74005180 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009fc0 tx=0x7f7c740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f208ce3c782198c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88031640 con 0x7f7c74004d00 2024-09-13T18:48:13.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8802d070 con 0x7f7c74004d00 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c8ea00640 1 -- 172.21.15.192:0/1865341851 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c880319e0 con 0x7f7c74004d00 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c94a00640 1 -- 172.21.15.192:0/1865341851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c74004d00 msgr2=0x7f7c74005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.617+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1865341851 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c74004d00 0x7f7c74005180 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009fc0 tx=0x7f7c740057f0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.618+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1865341851 reap_dead start 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.618+0000 7f7c94a00640 1 -- 172.21.15.192:0/1865341851 shutdown_connections 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.618+0000 7f7c94a00640 1 -- 172.21.15.192:0/1865341851 >> 172.21.15.192:0/1865341851 conn(0x7f7c900ae7f0 msgr2=0x7f7c9006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.618+0000 7f7c94a00640 1 -- 172.21.15.192:0/1865341851 shutdown_connections 2024-09-13T18:48:13.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.618+0000 7f7c94a00640 1 -- 172.21.15.192:0/1865341851 wait complete. 2024-09-13T18:48:13.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.619+0000 7f7c94a00640 1 Processor -- start 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.619+0000 7f7c94a00640 1 -- start start 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004d00 0x7f7c9013bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900ad840 0x7f7c900adcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900c5500 con 0x7f7c900c3af0 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c901f02f0 con 0x7f7c74004d00 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.620+0000 7f7c94a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c900ae2e0 con 0x7f7c900ad840 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56918/0 (socket says 172.21.15.192:56918) 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1659320773 learned_addr learned my addr 172.21.15.192:0/1659320773 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8f400640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004d00 0x7f7c9013bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c86a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900ad840 0x7f7c900adcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900ad840 msgr2=0x7f7c900adcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900ad840 0x7f7c900adcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004d00 msgr2=0x7f7c9013bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004d00 0x7f7c9013bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c90143360 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.621+0000 7f7c8fe00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7c88033040 tx=0x7f7c88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.622+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88031d30 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.622+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c88040070 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.622+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c901f3b90 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.622+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c88003bd0 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.622+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c901f4150 con 0x7f7c900c3af0 2024-09-13T18:48:13.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.623+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9004e210 con 0x7f7c900c3af0 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.624+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f7c88042030 con 0x7f7c900c3af0 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.625+0000 7f7c87e00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 0x7f7c6c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.625+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c880aa940 con 0x7f7c900c3af0 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.625+0000 7f7c8f400640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 0x7f7c6c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.625+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f7c6c072730 con 0x7f7c900c3af0 2024-09-13T18:48:13.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.626+0000 7f7c8f400640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 0x7f7c6c06d0c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7c90159e10 tx=0x7f7c80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.630 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.629+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f7c88075a80 con 0x7f7c900c3af0 2024-09-13T18:48:13.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.798+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7c900cd380 con 0x7f7c900c3af0 2024-09-13T18:48:13.800 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.798+0000 7f7c87e00640 1 -- 172.21.15.192:0/1659320773 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v201) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7c880790a0 con 0x7f7c900c3af0 2024-09-13T18:48:13.800 INFO:teuthology.orchestra.run.smithi192.stdout:pg_num: 64 2024-09-13T18:48:13.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 msgr2=0x7f7c6c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.802 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 0x7f7c6c06d0c0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f7c90159e10 tx=0x7f7c80009040 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 msgr2=0x7f7c900c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f7c88033040 tx=0x7f7c88009750 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 shutdown_connections 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f7c6c06ac00 0x7f7c6c06d0c0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c900c3af0 0x7f7c900c3f80 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f7c900ad840 0x7f7c900adcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 --2- 172.21.15.192:0/1659320773 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f7c74004d00 0x7f7c9013bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.800+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 >> 172.21.15.192:0/1659320773 conn(0x7f7c900ae7f0 msgr2=0x7f7c90069ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.801+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 shutdown_connections 2024-09-13T18:48:13.803 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.801+0000 7f7c94a00640 1 -- 172.21.15.192:0/1659320773 wait complete. 2024-09-13T18:48:13.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:13.971 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.969+0000 7feb9a400640 1 Processor -- start 2024-09-13T18:48:13.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.970+0000 7feb9a400640 1 -- start start 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb9a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb9406e990 0x7feb940cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb9a400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb940ce6c0 0x7feb940cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb9a400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb9406c5d0 con 0x7feb9415a9e0 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb9a400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb940b3730 con 0x7feb940ce6c0 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb9a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb940b3920 con 0x7feb9406e990 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb99a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb940ce6c0 0x7feb940cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb99a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7feb940ce6c0 0x7feb940cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56928/0 (socket says 172.21.15.192:56928) 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb99a00640 1 -- 172.21.15.192:0/3207937285 learned_addr learned my addr 172.21.15.192:0/3207937285 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:13.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.971+0000 7feb8be00640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb9406e990 0x7feb940cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.972+0000 7feb99a00640 1 -- 172.21.15.192:0/3207937285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb9406e990 msgr2=0x7feb940cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.972+0000 7feb99a00640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb9406e990 0x7feb940cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.972+0000 7feb99a00640 1 -- 172.21.15.192:0/3207937285 >> v1:172.21.15.192:6789/0 conn(0x7feb9415a9e0 legacy=0x7feb9406ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.972+0000 7feb99a00640 1 -- 172.21.15.192:0/3207937285 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb940b3c00 con 0x7feb940ce6c0 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.972+0000 7feb93e00640 1 -- 172.21.15.192:0/3207937285 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 702055243 0 0) 0x7feb9406c5d0 con 0x7feb9415a9e0 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb99a00640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb940ce6c0 0x7feb940cde00 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009e50 tx=0x7feb8c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5210038f6a74d0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb93e00640 1 -- 172.21.15.192:0/3207937285 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c031600 con 0x7feb940ce6c0 2024-09-13T18:48:13.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb93e00640 1 -- 172.21.15.192:0/3207937285 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c02d050 con 0x7feb940ce6c0 2024-09-13T18:48:13.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb93e00640 1 -- 172.21.15.192:0/3207937285 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c031980 con 0x7feb940ce6c0 2024-09-13T18:48:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb9a400640 1 -- 172.21.15.192:0/3207937285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb940ce6c0 msgr2=0x7feb940cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.973+0000 7feb9a400640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb940ce6c0 0x7feb940cde00 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7feb8c009e50 tx=0x7feb8c02a710 comp rx=0 tx=0).stop 2024-09-13T18:48:13.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 -- 172.21.15.192:0/3207937285 shutdown_connections 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb940ce6c0 0x7feb940cde00 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 --2- 172.21.15.192:0/3207937285 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb9406e990 0x7feb940cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 -- 172.21.15.192:0/3207937285 >> 172.21.15.192:0/3207937285 conn(0x7feb940736d0 msgr2=0x7feb940b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 -- 172.21.15.192:0/3207937285 shutdown_connections 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.974+0000 7feb9a400640 1 -- 172.21.15.192:0/3207937285 wait complete. 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.975+0000 7feb9a400640 1 Processor -- start 2024-09-13T18:48:13.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.975+0000 7feb9a400640 1 -- start start 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb940ce6c0 0x7feb9413a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9415a9e0 0x7feb9414f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9413ae70 con 0x7feb9406e990 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414c620 con 0x7feb9415a9e0 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb9a400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9414f9a0 con 0x7feb940ce6c0 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.976+0000 7feb99000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.980 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56942/0 (socket says 172.21.15.192:56942) 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 -- 172.21.15.192:0/2797472164 learned_addr learned my addr 172.21.15.192:0/2797472164 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb8be00640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb940ce6c0 0x7feb9413a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99a00640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9415a9e0 0x7feb9414f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 -- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb940ce6c0 msgr2=0x7feb9413a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb940ce6c0 0x7feb9413a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 -- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9415a9e0 msgr2=0x7feb9414f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9415a9e0 0x7feb9414f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c009b30 con 0x7feb9406e990 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.977+0000 7feb99000640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c4e0 tx=0x7feb8400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.978+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb84005480 con 0x7feb9406e990 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.978+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb840035f0 con 0x7feb9406e990 2024-09-13T18:48:13.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.978+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb840039c0 con 0x7feb9406e990 2024-09-13T18:48:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.978+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb9414ef80 con 0x7feb9406e990 2024-09-13T18:48:13.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.978+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb9414cb50 con 0x7feb9406e990 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.979+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9415adc0 con 0x7feb9406e990 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.980+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7feb84003b20 con 0x7feb9406e990 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.980+0000 7feb91600640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 0x7feb7006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.981+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb84088710 con 0x7feb9406e990 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.981+0000 7feb8be00640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 0x7feb7006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:13.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.981+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7feb70072730 con 0x7feb9406e990 2024-09-13T18:48:13.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.981+0000 7feb8be00640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 0x7feb7006d0c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7feb940b07d0 tx=0x7feb7c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:13.986 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:13.985+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7feb84017070 con 0x7feb9406e990 2024-09-13T18:48:14.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.188+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb940b3130 con 0x7feb9406e990 2024-09-13T18:48:14.190 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.189+0000 7feb91600640 1 -- 172.21.15.192:0/2797472164 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7feb84053a30 con 0x7feb9406e990 2024-09-13T18:48:14.191 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:14.191 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:48:14.191 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 msgr2=0x7feb7006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 0x7feb7006d0c0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7feb940b07d0 tx=0x7feb7c009190 comp rx=0 tx=0).stop 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 msgr2=0x7feb940715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7feb8400c4e0 tx=0x7feb8400c9a0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 shutdown_connections 2024-09-13T18:48:14.193 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7feb7006ac00 0x7feb7006d0c0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7feb9415a9e0 0x7feb9414f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7feb940ce6c0 0x7feb9413a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 --2- 172.21.15.192:0/2797472164 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feb9406e990 0x7feb940715b0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 >> 172.21.15.192:0/2797472164 conn(0x7feb940736d0 msgr2=0x7feb9406ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 shutdown_connections 2024-09-13T18:48:14.194 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.191+0000 7feb9a400640 1 -- 172.21.15.192:0/2797472164 wait complete. 2024-09-13T18:48:14.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:14.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.359+0000 7f95fbe00640 1 Processor -- start 2024-09-13T18:48:14.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.359+0000 7f95fbe00640 1 -- start start 2024-09-13T18:48:14.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f95f40cacd0 0x7f95f415e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cb0b0 0x7f95f415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95f4140980 0x7f95f4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f415c160 con 0x7f95f4140980 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f4140480 con 0x7f95f40cacd0 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95fbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f415ee90 con 0x7f95f40cb0b0 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95f4140980 0x7f95f4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f95f4140980 0x7f95f4140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56958/0 (socket says 172.21.15.192:56958) 2024-09-13T18:48:14.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 -- 172.21.15.192:0/606417430 learned_addr learned my addr 172.21.15.192:0/606417430 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f8a00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cb0b0 0x7f95f415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9400640 1 --2- 172.21.15.192:0/606417430 >> v2:172.21.15.194:3300/0 conn(0x7f95f40cacd0 0x7f95f415e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 -- 172.21.15.192:0/606417430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cb0b0 msgr2=0x7f95f415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cb0b0 0x7f95f415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 -- 172.21.15.192:0/606417430 >> v2:172.21.15.194:3300/0 conn(0x7f95f40cacd0 msgr2=0x7f95f415e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 --2- 172.21.15.192:0/606417430 >> v2:172.21.15.194:3300/0 conn(0x7f95f40cacd0 0x7f95f415e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.361+0000 7f95f9e00640 1 -- 172.21.15.192:0/606417430 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f415f170 con 0x7f95f4140980 2024-09-13T18:48:14.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.362+0000 7f95f9e00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f4140df0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f95f40b2350 tx=0x7f95ec02a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5015af7f3f141074 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95f3e00640 1 -- 172.21.15.192:0/606417430 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec031600 con 0x7f95f4140980 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95f3e00640 1 -- 172.21.15.192:0/606417430 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec02d050 con 0x7f95f4140980 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95f3e00640 1 -- 172.21.15.192:0/606417430 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec031980 con 0x7f95f4140980 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 -- 172.21.15.192:0/606417430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 msgr2=0x7f95f4140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f4140df0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f95f40b2350 tx=0x7f95ec02a610 comp rx=0 tx=0).stop 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 -- 172.21.15.192:0/606417430 shutdown_connections 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f4140df0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 --2- 172.21.15.192:0/606417430 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cb0b0 0x7f95f415bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 --2- 172.21.15.192:0/606417430 >> v2:172.21.15.194:3300/0 conn(0x7f95f40cacd0 0x7f95f415e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 -- 172.21.15.192:0/606417430 >> 172.21.15.192:0/606417430 conn(0x7f95f40ae960 msgr2=0x7f95f406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 -- 172.21.15.192:0/606417430 shutdown_connections 2024-09-13T18:48:14.366 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.363+0000 7f95fbe00640 1 -- 172.21.15.192:0/606417430 wait complete. 2024-09-13T18:48:14.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.365+0000 7f95fbe00640 1 Processor -- start 2024-09-13T18:48:14.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.365+0000 7f95fbe00640 1 -- start start 2024-09-13T18:48:14.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cacd0 0x7f95f413e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f40cb0b0 0x7f95f406aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f413e7a0 con 0x7f95f4140980 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cc100 con 0x7f95f40cb0b0 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95fbe00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f406a440 con 0x7f95f40cacd0 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95f9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95f9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56972/0 (socket says 172.21.15.192:56972) 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95f9e00640 1 -- 172.21.15.192:0/2150403149 learned_addr learned my addr 172.21.15.192:0/2150403149 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95f9400640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cacd0 0x7f95f413e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.366+0000 7f95f8a00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f40cb0b0 0x7f95f406aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 -- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cacd0 msgr2=0x7f95f413e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cacd0 0x7f95f413e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 -- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f40cb0b0 msgr2=0x7f95f406aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.372 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f40cb0b0 0x7f95f406aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec009b30 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f9e00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009f40 tx=0x7f95ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec03d860 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec03d9e0 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f40cc360 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.367+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec03dd90 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.368+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f40cc920 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.369+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f415bc20 con 0x7f95f4140980 2024-09-13T18:48:14.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.369+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f95ec03b400 con 0x7f95f4140980 2024-09-13T18:48:14.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.370+0000 7f95f1600640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 0x7f95d406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.370+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95ec0a9dd0 con 0x7f95f4140980 2024-09-13T18:48:14.374 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.371+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f95d4072730 con 0x7f95f4140980 2024-09-13T18:48:14.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.371+0000 7f95f9400640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 0x7f95d406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.375 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.371+0000 7f95f9400640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 0x7f95d406d0c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95e8003610 tx=0x7f95e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.376 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.375+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f95ec0750f0 con 0x7f95f4140980 2024-09-13T18:48:14.545 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.543+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f406c6c0 con 0x7f95f4140980 2024-09-13T18:48:14.546 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.544+0000 7f95f1600640 1 -- 172.21.15.192:0/2150403149 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f95ec041090 con 0x7f95f4140980 2024-09-13T18:48:14.546 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:14.546 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":201,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:11.893397+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:14.548 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.546+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 msgr2=0x7f95d406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.546+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 0x7f95d406d0c0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f95e8003610 tx=0x7f95e8008040 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.546+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 msgr2=0x7f95f413d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.546+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009f40 tx=0x7f95ec004a40 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 shutdown_connections 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f95d406ac00 0x7f95d406d0c0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f95f4140980 0x7f95f413d0c0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f95f40cb0b0 0x7f95f406aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 --2- 172.21.15.192:0/2150403149 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f95f40cacd0 0x7f95f413e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 >> 172.21.15.192:0/2150403149 conn(0x7f95f40ae960 msgr2=0x7f95f4157ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 shutdown_connections 2024-09-13T18:48:14.549 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.547+0000 7f95fbe00640 1 -- 172.21.15.192:0/2150403149 wait complete. 2024-09-13T18:48:14.564 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:48:14.564 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:14.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.715+0000 7fd5e8200640 1 Processor -- start 2024-09-13T18:48:14.717 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.715+0000 7fd5e8200640 1 -- start start 2024-09-13T18:48:14.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e8200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e8200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fd5e00b0490 0x7fd5e015a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.718 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e8200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e00b2f00 con 0x7fd5e015dee0 2024-09-13T18:48:14.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e8200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e015aec0 con 0x7fd5e00b0490 2024-09-13T18:48:14.719 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e8200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e00b3150 con 0x7fd5e00b3f10 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e4e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e4e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:45540/0 (socket says 172.21.15.192:45540) 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e4e00640 1 -- 172.21.15.192:0/663675646 learned_addr learned my addr 172.21.15.192:0/663675646 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e5800640 1 --1- 172.21.15.192:0/663675646 >> v1:172.21.15.194:6789/0 conn(0x7fd5e015dee0 0x7fd5e00afd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:54996/0 (socket says 172.21.15.192:54996) 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.717+0000 7fd5e6200640 1 --2- 172.21.15.192:0/663675646 >> v2:172.21.15.194:3300/0 conn(0x7fd5e00b0490 0x7fd5e015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.718+0000 7fd5e4e00640 1 -- 172.21.15.192:0/663675646 >> v2:172.21.15.194:3300/0 conn(0x7fd5e00b0490 msgr2=0x7fd5e015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.718+0000 7fd5e4e00640 1 --2- 172.21.15.192:0/663675646 >> v2:172.21.15.194:3300/0 conn(0x7fd5e00b0490 0x7fd5e015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.718+0000 7fd5e4e00640 1 -- 172.21.15.192:0/663675646 >> v1:172.21.15.194:6789/0 conn(0x7fd5e015dee0 legacy=0x7fd5e00afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.720 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.718+0000 7fd5e4e00640 1 -- 172.21.15.192:0/663675646 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e00b3430 con 0x7fd5e00b3f10 2024-09-13T18:48:14.721 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5e4e00640 1 --2- 172.21.15.192:0/663675646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc02c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dadbf781d3408290 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5dfe00640 1 -- 172.21.15.192:0/663675646 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc031710 con 0x7fd5e00b3f10 2024-09-13T18:48:14.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5dfe00640 1 -- 172.21.15.192:0/663675646 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc02f050 con 0x7fd5e00b3f10 2024-09-13T18:48:14.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5dfe00640 1 -- 172.21.15.192:0/663675646 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc031a90 con 0x7fd5e00b3f10 2024-09-13T18:48:14.722 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5e8200640 1 -- 172.21.15.192:0/663675646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 msgr2=0x7fd5e015a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.719+0000 7fd5e8200640 1 --2- 172.21.15.192:0/663675646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc02c460 comp rx=0 tx=0).stop 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 -- 172.21.15.192:0/663675646 shutdown_connections 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 --2- 172.21.15.192:0/663675646 >> v2:172.21.15.194:3300/0 conn(0x7fd5e00b0490 0x7fd5e015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 --2- 172.21.15.192:0/663675646 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e00b3f10 0x7fd5e015a440 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 -- 172.21.15.192:0/663675646 >> 172.21.15.192:0/663675646 conn(0x7fd5e00ae960 msgr2=0x7fd5e006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 -- 172.21.15.192:0/663675646 shutdown_connections 2024-09-13T18:48:14.723 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.720+0000 7fd5e8200640 1 -- 172.21.15.192:0/663675646 wait complete. 2024-09-13T18:48:14.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.721+0000 7fd5e8200640 1 Processor -- start 2024-09-13T18:48:14.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.721+0000 7fd5e8200640 1 -- start start 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e00b0490 0x7fd5e0135690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e0134350 0x7fd5e0142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e0152340 con 0x7fd5e015dee0 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e0141630 con 0x7fd5e00b0490 2024-09-13T18:48:14.727 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e8200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e01525e0 con 0x7fd5e0134350 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e4e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56982/0 (socket says 172.21.15.192:56982) 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.722+0000 7fd5e4e00640 1 -- 172.21.15.192:0/3234019391 learned_addr learned my addr 172.21.15.192:0/3234019391 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e6200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e0134350 0x7fd5e0142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e5800640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e00b0490 0x7fd5e0135690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 -- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e0134350 msgr2=0x7fd5e0142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e0134350 0x7fd5e0142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 -- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e00b0490 msgr2=0x7fd5e0135690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e00b0490 0x7fd5e0135690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc0094d0 con 0x7fd5e015dee0 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.723+0000 7fd5e4e00640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.724+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc03c830 con 0x7fd5e015dee0 2024-09-13T18:48:14.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.724+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc03c990 con 0x7fd5e015dee0 2024-09-13T18:48:14.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.724+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc03cd40 con 0x7fd5e015dee0 2024-09-13T18:48:14.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.724+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e01528c0 con 0x7fd5e015dee0 2024-09-13T18:48:14.730 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.724+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e01f3730 con 0x7fd5e015dee0 2024-09-13T18:48:14.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.725+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e01f38c0 con 0x7fd5e015dee0 2024-09-13T18:48:14.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.726+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fd5cc03a070 con 0x7fd5e015dee0 2024-09-13T18:48:14.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.726+0000 7fd5dd600640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 0x7fd5c006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:14.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.727+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5cc0aa070 con 0x7fd5e015dee0 2024-09-13T18:48:14.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.727+0000 7fd5e5800640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 0x7fd5c006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:14.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.727+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fd5c0072730 con 0x7fd5e015dee0 2024-09-13T18:48:14.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.727+0000 7fd5e5800640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 0x7fd5c006d0c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4000f60 tx=0x7fd5d4000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:14.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.731+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fd5e01f38c0 con 0x7fd5e015dee0 2024-09-13T18:48:14.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.934+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5e01f38c0 con 0x7fd5e015dee0 2024-09-13T18:48:14.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.935+0000 7fd5dd600640 1 -- 172.21.15.192:0/3234019391 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7fd5e01f38c0 con 0x7fd5e015dee0 2024-09-13T18:48:14.937 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:14.937 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:48:14.937 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 msgr2=0x7fd5c006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 0x7fd5c006d0c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd5d4000f60 tx=0x7fd5d4000ed0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 msgr2=0x7fd5e01f31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc000c00 tx=0x7fd5cc0046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 shutdown_connections 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fd5c006ac00 0x7fd5c006d0c0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fd5e0134350 0x7fd5e0142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.939 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5e015dee0 0x7fd5e01f31f0 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 --2- 172.21.15.192:0/3234019391 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fd5e00b0490 0x7fd5e0135690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:14.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 >> 172.21.15.192:0/3234019391 conn(0x7fd5e00ae960 msgr2=0x7fd5e0134f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:14.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 shutdown_connections 2024-09-13T18:48:14.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:14.937+0000 7fd5e8200640 1 -- 172.21.15.192:0/3234019391 wait complete. 2024-09-13T18:48:14.954 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.104+0000 7fbeaac00640 1 Processor -- start 2024-09-13T18:48:15.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.104+0000 7fbeaac00640 1 -- start start 2024-09-13T18:48:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.105+0000 7fbeaac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea40afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.105+0000 7fbeaac00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea40b2f00 con 0x7fbea415e2c0 2024-09-13T18:48:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.105+0000 7fbeaac00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea40b3150 con 0x7fbea40b3f10 2024-09-13T18:48:15.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.105+0000 7fbeaac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40b3430 con 0x7fbea415dee0 2024-09-13T18:48:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea8c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbea415e2c0 0x7fbea41637e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52932/0 (socket says 172.21.15.192:52932) 2024-09-13T18:48:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea8c00640 1 -- 172.21.15.192:0/3607632536 learned_addr learned my addr 172.21.15.192:0/3607632536 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea3e00640 1 --2- 172.21.15.192:0/3607632536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea40afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755092125 0 0) 0x7fbea40b2f00 con 0x7fbea415e2c0 2024-09-13T18:48:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe88003520 con 0x7fbea415e2c0 2024-09-13T18:48:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea3e00640 1 -- 172.21.15.192:0/3607632536 >> v1:172.21.15.194:6789/0 conn(0x7fbea40b3f10 legacy=0x7fbea415a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4024563902 0 0) 0x7fbea40b3150 con 0x7fbea40b3f10 2024-09-13T18:48:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea3e00640 1 -- 172.21.15.192:0/3607632536 >> v1:172.21.15.192:6789/0 conn(0x7fbea415e2c0 legacy=0x7fbea41637e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.106+0000 7fbea3e00640 1 -- 172.21.15.192:0/3607632536 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea40b3710 con 0x7fbea415dee0 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbea3e00640 1 --2- 172.21.15.192:0/3607632536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea40afd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097d0 tx=0x7fbe9402a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a40f2cc333d083 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94032440 con 0x7fbea415dee0 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe940325a0 con 0x7fbea415dee0 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbea2a00640 1 -- 172.21.15.192:0/3607632536 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe94032930 con 0x7fbea415dee0 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbeaac00640 1 -- 172.21.15.192:0/3607632536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 msgr2=0x7fbea40afd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbeaac00640 1 --2- 172.21.15.192:0/3607632536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea40afd80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe940097d0 tx=0x7fbe9402a210 comp rx=0 tx=0).stop 2024-09-13T18:48:15.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbeaac00640 1 -- 172.21.15.192:0/3607632536 shutdown_connections 2024-09-13T18:48:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbeaac00640 1 --2- 172.21.15.192:0/3607632536 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea40afd80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.108+0000 7fbeaac00640 1 -- 172.21.15.192:0/3607632536 >> 172.21.15.192:0/3607632536 conn(0x7fbea40ae960 msgr2=0x7fbea406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.109+0000 7fbeaac00640 1 -- 172.21.15.192:0/3607632536 shutdown_connections 2024-09-13T18:48:15.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.109+0000 7fbeaac00640 1 -- 172.21.15.192:0/3607632536 wait complete. 2024-09-13T18:48:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.110+0000 7fbeaac00640 1 Processor -- start 2024-09-13T18:48:15.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.110+0000 7fbeaac00640 1 -- start start 2024-09-13T18:48:15.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea4139350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea415e2c0 0x7fbea4153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41e3e50 con 0x7fbea41f0b70 2024-09-13T18:48:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41f1000 con 0x7fbea415e2c0 2024-09-13T18:48:15.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbeaac00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40cdfa0 con 0x7fbea415dee0 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbea8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbea8c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:56994/0 (socket says 172.21.15.192:56994) 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.111+0000 7fbea8c00640 1 -- 172.21.15.192:0/2024086049 learned_addr learned my addr 172.21.15.192:0/2024086049 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea3e00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea4139350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea3400640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea415e2c0 0x7fbea4153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 -- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 msgr2=0x7fbea4139350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea4139350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 -- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea415e2c0 msgr2=0x7fbea4153510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea415e2c0 0x7fbea4153510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe94009400 con 0x7fbea41f0b70 2024-09-13T18:48:15.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbea8c00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ca50 tx=0x7fbe9c00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00ab50 con 0x7fbea41f0b70 2024-09-13T18:48:15.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00acb0 con 0x7fbea41f0b70 2024-09-13T18:48:15.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea4139120 con 0x7fbea41f0b70 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.112+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c012620 con 0x7fbea41f0b70 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.113+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea40ce1f0 con 0x7fbea41f0b70 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.114+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea415a440 con 0x7fbea41f0b70 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.115+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbe9c007070 con 0x7fbea41f0b70 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.115+0000 7fbe9be00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 0x7fbe8406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.116+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe9c0891e0 con 0x7fbea41f0b70 2024-09-13T18:48:15.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.116+0000 7fbea3e00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 0x7fbe8406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.116+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7fbe84072730 con 0x7fbea41f0b70 2024-09-13T18:48:15.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.116+0000 7fbea3e00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 0x7fbe8406d0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbe94034000 tx=0x7fbe9402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.122 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.120+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbe9c0543f0 con 0x7fbea41f0b70 2024-09-13T18:48:15.328 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.326+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbea40ae720 con 0x7fbea41f0b70 2024-09-13T18:48:15.329 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.326+0000 7fbe9be00640 1 -- 172.21.15.192:0/2024086049 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4747 (secure 0 0 0) 0x7fbe9c017030 con 0x7fbea41f0b70 2024-09-13T18:48:15.330 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:15.330 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":85,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":85,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-13T18:47:36.646150+0000","modified":"2024-09-13T18:47:39.655357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9003},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9003":{"gid":9003,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":3,"addr":"172.21.15.194:6834/1492074018","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":1492074018},{"type":"v1","addr":"172.21.15.194:6834","nonce":1492074018}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2024-09-13T18:48:15.330 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 85 2024-09-13T18:48:15.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 msgr2=0x7fbe8406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 0x7fbe8406d0c0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fbe94034000 tx=0x7fbe9402e000 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 msgr2=0x7fbea4138be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c00ca50 tx=0x7fbe9c00cf10 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 shutdown_connections 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbe8406ac00 0x7fbe8406d0c0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbea41f0b70 0x7fbea4138be0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbea415e2c0 0x7fbea4153510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 --2- 172.21.15.192:0/2024086049 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbea415dee0 0x7fbea4139350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 >> 172.21.15.192:0/2024086049 conn(0x7fbea40ae960 msgr2=0x7fbea406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 shutdown_connections 2024-09-13T18:48:15.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.329+0000 7fbeaac00640 1 -- 172.21.15.192:0/2024086049 wait complete. 2024-09-13T18:48:15.348 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:15.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.497+0000 7f9170c00640 1 Processor -- start 2024-09-13T18:48:15.500 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.497+0000 7f9170c00640 1 -- start start 2024-09-13T18:48:15.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.498+0000 7f9170c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.498+0000 7f9170c00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0b2f00 con 0x7f916c0b3f10 2024-09-13T18:48:15.501 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.498+0000 7f9170c00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f916c0b3150 con 0x7f916c15dee0 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.498+0000 7f9170c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c0b3430 con 0x7f916c0b0490 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9169400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f916c0b3f10 0x7f916c15a440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52940/0 (socket says 172.21.15.192:52940) 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9169400640 1 -- 172.21.15.192:0/3507888017 learned_addr learned my addr 172.21.15.192:0/3507888017 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:15.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f916a800640 1 --2- 172.21.15.192:0/3507888017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1395988689 0 0) 0x7f916c0b2f00 con 0x7f916c0b3f10 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9150003520 con 0x7f916c0b3f10 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 478795829 0 0) 0x7f916c0b3150 con 0x7f916c15dee0 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f916c0b2f00 con 0x7f916c15dee0 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f916a800640 1 -- 172.21.15.192:0/3507888017 >> v1:172.21.15.194:6789/0 conn(0x7f916c15dee0 legacy=0x7f916c0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f916a800640 1 -- 172.21.15.192:0/3507888017 >> v1:172.21.15.192:6789/0 conn(0x7f916c0b3f10 legacy=0x7f916c15a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.499+0000 7f916a800640 1 -- 172.21.15.192:0/3507888017 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f916c0b3710 con 0x7f916c0b0490 2024-09-13T18:48:15.503 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.500+0000 7f916a800640 1 --2- 172.21.15.192:0/3507888017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c15ab50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9164009dc0 tx=0x7f916402a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30edcb53d40265c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164007740 con 0x7f916c0b0490 2024-09-13T18:48:15.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916402d050 con 0x7f916c0b0490 2024-09-13T18:48:15.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9168a00640 1 -- 172.21.15.192:0/3507888017 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164007aa0 con 0x7f916c0b0490 2024-09-13T18:48:15.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 -- 172.21.15.192:0/3507888017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 msgr2=0x7f916c15ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.504 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 --2- 172.21.15.192:0/3507888017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c15ab50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f9164009dc0 tx=0x7f916402a6d0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 -- 172.21.15.192:0/3507888017 shutdown_connections 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 --2- 172.21.15.192:0/3507888017 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c15ab50 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 -- 172.21.15.192:0/3507888017 >> 172.21.15.192:0/3507888017 conn(0x7f916c0ae960 msgr2=0x7f916c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 -- 172.21.15.192:0/3507888017 shutdown_connections 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.501+0000 7f9170c00640 1 -- 172.21.15.192:0/3507888017 wait complete. 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.503+0000 7f9170c00640 1 Processor -- start 2024-09-13T18:48:15.505 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.503+0000 7f9170c00640 1 -- start start 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 0x7f916c13edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c1578f0 con 0x7f916c13fc40 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c13d970 con 0x7f916c15dee0 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9170c00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f916c13dc10 con 0x7f916c0b0490 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f916a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f916a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57008/0 (socket says 172.21.15.192:57008) 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f916a800640 1 -- 172.21.15.192:0/1665908864 learned_addr learned my addr 172.21.15.192:0/1665908864 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:15.508 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9169e00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f916a800640 1 -- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 msgr2=0x7f916c134e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f9169400640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 0x7f916c13edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.504+0000 7f916a800640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c134e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f916a800640 1 -- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 msgr2=0x7f916c13edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f916a800640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 0x7f916c13edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f916a800640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9164009a70 con 0x7f916c13fc40 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9169e00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9169400640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 0x7f916c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f916a800640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f916402acc0 tx=0x7f9164004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916403c830 con 0x7f916c13fc40 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916403c990 con 0x7f916c13fc40 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c13def0 con 0x7f916c13fc40 2024-09-13T18:48:15.509 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916403cd20 con 0x7f916c13fc40 2024-09-13T18:48:15.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.505+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c13e4b0 con 0x7f916c13fc40 2024-09-13T18:48:15.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.506+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f916c0afd80 con 0x7f916c13fc40 2024-09-13T18:48:15.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.507+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9164031400 con 0x7f916c13fc40 2024-09-13T18:48:15.510 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.508+0000 7f9162000640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 0x7f914c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.508+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91640ab090 con 0x7f916c13fc40 2024-09-13T18:48:15.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.508+0000 7f9169e00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 0x7f914c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.508+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f914c072730 con 0x7f916c13fc40 2024-09-13T18:48:15.511 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.509+0000 7f9169e00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 0x7f914c06d0c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f915c001610 tx=0x7f915c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.512+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9164076310 con 0x7f916c13fc40 2024-09-13T18:48:15.685 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.682+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f916c06c3f0 con 0x7f916c13fc40 2024-09-13T18:48:15.687 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.684+0000 7f9162000640 1 -- 172.21.15.192:0/1665908864 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v201) v1 ==== 74+0+16666 (secure 0 0 0) 0x7f916404a090 con 0x7f916c13fc40 2024-09-13T18:48:15.687 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:15.687 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":201,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:11.893397+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-13T18:47:34.465884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"196","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-13T18:47:35.644556+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"201","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 msgr2=0x7f914c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 0x7f914c06d0c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f915c001610 tx=0x7f915c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 msgr2=0x7f916c13f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f916402acc0 tx=0x7f9164004a40 comp rx=0 tx=0).stop 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 shutdown_connections 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f914c06ac00 0x7f914c06d0c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f916c13fc40 0x7f916c13f300 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.689 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f916c15dee0 0x7f916c13edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 --2- 172.21.15.192:0/1665908864 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f916c0b0490 0x7f916c134e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 >> 172.21.15.192:0/1665908864 conn(0x7f916c0ae960 msgr2=0x7f916c15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 shutdown_connections 2024-09-13T18:48:15.690 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.686+0000 7f9170c00640 1 -- 172.21.15.192:0/1665908864 wait complete. 2024-09-13T18:48:15.705 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-13T18:48:15.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.855+0000 7f8950e00640 1 Processor -- start 2024-09-13T18:48:15.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.855+0000 7f8950e00640 1 -- start start 2024-09-13T18:48:15.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8950e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f894c0afd80 0x7f894c0b01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8950e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0adf50 con 0x7f894c146610 2024-09-13T18:48:15.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8950e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0ae770 con 0x7f894c0b2780 2024-09-13T18:48:15.861 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8950e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c0cd920 con 0x7f894c0afd80 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8949e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f894c146610 0x7f894c0ce2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52954/0 (socket says 172.21.15.192:52954) 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.856+0000 7f8949e00640 1 -- 172.21.15.192:0/977498327 learned_addr learned my addr 172.21.15.192:0/977498327 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f894a800640 1 --2- 172.21.15.192:0/977498327 >> v2:172.21.15.194:3300/0 conn(0x7f894c0afd80 0x7f894c0b01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750227761 0 0) 0x7f894c0adf50 con 0x7f894c146610 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8930003520 con 0x7f894c146610 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2674910715 0 0) 0x7f8930003520 con 0x7f894c146610 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 >> v2:172.21.15.194:3300/0 conn(0x7f894c0afd80 msgr2=0x7f894c0b01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 --2- 172.21.15.192:0/977498327 >> v2:172.21.15.194:3300/0 conn(0x7f894c0afd80 0x7f894c0b01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 >> v1:172.21.15.194:6789/0 conn(0x7f894c0b2780 legacy=0x7f894c0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c0cdb30 con 0x7f894c146610 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f893c001670 con 0x7f894c146610 2024-09-13T18:48:15.862 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 >> v1:172.21.15.192:6789/0 conn(0x7f894c146610 legacy=0x7f894c0ce2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930003970 0x7f8930003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 0x7f8930004860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8930005100 0x7f893000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0cd920 con 0x7f8930004390 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f893000c050 con 0x7f8930005100 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.857+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f893000c210 con 0x7f8930003970 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 0x7f8930004860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8949e00640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930003970 0x7f8930003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f894a800640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8930005100 0x7f893000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 -- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930003970 msgr2=0x7f8930003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930003970 0x7f8930003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 -- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8930005100 msgr2=0x7f893000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:15.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8930005100 0x7f893000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f8941400640 1 -- 172.21.15.192:0/977498327 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8930003520 con 0x7f8930004390 2024-09-13T18:48:15.864 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.858+0000 7f894a800640 1 -- 172.21.15.192:0/977498327 reap_dead start 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.859+0000 7f8941400640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 0x7f8930004860 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f89340018e0 tx=0x7f89300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44adf2f8dda1849 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.859+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893402ac00 con 0x7f8930004390 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.859+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893402ad60 con 0x7f8930004390 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.859+0000 7f8949400640 1 -- 172.21.15.192:0/977498327 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8934032660 con 0x7f8930004390 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 -- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 msgr2=0x7f8930004860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 0x7f8930004860 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f89340018e0 tx=0x7f89300057f0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 -- 172.21.15.192:0/977498327 shutdown_connections 2024-09-13T18:48:15.865 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 --2- 172.21.15.192:0/977498327 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8930004390 0x7f8930004860 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 -- 172.21.15.192:0/977498327 >> 172.21.15.192:0/977498327 conn(0x7f894c0ae960 msgr2=0x7f894c06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:15.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 -- 172.21.15.192:0/977498327 shutdown_connections 2024-09-13T18:48:15.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.860+0000 7f8950e00640 1 -- 172.21.15.192:0/977498327 wait complete. 2024-09-13T18:48:15.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.862+0000 7f8950e00640 1 Processor -- start 2024-09-13T18:48:15.866 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.862+0000 7f8950e00640 1 -- start start 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930004390 0x7f894c0b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f894c1411b0 0x7f894c141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c158530 con 0x7f894c0700b0 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15a720 con 0x7f894c1411b0 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8950e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c141b50 con 0x7f8930004390 2024-09-13T18:48:15.868 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f894a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8941400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f894c1411b0 0x7f894c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f894a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57020/0 (socket says 172.21.15.192:57020) 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f8949e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930004390 0x7f894c0b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.863+0000 7f894a800640 1 -- 172.21.15.192:0/2704323288 learned_addr learned my addr 172.21.15.192:0/2704323288 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 -- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930004390 msgr2=0x7f894c0b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930004390 0x7f894c0b32c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 -- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f894c1411b0 msgr2=0x7f894c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f894c1411b0 0x7f894c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c071880 con 0x7f894c0700b0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f894a800640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f894c0b2fa0 tx=0x7f894400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f894400e040 con 0x7f894c0700b0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f894400f040 con 0x7f894c0700b0 2024-09-13T18:48:15.869 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8944015430 con 0x7f894c0700b0 2024-09-13T18:48:15.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c070a70 con 0x7f894c0700b0 2024-09-13T18:48:15.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.864+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c0712c0 con 0x7f894c0700b0 2024-09-13T18:48:15.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.865+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c15a890 con 0x7f894c0700b0 2024-09-13T18:48:15.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.866+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f8944015590 con 0x7f894c0700b0 2024-09-13T18:48:15.870 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.867+0000 7f8942a00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 0x7f892806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:15.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.868+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(201..201 src has 1..201) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8944089ad0 con 0x7f894c0700b0 2024-09-13T18:48:15.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.868+0000 7f8949e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 0x7f892806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:15.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.868+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=202}) v3 -- 0x7f8928072730 con 0x7f894c0700b0 2024-09-13T18:48:15.871 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.868+0000 7f8949e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 0x7f892806d0c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f894c063b50 tx=0x7f893c000fe0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:15.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:15.872+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f894c15a890 con 0x7f894c0700b0 2024-09-13T18:48:16.076 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.073+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f894c15a890 con 0x7f894c0700b0 2024-09-13T18:48:16.077 INFO:tasks.ceph.mon.a.smithi192.stderr:2024-09-13T18:48:16.074+0000 7f90a6600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T18:48:16.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.078+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(202..202 src has 1..202) v4 ==== 374+0+0 (secure 0 0 0) 0x7f8944058a20 con 0x7f894c0700b0 2024-09-13T18:48:16.080 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.078+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7f8928072fe0 con 0x7f894c0700b0 2024-09-13T18:48:16.090 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.087+0000 7f8942a00640 1 -- 172.21.15.192:0/2704323288 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f894c15a890 con 0x7f894c0700b0 2024-09-13T18:48:16.090 INFO:teuthology.orchestra.run.smithi192.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 msgr2=0x7f892806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 0x7f892806d0c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f894c063b50 tx=0x7f893c000fe0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 msgr2=0x7f894c070530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f894c0b2fa0 tx=0x7f894400f580 comp rx=0 tx=0).stop 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 shutdown_connections 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f892806ac00 0x7f892806d0c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f894c0700b0 0x7f894c070530 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f894c1411b0 0x7f894c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 --2- 172.21.15.192:0/2704323288 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f8930004390 0x7f894c0b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 >> 172.21.15.192:0/2704323288 conn(0x7f894c0ae960 msgr2=0x7f894c161220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:16.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 shutdown_connections 2024-09-13T18:48:16.094 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.090+0000 7f8950e00640 1 -- 172.21.15.192:0/2704323288 wait complete. 2024-09-13T18:48:16.102 INFO:tasks.ceph.mds.b.smithi194.stderr: -9042> 2024-09-13T18:47:37.222+0000 7f4df1400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-13T18:48:16.109 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-13T18:48:16.156 INFO:tasks.ceph.mds.b.smithi194.stdout:starting mds.b at 2024-09-13T18:48:16.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.264+0000 7f4933e00640 1 Processor -- start 2024-09-13T18:48:16.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.264+0000 7f4933e00640 1 -- start start 2024-09-13T18:48:16.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.265+0000 7f4933e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f493406e990 0x7f493406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.265+0000 7f4933e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f49340cd7e0 0x7f49340cdbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.265+0000 7f4933e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4934071ab0 con 0x7f4934144730 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.265+0000 7f4933e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493415b810 con 0x7f493406e990 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.265+0000 7f4933e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49340ce130 con 0x7f49340cd7e0 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f493406e990 0x7f493406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f493406e990 0x7f493406ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57024/0 (socket says 172.21.15.192:57024) 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 -- 172.21.15.192:0/599295157 learned_addr learned my addr 172.21.15.192:0/599295157 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4933400640 1 --2- 172.21.15.192:0/599295157 >> v2:172.21.15.194:3300/0 conn(0x7f49340cd7e0 0x7f49340cdbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 -- 172.21.15.192:0/599295157 >> v2:172.21.15.194:3300/0 conn(0x7f49340cd7e0 msgr2=0x7f49340cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 --2- 172.21.15.192:0/599295157 >> v2:172.21.15.194:3300/0 conn(0x7f49340cd7e0 0x7f49340cdbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 -- 172.21.15.192:0/599295157 >> v1:172.21.15.194:6789/0 conn(0x7f4934144730 legacy=0x7f493415b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.266+0000 7f4932000640 1 -- 172.21.15.192:0/599295157 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49340714f0 con 0x7f493406e990 2024-09-13T18:48:16.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.267+0000 7f4932000640 1 --2- 172.21.15.192:0/599295157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493406ede0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f493406bbc0 tx=0x7f492002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8d73b2b918127dd server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.267+0000 7f4931600640 1 -- 172.21.15.192:0/599295157 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920032440 con 0x7f493406e990 2024-09-13T18:48:16.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.267+0000 7f4931600640 1 -- 172.21.15.192:0/599295157 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49200325a0 con 0x7f493406e990 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.267+0000 7f4931600640 1 -- 172.21.15.192:0/599295157 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4920032930 con 0x7f493406e990 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 -- 172.21.15.192:0/599295157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 msgr2=0x7f493406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 --2- 172.21.15.192:0/599295157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493406ede0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f493406bbc0 tx=0x7f492002a270 comp rx=0 tx=0).stop 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 -- 172.21.15.192:0/599295157 shutdown_connections 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 --2- 172.21.15.192:0/599295157 >> v2:172.21.15.194:3300/0 conn(0x7f49340cd7e0 0x7f49340cdbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 --2- 172.21.15.192:0/599295157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493406ede0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 -- 172.21.15.192:0/599295157 >> 172.21.15.192:0/599295157 conn(0x7f49340736d0 msgr2=0x7f49340b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 -- 172.21.15.192:0/599295157 shutdown_connections 2024-09-13T18:48:16.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.268+0000 7f4933e00640 1 -- 172.21.15.192:0/599295157 wait complete. 2024-09-13T18:48:16.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.269+0000 7f4933e00640 1 Processor -- start 2024-09-13T18:48:16.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 -- start start 2024-09-13T18:48:16.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 0x7f49340a9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4934144730 0x7f493415ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493413be80 con 0x7f493406e990 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49340a9750 con 0x7f49340cd7e0 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.270+0000 7f4933e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493413c060 con 0x7f4934144730 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57028/0 (socket says 172.21.15.192:57028) 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 -- 172.21.15.192:0/943395375 learned_addr learned my addr 172.21.15.192:0/943395375 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932000640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 0x7f49340a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4933400640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4934144730 0x7f493415ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 -- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4934144730 msgr2=0x7f493415ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4934144730 0x7f493415ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 -- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 msgr2=0x7f49340a9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 0x7f49340a9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932a00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49200094d0 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.271+0000 7f4932000640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 0x7f49340a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f4932a00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f492400c400 tx=0x7f492400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49240052d0 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4924005430 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493413c340 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4924003830 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.272+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493413c900 con 0x7f493406e990 2024-09-13T18:48:16.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.273+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49340cdbf0 con 0x7f493406e990 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.274+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f4924003990 con 0x7f493406e990 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.275+0000 7f492aa00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 0x7f491406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.275+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f49240887f0 con 0x7f493406e990 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.275+0000 7f4932000640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 0x7f491406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.275+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7f4914072840 con 0x7f493406e990 2024-09-13T18:48:16.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.276+0000 7f4932000640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 0x7f491406d0c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4920034000 tx=0x7f492002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:16.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.279+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f4924017060 con 0x7f493406e990 2024-09-13T18:48:16.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:16.483+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4934141970 con 0x7f493406e990 2024-09-13T18:48:17.093 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.090+0000 7f492aa00640 1 -- 172.21.15.192:0/943395375 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4924053ab0 con 0x7f493406e990 2024-09-13T18:48:17.096 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.093+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 msgr2=0x7f491406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.093+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 0x7f491406d0c0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f4920034000 tx=0x7f492002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.093+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 msgr2=0x7f493415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.093+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f492400c400 tx=0x7f492400c8c0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 shutdown_connections 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f491406ac00 0x7f491406d0c0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f4934144730 0x7f493415ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f49340cd7e0 0x7f49340a9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 --2- 172.21.15.192:0/943395375 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f493406e990 0x7f493415a5e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 >> 172.21.15.192:0/943395375 conn(0x7f49340736d0 msgr2=0x7f493406ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 shutdown_connections 2024-09-13T18:48:17.097 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.094+0000 7f4933e00640 1 -- 172.21.15.192:0/943395375 wait complete. 2024-09-13T18:48:17.115 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-13T18:48:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.270+0000 7efc66a00640 1 Processor -- start 2024-09-13T18:48:17.273 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.270+0000 7efc66a00640 1 -- start start 2024-09-13T18:48:17.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc60145c30 0x7efc6006bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc6006a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 0x7efc600adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc60146010 con 0x7efc60145c30 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc6006ab60 con 0x7efc600ad840 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc66a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6006b6e0 con 0x7efc600b3b90 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc60145c30 0x7efc6006bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7efc60145c30 0x7efc6006bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57030/0 (socket says 172.21.15.192:57030) 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 -- 172.21.15.192:0/198327896 learned_addr learned my addr 172.21.15.192:0/198327896 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc64a00640 1 --2- 172.21.15.192:0/198327896 >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 0x7efc600adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5f400640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc6006a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 -- 172.21.15.192:0/198327896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 msgr2=0x7efc6006a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc6006a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 -- 172.21.15.192:0/198327896 >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 msgr2=0x7efc600adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 --2- 172.21.15.192:0/198327896 >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 0x7efc600adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5fe00640 1 -- 172.21.15.192:0/198327896 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6006c0b0 con 0x7efc60145c30 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc64a00640 1 --2- 172.21.15.192:0/198327896 >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 0x7efc600adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:17.277 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.272+0000 7efc5f400640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc6006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:17.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.273+0000 7efc5fe00640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc6006bb70 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7efc600ceba0 tx=0x7efc5002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d322599e1bcd2abb server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.278 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc5ea00640 1 -- 172.21.15.192:0/198327896 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5002ae90 con 0x7efc60145c30 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc5ea00640 1 -- 172.21.15.192:0/198327896 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc50032440 con 0x7efc60145c30 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc5ea00640 1 -- 172.21.15.192:0/198327896 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc500327d0 con 0x7efc60145c30 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 -- 172.21.15.192:0/198327896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 msgr2=0x7efc6006bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc6006bb70 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7efc600ceba0 tx=0x7efc5002a140 comp rx=0 tx=0).stop 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 -- 172.21.15.192:0/198327896 shutdown_connections 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 --2- 172.21.15.192:0/198327896 >> v2:172.21.15.194:3300/0 conn(0x7efc600ad840 0x7efc600adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc6006a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 --2- 172.21.15.192:0/198327896 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc6006bb70 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 -- 172.21.15.192:0/198327896 >> 172.21.15.192:0/198327896 conn(0x7efc600b0c40 msgr2=0x7efc600b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 -- 172.21.15.192:0/198327896 shutdown_connections 2024-09-13T18:48:17.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.274+0000 7efc66a00640 1 -- 172.21.15.192:0/198327896 wait complete. 2024-09-13T18:48:17.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.276+0000 7efc66a00640 1 Processor -- start 2024-09-13T18:48:17.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.276+0000 7efc66a00640 1 -- start start 2024-09-13T18:48:17.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc600ad840 0x7efc601406b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc601436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc60140bf0 con 0x7efc60145c30 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc600706f0 con 0x7efc600ad840 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc66a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc600709d0 con 0x7efc600b3b90 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc64a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc64a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57038/0 (socket says 172.21.15.192:57038) 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc64a00640 1 -- 172.21.15.192:0/3731734 learned_addr learned my addr 172.21.15.192:0/3731734 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc5fe00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc600ad840 0x7efc601406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.277+0000 7efc5f400640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc601436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 -- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 msgr2=0x7efc601436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc601436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 -- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc600ad840 msgr2=0x7efc601406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:17.282 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc600ad840 0x7efc601406b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500094d0 con 0x7efc60145c30 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc64a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7efc5800cef0 tx=0x7efc5800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800d840 con 0x7efc60145c30 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc5800d9c0 con 0x7efc60145c30 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc5800dd70 con 0x7efc60145c30 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc60070cb0 con 0x7efc60145c30 2024-09-13T18:48:17.283 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.278+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc601f26e0 con 0x7efc60145c30 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.279+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc600adcb0 con 0x7efc60145c30 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.280+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc5801e3b0 con 0x7efc60145c30 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.281+0000 7efc57e00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 0x7efc4006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.281+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5795+0+0 (secure 0 0 0) 0x7efc58089e80 con 0x7efc60145c30 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.281+0000 7efc5fe00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 0x7efc4006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:17.284 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.281+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=203}) v3 -- 0x7efc40072840 con 0x7efc60145c30 2024-09-13T18:48:17.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.282+0000 7efc5fe00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 0x7efc4006d0c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efc50034000 tx=0x7efc5002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:17.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.285+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc5801a020 con 0x7efc60145c30 2024-09-13T18:48:17.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:17.453+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efc601f2900 con 0x7efc60145c30 2024-09-13T18:48:18.101 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.098+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(203..203 src has 1..203) v4 ==== 296+0+0 (secure 0 0 0) 0x7efc58058d90 con 0x7efc60145c30 2024-09-13T18:48:18.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.098+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=204}) v3 -- 0x7efc40070c70 con 0x7efc60145c30 2024-09-13T18:48:18.102 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.100+0000 7efc57e00640 1 -- 172.21.15.192:0/3731734 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v203) v1 ==== 181+0+0 (secure 0 0 0) 0x7efc5801a020 con 0x7efc60145c30 2024-09-13T18:48:18.102 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_metadata' removed 2024-09-13T18:48:18.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.102+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 msgr2=0x7efc4006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.102+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 0x7efc4006d0c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efc50034000 tx=0x7efc5002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.102+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 msgr2=0x7efc60143bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.102+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7efc5800cef0 tx=0x7efc5800a710 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 shutdown_connections 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc4006ac00 0x7efc4006d0c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc60145c30 0x7efc60143bf0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc600b3b90 0x7efc601436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 --2- 172.21.15.192:0/3731734 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc600ad840 0x7efc601406b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 >> 172.21.15.192:0/3731734 conn(0x7efc600b0c40 msgr2=0x7efc60144b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.103+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 shutdown_connections 2024-09-13T18:48:18.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.105+0000 7efc66a00640 1 -- 172.21.15.192:0/3731734 wait complete. 2024-09-13T18:48:18.129 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-13T18:48:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.282+0000 7f2eb2e00640 1 Processor -- start 2024-09-13T18:48:18.285 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.283+0000 7f2eb2e00640 1 -- start start 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb2e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2eac15e880 0x7f2eac15ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb2e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f2eac13e750 0x7f2eac15b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb2e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac0cd9d0 con 0x7f2eac13e2e0 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb2e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac15f760 con 0x7f2eac15e880 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb2e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac0ce970 con 0x7f2eac13e750 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2eac15e880 0x7f2eac15ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.287 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f2eac15e880 0x7f2eac15ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57048/0 (socket says 172.21.15.192:57048) 2024-09-13T18:48:18.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 -- 172.21.15.192:0/3568288845 learned_addr learned my addr 172.21.15.192:0/3568288845 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:18.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 -- 172.21.15.192:0/3568288845 >> v2:172.21.15.194:3300/0 conn(0x7f2eac13e750 msgr2=0x7f2eac15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:18.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/3568288845 >> v2:172.21.15.194:3300/0 conn(0x7f2eac13e750 0x7f2eac15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 -- 172.21.15.192:0/3568288845 >> v1:172.21.15.194:6789/0 conn(0x7f2eac13e2e0 legacy=0x7f2eac15b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:18.288 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.284+0000 7f2eb1a00640 1 -- 172.21.15.192:0/3568288845 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac15f1a0 con 0x7f2eac15e880 2024-09-13T18:48:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.285+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/3568288845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac15ec60 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b1c00 tx=0x7f2ea002a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6888e001c2333867 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eabe00640 1 -- 172.21.15.192:0/3568288845 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0032440 con 0x7f2eac15e880 2024-09-13T18:48:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eabe00640 1 -- 172.21.15.192:0/3568288845 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea00325a0 con 0x7f2eac15e880 2024-09-13T18:48:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eabe00640 1 -- 172.21.15.192:0/3568288845 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0032930 con 0x7f2eac15e880 2024-09-13T18:48:18.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 -- 172.21.15.192:0/3568288845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 msgr2=0x7f2eac15ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/3568288845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac15ec60 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0b1c00 tx=0x7f2ea002a230 comp rx=0 tx=0).stop 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 -- 172.21.15.192:0/3568288845 shutdown_connections 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/3568288845 >> v2:172.21.15.194:3300/0 conn(0x7f2eac13e750 0x7f2eac15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/3568288845 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac15ec60 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 -- 172.21.15.192:0/3568288845 >> 172.21.15.192:0/3568288845 conn(0x7f2eac073490 msgr2=0x7f2eac0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 -- 172.21.15.192:0/3568288845 shutdown_connections 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.286+0000 7f2eb2e00640 1 -- 172.21.15.192:0/3568288845 wait complete. 2024-09-13T18:48:18.290 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.288+0000 7f2eb2e00640 1 Processor -- start 2024-09-13T18:48:18.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.288+0000 7f2eb2e00640 1 -- start start 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 0x7f2eac135320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 0x7f2eac0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac135860 con 0x7f2eac15e880 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0ac4a0 con 0x7f2eac13e2e0 2024-09-13T18:48:18.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac0ac780 con 0x7f2eac13e750 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57062/0 (socket says 172.21.15.192:57062) 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.289+0000 7f2eb2400640 1 -- 172.21.15.192:0/2934161471 learned_addr learned my addr 172.21.15.192:0/2934161471 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 0x7f2eac135320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 -- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 msgr2=0x7f2eac0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb1000640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 0x7f2eac0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 0x7f2eac0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 -- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 msgr2=0x7f2eac135320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 0x7f2eac135320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea00094d0 con 0x7f2eac15e880 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 0x7f2eac135320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:18.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb1000640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 0x7f2eac0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2400640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400b970 tx=0x7f2ea400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea400cb40 con 0x7f2eac15e880 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea400ccc0 con 0x7f2eac15e880 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4014680 con 0x7f2eac15e880 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac0aca60 con 0x7f2eac15e880 2024-09-13T18:48:18.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.290+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac0ad020 con 0x7f2eac15e880 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.291+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac067b10 con 0x7f2eac15e880 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.292+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2ea401d3b0 con 0x7f2eac15e880 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.293+0000 7f2ea9600640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 0x7f2e8c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.293+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f2ea4089150 con 0x7f2eac15e880 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.293+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 0x7f2e8c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:18.296 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.293+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=204}) v3 -- 0x7f2e8c071a00 con 0x7f2eac15e880 2024-09-13T18:48:18.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.294+0000 7f2eb1a00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 0x7f2e8c06d0f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0034000 tx=0x7f2ea002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:18.299 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.297+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2ea4019020 con 0x7f2eac15e880 2024-09-13T18:48:18.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:18.462+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2eac0ad240 con 0x7f2eac15e880 2024-09-13T18:48:19.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.105+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 7 ==== osd_map(204..204 src has 1..204) v4 ==== 296+0+0 (secure 0 0 0) 0x7f2ea400ce30 con 0x7f2eac15e880 2024-09-13T18:48:19.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.105+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=205}) v3 -- 0x7f2e8c070790 con 0x7f2eac15e880 2024-09-13T18:48:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.107+0000 7f2ea9600640 1 -- 172.21.15.192:0/2934161471 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v204) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2ea4054480 con 0x7f2eac15e880 2024-09-13T18:48:19.110 INFO:teuthology.orchestra.run.smithi192.stderr:pool 'cephfs_data' removed 2024-09-13T18:48:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.110+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 msgr2=0x7f2e8c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.110+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 0x7f2e8c06d0f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0034000 tx=0x7f2ea002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:19.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.110+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 msgr2=0x7f2eac0706b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.110+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400b970 tx=0x7f2ea400be30 comp rx=0 tx=0).stop 2024-09-13T18:48:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 shutdown_connections 2024-09-13T18:48:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f2e8c06ac30 0x7f2e8c06d0f0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.116 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2eac15e880 0x7f2eac0706b0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f2eac13e750 0x7f2eac0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 --2- 172.21.15.192:0/2934161471 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f2eac13e2e0 0x7f2eac135320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.117 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.111+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 >> 172.21.15.192:0/2934161471 conn(0x7f2eac073490 msgr2=0x7f2eac15b190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.115+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 shutdown_connections 2024-09-13T18:48:19.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.116+0000 7f2eb2e00640 1 -- 172.21.15.192:0/2934161471 wait complete. 2024-09-13T18:48:19.138 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-13T18:48:19.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.290+0000 7f860a200640 1 Processor -- start 2024-09-13T18:48:19.293 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.290+0000 7f860a200640 1 -- start start 2024-09-13T18:48:19.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f860a200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f8604143350 0x7f86040cb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f860a200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f860406f5c0 con 0x7f86040cbaa0 2024-09-13T18:48:19.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f860a200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86040cbf40 con 0x7f8604143730 2024-09-13T18:48:19.294 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f860a200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86040cc220 con 0x7f8604143350 2024-09-13T18:48:19.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f8609800640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f86040cbaa0 0x7f860406fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52960/0 (socket says 172.21.15.192:52960) 2024-09-13T18:48:19.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.291+0000 7f8609800640 1 -- 172.21.15.192:0/3748976394 learned_addr learned my addr 172.21.15.192:0/3748976394 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:19.295 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8608e00640 1 --2- 172.21.15.192:0/3748976394 >> v2:172.21.15.194:3300/0 conn(0x7f8604143350 0x7f86040cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3571459452 0 0) 0x7f860406f5c0 con 0x7f86040cbaa0 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e8005730 con 0x7f86040cbaa0 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363006536 0 0) 0x7f86040cbf40 con 0x7f8604143730 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f860406f5c0 con 0x7f8604143730 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8608e00640 1 -- 172.21.15.192:0/3748976394 >> v1:172.21.15.194:6789/0 conn(0x7f8604143730 legacy=0x7f86040b2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8608e00640 1 -- 172.21.15.192:0/3748976394 >> v1:172.21.15.192:6789/0 conn(0x7f86040cbaa0 legacy=0x7f860406fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.292+0000 7f8608e00640 1 -- 172.21.15.192:0/3748976394 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86040cc500 con 0x7f8604143350 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.293+0000 7f8608e00640 1 --2- 172.21.15.192:0/3748976394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8604143350 0x7f86040cb560 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f85f40097a0 tx=0x7f85f402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=753d72ddd58c8ead server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.297 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.293+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4032440 con 0x7f8604143350 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f40325a0 con 0x7f8604143350 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f8603e00640 1 -- 172.21.15.192:0/3748976394 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4032930 con 0x7f8604143350 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 -- 172.21.15.192:0/3748976394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8604143350 msgr2=0x7f86040cb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 --2- 172.21.15.192:0/3748976394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8604143350 0x7f86040cb560 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f85f40097a0 tx=0x7f85f402a1a0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 -- 172.21.15.192:0/3748976394 shutdown_connections 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 --2- 172.21.15.192:0/3748976394 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f8604143350 0x7f86040cb560 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 -- 172.21.15.192:0/3748976394 >> 172.21.15.192:0/3748976394 conn(0x7f86040736d0 msgr2=0x7f86040b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 -- 172.21.15.192:0/3748976394 shutdown_connections 2024-09-13T18:48:19.298 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.294+0000 7f860a200640 1 -- 172.21.15.192:0/3748976394 wait complete. 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.296+0000 7f860a200640 1 Processor -- start 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.296+0000 7f860a200640 1 -- start start 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 0x7f86041f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 0x7f860413f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86041f38e0 con 0x7f8604143350 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f860415b970 con 0x7f860413a370 2024-09-13T18:48:19.301 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f860a200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f860415bc40 con 0x7f86040cbaa0 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57064/0 (socket says 172.21.15.192:57064) 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 -- 172.21.15.192:0/3866987935 learned_addr learned my addr 172.21.15.192:0/3866987935 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f8608e00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 0x7f86041f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 -- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 msgr2=0x7f86041f33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f8609800640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 0x7f860413f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 0x7f86041f33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 -- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 msgr2=0x7f860413f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 0x7f860413f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.302 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f85fbe00640 1 -- 172.21.15.192:0/3866987935 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f4009400 con 0x7f8604143350 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f8608e00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 0x7f86041f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.297+0000 7f8609800640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 0x7f860413f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f85fbe00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c3c0 tx=0x7f85ec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec0052d0 con 0x7f8604143350 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec005450 con 0x7f8604143350 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85ec003830 con 0x7f8604143350 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f860415bf20 con 0x7f8604143350 2024-09-13T18:48:19.303 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.298+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f860415c4e0 con 0x7f8604143350 2024-09-13T18:48:19.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.299+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86040cb560 con 0x7f8604143350 2024-09-13T18:48:19.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.300+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f85ec003990 con 0x7f8604143350 2024-09-13T18:48:19.304 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.301+0000 7f8601600640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 0x7f85e006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.301+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f85ec0885e0 con 0x7f8604143350 2024-09-13T18:48:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.301+0000 7f8608e00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 0x7f85e006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.305 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.302+0000 7f8608e00640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 0x7f85e006d0c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f85f4034000 tx=0x7f85f402e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.307 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.305+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f85ec053b70 con 0x7f8604143350 2024-09-13T18:48:19.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.474+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f86041e21c0 con 0x7f8604143350 2024-09-13T18:48:19.481 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.478+0000 7f8601600640 1 -- 172.21.15.192:0/3866987935 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f85ec057190 con 0x7f8604143350 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 msgr2=0x7f85e006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 0x7f85e006d0c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f85f4034000 tx=0x7f85f402e000 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 msgr2=0x7f860415b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f85ec00c3c0 tx=0x7f85ec00c880 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 shutdown_connections 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f85e006ac00 0x7f85e006d0c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f860413a370 0x7f860413f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8604143350 0x7f860415b430 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 --2- 172.21.15.192:0/3866987935 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f86040cbaa0 0x7f86041f33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 >> 172.21.15.192:0/3866987935 conn(0x7f86040736d0 msgr2=0x7f8604140240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.484 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 shutdown_connections 2024-09-13T18:48:19.485 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.481+0000 7f860a200640 1 -- 172.21.15.192:0/3866987935 wait complete. 2024-09-13T18:48:19.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2024-09-13T18:48:19.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.649+0000 7ff340a00640 1 Processor -- start 2024-09-13T18:48:19.652 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.649+0000 7ff340a00640 1 -- start start 2024-09-13T18:48:19.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.650+0000 7ff340a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c161af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.650+0000 7ff340a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c0b28a0 con 0x7ff33c162030 2024-09-13T18:48:19.653 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.650+0000 7ff340a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff33c06b720 con 0x7ff33c161710 2024-09-13T18:48:19.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.650+0000 7ff340a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0b3ed0 con 0x7ff33c0cdb50 2024-09-13T18:48:19.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33be00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7ff33c162030 0x7ff33c16acc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:52968/0 (socket says 172.21.15.192:52968) 2024-09-13T18:48:19.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33be00640 1 -- 172.21.15.192:0/341369425 learned_addr learned my addr 172.21.15.192:0/341369425 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:19.654 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33aa00640 1 --2- 172.21.15.192:0/341369425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c161af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3297251303 0 0) 0x7ff33c0b28a0 con 0x7ff33c162030 2024-09-13T18:48:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff320003520 con 0x7ff33c162030 2024-09-13T18:48:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276516295 0 0) 0x7ff33c06b720 con 0x7ff33c161710 2024-09-13T18:48:19.655 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff33c0b28a0 con 0x7ff33c161710 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33aa00640 1 -- 172.21.15.192:0/341369425 >> v1:172.21.15.194:6789/0 conn(0x7ff33c161710 legacy=0x7ff33c06b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33aa00640 1 -- 172.21.15.192:0/341369425 >> v1:172.21.15.192:6789/0 conn(0x7ff33c162030 legacy=0x7ff33c16acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.651+0000 7ff33aa00640 1 -- 172.21.15.192:0/341369425 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0b32c0 con 0x7ff33c0cdb50 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.652+0000 7ff33aa00640 1 --2- 172.21.15.192:0/341369425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c161af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097d0 tx=0x7ff32802a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e052055ad07693e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328032440 con 0x7ff33c0cdb50 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3280325a0 con 0x7ff33c0cdb50 2024-09-13T18:48:19.656 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff33a000640 1 -- 172.21.15.192:0/341369425 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328032930 con 0x7ff33c0cdb50 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 -- 172.21.15.192:0/341369425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 msgr2=0x7ff33c161af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 --2- 172.21.15.192:0/341369425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c161af0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff3280097d0 tx=0x7ff32802a210 comp rx=0 tx=0).stop 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 -- 172.21.15.192:0/341369425 shutdown_connections 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 --2- 172.21.15.192:0/341369425 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c161af0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 -- 172.21.15.192:0/341369425 >> 172.21.15.192:0/341369425 conn(0x7ff33c0b09f0 msgr2=0x7ff33c0b0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:19.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 -- 172.21.15.192:0/341369425 shutdown_connections 2024-09-13T18:48:19.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.653+0000 7ff340a00640 1 -- 172.21.15.192:0/341369425 wait complete. 2024-09-13T18:48:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.655+0000 7ff340a00640 1 Processor -- start 2024-09-13T18:48:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.655+0000 7ff340a00640 1 -- start start 2024-09-13T18:48:19.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c161710 0x7ff33c157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c071f50 con 0x7ff33c162030 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c0719a0 con 0x7ff33c161710 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff340a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33c070900 con 0x7ff33c0cdb50 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff33be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff33be00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:57080/0 (socket says 172.21.15.192:57080) 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff33be00640 1 -- 172.21.15.192:0/3980248390 learned_addr learned my addr 172.21.15.192:0/3980248390 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:19.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff33aa00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c161710 0x7ff33c157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.656+0000 7ff33b400640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 -- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 msgr2=0x7ff33c157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 -- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c161710 msgr2=0x7ff33c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c161710 0x7ff33c157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 -- 172.21.15.192:0/3980248390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff328009400 con 0x7ff33c162030 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33b400640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff33be00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cba0 tx=0x7ff33400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33400ace0 con 0x7ff33c162030 2024-09-13T18:48:19.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33400ae40 con 0x7ff33c162030 2024-09-13T18:48:19.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff334012620 con 0x7ff33c162030 2024-09-13T18:48:19.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff33c070be0 con 0x7ff33c162030 2024-09-13T18:48:19.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.657+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33c0711a0 con 0x7ff33c162030 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.659+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33c0affd0 con 0x7ff33c162030 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.659+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7ff334007070 con 0x7ff33c162030 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.660+0000 7ff333400640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 0x7ff31c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.660+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff334089080 con 0x7ff33c162030 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.661+0000 7ff33b400640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 0x7ff31c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:19.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.661+0000 7ff33b400640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 0x7ff31c06d0c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0011e0 tx=0x7ff32c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:19.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.664+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7ff3340bc9c0 con 0x7ff33c162030 2024-09-13T18:48:19.896 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:19.894+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7ff33c0afcf0 con 0x7ff33c162030 2024-09-13T18:48:20.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.109+0000 7ff333400640 1 -- 172.21.15.192:0/3980248390 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v605) v1 ==== 135+0+0 (secure 0 0 0) 0x7ff334058000 con 0x7ff33c162030 2024-09-13T18:48:20.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 msgr2=0x7ff31c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 0x7ff31c06d0c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff32c0011e0 tx=0x7ff32c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:20.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 msgr2=0x7ff33c06fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:20.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7ff33400cba0 tx=0x7ff33400a430 comp rx=0 tx=0).stop 2024-09-13T18:48:20.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 shutdown_connections 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7ff31c06ac00 0x7ff31c06d0c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff33c162030 0x7ff33c06fcb0 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7ff33c161710 0x7ff33c157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 --2- 172.21.15.192:0/3980248390 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7ff33c0cdb50 0x7ff33c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 >> 172.21.15.192:0/3980248390 conn(0x7ff33c0b09f0 msgr2=0x7ff33c0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 shutdown_connections 2024-09-13T18:48:20.115 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:20.111+0000 7ff340a00640 1 -- 172.21.15.192:0/3980248390 wait complete. 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner: 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner:Ran 10 tests in 722.524s 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner: 2024-09-13T18:48:20.130 INFO:tasks.cephfs_test_runner:OK 2024-09-13T18:48:20.131 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-13T18:48:20.142 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T18:48:20.149 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T18:48:20.149 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:20.149 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:20.185 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:48:20.185 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-13T18:48:20.185 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:20.260 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052617,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248976k,nr_inodes=812244,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497956k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-13T18:48:20.261 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:48:20.261 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:20.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:48:20.301 DEBUG:teuthology.orchestra.run.smithi194:> set -ex 2024-09-13T18:48:20.301 DEBUG:teuthology.orchestra.run.smithi194:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T18:48:20.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4052632,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248988k,nr_inodes=812247,mode=700,uid=1000,gid=1333 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497980k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-13T18:48:20.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:20.378 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:48:20.412 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T18:48:20.412 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-13T18:48:20.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:20.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T18:48:20.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:20.511 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-13T18:48:20.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:20.819 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-13T18:48:21.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.124 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-13T18:48:21.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.160 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-13T18:48:21.259 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-13T18:48:21.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:21.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.262 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:48:21.303 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T18:48:21.303 INFO:teuthology.orchestra.run.smithi194.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-13T18:48:21.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.303 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T18:48:21.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.405 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-13T18:48:21.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.679 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-09-13T18:48:21.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.954 DEBUG:teuthology.orchestra.run.smithi194:> ip netns list 2024-09-13T18:48:21.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T18:48:21.989 DEBUG:teuthology.orchestra.run.smithi194:> sudo ip link delete ceph-brx 2024-09-13T18:48:22.088 INFO:teuthology.orchestra.run.smithi194.stderr:Cannot find device "ceph-brx" 2024-09-13T18:48:22.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:22.091 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-13T18:48:22.100 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-13T18:48:22.100 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:22.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.262+0000 7efc85000640 1 Processor -- start 2024-09-13T18:48:22.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.262+0000 7efc85000640 1 -- start start 2024-09-13T18:48:22.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc85000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efc80159b00 0x7efc800b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc85000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015af60 con 0x7efc8006bc30 2024-09-13T18:48:22.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc85000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015aa40 con 0x7efc8015a5f0 2024-09-13T18:48:22.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc85000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8006b7a0 con 0x7efc80159b00 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc77e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7efc8006bc30 0x7efc80159ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33320/0 (socket says 172.21.15.192:33320) 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc77e00640 1 -- 172.21.15.192:0/741596404 learned_addr learned my addr 172.21.15.192:0/741596404 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.263+0000 7efc7f400640 1 --2- 172.21.15.192:0/741596404 >> v2:172.21.15.194:3300/0 conn(0x7efc80159b00 0x7efc800b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 45853575 0 0) 0x7efc8015af60 con 0x7efc8006bc30 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc64003520 con 0x7efc8006bc30 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570928129 0 0) 0x7efc78001490 con 0x7efc8015a5f0 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc8015af60 con 0x7efc8015a5f0 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7f400640 1 -- 172.21.15.192:0/741596404 >> v1:172.21.15.194:6789/0 conn(0x7efc8015a5f0 legacy=0x7efc800cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7f400640 1 -- 172.21.15.192:0/741596404 >> v1:172.21.15.192:6789/0 conn(0x7efc8006bc30 legacy=0x7efc80159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.264+0000 7efc7f400640 1 -- 172.21.15.192:0/741596404 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015ac80 con 0x7efc80159b00 2024-09-13T18:48:22.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.265+0000 7efc7f400640 1 --2- 172.21.15.192:0/741596404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800b2d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efc700097a0 tx=0x7efc7002a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=323a89cdf970f65e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.265+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70032440 con 0x7efc80159b00 2024-09-13T18:48:22.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700325a0 con 0x7efc80159b00 2024-09-13T18:48:22.268 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc7ea00640 1 -- 172.21.15.192:0/741596404 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70032930 con 0x7efc80159b00 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 -- 172.21.15.192:0/741596404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 msgr2=0x7efc800b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 --2- 172.21.15.192:0/741596404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800b2d70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7efc700097a0 tx=0x7efc7002a230 comp rx=0 tx=0).stop 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 -- 172.21.15.192:0/741596404 shutdown_connections 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 --2- 172.21.15.192:0/741596404 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800b2d70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 -- 172.21.15.192:0/741596404 >> 172.21.15.192:0/741596404 conn(0x7efc800736d0 msgr2=0x7efc800b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.269 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 -- 172.21.15.192:0/741596404 shutdown_connections 2024-09-13T18:48:22.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.266+0000 7efc85000640 1 -- 172.21.15.192:0/741596404 wait complete. 2024-09-13T18:48:22.270 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.268+0000 7efc85000640 1 Processor -- start 2024-09-13T18:48:22.271 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.268+0000 7efc85000640 1 -- start start 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 0x7efc80149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc801e7f90 con 0x7efc8015a5f0 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc801f2f10 con 0x7efc80159b00 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc85000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc801e7310 con 0x7efc8006bc30 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc7fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38964/0 (socket says 172.21.15.192:38964) 2024-09-13T18:48:22.272 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.269+0000 7efc7fe00640 1 -- 172.21.15.192:0/2586909315 learned_addr learned my addr 172.21.15.192:0/2586909315 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7f400640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 0x7efc80149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 -- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 msgr2=0x7efc80149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 0x7efc80149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc77e00640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 -- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 msgr2=0x7efc800af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 -- 172.21.15.192:0/2586909315 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc70009400 con 0x7efc8015a5f0 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7f400640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 0x7efc80149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc77e00640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:22.274 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc7fe00640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7efc7800c770 tx=0x7efc7800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78003b70 con 0x7efc8015a5f0 2024-09-13T18:48:22.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc78003cf0 con 0x7efc8015a5f0 2024-09-13T18:48:22.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc78003ea0 con 0x7efc8015a5f0 2024-09-13T18:48:22.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc801e75f0 con 0x7efc8015a5f0 2024-09-13T18:48:22.275 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.270+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc801e7bb0 con 0x7efc8015a5f0 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.271+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc800cb4b0 con 0x7efc8015a5f0 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.272+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efc7800aa30 con 0x7efc8015a5f0 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.273+0000 7efc77400640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 0x7efc5c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.273+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efc78088c90 con 0x7efc8015a5f0 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.273+0000 7efc7f400640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 0x7efc5c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.276 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.274+0000 7efc7f400640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 0x7efc5c06d0f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7efc70034000 tx=0x7efc7002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.280 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.278+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7efc78054160 con 0x7efc8015a5f0 2024-09-13T18:48:22.443 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.440+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc8006b430 con 0x7efc5c06ac30 2024-09-13T18:48:22.445 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.443+0000 7efc77400640 1 -- 172.21.15.192:0/2586909315 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49683 (secure 0 0 0) 0x7efc70041090 con 0x7efc5c06ac30 2024-09-13T18:48:22.446 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:22.446 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 msgr2=0x7efc5c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 0x7efc5c06d0f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7efc70034000 tx=0x7efc7002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 msgr2=0x7efc800afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7efc7800c770 tx=0x7efc7800cc30 comp rx=0 tx=0).stop 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 shutdown_connections 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efc5c06ac30 0x7efc5c06d0f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efc8015a5f0 0x7efc800afc20 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.448 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efc80159b00 0x7efc800af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 --2- 172.21.15.192:0/2586909315 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efc8006bc30 0x7efc80149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 >> 172.21.15.192:0/2586909315 conn(0x7efc800736d0 msgr2=0x7efc800cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 shutdown_connections 2024-09-13T18:48:22.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.445+0000 7efc85000640 1 -- 172.21.15.192:0/2586909315 wait complete. 2024-09-13T18:48:22.464 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2024-09-13T18:48:20.909465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":92040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1470459,"statfs":{"total":1600000000,"available":1505750699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490847,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-123,"num_write_kb":-85083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001476"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.083361+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:48:16.083361+0000","last_peered":"2024-09-13T18:48:16.083361+0000","last_clean":"2024-09-13T18:48:16.083361+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:48:16.083361+0000","last_undegraded":"2024-09-13T18:48:16.083361+0000","last_fullsized":"2024-09-13T18:48:16.083361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193608,"statfs":{"total":200000000,"available":198255558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.629,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.94799999999999995,"15min":1.014},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.68500000000000005},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.48699999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":1.004,"15min":1.004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.83399999999999996,"5min":0.93799999999999994,"15min":0.999},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.77000000000000002},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71299999999999997,"15min":0.76400000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.88,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.372,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.97599999999999998,"15min":1.036},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.83099999999999996,"5min":1.004,"15min":1.1799999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.38300000000000001},"max":{"1min":0.84599999999999997,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.94799999999999995,"15min":1.371},"last":0.749}]},{"osd":7,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.143},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.95699999999999996,"15min":1.125},"last":0.72299999999999998}]}]},{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5217,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190094,"statfs":{"total":200000000,"available":194657187,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.67800000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.91400000000000003,"5min":0.93200000000000005,"15min":1.665},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71199999999999997,"15min":0.66900000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.591},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.439},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":2.2709999999999999},"last":0.62},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.72499999999999998},"min":{"1min":0.54300000000000004,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":2.169},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.4450000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0780000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.0840000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68700000000000006,"15min":0.66800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.98999999999999999,"15min":1.115},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.98699999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1699999999999999},"last":0.71799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177806,"statfs":{"total":200000000,"available":182074275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.748},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":1.02,"15min":6.4539999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.65900000000000003},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.01},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.46200000000000002,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":1.038,"15min":6.5019999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.67600000000000005},"min":{"1min":0.57799999999999996,"5min":0.48699999999999999,"15min":0.41599999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.032},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70799999999999996,"15min":0.77400000000000002},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.69399999999999995},"min":{"1min":0.53300000000000003,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.048,"15min":1.048},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.749}]},{"osd":5,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.59899999999999998},"min":{"1min":0.436,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.871,"15min":1.5509999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.88400000000000001,"15min":1.403},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185998,"statfs":{"total":200000000,"available":190462883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.47399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":2.0579999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.57199999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":1.014,"15min":2.3399999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":0.94899999999999995,"15min":1.48},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.97599999999999998,"15min":2.8180000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.373},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":3.706},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":3.742},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40799999999999997},"max":{"1min":0.82699999999999996,"5min":1.085,"15min":3.6909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.996,"15min":2.1379999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.9970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":4.4569999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.74099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.91800000000000004,"5min":0.93700000000000006,"15min":8.5519999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":3.7989999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.94599999999999995,"15min":5.5069999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.97699999999999998,"15min":4.5259999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":11361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":183950,"statfs":{"total":200000000,"available":188365731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.437},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.371,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.627,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.59399999999999997},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.68600000000000005,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":4.7919999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.83499999999999996,"15min":7.798},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":1,"5min":1.028,"15min":3.093},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.48999999999999999},"max":{"1min":0.92700000000000005,"5min":1.0700000000000001,"15min":3.0299999999999998},"last":1.071},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73699999999999999},"min":{"1min":0.60199999999999998,"5min":0.51800000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.2,"15min":1.2},"last":1.101}]},{"osd":6,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.85399999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51600000000000001},"max":{"1min":0.98199999999999998,"5min":1.0700000000000001,"15min":7.9199999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.81399999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":8.0519999999999996},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":1.1879999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190100,"statfs":{"total":200000000,"available":194662406,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40699999999999997,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.624,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.31900000000000001},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.77400000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.747,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.111,"15min":1.111},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.47299999999999998},"max":{"1min":1.016,"5min":1.327,"15min":1.423},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.095,"15min":1.6200000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.266,"15min":1.329},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.6220000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81499999999999995,"15min":0.77000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.0509999999999999,"5min":1.198,"15min":1.508},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22178,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173134,"statfs":{"total":200000000,"available":177289603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.27000000000000002},"max":{"1min":0.55400000000000005,"5min":0.628,"15min":1.036},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.27900000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.85399999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46800000000000003},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.139,"15min":1.3029999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74299999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.242},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53200000000000003},"max":{"1min":1.018,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.56999999999999995,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19547,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175764,"statfs":{"total":200000000,"available":179983056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.25,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.669},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78200000000000003,"15min":0.874},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.591},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":1.03},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.637},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.71999999999999997},"min":{"1min":0.58699999999999997,"5min":0.46899999999999997,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.056,"15min":1.698},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.77600000000000002},"min":{"1min":0.628,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.48599999999999999,"15min":0.47299999999999998},"max":{"1min":1.071,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.56100000000000005,"5min":0.51300000000000001,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.236,"15min":1.236},"last":0.754}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.753},"min":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.45700000000000002},"max":{"1min":0.99099999999999999,"5min":1.165,"15min":2.3399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.45900000000000002},"max":{"1min":1.1020000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.92500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:48:22.465 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:22.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.614+0000 7fdf75e00640 1 Processor -- start 2024-09-13T18:48:22.617 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.614+0000 7fdf75e00640 1 -- start start 2024-09-13T18:48:22.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf75e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf75e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf7015ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf75e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf700b2f00 con 0x7fdf700b3f10 2024-09-13T18:48:22.618 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf75e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700b3150 con 0x7fdf7015dee0 2024-09-13T18:48:22.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf75e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700b3430 con 0x7fdf7015e2c0 2024-09-13T18:48:22.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.615+0000 7fdf6ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6ea00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38978/0 (socket says 172.21.15.192:38978) 2024-09-13T18:48:22.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6ea00640 1 -- 172.21.15.192:0/1682700882 learned_addr learned my addr 172.21.15.192:0/1682700882 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:22.619 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1682700882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf7015ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6e000640 1 -- 172.21.15.192:0/1682700882 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4127562327 0 0) 0x7fdf700b2f00 con 0x7fdf700b3f10 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6f400640 1 -- 172.21.15.192:0/1682700882 >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 msgr2=0x7fdf700afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1682700882 >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6f400640 1 -- 172.21.15.192:0/1682700882 >> v1:172.21.15.194:6789/0 conn(0x7fdf700b3f10 legacy=0x7fdf7015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6f400640 1 -- 172.21.15.192:0/1682700882 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700b3710 con 0x7fdf7015e2c0 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.616+0000 7fdf6ea00640 1 --2- 172.21.15.192:0/1682700882 >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.617+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1682700882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf7015ab50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009d90 tx=0x7fdf6802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e45e146f27aa7178 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.617+0000 7fdf6e000640 1 -- 172.21.15.192:0/1682700882 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68007740 con 0x7fdf7015e2c0 2024-09-13T18:48:22.620 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.617+0000 7fdf6e000640 1 -- 172.21.15.192:0/1682700882 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6802d050 con 0x7fdf7015e2c0 2024-09-13T18:48:22.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.617+0000 7fdf6e000640 1 -- 172.21.15.192:0/1682700882 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68007ac0 con 0x7fdf7015e2c0 2024-09-13T18:48:22.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 -- 172.21.15.192:0/1682700882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 msgr2=0x7fdf7015ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1682700882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf7015ab50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009d90 tx=0x7fdf6802a660 comp rx=0 tx=0).stop 2024-09-13T18:48:22.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 -- 172.21.15.192:0/1682700882 shutdown_connections 2024-09-13T18:48:22.621 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1682700882 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf7015ab50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1682700882 >> v2:172.21.15.192:3300/0 conn(0x7fdf7015dee0 0x7fdf700afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 -- 172.21.15.192:0/1682700882 >> 172.21.15.192:0/1682700882 conn(0x7fdf700ae960 msgr2=0x7fdf7006beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 -- 172.21.15.192:0/1682700882 shutdown_connections 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.618+0000 7fdf75e00640 1 -- 172.21.15.192:0/1682700882 wait complete. 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.620+0000 7fdf75e00640 1 Processor -- start 2024-09-13T18:48:22.622 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.620+0000 7fdf75e00640 1 -- start start 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7015dee0 0x7fdf70154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf70128fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7013a3a0 con 0x7fdf701294e0 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf70155190 con 0x7fdf7015dee0 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf75e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf701377e0 con 0x7fdf7015e2c0 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf6f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf6f400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:38994/0 (socket says 172.21.15.192:38994) 2024-09-13T18:48:22.624 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf6f400640 1 -- 172.21.15.192:0/1792420045 learned_addr learned my addr 172.21.15.192:0/1792420045 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:22.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf66000640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf70128fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.625 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.621+0000 7fdf6ea00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7015dee0 0x7fdf70154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 -- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 msgr2=0x7fdf70128fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf70128fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 -- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7015dee0 msgr2=0x7fdf70154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7015dee0 0x7fdf70154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 -- 172.21.15.192:0/1792420045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600094d0 con 0x7fdf701294e0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf6f400640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009d90 tx=0x7fdf68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68003b90 con 0x7fdf701294e0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf68003cf0 con 0x7fdf701294e0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6803c930 con 0x7fdf701294e0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.622+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf68009a70 con 0x7fdf701294e0 2024-09-13T18:48:22.626 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.623+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf70137120 con 0x7fdf701294e0 2024-09-13T18:48:22.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.624+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf70136f80 con 0x7fdf701294e0 2024-09-13T18:48:22.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.624+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fdf6803ca90 con 0x7fdf701294e0 2024-09-13T18:48:22.627 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.625+0000 7fdf67e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 0x7fdf4c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.625+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdf680aa180 con 0x7fdf701294e0 2024-09-13T18:48:22.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.625+0000 7fdf6ea00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 0x7fdf4c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.628 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.626+0000 7fdf6ea00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 0x7fdf4c06d0c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006ca0 tx=0x7fdf60009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.632 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.629+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fdf70136f80 con 0x7fdf701294e0 2024-09-13T18:48:22.799 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.796+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdf70136f80 con 0x7fdf4c06ac00 2024-09-13T18:48:22.801 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.799+0000 7fdf67e00640 1 -- 172.21.15.192:0/1792420045 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49683 (secure 0 0 0) 0x7fdf70136f80 con 0x7fdf4c06ac00 2024-09-13T18:48:22.802 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:22.802 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 msgr2=0x7fdf4c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 0x7fdf4c06d0c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fdf60006ca0 tx=0x7fdf60009240 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 msgr2=0x7fdf701f4130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdf68009d90 tx=0x7fdf68004a40 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 shutdown_connections 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fdf4c06ac00 0x7fdf4c06d0c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf701294e0 0x7fdf701f4130 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fdf7015e2c0 0x7fdf70128fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 --2- 172.21.15.192:0/1792420045 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fdf7015dee0 0x7fdf70154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.804 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 >> 172.21.15.192:0/1792420045 conn(0x7fdf700ae960 msgr2=0x7fdf700707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 shutdown_connections 2024-09-13T18:48:22.805 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.801+0000 7fdf75e00640 1 -- 172.21.15.192:0/1792420045 wait complete. 2024-09-13T18:48:22.819 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2024-09-13T18:48:20.909465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":92040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1470459,"statfs":{"total":1600000000,"available":1505750699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490847,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-123,"num_write_kb":-85083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001476"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.083361+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:48:16.083361+0000","last_peered":"2024-09-13T18:48:16.083361+0000","last_clean":"2024-09-13T18:48:16.083361+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:48:16.083361+0000","last_undegraded":"2024-09-13T18:48:16.083361+0000","last_fullsized":"2024-09-13T18:48:16.083361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193608,"statfs":{"total":200000000,"available":198255558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.629,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.94799999999999995,"15min":1.014},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.68500000000000005},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.48699999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":1.004,"15min":1.004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.83399999999999996,"5min":0.93799999999999994,"15min":0.999},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.77000000000000002},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71299999999999997,"15min":0.76400000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.88,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.372,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.97599999999999998,"15min":1.036},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.83099999999999996,"5min":1.004,"15min":1.1799999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.38300000000000001},"max":{"1min":0.84599999999999997,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.94799999999999995,"15min":1.371},"last":0.749}]},{"osd":7,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.143},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.95699999999999996,"15min":1.125},"last":0.72299999999999998}]}]},{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5217,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190094,"statfs":{"total":200000000,"available":194657187,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.67800000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.91400000000000003,"5min":0.93200000000000005,"15min":1.665},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71199999999999997,"15min":0.66900000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.591},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.439},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":2.2709999999999999},"last":0.62},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.72499999999999998},"min":{"1min":0.54300000000000004,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":2.169},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.4450000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0780000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.0840000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68700000000000006,"15min":0.66800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.98999999999999999,"15min":1.115},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.98699999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1699999999999999},"last":0.71799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177806,"statfs":{"total":200000000,"available":182074275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.748},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":1.02,"15min":6.4539999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.65900000000000003},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.01},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.46200000000000002,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":1.038,"15min":6.5019999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.67600000000000005},"min":{"1min":0.57799999999999996,"5min":0.48699999999999999,"15min":0.41599999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.032},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70799999999999996,"15min":0.77400000000000002},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.69399999999999995},"min":{"1min":0.53300000000000003,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.048,"15min":1.048},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.749}]},{"osd":5,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.59899999999999998},"min":{"1min":0.436,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.871,"15min":1.5509999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.88400000000000001,"15min":1.403},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185998,"statfs":{"total":200000000,"available":190462883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.47399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":2.0579999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.57199999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":1.014,"15min":2.3399999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":0.94899999999999995,"15min":1.48},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.97599999999999998,"15min":2.8180000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.373},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":3.706},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":3.742},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40799999999999997},"max":{"1min":0.82699999999999996,"5min":1.085,"15min":3.6909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.996,"15min":2.1379999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.9970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":4.4569999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.74099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.91800000000000004,"5min":0.93700000000000006,"15min":8.5519999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":3.7989999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.94599999999999995,"15min":5.5069999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.97699999999999998,"15min":4.5259999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":11361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":183950,"statfs":{"total":200000000,"available":188365731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.437},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.371,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.627,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.59399999999999997},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.68600000000000005,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":4.7919999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.83499999999999996,"15min":7.798},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":1,"5min":1.028,"15min":3.093},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.48999999999999999},"max":{"1min":0.92700000000000005,"5min":1.0700000000000001,"15min":3.0299999999999998},"last":1.071},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73699999999999999},"min":{"1min":0.60199999999999998,"5min":0.51800000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.2,"15min":1.2},"last":1.101}]},{"osd":6,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.85399999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51600000000000001},"max":{"1min":0.98199999999999998,"5min":1.0700000000000001,"15min":7.9199999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.81399999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":8.0519999999999996},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":1.1879999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190100,"statfs":{"total":200000000,"available":194662406,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40699999999999997,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.624,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.31900000000000001},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.77400000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.747,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.111,"15min":1.111},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.47299999999999998},"max":{"1min":1.016,"5min":1.327,"15min":1.423},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.095,"15min":1.6200000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.266,"15min":1.329},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.6220000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81499999999999995,"15min":0.77000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.0509999999999999,"5min":1.198,"15min":1.508},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22178,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173134,"statfs":{"total":200000000,"available":177289603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.27000000000000002},"max":{"1min":0.55400000000000005,"5min":0.628,"15min":1.036},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.27900000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.85399999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46800000000000003},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.139,"15min":1.3029999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74299999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.242},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53200000000000003},"max":{"1min":1.018,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.56999999999999995,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19547,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175764,"statfs":{"total":200000000,"available":179983056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.25,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.669},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78200000000000003,"15min":0.874},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.591},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":1.03},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.637},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.71999999999999997},"min":{"1min":0.58699999999999997,"5min":0.46899999999999997,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.056,"15min":1.698},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.77600000000000002},"min":{"1min":0.628,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.48599999999999999,"15min":0.47299999999999998},"max":{"1min":1.071,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.56100000000000005,"5min":0.51300000000000001,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.236,"15min":1.236},"last":0.754}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.753},"min":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.45700000000000002},"max":{"1min":0.99099999999999999,"5min":1.165,"15min":2.3399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.45900000000000002},"max":{"1min":1.1020000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.92500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:48:22.821 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-13T18:48:22.821 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.970+0000 7f55c3a00640 1 Processor -- start 2024-09-13T18:48:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.970+0000 7f55c3a00640 1 -- start start 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c3a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55bc0cacd0 0x7f55bc15e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15bc20 0x7f55bc0afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c3a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55bc140480 con 0x7f55bc0cb0b0 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c3a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55bc0cb520 con 0x7f55bc0cacd0 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc15ee90 con 0x7f55bc15bc20 2024-09-13T18:48:22.975 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55bc0cacd0 0x7f55bc15e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f55bc0cacd0 0x7f55bc15e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39006/0 (socket says 172.21.15.192:39006) 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 -- 172.21.15.192:0/1203863638 learned_addr learned my addr 172.21.15.192:0/1203863638 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1a00640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15bc20 0x7f55bc0afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 -- 172.21.15.192:0/1203863638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15bc20 msgr2=0x7f55bc0afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15bc20 0x7f55bc0afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 -- 172.21.15.192:0/1203863638 >> v1:172.21.15.194:6789/0 conn(0x7f55bc0cb0b0 legacy=0x7f55bc140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.976 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.972+0000 7f55c1000640 1 -- 172.21.15.192:0/1203863638 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55bc15f170 con 0x7f55bc0cacd0 2024-09-13T18:48:22.977 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.973+0000 7f55c1000640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0cacd0 0x7f55bc15e790 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009870 tx=0x7f55ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d9e0e87b1219469 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55bbe00640 1 -- 172.21.15.192:0/1203863638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac032440 con 0x7f55bc0cacd0 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55bbe00640 1 -- 172.21.15.192:0/1203863638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac0325a0 con 0x7f55bc0cacd0 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55bbe00640 1 -- 172.21.15.192:0/1203863638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac032930 con 0x7f55bc0cacd0 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 -- 172.21.15.192:0/1203863638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0cacd0 msgr2=0x7f55bc15e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0cacd0 0x7f55bc15e790 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009870 tx=0x7f55ac02a270 comp rx=0 tx=0).stop 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 -- 172.21.15.192:0/1203863638 shutdown_connections 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc15bc20 0x7f55bc0afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1203863638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc0cacd0 0x7f55bc15e790 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 -- 172.21.15.192:0/1203863638 >> 172.21.15.192:0/1203863638 conn(0x7f55bc0ae960 msgr2=0x7f55bc06beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.974+0000 7f55c3a00640 1 -- 172.21.15.192:0/1203863638 shutdown_connections 2024-09-13T18:48:22.978 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.975+0000 7f55c3a00640 1 -- 172.21.15.192:0/1203863638 wait complete. 2024-09-13T18:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.976+0000 7f55c3a00640 1 Processor -- start 2024-09-13T18:48:22.979 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.976+0000 7f55c3a00640 1 -- start start 2024-09-13T18:48:22.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 0x7f55bc13ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0cb0b0 0x7f55bc150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0b2b80 con 0x7f55bc15bc20 2024-09-13T18:48:22.981 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc159b00 con 0x7f55bc0cb0b0 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c3a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55bc0b2dd0 con 0x7f55bc0cacd0 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c1a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39020/0 (socket says 172.21.15.192:39020) 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.977+0000 7f55c1a00640 1 -- 172.21.15.192:0/1055274187 learned_addr learned my addr 172.21.15.192:0/1055274187 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1000640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 0x7f55bc13ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55b3e00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0cb0b0 0x7f55bc150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 -- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 msgr2=0x7f55bc13ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 0x7f55bc13ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 -- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0cb0b0 msgr2=0x7f55bc150b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0cb0b0 0x7f55bc150b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 -- 172.21.15.192:0/1055274187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ac0094d0 con 0x7f55bc15bc20 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1000640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 0x7f55bc13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:22.982 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c1a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f55b4007e40 tx=0x7f55b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b4014620 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b400ee90 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b40149e0 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.978+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55bc0b30b0 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.979+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55bc0b3670 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.980+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55bc15e790 con 0x7f55bc15bc20 2024-09-13T18:48:22.983 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.980+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f55b4014b40 con 0x7f55bc15bc20 2024-09-13T18:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.981+0000 7f55b9600640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 0x7f559806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.981+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f55b4089920 con 0x7f55bc15bc20 2024-09-13T18:48:22.984 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.982+0000 7f55c1000640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 0x7f559806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:22.985 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.982+0000 7f55c1000640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 0x7f559806d0c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f55ac034000 tx=0x7f55ac02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:22.988 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:22.985+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f55b4054e10 con 0x7f55bc15bc20 2024-09-13T18:48:23.154 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.151+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f55bc15c070 con 0x7f559806ac00 2024-09-13T18:48:23.156 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.153+0000 7f55b9600640 1 -- 172.21.15.192:0/1055274187 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49683 (secure 0 0 0) 0x7f55ac032d90 con 0x7f559806ac00 2024-09-13T18:48:23.157 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:23.157 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 msgr2=0x7f559806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 0x7f559806d0c0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f55ac034000 tx=0x7f55ac02e000 comp rx=0 tx=0).stop 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 msgr2=0x7f55bc158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f55b4007e40 tx=0x7f55b400e4b0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 shutdown_connections 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f559806ac00 0x7f559806d0c0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f55bc15bc20 0x7f55bc158d30 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55bc0cb0b0 0x7f55bc150b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.159 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 --2- 172.21.15.192:0/1055274187 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55bc0cacd0 0x7f55bc13ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 >> 172.21.15.192:0/1055274187 conn(0x7f55bc0ae960 msgr2=0x7f55bc0ad840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 shutdown_connections 2024-09-13T18:48:23.160 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.156+0000 7f55c3a00640 1 -- 172.21.15.192:0/1055274187 wait complete. 2024-09-13T18:48:23.175 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":583,"stamp":"2024-09-13T18:48:22.909779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":155,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":92040,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1470459,"statfs":{"total":1600000000,"available":1505750699,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52490847,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-1,"num_read_kb":-1,"num_write":-123,"num_write_kb":-85083,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.830524"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":335,"reported_epoch":202,"state":"active+clean","last_fresh":"2024-09-13T18:48:16.083361+0000","last_change":"2024-09-13T18:35:31.054483+0000","last_active":"2024-09-13T18:48:16.083361+0000","last_peered":"2024-09-13T18:48:16.083361+0000","last_clean":"2024-09-13T18:48:16.083361+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:48:16.083361+0000","last_undegraded":"2024-09-13T18:48:16.083361+0000","last_fullsized":"2024-09-13T18:48:16.083361+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T18:35:29.028602+0000","last_clean_scrub_stamp":"2024-09-13T18:35:29.028602+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T06:21:15.683562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193608,"statfs":{"total":200000000,"available":198255558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.629,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.94799999999999995,"15min":1.014},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.68500000000000005},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.48699999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":1.004,"15min":1.004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.83399999999999996,"5min":0.93799999999999994,"15min":0.999},"last":0.63800000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.77000000000000002},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71299999999999997,"15min":0.76400000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.88,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.372,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.97599999999999998,"15min":1.036},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.83099999999999996,"5min":1.004,"15min":1.1799999999999999},"last":0.58999999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.38300000000000001},"max":{"1min":0.84599999999999997,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.94799999999999995,"15min":1.371},"last":0.749}]},{"osd":7,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.143},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.95699999999999996,"15min":1.125},"last":0.72299999999999998}]}]},{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5217,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190094,"statfs":{"total":200000000,"available":194657187,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.67800000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.91400000000000003,"5min":0.93200000000000005,"15min":1.665},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71199999999999997,"15min":0.66900000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.591},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.439},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":2.2709999999999999},"last":0.62},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.72499999999999998},"min":{"1min":0.54300000000000004,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":2.169},"last":0.65900000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.4450000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.92500000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0780000000000001},"last":0.56699999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.0840000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68700000000000006,"15min":0.66800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.98999999999999999,"15min":1.115},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.98699999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.747},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1699999999999999},"last":0.71799999999999997}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":17505,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":177806,"statfs":{"total":200000000,"available":182074275,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.748},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":1.02,"15min":6.4539999999999997},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.65900000000000003},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.01},"last":0.66500000000000004}]},{"osd":1,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.46200000000000002,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":1.038,"15min":6.5019999999999998},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.67600000000000005},"min":{"1min":0.57799999999999996,"5min":0.48699999999999999,"15min":0.41599999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.032},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70799999999999996,"15min":0.77400000000000002},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.68100000000000005}]},{"osd":3,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.69399999999999995},"min":{"1min":0.53300000000000003,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.048,"15min":1.048},"last":0.71099999999999997}]},{"osd":4,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.749}]},{"osd":5,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.59899999999999998},"min":{"1min":0.436,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.871,"15min":1.5509999999999999},"last":0.495},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.88400000000000001,"15min":1.403},"last":0.52100000000000002}]},{"osd":7,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.69899999999999995}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9313,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185998,"statfs":{"total":200000000,"available":190462883,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.47399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":2.0579999999999998},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.57199999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":1.014,"15min":2.3399999999999999},"last":0.83099999999999996}]},{"osd":1,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":0.94899999999999995,"15min":1.48},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.97599999999999998,"15min":2.8180000000000001},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.373},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":3.706},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":3.742},"last":0.94399999999999995}]},{"osd":3,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40799999999999997},"max":{"1min":0.82699999999999996,"5min":1.085,"15min":3.6909999999999998},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.996,"15min":2.1379999999999999},"last":0.75600000000000001}]},{"osd":5,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.9970000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":4.4569999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.74099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.91800000000000004,"5min":0.93700000000000006,"15min":8.5519999999999996},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":3.7989999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.94599999999999995,"15min":5.5069999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.97699999999999998,"15min":4.5259999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":10,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":11361,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":183950,"statfs":{"total":200000000,"available":188365731,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.437},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.371,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.627,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.59399999999999997},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.436},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.68600000000000005,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.51000000000000001}]},{"osd":2,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":4.7919999999999998},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.83499999999999996,"15min":7.798},"last":0.47599999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":1,"5min":1.028,"15min":3.093},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.871}]},{"osd":5,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.48999999999999999},"max":{"1min":0.92700000000000005,"5min":1.0700000000000001,"15min":3.0299999999999998},"last":1.071},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73699999999999999},"min":{"1min":0.60199999999999998,"5min":0.51800000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.2,"15min":1.2},"last":1.101}]},{"osd":6,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.85399999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51600000000000001},"max":{"1min":0.98199999999999998,"5min":1.0700000000000001,"15min":7.9199999999999999},"last":1.1259999999999999},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.81399999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":8.0519999999999996},"last":0.89000000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":1.1879999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":5212,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":190100,"statfs":{"total":200000000,"available":194662406,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40699999999999997,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.624,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.34300000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.31900000000000001},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.77400000000000002},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.378}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.629}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.747,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.111,"15min":1.111},"last":0.59899999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.47299999999999998},"max":{"1min":1.016,"5min":1.327,"15min":1.423},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.095,"15min":1.6200000000000001},"last":0.60799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.266,"15min":1.329},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.6220000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81499999999999995,"15min":0.77000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.0509999999999999,"5min":1.198,"15min":1.508},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":22178,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173134,"statfs":{"total":200000000,"available":177289603,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.27000000000000002},"max":{"1min":0.55400000000000005,"5min":0.628,"15min":1.036},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.27900000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.85399999999999998},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.36199999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46800000000000003},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.139,"15min":1.3029999999999999},"last":0.68799999999999994}]},{"osd":5,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74299999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.242},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53200000000000003},"max":{"1min":1.018,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.56999999999999995,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.71399999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19547,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175764,"statfs":{"total":200000000,"available":179983056,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.25,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.669},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78200000000000003,"15min":0.874},"last":0.39900000000000002}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.591},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":1.03},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.637},"last":0.45800000000000002}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.21,"15min":1.21},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.71999999999999997},"min":{"1min":0.58699999999999997,"5min":0.46899999999999997,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.056,"15min":1.698},"last":0.82099999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.77600000000000002},"min":{"1min":0.628,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.85299999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.48599999999999999,"15min":0.47299999999999998},"max":{"1min":1.071,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.56100000000000005,"5min":0.51300000000000001,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.236,"15min":1.236},"last":0.754}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.753},"min":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.45700000000000002},"max":{"1min":0.99099999999999999,"5min":1.165,"15min":2.3399999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.45900000000000002},"max":{"1min":1.1020000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.92500000000000004}]}]}],"pool_statfs":[]}} 2024-09-13T18:48:23.177 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-13T18:48:23.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.327+0000 7f085d600640 1 Processor -- start 2024-09-13T18:48:23.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.327+0000 7f085d600640 1 -- start start 2024-09-13T18:48:23.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.328+0000 7f085d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.328+0000 7f085d600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f085815bc20 0x7f08580afd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f085d600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0858140480 con 0x7f08580cb0b0 2024-09-13T18:48:23.331 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f085d600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f085815ee90 con 0x7f085815bc20 2024-09-13T18:48:23.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f085d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085815f170 con 0x7f08580cacd0 2024-09-13T18:48:23.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f0856a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.332 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f0856a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:43510/0 (socket says 172.21.15.192:43510) 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f0856a00640 1 -- 172.21.15.192:0/3145728313 learned_addr learned my addr 172.21.15.192:0/3145728313 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.329+0000 7f0857400640 1 --2- 172.21.15.192:0/3145728313 >> v2:172.21.15.194:3300/0 conn(0x7f085815bc20 0x7f08580afd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.330+0000 7f0856a00640 1 -- 172.21.15.192:0/3145728313 >> v2:172.21.15.194:3300/0 conn(0x7f085815bc20 msgr2=0x7f08580afd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.330+0000 7f0856a00640 1 --2- 172.21.15.192:0/3145728313 >> v2:172.21.15.194:3300/0 conn(0x7f085815bc20 0x7f08580afd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.330+0000 7f0856a00640 1 -- 172.21.15.192:0/3145728313 >> v1:172.21.15.194:6789/0 conn(0x7f08580cb0b0 legacy=0x7f0858140980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.330+0000 7f0856a00640 1 -- 172.21.15.192:0/3145728313 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085815f450 con 0x7f08580cacd0 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f0856a00640 1 --2- 172.21.15.192:0/3145728313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084802a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3aa15c9d865114 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f0855600640 1 -- 172.21.15.192:0/3145728313 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848032440 con 0x7f08580cacd0 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f0855600640 1 -- 172.21.15.192:0/3145728313 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480325a0 con 0x7f08580cacd0 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f0855600640 1 -- 172.21.15.192:0/3145728313 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848032930 con 0x7f08580cacd0 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f085d600640 1 -- 172.21.15.192:0/3145728313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 msgr2=0x7f085815e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f085d600640 1 --2- 172.21.15.192:0/3145728313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0848009870 tx=0x7f084802a270 comp rx=0 tx=0).stop 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f085d600640 1 -- 172.21.15.192:0/3145728313 shutdown_connections 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f085d600640 1 --2- 172.21.15.192:0/3145728313 >> v2:172.21.15.194:3300/0 conn(0x7f085815bc20 0x7f08580afd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.331+0000 7f085d600640 1 --2- 172.21.15.192:0/3145728313 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f08580cacd0 0x7f085815e790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.332+0000 7f085d600640 1 -- 172.21.15.192:0/3145728313 >> 172.21.15.192:0/3145728313 conn(0x7f08580ae960 msgr2=0x7f085806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.332+0000 7f085d600640 1 -- 172.21.15.192:0/3145728313 shutdown_connections 2024-09-13T18:48:23.335 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.332+0000 7f085d600640 1 -- 172.21.15.192:0/3145728313 wait complete. 2024-09-13T18:48:23.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.333+0000 7f085d600640 1 Processor -- start 2024-09-13T18:48:23.336 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.333+0000 7f085d600640 1 -- start start 2024-09-13T18:48:23.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.337 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580cb0b0 0x7f085815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f085815bc20 0x7f085815ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858152d10 con 0x7f08580cacd0 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085812dee0 con 0x7f08580cb0b0 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f085d600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08581544c0 con 0x7f085815bc20 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f0856a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f0856a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39024/0 (socket says 172.21.15.192:39024) 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f0856a00640 1 -- 172.21.15.192:0/2037471076 learned_addr learned my addr 172.21.15.192:0/2037471076 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.334+0000 7f0856000640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580cb0b0 0x7f085815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0857400640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f085815bc20 0x7f085815ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 -- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f085815bc20 msgr2=0x7f085815ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f085815bc20 0x7f085815ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.338 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 -- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580cb0b0 msgr2=0x7f085815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580cb0b0 0x7f085815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 -- 172.21.15.192:0/2037471076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f08580cacd0 2024-09-13T18:48:23.339 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f0856a00640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0848000c00 tx=0x7f08480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.335+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848032440 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.336+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0848030980 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.336+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08581547a0 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.336+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0848030d30 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.336+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858154170 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.337+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580afd80 con 0x7f08580cacd0 2024-09-13T18:48:23.340 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.338+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0848039040 con 0x7f08580cacd0 2024-09-13T18:48:23.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.338+0000 7f084ea00640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 0x7f083806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:23.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.339+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f08480a9900 con 0x7f08580cacd0 2024-09-13T18:48:23.341 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.339+0000 7f0856000640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 0x7f083806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:23.342 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.339+0000 7f0856000640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 0x7f083806d0c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08580ce5d0 tx=0x7f0844009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:23.345 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.342+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f0848074df0 con 0x7f08580cacd0 2024-09-13T18:48:23.514 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.511+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f085815d210 con 0x7f08580cacd0 2024-09-13T18:48:23.515 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.512+0000 7f084ea00640 1 -- 172.21.15.192:0/2037471076 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v204) v1 ==== 74+0+13059 (secure 0 0 0) 0x7f0848078410 con 0x7f08580cacd0 2024-09-13T18:48:23.515 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:23.515 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":204,"fsid":"5e3ff1eb-2fb8-41d1-9304-859f6d9757cb","created":"2024-09-13T18:35:21.980890+0000","modified":"2024-09-13T18:48:19.099536+0000","last_up_change":"2024-09-13T18:35:29.028602+0000","last_in_change":"2024-09-13T18:35:24.785692+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T18:35:28.785395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6823","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6825","nonce":4155920616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6827","nonce":4155920616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6830","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6831","nonce":4155920616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6828","nonce":4155920616},{"type":"v1","addr":"172.21.15.192:6829","nonce":4155920616}]},"public_addr":"172.21.15.192:6825/4155920616","cluster_addr":"172.21.15.192:6827/4155920616","heartbeat_back_addr":"172.21.15.192:6831/4155920616","heartbeat_front_addr":"172.21.15.192:6829/4155920616","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6817","nonce":4129826895}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6819","nonce":4129826895}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6824","nonce":4129826895}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":4129826895},{"type":"v1","addr":"172.21.15.192:6821","nonce":4129826895}]},"public_addr":"172.21.15.192:6817/4129826895","cluster_addr":"172.21.15.192:6819/4129826895","heartbeat_back_addr":"172.21.15.192:6824/4129826895","heartbeat_front_addr":"172.21.15.192:6821/4129826895","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6809","nonce":1589536644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6811","nonce":1589536644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6815","nonce":1589536644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1589536644},{"type":"v1","addr":"172.21.15.192:6813","nonce":1589536644}]},"public_addr":"172.21.15.192:6809/1589536644","cluster_addr":"172.21.15.192:6811/1589536644","heartbeat_back_addr":"172.21.15.192:6815/1589536644","heartbeat_front_addr":"172.21.15.192:6813/1589536644","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6801","nonce":2116235987}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6803","nonce":2116235987}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6807","nonce":2116235987}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2116235987},{"type":"v1","addr":"172.21.15.192:6805","nonce":2116235987}]},"public_addr":"172.21.15.192:6801/2116235987","cluster_addr":"172.21.15.192:6803/2116235987","heartbeat_back_addr":"172.21.15.192:6807/2116235987","heartbeat_front_addr":"172.21.15.192:6805/2116235987","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6800","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6801","nonce":2064160374}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6802","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6803","nonce":2064160374}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6806","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6807","nonce":2064160374}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6804","nonce":2064160374},{"type":"v1","addr":"172.21.15.194:6805","nonce":2064160374}]},"public_addr":"172.21.15.194:6801/2064160374","cluster_addr":"172.21.15.194:6803/2064160374","heartbeat_back_addr":"172.21.15.194:6807/2064160374","heartbeat_front_addr":"172.21.15.194:6805/2064160374","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6817","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6819","nonce":1215883585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6821","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6823","nonce":1215883585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6829","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6831","nonce":1215883585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6825","nonce":1215883585},{"type":"v1","addr":"172.21.15.194:6827","nonce":1215883585}]},"public_addr":"172.21.15.194:6819/1215883585","cluster_addr":"172.21.15.194:6823/1215883585","heartbeat_back_addr":"172.21.15.194:6831/1215883585","heartbeat_front_addr":"172.21.15.194:6827/1215883585","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6808","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6809","nonce":3931263301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6810","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6811","nonce":3931263301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6814","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6815","nonce":3931263301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6812","nonce":3931263301},{"type":"v1","addr":"172.21.15.194:6813","nonce":3931263301}]},"public_addr":"172.21.15.194:6809/3931263301","cluster_addr":"172.21.15.194:6811/3931263301","heartbeat_back_addr":"172.21.15.194:6815/3931263301","heartbeat_front_addr":"172.21.15.194:6813/3931263301","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":195,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6816","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6818","nonce":4082236586}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6820","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6822","nonce":4082236586}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6828","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6830","nonce":4082236586}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6824","nonce":4082236586},{"type":"v1","addr":"172.21.15.194:6826","nonce":4082236586}]},"public_addr":"172.21.15.194:6818/4082236586","cluster_addr":"172.21.15.194:6822/4082236586","heartbeat_back_addr":"172.21.15.194:6830/4082236586","heartbeat_front_addr":"172.21.15.194:6826/4082236586","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.035279+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.081910+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.052665+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.968428+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:25.948128+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.089221+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.048828+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T18:35:26.011073+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.194:6834/1492074018":"2024-09-14T18:48:16.075379+0000","172.21.15.194:6833/1492074018":"2024-09-14T18:48:16.075379+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 msgr2=0x7f083806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 0x7f083806d0c0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08580ce5d0 tx=0x7f0844009040 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 msgr2=0x7f08581527d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f0848000c00 tx=0x7f08480046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 shutdown_connections 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f083806ac00 0x7f083806d0c0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f085815bc20 0x7f085815ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f08580cb0b0 0x7f085815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 --2- 172.21.15.192:0/2037471076 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f08580cacd0 0x7f08581527d0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 >> 172.21.15.192:0/2037471076 conn(0x7f08580ae960 msgr2=0x7f085815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:23.518 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 shutdown_connections 2024-09-13T18:48:23.519 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:23.515+0000 7f085d600640 1 -- 172.21.15.192:0/2037471076 wait complete. 2024-09-13T18:48:24.534 INFO:tasks.ceph:Scrubbing osd.0 2024-09-13T18:48:24.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:24.701 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.699+0000 7f93d3e00640 1 Processor -- start 2024-09-13T18:48:24.702 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.699+0000 7f93d3e00640 1 -- start start 2024-09-13T18:48:24.703 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 0x7f93d40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3e00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 0x7f93d40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3e00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93d40ae1e0 con 0x7f93d40cc910 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3e00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d40cde80 con 0x7f93d40add80 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40cd200 con 0x7f93d415a920 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f93d40cc910 0x7f93d406aeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33326/0 (socket says 172.21.15.192:33326) 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d3400640 1 -- 172.21.15.192:0/1574912568 learned_addr learned my addr 172.21.15.192:0/1574912568 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d2a00640 1 --2- 172.21.15.192:0/1574912568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 0x7f93d40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.700+0000 7f93d2000640 1 --2- 172.21.15.192:0/1574912568 >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 0x7f93d40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d1600640 1 -- 172.21.15.192:0/1574912568 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057224852 0 0) 0x7f93d40ae1e0 con 0x7f93d40cc910 2024-09-13T18:48:24.704 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d1600640 1 -- 172.21.15.192:0/1574912568 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b8003520 con 0x7f93d40cc910 2024-09-13T18:48:24.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d2a00640 1 -- 172.21.15.192:0/1574912568 >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 msgr2=0x7f93d40cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:24.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d2a00640 1 --2- 172.21.15.192:0/1574912568 >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 0x7f93d40cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d2a00640 1 -- 172.21.15.192:0/1574912568 >> v1:172.21.15.192:6789/0 conn(0x7f93d40cc910 legacy=0x7f93d406aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d2a00640 1 -- 172.21.15.192:0/1574912568 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d40cd4e0 con 0x7f93d415a920 2024-09-13T18:48:24.705 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.701+0000 7f93d2000640 1 --2- 172.21.15.192:0/1574912568 >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 0x7f93d40cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:24.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.702+0000 7f93d2a00640 1 --2- 172.21.15.192:0/1574912568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 0x7f93d40ad840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009d90 tx=0x7f93c402a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=469ac3bf9ae8e2e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.702+0000 7f93d1600640 1 -- 172.21.15.192:0/1574912568 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4031600 con 0x7f93d415a920 2024-09-13T18:48:24.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.702+0000 7f93d1600640 1 -- 172.21.15.192:0/1574912568 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c402d050 con 0x7f93d415a920 2024-09-13T18:48:24.706 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.702+0000 7f93d1600640 1 -- 172.21.15.192:0/1574912568 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c4031960 con 0x7f93d415a920 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 -- 172.21.15.192:0/1574912568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 msgr2=0x7f93d40ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 --2- 172.21.15.192:0/1574912568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 0x7f93d40ad840 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f93c4009d90 tx=0x7f93c402a5d0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 -- 172.21.15.192:0/1574912568 shutdown_connections 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 --2- 172.21.15.192:0/1574912568 >> v2:172.21.15.194:3300/0 conn(0x7f93d40add80 0x7f93d40cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 --2- 172.21.15.192:0/1574912568 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d415a920 0x7f93d40ad840 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 -- 172.21.15.192:0/1574912568 >> 172.21.15.192:0/1574912568 conn(0x7f93d40cef60 msgr2=0x7f93d40b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 -- 172.21.15.192:0/1574912568 shutdown_connections 2024-09-13T18:48:24.707 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.703+0000 7f93d3e00640 1 -- 172.21.15.192:0/1574912568 wait complete. 2024-09-13T18:48:24.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.704+0000 7f93d3e00640 1 Processor -- start 2024-09-13T18:48:24.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.704+0000 7f93d3e00640 1 -- start start 2024-09-13T18:48:24.709 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d40add80 0x7f93d414d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40cc910 0x7f93d40706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 0x7f93d40c4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d40c4e00 con 0x7f93d415a920 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d406f910 con 0x7f93d40cc910 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.705+0000 7f93d3e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d406fbf0 con 0x7f93d40add80 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 0x7f93d40c4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 0x7f93d40c4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39040/0 (socket says 172.21.15.192:39040) 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 -- 172.21.15.192:0/3901105822 learned_addr learned my addr 172.21.15.192:0/3901105822 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d2a00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d40add80 0x7f93d414d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d2000640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40cc910 0x7f93d40706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.710 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 -- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d40add80 msgr2=0x7f93d414d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f93d40add80 0x7f93d414d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 -- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40cc910 msgr2=0x7f93d40706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f93d40cc910 0x7f93d40706d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009400 con 0x7f93d415a920 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.706+0000 7f93d3400640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 0x7f93d40c4360 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c430 tx=0x7f93cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.707+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc005ce0 con 0x7f93d415a920 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.707+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93cc005e40 con 0x7f93d415a920 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.707+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93cc007310 con 0x7f93d415a920 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.707+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c4009a70 con 0x7f93d415a920 2024-09-13T18:48:24.711 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.707+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d40701b0 con 0x7f93d415a920 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.708+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93d40cdaa0 con 0x7f93d415a920 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.709+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f93cc007470 con 0x7f93d415a920 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.709+0000 7f93caa00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93b406ac00 0x7f93b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f93cc088570 con 0x7f93d415a920 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93d2a00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93b406ac00 0x7f93b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93caa00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f93b4070a60 0x7f93b4072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f93b4073530 con 0x7f93b4070a60 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93cc08ac30 con 0x7f93d415a920 2024-09-13T18:48:24.713 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93d2000640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f93b4070a60 0x7f93b4072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.710+0000 7f93d2a00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93b406ac00 0x7f93b406d0c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f93c4034000 tx=0x7f93c402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.711+0000 7f93d2000640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f93b4070a60 0x7f93b4072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.714 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.711+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== osd.0 v2:172.21.15.192:6823/4155920616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f93b4073530 con 0x7f93b4070a60 2024-09-13T18:48:24.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.723+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 --> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f93d40703d0 con 0x7f93b4070a60 2024-09-13T18:48:24.726 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.723+0000 7f93caa00640 1 -- 172.21.15.192:0/3901105822 <== osd.0 v2:172.21.15.192:6823/4155920616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f93d40703d0 con 0x7f93b4070a60 2024-09-13T18:48:24.726 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:24.726 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:24.727 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.723+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f93b4070a60 msgr2=0x7f93b4072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.723+0000 7f93d3e00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6823/4155920616,v1:172.21.15.192:6825/4155920616] conn(0x7f93b4070a60 0x7f93b4072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93b406ac00 msgr2=0x7f93b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f93b406ac00 0x7f93b406d0c0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f93c4034000 tx=0x7f93c402f000 comp rx=0 tx=0).stop 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 msgr2=0x7f93d40c4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.728 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 --2- 172.21.15.192:0/3901105822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f93d415a920 0x7f93d40c4360 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f93cc00c430 tx=0x7f93cc00c8f0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3400640 1 -- 172.21.15.192:0/3901105822 reap_dead start 2024-09-13T18:48:24.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 shutdown_connections 2024-09-13T18:48:24.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 >> 172.21.15.192:0/3901105822 conn(0x7f93d40cef60 msgr2=0x7f93d415b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 shutdown_connections 2024-09-13T18:48:24.729 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.724+0000 7f93d3e00640 1 -- 172.21.15.192:0/3901105822 wait complete. 2024-09-13T18:48:24.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-13T18:48:24.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.891+0000 7f557a800640 1 Processor -- start 2024-09-13T18:48:24.894 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.891+0000 7f557a800640 1 -- start start 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.892+0000 7f557a800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 0x7f557415a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.892+0000 7f557a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 0x7f55740afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.892+0000 7f557a800640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55740cd570 con 0x7f55740b0290 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.892+0000 7f557a800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55740b06c0 con 0x7f55740cb490 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.892+0000 7f557a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55740cd7a0 con 0x7f55740b3c60 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5573e00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f55740b0290 0x7f55740cbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33338/0 (socket says 172.21.15.192:33338) 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5573e00640 1 -- 172.21.15.192:0/2085019496 learned_addr learned my addr 172.21.15.192:0/2085019496 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5573400640 1 --2- 172.21.15.192:0/2085019496 >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 0x7f557415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.897 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f556aa00640 1 --2- 172.21.15.192:0/2085019496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 0x7f55740afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5572a00640 1 -- 172.21.15.192:0/2085019496 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769180374 0 0) 0x7f55740cd570 con 0x7f55740b0290 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5572a00640 1 -- 172.21.15.192:0/2085019496 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5558005730 con 0x7f55740b0290 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f556aa00640 1 -- 172.21.15.192:0/2085019496 >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 msgr2=0x7f557415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f556aa00640 1 --2- 172.21.15.192:0/2085019496 >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 0x7f557415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f556aa00640 1 -- 172.21.15.192:0/2085019496 >> v1:172.21.15.192:6789/0 conn(0x7f55740b0290 legacy=0x7f55740cbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f556aa00640 1 -- 172.21.15.192:0/2085019496 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55740cda80 con 0x7f55740b3c60 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.893+0000 7f5573400640 1 --2- 172.21.15.192:0/2085019496 >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 0x7f557415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:24.898 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.894+0000 7f556aa00640 1 --2- 172.21.15.192:0/2085019496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 0x7f55740afd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f555c0097a0 tx=0x7f555c02a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba989ace875737c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f5572a00640 1 -- 172.21.15.192:0/2085019496 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c02ae50 con 0x7f55740b3c60 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f5572a00640 1 -- 172.21.15.192:0/2085019496 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f555c032440 con 0x7f55740b3c60 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f5572a00640 1 -- 172.21.15.192:0/2085019496 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f555c0327d0 con 0x7f55740b3c60 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 -- 172.21.15.192:0/2085019496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 msgr2=0x7f55740afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 --2- 172.21.15.192:0/2085019496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 0x7f55740afd50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f555c0097a0 tx=0x7f555c02a100 comp rx=0 tx=0).stop 2024-09-13T18:48:24.899 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 -- 172.21.15.192:0/2085019496 shutdown_connections 2024-09-13T18:48:24.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 --2- 172.21.15.192:0/2085019496 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740b3c60 0x7f55740afd50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 --2- 172.21.15.192:0/2085019496 >> v2:172.21.15.194:3300/0 conn(0x7f55740cb490 0x7f557415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 -- 172.21.15.192:0/2085019496 >> 172.21.15.192:0/2085019496 conn(0x7f55740ae960 msgr2=0x7f557406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:24.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 -- 172.21.15.192:0/2085019496 shutdown_connections 2024-09-13T18:48:24.900 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.895+0000 7f557a800640 1 -- 172.21.15.192:0/2085019496 wait complete. 2024-09-13T18:48:24.901 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.897+0000 7f557a800640 1 Processor -- start 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.897+0000 7f557a800640 1 -- start start 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 0x7f5574155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 0x7f557406a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f557415bd00 con 0x7f557406aa40 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5574155f90 con 0x7f55740b0290 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f557a800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55741f65a0 con 0x7f55740cb490 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f5573e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f5573e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39048/0 (socket says 172.21.15.192:39048) 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.898+0000 7f5573e00640 1 -- 172.21.15.192:0/3702102823 learned_addr learned my addr 172.21.15.192:0/3702102823 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:24.902 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573400640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 0x7f5574155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f556aa00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 0x7f557406a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 -- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 msgr2=0x7f557406a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 0x7f557406a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 -- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 msgr2=0x7f5574155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 0x7f5574155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 -- 172.21.15.192:0/3702102823 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5564009400 con 0x7f557406aa40 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573400640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 0x7f5574155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f556aa00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 0x7f557406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:24.903 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f5573e00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f556c00cb40 tx=0x7f556c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c00ac40 con 0x7f557406aa40 2024-09-13T18:48:24.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f556c00ada0 con 0x7f557406aa40 2024-09-13T18:48:24.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f555c009400 con 0x7f557406aa40 2024-09-13T18:48:24.904 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f556c012620 con 0x7f557406aa40 2024-09-13T18:48:24.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.899+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55741f6e40 con 0x7f557406aa40 2024-09-13T18:48:24.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.900+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55740afd50 con 0x7f557406aa40 2024-09-13T18:48:24.905 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.901+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f556c007070 con 0x7f557406aa40 2024-09-13T18:48:24.906 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.902+0000 7f556be00640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 0x7f555006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:24.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.902+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f556c089070 con 0x7f557406aa40 2024-09-13T18:48:24.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.902+0000 7f5573400640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 0x7f555006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:24.907 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.903+0000 7f5573400640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 0x7f555006d0c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f55740ae550 tx=0x7f5564008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:24.909 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:24.906+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f556c0bc9c0 con 0x7f557406aa40 2024-09-13T18:48:25.078 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.075+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f5574159f80 con 0x7f555006ac00 2024-09-13T18:48:25.079 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.076+0000 7f556be00640 1 -- 172.21.15.192:0/3702102823 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5574159f80 con 0x7f555006ac00 2024-09-13T18:48:25.079 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 0 to deep-scrub 2024-09-13T18:48:25.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 msgr2=0x7f555006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 0x7f555006d0c0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f55740ae550 tx=0x7f5564008040 comp rx=0 tx=0).stop 2024-09-13T18:48:25.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 msgr2=0x7f55741ec700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.081 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f556c00cb40 tx=0x7f556c00a060 comp rx=0 tx=0).stop 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 shutdown_connections 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f555006ac00 0x7f555006d0c0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f557406aa40 0x7f55741ec700 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f55740cb490 0x7f557406a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 --2- 172.21.15.192:0/3702102823 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f55740b0290 0x7f5574155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 >> 172.21.15.192:0/3702102823 conn(0x7f55740ae960 msgr2=0x7f557415cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 shutdown_connections 2024-09-13T18:48:25.082 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.078+0000 7f557a800640 1 -- 172.21.15.192:0/3702102823 wait complete. 2024-09-13T18:48:25.098 INFO:tasks.ceph:Scrubbing osd.1 2024-09-13T18:48:25.098 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:25.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.251+0000 7efd55400640 1 Processor -- start 2024-09-13T18:48:25.254 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.251+0000 7efd55400640 1 -- start start 2024-09-13T18:48:25.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd55400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 0x7efd500cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd55400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.255 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd55400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd500cd200 con 0x7efd5015a920 2024-09-13T18:48:25.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd55400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd500cde80 con 0x7efd500adf50 2024-09-13T18:48:25.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd55400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd500cd4e0 con 0x7efd500cc910 2024-09-13T18:48:25.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd54a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.256 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd4f400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 0x7efd500cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd54a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:43576/0 (socket says 172.21.15.192:43576) 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd4fe00640 1 --1- >> v1:172.21.15.194:6789/0 conn(0x7efd5015a920 0x7efd500ad840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.194:6789/0 says I am v1:172.21.15.192:54118/0 (socket says 172.21.15.192:54118) 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.253+0000 7efd54a00640 1 -- 172.21.15.192:0/1811614774 learned_addr learned my addr 172.21.15.192:0/1811614774 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.254+0000 7efd54a00640 1 -- 172.21.15.192:0/1811614774 >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 msgr2=0x7efd500cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.254+0000 7efd54a00640 1 --2- 172.21.15.192:0/1811614774 >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 0x7efd500cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.254+0000 7efd54a00640 1 -- 172.21.15.192:0/1811614774 >> v1:172.21.15.194:6789/0 conn(0x7efd5015a920 legacy=0x7efd500ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.254+0000 7efd54a00640 1 -- 172.21.15.192:0/1811614774 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500cd7c0 con 0x7efd500cc910 2024-09-13T18:48:25.257 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.254+0000 7efd4f400640 1 --2- 172.21.15.192:0/1811614774 >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 0x7efd500cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.255+0000 7efd54a00640 1 --2- 172.21.15.192:0/1811614774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4802a680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3001be94c5080a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.255+0000 7efd4ea00640 1 -- 172.21.15.192:0/1811614774 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4802aea0 con 0x7efd500cc910 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.255+0000 7efd4ea00640 1 -- 172.21.15.192:0/1811614774 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4802d050 con 0x7efd500cc910 2024-09-13T18:48:25.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.255+0000 7efd4ea00640 1 -- 172.21.15.192:0/1811614774 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48031820 con 0x7efd500cc910 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 -- 172.21.15.192:0/1811614774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 msgr2=0x7efd5015e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 --2- 172.21.15.192:0/1811614774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd48009e50 tx=0x7efd4802a680 comp rx=0 tx=0).stop 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 -- 172.21.15.192:0/1811614774 shutdown_connections 2024-09-13T18:48:25.259 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 --2- 172.21.15.192:0/1811614774 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd5015e610 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 --2- 172.21.15.192:0/1811614774 >> v2:172.21.15.194:3300/0 conn(0x7efd500adf50 0x7efd500cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 -- 172.21.15.192:0/1811614774 >> 172.21.15.192:0/1811614774 conn(0x7efd500cef60 msgr2=0x7efd500b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 -- 172.21.15.192:0/1811614774 shutdown_connections 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.256+0000 7efd55400640 1 -- 172.21.15.192:0/1811614774 wait complete. 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.258+0000 7efd55400640 1 Processor -- start 2024-09-13T18:48:25.260 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.258+0000 7efd55400640 1 -- start start 2024-09-13T18:48:25.262 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 0x7efd50150850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd50153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5015a920 0x7efd50153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501f2680 con 0x7efd500adf50 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd501541d0 con 0x7efd5015a920 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd55400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd5006f8c0 con 0x7efd500cc910 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 0x7efd50150850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 0x7efd50150850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39056/0 (socket says 172.21.15.192:39056) 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 -- 172.21.15.192:0/1529684920 learned_addr learned my addr 172.21.15.192:0/1529684920 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4f400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd50153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd54a00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5015a920 0x7efd50153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 -- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 msgr2=0x7efd50153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.263 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7efd500cc910 0x7efd50153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 -- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5015a920 msgr2=0x7efd50153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5015a920 0x7efd50153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd4fe00640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c009400 con 0x7efd500adf50 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.259+0000 7efd54a00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7efd5015a920 0x7efd50153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd4fe00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 0x7efd50150850 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3e0 tx=0x7efd4000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400074e0 con 0x7efd500adf50 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd40007640 con 0x7efd500adf50 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd400049e0 con 0x7efd500adf50 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd48009b30 con 0x7efd500adf50 2024-09-13T18:48:25.264 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.260+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd5006fe80 con 0x7efd500adf50 2024-09-13T18:48:25.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.261+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd5015eb50 con 0x7efd500adf50 2024-09-13T18:48:25.265 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.262+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7efd40004b40 con 0x7efd500adf50 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd47e00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3006ac00 0x7efd3006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efd40088ac0 con 0x7efd500adf50 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd4f400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3006ac00 0x7efd3006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd47e00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7efd30070a60 0x7efd30072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd30073530 con 0x7efd30070a60 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd4008d2a0 con 0x7efd500adf50 2024-09-13T18:48:25.266 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.263+0000 7efd54a00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7efd30070a60 0x7efd30072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.264+0000 7efd4f400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3006ac00 0x7efd3006d0c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efd500b3db0 tx=0x7efd3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.264+0000 7efd54a00640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7efd30070a60 0x7efd30072e80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.267 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.264+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== osd.1 v2:172.21.15.192:6816/4129826895 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7efd30073530 con 0x7efd30070a60 2024-09-13T18:48:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.276+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 --> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd500cc3d0 con 0x7efd30070a60 2024-09-13T18:48:25.279 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd47e00640 1 -- 172.21.15.192:0/1529684920 <== osd.1 v2:172.21.15.192:6816/4129826895 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7efd500cc3d0 con 0x7efd30070a60 2024-09-13T18:48:25.279 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:25.279 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:25.280 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7efd30070a60 msgr2=0x7efd30072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6816/4129826895,v1:172.21.15.192:6817/4129826895] conn(0x7efd30070a60 0x7efd30072e80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3006ac00 msgr2=0x7efd3006d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7efd3006ac00 0x7efd3006d0c0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7efd500b3db0 tx=0x7efd3c008040 comp rx=0 tx=0).stop 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 msgr2=0x7efd50150850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 --2- 172.21.15.192:0/1529684920 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efd500adf50 0x7efd50150850 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7efd4000c3e0 tx=0x7efd4000c8a0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd54a00640 1 -- 172.21.15.192:0/1529684920 reap_dead start 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 shutdown_connections 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 >> 172.21.15.192:0/1529684920 conn(0x7efd500cef60 msgr2=0x7efd5006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 shutdown_connections 2024-09-13T18:48:25.281 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.277+0000 7efd55400640 1 -- 172.21.15.192:0/1529684920 wait complete. 2024-09-13T18:48:25.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-13T18:48:25.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.444+0000 7f3c01200640 1 Processor -- start 2024-09-13T18:48:25.447 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.445+0000 7f3c01200640 1 -- start start 2024-09-13T18:48:25.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3c01200640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f3bfc06afb0 0x7f3bfc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3c01200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3c01200640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bfc0b2d00 con 0x7f3bfc157480 2024-09-13T18:48:25.449 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3c01200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b3380 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3c01200640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bfc0b3eb0 con 0x7f3bfc06afb0 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3bfbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3bfbe00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39072/0 (socket says 172.21.15.192:39072) 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3bfbe00640 1 -- 172.21.15.192:0/1095493282 learned_addr learned my addr 172.21.15.192:0/1095493282 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3bfb400640 1 --1- 172.21.15.192:0/1095493282 >> v1:172.21.15.192:6789/0 conn(0x7f3bfc157480 0x7f3bfc0b37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33344/0 (socket says 172.21.15.192:33344) 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.446+0000 7f3bf2a00640 1 --2- 172.21.15.192:0/1095493282 >> v2:172.21.15.194:3300/0 conn(0x7f3bfc06afb0 0x7f3bfc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.447+0000 7f3bfbe00640 1 -- 172.21.15.192:0/1095493282 >> v2:172.21.15.194:3300/0 conn(0x7f3bfc06afb0 msgr2=0x7f3bfc06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.447+0000 7f3bfbe00640 1 --2- 172.21.15.192:0/1095493282 >> v2:172.21.15.194:3300/0 conn(0x7f3bfc06afb0 0x7f3bfc06b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.447+0000 7f3bfbe00640 1 -- 172.21.15.192:0/1095493282 >> v1:172.21.15.192:6789/0 conn(0x7f3bfc157480 legacy=0x7f3bfc0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.450 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.447+0000 7f3bfbe00640 1 -- 172.21.15.192:0/1095493282 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bfc0cdc80 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3bfbe00640 1 --2- 172.21.15.192:0/1095493282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc06cdb0 tx=0x7f3bf402c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f701f0ad8a546 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3bfaa00640 1 -- 172.21.15.192:0/1095493282 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4033400 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3bfaa00640 1 -- 172.21.15.192:0/1095493282 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf402f070 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3bfaa00640 1 -- 172.21.15.192:0/1095493282 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4033780 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.451 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 -- 172.21.15.192:0/1095493282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0ccfe0 msgr2=0x7f3bfc0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 --2- 172.21.15.192:0/1095493282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f3bfc06cdb0 tx=0x7f3bf402c8b0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 -- 172.21.15.192:0/1095493282 shutdown_connections 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 --2- 172.21.15.192:0/1095493282 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0cd3e0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 --2- 172.21.15.192:0/1095493282 >> v2:172.21.15.194:3300/0 conn(0x7f3bfc06afb0 0x7f3bfc06b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.448+0000 7f3c01200640 1 -- 172.21.15.192:0/1095493282 >> 172.21.15.192:0/1095493282 conn(0x7f3bfc0734f0 msgr2=0x7f3bfc0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.449+0000 7f3c01200640 1 -- 172.21.15.192:0/1095493282 shutdown_connections 2024-09-13T18:48:25.452 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.449+0000 7f3c01200640 1 -- 172.21.15.192:0/1095493282 wait complete. 2024-09-13T18:48:25.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.450+0000 7f3c01200640 1 Processor -- start 2024-09-13T18:48:25.453 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.450+0000 7f3c01200640 1 -- start start 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 0x7f3bfc14b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc14bd90 con 0x7f3bfc157480 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc0714a0 con 0x7f3bfc0ccfe0 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3c01200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bfc070400 con 0x7f3bfc06afb0 2024-09-13T18:48:25.455 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3bfbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3bfbe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39082/0 (socket says 172.21.15.192:39082) 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.451+0000 7f3bfbe00640 1 -- 172.21.15.192:0/272855135 learned_addr learned my addr 172.21.15.192:0/272855135 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfb400640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 0x7f3bfc14b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bf2a00640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 -- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 msgr2=0x7f3bfc14b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 0x7f3bfc14b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 -- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc0ccfe0 msgr2=0x7f3bfc0ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 -- 172.21.15.192:0/272855135 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf4009b30 con 0x7f3bfc157480 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfb400640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 0x7f3bfc14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bfbe00640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009f40 tx=0x7f3bf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.456 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf4009510 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf40090d0 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf403e690 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.452+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bfc0706e0 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.453+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bfc070ca0 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.454+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bfc0cdf60 con 0x7f3bfc157480 2024-09-13T18:48:25.457 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.454+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f3bf403e7f0 con 0x7f3bfc157480 2024-09-13T18:48:25.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.456+0000 7f3bf3e00640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 0x7f3bd806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.458 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.456+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3bf40a9d40 con 0x7f3bfc157480 2024-09-13T18:48:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.456+0000 7f3bfb400640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 0x7f3bd806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.459 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.457+0000 7f3bfb400640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 0x7f3bd806d0c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007fd0 tx=0x7f3bec007d40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.462 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.460+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f3bf40752a0 con 0x7f3bfc157480 2024-09-13T18:48:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.630+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3bfc157860 con 0x7f3bd806ac00 2024-09-13T18:48:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.631+0000 7f3bf3e00640 1 -- 172.21.15.192:0/272855135 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3bec007590 con 0x7f3bd806ac00 2024-09-13T18:48:25.633 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 1 to deep-scrub 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 msgr2=0x7f3bd806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 0x7f3bd806d0c0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3bec007fd0 tx=0x7f3bec007d40 comp rx=0 tx=0).stop 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 msgr2=0x7f3bfc0add80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f3bf4009f40 tx=0x7f3bf4004a40 comp rx=0 tx=0).stop 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 shutdown_connections 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f3bd806ac00 0x7f3bd806d0c0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bfc157480 0x7f3bfc0add80 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.636 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3bfc0ccfe0 0x7f3bfc0ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 --2- 172.21.15.192:0/272855135 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3bfc06afb0 0x7f3bfc14b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 >> 172.21.15.192:0/272855135 conn(0x7f3bfc0734f0 msgr2=0x7f3bfc0cc890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 shutdown_connections 2024-09-13T18:48:25.637 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.633+0000 7f3c01200640 1 -- 172.21.15.192:0/272855135 wait complete. 2024-09-13T18:48:25.652 INFO:tasks.ceph:Scrubbing osd.2 2024-09-13T18:48:25.653 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:25.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.806+0000 7f1189400640 1 Processor -- start 2024-09-13T18:48:25.809 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.806+0000 7f1189400640 1 -- start start 2024-09-13T18:48:25.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.811 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 0x7f118406c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f118406c5a0 0x7f118415a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118406afc0 con 0x7f118406c5a0 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f118406b2a0 con 0x7f11840cc220 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.807+0000 7f1189400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f118406b580 con 0x7f118413f3b0 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f118406c5a0 0x7f118415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f118406c5a0 0x7f118415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39092/0 (socket says 172.21.15.192:39092) 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 -- 172.21.15.192:0/2124861422 learned_addr learned my addr 172.21.15.192:0/2124861422 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1183e00640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1183400640 1 --2- 172.21.15.192:0/2124861422 >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 0x7f118406c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 -- 172.21.15.192:0/2124861422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 msgr2=0x7f11840cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.812 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 -- 172.21.15.192:0/2124861422 >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 msgr2=0x7f118406c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:25.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 --2- 172.21.15.192:0/2124861422 >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 0x7f118406c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1188a00640 1 -- 172.21.15.192:0/2124861422 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118406b860 con 0x7f118406c5a0 2024-09-13T18:48:25.813 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.808+0000 7f1183400640 1 --2- 172.21.15.192:0/2124861422 >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 0x7f118406c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.809+0000 7f1188a00640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118406c5a0 0x7f118415a670 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f117c009e50 tx=0x7f117c02a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84817c5c90139bb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.809+0000 7f1182a00640 1 -- 172.21.15.192:0/2124861422 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c02aea0 con 0x7f118406c5a0 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.809+0000 7f1182a00640 1 -- 172.21.15.192:0/2124861422 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117c02d050 con 0x7f118406c5a0 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.809+0000 7f1182a00640 1 -- 172.21.15.192:0/2124861422 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c031820 con 0x7f118406c5a0 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 -- 172.21.15.192:0/2124861422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118406c5a0 msgr2=0x7f118415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118406c5a0 0x7f118415a670 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f117c009e50 tx=0x7f117c02a6c0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 -- 172.21.15.192:0/2124861422 shutdown_connections 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f118406c5a0 0x7f118415a670 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 --2- 172.21.15.192:0/2124861422 >> v2:172.21.15.194:3300/0 conn(0x7f11840cc220 0x7f118406c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 --2- 172.21.15.192:0/2124861422 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.814 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 -- 172.21.15.192:0/2124861422 >> 172.21.15.192:0/2124861422 conn(0x7f11840cef60 msgr2=0x7f11840b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 -- 172.21.15.192:0/2124861422 shutdown_connections 2024-09-13T18:48:25.815 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.810+0000 7f1189400640 1 -- 172.21.15.192:0/2124861422 wait complete. 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.812+0000 7f1189400640 1 Processor -- start 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.812+0000 7f1189400640 1 -- start start 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118406c5a0 0x7f1184159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 0x7f118413ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840702b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f118413d1f0 con 0x7f11840cc220 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184159b40 con 0x7f118406c5a0 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1189400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1184159e20 con 0x7f118413f3b0 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 0x7f118413ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 0x7f118413ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39100/0 (socket says 172.21.15.192:39100) 2024-09-13T18:48:25.817 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 -- 172.21.15.192:0/120316277 learned_addr learned my addr 172.21.15.192:0/120316277 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183e00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118406c5a0 0x7f1184159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1188a00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 -- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 msgr2=0x7f11840702b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840702b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 -- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118406c5a0 msgr2=0x7f1184159560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f118406c5a0 0x7f1184159560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1183400640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f117c009b30 con 0x7f11840cc220 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.813+0000 7f1188a00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f118413f3b0 0x7f11840702b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f1183400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 0x7f118413ccb0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f117000e7e0 tx=0x7f117000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000c8d0 con 0x7f11840cc220 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f117000ee90 con 0x7f11840cc220 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117000cc70 con 0x7f11840cc220 2024-09-13T18:48:25.818 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f118415a100 con 0x7f11840cc220 2024-09-13T18:48:25.819 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.814+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118415a6c0 con 0x7f11840cc220 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.815+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f118413f790 con 0x7f11840cc220 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.816+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f1170013410 con 0x7f11840cc220 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f117be00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f116406ac00 0x7f116406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1170088d60 con 0x7f11840cc220 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f117be00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f1164070a60 0x7f1164072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1164073530 con 0x7f1164070a60 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f117008b420 con 0x7f11840cc220 2024-09-13T18:48:25.820 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f1183e00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f116406ac00 0x7f116406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.817+0000 7f1188a00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f1164070a60 0x7f1164072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:25.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.818+0000 7f1183e00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f116406ac00 0x7f116406d0c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f117400ab20 tx=0x7f117400a2a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.818+0000 7f1188a00640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f1164070a60 0x7f1164072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:25.821 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.818+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== osd.2 v2:172.21.15.192:6808/1589536644 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f1164073530 con 0x7f1164070a60 2024-09-13T18:48:25.832 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.830+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 --> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f118406c060 con 0x7f1164070a60 2024-09-13T18:48:25.833 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.830+0000 7f117be00640 1 -- 172.21.15.192:0/120316277 <== osd.2 v2:172.21.15.192:6808/1589536644 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f118406c060 con 0x7f1164070a60 2024-09-13T18:48:25.833 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:25.833 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:25.833 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:25.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.830+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f1164070a60 msgr2=0x7f1164072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.830+0000 7f1189400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6808/1589536644,v1:172.21.15.192:6809/1589536644] conn(0x7f1164070a60 0x7f1164072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f116406ac00 msgr2=0x7f116406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f116406ac00 0x7f116406d0c0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f117400ab20 tx=0x7f117400a2a0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 msgr2=0x7f118413ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 --2- 172.21.15.192:0/120316277 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11840cc220 0x7f118413ccb0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f117000e7e0 tx=0x7f117000eca0 comp rx=0 tx=0).stop 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1188a00640 1 -- 172.21.15.192:0/120316277 reap_dead start 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 shutdown_connections 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 >> 172.21.15.192:0/120316277 conn(0x7f11840cef60 msgr2=0x7f11841570f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 shutdown_connections 2024-09-13T18:48:25.835 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.831+0000 7f1189400640 1 -- 172.21.15.192:0/120316277 wait complete. 2024-09-13T18:48:25.848 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-13T18:48:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.997+0000 7fe77ba00640 1 Processor -- start 2024-09-13T18:48:26.000 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.997+0000 7fe77ba00640 1 -- start start 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.998+0000 7fe77ba00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe774153670 0x7fe774159820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe77ba00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe774153a50 0x7fe774159d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7740cd0e0 0x7fe7740cd550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe77ba00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740cb3c0 con 0x7fe774153a50 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe77ba00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7740cda90 con 0x7fe774153670 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe77ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77415a3a0 con 0x7fe7740cd0e0 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe774153a50 0x7fe774159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fe774153a50 0x7fe774159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39102/0 (socket says 172.21.15.192:39102) 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 -- 172.21.15.192:0/2161163120 learned_addr learned my addr 172.21.15.192:0/2161163120 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe779a00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7740cd0e0 0x7fe7740cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.002 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe779000640 1 --2- 172.21.15.192:0/2161163120 >> v2:172.21.15.194:3300/0 conn(0x7fe774153670 0x7fe774159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 -- 172.21.15.192:0/2161163120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7740cd0e0 msgr2=0x7fe7740cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7740cd0e0 0x7fe7740cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 -- 172.21.15.192:0/2161163120 >> v2:172.21.15.194:3300/0 conn(0x7fe774153670 msgr2=0x7fe774159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.003 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 --2- 172.21.15.192:0/2161163120 >> v2:172.21.15.194:3300/0 conn(0x7fe774153670 0x7fe774159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:25.999+0000 7fe773e00640 1 -- 172.21.15.192:0/2161163120 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77415a680 con 0x7fe774153a50 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.000+0000 7fe773e00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe774153a50 0x7fe774159d60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b1930 tx=0x7fe76002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38abd2c04e842a93 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe773400640 1 -- 172.21.15.192:0/2161163120 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760032440 con 0x7fe774153a50 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe773400640 1 -- 172.21.15.192:0/2161163120 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600325a0 con 0x7fe774153a50 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe773400640 1 -- 172.21.15.192:0/2161163120 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe760032930 con 0x7fe774153a50 2024-09-13T18:48:26.004 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 -- 172.21.15.192:0/2161163120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe774153a50 msgr2=0x7fe774159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe774153a50 0x7fe774159d60 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fe7740b1930 tx=0x7fe76002a210 comp rx=0 tx=0).stop 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 -- 172.21.15.192:0/2161163120 shutdown_connections 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7740cd0e0 0x7fe7740cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 --2- 172.21.15.192:0/2161163120 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe774153a50 0x7fe774159d60 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 --2- 172.21.15.192:0/2161163120 >> v2:172.21.15.194:3300/0 conn(0x7fe774153670 0x7fe774159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 -- 172.21.15.192:0/2161163120 >> 172.21.15.192:0/2161163120 conn(0x7fe7740ae960 msgr2=0x7fe77406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 -- 172.21.15.192:0/2161163120 shutdown_connections 2024-09-13T18:48:26.005 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.001+0000 7fe77ba00640 1 -- 172.21.15.192:0/2161163120 wait complete. 2024-09-13T18:48:26.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.003+0000 7fe77ba00640 1 Processor -- start 2024-09-13T18:48:26.006 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.003+0000 7fe77ba00640 1 -- start start 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe774153670 0x7fe77414c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe774153a50 0x7fe7740ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741f6200 con 0x7fe7740cd0e0 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741f64e0 con 0x7fe774153670 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe77ba00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7741f67c0 con 0x7fe774153a50 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe779000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe779000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39110/0 (socket says 172.21.15.192:39110) 2024-09-13T18:48:26.008 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe779000640 1 -- 172.21.15.192:0/54006524 learned_addr learned my addr 172.21.15.192:0/54006524 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe773e00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe774153670 0x7fe77414c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.004+0000 7fe779a00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe774153a50 0x7fe7740ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 -- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe774153a50 msgr2=0x7fe7740ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe774153a50 0x7fe7740ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 -- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe774153670 msgr2=0x7fe77414c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe774153670 0x7fe77414c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 -- 172.21.15.192:0/54006524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7600094d0 con 0x7fe7740cd0e0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe779000640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9b0 tx=0x7fe76400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe764009670 con 0x7fe7740cd0e0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe76400c9a0 con 0x7fe7740cd0e0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7741f6aa0 con 0x7fe7740cd0e0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe76400cd50 con 0x7fe7740cd0e0 2024-09-13T18:48:26.009 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.005+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7741f5ed0 con 0x7fe7740cd0e0 2024-09-13T18:48:26.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.006+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7740cd550 con 0x7fe7740cd0e0 2024-09-13T18:48:26.010 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.007+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe764013470 con 0x7fe7740cd0e0 2024-09-13T18:48:26.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.008+0000 7fe770c00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 0x7fe75406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.008+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe764089340 con 0x7fe7740cd0e0 2024-09-13T18:48:26.011 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.008+0000 7fe773e00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 0x7fe75406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.012 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.009+0000 7fe773e00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 0x7fe75406d0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.015 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.012+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe764054780 con 0x7fe7740cd0e0 2024-09-13T18:48:26.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.182+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7741f6650 con 0x7fe75406ac00 2024-09-13T18:48:26.185 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.183+0000 7fe770c00640 1 -- 172.21.15.192:0/54006524 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7741f6650 con 0x7fe75406ac00 2024-09-13T18:48:26.185 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 2 to deep-scrub 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 msgr2=0x7fe75406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 0x7fe75406d0c0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fe760034000 tx=0x7fe76002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 msgr2=0x7fe774159120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fe76400e9b0 tx=0x7fe76400ee70 comp rx=0 tx=0).stop 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 shutdown_connections 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe75406ac00 0x7fe75406d0c0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe774153a50 0x7fe7740ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe774153670 0x7fe77414c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.188 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 --2- 172.21.15.192:0/54006524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7740cd0e0 0x7fe774159120 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 >> 172.21.15.192:0/54006524 conn(0x7fe7740ae960 msgr2=0x7fe77415b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 shutdown_connections 2024-09-13T18:48:26.189 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.185+0000 7fe77ba00640 1 -- 172.21.15.192:0/54006524 wait complete. 2024-09-13T18:48:26.203 INFO:tasks.ceph:Scrubbing osd.3 2024-09-13T18:48:26.203 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:26.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.357+0000 7f0cb7e00640 1 Processor -- start 2024-09-13T18:48:26.360 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.357+0000 7f0cb7e00640 1 -- start start 2024-09-13T18:48:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb7e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0cb81586f0 0x7f0cb80cd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb80b3cf0 0x7f0cb80b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.361 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb7e00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cb80cde00 con 0x7f0cb815bae0 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb7e00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cb8158ad0 con 0x7f0cb81586f0 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb815ea80 con 0x7f0cb80b3cf0 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0cb81586f0 0x7f0cb80cd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.358+0000 7f0cb6a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f0cb81586f0 0x7f0cb80cd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39120/0 (socket says 172.21.15.192:39120) 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb6a00640 1 -- 172.21.15.192:0/1527138287 learned_addr learned my addr 172.21.15.192:0/1527138287 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb7400640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb80b3cf0 0x7f0cb80b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb6a00640 1 -- 172.21.15.192:0/1527138287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb80b3cf0 msgr2=0x7f0cb80b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb6a00640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb80b3cf0 0x7f0cb80b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb6a00640 1 -- 172.21.15.192:0/1527138287 >> v1:172.21.15.194:6789/0 conn(0x7f0cb815bae0 legacy=0x7f0cb815ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.359+0000 7f0cb6a00640 1 -- 172.21.15.192:0/1527138287 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb80b4660 con 0x7f0cb81586f0 2024-09-13T18:48:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.360+0000 7f0cb6a00640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb81586f0 0x7f0cb80cd180 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009870 tx=0x7f0ca802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e1d9dcc3c7793f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.360+0000 7f0cb5600640 1 -- 172.21.15.192:0/1527138287 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca802ae90 con 0x7f0cb81586f0 2024-09-13T18:48:26.363 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.360+0000 7f0cb5600640 1 -- 172.21.15.192:0/1527138287 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca8032440 con 0x7f0cb81586f0 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.360+0000 7f0cb5600640 1 -- 172.21.15.192:0/1527138287 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca80327d0 con 0x7f0cb81586f0 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 -- 172.21.15.192:0/1527138287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb81586f0 msgr2=0x7f0cb80cd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb81586f0 0x7f0cb80cd180 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009870 tx=0x7f0ca802a180 comp rx=0 tx=0).stop 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 -- 172.21.15.192:0/1527138287 shutdown_connections 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb80b3cf0 0x7f0cb80b4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/1527138287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb81586f0 0x7f0cb80cd180 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 -- 172.21.15.192:0/1527138287 >> 172.21.15.192:0/1527138287 conn(0x7f0cb80cef60 msgr2=0x7f0cb80b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 -- 172.21.15.192:0/1527138287 shutdown_connections 2024-09-13T18:48:26.364 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.361+0000 7f0cb7e00640 1 -- 172.21.15.192:0/1527138287 wait complete. 2024-09-13T18:48:26.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.362+0000 7f0cb7e00640 1 Processor -- start 2024-09-13T18:48:26.365 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 -- start start 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cb80b3cf0 0x7f0cb81463b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb81586f0 0x7f0cb80af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 0x7f0cb80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb814e920 con 0x7f0cb815bae0 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb81468f0 con 0x7f0cb80b3cf0 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.363+0000 7f0cb7e00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb8151ae0 con 0x7f0cb81586f0 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 0x7f0cb80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 0x7f0cb80afd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39124/0 (socket says 172.21.15.192:39124) 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 -- 172.21.15.192:0/2256847032 learned_addr learned my addr 172.21.15.192:0/2256847032 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb6a00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cb80b3cf0 0x7f0cb81463b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.367 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb6000640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb81586f0 0x7f0cb80af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 -- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb81586f0 msgr2=0x7f0cb80af7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f0cb81586f0 0x7f0cb80af7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 -- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cb80b3cf0 msgr2=0x7f0cb81463b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f0cb80b3cf0 0x7f0cb81463b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca80094d0 con 0x7f0cb815bae0 2024-09-13T18:48:26.368 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0cb7400640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 0x7f0cb80afd00 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0007e60 tx=0x7f0cb000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.364+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0014420 con 0x7f0cb815bae0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.365+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb00145a0 con 0x7f0cb815bae0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.365+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0014950 con 0x7f0cb815bae0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.365+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb8151570 con 0x7f0cb815bae0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.365+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb8159310 con 0x7f0cb815bae0 2024-09-13T18:48:26.369 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.366+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0cb815e710 con 0x7f0cb815bae0 2024-09-13T18:48:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.367+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f0cb0014ab0 con 0x7f0cb815bae0 2024-09-13T18:48:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.367+0000 7f0caea00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c9806ac00 0x7f0c9806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0cb0089860 con 0x7f0cb815bae0 2024-09-13T18:48:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0caea00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7f0c98070a60 0x7f0c98072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.370 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0cb6a00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c9806ac00 0x7f0c9806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c98073530 con 0x7f0c98070a60 2024-09-13T18:48:26.371 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0cb008e2c0 con 0x7f0cb815bae0 2024-09-13T18:48:26.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0cb6000640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7f0c98070a60 0x7f0c98072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.368+0000 7f0cb6a00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c9806ac00 0x7f0c9806d0c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.369+0000 7f0cb6000640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7f0c98070a60 0x7f0c98072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.373 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.369+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== osd.3 v2:172.21.15.192:6800/2116235987 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f0c98073530 con 0x7f0c98070a60 2024-09-13T18:48:26.383 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.381+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 --> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0cb80cdb20 con 0x7f0c98070a60 2024-09-13T18:48:26.384 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.381+0000 7f0caea00640 1 -- 172.21.15.192:0/2256847032 <== osd.3 v2:172.21.15.192:6800/2116235987 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f0ca4005090 con 0x7f0c98070a60 2024-09-13T18:48:26.384 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:26.385 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:26.385 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:26.385 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7f0c98070a60 msgr2=0x7f0c98072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6800/2116235987,v1:172.21.15.192:6801/2116235987] conn(0x7f0c98070a60 0x7f0c98072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c9806ac00 msgr2=0x7f0c9806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f0c9806ac00 0x7f0c9806d0c0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8034000 tx=0x7f0ca802e000 comp rx=0 tx=0).stop 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 msgr2=0x7f0cb80afd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 --2- 172.21.15.192:0/2256847032 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0cb815bae0 0x7f0cb80afd00 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0007e60 tx=0x7f0cb000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7400640 1 -- 172.21.15.192:0/2256847032 reap_dead start 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 shutdown_connections 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 >> 172.21.15.192:0/2256847032 conn(0x7f0cb80cef60 msgr2=0x7f0cb80b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 shutdown_connections 2024-09-13T18:48:26.386 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.382+0000 7f0cb7e00640 1 -- 172.21.15.192:0/2256847032 wait complete. 2024-09-13T18:48:26.399 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-13T18:48:26.551 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.549+0000 7fc010a00640 1 Processor -- start 2024-09-13T18:48:26.552 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.549+0000 7fc010a00640 1 -- start start 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc010a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fc00c0cd6f0 0x7fc00c06b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc010a00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0b2d00 con 0x7fc00c157480 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc010a00640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0cdc80 con 0x7fc00c06afb0 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc010a00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0b3380 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc00b400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fc00c157480 0x7fc00c0b37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33356/0 (socket says 172.21.15.192:33356) 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc00b400640 1 -- 172.21.15.192:0/1105522638 learned_addr learned my addr 172.21.15.192:0/1105522638 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.550+0000 7fc00be00640 1 --2- 172.21.15.192:0/1105522638 >> v2:172.21.15.192:3300/0 conn(0x7fc00c0cd6f0 0x7fc00c06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60398295 0 0) 0x7fc00c0b2d00 con 0x7fc00c157480 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0005730 con 0x7fc00c157480 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411029066 0 0) 0x7fc00c0cdc80 con 0x7fc00c06afb0 2024-09-13T18:48:26.554 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc00c0b2d00 con 0x7fc00c06afb0 2024-09-13T18:48:26.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00be00640 1 -- 172.21.15.192:0/1105522638 >> v1:172.21.15.194:6789/0 conn(0x7fc00c06afb0 legacy=0x7fc00c0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00be00640 1 -- 172.21.15.192:0/1105522638 >> v1:172.21.15.192:6789/0 conn(0x7fc00c157480 legacy=0x7fc00c0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.555 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.551+0000 7fc00be00640 1 -- 172.21.15.192:0/1105522638 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0b2fa0 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.552+0000 7fc00be00640 1 --2- 172.21.15.192:0/1105522638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c06b420 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d90 tx=0x7fc00402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=641ab2b3992b3150 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.552+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004007740 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.552+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc00402d050 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.552+0000 7fc00a000640 1 -- 172.21.15.192:0/1105522638 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004007ac0 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 -- 172.21.15.192:0/1105522638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 msgr2=0x7fc00c06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 --2- 172.21.15.192:0/1105522638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c06b420 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d90 tx=0x7fc00402a660 comp rx=0 tx=0).stop 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 -- 172.21.15.192:0/1105522638 shutdown_connections 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 --2- 172.21.15.192:0/1105522638 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c06b420 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.556 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 -- 172.21.15.192:0/1105522638 >> 172.21.15.192:0/1105522638 conn(0x7fc00c0734f0 msgr2=0x7fc00c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 -- 172.21.15.192:0/1105522638 shutdown_connections 2024-09-13T18:48:26.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.553+0000 7fc010a00640 1 -- 172.21.15.192:0/1105522638 wait complete. 2024-09-13T18:48:26.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.554+0000 7fc010a00640 1 Processor -- start 2024-09-13T18:48:26.557 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.554+0000 7fc010a00640 1 -- start start 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c06afb0 0x7fc00c0c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c157480 0x7fc00c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0b3eb0 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c146a30 con 0x7fc00c157480 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.555+0000 7fc010a00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c146c80 con 0x7fc00c06afb0 2024-09-13T18:48:26.561 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39136/0 (socket says 172.21.15.192:39136) 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 -- 172.21.15.192:0/3845404123 learned_addr learned my addr 172.21.15.192:0/3845404123 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00be00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c157480 0x7fc00c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00b400640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c06afb0 0x7fc00c0c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 -- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c06afb0 msgr2=0x7fc00c0c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c06afb0 0x7fc00c0c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 -- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c157480 msgr2=0x7fc00c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c157480 0x7fc00c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 -- 172.21.15.192:0/3845404123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009a70 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.556+0000 7fc00aa00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c490 tx=0x7fbff800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.557+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80052d0 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.557+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8005430 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.562 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.557+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff8012870 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.557+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c146f60 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.557+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c147520 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.558+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c06b420 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.563 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.559+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbff80129d0 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.560+0000 7fc003400640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 0x7fbfec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.560+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbff8088b60 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.560+0000 7fc00b400640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 0x7fbfec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.561+0000 7fc00b400640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 0x7fbfec06d0f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0011e0 tx=0x7fbffc007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.564+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbff8054060 con 0x7fc00c0cd6f0 2024-09-13T18:48:26.736 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.733+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fc00c06b960 con 0x7fbfec06ac30 2024-09-13T18:48:26.737 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.734+0000 7fc003400640 1 -- 172.21.15.192:0/3845404123 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbffc005850 con 0x7fbfec06ac30 2024-09-13T18:48:26.737 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 3 to deep-scrub 2024-09-13T18:48:26.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 msgr2=0x7fbfec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 0x7fbfec06d0f0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbffc0011e0 tx=0x7fbffc007d30 comp rx=0 tx=0).stop 2024-09-13T18:48:26.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 msgr2=0x7fc00c146140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.739 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7fbff800c490 tx=0x7fbff800c950 comp rx=0 tx=0).stop 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 shutdown_connections 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbfec06ac30 0x7fbfec06d0f0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fc00c157480 0x7fc00c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc00c0cd6f0 0x7fc00c146140 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 --2- 172.21.15.192:0/3845404123 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fc00c06afb0 0x7fc00c0c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 >> 172.21.15.192:0/3845404123 conn(0x7fc00c0734f0 msgr2=0x7fc00c0b36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 shutdown_connections 2024-09-13T18:48:26.740 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.736+0000 7fc010a00640 1 -- 172.21.15.192:0/3845404123 wait complete. 2024-09-13T18:48:26.755 INFO:tasks.ceph:Scrubbing osd.4 2024-09-13T18:48:26.755 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.908+0000 7f57bb800640 1 Processor -- start 2024-09-13T18:48:26.911 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.908+0000 7f57bb800640 1 -- start start 2024-09-13T18:48:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.909+0000 7f57bb800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f57b40ce310 0x7f57b415a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.909+0000 7f57bb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.909+0000 7f57bb800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b40ce6f0 con 0x7f57b406afb0 2024-09-13T18:48:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.909+0000 7f57bb800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40b3bf0 con 0x7f57b40ce310 2024-09-13T18:48:26.912 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.909+0000 7f57bb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b413f490 con 0x7f57b40b3290 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.194:3301/0 says I am v2:172.21.15.192:43676/0 (socket says 172.21.15.192:43676) 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 -- 172.21.15.192:0/2458812860 learned_addr learned my addr 172.21.15.192:0/2458812860 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b8e00640 1 --2- 172.21.15.192:0/2458812860 >> v2:172.21.15.194:3300/0 conn(0x7f57b40ce310 0x7f57b415a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 -- 172.21.15.192:0/2458812860 >> v2:172.21.15.194:3300/0 conn(0x7f57b40ce310 msgr2=0x7f57b415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 --2- 172.21.15.192:0/2458812860 >> v2:172.21.15.194:3300/0 conn(0x7f57b40ce310 0x7f57b415a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.913 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 -- 172.21.15.192:0/2458812860 >> v1:172.21.15.194:6789/0 conn(0x7f57b406afb0 legacy=0x7f57b406b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.910+0000 7f57b3e00640 1 -- 172.21.15.192:0/2458812860 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b413f770 con 0x7f57b40b3290 2024-09-13T18:48:26.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.911+0000 7f57b3e00640 1 --2- 172.21.15.192:0/2458812860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d0da42ee101ade server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57b3400640 1 -- 172.21.15.192:0/2458812860 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0032440 con 0x7f57b40b3290 2024-09-13T18:48:26.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57b3400640 1 -- 172.21.15.192:0/2458812860 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a00325a0 con 0x7f57b40b3290 2024-09-13T18:48:26.914 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57b3400640 1 -- 172.21.15.192:0/2458812860 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0032930 con 0x7f57b40b3290 2024-09-13T18:48:26.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 -- 172.21.15.192:0/2458812860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 msgr2=0x7f57b40b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 --2- 172.21.15.192:0/2458812860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009870 tx=0x7f57a002a270 comp rx=0 tx=0).stop 2024-09-13T18:48:26.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 -- 172.21.15.192:0/2458812860 shutdown_connections 2024-09-13T18:48:26.915 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 --2- 172.21.15.192:0/2458812860 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40b3290 0x7f57b40b36b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 --2- 172.21.15.192:0/2458812860 >> v2:172.21.15.194:3300/0 conn(0x7f57b40ce310 0x7f57b415a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 -- 172.21.15.192:0/2458812860 >> 172.21.15.192:0/2458812860 conn(0x7f57b40b0e80 msgr2=0x7f57b40b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 -- 172.21.15.192:0/2458812860 shutdown_connections 2024-09-13T18:48:26.916 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.912+0000 7f57bb800640 1 -- 172.21.15.192:0/2458812860 wait complete. 2024-09-13T18:48:26.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.914+0000 7f57bb800640 1 Processor -- start 2024-09-13T18:48:26.917 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.914+0000 7f57bb800640 1 -- start start 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57b406afb0 0x7f57b413e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 0x7f57b4166280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40ce310 0x7f57b415e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b41667c0 con 0x7f57b40b3290 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b4165df0 con 0x7f57b406afb0 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57bb800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b413eb50 con 0x7f57b40ce310 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57b3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 0x7f57b4166280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.918 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57b3e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 0x7f57b4166280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39144/0 (socket says 172.21.15.192:39144) 2024-09-13T18:48:26.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57b3e00640 1 -- 172.21.15.192:0/4216608403 learned_addr learned my addr 172.21.15.192:0/4216608403 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:26.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57b8e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57b406afb0 0x7f57b413e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.919 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.915+0000 7f57b9800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40ce310 0x7f57b415e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 -- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40ce310 msgr2=0x7f57b415e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f57b40ce310 0x7f57b415e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 -- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57b406afb0 msgr2=0x7f57b413e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f57b406afb0 0x7f57b413e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00094d0 con 0x7f57b40b3290 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b3e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 0x7f57b4166280 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0032440 con 0x7f57b40b3290 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0030980 con 0x7f57b40b3290 2024-09-13T18:48:26.920 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0030d30 con 0x7f57b40b3290 2024-09-13T18:48:26.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b415edf0 con 0x7f57b40b3290 2024-09-13T18:48:26.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.916+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b41657a0 con 0x7f57b40b3290 2024-09-13T18:48:26.921 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.917+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f57b4140010 con 0x7f57b40b3290 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.918+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f57a0039040 con 0x7f57b40b3290 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b0c00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f579406ac00 0x7f579406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f57a00a9830 con 0x7f57b40b3290 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b8e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f579406ac00 0x7f579406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b0c00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f5794070a60 0x7f5794072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:26.923 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5794073530 con 0x7f5794070a60 2024-09-13T18:48:26.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.919+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57a00abe10 con 0x7f57b40b3290 2024-09-13T18:48:26.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.920+0000 7f57b9800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f5794070a60 0x7f5794072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:26.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.920+0000 7f57b8e00640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f579406ac00 0x7f579406d0c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f57b4150fc0 tx=0x7f57a8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.920+0000 7f57b9800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f5794070a60 0x7f5794072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:26.924 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.921+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== osd.4 v2:172.21.15.194:6800/2064160374 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f5794073530 con 0x7f5794070a60 2024-09-13T18:48:26.935 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.933+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 --> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f57b413fd30 con 0x7f5794070a60 2024-09-13T18:48:26.936 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.933+0000 7f57b0c00640 1 -- 172.21.15.192:0/4216608403 <== osd.4 v2:172.21.15.194:6800/2064160374 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f57ac001b20 con 0x7f5794070a60 2024-09-13T18:48:26.936 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:26.936 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:26.936 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f5794070a60 msgr2=0x7f5794072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.194:6800/2064160374,v1:172.21.15.194:6801/2064160374] conn(0x7f5794070a60 0x7f5794072e80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.937 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f579406ac00 msgr2=0x7f579406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f579406ac00 0x7f579406d0c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f57b4150fc0 tx=0x7f57a8009190 comp rx=0 tx=0).stop 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 msgr2=0x7f57b4166280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 --2- 172.21.15.192:0/4216608403 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57b40b3290 0x7f57b4166280 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f57a0000c00 tx=0x7f57a00046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57b9800640 1 -- 172.21.15.192:0/4216608403 reap_dead start 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 shutdown_connections 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 >> 172.21.15.192:0/4216608403 conn(0x7f57b40b0e80 msgr2=0x7f57b40702f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 shutdown_connections 2024-09-13T18:48:26.938 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:26.934+0000 7f57bb800640 1 -- 172.21.15.192:0/4216608403 wait complete. 2024-09-13T18:48:26.951 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-13T18:48:27.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.100+0000 7fe7d9400640 1 Processor -- start 2024-09-13T18:48:27.103 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.100+0000 7fe7d9400640 1 -- start start 2024-09-13T18:48:27.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.101+0000 7fe7d9400640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fe7d40b3c60 0x7fe7d40afd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.101+0000 7fe7d9400640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40cd570 con 0x7fe7d40b0290 2024-09-13T18:48:27.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.101+0000 7fe7d9400640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40cd7a0 con 0x7fe7d40cb490 2024-09-13T18:48:27.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.101+0000 7fe7d9400640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d415b0a0 con 0x7fe7d40b3c60 2024-09-13T18:48:27.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d3200640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fe7d40b0290 0x7fe7d41637c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33370/0 (socket says 172.21.15.192:33370) 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d3200640 1 -- 172.21.15.192:0/1306047399 learned_addr learned my addr 172.21.15.192:0/1306047399 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1e00640 1 --2- 172.21.15.192:0/1306047399 >> v2:172.21.15.194:3300/0 conn(0x7fe7d40b3c60 0x7fe7d40afd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275236683 0 0) 0x7fe7d40cd570 con 0x7fe7d40b0290 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b8003520 con 0x7fe7d40b0290 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 <== mon.1 v1:172.21.15.194:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781924018 0 0) 0x7fe7d40cd7a0 con 0x7fe7d40cb490 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 --> v1:172.21.15.194:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d40cd570 con 0x7fe7d40cb490 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1e00640 1 -- 172.21.15.192:0/1306047399 >> v1:172.21.15.194:6789/0 conn(0x7fe7d40cb490 legacy=0x7fe7d415a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.106 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1e00640 1 -- 172.21.15.192:0/1306047399 >> v1:172.21.15.192:6789/0 conn(0x7fe7d40b0290 legacy=0x7fe7d41637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.107 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.102+0000 7fe7d1e00640 1 -- 172.21.15.192:0/1306047399 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40cda80 con 0x7fe7d40b3c60 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.103+0000 7fe7d1e00640 1 --2- 172.21.15.192:0/1306047399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b3c60 0x7fe7d40afd50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00097a0 tx=0x7fe7c002a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f77a5651239843e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0032440 con 0x7fe7d40b3c60 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c00325a0 con 0x7fe7d40b3c60 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d1400640 1 -- 172.21.15.192:0/1306047399 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0032930 con 0x7fe7d40b3c60 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 -- 172.21.15.192:0/1306047399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b3c60 msgr2=0x7fe7d40afd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 --2- 172.21.15.192:0/1306047399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b3c60 0x7fe7d40afd50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe7c00097a0 tx=0x7fe7c002a1a0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 -- 172.21.15.192:0/1306047399 shutdown_connections 2024-09-13T18:48:27.108 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 --2- 172.21.15.192:0/1306047399 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b3c60 0x7fe7d40afd50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 -- 172.21.15.192:0/1306047399 >> 172.21.15.192:0/1306047399 conn(0x7fe7d40ae960 msgr2=0x7fe7d406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 -- 172.21.15.192:0/1306047399 shutdown_connections 2024-09-13T18:48:27.109 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.104+0000 7fe7d9400640 1 -- 172.21.15.192:0/1306047399 wait complete. 2024-09-13T18:48:27.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.106+0000 7fe7d9400640 1 Processor -- start 2024-09-13T18:48:27.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.106+0000 7fe7d9400640 1 -- start start 2024-09-13T18:48:27.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b0290 0x7fe7d413f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.111 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7d40cb490 0x7fe7d40ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40ae200 con 0x7fe7d40add80 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d414fac0 con 0x7fe7d40b0290 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d9400640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d414ff50 con 0x7fe7d40cb490 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d3200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39152/0 (socket says 172.21.15.192:39152) 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.107+0000 7fe7d3200640 1 -- 172.21.15.192:0/980464057 learned_addr learned my addr 172.21.15.192:0/980464057 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d1e00640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7d40cb490 0x7fe7d40ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d2800640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b0290 0x7fe7d413f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 -- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7d40cb490 msgr2=0x7fe7d40ad840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7d40cb490 0x7fe7d40ad840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 -- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b0290 msgr2=0x7fe7d413f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.112 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b0290 0x7fe7d413f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 -- 172.21.15.192:0/980464057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0009400 con 0x7fe7d40add80 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d3200640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00cbd0 tx=0x7fe7cc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc00ace0 con 0x7fe7d40add80 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00ae40 con 0x7fe7d40add80 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d414eeb0 con 0x7fe7d40add80 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc012620 con 0x7fe7d40add80 2024-09-13T18:48:27.113 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.108+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d414f470 con 0x7fe7d40add80 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.110+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d40cb870 con 0x7fe7d40add80 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.110+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fe7cc007070 con 0x7fe7d40add80 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.111+0000 7fe7caa00640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 0x7fe7b406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.111+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe7cc0893d0 con 0x7fe7d40add80 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.111+0000 7fe7d2800640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 0x7fe7b406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.114 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.112+0000 7fe7d2800640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 0x7fe7b406d0c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40011e0 tx=0x7fe7c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.118 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.115+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fe7cc058210 con 0x7fe7d40add80 2024-09-13T18:48:27.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.285+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7d40b2610 con 0x7fe7b406ac00 2024-09-13T18:48:27.289 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.286+0000 7fe7caa00640 1 -- 172.21.15.192:0/980464057 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7d40b2610 con 0x7fe7b406ac00 2024-09-13T18:48:27.289 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 4 to deep-scrub 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 msgr2=0x7fe7b406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 0x7fe7b406d0c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe7c40011e0 tx=0x7fe7c4009040 comp rx=0 tx=0).stop 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 msgr2=0x7fe7d414e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00cbd0 tx=0x7fe7cc00a430 comp rx=0 tx=0).stop 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 shutdown_connections 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fe7b406ac00 0x7fe7b406d0c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.291 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe7d40add80 0x7fe7d414e1f0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fe7d40cb490 0x7fe7d40ad840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 --2- 172.21.15.192:0/980464057 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fe7d40b0290 0x7fe7d413f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 >> 172.21.15.192:0/980464057 conn(0x7fe7d40ae960 msgr2=0x7fe7d40714b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 shutdown_connections 2024-09-13T18:48:27.292 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.288+0000 7fe7d9400640 1 -- 172.21.15.192:0/980464057 wait complete. 2024-09-13T18:48:27.307 INFO:tasks.ceph:Scrubbing osd.5 2024-09-13T18:48:27.307 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:27.463 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.461+0000 7f372de00640 1 Processor -- start 2024-09-13T18:48:27.464 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.461+0000 7f372de00640 1 -- start start 2024-09-13T18:48:27.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f372de00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3728150260 0x7f372806c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f372de00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f372806cc20 0x7f372815cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.465 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f372de00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f372806a7b0 con 0x7f3728150640 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f372de00640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372806b5f0 con 0x7f3728150260 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f372de00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372806a9e0 con 0x7f372806cc20 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f3726a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3728150260 0x7f372806c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f3726a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f3728150260 0x7f372806c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39154/0 (socket says 172.21.15.192:39154) 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.462+0000 7f3726a00640 1 -- 172.21.15.192:0/1899130664 learned_addr learned my addr 172.21.15.192:0/1899130664 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.463+0000 7f371fe00640 1 --2- 172.21.15.192:0/1899130664 >> v2:172.21.15.194:3300/0 conn(0x7f372806cc20 0x7f372815cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.463+0000 7f3726a00640 1 -- 172.21.15.192:0/1899130664 >> v2:172.21.15.194:3300/0 conn(0x7f372806cc20 msgr2=0x7f372815cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.463+0000 7f3726a00640 1 --2- 172.21.15.192:0/1899130664 >> v2:172.21.15.194:3300/0 conn(0x7f372806cc20 0x7f372815cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.463+0000 7f3726a00640 1 -- 172.21.15.192:0/1899130664 >> v1:172.21.15.192:6789/0 conn(0x7f3728150640 legacy=0x7f37281599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.466 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.463+0000 7f3726a00640 1 -- 172.21.15.192:0/1899130664 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372806acc0 con 0x7f3728150260 2024-09-13T18:48:27.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.464+0000 7f3726a00640 1 --2- 172.21.15.192:0/1899130664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3728150260 0x7f372806c6e0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f372806bba0 tx=0x7f371802b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4504875b44c1a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.464+0000 7f3726000640 1 -- 172.21.15.192:0/1899130664 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718030710 con 0x7f3728150260 2024-09-13T18:48:27.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.464+0000 7f3726000640 1 -- 172.21.15.192:0/1899130664 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371802e050 con 0x7f3728150260 2024-09-13T18:48:27.467 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.464+0000 7f3726000640 1 -- 172.21.15.192:0/1899130664 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718030a90 con 0x7f3728150260 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 -- 172.21.15.192:0/1899130664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3728150260 msgr2=0x7f372806c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 --2- 172.21.15.192:0/1899130664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3728150260 0x7f372806c6e0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f372806bba0 tx=0x7f371802b630 comp rx=0 tx=0).stop 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 -- 172.21.15.192:0/1899130664 shutdown_connections 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 --2- 172.21.15.192:0/1899130664 >> v2:172.21.15.194:3300/0 conn(0x7f372806cc20 0x7f372815cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 --2- 172.21.15.192:0/1899130664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3728150260 0x7f372806c6e0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 -- 172.21.15.192:0/1899130664 >> 172.21.15.192:0/1899130664 conn(0x7f37280b0e80 msgr2=0x7f37280b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 -- 172.21.15.192:0/1899130664 shutdown_connections 2024-09-13T18:48:27.468 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.465+0000 7f372de00640 1 -- 172.21.15.192:0/1899130664 wait complete. 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.467+0000 7f372de00640 1 Processor -- start 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.467+0000 7f372de00640 1 -- start start 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 0x7f3728163a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728150260 0x7f37280ad9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3728150640 0x7f37280adef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.472 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372814ecc0 con 0x7f372806cc20 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3728151f20 con 0x7f3728150260 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f372de00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372814eed0 con 0x7f3728150640 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 0x7f3728163a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 0x7f3728163a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39158/0 (socket says 172.21.15.192:39158) 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 -- 172.21.15.192:0/4285027514 learned_addr learned my addr 172.21.15.192:0/4285027514 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 -- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3728150640 msgr2=0x7f37280adef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f3728150640 0x7f37280adef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 -- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728150260 msgr2=0x7f37280ad9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f371fe00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728150260 0x7f37280ad9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728150260 0x7f37280ad9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f3726a00640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371800a670 con 0x7f372806cc20 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.468+0000 7f371fe00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f3728150260 0x7f37280ad9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:27.473 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f3726a00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 0x7f3728163a70 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f3718000c00 tx=0x7f37180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718032990 con 0x7f372806cc20 2024-09-13T18:48:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718032b10 con 0x7f372806cc20 2024-09-13T18:48:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371803b430 con 0x7f372806cc20 2024-09-13T18:48:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372814f1b0 con 0x7f372806cc20 2024-09-13T18:48:27.474 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.469+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372814f770 con 0x7f372806cc20 2024-09-13T18:48:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.470+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37280718e0 con 0x7f372806cc20 2024-09-13T18:48:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.471+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f371803b590 con 0x7f372806cc20 2024-09-13T18:48:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371f400640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f370406ac00 0x7f370406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f37180a9e30 con 0x7f372806cc20 2024-09-13T18:48:27.475 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371fe00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f370406ac00 0x7f370406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371f400640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f3704070a60 0x7f3704072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3704073530 con 0x7f3704070a60 2024-09-13T18:48:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37180ac490 con 0x7f372806cc20 2024-09-13T18:48:27.476 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.472+0000 7f3727400640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f3704070a60 0x7f3704072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.473+0000 7f371fe00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f370406ac00 0x7f370406d0c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f372815ca50 tx=0x7f3710008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.473+0000 7f3727400640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f3704070a60 0x7f3704072e80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.477 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.474+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== osd.5 v2:172.21.15.194:6817/1215883585 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f3704073530 con 0x7f3704070a60 2024-09-13T18:48:27.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.485+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 --> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f372814d8d0 con 0x7f3704070a60 2024-09-13T18:48:27.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.486+0000 7f371f400640 1 -- 172.21.15.192:0/4285027514 <== osd.5 v2:172.21.15.194:6817/1215883585 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f372814d8d0 con 0x7f3704070a60 2024-09-13T18:48:27.489 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:27.489 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:27.489 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:27.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.486+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f3704070a60 msgr2=0x7f3704072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.486+0000 7f372de00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.194:6817/1215883585,v1:172.21.15.194:6819/1215883585] conn(0x7f3704070a60 0x7f3704072e80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f370406ac00 msgr2=0x7f370406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f370406ac00 0x7f370406d0c0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f372815ca50 tx=0x7f3710008040 comp rx=0 tx=0).stop 2024-09-13T18:48:27.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 msgr2=0x7f3728163a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 --2- 172.21.15.192:0/4285027514 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f372806cc20 0x7f3728163a70 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f3718000c00 tx=0x7f37180046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f3727400640 1 -- 172.21.15.192:0/4285027514 reap_dead start 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 shutdown_connections 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 >> 172.21.15.192:0/4285027514 conn(0x7f37280b0e80 msgr2=0x7f372815b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 shutdown_connections 2024-09-13T18:48:27.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.487+0000 7f372de00640 1 -- 172.21.15.192:0/4285027514 wait complete. 2024-09-13T18:48:27.505 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-13T18:48:27.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.654+0000 7f264f200640 1 Processor -- start 2024-09-13T18:48:27.657 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.654+0000 7f264f200640 1 -- start start 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f264f200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f26480cb490 0x7f264815a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f264f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481637c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f264f200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26480cd570 con 0x7f26480b3c60 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f264f200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26480cd7a0 con 0x7f26480cb490 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f264f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26480cda80 con 0x7f26480b0460 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f2647e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f26480cb490 0x7f264815a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f2647e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f26480cb490 0x7f264815a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39164/0 (socket says 172.21.15.192:39164) 2024-09-13T18:48:27.658 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.655+0000 7f2647e00640 1 -- 172.21.15.192:0/746356374 learned_addr learned my addr 172.21.15.192:0/746356374 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f264d200640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481637c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f2647e00640 1 -- 172.21.15.192:0/746356374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 msgr2=0x7f26481637c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f2647e00640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481637c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f2647e00640 1 -- 172.21.15.192:0/746356374 >> v1:172.21.15.194:6789/0 conn(0x7f26480b3c60 legacy=0x7f26480afd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f2647e00640 1 -- 172.21.15.192:0/746356374 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26480cdd60 con 0x7f26480cb490 2024-09-13T18:48:27.659 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.656+0000 7f264d200640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:27.660 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f2647e00640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26480cb490 0x7f264815a990 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f263800bb10 tx=0x7f263802c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9075a876f739f71f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f2647400640 1 -- 172.21.15.192:0/746356374 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26380326f0 con 0x7f26480cb490 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f2647400640 1 -- 172.21.15.192:0/746356374 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2638032850 con 0x7f26480cb490 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f2647400640 1 -- 172.21.15.192:0/746356374 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638032be0 con 0x7f26480cb490 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f264f200640 1 -- 172.21.15.192:0/746356374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26480cb490 msgr2=0x7f264815a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.657+0000 7f264f200640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26480cb490 0x7f264815a990 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f263800bb10 tx=0x7f263802c830 comp rx=0 tx=0).stop 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 -- 172.21.15.192:0/746356374 shutdown_connections 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481637c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 --2- 172.21.15.192:0/746356374 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f26480cb490 0x7f264815a990 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 -- 172.21.15.192:0/746356374 >> 172.21.15.192:0/746356374 conn(0x7f26480ae960 msgr2=0x7f264806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.661 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 -- 172.21.15.192:0/746356374 shutdown_connections 2024-09-13T18:48:27.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.658+0000 7f264f200640 1 -- 172.21.15.192:0/746356374 wait complete. 2024-09-13T18:48:27.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.659+0000 7f264f200640 1 Processor -- start 2024-09-13T18:48:27.662 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.659+0000 7f264f200640 1 -- start start 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26480cb490 0x7f26480ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26481f6ee0 con 0x7f264814d930 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26480caca0 con 0x7f26480cb490 2024-09-13T18:48:27.663 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.660+0000 7f264f200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26481f62d0 con 0x7f26480b0460 2024-09-13T18:48:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39180/0 (socket says 172.21.15.192:39180) 2024-09-13T18:48:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 -- 172.21.15.192:0/2519581125 learned_addr learned my addr 172.21.15.192:0/2519581125 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f2647e00640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f263fe00640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26480cb490 0x7f26480ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 -- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 msgr2=0x7f26481559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 -- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26480cb490 msgr2=0x7f26480ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26480cb490 0x7f26480ca760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 -- 172.21.15.192:0/2519581125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263800b770 con 0x7f264814d930 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.661+0000 7f264d200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f264000ce80 tx=0x7f264000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.662+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000d840 con 0x7f264814d930 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.662+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f264000d9e0 con 0x7f264814d930 2024-09-13T18:48:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.662+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f264000dd90 con 0x7f264814d930 2024-09-13T18:48:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.662+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26481f65b0 con 0x7f264814d930 2024-09-13T18:48:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.662+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481f6b70 con 0x7f264814d930 2024-09-13T18:48:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.663+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26480afd50 con 0x7f264814d930 2024-09-13T18:48:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.664+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2640015440 con 0x7f264814d930 2024-09-13T18:48:27.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.665+0000 7f2644c00640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 0x7f262406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:27.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.665+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2640089920 con 0x7f264814d930 2024-09-13T18:48:27.667 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.665+0000 7f2647e00640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 0x7f262406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:27.668 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.666+0000 7f2647e00640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 0x7f262406d0c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2638037000 tx=0x7f2638032000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:27.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.669+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f2640054f40 con 0x7f264814d930 2024-09-13T18:48:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.839+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f26480ccc20 con 0x7f262406ac00 2024-09-13T18:48:27.842 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.840+0000 7f2644c00640 1 -- 172.21.15.192:0/2519581125 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2638045090 con 0x7f262406ac00 2024-09-13T18:48:27.843 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 5 to deep-scrub 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 msgr2=0x7f262406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 0x7f262406d0c0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2638037000 tx=0x7f2638032000 comp rx=0 tx=0).stop 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 msgr2=0x7f26480ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f264000ce80 tx=0x7f264000a710 comp rx=0 tx=0).stop 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 shutdown_connections 2024-09-13T18:48:27.845 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f262406ac00 0x7f262406d0c0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f264814d930 0x7f26480ad840 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f26480cb490 0x7f26480ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 --2- 172.21.15.192:0/2519581125 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f26480b0460 0x7f26481559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 >> 172.21.15.192:0/2519581125 conn(0x7f26480ae960 msgr2=0x7f26480cbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 shutdown_connections 2024-09-13T18:48:27.846 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:27.842+0000 7f264f200640 1 -- 172.21.15.192:0/2519581125 wait complete. 2024-09-13T18:48:27.860 INFO:tasks.ceph:Scrubbing osd.6 2024-09-13T18:48:27.861 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:28.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.013+0000 7f272f000640 1 Processor -- start 2024-09-13T18:48:28.016 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.013+0000 7f272f000640 1 -- start start 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f272815a920 0x7f27280ad840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272f000640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280ae1e0 con 0x7f27280ccae0 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272f000640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27280cd200 con 0x7f27280add80 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27280cde80 con 0x7f272815a920 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272e600640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f27280ccae0 0x7f272815e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33390/0 (socket says 172.21.15.192:33390) 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272e600640 1 -- 172.21.15.192:0/2251696776 learned_addr learned my addr 172.21.15.192:0/2251696776 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:28.018 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.015+0000 7f272dc00640 1 --2- 172.21.15.192:0/2251696776 >> v2:172.21.15.194:3300/0 conn(0x7f272815a920 0x7f27280ad840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.016+0000 7f2727e00640 1 -- 172.21.15.192:0/2251696776 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568244822 0 0) 0x7f27280ae1e0 con 0x7f27280ccae0 2024-09-13T18:48:28.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.016+0000 7f2727e00640 1 -- 172.21.15.192:0/2251696776 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2710003520 con 0x7f27280ccae0 2024-09-13T18:48:28.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.016+0000 7f272dc00640 1 -- 172.21.15.192:0/2251696776 >> v1:172.21.15.194:6789/0 conn(0x7f27280add80 legacy=0x7f27280cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.016+0000 7f272dc00640 1 -- 172.21.15.192:0/2251696776 >> v1:172.21.15.192:6789/0 conn(0x7f27280ccae0 legacy=0x7f272815e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.019 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.016+0000 7f272dc00640 1 -- 172.21.15.192:0/2251696776 --> v2:172.21.15.194:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27280cd4e0 con 0x7f272815a920 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.017+0000 7f272dc00640 1 --2- 172.21.15.192:0/2251696776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272815a920 0x7f27280ad840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f271c0097a0 tx=0x7f271c02a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=619799f2c99b43f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.017+0000 7f2727e00640 1 -- 172.21.15.192:0/2251696776 <== mon.1 v2:172.21.15.194:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c032440 con 0x7f272815a920 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.017+0000 7f2727e00640 1 -- 172.21.15.192:0/2251696776 <== mon.1 v2:172.21.15.194:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c0325a0 con 0x7f272815a920 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.017+0000 7f2727e00640 1 -- 172.21.15.192:0/2251696776 <== mon.1 v2:172.21.15.194:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c032930 con 0x7f272815a920 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 -- 172.21.15.192:0/2251696776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272815a920 msgr2=0x7f27280ad840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 --2- 172.21.15.192:0/2251696776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272815a920 0x7f27280ad840 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f271c0097a0 tx=0x7f271c02a1a0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 -- 172.21.15.192:0/2251696776 shutdown_connections 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 --2- 172.21.15.192:0/2251696776 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f272815a920 0x7f27280ad840 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.021 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 -- 172.21.15.192:0/2251696776 >> 172.21.15.192:0/2251696776 conn(0x7f27280cef60 msgr2=0x7f27280b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 -- 172.21.15.192:0/2251696776 shutdown_connections 2024-09-13T18:48:28.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.018+0000 7f272f000640 1 -- 172.21.15.192:0/2251696776 wait complete. 2024-09-13T18:48:28.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.019+0000 7f272f000640 1 Processor -- start 2024-09-13T18:48:28.022 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 -- start start 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27280add80 0x7f27280c4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27280ccae0 0x7f27281586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 0x7f2728158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272806e5e0 con 0x7f272815a920 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27280c4e70 con 0x7f27280add80 2024-09-13T18:48:28.025 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.020+0000 7f272f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272806e830 con 0x7f27280ccae0 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 0x7f2728158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 0x7f2728158c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39188/0 (socket says 172.21.15.192:39188) 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 -- 172.21.15.192:0/3014609457 learned_addr learned my addr 172.21.15.192:0/3014609457 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272dc00640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27280add80 0x7f27280c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272d200640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27280ccae0 0x7f27281586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 -- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27280ccae0 msgr2=0x7f27281586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f27280ccae0 0x7f27281586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.026 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 -- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27280add80 msgr2=0x7f27280c4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f27280add80 0x7f27280c4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c009400 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.021+0000 7f272e600640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 0x7f2728158c10 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f272000cb70 tx=0x7f272000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.022+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000ad40 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.022+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720012400 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.022+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272000aea0 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.022+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f272806eb10 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.022+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f272806f0d0 con 0x7f272815a920 2024-09-13T18:48:28.027 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.023+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f27280ccf00 con 0x7f272815a920 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.024+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f2720007070 con 0x7f272815a920 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f2725600640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270806ac00 0x7f270806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2720089080 con 0x7f272815a920 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f272dc00640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270806ac00 0x7f270806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f2725600640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7f2708070a60 0x7f2708072e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2708073530 con 0x7f2708070a60 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f272008b600 con 0x7f272815a920 2024-09-13T18:48:28.029 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.025+0000 7f272d200640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7f2708070a60 0x7f2708072e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.030 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.026+0000 7f272dc00640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270806ac00 0x7f270806d0c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.026+0000 7f272d200640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7f2708070a60 0x7f2708072e80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.031 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.027+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== osd.6 v2:172.21.15.194:6808/3931263301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f2708073530 con 0x7f2708070a60 2024-09-13T18:48:28.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.038+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 --> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f27280cdaa0 con 0x7f2708070a60 2024-09-13T18:48:28.041 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f2725600640 1 -- 172.21.15.192:0/3014609457 <== osd.6 v2:172.21.15.194:6808/3931263301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f27140014a0 con 0x7f2708070a60 2024-09-13T18:48:28.042 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:28.042 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:28.042 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7f2708070a60 msgr2=0x7f2708072e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.194:6808/3931263301,v1:172.21.15.194:6809/3931263301] conn(0x7f2708070a60 0x7f2708072e80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270806ac00 msgr2=0x7f270806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f270806ac00 0x7f270806d0c0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c02e000 comp rx=0 tx=0).stop 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 msgr2=0x7f2728158c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.039+0000 7f272f000640 1 --2- 172.21.15.192:0/3014609457 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f272815a920 0x7f2728158c10 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f272000cb70 tx=0x7f272000a430 comp rx=0 tx=0).stop 2024-09-13T18:48:28.043 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.040+0000 7f272e600640 1 -- 172.21.15.192:0/3014609457 reap_dead start 2024-09-13T18:48:28.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.040+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 shutdown_connections 2024-09-13T18:48:28.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.040+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 >> 172.21.15.192:0/3014609457 conn(0x7f27280cef60 msgr2=0x7f272815b950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.040+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 shutdown_connections 2024-09-13T18:48:28.044 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.040+0000 7f272f000640 1 -- 172.21.15.192:0/3014609457 wait complete. 2024-09-13T18:48:28.058 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-13T18:48:28.212 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.209+0000 7fbd4da00640 1 Processor -- start 2024-09-13T18:48:28.213 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.209+0000 7fbd4da00640 1 -- start start 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd4da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd4815b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd4da00640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 0x7fbd48140db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd4da00640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd4813e080 con 0x7fbd480afd50 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd4da00640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd4815b6c0 con 0x7fbd4813e310 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd4da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd481412f0 con 0x7fbd48155460 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd47400640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7fbd480afd50 0x7fbd48071060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33394/0 (socket says 172.21.15.192:33394) 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.210+0000 7fbd47400640 1 -- 172.21.15.192:0/1675750461 learned_addr learned my addr 172.21.15.192:0/1675750461 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46a00640 1 --2- 172.21.15.192:0/1675750461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd4815b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.216 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd3fe00640 1 --2- 172.21.15.192:0/1675750461 >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 0x7fbd48140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46000640 1 -- 172.21.15.192:0/1675750461 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347264398 0 0) 0x7fbd4813e080 con 0x7fbd480afd50 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46000640 1 -- 172.21.15.192:0/1675750461 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd2c003520 con 0x7fbd480afd50 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46a00640 1 -- 172.21.15.192:0/1675750461 >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 msgr2=0x7fbd48140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46a00640 1 --2- 172.21.15.192:0/1675750461 >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 0x7fbd48140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46a00640 1 -- 172.21.15.192:0/1675750461 >> v1:172.21.15.192:6789/0 conn(0x7fbd480afd50 legacy=0x7fbd48071060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd46a00640 1 -- 172.21.15.192:0/1675750461 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd4815b8a0 con 0x7fbd48155460 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.211+0000 7fbd3fe00640 1 --2- 172.21.15.192:0/1675750461 >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 0x7fbd48140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.212+0000 7fbd46a00640 1 --2- 172.21.15.192:0/1675750461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd4815b180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097a0 tx=0x7fbd3802a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e9be4e45f6fea0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd46000640 1 -- 172.21.15.192:0/1675750461 <== mon.2 v2:172.21.15.194:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38032440 con 0x7fbd48155460 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd46000640 1 -- 172.21.15.192:0/1675750461 <== mon.2 v2:172.21.15.194:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd380325a0 con 0x7fbd48155460 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd46000640 1 -- 172.21.15.192:0/1675750461 <== mon.2 v2:172.21.15.194:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd38032930 con 0x7fbd48155460 2024-09-13T18:48:28.217 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 -- 172.21.15.192:0/1675750461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 msgr2=0x7fbd4815b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 --2- 172.21.15.192:0/1675750461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd4815b180 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbd380097a0 tx=0x7fbd3802a180 comp rx=0 tx=0).stop 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 -- 172.21.15.192:0/1675750461 shutdown_connections 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 --2- 172.21.15.192:0/1675750461 >> v2:172.21.15.194:3300/0 conn(0x7fbd4813e310 0x7fbd48140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 --2- 172.21.15.192:0/1675750461 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd4815b180 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 -- 172.21.15.192:0/1675750461 >> 172.21.15.192:0/1675750461 conn(0x7fbd480ae960 msgr2=0x7fbd4806beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 -- 172.21.15.192:0/1675750461 shutdown_connections 2024-09-13T18:48:28.218 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.213+0000 7fbd4da00640 1 -- 172.21.15.192:0/1675750461 wait complete. 2024-09-13T18:48:28.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.215+0000 7fbd4da00640 1 Processor -- start 2024-09-13T18:48:28.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.215+0000 7fbd4da00640 1 -- start start 2024-09-13T18:48:28.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd480afd50 0x7fbd48153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.221 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd481e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd48139e10 con 0x7fbd4813e310 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4813c320 con 0x7fbd480afd50 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd4da00640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd4813b710 con 0x7fbd48155460 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39192/0 (socket says 172.21.15.192:39192) 2024-09-13T18:48:28.222 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 -- 172.21.15.192:0/3678947030 learned_addr learned my addr 172.21.15.192:0/3678947030 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:28.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 -- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 msgr2=0x7fbd481e2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd481e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 -- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd480afd50 msgr2=0x7fbd48153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.223 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd480afd50 0x7fbd48153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.216+0000 7fbd3fe00640 1 -- 172.21.15.192:0/3678947030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009400 con 0x7fbd4813e310 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd3fe00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e960 tx=0x7fbd3000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3000ca00 con 0x7fbd4813e310 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3000cb60 con 0x7fbd4813e310 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd38009400 con 0x7fbd4813e310 2024-09-13T18:48:28.224 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30013470 con 0x7fbd4813e310 2024-09-13T18:48:28.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.217+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd4813bcd0 con 0x7fbd4813e310 2024-09-13T18:48:28.225 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.218+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd48140db0 con 0x7fbd4813e310 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.219+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fbd300135d0 con 0x7fbd4813e310 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.220+0000 7fbd3ea00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.220+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbd30089300 con 0x7fbd4813e310 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.220+0000 7fbd46a00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.221+0000 7fbd46a00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 0x7fbd2406d0c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbd38034000 tx=0x7fbd3802c000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.227 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.224+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fbd300547d0 con 0x7fbd4813e310 2024-09-13T18:48:28.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.391+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fbd4806ed60 con 0x7fbd2406ac00 2024-09-13T18:48:28.395 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.392+0000 7fbd3ea00640 1 -- 172.21.15.192:0/3678947030 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fbd4806ed60 con 0x7fbd2406ac00 2024-09-13T18:48:28.395 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 6 to deep-scrub 2024-09-13T18:48:28.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 msgr2=0x7fbd2406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 0x7fbd2406d0c0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fbd38034000 tx=0x7fbd3802c000 comp rx=0 tx=0).stop 2024-09-13T18:48:28.398 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 msgr2=0x7fbd4813c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fbd3000e960 tx=0x7fbd3000ee20 comp rx=0 tx=0).stop 2024-09-13T18:48:28.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 shutdown_connections 2024-09-13T18:48:28.399 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fbd2406ac00 0x7fbd2406d0c0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fbd48155460 0x7fbd481e2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.400 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbd4813e310 0x7fbd4813c7b0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 --2- 172.21.15.192:0/3678947030 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fbd480afd50 0x7fbd48153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 >> 172.21.15.192:0/3678947030 conn(0x7fbd480ae960 msgr2=0x7fbd48071810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.394+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 shutdown_connections 2024-09-13T18:48:28.401 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.395+0000 7fbd4da00640 1 -- 172.21.15.192:0/3678947030 wait complete. 2024-09-13T18:48:28.413 INFO:tasks.ceph:Scrubbing osd.7 2024-09-13T18:48:28.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-13T18:48:28.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.567+0000 7f98b3600640 1 Processor -- start 2024-09-13T18:48:28.570 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.567+0000 7f98b3600640 1 -- start start 2024-09-13T18:48:28.576 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b3600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f98ac0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b3600640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f98ac13d410 0x7f98ac13d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b3600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac0ce6f0 con 0x7f98ac0ce310 2024-09-13T18:48:28.577 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b3600640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0b3bf0 con 0x7f98ac13d410 2024-09-13T18:48:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b3600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15b0a0 con 0x7f98ac0b3290 2024-09-13T18:48:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b0c00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f98ac0ce310 0x7f98ac15a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33402/0 (socket says 172.21.15.192:33402) 2024-09-13T18:48:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.568+0000 7f98b0c00640 1 -- 172.21.15.192:0/551092474 learned_addr learned my addr 172.21.15.192:0/551092474 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v1:172.21.15.192:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1845667783 0 0) 0x7f98ac0ce6f0 con 0x7f98ac0ce310 2024-09-13T18:48:28.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98b1600640 1 --2- 172.21.15.192:0/551092474 >> v2:172.21.15.194:3300/0 conn(0x7f98ac13d410 0x7f98ac13d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 --> v1:172.21.15.192:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9890003520 con 0x7f98ac0ce310 2024-09-13T18:48:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98abe00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f98ac0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v1:172.21.15.192:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2113081012 0 0) 0x7f9890003520 con 0x7f98ac0ce310 2024-09-13T18:48:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 msgr2=0x7f98ac0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f98ac0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 >> v2:172.21.15.194:3300/0 conn(0x7f98ac13d410 msgr2=0x7f98ac13d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 --2- 172.21.15.192:0/551092474 >> v2:172.21.15.194:3300/0 conn(0x7f98ac13d410 0x7f98ac13d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 --> v1:172.21.15.192:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac13f490 con 0x7f98ac0ce310 2024-09-13T18:48:28.580 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v1:172.21.15.192:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2910209656 0 0) 0x7f989c001670 con 0x7f98ac0ce310 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 >> v1:172.21.15.192:6789/0 conn(0x7f98ac0ce310 legacy=0x7f98ac15a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f9890003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9890003ef0 0x7f98900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9890004d00 0x7f9890005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b3bf0 con 0x7f9890003ef0 2024-09-13T18:48:28.581 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15b0a0 con 0x7f9890004d00 2024-09-13T18:48:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989000b980 con 0x7f98ac0b3290 2024-09-13T18:48:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.569+0000 7f98abe00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9890003ef0 0x7f98900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98b0c00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f9890003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98b1600640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9890004d00 0x7f9890005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.582 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98abe00640 1 -- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 msgr2=0x7f9890003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98abe00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f98ac0b3290 0x7f9890003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98abe00640 1 -- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9890004d00 msgr2=0x7f9890005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98abe00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f9890004d00 0x7f9890005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.570+0000 7f98abe00640 1 -- 172.21.15.192:0/551092474 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9890003520 con 0x7f9890003ef0 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.571+0000 7f98abe00640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9890003ef0 0x7f98900047c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9898009ac0 tx=0x7f98900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571a83343ecf2a9f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.571+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898031400 con 0x7f9890003ef0 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.571+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989802d050 con 0x7f9890003ef0 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.571+0000 7f98ab400640 1 -- 172.21.15.192:0/551092474 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9898031780 con 0x7f9890003ef0 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 -- 172.21.15.192:0/551092474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9890003ef0 msgr2=0x7f98900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 --2- 172.21.15.192:0/551092474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9890003ef0 0x7f98900047c0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f9898009ac0 tx=0x7f98900057f0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b1600640 1 -- 172.21.15.192:0/551092474 reap_dead start 2024-09-13T18:48:28.583 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 -- 172.21.15.192:0/551092474 shutdown_connections 2024-09-13T18:48:28.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 -- 172.21.15.192:0/551092474 >> 172.21.15.192:0/551092474 conn(0x7f98ac0b0e80 msgr2=0x7f98ac0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 -- 172.21.15.192:0/551092474 shutdown_connections 2024-09-13T18:48:28.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.572+0000 7f98b3600640 1 -- 172.21.15.192:0/551092474 wait complete. 2024-09-13T18:48:28.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.573+0000 7f98b3600640 1 Processor -- start 2024-09-13T18:48:28.584 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.573+0000 7f98b3600640 1 -- start start 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9890003ef0 0x7f98ac159a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98ac153560 0x7f98ac12d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 0x7f98ac151b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac154ac0 con 0x7f98ac1516f0 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1520b0 con 0x7f98ac153560 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.574+0000 7f98b3600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac153e40 con 0x7f9890003ef0 2024-09-13T18:48:28.587 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 0x7f98ac151b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 0x7f98ac151b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39222/0 (socket says 172.21.15.192:39222) 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 -- 172.21.15.192:0/1578431137 learned_addr learned my addr 172.21.15.192:0/1578431137 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98abe00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98ac153560 0x7f98ac12d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b0c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9890003ef0 0x7f98ac159a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 -- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9890003ef0 msgr2=0x7f98ac159a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9890003ef0 0x7f98ac159a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 -- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98ac153560 msgr2=0x7f98ac12d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f98ac153560 0x7f98ac12d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac154120 con 0x7f98ac1516f0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b0c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f9890003ef0 0x7f98ac159a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98b1600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 0x7f98ac151b70 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f98ac140380 tx=0x7f98a400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400e040 con 0x7f98ac1516f0 2024-09-13T18:48:28.588 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.575+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400f040 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.576+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4015430 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.576+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac154400 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.576+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac12d7a0 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.576+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98ac15e6f0 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.577+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f98a4015590 con 0x7f98ac1516f0 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98a8c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988c06ac30 0x7f988c06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.589 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f98a40897d0 con 0x7f98ac1516f0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98b0c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988c06ac30 0x7f988c06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98a8c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f988c070a90 0x7f988c072eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f988c073560 con 0x7f988c070a90 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.578+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_get_version_reply(handle=1 version=204) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98a408bdb0 con 0x7f98ac1516f0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.579+0000 7f98abe00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f988c070a90 0x7f988c072eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.579+0000 7f98b0c00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988c06ac30 0x7f988c06d0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f989c001050 tx=0x7f989c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.580+0000 7f98abe00640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f988c070a90 0x7f988c072eb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.580+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== osd.7 v2:172.21.15.194:6816/4082236586 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24459 (crc 0 0 0) 0x7f988c073560 con 0x7f988c070a90 2024-09-13T18:48:28.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.592+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 --> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f98ac13fd30 con 0x7f988c070a90 2024-09-13T18:48:28.595 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98a8c00640 1 -- 172.21.15.192:0/1578431137 <== osd.7 v2:172.21.15.194:6816/4082236586 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+632 (crc 0 0 0) 0x7f98980041c0 con 0x7f988c070a90 2024-09-13T18:48:28.596 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-13T18:48:28.596 INFO:teuthology.orchestra.run.smithi192.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-09-13T18:48:28.596 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f988c070a90 msgr2=0x7f988c072eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.194:6816/4082236586,v1:172.21.15.194:6818/4082236586] conn(0x7f988c070a90 0x7f988c072eb0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988c06ac30 msgr2=0x7f988c06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f988c06ac30 0x7f988c06d0f0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f989c001050 tx=0x7f989c009040 comp rx=0 tx=0).stop 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 msgr2=0x7f98ac151b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 --2- 172.21.15.192:0/1578431137 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98ac1516f0 0x7f98ac151b70 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f98ac140380 tx=0x7f98a400f580 comp rx=0 tx=0).stop 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b1600640 1 -- 172.21.15.192:0/1578431137 reap_dead start 2024-09-13T18:48:28.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 shutdown_connections 2024-09-13T18:48:28.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 >> 172.21.15.192:0/1578431137 conn(0x7f98ac0b0e80 msgr2=0x7f98ac0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 shutdown_connections 2024-09-13T18:48:28.598 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.593+0000 7f98b3600640 1 -- 172.21.15.192:0/1578431137 wait complete. 2024-09-13T18:48:28.611 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-13T18:48:28.763 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.761+0000 7f54c1600640 1 Processor -- start 2024-09-13T18:48:28.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.761+0000 7f54c1600640 1 -- start start 2024-09-13T18:48:28.765 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c1600640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f54bc0cd6f0 0x7f54bc06b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c1600640 1 -- --> v1:172.21.15.192:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0b2d00 con 0x7f54bc157480 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c1600640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54bc0cdc80 con 0x7f54bc06afb0 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c1600640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54bc0b3380 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54bbe00640 1 --1- >> v1:172.21.15.192:6789/0 conn(0x7f54bc157480 0x7f54bc0b37a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.192:6789/0 says I am v1:172.21.15.192:33408/0 (socket says 172.21.15.192:33408) 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54bbe00640 1 -- 172.21.15.192:0/2630828414 learned_addr learned my addr 172.21.15.192:0/2630828414 (peer_addr_for_me v1:172.21.15.192:0/0) 2024-09-13T18:48:28.767 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c0c00640 1 --2- 172.21.15.192:0/2630828414 >> v2:172.21.15.192:3300/0 conn(0x7f54bc0cd6f0 0x7f54bc06b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.762+0000 7f54c0c00640 1 -- 172.21.15.192:0/2630828414 >> v1:172.21.15.194:6789/0 conn(0x7f54bc06afb0 legacy=0x7f54bc0ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:28.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.763+0000 7f54c0c00640 1 -- 172.21.15.192:0/2630828414 >> v1:172.21.15.192:6789/0 conn(0x7f54bc157480 legacy=0x7f54bc0b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.769 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.763+0000 7f54c0c00640 1 -- 172.21.15.192:0/2630828414 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54bc0b2fa0 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.763+0000 7f54c0c00640 1 --2- 172.21.15.192:0/2630828414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc06b420 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b402c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac23db9e1c01ad server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54baa00640 1 -- 172.21.15.192:0/2630828414 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4007740 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54baa00640 1 -- 172.21.15.192:0/2630828414 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54b402f050 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54baa00640 1 -- 172.21.15.192:0/2630828414 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54b4007ac0 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 -- 172.21.15.192:0/2630828414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 msgr2=0x7f54bc06b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 --2- 172.21.15.192:0/2630828414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc06b420 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f54b4009d90 tx=0x7f54b402c820 comp rx=0 tx=0).stop 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 -- 172.21.15.192:0/2630828414 shutdown_connections 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 --2- 172.21.15.192:0/2630828414 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc06b420 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 -- 172.21.15.192:0/2630828414 >> 172.21.15.192:0/2630828414 conn(0x7f54bc0734f0 msgr2=0x7f54bc0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.770 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.764+0000 7f54c1600640 1 -- 172.21.15.192:0/2630828414 shutdown_connections 2024-09-13T18:48:28.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.765+0000 7f54c1600640 1 -- 172.21.15.192:0/2630828414 wait complete. 2024-09-13T18:48:28.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.766+0000 7f54c1600640 1 Processor -- start 2024-09-13T18:48:28.771 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.766+0000 7f54c1600640 1 -- start start 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc06afb0 0x7f54bc142e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54bc157480 0x7f54bc1e43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc0b3eb0 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc15bdc0 con 0x7f54bc06afb0 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54c1600640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54bc15b1b0 con 0x7f54bc157480 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54bb400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39234/0 (socket says 172.21.15.192:39234) 2024-09-13T18:48:28.773 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54bb400640 1 -- 172.21.15.192:0/286694014 learned_addr learned my addr 172.21.15.192:0/286694014 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.767+0000 7f54bbe00640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc06afb0 0x7f54bc142e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54c0c00640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54bc157480 0x7f54bc1e43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 -- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54bc157480 msgr2=0x7f54bc1e43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54bc157480 0x7f54bc1e43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 -- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc06afb0 msgr2=0x7f54bc142e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc06afb0 0x7f54bc142e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 -- 172.21.15.192:0/286694014 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b4009a70 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54bb400640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c430 tx=0x7f54a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011790 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a80118f0 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54bc15b490 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.774 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a8011ce0 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.768+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54bc15ba50 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.775 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.770+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54bc15bc10 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.770+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f54a801c460 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.771+0000 7f54b3e00640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 0x7f549c06d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:28.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.771+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f54a8088f40 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.772+0000 7f54bbe00640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 0x7f549c06d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:28.776 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.772+0000 7f54bbe00640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 0x7f549c06d0c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f54ac005880 tx=0x7f54ac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:28.778 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.776+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f54a8054410 con 0x7f54bc0cd6f0 2024-09-13T18:48:28.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.945+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f54bc071350 con 0x7f549c06ac00 2024-09-13T18:48:28.948 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.945+0000 7f54b3e00640 1 -- 172.21.15.192:0/286694014 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f54bc071350 con 0x7f549c06ac00 2024-09-13T18:48:28.948 INFO:teuthology.orchestra.run.smithi192.stderr:instructed osd(s) 7 to deep-scrub 2024-09-13T18:48:28.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 msgr2=0x7f549c06d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.950 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 0x7f549c06d0c0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f54ac005880 tx=0x7f54ac009040 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 msgr2=0x7f54bc0ad910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f54a800c430 tx=0x7f54a800c8f0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 shutdown_connections 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f549c06ac00 0x7f549c06d0c0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f54bc157480 0x7f54bc1e43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54bc0cd6f0 0x7f54bc0ad910 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 --2- 172.21.15.192:0/286694014 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f54bc06afb0 0x7f54bc142e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 >> 172.21.15.192:0/286694014 conn(0x7f54bc0734f0 msgr2=0x7f54bc0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 shutdown_connections 2024-09-13T18:48:28.951 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:28.947+0000 7f54c1600640 1 -- 172.21.15.192:0/286694014 wait complete. 2024-09-13T18:48:28.966 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-13T18:48:29.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.127+0000 7f5099200640 1 Processor -- start 2024-09-13T18:48:29.130 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.127+0000 7f5099200640 1 -- start start 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5099200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 0x7f50940b8340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5099200640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50940b22b0 0x7f50940b8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5099200640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50940d0940 con 0x7f509415d590 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5099200640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509415e130 con 0x7f50940b22b0 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5099200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50940d0b90 con 0x7f50941571a0 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5092a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50940b22b0 0x7f50940b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5092a00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f50940b22b0 0x7f50940b8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39244/0 (socket says 172.21.15.192:39244) 2024-09-13T18:48:29.131 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.128+0000 7f5092a00640 1 -- 172.21.15.192:0/1156115483 learned_addr learned my addr 172.21.15.192:0/1156115483 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5093400640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 0x7f50940b8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5092a00640 1 -- 172.21.15.192:0/1156115483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 msgr2=0x7f50940b8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5092a00640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 0x7f50940b8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5092a00640 1 -- 172.21.15.192:0/1156115483 >> v1:172.21.15.194:6789/0 conn(0x7f509415d590 legacy=0x7f509415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.132 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5092a00640 1 -- 172.21.15.192:0/1156115483 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50940d0e70 con 0x7f50940b22b0 2024-09-13T18:48:29.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.129+0000 7f5093400640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 0x7f50940b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T18:48:29.133 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5092a00640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f50940b8880 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508002a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e2a55f4427796f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5092000640 1 -- 172.21.15.192:0/1156115483 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080032440 con 0x7f50940b22b0 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5092000640 1 -- 172.21.15.192:0/1156115483 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50800325a0 con 0x7f50940b22b0 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5092000640 1 -- 172.21.15.192:0/1156115483 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080032930 con 0x7f50940b22b0 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5099200640 1 -- 172.21.15.192:0/1156115483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 msgr2=0x7f50940b8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.130+0000 7f5099200640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f50940b8880 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f5080009870 tx=0x7f508002a210 comp rx=0 tx=0).stop 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 -- 172.21.15.192:0/1156115483 shutdown_connections 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f50940b8880 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 --2- 172.21.15.192:0/1156115483 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f50941571a0 0x7f50940b8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 -- 172.21.15.192:0/1156115483 >> 172.21.15.192:0/1156115483 conn(0x7f50940b4860 msgr2=0x7f50940b4c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 -- 172.21.15.192:0/1156115483 shutdown_connections 2024-09-13T18:48:29.134 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.131+0000 7f5099200640 1 -- 172.21.15.192:0/1156115483 wait complete. 2024-09-13T18:48:29.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.132+0000 7f5099200640 1 Processor -- start 2024-09-13T18:48:29.135 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.133+0000 7f5099200640 1 -- start start 2024-09-13T18:48:29.136 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.133+0000 7f5099200640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.133+0000 7f5099200640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50941571a0 0x7f50941586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5099200640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f509415d590 0x7f5094158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5099200640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50941582b0 con 0x7f50940b22b0 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5099200640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5094156310 con 0x7f50941571a0 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5099200640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50941e74b0 con 0x7f509415d590 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39252/0 (socket says 172.21.15.192:39252) 2024-09-13T18:48:29.138 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 -- 172.21.15.192:0/3110430248 learned_addr learned my addr 172.21.15.192:0/3110430248 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5092a00640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50941571a0 0x7f50941586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093e00640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f509415d590 0x7f5094158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 -- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f509415d590 msgr2=0x7f5094158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f509415d590 0x7f5094158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 -- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50941571a0 msgr2=0x7f50941586d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50941571a0 0x7f50941586d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.134+0000 7f5093400640 1 -- 172.21.15.192:0/3110430248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800094d0 con 0x7f50940b22b0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f5093400640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f508400c7f0 tx=0x7f508400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5084007a30 con 0x7f50940b22b0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5084007b90 con 0x7f50940b22b0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5094157910 con 0x7f50940b22b0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508400ce40 con 0x7f50940b22b0 2024-09-13T18:48:29.139 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.135+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5094157ed0 con 0x7f50940b22b0 2024-09-13T18:48:29.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.136+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509415aee0 con 0x7f50940b22b0 2024-09-13T18:48:29.140 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.137+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f50840113f0 con 0x7f50940b22b0 2024-09-13T18:48:29.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.138+0000 7f508b400640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 0x7f507406d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.138+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f50840891a0 con 0x7f50940b22b0 2024-09-13T18:48:29.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.138+0000 7f5092a00640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 0x7f507406d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.141 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.139+0000 7f5092a00640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 0x7f507406d0c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5080034000 tx=0x7f508002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.145 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.142+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f5084054720 con 0x7f50940b22b0 2024-09-13T18:48:29.314 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.311+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 --> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50940b3cb0 con 0x7f507406ac00 2024-09-13T18:48:29.316 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.313+0000 7f508b400640 1 -- 172.21.15.192:0/3110430248 <== mgr.4107 v2:172.21.15.192:6832/2095686379 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49712 (secure 0 0 0) 0x7f50940b3cb0 con 0x7f507406ac00 2024-09-13T18:48:29.318 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:29.318 INFO:teuthology.orchestra.run.smithi192.stderr:dumped all 2024-09-13T18:48:29.320 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 msgr2=0x7f507406d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.321 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 0x7f507406d0c0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5080034000 tx=0x7f508002e000 comp rx=0 tx=0).stop 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 msgr2=0x7f5094155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f508400c7f0 tx=0x7f508400cbf0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 shutdown_connections 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f507406ac00 0x7f507406d0c0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f509415d590 0x7f5094158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f50941571a0 0x7f50941586d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.322 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 --2- 172.21.15.192:0/3110430248 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50940b22b0 0x7f5094155dd0 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 >> 172.21.15.192:0/3110430248 conn(0x7f50940b4860 msgr2=0x7f509406b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 shutdown_connections 2024-09-13T18:48:29.323 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.316+0000 7f5099200640 1 -- 172.21.15.192:0/3110430248 wait complete. 2024-09-13T18:48:29.335 INFO:teuthology.orchestra.run.smithi192.stdout:{"pg_ready":true,"pg_map":{"version":586,"stamp":"2024-09-13T18:48:28.910714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":10169,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552330,"statfs":{"total":1600000000,"available":1589586672,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52428800,"num_objects":-13,"num_object_clones":0,"num_object_copies":-26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-32,"num_write_kb":-84992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001801"},"pg_stats":[{"pgid":"1.0","version":"204'119","reported_seq":350,"reported_epoch":204,"state":"active+clean","last_fresh":"2024-09-13T18:48:26.295076+0000","last_change":"2024-09-13T18:48:26.295151+0000","last_active":"2024-09-13T18:48:26.295076+0000","last_peered":"2024-09-13T18:48:26.295076+0000","last_clean":"2024-09-13T18:48:26.295076+0000","last_became_active":"2024-09-13T18:35:31.054304+0000","last_became_peered":"2024-09-13T18:35:31.054304+0000","last_unstale":"2024-09-13T18:48:26.295076+0000","last_undegraded":"2024-09-13T18:48:26.295076+0000","last_fullsized":"2024-09-13T18:48:26.295076+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"204'119","last_scrub_stamp":"2024-09-13T18:48:26.295055+0000","last_deep_scrub":"204'119","last_deep_scrub_stamp":"2024-09-13T18:48:26.295055+0000","last_clean_scrub_stamp":"2024-09-13T18:48:26.295055+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T20:50:12.133564+0000","scrub_duration":0.0028684800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":14,"seq":60129542303,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193608,"statfs":{"total":200000000,"available":198255558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.66200000000000003,"15min":0.65000000000000002},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.313},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":2.5419999999999998},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.68700000000000006,"15min":0.66500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.34599999999999997},"max":{"1min":0.81299999999999994,"5min":0.94799999999999995,"15min":1.014},"last":0.65700000000000003}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.70799999999999996,"15min":0.68500000000000005},"min":{"1min":0.42099999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":1.0589999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.68300000000000005,"15min":0.66700000000000004},"min":{"1min":0.45800000000000002,"5min":0.40200000000000002,"15min":0.39800000000000002},"max":{"1min":0.91600000000000004,"5min":1.0449999999999999,"15min":1.0620000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.69799999999999995,"15min":0.67800000000000005},"min":{"1min":0.48699999999999999,"5min":0.45300000000000001,"15min":0.30199999999999999},"max":{"1min":0.81699999999999995,"5min":1.004,"15min":1.004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.68400000000000005,"15min":0.66600000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.41599999999999998},"max":{"1min":0.83399999999999996,"5min":0.93799999999999994,"15min":0.999},"last":0.64300000000000002}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71999999999999997,"15min":0.77000000000000002},"min":{"1min":0.57099999999999995,"5min":0.51900000000000002,"15min":0.47499999999999998},"max":{"1min":0.91900000000000004,"5min":0.94199999999999995,"15min":6.1040000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.71299999999999997,"15min":0.76400000000000001},"min":{"1min":0.54400000000000004,"5min":0.49399999999999999,"15min":0.44},"max":{"1min":0.88,"5min":1.0880000000000001,"15min":6.0890000000000004},"last":0.48999999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.373,"5min":0.372,"15min":0.313},"max":{"1min":0.80900000000000005,"5min":0.97599999999999998,"15min":1.036},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.61399999999999999},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36299999999999999},"max":{"1min":0.83099999999999996,"5min":1.004,"15min":1.1799999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66300000000000003,"15min":0.65800000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.38300000000000001},"max":{"1min":0.84599999999999997,"5min":0.95499999999999996,"15min":1.0700000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.69499999999999995,"15min":0.70299999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89900000000000002,"5min":0.94799999999999995,"15min":1.371},"last":0.71699999999999997}]},{"osd":7,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68400000000000005,"15min":0.68000000000000005},"min":{"1min":0.45700000000000002,"5min":0.45600000000000002,"15min":0.40400000000000003},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":1.143},"last":0.621},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.505,"5min":0.48699999999999999,"15min":0.41799999999999998},"max":{"1min":0.88500000000000001,"5min":0.95699999999999996,"15min":1.125},"last":0.66600000000000004}]}]},{"osd":7,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.71099999999999997,"15min":0.67800000000000005},"min":{"1min":0.42499999999999999,"5min":0.372,"15min":0.34699999999999998},"max":{"1min":0.91400000000000003,"5min":0.93200000000000005,"15min":1.665},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71199999999999997,"15min":0.66900000000000004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.92000000000000004,"5min":0.95699999999999996,"15min":1.0429999999999999},"last":0.56299999999999994}]},{"osd":1,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73599999999999999,"15min":0.69399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.88200000000000001,"5min":0.97499999999999998,"15min":1.1240000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69099999999999995,"15min":0.66700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":1.591},"last":0.83999999999999997}]},{"osd":2,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.748,"15min":0.71299999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.439},"max":{"1min":0.94899999999999995,"5min":1.016,"15min":2.2709999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.75,"15min":0.72499999999999998},"min":{"1min":0.54300000000000004,"5min":0.49199999999999999,"15min":0.435},"max":{"1min":0.95899999999999996,"5min":1.0349999999999999,"15min":2.169},"last":0.66200000000000003}]},{"osd":3,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75900000000000001,"15min":0.71699999999999997},"min":{"1min":0.53700000000000003,"5min":0.52900000000000003,"15min":0.40300000000000002},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":1.4450000000000001},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.67500000000000004},"min":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.42199999999999999},"max":{"1min":0.91000000000000003,"5min":1.071,"15min":1.071},"last":0.80600000000000005}]},{"osd":4,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.58799999999999997,"15min":0.58699999999999997},"min":{"1min":0.46100000000000002,"5min":0.38200000000000001,"15min":0.34000000000000002},"max":{"1min":0.85699999999999998,"5min":0.86599999999999999,"15min":0.92500000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.61699999999999999,"15min":0.63300000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0780000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.70099999999999996,"15min":0.69499999999999995},"min":{"1min":0.48099999999999998,"5min":0.42899999999999999,"15min":0.40100000000000002},"max":{"1min":1.052,"5min":1.052,"15min":1.0840000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.68700000000000006,"15min":0.66800000000000004},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.372},"max":{"1min":0.95399999999999996,"5min":0.98999999999999999,"15min":1.115},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Sep 13 18:47:48 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.73699999999999999,"15min":0.71699999999999997},"min":{"1min":0.57199999999999995,"5min":0.51800000000000002,"15min":0.38900000000000001},"max":{"1min":0.98699999999999999,"5min":1.0269999999999999,"15min":1.0680000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1699999999999999},"last":0.79300000000000004}]}]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.70199999999999996,"15min":0.748},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.32400000000000001},"max":{"1min":0.92700000000000005,"5min":1.02,"15min":6.4539999999999997},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.69399999999999995,"15min":0.65900000000000003},"min":{"1min":0.504,"5min":0.42199999999999999,"15min":0.35899999999999999},"max":{"1min":0.86599999999999999,"5min":1.01,"15min":1.01},"last":0.56599999999999995}]},{"osd":1,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70799999999999996,"15min":0.75600000000000001},"min":{"1min":0.52500000000000002,"5min":0.46200000000000002,"15min":0.377},"max":{"1min":0.90500000000000003,"5min":1.0229999999999999,"15min":6.3890000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70499999999999996,"15min":0.74399999999999999},"min":{"1min":0.52300000000000002,"5min":0.46300000000000002,"15min":0.41199999999999998},"max":{"1min":0.88700000000000001,"5min":1.038,"15min":6.5019999999999998},"last":0.60099999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.70699999999999996,"15min":0.67600000000000005},"min":{"1min":0.57799999999999996,"5min":0.48699999999999999,"15min":0.41599999999999998},"max":{"1min":0.879,"5min":1.004,"15min":1.032},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.70799999999999996,"15min":0.77400000000000002},"min":{"1min":0.57199999999999995,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.875,"5min":0.98399999999999999,"15min":6.3310000000000004},"last":0.58499999999999996}]},{"osd":3,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71099999999999997,"15min":0.751},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.39500000000000002},"max":{"1min":0.88400000000000001,"5min":0.97699999999999998,"15min":6.2039999999999997},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73099999999999998,"15min":0.69399999999999995},"min":{"1min":0.53300000000000003,"5min":0.51400000000000001,"15min":0.44},"max":{"1min":0.91000000000000003,"5min":1.048,"15min":1.048},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.622,"15min":0.63700000000000001},"min":{"1min":0.41099999999999998,"5min":0.379,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.85199999999999998,"15min":0.97199999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67400000000000004,"15min":0.68400000000000005},"min":{"1min":0.499,"5min":0.45700000000000002,"15min":0.38400000000000001},"max":{"1min":0.88100000000000001,"5min":0.88800000000000001,"15min":0.96399999999999997},"last":0.51800000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57399999999999995,"15min":0.59899999999999998},"min":{"1min":0.436,"5min":0.372,"15min":0.36399999999999999},"max":{"1min":0.78000000000000003,"5min":0.871,"15min":1.5509999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.626,"15min":0.63200000000000001},"min":{"1min":0.46700000000000003,"5min":0.38,"15min":0.38},"max":{"1min":0.79200000000000004,"5min":0.88400000000000001,"15min":1.403},"last":0.79200000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:47:43 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66100000000000003,"15min":0.67700000000000005},"min":{"1min":0.48399999999999999,"5min":0.438,"15min":0.41099999999999998},"max":{"1min":0.88600000000000001,"5min":0.90700000000000003,"15min":1.6040000000000001},"last":0.623},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.71099999999999997,"15min":0.70699999999999996},"min":{"1min":0.56899999999999995,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.90000000000000002,"5min":0.93300000000000005,"15min":1.0580000000000001},"last":0.83499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.70399999999999996,"15min":0.68700000000000006},"min":{"1min":0.47399999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92900000000000005,"5min":0.98899999999999999,"15min":2.0579999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.67500000000000004},"min":{"1min":0.57199999999999995,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.82699999999999996,"5min":1.014,"15min":2.3399999999999999},"last":0.72099999999999997}]},{"osd":1,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71099999999999997,"15min":0.69399999999999995},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.40400000000000003},"max":{"1min":0.84999999999999998,"5min":0.94899999999999995,"15min":1.48},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.42799999999999999},"max":{"1min":0.876,"5min":0.97599999999999998,"15min":2.8180000000000001},"last":0.61799999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71699999999999997,"15min":0.71299999999999997},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.373},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":3.706},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.48699999999999999,"15min":0.41899999999999998},"max":{"1min":0.88600000000000001,"5min":1.036,"15min":3.742},"last":0.59899999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.40799999999999997},"max":{"1min":0.82699999999999996,"5min":1.085,"15min":3.6909999999999998},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72099999999999997,"15min":0.70299999999999996},"min":{"1min":0.57999999999999996,"5min":0.42499999999999999,"15min":0.40799999999999997},"max":{"1min":0.88500000000000001,"5min":0.996,"15min":2.1379999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.59199999999999997,"15min":0.61299999999999999},"min":{"1min":0.42899999999999999,"5min":0.36499999999999999,"15min":0.32200000000000001},"max":{"1min":0.87,"5min":0.91700000000000004,"15min":1.9970000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61699999999999999,"15min":0.623},"min":{"1min":0.42999999999999999,"5min":0.42599999999999999,"15min":0.37},"max":{"1min":0.81499999999999995,"5min":0.94799999999999995,"15min":4.4569999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.68100000000000005,"15min":0.74099999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.44400000000000001},"max":{"1min":0.91800000000000004,"5min":0.93700000000000006,"15min":8.5519999999999996},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.67900000000000005,"15min":0.70099999999999996},"min":{"1min":0.46899999999999997,"5min":0.42199999999999999,"15min":0.36399999999999999},"max":{"1min":0.90800000000000003,"5min":0.97099999999999997,"15min":3.7989999999999999},"last":0.51400000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:47:56 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.63400000000000001,"15min":0.63900000000000001},"min":{"1min":0.45500000000000002,"5min":0.379,"15min":0.34499999999999997},"max":{"1min":0.81699999999999995,"5min":0.94599999999999995,"15min":5.5069999999999997},"last":0.629},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.74199999999999999,"15min":0.73399999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.44800000000000001},"max":{"1min":0.90200000000000002,"5min":0.97699999999999998,"15min":4.5259999999999998},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.441,"15min":0.437},"min":{"1min":0.28799999999999998,"5min":0.27300000000000002,"15min":0.23699999999999999},"max":{"1min":0.71299999999999997,"5min":0.76800000000000002,"15min":0.83799999999999997},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47599999999999998,"15min":0.45800000000000002},"min":{"1min":0.371,"5min":0.25900000000000001,"15min":0.248},"max":{"1min":0.627,"5min":0.79400000000000004,"15min":0.90400000000000003},"last":0.38800000000000001}]},{"osd":1,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.49299999999999999,"15min":0.59399999999999997},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.26800000000000002},"max":{"1min":0.64800000000000002,"5min":0.74099999999999999,"15min":8.1059999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.28299999999999997},"max":{"1min":0.68600000000000005,"5min":0.81399999999999995,"15min":4.8310000000000004},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.54100000000000004,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.38600000000000001,"15min":0.34499999999999997},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":4.7919999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.58799999999999997},"min":{"1min":0.38400000000000001,"5min":0.34300000000000003,"15min":0.314},"max":{"1min":0.68200000000000005,"5min":0.83499999999999996,"15min":7.798},"last":0.51400000000000001}]},{"osd":4,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.75800000000000001,"15min":0.77800000000000002},"min":{"1min":0.51900000000000002,"5min":0.501,"15min":0.49099999999999999},"max":{"1min":1,"5min":1.028,"15min":3.093},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.54000000000000004,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.999,"5min":1.0389999999999999,"15min":1.4039999999999999},"last":0.60999999999999999}]},{"osd":5,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.78600000000000003},"min":{"1min":0.57699999999999996,"5min":0.56799999999999995,"15min":0.48999999999999999},"max":{"1min":0.92700000000000005,"5min":1.0700000000000001,"15min":3.0299999999999998},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.73699999999999999},"min":{"1min":0.60199999999999998,"5min":0.51800000000000002,"15min":0.45900000000000002},"max":{"1min":0.94799999999999995,"5min":1.2,"15min":1.2},"last":0.66900000000000004}]},{"osd":6,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76800000000000002,"15min":0.85399999999999998},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51600000000000001},"max":{"1min":0.98199999999999998,"5min":1.0700000000000001,"15min":7.9199999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.75800000000000001,"15min":0.81399999999999995},"min":{"1min":0.51800000000000002,"5min":0.505,"15min":0.46800000000000003},"max":{"1min":0.96599999999999997,"5min":1.105,"15min":8.0519999999999996},"last":0.73299999999999998}]},{"osd":7,"last update":"Fri Sep 13 18:47:59 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76700000000000002,"15min":0.74399999999999999},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.0209999999999999,"5min":1.1559999999999999,"15min":1.206},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81699999999999995},"min":{"1min":0.59399999999999997,"5min":0.57999999999999996,"15min":0.53300000000000003},"max":{"1min":0.98599999999999999,"5min":2.4729999999999999,"15min":2.9900000000000002},"last":0.69899999999999995}]}]},{"osd":2,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.40699999999999997,"15min":0.41699999999999998},"min":{"1min":0.28599999999999998,"5min":0.26000000000000001,"15min":0.21299999999999999},"max":{"1min":0.56100000000000005,"5min":0.67700000000000005,"15min":1.2390000000000001},"last":0.438},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.45800000000000002,"15min":0.45400000000000001},"min":{"1min":0.28299999999999997,"5min":0.28199999999999997,"15min":0.253},"max":{"1min":0.624,"5min":0.73199999999999998,"15min":0.93200000000000005},"last":0.52300000000000002}]},{"osd":1,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.499,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.31900000000000001},"max":{"1min":0.58299999999999996,"5min":0.70899999999999996,"15min":0.77400000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.46100000000000002,"15min":0.46400000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26100000000000001},"max":{"1min":0.59999999999999998,"5min":0.68000000000000005,"15min":1.3300000000000001},"last":0.48699999999999999}]},{"osd":3,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.504},"min":{"1min":0.41299999999999998,"5min":0.316,"15min":0.30499999999999999},"max":{"1min":0.69899999999999995,"5min":0.71899999999999997,"15min":1.5009999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59499999999999997,"15min":0.57699999999999996},"min":{"1min":0.45500000000000002,"5min":0.39800000000000002,"15min":0.34499999999999997},"max":{"1min":0.73899999999999999,"5min":0.78200000000000003,"15min":1.7030000000000001},"last":0.60099999999999998}]},{"osd":4,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76900000000000002,"15min":0.73599999999999999},"min":{"1min":0.54400000000000004,"5min":0.51900000000000002,"15min":0.46899999999999997},"max":{"1min":3.222,"5min":3.222,"15min":3.222},"last":0.629},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.747,"15min":0.72099999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.92300000000000004,"5min":1.111,"15min":1.111},"last":0.749}]},{"osd":5,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.79400000000000004,"15min":0.77800000000000002},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.47299999999999998},"max":{"1min":1.016,"5min":1.327,"15min":1.423},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.78000000000000003,"15min":0.753},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.008,"5min":1.095,"15min":1.6200000000000001},"last":0.72799999999999998}]},{"osd":6,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.75900000000000001,"15min":0.73999999999999999},"min":{"1min":0.52800000000000002,"5min":0.51700000000000002,"15min":0.45800000000000002},"max":{"1min":0.95099999999999996,"5min":1.266,"15min":1.329},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.74399999999999999,"15min":0.72299999999999998},"min":{"1min":0.53300000000000003,"5min":0.504,"15min":0.46200000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.6220000000000001},"last":0.63500000000000001}]},{"osd":7,"last update":"Fri Sep 13 18:48:02 2024","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.81499999999999995,"15min":0.77000000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":3.2789999999999999,"5min":3.2789999999999999,"15min":3.2789999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.81000000000000005,"15min":0.79100000000000004},"min":{"1min":0.57899999999999996,"5min":0.54700000000000004,"15min":0.502},"max":{"1min":1.0509999999999999,"5min":1.198,"15min":1.508},"last":0.71399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1703,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193608,"statfs":{"total":200000000,"available":198255558,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.39900000000000002,"5min":0.42399999999999999,"15min":0.435},"min":{"1min":0.28999999999999998,"5min":0.26400000000000001,"15min":0.23999999999999999},"max":{"1min":0.57699999999999996,"5min":0.64700000000000002,"15min":1.6000000000000001},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.47799999999999998,"15min":0.47999999999999998},"min":{"1min":0.311,"5min":0.311,"15min":0.26400000000000001},"max":{"1min":0.68300000000000005,"5min":0.69899999999999995,"15min":0.91000000000000003},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44400000000000001,"15min":0.45200000000000001},"min":{"1min":0.34300000000000003,"5min":0.316,"15min":0.27000000000000002},"max":{"1min":0.55400000000000005,"5min":0.628,"15min":1.036},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51500000000000001,"15min":0.5},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.27900000000000003},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.85399999999999998},"last":0.54900000000000004}]},{"osd":3,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55200000000000005,"15min":0.53700000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.502,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.29499999999999998},"max":{"1min":0.60599999999999998,"5min":0.65100000000000002,"15min":1.1870000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.79200000000000004,"15min":0.77600000000000002},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.46800000000000003},"max":{"1min":1.006,"5min":1.1699999999999999,"15min":1.2010000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.745,"5min":0.76500000000000001,"15min":0.76400000000000001},"min":{"1min":0.52900000000000003,"5min":0.52200000000000002,"15min":0.45500000000000002},"max":{"1min":0.98799999999999999,"5min":1.139,"15min":1.3029999999999999},"last":0.72299999999999998}]},{"osd":5,"last update":"Fri Sep 13 18:48:07 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.74299999999999999,"15min":0.74199999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.42599999999999999},"max":{"1min":0.97699999999999998,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.72299999999999998,"15min":0.72099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.41899999999999998},"max":{"1min":0.874,"5min":0.96499999999999997,"15min":1.242},"last":0.83099999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.77600000000000002,"15min":0.77900000000000003},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.53200000000000003},"max":{"1min":1.018,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.79000000000000004,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.56999999999999995,"15min":0.46600000000000003},"max":{"1min":0.94899999999999995,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:47:47 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.76800000000000002,"15min":0.75600000000000001},"min":{"1min":0.52900000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.244,"15min":1.244},"last":0.878},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.5},"max":{"1min":0.88300000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1127,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194185,"statfs":{"total":200000000,"available":198845926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.42399999999999999,"15min":0.44},"min":{"1min":0.25,"5min":0.20999999999999999,"15min":0.20999999999999999},"max":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":1.669},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.45300000000000001},"min":{"1min":0.29899999999999999,"5min":0.28499999999999998,"15min":0.24099999999999999},"max":{"1min":0.65300000000000002,"5min":0.78200000000000003,"15min":0.874},"last":0.377}]},{"osd":2,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.499,"15min":0.496},"min":{"1min":0.32500000000000001,"5min":0.32100000000000001,"15min":0.28000000000000003},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":1.591},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.51800000000000002,"15min":0.496},"min":{"1min":0.375,"5min":0.32700000000000001,"15min":0.32000000000000001},"max":{"1min":0.72699999999999998,"5min":0.80600000000000005,"15min":0.88800000000000001},"last":0.41499999999999998}]},{"osd":3,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48299999999999998,"15min":0.46999999999999997},"min":{"1min":0.316,"5min":0.28999999999999998,"15min":0.251},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":1.03},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54800000000000004,"15min":0.53600000000000003},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.315},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.637},"last":0.43099999999999999}]},{"osd":4,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.75,"15min":0.72199999999999998},"min":{"1min":0.53600000000000003,"5min":0.504,"15min":0.45200000000000001},"max":{"1min":1.149,"5min":1.21,"15min":1.21},"last":0.502},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.74299999999999999,"15min":0.71999999999999997},"min":{"1min":0.58699999999999997,"5min":0.46899999999999997,"15min":0.45300000000000001},"max":{"1min":1.01,"5min":1.056,"15min":1.698},"last":0.52100000000000002}]},{"osd":5,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.80900000000000005,"15min":0.77300000000000002},"min":{"1min":0.58999999999999997,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0109999999999999,"5min":1.1830000000000001,"15min":1.204},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.78900000000000003,"15min":0.77600000000000002},"min":{"1min":0.628,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1419999999999999,"5min":1.2430000000000001,"15min":2.2589999999999999},"last":0.69999999999999996}]},{"osd":6,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77000000000000002,"15min":0.753},"min":{"1min":0.57999999999999996,"5min":0.48599999999999999,"15min":0.47299999999999998},"max":{"1min":1.071,"5min":1.3009999999999999,"15min":2.3010000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77900000000000003,"15min":0.74199999999999999},"min":{"1min":0.56100000000000005,"5min":0.51300000000000001,"15min":0.48999999999999999},"max":{"1min":1.0349999999999999,"5min":1.236,"15min":1.236},"last":0.54600000000000004}]},{"osd":7,"last update":"Fri Sep 13 18:47:53 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.76700000000000002,"15min":0.753},"min":{"1min":0.56799999999999995,"5min":0.53500000000000003,"15min":0.45700000000000002},"max":{"1min":0.99099999999999999,"5min":1.165,"15min":2.3399999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78000000000000003,"15min":0.73499999999999999},"min":{"1min":0.57799999999999996,"5min":0.52700000000000002,"15min":0.45900000000000002},"max":{"1min":1.1020000000000001,"5min":1.135,"15min":1.1830000000000001},"last":0.624}]}]}],"pool_statfs":[]}} 2024-09-13T18:48:29.340 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-13T18:48:29.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.485+0000 7fb4dc800640 1 Processor -- start 2024-09-13T18:48:29.488 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.485+0000 7fb4dc800640 1 -- start start 2024-09-13T18:48:29.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.486+0000 7fb4dc800640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4d41434c0 0x7fb4d406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.486+0000 7fb4dc800640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7fb4d40b3da0 0x7fb4d406e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.486+0000 7fb4dc800640 1 -- --> v1:172.21.15.194:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4d406b480 con 0x7fb4d406a8b0 2024-09-13T18:48:29.489 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.486+0000 7fb4dc800640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d40ce770 con 0x7fb4d41434c0 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.486+0000 7fb4dc800640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d406b760 con 0x7fb4d40b3da0 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4d41434c0 0x7fb4d406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7fb4d41434c0 0x7fb4d406c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39260/0 (socket says 172.21.15.192:39260) 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 -- 172.21.15.192:0/1550170703 learned_addr learned my addr 172.21.15.192:0/1550170703 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4da800640 1 --2- 172.21.15.192:0/1550170703 >> v2:172.21.15.194:3300/0 conn(0x7fb4d40b3da0 0x7fb4d406e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 -- 172.21.15.192:0/1550170703 >> v2:172.21.15.194:3300/0 conn(0x7fb4d40b3da0 msgr2=0x7fb4d406e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.490 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 --2- 172.21.15.192:0/1550170703 >> v2:172.21.15.194:3300/0 conn(0x7fb4d40b3da0 0x7fb4d406e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 -- 172.21.15.192:0/1550170703 >> v1:172.21.15.194:6789/0 conn(0x7fb4d406a8b0 legacy=0x7fb4d40b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.487+0000 7fb4d9e00640 1 -- 172.21.15.192:0/1550170703 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d406ba40 con 0x7fb4d41434c0 2024-09-13T18:48:29.491 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.488+0000 7fb4d9e00640 1 --2- 172.21.15.192:0/1550170703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d41434c0 0x7fb4d406c800 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40cdd20 tx=0x7fb4c802a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad43e198d2134025 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.488+0000 7fb4d8a00640 1 -- 172.21.15.192:0/1550170703 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4d41434c0 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.488+0000 7fb4d8a00640 1 -- 172.21.15.192:0/1550170703 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c80325a0 con 0x7fb4d41434c0 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.488+0000 7fb4d8a00640 1 -- 172.21.15.192:0/1550170703 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032930 con 0x7fb4d41434c0 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 -- 172.21.15.192:0/1550170703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d41434c0 msgr2=0x7fb4d406c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 --2- 172.21.15.192:0/1550170703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d41434c0 0x7fb4d406c800 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7fb4d40cdd20 tx=0x7fb4c802a200 comp rx=0 tx=0).stop 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 -- 172.21.15.192:0/1550170703 shutdown_connections 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 --2- 172.21.15.192:0/1550170703 >> v2:172.21.15.194:3300/0 conn(0x7fb4d40b3da0 0x7fb4d406e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 --2- 172.21.15.192:0/1550170703 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d41434c0 0x7fb4d406c800 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 -- 172.21.15.192:0/1550170703 >> 172.21.15.192:0/1550170703 conn(0x7fb4d40b08f0 msgr2=0x7fb4d40b0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.492 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 -- 172.21.15.192:0/1550170703 shutdown_connections 2024-09-13T18:48:29.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.489+0000 7fb4dc800640 1 -- 172.21.15.192:0/1550170703 wait complete. 2024-09-13T18:48:29.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.491+0000 7fb4dc800640 1 Processor -- start 2024-09-13T18:48:29.493 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.491+0000 7fb4dc800640 1 -- start start 2024-09-13T18:48:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.491+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.495 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 0x7fb4d415b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4dc800640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4d41434c0 0x7fb4d414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4dc800640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d413f7f0 con 0x7fb4d406a8b0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4dc800640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d414af70 con 0x7fb4d41434c0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4dc800640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d413fa40 con 0x7fb4d40b3da0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39274/0 (socket says 172.21.15.192:39274) 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 -- 172.21.15.192:0/3212311142 learned_addr learned my addr 172.21.15.192:0/3212311142 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4da800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4d41434c0 0x7fb4d414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9400640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 0x7fb4d415b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 -- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 msgr2=0x7fb4d415b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 0x7fb4d415b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.496 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 -- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4d41434c0 msgr2=0x7fb4d414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4d41434c0 0x7fb4d414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9e00640 1 -- 172.21.15.192:0/3212311142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c80094d0 con 0x7fb4d406a8b0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.492+0000 7fb4d9400640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 0x7fb4d415b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4d9e00640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb4c802a240 tx=0x7fb4c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8032440 con 0x7fb4d406a8b0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c8030b80 con 0x7fb4d406a8b0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d413fd20 con 0x7fb4d406a8b0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c803d440 con 0x7fb4d406a8b0 2024-09-13T18:48:29.497 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.493+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d4156400 con 0x7fb4d406a8b0 2024-09-13T18:48:29.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.494+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d40cc7d0 con 0x7fb4d406a8b0 2024-09-13T18:48:29.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.495+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7fb4c8039040 con 0x7fb4d406a8b0 2024-09-13T18:48:29.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.495+0000 7fb4ce000640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 0x7fb4b806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.496+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb4c80a9ab0 con 0x7fb4d406a8b0 2024-09-13T18:48:29.498 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.496+0000 7fb4d9400640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 0x7fb4b806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.499 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.496+0000 7fb4d9400640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 0x7fb4b806d0c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4156ba0 tx=0x7fb4c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.502 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.500+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7fb4c8075020 con 0x7fb4d406a8b0 2024-09-13T18:48:29.671 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.669+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb4d415c5d0 con 0x7fb4d406a8b0 2024-09-13T18:48:29.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.673+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb4c8075020 con 0x7fb4d406a8b0 2024-09-13T18:48:29.676 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.673+0000 7fb4ce000640 1 -- 172.21.15.192:0/3212311142 <== mon.0 v2:172.21.15.192:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb4c8078640 con 0x7fb4d406a8b0 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 msgr2=0x7fb4b806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 0x7fb4b806d0c0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb4d4156ba0 tx=0x7fb4c4009040 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 msgr2=0x7fb4d415aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fb4c802a240 tx=0x7fb4c80046c0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 shutdown_connections 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7fb4b806ac00 0x7fb4b806d0c0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7fb4d41434c0 0x7fb4d414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7fb4d40b3da0 0x7fb4d415b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 --2- 172.21.15.192:0/3212311142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4d406a8b0 0x7fb4d415aad0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.676+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 >> 172.21.15.192:0/3212311142 conn(0x7fb4d40b08f0 msgr2=0x7fb4d406c650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.680 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.677+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 shutdown_connections 2024-09-13T18:48:29.681 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.677+0000 7fb4dc800640 1 -- 172.21.15.192:0/3212311142 wait complete. 2024-09-13T18:48:29.695 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-13T18:48:29.695 DEBUG:teuthology.orchestra.run.smithi192:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-13T18:48:29.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.844+0000 7f936f000640 1 Processor -- start 2024-09-13T18:48:29.847 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.845+0000 7f936f000640 1 -- start start 2024-09-13T18:48:29.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f936815a9e0 0x7f936806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.849 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 --2- >> v2:172.21.15.194:3300/0 conn(0x7f936806b3d0 0x7f93680cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93680cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 -- --> v2:172.21.15.192:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93680b3730 con 0x7f936815a9e0 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 -- --> v2:172.21.15.194:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f936806c5d0 con 0x7f936806b3d0 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93680b3920 con 0x7f936806e990 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f936815a9e0 0x7f936806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936dc00640 1 --2- >> v2:172.21.15.192:3300/0 conn(0x7f936815a9e0 0x7f936806ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39290/0 (socket says 172.21.15.192:39290) 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936dc00640 1 -- 172.21.15.192:0/1688509654 learned_addr learned my addr 172.21.15.192:0/1688509654 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936e600640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93680cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.846+0000 7f936d200640 1 --2- 172.21.15.192:0/1688509654 >> v2:172.21.15.194:3300/0 conn(0x7f936806b3d0 0x7f93680cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.847+0000 7f936dc00640 1 -- 172.21.15.192:0/1688509654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 msgr2=0x7f93680cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.847+0000 7f936dc00640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93680cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.850 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.847+0000 7f936dc00640 1 -- 172.21.15.192:0/1688509654 >> v2:172.21.15.194:3300/0 conn(0x7f936806b3d0 msgr2=0x7f93680cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-13T18:48:29.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.847+0000 7f936dc00640 1 --2- 172.21.15.192:0/1688509654 >> v2:172.21.15.194:3300/0 conn(0x7f936806b3d0 0x7f93680cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.851 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.847+0000 7f936dc00640 1 -- 172.21.15.192:0/1688509654 --> v2:172.21.15.192:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93680b3c00 con 0x7f936815a9e0 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f936dc00640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f936806ae90 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f936806b7b0 tx=0x7f935c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cb492c9337b407 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f9367e00640 1 -- 172.21.15.192:0/1688509654 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c032440 con 0x7f936815a9e0 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f9367e00640 1 -- 172.21.15.192:0/1688509654 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f935c0325a0 con 0x7f936815a9e0 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f9367e00640 1 -- 172.21.15.192:0/1688509654 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c032950 con 0x7f936815a9e0 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f936f000640 1 -- 172.21.15.192:0/1688509654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 msgr2=0x7f936806ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.848+0000 7f936f000640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f936806ae90 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f936806b7b0 tx=0x7f935c02a1e0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.852 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 -- 172.21.15.192:0/1688509654 shutdown_connections 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93680cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 --2- 172.21.15.192:0/1688509654 >> v2:172.21.15.194:3300/0 conn(0x7f936806b3d0 0x7f93680cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 --2- 172.21.15.192:0/1688509654 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f936806ae90 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 -- 172.21.15.192:0/1688509654 >> 172.21.15.192:0/1688509654 conn(0x7f93680736d0 msgr2=0x7f93680b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 -- 172.21.15.192:0/1688509654 shutdown_connections 2024-09-13T18:48:29.853 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.849+0000 7f936f000640 1 -- 172.21.15.192:0/1688509654 wait complete. 2024-09-13T18:48:29.855 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.850+0000 7f936f000640 1 Processor -- start 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.850+0000 7f936f000640 1 -- start start 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 --2- >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f936806b3d0 0x7f936814d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 --2- >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93681433b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936815beb0 con 0x7f936815a9e0 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 -- --> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93681438f0 con 0x7f936806b3d0 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936f000640 1 -- --> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f936815c120 con 0x7f936806e990 2024-09-13T18:48:29.856 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936e600640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:39294/0 (socket says 172.21.15.192:39294) 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.851+0000 7f936e600640 1 -- 172.21.15.192:0/1350516884 learned_addr learned my addr 172.21.15.192:0/1350516884 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936d200640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93681433b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936dc00640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f936806b3d0 0x7f936814d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 -- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 msgr2=0x7f93681433b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93681433b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 -- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f936806b3d0 msgr2=0x7f936814d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f936806b3d0 0x7f936814d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 -- 172.21.15.192:0/1350516884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935c0094d0 con 0x7f936815a9e0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936e600640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9360007e70 tx=0x7f936000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360014620 con 0x7f936815a9e0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f93600147a0 con 0x7f936815a9e0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360014b70 con 0x7f936815a9e0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.852+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93680ccbb0 con 0x7f936815a9e0 2024-09-13T18:48:29.858 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.853+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93680cd170 con 0x7f936815a9e0 2024-09-13T18:48:29.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.854+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f936815c2d0 con 0x7f936815a9e0 2024-09-13T18:48:29.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.855+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 5) v1 ==== 89145+0+0 (secure 0 0 0) 0x7f9360014cd0 con 0x7f936815a9e0 2024-09-13T18:48:29.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.855+0000 7f9365600640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 0x7f934806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T18:48:29.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.856+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9360089820 con 0x7f936815a9e0 2024-09-13T18:48:29.859 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.856+0000 7f936dc00640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 0x7f934806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T18:48:29.860 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.857+0000 7f936dc00640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 0x7f934806d0c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f935c034000 tx=0x7f935c02e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T18:48:29.863 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:29.860+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182695 (secure 0 0 0) 0x7f9360054e40 con 0x7f936815a9e0 2024-09-13T18:48:30.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.058+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93680ce6c0 con 0x7f936815a9e0 2024-09-13T18:48:30.061 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.059+0000 7f9365600640 1 -- 172.21.15.192:0/1350516884 <== mon.0 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3538 (secure 0 0 0) 0x7f9360058460 con 0x7f936815a9e0 2024-09-13T18:48:30.062 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-13T18:48:30.062 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6835/1030150100","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6832","nonce":1030150100},{"type":"v1","addr":"172.21.15.194:6835","nonce":1030150100}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":8997,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6836/270996449","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6834","nonce":270996449},{"type":"v1","addr":"172.21.15.192:6836","nonce":270996449}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9000,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6837/2692277275","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6835","nonce":2692277275},{"type":"v1","addr":"172.21.15.192:6837","nonce":2692277275}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":81},{"gid":9381,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.194:6834/2484639155","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.194:6833","nonce":2484639155},{"type":"v1","addr":"172.21.15.194:6834","nonce":2484639155}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2024-09-13T18:48:30.062 INFO:teuthology.orchestra.run.smithi192.stderr:dumped fsmap epoch 87 2024-09-13T18:48:30.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 msgr2=0x7f934806d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 0x7f934806d0c0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f935c034000 tx=0x7f935c02e000 comp rx=0 tx=0).stop 2024-09-13T18:48:30.064 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 msgr2=0x7f93680cc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f9360007e70 tx=0x7f936000e4b0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 shutdown_connections 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:6832/2095686379,v1:172.21.15.192:6833/2095686379] conn(0x7f934806ac00 0x7f934806d0c0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936815a9e0 0x7f93680cc2f0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3301/0,v1:172.21.15.194:6790/0] conn(0x7f936806e990 0x7f93681433b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 --2- 172.21.15.192:0/1350516884 >> [v2:172.21.15.194:3300/0,v1:172.21.15.194:6789/0] conn(0x7f936806b3d0 0x7f936814d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 >> 172.21.15.192:0/1350516884 conn(0x7f93680736d0 msgr2=0x7f936806ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 shutdown_connections 2024-09-13T18:48:30.065 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-13T18:48:30.061+0000 7f936f000640 1 -- 172.21.15.192:0/1350516884 wait complete. 2024-09-13T18:48:30.079 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-13T18:48:30.080 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-13T18:48:30.080 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-13T18:48:30.080 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.095 INFO:tasks.ceph.mds.a:Stopped 2024-09-13T18:48:30.095 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-13T18:48:30.095 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.149 INFO:tasks.ceph.mds.c:Stopped 2024-09-13T18:48:30.149 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-13T18:48:30.149 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.166 INFO:tasks.ceph.mds.b:Stopped 2024-09-13T18:48:30.166 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-13T18:48:30.167 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.223 INFO:tasks.ceph.mds.d:Stopped 2024-09-13T18:48:30.223 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-13T18:48:30.223 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-13T18:48:30.223 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.273 INFO:tasks.ceph.osd.0:Stopped 2024-09-13T18:48:30.273 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-13T18:48:30.274 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.331 INFO:tasks.ceph.osd.1:Stopped 2024-09-13T18:48:30.331 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-13T18:48:30.331 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.385 INFO:tasks.ceph.osd.2:Stopped 2024-09-13T18:48:30.386 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-13T18:48:30.386 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.433 INFO:tasks.ceph.osd.3:Stopped 2024-09-13T18:48:30.433 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-13T18:48:30.433 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.477 INFO:tasks.ceph.osd.4:Stopped 2024-09-13T18:48:30.477 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-13T18:48:30.477 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.529 INFO:tasks.ceph.osd.5:Stopped 2024-09-13T18:48:30.529 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-13T18:48:30.530 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.595 INFO:tasks.ceph.osd.6:Stopped 2024-09-13T18:48:30.596 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-13T18:48:30.596 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.653 INFO:tasks.ceph.osd.7:Stopped 2024-09-13T18:48:30.654 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-13T18:48:30.654 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-13T18:48:30.654 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.722 INFO:tasks.ceph.mgr.y:Stopped 2024-09-13T18:48:30.722 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-13T18:48:30.722 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.783 INFO:tasks.ceph.mgr.x:Stopped 2024-09-13T18:48:30.784 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-13T18:48:30.784 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-13T18:48:30.784 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.805 INFO:tasks.ceph.mon.a:Stopped 2024-09-13T18:48:30.805 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-13T18:48:30.806 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.823 INFO:tasks.ceph.mon.b:Stopped 2024-09-13T18:48:30.823 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-13T18:48:30.824 INFO:teuthology.orchestra.run:waiting for 300 2024-09-13T18:48:30.882 INFO:tasks.ceph.mon.c:Stopped 2024-09-13T18:48:30.882 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-13T18:48:30.883 DEBUG:teuthology.orchestra.run.smithi192:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-13T18:48:30.965 INFO:teuthology.orchestra.run.smithi192.stdout:2024-09-13T18:35:27.039521+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 137251.503865 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2024-09-13T18:48:30.966 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-09-13T18:48:30.966 DEBUG:teuthology.orchestra.run.smithi192:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-13T18:48:31.048 DEBUG:teuthology.orchestra.run.smithi192:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-13T18:48:31.131 DEBUG:teuthology.orchestra.run.smithi192:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2024-09-13T18:48:31.214 INFO:teuthology.orchestra.run.smithi192.stdout:2024-09-13T18:35:27.039521+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 137251.503865 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2024-09-13T18:48:31.215 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:31.215 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-13T18:48:31.514 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:31.515 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-13T18:48:31.668 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:31.668 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-13T18:48:31.769 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:31.770 DEBUG:teuthology.orchestra.run.smithi192:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-13T18:48:31.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:31.905 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-13T18:48:32.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:32.238 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-13T18:48:32.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:32.361 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-13T18:48:32.468 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:32.468 DEBUG:teuthology.orchestra.run.smithi194:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-13T18:48:32.637 INFO:tasks.ceph:Archiving mon data... 2024-09-13T18:48:32.639 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/data/mon.a.tgz 2024-09-13T18:48:32.639 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-13T18:48:32.676 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.p3SQt47Lbr 2024-09-13T18:48:32.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.p3SQt47Lbr 2024-09-13T18:48:32.892 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.p3SQt47Lbr 2024-09-13T18:48:32.986 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.p3SQt47Lbr is 424KB 2024-09-13T18:48:33.076 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.p3SQt47Lbr 2024-09-13T18:48:33.110 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/data/mon.b.tgz 2024-09-13T18:48:33.111 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-13T18:48:33.147 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.Zizztm6epg 2024-09-13T18:48:33.147 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.Zizztm6epg 2024-09-13T18:48:33.339 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.Zizztm6epg 2024-09-13T18:48:33.432 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.Zizztm6epg is 429KB 2024-09-13T18:48:33.521 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.Zizztm6epg 2024-09-13T18:48:33.556 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/data/mon.c.tgz 2024-09-13T18:48:33.556 DEBUG:teuthology.orchestra.run.smithi194:> mktemp 2024-09-13T18:48:33.630 INFO:teuthology.orchestra.run.smithi194.stdout:/tmp/tmp.dAfQ604wbM 2024-09-13T18:48:33.631 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.dAfQ604wbM 2024-09-13T18:48:33.809 DEBUG:teuthology.orchestra.run.smithi194:> sudo chmod 0666 /tmp/tmp.dAfQ604wbM 2024-09-13T18:48:33.902 DEBUG:teuthology.orchestra.remote:smithi194:/tmp/tmp.dAfQ604wbM is 429KB 2024-09-13T18:48:33.991 DEBUG:teuthology.orchestra.run.smithi194:> rm -fr /tmp/tmp.dAfQ604wbM 2024-09-13T18:48:34.026 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-13T18:48:34.026 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:48:34.031 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-13T18:48:34.121 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-09-13T18:48:34.121 DEBUG:teuthology.orchestra.run.smithi192:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:48:34.126 DEBUG:teuthology.orchestra.run.smithi194:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-09-13T18:48:34.186 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:48:34.186 INFO:teuthology.orchestra.run.smithi194.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-09-13T18:48:34.197 INFO:tasks.ceph:Archiving crash dumps... 2024-09-13T18:48:34.200 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi192/crash 2024-09-13T18:48:34.201 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:48:34.255 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi194/crash 2024-09-13T18:48:34.257 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-13T18:48:34.311 INFO:tasks.ceph:Shutting down logrotate 2024-09-13T18:48:34.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:34.316 DEBUG:teuthology.orchestra.run.smithi194:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:34.423 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:34.478 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-13T18:48:34.533 INFO:tasks.ceph:Compressing logs... 2024-09-13T18:48:34.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:48:34.537 DEBUG:teuthology.orchestra.run.smithi194:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:48:40.074 INFO:tasks.ceph:Archiving logs... 2024-09-13T18:48:40.074 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi192/log 2024-09-13T18:48:40.075 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:48:41.335 DEBUG:teuthology.misc:Transferring archived files from smithi194:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi194/log 2024-09-13T18:48:41.336 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T18:48:41.910 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T18:48:41.919 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T18:48:41.919 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:48:41.923 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T18:48:42.064 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T18:48:42.074 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T18:48:42.075 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:48:42.079 DEBUG:teuthology.orchestra.run.smithi194:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T18:48:42.109 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:48:42.112 INFO:teuthology.orchestra.run.smithi194.stderr:bash: line 1: ntpq: command not found 2024-09-13T18:48:42.115 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:48:42.115 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-13T18:48:42.115 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 10 -1125us[-1112us] +/- 66ms 2024-09-13T18:48:42.115 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 8 +3232us[+3232us] +/- 57ms 2024-09-13T18:48:42.115 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 11 -1314us[-1300us] +/- 69ms 2024-09-13T18:48:42.116 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:=============================================================================== 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 -1476us[-1156us] +/- 66ms 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 10 +2890us[+3210us] +/- 57ms 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -1689us[-1369us] +/- 69ms 2024-09-13T18:48:42.119 INFO:teuthology.orchestra.run.smithi194.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T18:48:42.120 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T18:48:42.129 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T18:48:42.129 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T18:48:42.138 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:48:42.295 DEBUG:teuthology.orchestra.run.smithi194:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T18:48:42.412 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:48:42.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:42.474 DEBUG:teuthology.orchestra.run.smithi194:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T18:48:42.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:42.535 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T18:48:42.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T18:48:42.554 INFO:teuthology.task.internal:Duration was 1204.449816 seconds 2024-09-13T18:48:42.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T18:48:42.563 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T18:48:42.563 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:48:42.567 DEBUG:teuthology.orchestra.run.smithi194:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T18:48:42.651 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:48:42.654 INFO:teuthology.orchestra.run.smithi194.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T18:48:43.062 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T18:48:43.062 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-13T18:48:43.062 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:48:43.113 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi194.front.sepia.ceph.com 2024-09-13T18:48:43.113 DEBUG:teuthology.orchestra.run.smithi194:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T18:48:43.163 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T18:48:43.163 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:48:43.168 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T18:48:43.226 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T18:48:43.226 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:48:43.230 DEBUG:teuthology.orchestra.run.smithi194:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T18:48:43.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T18:48:43.413 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T18:48:43.413 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:48:43.469 DEBUG:teuthology.orchestra.run.smithi194:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T18:48:43.526 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T18:48:43.536 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:48:43.541 DEBUG:teuthology.orchestra.run.smithi194:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:48:43.607 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-13T18:48:43.610 INFO:teuthology.orchestra.run.smithi194.stdout:kernel.core_pattern = core 2024-09-13T18:48:43.640 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:48:43.673 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:43.674 DEBUG:teuthology.orchestra.run.smithi194:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T18:48:43.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T18:48:43.707 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T18:48:43.717 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T18:48:43.718 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi192 2024-09-13T18:48:43.718 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:48:43.784 DEBUG:teuthology.misc:Transferring archived files from smithi194:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-09-13_14:42:16-fs-wip-rishabh-testing-20240910.100730-reef-distro-default-smithi/7903991/remote/smithi194 2024-09-13T18:48:43.784 DEBUG:teuthology.orchestra.run.smithi194:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T18:48:43.848 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T18:48:43.848 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:48:43.852 DEBUG:teuthology.orchestra.run.smithi194:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T18:48:43.887 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T18:48:43.898 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T18:48:43.899 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T18:48:43.910 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T18:48:43.911 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:48:43.928 DEBUG:teuthology.orchestra.run.smithi194:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T18:48:43.959 INFO:teuthology.orchestra.run.smithi192.stdout: 393730 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:48 /home/ubuntu/cephtest 2024-09-13T18:48:43.962 INFO:teuthology.orchestra.run.smithi194.stdout: 393253 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 18:48 /home/ubuntu/cephtest 2024-09-13T18:48:43.965 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T18:48:43.976 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T18:48:44.005 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v2 tasks/mds-full} duration: 1204.4498162269592 failure_reason: '"2024-09-13T18:35:27.039521+0000 osd.6 (osd.6) 3 : cluster [WRN] OSD bench result of 137251.503865 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.6. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_rishabh@teuthology success: false 2024-09-13T18:48:44.005 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T18:48:44.140 INFO:teuthology.run:FAIL